1 2 3 4 UNITED STATES DISTRICT COURT 5 NORTHERN DISTRICT OF CALIFORNIA 6 7 FEDERAL TRADE COMMISSION, et al., Case No. 25-cv-03477-JST (TSH)
8 Plaintiffs, DISCOVERY ORDER 9 v. Re: Dkt. No. 243 10 UBER TECHNOLOGIES, INC., et al., 11 Defendants.
12 13 The Court held a hearing today concerning the parties’ discovery status report at ECF No. 14 243. This order follows. 15 A. Request for Production 11 16 The FTC’s RFP 11 sought “All video recordings, Including compilations of video 17 recordings, of consumers or individuals interacting with the Uber One Enrollment or Cancellation 18 Process.” The FTC requests a July 6, 2026 deadline for Uber to complete its production in 19 response to this RFP, and Uber agrees to that date. Accordingly, the Court ORDERS Uber to 20 complete its production in response to RFP 11 by July 6. 21 B. Requests for Production 33(c) and (d) 22 On March 11, 2026, the Court ordered Uber to complete its non-custodial production in 23 response to RFPs 33(c) and (d) within 45 days. ECF No. 150. Because the 45th day was a 24 Saturday, that means Uber’s deadline was April 27, 2026. In the status report, the FTC requested 25 that the Court order Uber to confirm whether it produced all non-custodial documents in response 26 to RFPs 33(c) and (d), and Uber confirmed that it did by the April 27 deadline. There was further 27 discussion of this matter at the hearing. At this time, there is no dispute for the Court to resolve. 1 C. Privilege Logs 2 Uber proposes a July 24, 2026 deadline for Uber’s first privilege log (expected to include 3 approximately half of the documents) and a July 31, 2026 deadline for Uber’s final log (to include 4 the remaining privileged custodial documents). The FTC asks the Court to enter Uber’s proposal. 5 Accordingly, the Court SO ORDERS. 6 D. Requests for Production 8 and 10 (Enrollment and Cancellation Flows from Foreign Jurisdictions) 7 8 There was discussion at the hearing about the fact that Uber did not produce the entry 9 points for the five foreign jurisdictions. Uber argued that it considers the entry points to be 10 different from the enrollment flows. From a business perspective, that could be true. However, 11 the FTC defined “enrollment” and “enrollment process” in its RFPs to include “all immediately 12 preceding or immediately subsequent steps that form part of that process, flow, or experience 13 (such as any elements that could influence the customer’s behavior during, or understanding of, 14 the process, flow, or experience).” The Court thinks that definition includes the entry points. 15 Accordingly, the Court ORDERS Uber to produce the entry points for the five foreign 16 jurisdictions. The Court ORDERS Uber to complete that document production within three 17 weeks. 18 E. Uber’s TAR Protocol 19 The FTC says that Uber made its first custodial document production of about 18,000 20 documents and represented that its production is 25% complete. The FTC extrapolates from this 21 that Uber will likely produce around 72,000 custodial documents. The FTC thinks “[t]his is a 22 shockingly low figure,” which means there is a problem with Uber’s TAR protocol. Uber says the 23 FTC’s math is wrong because its 25% estimate excluded Slack materials, and that the more likely 24 end result is a production of around 156,000 documents. 25 The FTC has two requests. First, it asks the Court to change the recall rate for Uber’s TAR 26 protocol from 75% to 85%. Second, it asks the Court to order Uber to produce a random sample 27 of the training documents marked non-responsive. 1 custodial document production. ECF No. 233. Changing the recall rate 11 days before the 2 production deadline is not practical or feasible. ECF No. 243-1 (Supplemental Declaration of Jeff 3 Grobart ¶¶ 8-10). 4 The FTC’s second request, however, has merit. Sometimes when parties use TAR they 5 exchange training sets, so each side can see what the other is calling responsive. And then when 6 they’ve completed production, they exchange validation information to show they’ve met the 7 agreed upon metrics. When that happens, the parties can then bring to the Court any disputes 8 about responsiveness. Here, that kind of transparency does not exist. Uber’s document reviewers 9 train the TAR model with their responsiveness calls, but the FTC does not see what those calls are. 10 Allowing the FTC to review a random sample of the training documents that Uber’s document 11 reviewers marked as non-responsive would let the FTC see if the model is being trained 12 improperly, and if it is, the Court could order Uber to retrain it. 13 Both sides cite Winfield v. City of New York, 2017 WL 5664852 (S.D.N.Y. Nov. 27, 2017). 14 The FTC cites it in support of its request for a random sample of non-responsive training 15 documents so it can determine if the TAR model has been appropriately trained. Uber cites the 16 same case for the proposition that courts have held that documents used to train a TAR model are 17 work product. 18 Winfield similarly dealt with an objection to how the defendant was coding documents as 19 responsive or non-responsive for purposes of training its TAR model. In that case, the Court 20 found “that Plaintiffs have presented sufficient evidence to justify their request for sample sets of 21 non-privileged documents from the documents pulled from the 50 custodians.” It then ordered the 22 defendant “to provide to Plaintiffs a sample of 300 non-privileged documents in total from the 23 HPD custodians and the Mayor's Office. These documents should be randomly pulled from the 24 corpus of non-responsive documents.” Id. The Court further ordered the defendant to “provide 25 Plaintiffs with a random sample of 100 non-privileged, non-responsive documents in total from 26 the DCP/Banks review population.” Id. Thus, the case cited by Uber ordered the relief the FTC 27 seeks here. Winfield does not stand for the proposition that the training documents coded as non- 1 Also, think about Uber’s work product argument for a moment. If the non-responsive 2 documents are work product because producing them would reveal counsel’s thought processes, 3 then the responsive documents would also be work product for the same reason. Under Uber’s 4 reasoning, every document review should result in no documents being produced. That doesn’t 5 make any sense. 6 Further, aside from its work product argument, Uber argues that it is not standard practice 7 to exchange documents used to train a TAR model. But in reality, “where the parties do not agree 8 to transparency, the decisions are split and the debate in the discovery literature is robust.” Rio 9 Tinto PLC v. Vale, S.A., 306 F.R.D. 125, 128 (S.D.N.Y. March 2, 2015); see also Winfield, 2017 10 WL 5664852 at *10 (“Courts are split as to the degree of transparency required by the producing 11 party as to its predictive coding process.”). 12 Here, the parties disagree on whether Uber’s 10% responsiveness rate means the search 13 terms are broad (Uber’s view) or Uber’s responsiveness calls are too narrow (FTC’s view). There 14 is no real way to answer that question without data. Accordingly, it is appropriate to require Uber 15 to produce a random sample of 300 documents that were marked as non-responsive to allow the 16 FTC to test Uber’s responsiveness calls. 17 At the hearing, there was discussion about the denominator from which the 300 documents 18 should be drawn. Uber suggested it should be the output of the TAR model rather than the coding 19 decisions that were the input. Also, if it is the training documents, there needs to be some 20 specification of which training documents, as continuous active learning means that every day 21 there are more training documents. The FTC requested that the random sample be taken from the 22 initial seed set that was first used to train the model.
Free access — add to your briefcase to read the full text and ask questions with AI
1 2 3 4 UNITED STATES DISTRICT COURT 5 NORTHERN DISTRICT OF CALIFORNIA 6 7 FEDERAL TRADE COMMISSION, et al., Case No. 25-cv-03477-JST (TSH)
8 Plaintiffs, DISCOVERY ORDER 9 v. Re: Dkt. No. 243 10 UBER TECHNOLOGIES, INC., et al., 11 Defendants.
12 13 The Court held a hearing today concerning the parties’ discovery status report at ECF No. 14 243. This order follows. 15 A. Request for Production 11 16 The FTC’s RFP 11 sought “All video recordings, Including compilations of video 17 recordings, of consumers or individuals interacting with the Uber One Enrollment or Cancellation 18 Process.” The FTC requests a July 6, 2026 deadline for Uber to complete its production in 19 response to this RFP, and Uber agrees to that date. Accordingly, the Court ORDERS Uber to 20 complete its production in response to RFP 11 by July 6. 21 B. Requests for Production 33(c) and (d) 22 On March 11, 2026, the Court ordered Uber to complete its non-custodial production in 23 response to RFPs 33(c) and (d) within 45 days. ECF No. 150. Because the 45th day was a 24 Saturday, that means Uber’s deadline was April 27, 2026. In the status report, the FTC requested 25 that the Court order Uber to confirm whether it produced all non-custodial documents in response 26 to RFPs 33(c) and (d), and Uber confirmed that it did by the April 27 deadline. There was further 27 discussion of this matter at the hearing. At this time, there is no dispute for the Court to resolve. 1 C. Privilege Logs 2 Uber proposes a July 24, 2026 deadline for Uber’s first privilege log (expected to include 3 approximately half of the documents) and a July 31, 2026 deadline for Uber’s final log (to include 4 the remaining privileged custodial documents). The FTC asks the Court to enter Uber’s proposal. 5 Accordingly, the Court SO ORDERS. 6 D. Requests for Production 8 and 10 (Enrollment and Cancellation Flows from Foreign Jurisdictions) 7 8 There was discussion at the hearing about the fact that Uber did not produce the entry 9 points for the five foreign jurisdictions. Uber argued that it considers the entry points to be 10 different from the enrollment flows. From a business perspective, that could be true. However, 11 the FTC defined “enrollment” and “enrollment process” in its RFPs to include “all immediately 12 preceding or immediately subsequent steps that form part of that process, flow, or experience 13 (such as any elements that could influence the customer’s behavior during, or understanding of, 14 the process, flow, or experience).” The Court thinks that definition includes the entry points. 15 Accordingly, the Court ORDERS Uber to produce the entry points for the five foreign 16 jurisdictions. The Court ORDERS Uber to complete that document production within three 17 weeks. 18 E. Uber’s TAR Protocol 19 The FTC says that Uber made its first custodial document production of about 18,000 20 documents and represented that its production is 25% complete. The FTC extrapolates from this 21 that Uber will likely produce around 72,000 custodial documents. The FTC thinks “[t]his is a 22 shockingly low figure,” which means there is a problem with Uber’s TAR protocol. Uber says the 23 FTC’s math is wrong because its 25% estimate excluded Slack materials, and that the more likely 24 end result is a production of around 156,000 documents. 25 The FTC has two requests. First, it asks the Court to change the recall rate for Uber’s TAR 26 protocol from 75% to 85%. Second, it asks the Court to order Uber to produce a random sample 27 of the training documents marked non-responsive. 1 custodial document production. ECF No. 233. Changing the recall rate 11 days before the 2 production deadline is not practical or feasible. ECF No. 243-1 (Supplemental Declaration of Jeff 3 Grobart ¶¶ 8-10). 4 The FTC’s second request, however, has merit. Sometimes when parties use TAR they 5 exchange training sets, so each side can see what the other is calling responsive. And then when 6 they’ve completed production, they exchange validation information to show they’ve met the 7 agreed upon metrics. When that happens, the parties can then bring to the Court any disputes 8 about responsiveness. Here, that kind of transparency does not exist. Uber’s document reviewers 9 train the TAR model with their responsiveness calls, but the FTC does not see what those calls are. 10 Allowing the FTC to review a random sample of the training documents that Uber’s document 11 reviewers marked as non-responsive would let the FTC see if the model is being trained 12 improperly, and if it is, the Court could order Uber to retrain it. 13 Both sides cite Winfield v. City of New York, 2017 WL 5664852 (S.D.N.Y. Nov. 27, 2017). 14 The FTC cites it in support of its request for a random sample of non-responsive training 15 documents so it can determine if the TAR model has been appropriately trained. Uber cites the 16 same case for the proposition that courts have held that documents used to train a TAR model are 17 work product. 18 Winfield similarly dealt with an objection to how the defendant was coding documents as 19 responsive or non-responsive for purposes of training its TAR model. In that case, the Court 20 found “that Plaintiffs have presented sufficient evidence to justify their request for sample sets of 21 non-privileged documents from the documents pulled from the 50 custodians.” It then ordered the 22 defendant “to provide to Plaintiffs a sample of 300 non-privileged documents in total from the 23 HPD custodians and the Mayor's Office. These documents should be randomly pulled from the 24 corpus of non-responsive documents.” Id. The Court further ordered the defendant to “provide 25 Plaintiffs with a random sample of 100 non-privileged, non-responsive documents in total from 26 the DCP/Banks review population.” Id. Thus, the case cited by Uber ordered the relief the FTC 27 seeks here. Winfield does not stand for the proposition that the training documents coded as non- 1 Also, think about Uber’s work product argument for a moment. If the non-responsive 2 documents are work product because producing them would reveal counsel’s thought processes, 3 then the responsive documents would also be work product for the same reason. Under Uber’s 4 reasoning, every document review should result in no documents being produced. That doesn’t 5 make any sense. 6 Further, aside from its work product argument, Uber argues that it is not standard practice 7 to exchange documents used to train a TAR model. But in reality, “where the parties do not agree 8 to transparency, the decisions are split and the debate in the discovery literature is robust.” Rio 9 Tinto PLC v. Vale, S.A., 306 F.R.D. 125, 128 (S.D.N.Y. March 2, 2015); see also Winfield, 2017 10 WL 5664852 at *10 (“Courts are split as to the degree of transparency required by the producing 11 party as to its predictive coding process.”). 12 Here, the parties disagree on whether Uber’s 10% responsiveness rate means the search 13 terms are broad (Uber’s view) or Uber’s responsiveness calls are too narrow (FTC’s view). There 14 is no real way to answer that question without data. Accordingly, it is appropriate to require Uber 15 to produce a random sample of 300 documents that were marked as non-responsive to allow the 16 FTC to test Uber’s responsiveness calls. 17 At the hearing, there was discussion about the denominator from which the 300 documents 18 should be drawn. Uber suggested it should be the output of the TAR model rather than the coding 19 decisions that were the input. Also, if it is the training documents, there needs to be some 20 specification of which training documents, as continuous active learning means that every day 21 there are more training documents. The FTC requested that the random sample be taken from the 22 initial seed set that was first used to train the model. The FTC explained that it understands that 23 there were later coding decisions made to further train the model, but it wants to see the initial 24 responsiveness calls to see if there were problems right from the beginning. That sounds like a 25 good idea. The FTC has doubted Uber’s 10% responsiveness rate from the beginning, and that 26 rate has held fairly constant, suggesting that the human reviewers have likely been consistent in 27 their responsiveness calls. An additional benefit to sampling the initial seed set is speed. If the 1 could not be drawn until after custodial document production is completed by July 13. By 2 contrast, Uber represents it can produce a random sample drawn from the initial training set by 3 July 10. 4 Accordingly, the Court ORDERS Uber to produce a random sample of 300 non- 5 privileged, non-responsive documents from the initial seed set no later than July 10, 2026. 6 F. Future Discovery Status Reports 7 For future discovery status reports, the Court ORDERS the moving party to send its 8 portion (including any declarations and exhibits) by 9:00 a.m. Pacific time three days before the 9 deadline, the responding party to send its responses (including any declarations and exhibits) by 10 5:00 p.m. the day before the deadline, and the parties to file the statement by noon on the day of 11 the deadline. 12 G. Interrogatories 9, 10 and 11 13 There does not seem to be a dispute for the Court to rule on concerning Uber’s 14 interrogatories 9-11 to the States because the States have agreed to amend their responses by 15 around July 6, 2026. 16 H. Interrogatory 12 17 Uber and the States have a dispute about interrogatory 12. They cite Alabama’s response 18 as being representative of the States’ responses. Rog 12 asked: “State whether You contend that 19 Uber did not disclose the date on which the following month or year’s Uber One subscription 20 would be charged. If You so contend, Identify all facts in support of your response. If You do not 21 so contend, so state.” Following some objections, “Alabama answers that its allegations do not 22 revolve around Uber’s failure to disclose a billing date. Rather, Alabama alleges that Uber 23 charged consumers up to forty-eight hours before the stated billing date, thereby charging 24 consumers without their express informed consent and causing them to pay additional fees despite 25 the consumers having cancelled their subscriptions before the stated billing date.” 26 The Court agrees with Uber in part and with the States in part. The Court gathers that the 27 true answer to rog 12 is “yes, we contend that,” but the States are concerned that answer could be ] where it told consumers what the billing date is. Accordingly, the Court thinks the States mean to 2 || say something like: “We do not contend that you did not disclose a date on which the following 3 month or year’s Uber One subscription would be charged. However, you actually charged 4 || consumers up to 48 hours before the date you ‘disclosed.’” 5 The problem with the States’ response as currently drafted is that sentence #1 that says 6 || what the States don’t contend uses elliptical and indirect language (“its allegations do not revolve 7 || around”), while sentence #2 is clear on what the States do contend. Uber is entitled to a more 8 direct sentence #1. 9 However, the Court does not agree with Uber that “stated billing date” is vague. An 10 || ordinary reader of the English language would understand this to mean the date that Uber stated it 11 would charge the following month or year’s Uber One subscription. Uber’s rog does not draw a 12 || distinction between the stated date and the actual date, referring generally to the disclosure of “the 13 date” on which the following month or year’s Uber One subscription would be charged. But the 14 States are free to say that there are two dates — the stated one, and the real one. 3 15 Accordingly, Uber’s motion to compel as to rog 12 is GRANTED IN PART and B 16 || DENIED IN PART. 17 I. Next Discovery Hearing 18 The Court SCHEDULES a further discovery status conference for July 24, 2026, at 10:00 19 || a.m. The parties shall file a discovery status report no later than July 17, 2026. 20 IT IS SO ORDERED. 21 2 Dated: July 2, 2026 23 TAA. |} THOMAS S. HIXSON 24 United States Magistrate Judge 25 26 27 28