UNITED STATES DISTRICT COURT FOR THE DISTRICT OF COLUMBIA _______________________________________ ) ) DL, et al., ) Plaintiffs, ) ) v. ) Civil Action No. 05-1437 (RCL) ) DISTRICT OF COLUMBIA, et al., ) Defendants. ) ) _______________________________________)
MEMORANDUM OPINION
Before the Court is Defendants’ Motion [181] to Strike Report and Testimony of Dr.
Leonard Cupingood, Along with All Evidence Based Thereon. Upon consideration of the
motion, plaintiffs’ opposition [184] thereto, defendants’ reply brief [190], and plaintiffs’ sur-
reply brief [191-2], the Court will deny the motion for the reasons set forth below.
I. BACKGROUND
The Court set out the background of this case in its memorandum opinion issued this
same date regarding defendants’ motion for summary judgment and plaintiffs’ motion for partial
summary judgment on liability.
At issue here is the testimony of plaintiffs’ statistical expert, Dr. Leonard A. Cupingood.
Dr. Cupingood reviewed data from two databases, covering the time period of 2000 to 2009, to
assess the number of children in the District ages 3 to 5 “with suspected disabilities who were to
be assessed for their eligibility for special education and related services.” (Bernard R. Siskin
and Leonard A. Cupingood, Statistical Analysis of Timeliness of Assessment of Eligibility for
Special Education Services for Children Aged Three to Five in the District of Columbia Public
1 Schools 2000-2008 (April 2009) (“Cupingood Report”) at 2.) Before beginning his analysis, Dr.
Cupingood “cleaned” the data by, inter alia, “consolidating approximately 130 records having a
complete duplication of all information except for the student ID.” (Cupingood Aff., May 18,
2010 (“Cupingood Aff.”) at ¶ 8.) Dr. Cupingood then analyzed the data, the results of which the
Court relied on in its summary judgment opinion issued this same date.
II. LEGAL STANDARD
The Court may qualify an expert on the basis of his “knowledge, skill, experience,
training, or education.” FED. R. EVID. 702. Plaintiffs have the burden of establishing by a
preponderance of the evidence that the expert is so qualified and that the testimony is admissible.
Meister v. Med. Eng’g Corp., 267 F.3d 1123, 1127 n.9 (D.C. Cir. 2001); FED. R. EVID. 702
advisory committee’s notes to 2000 amend.
The relevant Federal Rules of Evidence governing expert testimony state:
If scientific, technical, or other specialized knowledge will assist the trier of fact to understand the evidence or to determine a fact in issue, a witness qualified as an expert . . . may testify thereto in the form of an opinion or otherwise, if (1) the testimony is based upon sufficient facts or data, (2) the testimony is the product of reliable principles and methods, and (3) the witness has applied the principles and methods reliably to the facts of the case.
FED. R. EVID. 702.
The facts or data in the particular case upon which an expert bases an opinion or inference may be those perceived by or made known to the expert at or before the hearing. If of a type reasonably relied upon by experts in the particular field in forming opinions or inferences upon the subject, the facts or data need not be admissible in evidence in order for the opinion or inference to be admitted. Facts or data that are otherwise inadmissible shall not be disclosed to the jury by the proponent of the opinion or inference unless the court determines that their probative value in assisting the jury to evaluate the expert's opinion substantially outweighs their prejudicial effect.
FED. R. EVID. 703.
III. DISCUSSION
2 As a preliminary matter, plaintiffs argue that the Court may postpone ruling on this
motion until trial. (Pls.’ Opp’n at 14.) The Court, however, relies on Dr. Cupingood’s testimony
in its summary judgment order issued this same date. Accordingly, the Court will rule on the
admissibility of Dr. Cupingood’s opinions now, and it will not wait until any possible trial.
A. QUALIFICATION AS AN EXPERT
First, defendants challenge Dr. Cupingood’s qualification as a “programming or data
expert.” (Defs.’ Mot. at 10; Defs.’ Reply at 3.) Plaintiffs contend that he is such an expert. The
Court agrees with defendants.
The Court may look directly to Dr. Cupingood’s testimony in determining whether the
expert is so qualified, see United States v. Pansier, 576 F.3d 726, 738 (7th Cir. 2009), as well as
other evidence. Dr. Cupingood testified only that he has “more than 35 years of experience with
computers, computer programming and databases.” (Cupingood Aff. at ¶ 13.) He was also a
court-appointed consultant to the U.S. District Court for the Eastern District of Pennsylvania,
where he “advised the court regarding the adequacy of a computer system . . . .” (Pls.’ Ex. K at 2;
Pls.’ Ex. L at 27.) Finally, Dr. Cupingood has been qualified as an expert in other courts to
testify “regarding database construction and programming.” (Cupingood Aff. at ¶ 13.)
Although Dr. Cupingood may in fact be an expert in computer programming, plaintiffs
have not met their burden of establishing his expertise. They have cited sparse evidence of his
experience, and Dr. Cupingood has conclusively stated that he has 35 years experience, without
further explanation of what that experience entails. Accordingly, the Court finds that Dr.
Cupingood is not qualified as an expert in computer programming.
Second, defendants concede that Dr. Cupingood is an expert in statistics. (Defs.’ Mot. at
10 (“Dr. Cupingood is a statistical expert.”); Defs.’ Mot. at 12.) Dr. Cupingood has an extensive
3 resume to support this expertise. Accordingly, the Court finds that Dr. Cupingood is an expert in
statistics.
B. BASIS OF EXPERT OPINION
Defendants challenge the basis upon which Dr. Cupingood formed his expert opinion.
Specifically, defendants allege that:
(1) Dr. Cupingood’s opinions are based upon improperly ‘cleaned,’ and therefore useless, data; (2) Dr. Cupingood is not the author of the report submitted in his name, nor did he perform the calculations described therein; and (3) in any event, the matters on which Dr. Cupingood purports to opine are not properly the subjects of statistical expertise, as the Court is perfectly able to evaluate these data and decide these issues without expert assistance or, at most, with the very limited assistance of a computer-programming expert.
(Defs.’ Mot. at 1.) Defendants further allege in their reply that Dr. Cupingood’s charts and tables
summarizing his calculations are inadmissible. The Court will address these arguments in turn.
1. Dr. Cupingood Did Not Rely on Improperly “Cleaned” Data.
Defendants argue that Dr. Cupingood improperly eliminated potentially duplicate
records, so the data on which he based his opinion was improperly “cleaned.” Plaintiffs argue
that Dr. Cupingood’s decision to eliminate these records was based on generally accepted
statistical methods and did not significantly affect his conclusions. The Court agrees with
plaintiffs.
Dr. Cupingood received extracts from two databases (“ENCORE” and “SEDS”) to
perform his analysis.
Free access — add to your briefcase to read the full text and ask questions with AI
UNITED STATES DISTRICT COURT FOR THE DISTRICT OF COLUMBIA _______________________________________ ) ) DL, et al., ) Plaintiffs, ) ) v. ) Civil Action No. 05-1437 (RCL) ) DISTRICT OF COLUMBIA, et al., ) Defendants. ) ) _______________________________________)
MEMORANDUM OPINION
Before the Court is Defendants’ Motion [181] to Strike Report and Testimony of Dr.
Leonard Cupingood, Along with All Evidence Based Thereon. Upon consideration of the
motion, plaintiffs’ opposition [184] thereto, defendants’ reply brief [190], and plaintiffs’ sur-
reply brief [191-2], the Court will deny the motion for the reasons set forth below.
I. BACKGROUND
The Court set out the background of this case in its memorandum opinion issued this
same date regarding defendants’ motion for summary judgment and plaintiffs’ motion for partial
summary judgment on liability.
At issue here is the testimony of plaintiffs’ statistical expert, Dr. Leonard A. Cupingood.
Dr. Cupingood reviewed data from two databases, covering the time period of 2000 to 2009, to
assess the number of children in the District ages 3 to 5 “with suspected disabilities who were to
be assessed for their eligibility for special education and related services.” (Bernard R. Siskin
and Leonard A. Cupingood, Statistical Analysis of Timeliness of Assessment of Eligibility for
Special Education Services for Children Aged Three to Five in the District of Columbia Public
1 Schools 2000-2008 (April 2009) (“Cupingood Report”) at 2.) Before beginning his analysis, Dr.
Cupingood “cleaned” the data by, inter alia, “consolidating approximately 130 records having a
complete duplication of all information except for the student ID.” (Cupingood Aff., May 18,
2010 (“Cupingood Aff.”) at ¶ 8.) Dr. Cupingood then analyzed the data, the results of which the
Court relied on in its summary judgment opinion issued this same date.
II. LEGAL STANDARD
The Court may qualify an expert on the basis of his “knowledge, skill, experience,
training, or education.” FED. R. EVID. 702. Plaintiffs have the burden of establishing by a
preponderance of the evidence that the expert is so qualified and that the testimony is admissible.
Meister v. Med. Eng’g Corp., 267 F.3d 1123, 1127 n.9 (D.C. Cir. 2001); FED. R. EVID. 702
advisory committee’s notes to 2000 amend.
The relevant Federal Rules of Evidence governing expert testimony state:
If scientific, technical, or other specialized knowledge will assist the trier of fact to understand the evidence or to determine a fact in issue, a witness qualified as an expert . . . may testify thereto in the form of an opinion or otherwise, if (1) the testimony is based upon sufficient facts or data, (2) the testimony is the product of reliable principles and methods, and (3) the witness has applied the principles and methods reliably to the facts of the case.
FED. R. EVID. 702.
The facts or data in the particular case upon which an expert bases an opinion or inference may be those perceived by or made known to the expert at or before the hearing. If of a type reasonably relied upon by experts in the particular field in forming opinions or inferences upon the subject, the facts or data need not be admissible in evidence in order for the opinion or inference to be admitted. Facts or data that are otherwise inadmissible shall not be disclosed to the jury by the proponent of the opinion or inference unless the court determines that their probative value in assisting the jury to evaluate the expert's opinion substantially outweighs their prejudicial effect.
FED. R. EVID. 703.
III. DISCUSSION
2 As a preliminary matter, plaintiffs argue that the Court may postpone ruling on this
motion until trial. (Pls.’ Opp’n at 14.) The Court, however, relies on Dr. Cupingood’s testimony
in its summary judgment order issued this same date. Accordingly, the Court will rule on the
admissibility of Dr. Cupingood’s opinions now, and it will not wait until any possible trial.
A. QUALIFICATION AS AN EXPERT
First, defendants challenge Dr. Cupingood’s qualification as a “programming or data
expert.” (Defs.’ Mot. at 10; Defs.’ Reply at 3.) Plaintiffs contend that he is such an expert. The
Court agrees with defendants.
The Court may look directly to Dr. Cupingood’s testimony in determining whether the
expert is so qualified, see United States v. Pansier, 576 F.3d 726, 738 (7th Cir. 2009), as well as
other evidence. Dr. Cupingood testified only that he has “more than 35 years of experience with
computers, computer programming and databases.” (Cupingood Aff. at ¶ 13.) He was also a
court-appointed consultant to the U.S. District Court for the Eastern District of Pennsylvania,
where he “advised the court regarding the adequacy of a computer system . . . .” (Pls.’ Ex. K at 2;
Pls.’ Ex. L at 27.) Finally, Dr. Cupingood has been qualified as an expert in other courts to
testify “regarding database construction and programming.” (Cupingood Aff. at ¶ 13.)
Although Dr. Cupingood may in fact be an expert in computer programming, plaintiffs
have not met their burden of establishing his expertise. They have cited sparse evidence of his
experience, and Dr. Cupingood has conclusively stated that he has 35 years experience, without
further explanation of what that experience entails. Accordingly, the Court finds that Dr.
Cupingood is not qualified as an expert in computer programming.
Second, defendants concede that Dr. Cupingood is an expert in statistics. (Defs.’ Mot. at
10 (“Dr. Cupingood is a statistical expert.”); Defs.’ Mot. at 12.) Dr. Cupingood has an extensive
3 resume to support this expertise. Accordingly, the Court finds that Dr. Cupingood is an expert in
statistics.
B. BASIS OF EXPERT OPINION
Defendants challenge the basis upon which Dr. Cupingood formed his expert opinion.
Specifically, defendants allege that:
(1) Dr. Cupingood’s opinions are based upon improperly ‘cleaned,’ and therefore useless, data; (2) Dr. Cupingood is not the author of the report submitted in his name, nor did he perform the calculations described therein; and (3) in any event, the matters on which Dr. Cupingood purports to opine are not properly the subjects of statistical expertise, as the Court is perfectly able to evaluate these data and decide these issues without expert assistance or, at most, with the very limited assistance of a computer-programming expert.
(Defs.’ Mot. at 1.) Defendants further allege in their reply that Dr. Cupingood’s charts and tables
summarizing his calculations are inadmissible. The Court will address these arguments in turn.
1. Dr. Cupingood Did Not Rely on Improperly “Cleaned” Data.
Defendants argue that Dr. Cupingood improperly eliminated potentially duplicate
records, so the data on which he based his opinion was improperly “cleaned.” Plaintiffs argue
that Dr. Cupingood’s decision to eliminate these records was based on generally accepted
statistical methods and did not significantly affect his conclusions. The Court agrees with
plaintiffs.
Dr. Cupingood received extracts from two databases (“ENCORE” and “SEDS”) to
perform his analysis. (Cupingood Report at 2.) Of all of the 12,340 entries in these databases,
there were 130 records for which there was “complete duplication of information, as identified
by having the same date of birth, year, referral date, eligibility status, eligibility date, initial IEP
date, notice of placement date, hearing request date, hearing decision dates, services provided
date and services,” and in which the “duplicate records were associated with more than one
student ID.” (Id. at 7.) Dr. Cupingood concluded that “[w]hile it is theoretically possible that
4 such duplicate information could be valid (e.g., identical twins for whom the referral and other
dates were exactly the same), it is unlikely that they would have the exact same services
provided on the same dates.” (Id.) Before reaching this conclusion, Dr. Cupingood asked
plaintiffs’ attorney for his thoughts on the matter, and attorney Alexander Karam responded that
he thought it was more likely that these were duplicate entries than identical twins. (Defs.’ Ex. B;
Defs.’ Ex. A at 109-10.) Because Dr. Cupingood concluded that these were duplicate entries, he
“only counted such student records once, instead of multiple times.” (Cupingood Report at 7.)
Dr. Cupingood stated that these entries were not necessarily duplicates in every instance, but it
was more likely than not that they were mostly duplicates. (Defs.’ Ex. A at 82-83.)
Dr. Cupingood stated that this is a common way for a statistician to ensure the accuracy
of his work: “[P]rior to conducting analyses, a statistician should examine the database provided
for inconsistencies, duplicate information, erroneous data entries, and other situations where the
database (or portions of the database) just do not make sense.” (Cupingood Aff. at ¶ 7.) This is
logical. Based on solely the Court’s common sense, it would appear that, based on the large
amount of duplicative information in these entries, the majority of these entries were in fact
duplicates.
Defendants also argue that Dr. Cupingood relied on a computer programmer named
Bryan Niederberger to assist him with “cleaning” the data. (Defs.’ Mot. at 9.) Even if Dr.
Cupingood relied on Mr. Niederberger to help write computer code and carry out analyses, the
Court finds that such reliance is permissible. An expert may rely on evidence if “of a type
reasonably relied upon” by experts in the field, FED. R. EVID. 703, and this evidence may include
analyses carried out by assistants, McReynolds v. Sodexho Marriott Servs., 349 F. Supp. 2d 30,
36-37 (D.D.C. 2004) (Huvelle, J.).
5 Finally, any statistical error created by any improper “cleaning” is de minimis. There are
only 130 entries in dispute, and Dr. Cupingood analyzed 12,340 entries. (Cupingood Aff. at ¶
14.) Dr. Cupingood calculated that if he were to include the deleted entries in his calculations,
the resulting calculations would be less than 1% different from the calculations provided in his
expert report. (Id. at ¶ 12.) In fact, to the District’s detriment, the resulting calculations would
actually show that the District had a higher rate of failing to provide services than previously
calculated. Any minor change in this statistical calculus would not change the Court’s ruling this
same date as to summary judgment on liability.
2. Dr. Cupingood is the Author of the Report Submitted in His Name.
First, defendants allege that Dr. Cupingood did not write his own expert report. Rather,
they allege that his subordinate, Mr. Niederberger, wrote the report. The only evidence that
defendants cite in support of this claim is an e-mail in which Mr. Niederberger states: “The data
has been cleaned up, but since [Dr. Cupingood’s] name is going on the report, I want to get [his]
approval on the cleaned up data before I produce any numbers.” (Defs.’ Ex. D at 1.) Dr.
Cupingood, however, stated that he, not Mr. Niederberger, wrote his own report. (Pls.’ Ex. I at
52-54.) Mr. Niederberger confirmed this fact, clarifying that he was not authoring the report, but
rather looking for the approval of his supervisor, Dr. Cupingood. (Pls.’ Ex. F at ¶ 4.) The Court
finds this explanation convincing. In forming his statistical expert opinion, Dr. Cupingood may
rely on data provided by a subordinate computer programmer. See McReynolds, 349 F. Supp. 2d
at 36-37; see also FED. R. EVID. 702 (an expert may rely on facts or data “of a type reasonably
relied upon by experts in the particular field in forming opinions or inferences upon the subject”).
Second, defendants allege that someone named “Ihe” was involved in authoring Dr.
Cupingood’s report. In so doing, defendants point to an e-mail in which Mr. Niederberger wrote:
“Once Ihe and I sit down and talk we should be able to get you your answer.” (Defs.’ Ex. D at 1.)
6 Plaintiffs provide the very reasonable explanation that the word “Ihe” in an e-mail was a typo,
and Mr. Niederberger instead meant to write “he.” Dr. Cupingood confirmed this typo in his
affidavit. (Cupingood Aff. at ¶ 4.) This quibble does not require serious debate. The Court agrees
with plaintiffs that the word “Ihe” was a typo, and there was never someone named Ihe involved
in the preparation of the report.
3. Dr. Cupingood’s Testimony Is a Proper Subject of Statistical Expertise.
Defendants claim that Mr. Cupingood’s only contribution was to “count,” which does not
require expertise. Plaintiffs argue that the quantity of data makes counting impractical, if not
impossible, and that the field of statistics includes such counting activity. The Court agrees with
Federal Rule of Evidence 702 governs the question of whether testimony is helpful to the
Court, and thus a proper subject of expert testimony. The Rule states that an expert may use
“scientific, technical, or other specialized knowledge” if it “will assist the trier of fact to
understand the evidence or to determine a fact in issue.” FED. R. EVID. 702. The advisory
committee’s notes to Rule 702 state:
Whether the situation is a proper one for the use of expert testimony is to be determined on the basis of assisting the trier. There is no more certain test for determining when experts may be used than the common sense inquiry whether the untrained layman would be qualified to determine intelligently and to the best possible degree the particular issue without enlightenment from those having a specialized understanding of the subject involved in the dispute. When opinions are excluded, it is because they are unhelpful and therefore superfluous and a waste of time.
FED. R. EVID. 702 advisory committee’s notes (internal citations omitted). Statistics can be a
proper subject of expert testimony when they are helpful in a particular case to a trier of fact. See
Adams v. Ameritech Servs., Inc., 231 F.3d 414 (7th Cir. 2000); City of Tuscaloosa v. Harcros
Chems., Inc., 158 F.3d 548 (11th Cir. 1999).
7 The Court finds that Dr. Cupingood’s testimony is helpful to the Court in understanding
the database at issue. First, the high quantity of data makes counting impractical. The database
consists of 12,340 entries. Although it technically would be feasible for the Court to “count” the
data and reach very elementary statistical conclusions without Dr. Cupingood’s expertise, this
would be a waste of time and possibly would lead to unfounded conclusions. Dr. Cupingood’s
testimony is very helpful to the Court in distilling conclusions from this large set of data. Second,
the field of statistics includes this “counting” activity. A statistician’s purpose is to “count” by
sorting through raw data and putting it in a more digestible format. He can present statistical
conclusions that are not evident on the face of the data.
4. Defendants’ Argument that Dr. Cupingood’s Tables and Charts Are Not Admissible is Moot.
Plaintiffs argue that “if the Court decides not to rule on the admissibility of Dr.
Cupingood’s opinions as expert testimony at this time, it can still consider Dr. Cupingood’s
summary charts and tables.” (Pls.’ Opp’n at 15.) Because the Court will rule on the admissibility
of the testimony now, this argument is moot.
IV. CONCLUSION
Accordingly, the Court will grant in part and deny in part defendants’ motion. The Court
will order that Dr. Leonard Cupingood is qualified as an expert in statistics, but he is not
qualified as an expert in computer programming. The Court will order that Dr. Cupingood’s
testimony is admissible.
A separate Order consistent with this Memorandum Opinion shall issue this date.
Signed by Royce C. Lamberth, Chief Judge, on August 10, 2010.