S.D.N.Y. TAR Ruling - Winfield v. City of New York
On November 27, 2017, in Winfield v. City of New York, 2017 U.S. Dist. LEXIS 194413 (S.D.N.Y.) Magistrate Judge Katharine Parker of the Southern District of New York ruled that the defendants did not have to disclose information on the TAR system they used for document review, while granting the plaintiffs' request to sample non-responsive documents. The court did review information related to the City’s document ranking system in camera but would not disclose this information to the plaintiffs.
The Court ordered the City to perform a TAR review on the rest of its document set after completing its linear review (run with search terms the parties agreed to only with the help of the Court) on ESI collected from certain custodians. The Court judged that TAR was necessary to hasten the identification, review and production of responsive documents. The City had complained that it cost more than $350,000 to review 100,000 documents using linear review.
In order to support its position that the City's TAR system did not correctly identify responsive documents, the plaintiffs pointed to documents the City produced inadvertently, or produced with redactions which were in fact responsive. "Among these were two electronic documents for which the City only produced a 'slip sheet' because the documents had been designated as non-responsive (the 'slip-sheeted' documents), but where Plaintiffs were nevertheless able to view the 'extracted text' of the documents due to a production error." (Id. at *16). The court ordered briefing and depositions on the defendants' privilege designations, and also requested a log of a sample of 80 privileged documents. After the review of the sample, the City subsequently changed its designation of 36 documents from privileged to responsive.
Nevertheless, the Court found no evidence of gross negligence or unreasonableness in the City's use of its TAR system. It ordered that the City could use this system to run a search using 665 search terms proposed by the plaintiffs. The court stated that a meet and confer and motion for compel would be needed if the City's subsequent review found responsive documents related to primary claims and defenses in a subject area covered by a previous production phase.
The plaintiffs contended that the City over designated documents as non-responsive in the training set used for its TAR system. In holding that the producing party was in the best position to evaluate its methods for producing responsive documents, the Court cited Judge Peck's decision in Hyles v. New York City, and Sedona Principle 6. Judge Parker also noted that attorneys are obligated to comply with FRCP 26 in certifying that a reasonable inquiry was performed when making document productions; the danger of revealing trial strategy and work product; and that perfection is not required in the production of responsive ESI. Judge Parker stated that:
". . . this Court is of the view that there is nothing so exceptional about ESI production that should cause courts to insert themselves as super-managers of the parties' internal review processes, including training of TAR software, or to permit discovery about such process, in the absence of evidence of good cause such as a showing of gross negligence in the review and production process, the failure to produce relevant specific documents known to exist or that are likely to exist, or other malfeasance." [Id. at *29-30]
The Court's in camera review of the TAR system showed that the seed set included more than 7200 documents that were randomly selected and 'pre-coded example' documents. There were five training rounds and a validation process, and the review team received extensive training.
In granting the request for a sample set, the Court cited the need for transparency, the low responsiveness rate in a high volume of ESI, and specific errors in coding identified by the plaintiffs. The sample set is to consist of 400 documents - 300 from one category, and 100 from another.
While the Court did not order disclosure of information on the TAR ranking system, it did encourage the City to share this information with the plaintiffs.