Goodhart's Law
top of page

Goodhart's Law


Goodhart's Law states that when a measure becomes a target it ceases to be a good measure. Keep in mind that his can be a concern in electronic discovery. Maura Grossman and Gordon Cormack (authors of the famous TAR glossary, see the night of June 3, 2015) published a paper in The Federal Courts Law Review, entitled, "Comments on “The Implications of Rule 26(g) on the Use of Technology-Assisted Review”. This paper criticizes a study on TAR by Karl Schieneman and Thomas Gricks that specifies that enough random sampling must be conducted in order estimate precision and recall within a margin of error of plus or minus 5 per cent. Grossman and Cormack submit that the goal of TAR is always to identify as much responsive ESI as possible for a proportionate cost and that statistics about precision and recall are just measures of success in getting to that goal. They assert that TAR directed by sampling specifications reflect the problem stated in Goodhart's Law. 2014 Fed. Cts. L. Rev. 285, 287.

Sean O'Shea has more than 20 years of experience in the litigation support field with major law firms in New York and San Francisco.   He is an ACEDS Certified eDiscovery Specialist and a Relativity Certified Administrator.

The views expressed in this blog are those of the owner and do not reflect the views or opinions of the owner’s employer.

If you have a question or comment about this blog, please make a submission using the form to the right. 

Your details were sent successfully!

© 2015 by Sean O'Shea . Proudly created with Wix.com

bottom of page