ARCHIVED CONTENT
You are viewing ARCHIVED CONTENT released online between 1 April 2010 and 24 August 2018 or content that has been selectively archived and is no longer active. Content in this archive is NOT UPDATED, and links may not function.
The Cartoon and Clip of the Week for January 21, 2015
Daily we read, see and hear more and more about the many technology approaches, quality control measures and defensibility risks associated with technology-assisted review. This week’s cartoon and clip highlights the importance of agreement among industry leaders on key technology-assisted review issues (cartoon) and provides a short list of recent articles that advise caution in blindly agreeing with vendor and thought leader assertions (clip).
Three Recent Technology-Assisted Review Articles with Cautionary Exhortations
Provided below is a short list of several recent articles where the authors highlight the importance of carefully considering claims and assertions when evaluating technology-assisted review approaches.
1. Introducing “ei-Recall” – A New Gold Standard for Recall Calculations in Legal Search – Part Three by Ralph Losey
“Be cautious in evaluating any criticisms you may read of ei-Recall from persons with a vested monetary interest in the defense of a competitive formula, especially vendors, or experts hired by vendors. Their views may be colored by their monetary interests. I have no skin in the game.”
2. Every Form of Recall Has Its Price by Herb Roitblat
“We should, be cautious, and even skeptical, however, of claims that any method currently in use suffers from fatal flaws or provides a “gold standard.” That supposed fatal flaw may be more a reflection of ignorance than one of statistical or methodological failure. Gold standards take time to emerge by consensus, they cannot be claimed by fiat.”
3.
“TAR/PC proponents point out that TAR is generally as effective as the “gold standard” of human review in identifying relevant records. However it has at least two soft spots compared to what is achievable with alternative technology: text dependence & document unitization.”
Click here to follow a running list of recent posts on technology-assisted review.
