Fri. Mar 29th, 2024

Content Assessment: Cross Platform Email Duplicate Identification Specification Announced by EDRM

Information - 93%
Insight - 94%
Relevance - 95%
Objectivity - 92%
Authority - 93%

93%

Excellent

A short percentage-based assessment of the qualitative benefit of the post highlighting the EDRM announcement of a cross-platform email specification for email duplicate identification.

Editor’s Note: From time to time, ComplexDiscovery highlights publicly available or privately purchasable announcements, content updates, and research from cyber, data, and legal discovery providers, research organizations, and ComplexDiscovery community members. While ComplexDiscovery regularly highlights this information, it does not assume any responsibility for content assertions.

To submit recommendations for consideration and inclusion in ComplexDiscovery’s cyber, data, and legal discovery-centric service, product, or research announcements, contact us today.


Background Note: The Electronic Discovery Reference Model (EDRM) is a framework that helps organizations manage the eDiscovery process, which involves the identification, preservation, collection, review, and production of electronic information for litigation and other legal proceedings. The EDRM Cross-Platform Email Duplicate Identification Specification is a new development in the field of eDiscovery and information management that provides a framework for identifying duplicates across multiple email platforms. The project team has developed the EDRM Email Duplicate Identification Toolkit as a resource to support the implementation of the EDRM Message Identification Hash (MIH) and use of it for cross-platform email duplicate identification. This new approach enables organizations to identify duplicate emails efficiently and effectively in a defensible and cost-effective manner.

This development is important to cybersecurity, information governance, and eDiscovery professionals because it provides a solution to a common challenge in eDiscovery, which is identifying duplicate emails across multiple email platforms. Prior to the development of the MIH hash, there was no economical way to deduplicate across platforms, so parties ended up having to pay for duplicative review and analysis of the same documents. The use of EDRM MIH is expected to lead to significant time and cost benefits, and legal teams can rapidly triage emails already reviewed that also reside in data received from others. This solution is an open-source, collaborative effort of leading companies and technologists backed by the integrity and influence of the EDRM, and it seamlessly integrates with existing tools and workflows.

Press Announcement

EDRM Announces Cross Platform Email Duplicate Identification Specification

Comments from the public are welcomed until March 15, 2023

Setting the global standards for e-discovery, the Electronic Discovery Reference Model (EDRM) today announces the EDRM Cross Platform Email Duplicate Identification Specification.

The EDRM Cross-Platform Email Duplicate Identification Specification is an important development in the field of eDiscovery and information management. This specification provides a framework for identifying duplicates across multiple email platforms, allowing organizations to identify duplicate emails efficiently and effectively in a defensible and cost-effective manner. Currently no means of cross platform email duplicate identification exists, except to reprocess the data using a single vendor platform, often expending significant time and cost.

The solution is a simple, but effective approach which involves the use of the hash value of an email Message ID metadata field which is the EDRM Message Identification Hash (“MIH”). This new approach will not replace current email deduplication methods but will enable cross platform email duplicate identification.

“Our global, multidisciplinary EDRM Committee, comprising legal technologists, forensic professionals, product developers, consultants, c-suite business leaders, data scientists and lawyers, is really excited to bring this solution for email cross platform duplicate identification to the market. We believe it has numerous applications that will save significant time and cost,” said Beth Patterson, director at ESPConnect and project trustee. “We encourage product vendors to implement the generation of the MIH in their products and lawyers, eDiscovery & forensic professionals, service providers, regulators and courts to request the MIH in productions. Like any eDiscovery tool, expertise is required to determine how best to apply the MIH for a particular case.”

The global EDRM Email Duplicate Identification Specification project team has developed the EDRM Email Duplicate Identification Toolkit as a resource to support the implementation of the EDRM MIH and use of it for cross platform email duplicate identification. The Toolkit outlines several considerations which should be taken into account when deciding how to utilize the MIH. We encourage feedback during this 30-day market consultation period.

The project team anticipates that the use of EDRM MIH will lead to significant time and cost benefits. For example, during discovery, disclosure or an investigation, it is often useful to identify duplicate emails in data exchanged between parties. This can deliver many benefits, including the ability for legal teams to rapidly triage emails already reviewed that also reside in data received from others.

“Anyone who has been active in e-discovery for a while has almost certainly run into the situation where they want to de-duplicate data across platforms,” said David Cohen, Chair of the EDRM Project Trustees and Practice Group Leader of Reed Smith’s Records & E-Discovery Practice Group. “For example, that occurs where clients or providers want or need to change processing and review platforms or wish to use multiple tools that have different duplication identification standards. Prior to development of the MIH hash, there was no economical way to deduplicate across platforms, so parties ended up having to pay for duplicative review and analysis of the same documents. Now, thanks to Beth Patterson and her dedicated team, there is a solution that can save parties significant time and money. The whole development team deserves credit, including the volunteers from companies that offer some of the leading platforms that can now implement the MIH hash, like Relativity, Reveal-Brainspace, EDT and Nuix.”

“The strength of the EDRM MIH springs from its simplicity and economy,” said Craig Ball, EDRM General Counsel, Special Master and Texas litigator. “ Pairing decades-old technologies in an innovative way, the EDRM MIH enables cross-platform duplicate identification–an unprecedented, disruptive capability that seamlessly integrates with existing tools and workflows. The EDRM MIH is more than simply a great idea that’s been rigorously developed and tested; it’s an open-source, collaborative effort of leading companies and technologists backed by the integrity and influence of the EDRM. I’m proud to be part of the EDRM MIH development team.”

The project team includes (organizations listed for identification purposes):

• Murali Baddula, Chief Digital Officer, Law In Order (Sydney, Australia)
• Craig Ball, Attorney, Certified Computer Forensic Examiner, Adjunct Professor, University of Texas School of Law (Austin, Texas USA)
• Klaus-Peter Finke-Härkönen, Director Strategic Initiatives, Cyber Diligence LLC, (Syosset NY USA)
• Ian Folkman, Vice President – Forensic Technology at Deloitte Tohmatsu Financial Advisory (Japan)
• Scott Foster, Senior Managing Director at FTI Consulting–Technology Lead (Australia)
• Matthew Golab, Director Legal Informatics and R+D, Gilbert + Tobin (Sydney, Australia)
• Phil Haselden, Technical Fellow, EDT (Australia)
• Greg Houston, Workflow Enablement, Relativity (Chicago, Illinois USA)
• Dr Paul Hunter, Chief Data Scientist, EDT (Australia)
• Dinesh Karamchandani, Senior Data Scientist, Reveal-Brainspace (Chicago, Illinois USA)
• Lisa Kozaris, Chief Innovation & Legal Solutions Officer, Allens (Melbourne, Australia)
• Enzo Lisciotto, Director of Customer Success at Reveal-Brainspace & Co-Membership Director, ACEDS-ANZ (Sydney, Australia)
• James MacGregor, Partner, FORCYD (London, UK)
• Karan Mehta, Head of Legal Technology, Allens (Sydney, Australia)
• Rachi Messing, Co-Founder, Altorney (Israel)
• Elizabeth Miller, Senior Director, Law in Order (Australia)
• Beth Patterson, Director, ESPconnect & Adjunct Professor, University of Technology Sydney Law School (Australia)
• Alexander Poelma, Product Manager Nuix Workstation & Engine, Nuix (California, USA)
• Jo Sherman, CEO & Founder, EDT (Australia/USA)
• Paul Sirkis, Division Director, Regional Head of Litigation, Americas at Macquarie Group (New York, New York USA)
• George Socha, Senior Vice President of Brand Awareness, Reveal-Brainspace (Chicago, Illinois USA)
• Stephen Stewart, CTO, Nuix (Philadelphia, PA USA)
• Gavin Wingfield, Director Applied Legal Technology, King & Wood Mallesons
• Emma Young, Head of eDiscovery Delivery, Sky Discovery (Brisbane, Australia)

Comments from the public are welcomed until March 15, 2023.

About EDRM

Empowering the global leaders of e-discovery, the Electronic Discovery Reference Model (EDRM) creates practical resources to improve e-discovery, privacy, security and information governance. Since 2005, EDRM has delivered leadership, standards, tools and guides to improve best practices throughout the world. EDRM has an international presence in 145 countries, an innovative support infrastructure for individuals, law firms, corporations and government organizations seeking to improve the practice and provision of data and legal discovery.


Additional Reading

Source: ComplexDiscovery

 

Generative Artificial Intelligence and Large Language Model Use

ComplexDiscovery OÜ recognizes the value of GAI and LLM tools in streamlining content creation processes and enhancing the overall quality of its research, writing, and editing efforts. To this end, ComplexDiscovery OÜ regularly employs GAI tools, including ChatGPT, Claude, Midjourney, and DALL-E, to assist, augment, and accelerate the development and publication of both new and revised content in posts and pages published (initiated in late 2022).

ComplexDiscovery also provides a ChatGPT-powered AI article assistant for its users. This feature leverages LLM capabilities to generate relevant and valuable insights related to specific page and post content published on ComplexDiscovery.com. By offering this AI-driven service, ComplexDiscovery OÜ aims to create a more interactive and engaging experience for its users, while highlighting the importance of responsible and ethical use of GAI and LLM technologies.

 

Have a Request?

If you have information or offering requests that you would like to ask us about, please let us know, and we will make our response to you a priority.

ComplexDiscovery OÜ is a highly recognized digital publication focused on providing detailed insights into the fields of cybersecurity, information governance, and eDiscovery. Based in Estonia, a hub for digital innovation, ComplexDiscovery OÜ upholds rigorous standards in journalistic integrity, delivering nuanced analyses of global trends, technology advancements, and the eDiscovery sector. The publication expertly connects intricate legal technology issues with the broader narrative of international business and current events, offering its readership invaluable insights for informed decision-making.

For the latest in law, technology, and business, visit ComplexDiscovery.com.