Extract, Transform, and Load: Searching Blockchain with Google

Google Cloud developer advocate Allen Day and his team of open source developers from around the world are launching a number of tools designed to do to blockchain what Google search did to the internet.

Google’s New Blockchain Search Tools, Broken Down

Extract of an article by Michael del Castillo

Google is now in the blockchain search business. Less than a day after Forbes broke the story that the internet search giant would be launching a suite of tools built by, and for, open source developers, those tools are live.

In addition to loading datasets for all the transactions and metadata in eight cryptocurrencies, including bitcoin and ethereum, Google Cloud developer advocate Allen Day and his team of open source developers from around the world are launching a number of tools designed to do to blockchain, what Google search did to the internet.

“I’m very interested to quantify what’s happening so that we can see where the real legitimate use cases are for blockchain,” said Day, who manages the cloud portion of the project. “So people can acknowledge that and then we can move to the next use case and develop out what these technologies are really appropriate for.”

Last year Day, and lead developer Evegeny Medvedev discreetly loaded transaction data for the bitcoin and ethereum blockchains, along with some basic search tools, to Google’s BigQuery big data analytics platform, and have been studying how developers are using the software. As of today, they’re taking what they’ve learned and making datasets available for bitcoin cash, ethereum classic, litecoin, zcash, dogecoin and dash, along with an expanded suite of search tools.

Dubbed Blockchain ETL (extract, transform, load), the software created by independent developer Medvedev, with support from the rest the team, now includes features such as integration with Google’s BigQuery ML (machine learning) tool, launched into a test, or “beta” version last year. By searching for patterns in transaction flows, the machine learning integration will automatically inform the user basic information about how a cryptocurrency address is being used.

Google Using Big Data to Make Blockchains Searchable

Extract of an article by Emilio Janus

Senior developer advocate for Google Cloud, Allen Day, is anticipating customer demand before products even exist. He thinks accessible blockchain is the next big thing. So he started to feed the entire Bitcoin and Ethereum blockchains in Google’s big data platform, BigQuery.

The next stage was to create a suite of software tools to search the data. The project, known as Blockchain ETL (extract, transform, load), has already proven to be a word of mouth hit.

Previously, searching the blockchain meant using a block-explorer, to retrieve data on a known individual transaction number. Blockchain ETL allows generalized searches of entire blockchains.

Read the complete article at Google Using Big Data to Make Blockchains Searchable

US SEC Seeking Big Data Tool for Major Blockchains

Extract of article by Yogita Khatri

The U.S. Securities and Exchange Commission (SEC) is seeking a tool to provide a Big Data view across major blockchains.

In a solicitation notice published Thursday [January 31], the regulator said it is looking for both small and large businesses who can provide data for the “most widely used” blockchain ledgers based on transaction volume, in order to “monitor risk and improve compliance” related to cryptocurrencies.

The SEC said it requires the data in an “easily reviewable” format, along with an overview of how the information is extracted and converted to ensure “there is no loss in data completeness and accuracy due to the data transformation tools and processes applied.” Notably, the agency is seeking to identify transaction details among “the universe of available information.”

Interested vendors should respond to the SEC by Feb. 14, according to the announcement

Read the complete article at US SEC Seeking Big Data Tool for Major Blockchains

Additional Reading

Source: ComplexDiscovery

Have a Request?

If you have information or offering requests that you would like to ask us about, please let us know and we will make our response to you a priority.

ComplexDiscovery is an online publication that highlights data and legal discovery insight and intelligence ranging from original research to aggregated news for use by business, information technology, and legal professionals. The highly targeted publication seeks to increase the collective understanding of readers regarding data and legal discovery information and issues and to provide an objective resource for considering trends, technologies, and services related to electronically stored information.

ComplexDiscovery OÜ is a technology marketing firm providing strategic planning and tactical execution expertise in support of data and legal discovery organizations. Registered as a private limited company in the European Union country of Estonia, one of the most digitally advanced countries in the world, ComplexDiscovery OÜ operates virtually worldwide to deliver marketing consulting and services.

A (Brand) New Approach? Considering the Framework and Structure of eDiscovery Offerings

Today’s eDiscovery providers may benefit from the lessons learned in the creation of the Sgt. Pepper’s Lonely Hearts Club Band album by creating a concept for branding and packaging their offerings within that brand in a connected, theme-based way that represents the offerings’ promise and capability in a way that is easy to understand and remember.



Check Out the New Approach Now!

Interested in Contributing?

ComplexDiscovery combines original industry research with curated expert articles to create an informational resource that helps legal, business, and information technology professionals better understand the business and practice of data discovery and legal discovery.

All contributions are invested to support the development and distribution of ComplexDiscovery content. Contributors can make as many article contributions as they like, but will not be asked to register and pay until their contribution reaches $5.

New from NIST: Integrating Cybersecurity and Enterprise Risk Management (ERM)

NIST has released NISTIR 8286, Integrating Cybersecurity and Enterprise Risk Management...

A Cloudy Alliance? A Next-Generation Cloud for Europe

According to Thierry Breton, Commissioner for the Internal Market, "Europe needs...

Five Great Reads on eDiscovery for October 2020

From business confidence and captive ALSPs to digital republics and mass...

A Season of Change? Eighteen Observations on eDiscovery Business Confidence in the Fall of 2020

In the fall of 2020, 77.2% of eDiscovery Business Confidence Survey...

A Running List: Top 100+ eDiscovery Providers

Based on a compilation of research from analyst firms and industry...

The eDisclosure Systems Buyers Guide – 2020 Edition (Andrew Haslam)

Authored by industry expert Andrew Haslam, the eDisclosure Buyers Guide continues...

The Race to the Starting Line? Recent Secure Remote Review Announcements

Not all secure remote review offerings are equal as the apparent...

Enabling Remote eDiscovery? A Snapshot of DaaS

Desktop as a Service (DaaS) providers are becoming important contributors to...

Home or Away? New eDiscovery Collection Market Sizing and Pricing Considerations

One of the key home (onsite) or away (remote) decisions that...

Revisions and Decisions? New Considerations for eDiscovery Secure Remote Reviews

One of the key revision and decision areas that business, legal,...

A Macro Look at Past and Projected eDiscovery Market Size from 2012 to 2024

From a macro look at past estimations of eDiscovery market size...

An eDiscovery Market Size Mashup: 2019-2024 Worldwide Software and Services Overview

While the Compound Annual Growth Rate (CAGR) for worldwide eDiscovery software...

A Season of Change? Eighteen Observations on eDiscovery Business Confidence in the Fall of 2020

In the fall of 2020, 77.2% of eDiscovery Business Confidence Survey...

The Continuing Case of Budgetary Constraints in the Business of eDiscovery

In the fall of 2020, 49.4% of respondents viewed budgetary constraints...

Outstanding Accounts? eDiscovery Operational Metrics in the Fall of 2020

In the fall of 2020, eDiscovery Business Confidence Survey more...

Holding the Rudder? Fall 2020 eDiscovery Business Confidence Survey Results

This is the twentieth quarterly eDiscovery Business Confidence Survey conducted by...

DISCO Raises $60 Million

According to the media release, DISCO will use this investment to...

Rampiva and the RYABI Group Merge

According to today's announcement, the RYABI Group merger is Rampiva's first...

eDiscovery Mergers, Acquisitions, and Investments in Q3 2020

From HaystackID and NightOwl Global to Reveal Data and NexLP, the...

Mitratech Acquires Acuity ELM

According to Mike Williams, CEO of Mitratech, “We came to the...

Five Great Reads on eDiscovery for October 2020

From business confidence and captive ALSPs to digital republics and mass...

Five Great Reads on eDiscovery for September 2020

From cloud forensics and cyber defense to social media and surveys,...

Five Great Reads on eDiscovery for August 2020

From predictive coding and artificial intelligence to antitrust investigations and malware,...

Five Great Reads on eDiscovery for July 2020

From business confidence and operational metrics to data protection and privacy...