Extract, Transform, and Load: Searching Blockchain with Google

Google Cloud developer advocate Allen Day and his team of open source developers from around the world are launching a number of tools designed to do to blockchain what Google search did to the internet.

Google’s New Blockchain Search Tools, Broken Down

Extract of an article by Michael del Castillo

Google is now in the blockchain search business. Less than a day after Forbes broke the story that the internet search giant would be launching a suite of tools built by, and for, open source developers, those tools are live.

In addition to loading datasets for all the transactions and metadata in eight cryptocurrencies, including bitcoin and ethereum, Google Cloud developer advocate Allen Day and his team of open source developers from around the world are launching a number of tools designed to do to blockchain, what Google search did to the internet.

“I’m very interested to quantify what’s happening so that we can see where the real legitimate use cases are for blockchain,” said Day, who manages the cloud portion of the project. “So people can acknowledge that and then we can move to the next use case and develop out what these technologies are really appropriate for.”

Last year Day, and lead developer Evegeny Medvedev discreetly loaded transaction data for the bitcoin and ethereum blockchains, along with some basic search tools, to Google’s BigQuery big data analytics platform, and have been studying how developers are using the software. As of today, they’re taking what they’ve learned and making datasets available for bitcoin cash, ethereum classic, litecoin, zcash, dogecoin and dash, along with an expanded suite of search tools.

Dubbed Blockchain ETL (extract, transform, load), the software created by independent developer Medvedev, with support from the rest the team, now includes features such as integration with Google’s BigQuery ML (machine learning) tool, launched into a test, or “beta” version last year. By searching for patterns in transaction flows, the machine learning integration will automatically inform the user basic information about how a cryptocurrency address is being used.

Google Using Big Data to Make Blockchains Searchable

Extract of an article by Emilio Janus

Senior developer advocate for Google Cloud, Allen Day, is anticipating customer demand before products even exist. He thinks accessible blockchain is the next big thing. So he started to feed the entire Bitcoin and Ethereum blockchains in Google’s big data platform, BigQuery.

The next stage was to create a suite of software tools to search the data. The project, known as Blockchain ETL (extract, transform, load), has already proven to be a word of mouth hit.

Previously, searching the blockchain meant using a block-explorer, to retrieve data on a known individual transaction number. Blockchain ETL allows generalized searches of entire blockchains.

Read the complete article at Google Using Big Data to Make Blockchains Searchable

US SEC Seeking Big Data Tool for Major Blockchains

Extract of article by Yogita Khatri

The U.S. Securities and Exchange Commission (SEC) is seeking a tool to provide a Big Data view across major blockchains.

In a solicitation notice published Thursday [January 31], the regulator said it is looking for both small and large businesses who can provide data for the “most widely used” blockchain ledgers based on transaction volume, in order to “monitor risk and improve compliance” related to cryptocurrencies.

The SEC said it requires the data in an “easily reviewable” format, along with an overview of how the information is extracted and converted to ensure “there is no loss in data completeness and accuracy due to the data transformation tools and processes applied.” Notably, the agency is seeking to identify transaction details among “the universe of available information.”

Interested vendors should respond to the SEC by Feb. 14, according to the announcement

Read the complete article at US SEC Seeking Big Data Tool for Major Blockchains

Additional Reading

Source: ComplexDiscovery

WP-Backgrounds Lite by InoPlugs Web Design and Juwelier Schönmann 1010 Wien