Apache Impala, a native analytics database for Hadoop

The Apache Software Foundation (ASF) has graduated Apache Impala to become a Top-Level Project (TLP).

Apache Impala itself is an analytic database for Apache Hadoop, the open source software framework used for distributed storage and processing of dataset of big data.

This TLP status is intended to signify that the project’s community and products have been well-governed under the ASF’s meritocratic process and principles.

Massively parallel processing

Impala is built with what is known as a massively parallel processing (MPP) SQL query engine. This allows analytical queries on data stored on-premises (in HDFS or Apache Kudu) or in cloud object storage via SQL or business intelligence tools.

“The Impala project has grown a lot since we entered incubation in December 2015,” said Jim Apple, VP of Apache Impala.

In addition to using the same unified storage platform as other Hadoop components, Impala also uses the same metadata, SQL syntax (Apache Hive SQL), ODBC driver and user interface (Impala query UI in Hue) as Hive.

Inspired by Google

Impala was inspired by Google’s F1 database, which also separates query processing from storage management..

“In 2011, we started development of Impala in order to make state-of-the-art SQL analytics available to the user community as open source technology,” said Marcel Kornacker, original founder of the Impala project.

Apache Impala is deployed across a number of industries such as financial services, healthcare and telecommunications — and is in use at companies that include Caterpillar, Cox Automotive and the New York Stock Exchange — in addition, Impala is shipped by Cloudera, MapR and Oracle.