SQL on Hadoop

What Does SQL on Hadoop Mean?

SQL on Hadoop is a type of analytical application tool — the SQL implementation on the Hadoop platform, which combines standard SQL-style querying of structured data with the Hadoop data framework. Hadoop is a relatively new platform, as is big data itself, and not many professionals are experts in it, but SQL on Hadoop simplifies access to the Hadoop framework and makes it easier to implement on current enterprise systems.


Techopedia Explains SQL on Hadoop

SQL on Hadoop refers to various implementations of SQL for the Hadoop platform. MapReduce, which is Hadoop’s cluster job mapper and result organizer, supports SQL as a major use-case as well as other processing methods. Therefore, it makes sense to create powerful tools for allowing SQL, which is one of the most widely used languages for database query and manipulation. As Hadoop gains popularity for enterprise data architecture, SQL is key for proper adoption for both loosely-structured data and structured data used in Hadoop.

SQL on Hadoop key drivers include:

  • Leveraging existing SQL skills present in most organizations
  • Reusing extract transform load (ETL), business intelligence (BI) and analytics infrastructure investments in Hadoop

Some SQL on Hadoop implementations include:

  • Apache Spark SQL
  • Apache Hive
  • Apache Tajo
  • Apache Drill
  • HP Vertica on MapR
  • ODBC Drivers
  • Presto
  • Shark

Related Terms

Margaret Rouse
Technology Expert

Margaret is an award-winning technical writer and teacher known for her ability to explain complex technical subjects to a non-technical business audience. Over the past twenty years, her IT definitions have been published by Que in an encyclopedia of technology terms and cited in articles by the New York Times, Time Magazine, USA Today, ZDNet, PC Magazine, and Discovery Magazine. She joined Techopedia in 2011. Margaret's idea of a fun day is helping IT and business professionals learn to speak each other’s highly specialized languages.