Instant Apache Hive Essentials How-to

Leverage your knowledge of SQL to easily write distributed data processing applications on Hadoop using Apache Hive

Overview

• Learn something new in an Instant! A short, fast, focused guide delivering immediate results
• Learn to use SQL to write Hadoop jobs
• Add support for data to Hive in your own file formats
• Understand how the Hive query processor works to optimize common queries

In Detail

Hadoop provides a robust framework for building distributed applications, but working directly with Hadoop requires writing a lot of code. Adding structure to data and using a higher-level language such as SQL makes working with Hadoop both easier and faster.

"Instant Apache Hive Essentials How-to" contains a series of practical recipes that introduce the power and flexibility of Hive. Starting with your first query, this book will provide step-by-step instructions and behind-the-scenes explanations for how to effectively write MapReduce jobs with SQL.

This book looks at how Hive transforms SQL statements into MapReduce jobs and demonstrates how you can extend Hive to support your own use cases. Its recipes will teach you how to leverage the scale of Hadoop while retaining the benefits of using a structured query language.You will learn how Hive translates a query into MapReduce jobs and explore how to structure your queries for better performance. You will extend Hive to understand your own file formats, simplifying the loading of data into the warehouse. You will finally add your own custom functions to Hive to support whatever use cases you may have.

"Instant Apache Hive Essentials How-to" is a quick introduction for adding Hive to your data toolkit. It is packed with high-level instructions for making Hive work as well as drawing connections to the underlying Hadoop framework to explain how things happen.

What you will learn from this book

• Start with the basics of loading data and writing your first query
• Use de-normalized data efficiently by manipulating complex data types
• Structure your data and queries to take advantage of Hive’s optimizations
• Bring your own data files to Hive and teach Hive how to understand them
• Access the specialized functions built-in to Hive to manipulate your data
• Use Hive streaming to integrate code written in any language into your queries
• Extend Hive with user-defined functions

Approach

Filled with practical, step-by-step instructions and clear explanations for the most important and useful tasks.This book provides quick recipes for using Hive to read data in various formats, efficiently querying this data, and extending Hive with any custom functions you may need to insert your own logic into the data pipeline.

Who this book is written for

This book is written for data analysts and developers who want to use their current knowledge of SQL to be more productive with Hadoop. It assumes that readers are comfortable writing SQL queries and are familiar with Hadoop at the level of the classic WordCount example.