Hive Configuration Over Hadoop Platform

The Apache Hive data warehouse software facilitates querying and managing large data sets residing in distributed storage. Hive provides a mechanism to project structure onto this data and query the data using a SQL-like language called HiveQL. At the same time this language also allows traditional map/reduce programmers to plug in their custom mappers and reducers when it is inconvenient or inefficient to express this logic in HiveQL.

So, today we will look into the installation and configuration of Hive. And we will explore the advantages of SQL-like queries over the Hadoop platform.

Pre-requisites:

• To install Hive, make sure you have the Hadoop instances are running on your clusters. If not, get it done first!!

• Download hive from Hive downloads

Steps to configure Hive:

• First, extract the hive-<version>.gz file.

• Now, go to Hive directory:

  cd path/to/hive

• Now run following commands one by one:

  export HIVE_HOME={{pwd}}

  export PATH=$HIVE_HOME/bin:$PATH

  export HADOOP_HOME=/path/to/hadoop/

• Now, create /tmp and /user/hive/warehouse directory at the HDFS location.

  For that, go to Hadoop directory:

  cd path/to/hadoop/

• And, run the following commands:

  bin/hadoop fs -mkdir /tmp

  bin/hadoop fs -mkdir /user/hive/warehouse

  bin/hadoop fs -chmod g+w /tmp

  bin/hadoop fs -chmod g+w /user/hive/warehouse

• Now, set the Hive home:

export HIVE_HOME=/path/to/hive

Congratulations, you are done with the configuration..!!

To start hive go to Hive home:

cd /path/to/hive

• And run the command:

bin/hive

Hive will be started, If this article helps do share your feedback below

Add Comment

* Required information

Comment

1000

Upload

Drag & drop images (max 3)

Rating

Name

Email

Website

Town

Country

State

Question

Enter the word shark backwards.

Answer

Captcha

Notify me of new comments via email

Remember my form inputs on this computer

I have read and understand the privacy policy

I have read and agree to the terms and conditions

Powered by Commentics

x

Insert Bullet List

Please enter at least one item.

Item:

Item:

Item:

Item:

Item:

x

Insert Numeric List

Please enter at least one item.

Item:

Item:

Item:

Item:

Item:

x

Insert Link

Please enter the link of the website

Optionally you can add display text

x

Insert Email

Please enter the email address

Optionally add any display text

x

Insert Image

Please enter the link of the image

x

Insert YouTube Video

Please enter the link of the video

x

Image Upload

x

Privacy Policy

This policy contains information about your privacy. By posting, you are declaring that you understand this policy:

• Your name, rating, website address, town, country, state and comment will be publicly displayed if entered.
• Aside from the data entered into these form fields, other stored data about your comment will include:
  • Your IP address (not displayed)
  • The time/date of your submission (displayed)
• Your email address will not be shared. It is collected for only two reasons:
  • Administrative purposes, should a need to contact you arise.
  • To inform you of new comments, should you subscribe to receive notifications.
• A cookie may be set on your computer. This is used to remember your inputs. It will expire by itself.

This policy is subject to change at any time and without notice.

x

Terms and Conditions

These terms and conditions contain rules about posting comments. By submitting a comment, you are declaring that you agree with these rules:

• Although the administrator will attempt to moderate comments, it is impossible for every comment to have been moderated at any given time.
• You acknowledge that all comments express the views and opinions of the original author and not those of the administrator.
• You agree not to post any material which is knowingly false, obscene, hateful, threatening, harassing or invasive of a person's privacy.
• The administrator has the right to edit, move or remove any comment for any reason and without notice.

Failure to comply with these rules may result in being banned from submitting further comments.

These terms and conditions are subject to change at any time and without notice.

Comments

No comments yet. Be the first!

x