SlideShare uma empresa Scribd logo
1 de 4
Baixar para ler offline
RHive tutorial – Installing Hive
As an add-on to Hadoop, Hive cannot run independent of Hadoop.
This tutorial explains how additionally configure Hive to the Hadoop
environment made in the Hadoop setup tutorial.

Hive does not need to be installed for all servers where Hadoop is installed.
It is just needed for the server where Hadoop client will run.
Here, Hive will be installed in Hadoop namenode for convenience in setup.

Downloading Hive

Because Hive is written in Java just like Hadoop is, downloading the file and
decompressing it alone constitutes the entire setup procedure.

A stable version of Hive can be found in the URL below.

http://www.apache.org/dist//hive/hive-0.7.1/hive-0.7.1-bin.tar.gz

The latest stable version at the point of this tutorial’s creation is 0.7.1; it is
alright to build a separate snapshot version and use that instead.
If version 0.8x is released, it’s okay to use that.

Like the following, connect to the target server for Hive installation and
download the final version of Hive.

ssh	
  root@10.1.1.1	
  
mkdir	
  hive_stable	
  
cd	
  hive_stable	
  
wget	
   http://www.apache.org/dist//hive/hive-­‐0.7.1/hive-­‐0.7.1-­‐
bin.tar.gz	
  
tar	
  xvfz	
  ./hive-­‐0.7.1-­‐bin.tar.gz	
  
mkdir	
  /service	
  
mv	
  ./hive-­‐0.7.1-­‐bin	
  /service	
  

Configuring MySQL

We will be choosing and using MySQL for Hive’s repository.
Hive uses SQLite by default, but if you want to enable multiple users to use
Hive simultaneously, you need to be able to use MySQL or other DBs as
repositories.
Hence this tutorial will be using MySQL.
MySQL can be installed in a server apart from the one where Hive will be
installed, but this tutorial will install MySQL along where, Hadoop namenode is
installed (that is, where Hive is installed).

Use yum like the following to install mysql client and server

yum	
  install	
  mysql	
  mysql-­‐server	
  

After installation, start mysql server.

/etc/init.d/mysqld	
  start	
  

Now create a database in MySQL for Hive to use.
This tutorial will use the name “metastore” for that database.

Go into mysql and create a database like shown.

mysql>	
  CREATE	
  DATABASE	
  metastore;	
  
mysql>	
  USE	
  metastore;	
  
mysql>	
                 SOURCE	
                      /service/hive-­‐
0.7.1/scripts/metastore/upgrade/mysql/hive-­‐schema-­‐
0.7.0.mysql.sql;	
  

Here, “/service/hive-0.7.1" is Hive’s HOME directory, and
"$HIVE_HOME/scripts/metastore/upgrade/mysql" contains SQL files that can
set MySQL up for Hive or upgrade Hive database (which exists in MySQL
database). Select and run the ones suited to your version and complete setup.

Now create a MySQL user which Hive will use, and grant it the privilege to
access the database, “metastore”.

mysql>	
  CREATE	
  USER	
  'hiveuser'@'%'	
  IDENTIFIED	
  BY	
  'password';	
  
mysql>	
   GRANT	
   SELECT,INSERT,UPDATE,DELETE	
   ON	
   metastore.*	
   TO	
  
'hiveuser'@'%';	
  
mysql>	
  REVOKE	
  ALTER,CREATE	
  ON	
  metastore.*	
  FROM	
  'hiveuser'@'%';	
  

Configuring MySQL for Hive use is complete.
Now you need to configure Hive to enable it to connect to MySQL.
JDBC is required for allowing connecting to MySQL from Hive but JDBC is not
included in MySQL.
You must manually download it from the MySQL site and copy it into the
installed Hive.

JDBC is available for download from here:
http://dev.mysql.com/downloads/

As shown below, download and decompress it, then copy the jar file to
Hadoop’s lib directory.

$	
   curl	
   http://dev.mysql.com/get/Downloads/Connector-­‐J/mysql-­‐
connector-­‐java-­‐
5.1.18.tar.gz/from/http://mirror.services.wisc.edu/mysql/	
  
$	
  tar	
  xvfz	
  mysql-­‐connector-­‐java-­‐5.1.18.tar.gz	
  
$	
   cp	
   ./mysql-­‐connector-­‐java-­‐5.1.18/mysql-­‐connector-­‐java-­‐5.1.18-­‐
bin.jar	
  /service/hive-­‐0.7.1/lib/	
  

Now for modifying Hive’s configuration.
You need to open $HIVE_HOME/conf/hive-site.xml with a text editor and
appropriately adjust the items pertaining to MySQL.
If you have installed Hive for the first time, then the $HIVE_HOME/conf/hive-
site.xml file probably doesn’t exist in the directory.
Copy the hive-default.xml.template file in the same directory and edit it like the
following:

cd	
  /service/hive-­‐0.7.1/conf/hive-­‐site.xml	
  
cp	
  ./hive-­‐default.xml.template	
  ./hive-­‐site.xml	
  

Now look for the contents below in ./hive-site.xml and make suitable
adjustments for the MySQL accounts which will be used to connect to the
MySQL server.

<property>	
  
	
  	
  <name>javax.jdo.option.ConnectionURL</name>	
  
	
  	
  <value>jdbc:mysql://MYSQL_HOSTNAME/metastore</value>	
  
</property>	
  
	
  	
  
<property>	
  
	
  	
  <name>javax.jdo.option.ConnectionDriverName</name>	
  
	
  	
  <value>com.mysql.jdbc.Driver</value>	
  
</property>	
  
	
  	
  
<property>	
  
	
  	
  <name>javax.jdo.option.ConnectionUserName</name>	
  
	
  	
  <value>hiveuser</value>	
  
</property>	
  
	
  	
  
<property>	
  
	
  	
  <name>javax.jdo.option.ConnectionPassword</name>	
  
	
  	
  <value>password</value>	
  
</property>	
  
	
  	
  
<property>	
  
	
  	
  <name>datanucleus.autoCreateSchema</name>	
  
	
  	
  <value>false</value>	
  
</property>	
  
	
  	
  
<property>	
  
	
  	
  <name>datanucleus.fixedDatastore</name>	
  
	
  	
  <value>true</value>	
  
</property>	
  


From above, you should replace the “MYSQL_HOSTNAME” string to be the
hostname or the IP address of the server where MySQL is installed to. But this
tutorial installed MySQL in the very server where Hive was installed so it is
127.0.0.1.
If, for purposes of safer management or some other reason, you installed
MySQL to some other server then just replace “MYSQL_HOSTNAME” string
with its IP address.

Thus concludes the installation and configuration of Hive.
Consult Hive’s official site documents for a detailed usage guide for Hive.

Mais conteúdo relacionado

Mais procurados

Linux apache installation
Linux apache installationLinux apache installation
Linux apache installation
Dima Gomaa
 
Linux Webserver Installation Command and GUI.ppt
Linux Webserver Installation Command and GUI.pptLinux Webserver Installation Command and GUI.ppt
Linux Webserver Installation Command and GUI.ppt
webhostingguy
 

Mais procurados (17)

Installing apache sqoop
Installing apache sqoopInstalling apache sqoop
Installing apache sqoop
 
Installing hadoop on ubuntu 16
Installing hadoop on ubuntu 16Installing hadoop on ubuntu 16
Installing hadoop on ubuntu 16
 
Installing hive on ubuntu 16
Installing hive on ubuntu 16Installing hive on ubuntu 16
Installing hive on ubuntu 16
 
Hadoop on ec2
Hadoop on ec2Hadoop on ec2
Hadoop on ec2
 
Single node hadoop cluster installation
Single node hadoop cluster installation Single node hadoop cluster installation
Single node hadoop cluster installation
 
Linux apache installation
Linux apache installationLinux apache installation
Linux apache installation
 
Content server installation guide
Content server installation guideContent server installation guide
Content server installation guide
 
Linux
LinuxLinux
Linux
 
Hadoop single cluster installation
Hadoop single cluster installationHadoop single cluster installation
Hadoop single cluster installation
 
Hadoop completereference
Hadoop completereferenceHadoop completereference
Hadoop completereference
 
Linux Webserver Installation Command and GUI.ppt
Linux Webserver Installation Command and GUI.pptLinux Webserver Installation Command and GUI.ppt
Linux Webserver Installation Command and GUI.ppt
 
Setting up LAMP for Linux newbies
Setting up LAMP for Linux newbiesSetting up LAMP for Linux newbies
Setting up LAMP for Linux newbies
 
Cloudera cluster setup and configuration
Cloudera cluster setup and configurationCloudera cluster setup and configuration
Cloudera cluster setup and configuration
 
Installing lemp with ssl and varnish on Debian 9
Installing lemp with ssl and varnish on Debian 9Installing lemp with ssl and varnish on Debian 9
Installing lemp with ssl and varnish on Debian 9
 
2.4.1 use debian package management v2
2.4.1 use debian package management v22.4.1 use debian package management v2
2.4.1 use debian package management v2
 
are available here
are available hereare available here
are available here
 
Salt conf 2014-installing-openstack-using-saltstack-v02
Salt conf 2014-installing-openstack-using-saltstack-v02Salt conf 2014-installing-openstack-using-saltstack-v02
Salt conf 2014-installing-openstack-using-saltstack-v02
 

Semelhante a R hive tutorial supplement 2 - Installing Hive

Getting started-with-zend-framework
Getting started-with-zend-frameworkGetting started-with-zend-framework
Getting started-with-zend-framework
Marcelo da Rocha
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
tutorialsruby
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
tutorialsruby
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
tutorialsruby
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
tutorialsruby
 
LuisRodriguezLocalDevEnvironmentsDrupalOpenDays
LuisRodriguezLocalDevEnvironmentsDrupalOpenDaysLuisRodriguezLocalDevEnvironmentsDrupalOpenDays
LuisRodriguezLocalDevEnvironmentsDrupalOpenDays
Luis Rodríguez Castromil
 
Single node setup
Single node setupSingle node setup
Single node setup
KBCHOW123
 
Apache hadoop 2_installation
Apache hadoop 2_installationApache hadoop 2_installation
Apache hadoop 2_installation
sushantbit04
 

Semelhante a R hive tutorial supplement 2 - Installing Hive (20)

Apache Hive micro guide - ConfusedCoders
Apache Hive micro guide - ConfusedCodersApache Hive micro guide - ConfusedCoders
Apache Hive micro guide - ConfusedCoders
 
Ex-8-hive.pptx
Ex-8-hive.pptxEx-8-hive.pptx
Ex-8-hive.pptx
 
Getting started-with-zend-framework
Getting started-with-zend-frameworkGetting started-with-zend-framework
Getting started-with-zend-framework
 
PHP
PHP PHP
PHP
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
 
php-and-zend-framework-getting-started
php-and-zend-framework-getting-startedphp-and-zend-framework-getting-started
php-and-zend-framework-getting-started
 
Apache - Quick reference guide
Apache - Quick reference guideApache - Quick reference guide
Apache - Quick reference guide
 
Configure h base hadoop and hbase client
Configure h base hadoop and hbase clientConfigure h base hadoop and hbase client
Configure h base hadoop and hbase client
 
LuisRodriguezLocalDevEnvironmentsDrupalOpenDays
LuisRodriguezLocalDevEnvironmentsDrupalOpenDaysLuisRodriguezLocalDevEnvironmentsDrupalOpenDays
LuisRodriguezLocalDevEnvironmentsDrupalOpenDays
 
Single node setup
Single node setupSingle node setup
Single node setup
 
Deploying your rails application to a clean ubuntu 10
Deploying your rails application to a clean ubuntu 10Deploying your rails application to a clean ubuntu 10
Deploying your rails application to a clean ubuntu 10
 
Hadoop cluster 安裝
Hadoop cluster 安裝Hadoop cluster 安裝
Hadoop cluster 安裝
 
Appache.ppt
Appache.pptAppache.ppt
Appache.ppt
 
Appache.ppt
Appache.pptAppache.ppt
Appache.ppt
 
02 Hadoop deployment and configuration
02 Hadoop deployment and configuration02 Hadoop deployment and configuration
02 Hadoop deployment and configuration
 
Mysql
MysqlMysql
Mysql
 
Apache hadoop 2_installation
Apache hadoop 2_installationApache hadoop 2_installation
Apache hadoop 2_installation
 
Apache windows
Apache windowsApache windows
Apache windows
 

Mais de Aiden Seonghak Hong

Mais de Aiden Seonghak Hong (13)

IoT and Big data with R
IoT and Big data with RIoT and Big data with R
IoT and Big data with R
 
RHive tutorial supplement 3: RHive 튜토리얼 부록 3 - RStudio 설치
RHive tutorial supplement 3: RHive 튜토리얼 부록 3 - RStudio 설치RHive tutorial supplement 3: RHive 튜토리얼 부록 3 - RStudio 설치
RHive tutorial supplement 3: RHive 튜토리얼 부록 3 - RStudio 설치
 
RHive tutorial supplement 2: RHive 튜토리얼 부록 2 - Hive 설치
RHive tutorial supplement 2: RHive 튜토리얼 부록 2 - Hive 설치RHive tutorial supplement 2: RHive 튜토리얼 부록 2 - Hive 설치
RHive tutorial supplement 2: RHive 튜토리얼 부록 2 - Hive 설치
 
RHive tutorial supplement 1: RHive 튜토리얼 부록 1 - Hadoop 설치
RHive tutorial supplement 1: RHive 튜토리얼 부록 1 - Hadoop 설치RHive tutorial supplement 1: RHive 튜토리얼 부록 1 - Hadoop 설치
RHive tutorial supplement 1: RHive 튜토리얼 부록 1 - Hadoop 설치
 
RHive tutorial 5: RHive 튜토리얼 5 - apply 함수와 맵리듀스
RHive tutorial 5: RHive 튜토리얼 5 - apply 함수와 맵리듀스RHive tutorial 5: RHive 튜토리얼 5 - apply 함수와 맵리듀스
RHive tutorial 5: RHive 튜토리얼 5 - apply 함수와 맵리듀스
 
RHive tutorial 4: RHive 튜토리얼 4 - UDF, UDTF, UDAF 함수
RHive tutorial 4: RHive 튜토리얼 4 - UDF, UDTF, UDAF 함수RHive tutorial 4: RHive 튜토리얼 4 - UDF, UDTF, UDAF 함수
RHive tutorial 4: RHive 튜토리얼 4 - UDF, UDTF, UDAF 함수
 
RHive tutorial 3: RHive 튜토리얼 3 - HDFS 함수
RHive tutorial 3: RHive 튜토리얼 3 - HDFS 함수RHive tutorial 3: RHive 튜토리얼 3 - HDFS 함수
RHive tutorial 3: RHive 튜토리얼 3 - HDFS 함수
 
RHive tutorial 2: RHive 튜토리얼 2 - 기본 함수
RHive tutorial 2: RHive 튜토리얼 2 - 기본 함수RHive tutorial 2: RHive 튜토리얼 2 - 기본 함수
RHive tutorial 2: RHive 튜토리얼 2 - 기본 함수
 
RHive tutorial 1: RHive 튜토리얼 1 - 설치 및 설정
RHive tutorial 1: RHive 튜토리얼 1 - 설치 및 설정RHive tutorial 1: RHive 튜토리얼 1 - 설치 및 설정
RHive tutorial 1: RHive 튜토리얼 1 - 설치 및 설정
 
R hive tutorial 1
R hive tutorial 1R hive tutorial 1
R hive tutorial 1
 
R hive tutorial - apply functions and map reduce
R hive tutorial - apply functions and map reduceR hive tutorial - apply functions and map reduce
R hive tutorial - apply functions and map reduce
 
R hive tutorial - udf, udaf, udtf functions
R hive tutorial - udf, udaf, udtf functionsR hive tutorial - udf, udaf, udtf functions
R hive tutorial - udf, udaf, udtf functions
 
RHive tutorials - Basic functions
RHive tutorials - Basic functionsRHive tutorials - Basic functions
RHive tutorials - Basic functions
 

Último

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Último (20)

Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 

R hive tutorial supplement 2 - Installing Hive

  • 1. RHive tutorial – Installing Hive As an add-on to Hadoop, Hive cannot run independent of Hadoop. This tutorial explains how additionally configure Hive to the Hadoop environment made in the Hadoop setup tutorial. Hive does not need to be installed for all servers where Hadoop is installed. It is just needed for the server where Hadoop client will run. Here, Hive will be installed in Hadoop namenode for convenience in setup. Downloading Hive Because Hive is written in Java just like Hadoop is, downloading the file and decompressing it alone constitutes the entire setup procedure. A stable version of Hive can be found in the URL below. http://www.apache.org/dist//hive/hive-0.7.1/hive-0.7.1-bin.tar.gz The latest stable version at the point of this tutorial’s creation is 0.7.1; it is alright to build a separate snapshot version and use that instead. If version 0.8x is released, it’s okay to use that. Like the following, connect to the target server for Hive installation and download the final version of Hive. ssh  root@10.1.1.1   mkdir  hive_stable   cd  hive_stable   wget   http://www.apache.org/dist//hive/hive-­‐0.7.1/hive-­‐0.7.1-­‐ bin.tar.gz   tar  xvfz  ./hive-­‐0.7.1-­‐bin.tar.gz   mkdir  /service   mv  ./hive-­‐0.7.1-­‐bin  /service   Configuring MySQL We will be choosing and using MySQL for Hive’s repository. Hive uses SQLite by default, but if you want to enable multiple users to use Hive simultaneously, you need to be able to use MySQL or other DBs as repositories. Hence this tutorial will be using MySQL.
  • 2. MySQL can be installed in a server apart from the one where Hive will be installed, but this tutorial will install MySQL along where, Hadoop namenode is installed (that is, where Hive is installed). Use yum like the following to install mysql client and server yum  install  mysql  mysql-­‐server   After installation, start mysql server. /etc/init.d/mysqld  start   Now create a database in MySQL for Hive to use. This tutorial will use the name “metastore” for that database. Go into mysql and create a database like shown. mysql>  CREATE  DATABASE  metastore;   mysql>  USE  metastore;   mysql>   SOURCE   /service/hive-­‐ 0.7.1/scripts/metastore/upgrade/mysql/hive-­‐schema-­‐ 0.7.0.mysql.sql;   Here, “/service/hive-0.7.1" is Hive’s HOME directory, and "$HIVE_HOME/scripts/metastore/upgrade/mysql" contains SQL files that can set MySQL up for Hive or upgrade Hive database (which exists in MySQL database). Select and run the ones suited to your version and complete setup. Now create a MySQL user which Hive will use, and grant it the privilege to access the database, “metastore”. mysql>  CREATE  USER  'hiveuser'@'%'  IDENTIFIED  BY  'password';   mysql>   GRANT   SELECT,INSERT,UPDATE,DELETE   ON   metastore.*   TO   'hiveuser'@'%';   mysql>  REVOKE  ALTER,CREATE  ON  metastore.*  FROM  'hiveuser'@'%';   Configuring MySQL for Hive use is complete. Now you need to configure Hive to enable it to connect to MySQL. JDBC is required for allowing connecting to MySQL from Hive but JDBC is not included in MySQL.
  • 3. You must manually download it from the MySQL site and copy it into the installed Hive. JDBC is available for download from here: http://dev.mysql.com/downloads/ As shown below, download and decompress it, then copy the jar file to Hadoop’s lib directory. $   curl   http://dev.mysql.com/get/Downloads/Connector-­‐J/mysql-­‐ connector-­‐java-­‐ 5.1.18.tar.gz/from/http://mirror.services.wisc.edu/mysql/   $  tar  xvfz  mysql-­‐connector-­‐java-­‐5.1.18.tar.gz   $   cp   ./mysql-­‐connector-­‐java-­‐5.1.18/mysql-­‐connector-­‐java-­‐5.1.18-­‐ bin.jar  /service/hive-­‐0.7.1/lib/   Now for modifying Hive’s configuration. You need to open $HIVE_HOME/conf/hive-site.xml with a text editor and appropriately adjust the items pertaining to MySQL. If you have installed Hive for the first time, then the $HIVE_HOME/conf/hive- site.xml file probably doesn’t exist in the directory. Copy the hive-default.xml.template file in the same directory and edit it like the following: cd  /service/hive-­‐0.7.1/conf/hive-­‐site.xml   cp  ./hive-­‐default.xml.template  ./hive-­‐site.xml   Now look for the contents below in ./hive-site.xml and make suitable adjustments for the MySQL accounts which will be used to connect to the MySQL server. <property>      <name>javax.jdo.option.ConnectionURL</name>      <value>jdbc:mysql://MYSQL_HOSTNAME/metastore</value>   </property>       <property>      <name>javax.jdo.option.ConnectionDriverName</name>      <value>com.mysql.jdbc.Driver</value>  
  • 4. </property>       <property>      <name>javax.jdo.option.ConnectionUserName</name>      <value>hiveuser</value>   </property>       <property>      <name>javax.jdo.option.ConnectionPassword</name>      <value>password</value>   </property>       <property>      <name>datanucleus.autoCreateSchema</name>      <value>false</value>   </property>       <property>      <name>datanucleus.fixedDatastore</name>      <value>true</value>   </property>   From above, you should replace the “MYSQL_HOSTNAME” string to be the hostname or the IP address of the server where MySQL is installed to. But this tutorial installed MySQL in the very server where Hive was installed so it is 127.0.0.1. If, for purposes of safer management or some other reason, you installed MySQL to some other server then just replace “MYSQL_HOSTNAME” string with its IP address. Thus concludes the installation and configuration of Hive. Consult Hive’s official site documents for a detailed usage guide for Hive.