Hive Window安装 (Hadoop)

Hive Window安装 (Hadoop)

一、Hadoop安装

1)、启动

2)、创建hdfs目录

$ hadoop fs -mkdir /tmp$ hadoop fs -mkdir /user/$ hadoop fs -mkdir /user/hive/$ hadoop fs -mkdir /user/hive/warehouse $ hadoop fs -chmod g+w /tmp$ hadoop fs -chmod g+w /user/hive/warehouse

二、MySql 创建库Hive

三、Hive安装

1)、配置环境变量

2)、创建my_hive目录

3)、配置文件conf

hive-default.xml.template             ----->       hive-site.xmlhive-env.sh.template                     ----->             hive-env.shhive-exec-log4j.properties.template     ----->    hive-exec-log4j2.propertieshive-log4j.properties.template             ----->    hive-log4j2.properties

hive-site.xml配置*******************************************************************

hive.metastore.warehouse.dir /user/hive/warehouse location of default database for the warehouse hive.exec.scratchdir /tmp/hive HDFS root scratch dir for Hive jobs which gets created with write all (733) permission. For each connecting user, an HDFS scratch dir: ${hive.exec.scratchdir}/<username> is created, with ${hive.scratch.dir.permission}. hive.exec.local.scratchdir D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/scratch_dir Local scratch space for Hive jobs hive.downloaded.resources.dir D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/resources_dir/${hive.session.id}_resources Temporary local directory for added resources in the remote file system. hive.querylog.location D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/querylog_dir Location of Hive run time structured log file hive.server2.logging.operation.log.location D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/operation_logs_dir Top level directory where operation logs are stored if logging functionality is enabled javax.jdo.option.ConnectionURL jdbc:mysql://localhost:3306/hive?serverTimezone=UTC&useSSL=false&allowPublicKeyRetrieval=true JDBC connect string for a JDBC metastore. To use SSL to encrypt/authenticate the connection, provide database-specific SSL flag in the connection URL. For example, jdbc:postgresql://myhost/db?ssl=true for postgres database. javax.jdo.option.ConnectionDriverName com.mysql.jdbc.Driver Driver class name for a JDBC metastore javax.jdo.option.ConnectionUserName root Username to use against metastore database javax.jdo.option.ConnectionPassword root password to use against metastore database hive.metastore.schema.verification false Enforce metastore schema version consistency. True: Verify that version information stored in is compatible with one from Hive jars. Also disable automatic schema migration attempt. Users are required to manually migrate schema after Hive upgrade which ensures proper metastore schema migration. (Default) False: Warn if the version information stored in metastore doesn't match with one from in Hive jars. datanucleus.schema.autoCreateAlltrueAuto creates necessary schema on a startup if one doesn't exist. Set this to false, after creating it once.To enable auto create also set hive.metastore.schema.verification=false. Auto creation is not recommended for production use cases, run schematool command instead.

hive-env.sh配置*******************************************************************

4)、添加lib 目录包

mysql-connector-java

5)、bin

Hive_x.x.x_bin.tar.gz 版本在windows 环境少 Hive的执行文件、运行程序

用apache-hive-1.0.0-src\bin替换D:\temp\hadoop\apache-hive-2.1.1-bin

6)、hive 初化数据库

hive --service metastore

注:若初化数据库出错，直接运行sql

7)、hive 运行

8、hive 运行出现问题

impossible to write to binary log since binlog_format=statement

解决

use hive;stop slave;set GLOBAL binlog_format=ROW;stop slave;

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。