Hive 安装

    技术2024-06-15  52

    文章目录

    下载 hive:解压环境变量查看版本配置 hive初始化 schema运行 hive

    下载 hive:

    wget http://archive.apache.org/dist/hive/hive-2.1.1/apache-hive-2.1.1-bin.tar.gz

    解压

    tar -xzvf apache-hive-2.1.1-bin.tar.gz mv apache-hive-2.1.1-bin hive mv hive /usr/local/

    环境变量

    vi /etc/profile export HIVE_HOME=/usr/local/hive export PATH=$PATH:$HIVE_HOME/bin source /etc/profile

    查看版本

    hive --version

    配置 hive

    hive-env.sh

    cd $HIVE_HOME/conf cp hive-env.sh.template hive-env.sh vi hive-env.sh

    添加:

    HADOOP_HOME=/usr/local/hadoop

    拷贝创建hive-site.xml、hive-log4j2.properties、hive-exec-log4j2.properties,执行

    cp hive-default.xml.template hive-site.xml cp hive-log4j2.properties.template hive-log4j2.properties cp hive-exec-log4j2.properties.template hive-exec-log4j2.properties

    创建临时文件夹

    mkdir -p /data/hive/tmp

    修改 hive-site.xml

    :%s/${system:java.io.tmpdir}/\/data\/hive\/tmp/g :%s/${system:user.name}/root/g

    初始化 schema

    $HIVE_HOME/bin/schematool -initSchema -dbType derby

    遭遇大坑

    SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357) at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338) at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:536) at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:554) at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:448) at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5141) at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:5099) at org.apache.hadoop.hive.common.LogUtils.initHiveLog4jCommon(LogUtils.java:97) at org.apache.hadoop.hive.common.LogUtils.initHiveLog4j(LogUtils.java:81) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:699) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:323) at org.apache.hadoop.util.RunJar.main(RunJar.java:236)

    找到原因: com.google.common.base.Preconditions.checkArgument 这是因为hive内依赖的guava.jar和hadoop内的版本不一致造成的。

    检验方法:

    查看hadoop安装目录下share/hadoop/common/lib内guava.jar版本查看hive安装目录下lib内guava.jar的版本如果两者不一致,删除版本低的,并拷贝高版本的

    问题解决!

    运行 hive

    Processed: 0.013, SQL: 9