Shulou(Shulou.com)05/31 Report--

This article mainly introduces what Hive common questions are, which can be used for reference by interested friends. I hope you can learn a lot after reading this article. Let's take a look at it.

1. HIVE startup error report

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/MRVersion

At org.apache.hadoop.hive.shims.Hadoop23Shims.isMR2 (Hadoop23Shims.java:852)

At org.apache.hadoop.hive.shims.Hadoop23Shims.getHadoopConfNames (Hadoop23Shims.java:923)

At org.apache.hadoop.hive.conf.HiveConf$ConfVars. (HiveConf.java:358)

At org.apache.hadoop.hive.conf.HiveConf. (HiveConf.java:105)

At org.apache.hadoop.hive.metastore.HiveMetaStore.main (HiveMetaStore.java:6000)

At sun.reflect.NativeMethodAccessorImpl.invoke0 (NativeMethod)

At sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:57)

At sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)

At java.lang.reflect.Method.invoke (Method.java:606)

At org.apache.hadoop.util.RunJar.run (RunJar.java:221)

At org.apache.hadoop.util.RunJar.main (RunJar.java:136)

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.MRVersion

At java.net.URLClassLoader$1.run (URLClassLoader.java:366)

At java.net.URLClassLoader$1.run (URLClassLoader.java:355)

At java.security.AccessController.doPrivileged (Native Method)

At java.net.URLClassLoader.findClass (URLClassLoader.java:354)

At java.lang.ClassLoader.loadClass (ClassLoader.java:425)

At sun.misc.Launcher$AppClassLoader.loadClass (Launcher.java:308)

At java.lang.ClassLoader.loadClass (ClassLoader.java:358)

... 11 more

Solution: download hadoop-mapreduce-client-common-2.6.0-cdh6.4.4.jar to replace the package in hadoop-mapreduce

two。 Error

[ERROR] Terminal initialization failed; falling back to unsupported

Java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected

At jline.TerminalFactory.create (TerminalFactory.java:101)

At jline.TerminalFactory.get (TerminalFactory.java:158)

At jline.console.ConsoleReader. (ConsoleReader.java:229)

At jline.console.ConsoleReader. (ConsoleReader.java:221)

At jline.console.ConsoleReader. (ConsoleReader.java:209)

At org.apache.hadoop.hive.cli.CliDriver.getConsoleReader (CliDriver.java:794)

At org.apache.hadoop.hive.cli.CliDriver.executeDriver (CliDriver.java:733)

At org.apache.hadoop.hive.cli.CliDriver.run (CliDriver.java:693)

At org.apache.hadoop.hive.cli.CliDriver.main (CliDriver.java:628)

At sun.reflect.NativeMethodAccessorImpl.invoke0 (NativeMethod)

At sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:57)

At sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)

At java.lang.reflect.Method.invoke (Method.java:606)

At org.apache.hadoop.util.RunJar.run (RunJar.java:221)

At org.apache.hadoop.util.RunJar.main (RunJar.java:136)

Exception in thread "main" java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected

At jline.console.ConsoleReader. (ConsoleReader.java:230)

At jline.console.ConsoleReader. (ConsoleReader.java:221)

At jline.console.ConsoleReader. (ConsoleReader.java:209)

At org.apache.hadoop.hive.cli.CliDriver.getConsoleReader (CliDriver.java:794)

At org.apache.hadoop.hive.cli.CliDriver.executeDriver (CliDriver.java:733)

At org.apache.hadoop.hive.cli.CliDriver.run (CliDriver.java:693)

At org.apache.hadoop.hive.cli.CliDriver.main (CliDriver.java:628)

At sun.reflect.NativeMethodAccessorImpl.invoke0 (NativeMethod)

At sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:57)

At sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)

At java.lang.reflect.Method.invoke (Method.java:606)

At org.apache.hadoop.util.RunJar.run (RunJar.java:221)

At org.apache.hadoop.util.RunJar.main (RunJar.java:136)

Solution: delete the jline.jar under the yarn directory

Rm-rf / usr/hdp/2.2.8.0-3150/hadoop-yarn/lib/jline-0.9.94.jar

3. problem

Caused by: org.datanucleus.store.rdbms.datasource.DatastoreDriverNotFoundException: The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH. Please check your CLASSPATH specification, and the name of the driver.

Solution:

Copy the mysql-connector-java-commercial-5.0.3-bin.jar file to the / usr/lib/hive/lib directory

4. problem

Error executing insert statement

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/MRVersion

At org.apache.hadoop.hive.shims.Hadoop23Shims.isMR2 (Hadoop23Shims.java:852)

At org.apache.hadoop.hive.shims.Hadoop23Shims.getHadoopConfNames (Hadoop23Shims.java:923)

At org.apache.hadoop.hive.conf.HiveConf$ConfVars. (HiveConf.java:358)

At org.apache.hadoop.hive.conf.HiveConf. (HiveConf.java:105)

At org.apache.hadoop.hive.metastore.HiveMetaStore.main (HiveMetaStore.java:6000)

At sun.reflect.NativeMethodAccessorImpl.invoke0 (NativeMethod)

At sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:57)

At sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)

At java.lang.reflect.Method.invoke (Method.java:606)

At org.apache.hadoop.util.RunJar.run (RunJar.java:221)

At org.apache.hadoop.util.RunJar.main (RunJar.java:136)

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.MRVersion

At java.net.URLClassLoader$1.run (URLClassLoader.java:366)

At java.net.URLClassLoader$1.run (URLClassLoader.java:355)

At java.security.AccessController.doPrivileged (Native Method)

At java.net.URLClassLoader.findClass (URLClassLoader.java:354)

At java.lang.ClassLoader.loadClass (ClassLoader.java:425)

At sun.misc.Launcher$AppClassLoader.loadClass (Launcher.java:308)

At java.lang.ClassLoader.loadClass (ClassLoader.java:358)

... 11 more

X=vertex_1468482423723_0008_2_00 [Map 1], java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hive.conf.HiveConf$ConfVars

At org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork (Utilities.java:371)

At org.apache.hadoop.hive.ql.exec.Utilities.getMapWork (Utilities.java:296)

At org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize (HiveSplitGenerator.java:106)

At org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run (RootInputInitializerManager.java:245)

At org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run (RootInputInitializerManager.java:239)

At java.security.AccessController.doPrivileged (Native Method)

At javax.security.auth.Subject.doAs (Subject.java:415)

At org.apache.hadoop.security.UserGroupInformation.doAs (UserGroupInformation.java:1671)

At org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call (RootInputInitializerManager.java:239)

At org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call (RootInputInitializerManager.java:226)

At java.util.concurrent.FutureTask.run (FutureTask.java:262)

At java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1145)

At java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:615)

At java.lang.Thread.run (Thread.java:745)

Solution:

Temporarily change the method

Hive > add jar / usr/hdp/2.2.8.0-3150/hadoop-mapreduce/hadoop-mapreduce-client-common.jar

Hive > add jar / usr/lib/hive/lib/hive-common.jar

Permanently change the method

Mkdir-p / usr/hdp/2.2.8.0-3150/hive/auxlib

Ln-sf / usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-common.jar hadoop-mapreduce-client-common.jar

Ln-sf / usr/lib/hive/lib/hive-common.jar hive-common.jar

Thank you for reading this article carefully. I hope the article "what are the Hive FAQs" shared by the editor will be helpful to you. At the same time, I also hope you will support us and pay attention to the industry information channel. More related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.