datasophon下dolphinscheduler执行脚本出错
执行hive脚本出错:
错误消息:
FAILED: RuntimeException Error loading hooks(hive.exec.post.hooks): java.lang.ClassNotFoundException: org.apache.atlas.hive.hook.HiveHookat java.net.URLClassLoader.findClass(URLClassLoader.java:387)at java.lang.ClassLoader.loadClass(ClassLoader.java:418)at java.lang.ClassLoader.loadClass(ClassLoader.java:351)at java.lang.Class.forName0(Native Method)at java.lang.Class.forName(Class.java:348)at org.apache.hadoop.hive.ql.hooks.HookUtils.readHooksFromConf(HookUtils.java:55)at org.apache.hadoop.hive.ql.HookRunner.loadHooksFromConf(HookRunner.java:90)at org.apache.hadoop.hive.ql.HookRunner.initialize(HookRunner.java:79)at org.apache.hadoop.hive.ql.HookRunner.runBeforeParseHook(HookRunner.java:105)at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:612)at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1826)at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1773)at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1768)at org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126)at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214)at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188)at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402)at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335)at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787)at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.hadoop.util.RunJar.run(RunJar.java:323)at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
修复:
ln -s /opt/atlas/hook/hive/* /opt/hive/libln -s /opt/atlas/conf/atlas-application.properties /opt/datasophon/hive/conf/
客户端机器也要
执行shell 脚本出错:
shell脚本:
sudo -u hive sqoop
sudo: sqoop: command not found
修复:
sudo -u hive -E env "PATH=$PATH" sqoop