hadoop - Hive Could not set permission for staging directory -

-

my hive job fails below error set exec directory , scratch directory before run job , not sure why default properties not getting updated.

set hive.exec.scratchdir=/domain/usecase/warehouse/hive_scratch_tmp; set hive.exec.stagingdir=/domain/usecase/warehouse/.staging;

exception:

17/09/13 11:30:42 [thread-126]: error mr.execdriver: yarn java.io.ioexception: not set permission /var/mapr/cluster/yarn/rm/staging/usecase/.staging/job_1503499283269_761069/job.jar @ com.mapr.fs.maprfilesystem.setpermission(maprfilesystem.java:2100) @ org.apache.hadoop.mapreduce.jobresourceuploader.copyjar(jobresourceuploader.java:248)

are there other property need set? thanks

there similar issue here, property using.

try below configuration property in hive shell override hive-mapreduce stage directory. use full uri

yarn.app.mapreduce.am.staging-dir

http://doc.mapr.com/display/mapr/default+mapred+parameters


Comments

Post a Comment

Popular posts from this blog

ZeroMQ on Windows, with Qt Creator -

-
i have installed zmq link given below on windows 7. http://zeromq.org/distro:microsoft-windows 1) have c++ project in qt-creator , i'm using zmq c++ binding (zhelpers.hpp etc). 2) have added .lib installed zmq folder qtcreator 3) while compiling, compiler looks _imp__zmq_verion, in .dll files present in .lib have __imp_zmq_version. 4) causing undefined reference zmq_version. anyone else faced problem , has solution ?
Read more

unity3d - Unity SceneManager.LoadScene quits application -

-
i have 2 different scenes 1 named 'main' , other 'game' both added scenes in load. when use scenemanager.loadscene("game"); works no problem when tried return main scene code if (input.getkeydown (keycode.escape)) { scenemanager.loadscene("main"); } strangely game quits. thanks. sorry interruption. somewhere on other script found code. if (input.getkeydown (keycode.escape)) { application.quit (); } that's bad, know...
Read more

python - Error while using APScheduler: 'NoneType' object has no attribute 'now' -

-
i have python app hosting on heroku. use apscheduler call function every day @ time. strange thing 1 time function runs after while have following error log: exception in thread apscheduler (most raised during interpreter shutdown): 2017-09-06t15:03:28.347848+00:00 app[web.1]: traceback (most recent call last): 2017-09-06t15:03:28.347858+00:00 app[web.1]: file "/app/.heroku/python/lib/python2.7/threading.py", line 810, in __bootstrap_inner 2017-09-06t15:03:28.347859+00:00 app[web.1]: file "/app/.heroku/python/lib/python2.7/threading.py", line 763, in run 2017-09-06t15:03:28.347861+00:00 app[web.1]: file "/app/.heroku/python/lib/python2.7/site-packages/apscheduler/schedulers/blocking.py", line 27, in _main_loop 2017-09-06t15:03:28.348167+00:00 app[web.1]: <type 'exceptions.attributeerror'>: 'nonetype' object has no attribute 'now' any guesses? the full code long here key parts: def startdayauto(): global ...
Read more