hadoop - Hive Could not set permission for staging directory -


my hive job fails below error set exec directory , scratch directory before run job , not sure why default properties not getting updated.

set hive.exec.scratchdir=/domain/usecase/warehouse/hive_scratch_tmp; set hive.exec.stagingdir=/domain/usecase/warehouse/.staging; 

exception:

17/09/13 11:30:42 [thread-126]: error mr.execdriver: yarn java.io.ioexception: not set permission /var/mapr/cluster/yarn/rm/staging/usecase/.staging/job_1503499283269_761069/job.jar @ com.mapr.fs.maprfilesystem.setpermission(maprfilesystem.java:2100) @ org.apache.hadoop.mapreduce.jobresourceuploader.copyjar(jobresourceuploader.java:248)

are there other property need set? thanks

there similar issue here, property using.

try below configuration property in hive shell override hive-mapreduce stage directory. use full uri

yarn.app.mapreduce.am.staging-dir

http://doc.mapr.com/display/mapr/default+mapred+parameters


Comments

Popular posts from this blog

ios - MKAnnotationView layer is not of expected type: MKLayer -

ZeroMQ on Windows, with Qt Creator -

unity3d - Unity SceneManager.LoadScene quits application -