hive - ODBC configuration to connect to Spark Thrift Server -

-

this question might seem repeated, in fact, i've seen couple of questions related not same error, i'm asking see if has clue.

i've set spark thrift server running default settings. spark version 2.1 , runs on yarn (hadoop 2.7.3)

the fact i'm not able setup either simba hive odbc driver nor microsoft 1 test in odbc setup succeeds.

this config i'm using microsoft hive odbc driver:

enter image description here

when hit test button, error message shown following:

enter image description here

while in spark thrift server logs following seen:

17/09/15 17:31:36 info thriftcliservice: client protocol version: hive_cli_service_protocol_v1 17/09/15 17:31:36 info sessionstate: created local directory: /tmp/00abf145-2928-4995-81f2-fea578280c42_resources 17/09/15 17:31:36 info sessionstate: created hdfs directory: /tmp/hive/test/00abf145-2928-4995-81f2-fea578280c42 17/09/15 17:31:36 info sessionstate: created local directory: /tmp/vagrant/00abf145-2928-4995-81f2-fea578280c42 17/09/15 17:31:36 info sessionstate: created hdfs directory: /tmp/hive/test/00abf145-2928-4995-81f2-fea578280c42/_tmp_space.db 17/09/15 17:31:36 info hivesessionimpl: operation log session directory created: /tmp/vagrant/operation_logs/00abf145-2928-4995-81f2-fea578280c42 17/09/15 17:31:36 info sparkexecutestatementoperation: running query 'set -v' 82d7f9a6-f2a6-4ebd-93bb-5c8da1611f84 17/09/15 17:31:36 info sparksqlparser: parsing command: set -v 17/09/15 17:31:36 info sparkexecutestatementoperation: result schema: structtype(structfield(key,stringtype,false), structfield(value,stringtype,false), structfield(meaning,stringtype,false))

if connect using jdbc driver means of beeline (which works ok), these logs:

17/09/15 17:04:24 info thriftcliservice: client protocol version: hive_cli_service_protocol_v8 17/09/15 17:04:24 info sessionstate: created hdfs directory: /tmp/hive/test 17/09/15 17:04:24 info sessionstate: created local directory: /tmp/c0681d6f-cc0f-40ae-970d-e3ea366aa414_resources 17/09/15 17:04:24 info sessionstate: created hdfs directory: /tmp/hive/test/c0681d6f-cc0f-40ae-970d-e3ea366aa414 17/09/15 17:04:24 info sessionstate: created local directory: /tmp/vagrant/c0681d6f-cc0f-40ae-970d-e3ea366aa414 17/09/15 17:04:24 info sessionstate: created hdfs directory: /tmp/hive/test/c0681d6f-cc0f-40ae-970d-e3ea366aa414/_tmp_space.db 17/09/15 17:04:24 info hivesessionimpl: operation log session directory created: /tmp/vagrant/operation_logs/c0681d6f-cc0f-40ae-970d-e3ea366aa414 17/09/15 17:04:24 info sparksqlparser: parsing command: use default 17/09/15 17:04:25 info hivemetastore: 1: get_database: default 17/09/15 17:04:25 info audit: ugi=vagrant   ip=unknown-ip-addr  cmd=get_database: default    17/09/15 17:04:25 info hivemetastore: 1: opening raw store implemenation class:org.apache.hadoop.hive.metastore.objectstore 17/09/15 17:04:25 info objectstore: objectstore, initialize called 17/09/15 17:04:25 info query: reading in results query "org.datanucleus.store.rdbms.query.sqlquery@0" since connection used closing 17/09/15 17:04:25 info metastoredirectsql: using direct sql, underlying db derby 17/09/15 17:04:25 info objectstore: initialized objectstore

well managed connect installing microsoft spark odbc driver instead of hive one. looked problem had driver rejecting connect spark thrift server when discovering not hive2 server based on server property. doubt there actual differences @ wire level between hive2 , spark thrift server because latter port of former without changes @ protocol level (thrift), in case, solution move driver , configuring same way hive2 one:

microsoft® spark odbc driver


Comments

Post a Comment

Popular posts from this blog

ios - MKAnnotationView layer is not of expected type: MKLayer -

-
Image
so code works fine logger riddled message. there way rid of or suppress it? postannotation.swift class postannotation: mkpointannotation { //mark: properties let post: post //mark: initialization init(post: post) { self.post = post super.init() self.coordinate = cllocationcoordinate2d(latitude: post.latitude, longitude: post.longitude) self.title = post.title self.subtitle = post.timestring() } } adding annotation let annotation = postannotation(post: post) self.map.addannotation(annotation) func mapview func mapview(_ mapview: mkmapview, viewfor annotation: mkannotation) -> mkannotationview? { if annotation mkuserlocation { return nil } var annotationview = mapview.dequeuereusableannotationview(withidentifier: "pin") as? mkpinannotationview if annotationview == nil { annotationview = mkpinannotationview(annotation: annotation, reuseidentifier: "pin")
Read more

ZeroMQ on Windows, with Qt Creator -

-
i have installed zmq link given below on windows 7. http://zeromq.org/distro:microsoft-windows 1) have c++ project in qt-creator , i'm using zmq c++ binding (zhelpers.hpp etc). 2) have added .lib installed zmq folder qtcreator 3) while compiling, compiler looks _imp__zmq_verion, in .dll files present in .lib have __imp_zmq_version. 4) causing undefined reference zmq_version. anyone else faced problem , has solution ?
Read more

unity3d - Unity SceneManager.LoadScene quits application -

-
i have 2 different scenes 1 named 'main' , other 'game' both added scenes in load. when use scenemanager.loadscene("game"); works no problem when tried return main scene code if (input.getkeydown (keycode.escape)) { scenemanager.loadscene("main"); } strangely game quits. thanks. sorry interruption. somewhere on other script found code. if (input.getkeydown (keycode.escape)) { application.quit (); } that's bad, know...
Read more