Skip to content

Conversation

@wangyum
Copy link
Member

@wangyum wangyum commented Mar 24, 2018

What changes were proposed in this pull request?

spark-sql can't connect to metastore with a security Hadoop cluster after SPARK-21428.

hive.metastore.uris was HiveConf.ConfVars.METASTOREURIS.defaultStrVal here before SPARK-21428.

This pr revert hive.metastore.uris to HiveConf.ConfVars.METASTOREURIS.defaultStrVal.

How was this patch tested?

manual tests with a security Hadoop cluster

@SparkQA
Copy link

SparkQA commented Mar 24, 2018

Test build #88559 has finished for PR 20898 at commit a382aab.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum
Copy link
Member Author

wangyum commented Mar 24, 2018

cc @yaooqinn @cloud-fan

@yaooqinn
Copy link
Member

yaooqinn commented Mar 24, 2018

proxy or not, i only find such an issue with proxy #20784, and if we point it to a default metastore, how could we connect to the correct one?

@wangyum
Copy link
Member Author

wangyum commented Mar 24, 2018

Yes, it's proxy user:

export HADOOP_PROXY_USER=user
spark-sql --master yarn

@jerryshao
Copy link
Contributor

What's the relation between this pr and #20784 ? @wangyum

Are they just two fixes for the same issue?

@wangyum
Copy link
Member Author

wangyum commented Mar 27, 2018

It looks like

@wangyum wangyum closed this Mar 27, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants