Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-43017

Connect to multiple hive metastore using single sparkcontext (i.e without stopping it")

    XMLWordPrintableJSON

Details

    • Question
    • Status: Resolved
    • Critical
    • Resolution: Invalid
    • 3.2.0
    • None
    • Spark Core, Spark Submit
    • None

    Description

      I wanted to join 2 hive tables which are stored in 2 different hive metastores.
      I would like fetch the first table, create a tempview. Change hive metastore uri, connect to that metastore and fetch the second table , create a tempview and then use tempviews to do further. 

      I launched 2 different instances of hive on my local , individually i'm able to connect to both, but when i try to connect to them one after other, the second time the old URI's is getting used.

      Any workaround this.

      Please help out :\ 

      Attachments

        Activity

          People

            Unassigned Unassigned
            pravin1406 Pravin Rathore
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: