Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-20054

Propagate ExecutionExceptions from the driver thread to the client

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In AbstractSparkClient we have the following code:

             try {
                driverFuture.get();
              } catch (InterruptedException ie) {
                // Give up.
                LOG.warn("Interrupted before driver thread was finished.", ie);
              } catch (ExecutionException ee) {
                LOG.error("Driver thread failed", ee);
              }
      

      If the driver Future throws an ExecutionException the error is simply logged, and a RuntimeException is thrown with the generic message "Error while waiting for Remote Spark Driver to connect back to HiveServer2."

      We should propagate the ExecutionException to the client.

      Attachments

        Activity

          People

            Unassigned Unassigned
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: