Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-3946

Zeppelin hive interpreter broken pipe issue

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.8.0
    • 0.8.2, 0.9.0
    • zeppelin-interpreter
    • None

    Description

      We have multiple users using zeppelin UI to submit Hive and spark queries.
      Initially we had zeppelin 0.7.0 installed and then we upgraded the HDP pack from 2.6.0 to 2.6.5. With this pack zeppelin 0.7.3 was installed. With the new version of zeppelin we started facing issues such as broken pipe and zeppelin UI slowness.

      We used to get broken pipe issues earlier with zeppelin 0.7.0 but it used to get resolved by simply restarting the hive interpreter. But with zeppelin 0.7.3 restarting the hive interpreter would result in zeppelin service crash. In order to resolve we had to restart the zeppelin service.

      Upon raising the concern (ZEPPELIN-3860), we were suggested to upgrade the zeppelin service from 0.7.3 to 0.8.0 version. With the current zeppelin version i.e 0.8.0 the frequency of broken pipe error has gone up. We are able to resolve this error by restarting the hive interpreter but the end users are concerned with the frequency at which this issue is occurring.

      Note: We have user impersonation (per user and isolated mode) enabled for Hive and Spark interpreters. So at the back end for every user it creates a new interpreter connection. We have observed the if that user doesn't submit query for a long time, it breaks the connection between hiveserver2 (installed on another machine) and interpreter. But at the hiveserver2 end the connection doesn't close properly. We think this leads to broken pipe issue.

      Can someone help with any configuration changes which would help us resolve this issue?

      Attachments

        1. zeppelin_broken_pipe_20190507.log
          4 kB
          Mike Zhao
        2. zeppelin.log
          2.10 MB
          Mike Zhao

        Issue Links

          Activity

            People

              liuxun323 Xun Liu
              akashm91 Akash Mendiratta
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m