Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22619 Fix unstable tests
  3. HIVE-22624

Fix results_cache_invalidation and results_cache_lifetime

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • None
    • None

    Description

      these tests are falling together

      • they both run on hive-ptest-slaves-8e2.c.gcp-hive-upstream.internal
      • I suspect that they are fighting for the ownership /tmp/hive/resultscache

      exception#1

      2019-12-11T00:16:02,564  INFO [22d96536-983a-417d-b10c-aa1766ba0994 main] results.QueryResultsCache: Initializing query results cache at /tmp/hive/_resultscache_
      2019-12-11T00:16:02,569 DEBUG [22d96536-983a-417d-b10c-aa1766ba0994 main] exec.Utilities: HDFS dir: /tmp/hive/_resultscache_ with schema null, permission: rwxr-xr-x
      2019-12-11T00:16:02,571 ERROR [22d96536-983a-417d-b10c-aa1766ba0994 main] ql.Driver: FAILED: IllegalStateException java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Curren
      t permissions are: rwxr-xr-x
      java.lang.IllegalStateException: java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Current permissions are: rwxr-xr-x
              at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.checkResultsCache(SemanticAnalyzer.java:15230)
              at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12467)
              at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:359)
              at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285)
              at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:171)
              at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285)
      
      

      exception#2

      2019-12-11T00:15:06,156 ERROR [5f435468-f02b-4587-ae48-517777bfdbed main] ql.Driver: FAILED: IllegalStateException java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Curren
      t permissions are: rwxr-xr-x
      java.lang.IllegalStateException: java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Current permissions are: rwxr-xr-x
              at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.checkResultsCache(SemanticAnalyzer.java:15230)
              at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12467)
              at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:359)
      

      Attachments

        1. HIVE-22624.01.patch
          2 kB
          Zoltan Haindrich
        2. logs.tgz
          51.61 MB
          Zoltan Haindrich

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kgyrtkirk Zoltan Haindrich Assign to me
            kgyrtkirk Zoltan Haindrich
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment