Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21637 Synchronized metastore cache
  3. HIVE-25936

ValidWriteIdList & table id are sometimes missing when requesting partitions by name via HS2

    XMLWordPrintableJSON

Details

    Description

      According to HIVE-24743 the table id and ValidWriteIdList are important for keeping HMS remote metadata cache consistent. Although HIVE-24743 attempted to pass the write id list and table id in every call to HMS it failed to do so completely. For those partitions not handled in the batch logic, the metastore call in Hive#getPartitionsByName method does not pass the table id and write id list.

      Attachments

        Issue Links

          is fixed by

          Task - A task that needs to be done. HIVE-25935 Cleanup IMetaStoreClient#getPartitionsByNames APIs

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HIVE-24743 [HS2] Send tableId to get_partitions_by_names_req HMS API from HS2

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-26278 Add unit tests for Hive#getPartitionsByNames using batching

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #3007

          Activity

            People

              zabetak Stamatis Zampetakis
              zabetak Stamatis Zampetakis
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m