Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14841 Replication - Phase 2
  3. HIVE-15354

Investigate TestHCatClientNotification#createTable test failure

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • None
    • None
    • repl
    • None

    Description

      From the test logs, the createTime field for the table object when it was stored in notification is 1480852597:

      <Table(tableName:hcatcreatetable, dbName:default, owner:hiveptest, createTime:1480852597, lastAccessTime:0, retention:0, sd:StorageDescriptor(cols:[FieldSchema(name:onecol, type:string, comment:)], location:pfile:/home/hiveptest/104.154.199.46-hiveptest-1/apache-github-source-source/itests/hcatalog-unit/target/warehouse/hcatcreatetable, inputFormat:org.apache.hadoop.mapred.TextInputFormat, outputFormat:org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, compressed:false, numBuckets:0, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, parameters:{serialization.format=1}), bucketCols:null, sortCols:null, parameters:null), partitionKeys:[], parameters:{transient_lastDdlTime=1480852596}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE)>

      However, when the notification is read and the table object is reconstructed on client side, the createTime is 1480852596: 

      <Table(tableName:hcatcreatetable, dbName:default, owner:hiveptest, createTime:1480852596, lastAccessTime:0, retention:0, sd:StorageDescriptor(cols:[FieldSchema(name:onecol, type:string, comment:)], location:pfile:/home/hiveptest/104.154.199.46-hiveptest-1/apache-github-source-source/itests/hcatalog-unit/target/warehouse/hcatcreatetable, inputFormat:org.apache.hadoop.mapred.TextInputFormat, outputFormat:org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, compressed:false, numBuckets:0, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, parameters:{serialization.format=1}), bucketCols:null, sortCols:null, parameters:null), partitionKeys:[], parameters:{transient_lastDdlTime=1480852596}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE)>

      This also happens intermittently. Need to investigate.

      Attachments

        Issue Links

          Is contained by

          Sub-task - The sub-task of the issue HIVE-15365 Add new methods to MessageFactory API (corresponding to the ones added in JSONMessageFactory)

          • Major - Major loss of function.
          • Closed
          is related to

          Task - A task that needs to be done. HIVE-15058 [Umbrella] Current Flaky Tests

          • Major - Major loss of function.
          • Open

          Activity

            People

              sushanth Sushanth Sowmyan
              vgumashta Vaibhav Gumashta
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: