Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5151

Adding partition on impala over a table with old metadata

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None
    • ghx-label-3

    Description

      1) connect on beeline and execute:
      CREATE TABLE test(id int,description string) PARTITIONED BY (year string) ;
      2) connect on Impala and execute:
      invalidate metadata test;
      desc test;
      3) from beeline change the table structure:
      ALTER TABLE test ADD COLUMNS (missing_col string );
      4) At this point Impala holds a old metadata, an impala does not know about the new column "missing_col" when execute the SQL statement:

      alter table add partition (year='2017');

      Impala will change the table structure for the table test, basically reverting any changes that have been made on the table to the point from impala last invalidate metadata.
      5) from beeline session executing the command:
      desc test
      the new field "missing_col" no longer will appear.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              daniel.goldszmit Daniel Goldszmit
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: