Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4284

Load/insert after alter add column on partition table with complex column fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      Insert after alter add column on partition table with complex column fails with bufferUnderFlowException

      [Steps] :-

      drop table if exists strarmap1; create table strarmap1(id int,str struct<intval:int,tm:timestamp,map1:map<int,string>>,arr array<map<string,timestamp>>) PARTITIONED BY(name string) stored as carbondata tblproperties('local_dictionary_enable'='true','local_dictionary_include'='name,str,arr'); load data inpath 'hdfs://hacluster/chetan/strarmap1.csv' into table strarmap1 partition(name='name0') options('fileheader'='id,name,str,arr','COMPLEX_DELIMITER_LEVEL_3'='#','COMPLEX_DELIMITER_LEVEL_2'='$','COMPLEX_DELIMITER_LEVEL_1'='&','BAD_RECORDS_ACTION'='FORCE'); select * from strarmap1 limit 1; show partitions strarmap1; ALTER TABLE strarmap1 ADD COLUMNS(map1 Map<short,int>, map2 Map<long,double>, map3 Map<decimal(3,2),string>, map4 Map<char(5),varchar(50)>, map5 Map<boolean,date>,map6 Map<string,timestamp>,map7 map<string,array<string>>, map8 map<string,struct<d:int, s:struct<im:string>>>); load data inpath 'hdfs://hacluster/chetan/strarmap1.csv' into table strarmap1 partition(name='name0') options('fileheader'='id,name,str,arr,map1,map2,map3,map4,map5,map6,map7,map8','COMPLEX_DELIMITER_LEVEL_3'='#','COMPLEX_DELIMITER_LEVEL_2'='$','COMPLEX_DELIMITER_LEVEL_1'='&','BAD_RECORDS_ACTION'='FORCE');

      [Expected Result] :- load after add map columns on partition table should be success

      [Actual Issue]:- error on load after add map columns on partition table

      Attachments

        Activity

          People

            Unassigned Unassigned
            Shreelekhya SHREELEKHYA GAMPA
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 10m
                1h 10m