Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-47912

File format of insert overwrite dir does not take effect

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 4.0.0
    • None
    • SQL

    Description

      File format of insert overwrite dir does not take effect.

       

      Reproduce:

      set hive.default.fileformat=parquet;
      
      -- Not as expected, I want an orc file but written in parquet format
      INSERT OVERWRITE DIRECTORY '$tablePath'
      STORED AS
        INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
        OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
      select 1;
      
      -- Failed
      select * from `orc`.`$tablePath`; 

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              wforget Zhen Wang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: