Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28848

insert overwrite local directory <path> stored as parquet does not creates snappy.parquet data file at local directory path

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.4.3
    • None
    • SQL
    • None

    Description

      0: jdbc:hive2://10.18.18.214:23040/func> insert overwrite local directory '/opt/trash4/' stored as parquet select * from trash1 a where a.country='PAK';
      +---------+--+
      | Result  |
      +---------+--+
      +---------+--+
      No rows selected (1.368 seconds)
      

      Data file at local directory path:

      vm1:/opt/trash4 # ll
      total 12
      -rw-r--r-- 1 root root   8 Aug 22 14:30 ._SUCCESS.crc
      -rw-r--r-- 1 root root  16 Aug 22 14:30 .part-00001-2b17ec6a-ef7e-4b45-927e-f93b88ff4f65-c000.crc
      -rw-r--r-- 1 root root   0 Aug 22 14:30 _SUCCESS
      -rw-r--r-- 1 root root 619 Aug 22 14:30 part-00001-2b17ec6a-ef7e-4b45-927e-f93b88ff4f65-c000
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              abhishek.akg ABHISHEK KUMAR GUPTA
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: