Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-428

AvroOutputFormat doesn't support compression even though documentation claims it does

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.4.0-incubating
    • 1.4.1-incubating
    • docs

    Description

      The documentation claims that Avro files can be compressed as well:

      By default, data is not compressed. You can compress your data by using the deflate (gzip) algorithm with the -z or --compress argument, or specify any Hadoop compression codec using the --compression-codec argument. This applies to SequenceFile, text, and Avro files.

      This is not true as the AvroOutputFormat currently doesn't support compression.

      Attachments

        1. SQOOP-428.1.patch
          8 kB
          Lars Francke
        2. SQOOP-428.2.patch
          11 kB
          Lars Francke
        3. SQOOP-428.3.patch
          16 kB
          Lars Francke
        4. TEST-com.cloudera.sqoop.TestAvroImport.txt
          690 kB
          Jarek Jarcec Cecho
        5. SQOOP-428.4.patch
          16 kB
          Lars Francke

        Activity

          People

            larsfrancke Lars Francke
            larsfrancke Lars Francke
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: