Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-2347

Add interface layer between Parquet and Hadoop Configuration

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.14.0
    • parquet-mr
    • None

    Description

      Parquet relies heavily on a few Hadoop classes, such as its Configuration class, which is used throughout Parquet's reading and writing logic. If we include our own interface for this, this could potentially allow users to use Parquet's readers and writers without the Hadoop dependency later on.

      In order to preserve backward compatibility and avoid breaking downstream projects, the constructors and methods using Hadoop's constructor should be preserved for the time being, though I would favour deprecation in the near future.

      This is part of an effort that has been discussed on the dev mailing list.

      Attachments

        Issue Links

          Activity

            People

              amousavigourabi Atour Mousavi Gourabi
              amousavigourabi Atour Mousavi Gourabi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: