Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18855 VectorIO API tuning/stabilization
  3. HADOOP-19098

Vector IO: consistent specified rejection of overlapping ranges

    XMLWordPrintableJSON

Details

    Description

      Related to PARQUET-2171 q: "how do you deal with overlapping ranges?"

      I believe s3a rejects this, but the other impls may not.

      Proposed

      FS spec to say

      • "overlap triggers IllegalArgumentException".
      • special case: 0 byte ranges may be short circuited to return empty buffer even without checking file length etc.

      Contract tests to validate this

      (+ common helper code to do this).

      I'll copy the validation stuff into the parquet PR for consistency with older releases

      Attachments

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: