Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11091

HadoopFormatIO should allow to specify coders

Details

    • Improvement
    • Status: Resolved
    • P3
    • Resolution: Fixed
    • 2.24.0
    • 2.26.0
    • io-java-hadoop-format
    • None

    Description

      HadoopFormatIO does allow only to pass in type descriptors for key and value and those are then resolved to Coder via CoderRegistry.

      We did find this restrictive after https://issues.apache.org/jira/browse/BEAM-9569
      which makes it impossible to emit Row out of the source.

      Easy solution I see can be to allow set Coder directly and bypass the resolution against registry in that case.

      Attachments

        Issue Links

          Activity

            People

              jvilcek Jozef Vilcek
              jvilcek Jozef Vilcek
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 10m
                  2h 10m