Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6730

Enable configuration of Java transforms (specifically IO) through other SDKs

    XMLWordPrintableJSON

    Details

      Description

      Since https://github.com/apache/beam/pull/7316 we can reference external transforms which are transforms only available in a "foreign" SDKs. This allows us to fill the gap in terms of missing transforms in the Python and Go SDK, specifically IO transforms.

      We can start collecting/exposing transforms that Beam users need. The following transforms could be interesting:

      • KafkaIO / KinesisIO
      • CassandraIO / ElasticserchIO / Hbase / Redis
      • JDBC
      • S3 file system
      • GenerateSequence

      See also https://s.apache.org/beam-cross-language-io and BEAM-6485.

      CC Robert Bradshaw Chamikara Madhusanka Jayalath Thomas Weise

        Attachments

          Activity

            People

            • Assignee:
              mxm Maximilian Michels
              Reporter:
              mxm Maximilian Michels
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 12h
                12h