Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5980 Add load tests for Core Apache Beam operations
  3. BEAM-6201

Provide a "Data insertion pipeline" for Python suites

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • P4
    • Resolution: Done
    • None
    • 2.10.0
    • testing
    • None

    Description

      We can provide a special pipeline that simply writes synthetic data to a PubSub topic. Then this data can be read from a subscription in a streaming test (eg. in python SDK tests or others). 

       

       

      Attachments

        Issue Links

          is cloned by

          Sub-task - The sub-task of the issue BEAM-6207 extend "Data insertion Pipeline" with Kafka IO

          • P4 - Trivial items, spelling errors, etc.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue BEAM-6335 GroupByKey uses data insertion pipeline in streaming tests

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-6397 Add KeyValue attribute to SyntheticDataPubSubPublisher

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          links to

          Web Link GitHub Pull Request #7238

          Activity

            People

              ŁukaszG Lukasz Gajowy
              ŁukaszG Lukasz Gajowy
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m