Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3446

RedisIO non-prefix read operations

Details

    • New Feature
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.8.0
    • io-java-redis
    • None

    Description

      Read operation in RedisIO is for prefix based look ups. While this can be used for exact key matches as well, the number of operations limits the through put of the function.
      I suggest exposing current readAll operation as readbyprefix and using more simpler operations for readAll functionality.
      ex:

      String output = jedis.get(element);
      if (output != null) {
          processContext.output(KV.of(element, output));
      }
      

      instead of:
      https://github.com/apache/beam/blob/7d240c0bb171af6868f1a6e95196c9dcfc9ac640/sdks/java/io/redis/src/main/java/org/apache/beam/sdk/io/redis/RedisIO.java#L292

      Attachments

        Activity

          People

            vvarma Vinay varma
            vvarma Vinay varma
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 6h 20m
                6h 20m