Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-2260

Paginated getChildren call

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 3.4.6, 3.5.0
    • None
    • None

    Description

      Add pagination support to the getChildren() call, allowing clients to iterate over children N at the time.

      Motivations for this include:

      • Getting out of a situation where so many children were created that listing them exceeded the network buffer sizes (making it impossible to recover by deleting)[1]
      • More efficient traversal of nodes with large number of children [2]

      I do have a patch (for 3.4.6) we've been using successfully for a while, but I suspect much more work is needed for this to be accepted.

      [1] https://issues.apache.org/jira/browse/ZOOKEEPER-272
      [2] https://issues.apache.org/jira/browse/ZOOKEEPER-282

      Attachments

        1. ZOOKEEPER-2260.patch
          26 kB
          Marco P.
        2. ZOOKEEPER-2260.patch
          25 kB
          Marco P.

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-14938 Limit the number of znodes for ZK in bulk loaded hfile replication

          • Major - Major loss of function.
          • Closed
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. ZOOKEEPER-4383 GetChildren Pagination Feature

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ZOOKEEPER-282 the getchildren api in zookeeper should return an iterator.

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. ZOOKEEPER-4383 GetChildren Pagination Feature

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ZOOKEEPER-1162 consistent handling of jute.maxbuffer when attempting to read large zk "directories"

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #50

          Web Link GitHub Pull Request #50

          Activity

            People

              mprime Marco P.
              mprime Marco P.
              Votes:
              4 Vote for this issue
              Watchers:
              26 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m