Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-2260

Paginated getChildren call

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 3.4.6, 3.5.0
    • None
    • None

    Description

      Add pagination support to the getChildren() call, allowing clients to iterate over children N at the time.

      Motivations for this include:

      • Getting out of a situation where so many children were created that listing them exceeded the network buffer sizes (making it impossible to recover by deleting)[1]
      • More efficient traversal of nodes with large number of children [2]

      I do have a patch (for 3.4.6) we've been using successfully for a while, but I suspect much more work is needed for this to be accepted.

      [1] https://issues.apache.org/jira/browse/ZOOKEEPER-272
      [2] https://issues.apache.org/jira/browse/ZOOKEEPER-282

      Attachments

        1. ZOOKEEPER-2260.patch
          25 kB
          Marco P.
        2. ZOOKEEPER-2260.patch
          26 kB
          Marco P.

        Issue Links

        blocks

        Improvement - An improvement or enhancement to an existing feature or task. HBASE-14938 Limit the number of znodes for ZK in bulk loaded hfile replication

        • Major - Major loss of function.
        • Closed
        is duplicated by

        New Feature - A new feature of the product, which has yet to be developed. ZOOKEEPER-4383 GetChildren Pagination Feature

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. ZOOKEEPER-282 the getchildren api in zookeeper should return an iterator.

        • Major - Major loss of function.
        • Resolved
        relates to

        New Feature - A new feature of the product, which has yet to be developed. ZOOKEEPER-4383 GetChildren Pagination Feature

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. ZOOKEEPER-1162 consistent handling of jute.maxbuffer when attempting to read large zk "directories"

        • Major - Major loss of function.
        • Open
        links to

        Web Link GitHub Pull Request #50

        Web Link GitHub Pull Request #50

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mprime Marco P.
            mprime Marco P.
            Votes:
            4 Vote for this issue
            Watchers:
            26 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                Slack

                  Issue deployment