Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13891

HDFS RBF stabilization phase I

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • None
    • None

    Description

      RBF(Router Based Federation) shipped in 3.0+ and 2.9..

      now its out various corner cases, scale and error handling issues are surfacing.

      And we are targeting security feaiure (HDFS-13532) also.

      this umbrella to fix all those issues and support missing protocols(HDFS-13655) before next 3.3 release.

      Attachments

        Issue Links

        incorporates

        New Feature - A new feature of the product, which has yet to be developed. HDFS-13532 RBF: Adding security

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-13655 RBF: Add missing ClientProtocol APIs to RBF

        • Major - Major loss of function.
        • Resolved
        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-12615 Router-based HDFS federation phase 2

        • Major - Major loss of function.
        • Resolved
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-14603 Über-JIRA: HDFS RBF stabilization phase II

        • Major - Major loss of function.
        • Open
        1.
        		 RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails Sub-task Resolved Takanobu Asanuma Actions
        2.
        		 RBF: RouterAdmin update cmd is overwriting the entry not updating the existing Sub-task Resolved Ayush Saxena Actions
        3.
        		 RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Sub-task Resolved Mohammad Arshad Actions
        4.
        		 RBF: Fail when try to remove mount point paths Sub-task Resolved Akira Ajisaka Actions
        5.
        		 RBF: Connection creator thread should catch Throwable Sub-task Resolved CR Hota Actions
        6.
        		 RBF: Add multiple paths for dfsrouteradmin "rm" and "clrquota" commands Sub-task Resolved Ayush Saxena Actions
        7.
        		 RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Sub-task Resolved yanghuafeng Actions
        8.
        		 RBF: The default MountTableResolver should fail resolving multi-destination paths Sub-task Resolved yanghuafeng Actions
        9.
        		 RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics Sub-task Resolved Ranith Sardar Actions
        10.
        		 RBF: Add more information to HdfsFileStatus for a mount point Sub-task Resolved Akira Ajisaka Actions
        11.
        		 RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService Sub-task Resolved CR Hota Actions
        12.
        		 RBF: LS command for root shows wrong owner and permission information. Sub-task Resolved Ayush Saxena Actions
        13.
        		 RBF: Add option to fail operations when a subcluster is unavailable Sub-task Resolved Íñigo Goiri Actions
        14.
        		 RBF: MIN_ACTIVE_RATIO should be configurable Sub-task Resolved Hui Fei Actions
        15.
        		 RBF: Make the read-only column of Mount Table clearly understandable Sub-task Resolved Takanobu Asanuma Actions
        16.
        		 RBF: Fix a typo in RouterAdmin usage Sub-task Resolved Ayush Saxena Actions
        17.
        		 RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection Sub-task Resolved Hui Fei Actions
        18.
        		 RBF: RouterAdmin should support dfsrouteradmin -refreshRouterArgs command Sub-task Resolved yanghuafeng Actions
        19.
        		 RBF: Add stale nodes to federation metrics Sub-task Resolved Íñigo Goiri Actions
        20.
        		 RBF: Quotas of the sub-cluster should be removed when removing the mount point Sub-task Resolved Takanobu Asanuma Actions
        21.
        		 RBF: Remove hard coded router status from FederationMetrics. Sub-task Resolved Ranith Sardar Actions
        22.
        		 RBF: Inconsistency with the Default Namespace Sub-task Resolved Ayush Saxena Actions
        23.
        		 RBF: Cleanup quota modules Sub-task Resolved Íñigo Goiri Actions
        24.
        		 RBF: rollEdit() command fails with Router Sub-task Resolved Shubham Dewan Actions
        25.
        		 RBF: setQuota() through router is working for only the mount Points under the Source column in MountTable Sub-task Resolved Shubham Dewan Actions
        26.
        		 RBF: ACL commands should work over all the destinations Sub-task Resolved Ayush Saxena Actions
        27.
        		 RBF: Remove dependency on availability of default namespace Sub-task Resolved Ayush Saxena Actions
        28.
        		 RBF: Add configuration documents for using multiple sub-clusters Sub-task Resolved Takanobu Asanuma Actions
        29.
        		 RBF: NPE in getContentSummary() for getEcPolicy() in case of multiple destinations Sub-task Resolved Ayush Saxena Actions
        30.
        		 RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace Sub-task Resolved Ranith Sardar Actions
        31.
        		 RBF: Setting attributes should set on all subclusters' directories. Sub-task Resolved Ayush Saxena Actions
        32.
        		 RBF: Tooling to identify the subcluster location of a file Sub-task Resolved Íñigo Goiri Actions
        33.
        		 RBF : Exceptions are exposing the actual sub cluster path Sub-task Resolved Ayush Saxena Actions
        34.
        		 RBF: Fix safemode message for Router Sub-task Resolved Ranith Sardar Actions
        35.
        		 RBF: Fix the location of the DNs in getDatanodeReport() Sub-task Resolved Íñigo Goiri Actions
        36.
        		 RBF: Throw RetriableException instead of IOException when no namenodes available Sub-task Resolved Hui Fei Actions
        37.
        		 RBF: Support unavailable subclusters for mount points with multiple destinations Sub-task Resolved Íñigo Goiri Actions
        38.
        		 RBF: Add maintenance nodes to federation metrics Sub-task Resolved Ayush Saxena Actions
        39.
        		 RBF: IOE While Removing Mount Entry Sub-task Resolved Ayush Saxena Actions
        40.
        		 RBF: Use human readable format for long numbers in the Router UI Sub-task Resolved Íñigo Goiri Actions
        41.
        		 RBF: Fix renaming folders spread across multiple subclusters Sub-task Resolved Ayush Saxena Actions
        42.
        		 RBF: Optimize configuration item resolving for monitor namenode Sub-task Resolved Xiaoqiao He Actions
        43.
        		 RBF: Fix trailing "/" for webhdfs Sub-task Resolved Akira Ajisaka Actions
        44.
        		 RBF: Prevent loading metric system when disabled Sub-task Resolved Íñigo Goiri Actions
        45.
        		 RBF: Router shouldn't allow READ operations in safe mode Sub-task Resolved Íñigo Goiri Actions
        46.
        		 RBF: Optimize the file write process in case of multiple destinations. Sub-task Resolved Ayush Saxena Actions
        47.
        		 RBF: Add safemode to Router UI Sub-task Resolved Fengnan Li Actions
        48.
        		 RBF: Router should support RefreshUserMappingsProtocol Sub-task Resolved Shen Yinjie Actions
        49.
        		 RBF: getContentSummary() should allow non-existing folders Sub-task Resolved Íñigo Goiri Actions
        50.
        		 RBF: Add order text SPACE in CLI command 'hdfs dfsrouteradmin' Sub-task Resolved luhuachao Actions
        51.
        		 RBF: Remove unnecessary quota checks Sub-task Resolved Ayush Saxena Actions
        52.
        		 RBF: Clean-up and refactor UI components Sub-task Resolved Takanobu Asanuma Actions
        53.
        		 RBF: Create hdfs-rbf-site.xml for RBF specific properties Sub-task Resolved Takanobu Asanuma Actions
        54.
        		 RBF: Separate namenodeHeartbeat and routerHeartbeat to different config key Sub-task Resolved Ayush Saxena Actions
        55.
        		 RBF: Update the document of RBF related metrics Sub-task Resolved Takanobu Asanuma Actions
        56.
        		 RBF: Router should support GetUserMappingsProtocol Sub-task Resolved Ayush Saxena Actions
        57.
        		 RBF: Failed to get statistics from NameNodes before 2.9.0 Sub-task Resolved Xiaoqiao He Actions
        58.
        		 RBF: updateMount should validate the newEntry in RouterAdmin Sub-task Resolved ZanderXu Actions
        59.
        		 RBF: Remove FSCK from Router Web UI Sub-task Resolved Hui Fei Actions
        60.
        		 RBF: Add FSCK to the Router Sub-task Resolved Akira Ajisaka Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            brahmareddy Brahma Reddy Battula
            Votes:
            0 Vote for this issue
            Watchers:
            24 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment