Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11890

Uber-JIRA: Hadoop should support IPv6

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • net

    Description

      Hadoop currently treats IPv6 as unsupported. Track related smaller issues to support IPv6.

      (Current case here is mainly HBase on HDFS, so any suggestions about other test cases/workload are really appreciated.)

      Attachments

        1. hadoop_2.7.3_ipv6_commits.txt
          2 kB
          Konstantin Shvachko

        Issue Links

        is cloned by

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-17800 CLONE - Uber-JIRA: Hadoop should support IPv6

        • Major - Major loss of function.
        • Open
        is depended upon by

        Sub-task - The sub-task of the issue HADOOP-17543 HDFS Put was failed with IPV6 cluster

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open
        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-14762 "Path(Path/String parent, String child)" will fail when "child" contains ":"

        • Major - Major loss of function.
        • Reopened

        Improvement - An improvement or enhancement to an existing feature or task. YARN-1226 Inconsistent hostname leads to low data locality on IPv6 hosts

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. YARN-8604 Modify WebApps.Builder<T>#at to parse IPv6 address

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Patch Available

        Task - A task that needs to be done. HADOOP-11574 Uber-JIRA: improve Hadoop network resilience & diagnostics

        • Major - Major loss of function.
        • Open

        Task - A task that needs to be done. MAPREDUCE-6519 Avoid unsafe split and append on fields that might be IPv6 literals

        • Major - Major loss of function.
        • Resolved

        Task - A task that needs to be done. MAPREDUCE-6523 hadoop-yarn Avoid unsafe split and append on fields that might be IPv6 literals

        • Major - Major loss of function.
        • Resolved

        Task - A task that needs to be done. YARN-4283 Avoid unsafe split and append on fields that might be IPv6 literals

        • Major - Major loss of function.
        • Resolved
        relates to

        Task - A task that needs to be done. HDFS-9266 Avoid unsafe split and append on fields that might be IPv6 literals

        • Major - Major loss of function.
        • Resolved
        links to

        Web Link https://github.com/ghelmling/hadoop/tree/branch-2.7.3-ipv6

        1.
        		 Fix HDFS client gets errors trying to to connect to IPv6 DataNode Sub-task Resolved Nate Edel   Actions
        2.
        		 Allow hadoop.sh to bind to ipv6 conditionally Sub-task Resolved Elliott Neil Clark   Actions
        3.
        		 DNS.getHosts triggers an ArrayIndexOutOfBoundsException in reverseDNS if one of the interfaces is IPv6 Sub-task Resolved Dr. Martin Menzel   Actions
        4.
        		 org.apache.hadoop.net.TestDNS failing with NumberFormatException -IPv6 related? Sub-task Resolved Varun Saxena   Actions
        5.
        		 DNS#reverseDns fails with a NumberFormatException when using an IPv6 DNS server Sub-task Resolved Unassigned   Actions
        6.
        		 NameNode should bind on both IPv6 and IPv4 if running on dual-stack machine and IPv6 enabled Sub-task Resolved Unassigned   Actions
        7.
        		 Add support for include/exclude lists on IPv6 setup Sub-task Resolved Nemanja Matkovic

        0%
        Original Estimate - 168h
        Remaining Estimate - 168h
        		Actions
        8.
        		 Fix Hadoop should avoid unsafe split and append on fields that might be IPv6 literals Sub-task Resolved Nemanja Matkovic   Actions
        9.
        		 Don't prefer IPV4 stack on tests. Sub-task Resolved Elliott Neil Clark   Actions
        10.
        		 Hadoop-common - Avoid unsafe split and append on fields that might be IPv6 literals Sub-task Resolved Nemanja Matkovic

        0%
        Original Estimate - 48h
        Remaining Estimate - 48h
        		Actions
        11.
        		 Fix TestNetUtils and TestSecurityUtil when localhost is ipv6 only Sub-task Resolved Elliott Neil Clark   Actions
        12.
        		 Fix libexec scripts that unconditionally add on preferIPv4 Sub-task Resolved Elliott Neil Clark   Actions
        13.
        		 NetUtils.createSocketAddr was not handling IPV6 scoped address Sub-task Resolved Hemanth Boyina   Actions
        14.
        		 IPV6 support in Netutils#createSocketAddress Sub-task Resolved Renukaprasad C

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 3h 50m
        		Actions
        15.
        		 better Logging in DNS.java Sub-task Open Unassigned   Actions
        16.
        		 Clean up IPv6 code Sub-task Open Unassigned   Actions
        17.
        		 Update documentation to reflect IPv6 Hadoop cluster setup Sub-task Open Unassigned   Actions
        18.
        		 HDFS Put was failed with IPV6 cluster Sub-task Open Unassigned   Actions
        19.
        		 Support IPV6 with IP for internal and external communication Sub-task In Progress Renukaprasad C

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h 40m
        		Actions
        20.
        		 Support IPv6 for ChecksumFileSystem Sub-task Open Renukaprasad C

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        		Actions
        21.
        		 Fix links to DataNodes in NameNode UI to support IPv6 Sub-task Patch Available Renukaprasad C

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 1h 20m
        		Actions
        22.
        		 [IPv6] Yarn WebApps to support IPv6 address. Sub-task Open Renukaprasad C

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 20m
        		Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            nkedel Nate Edel
            nkedel Nate Edel
            Votes:
            6 Vote for this issue
            Watchers:
            65 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 216h Original Estimate - 216h
                216h
                Remaining:
                Time Spent - 8h 50m Remaining Estimate - 216h
                216h
                Logged:
                Time Spent - 8h 50m Remaining Estimate - 216h
                8h 50m

                Slack

                  Issue deployment