Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11575

the connection of resourcemanager with datanode cannot close after executing the command yarn application -status ats-hbase

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.0
    • None
    • ATSv2, resourcemanager
    • None

    Description

      I encountered a yarn bug where executing the command "yarn application -status ats-hbase" leads to a connection leak between the resourcemanager and datanode. The resourcemanager does not close the connections with the datanode, and on the resourcemanager node, many TCP connections with the datanode are in the CLOSE_WAIT state
      The relevant issue and log screenshots are as follows. The tcpdump log capturing port 1019 is shown below
        
      this is the resourcemanager log

       
      this is the resourcemanager process

       
       
      This is the tcpdump package info of resourcemanager with datanode 1019 port 

       
      this is the tcp connection of resoucemanager with datanode, after rm running a period of time will leave  many close_wait state connection.

       
       
      my  service version is
      amabri: 3.1.1.3.1.0.0-78
      HDFS: 3.1.1.3.1
      yarn: 3.1.0

      Attachments

        1. 5B985F102FAF4EECA0CAD1D20019D181.PNG.crdownload
          57 kB
          zhixing
        2. 5B985F102FAF4EECA0CAD1D20019D181.PNG-1.crdownload
          57 kB
          zhixing
        3. image-2023-09-21-23-51-01-583.png
          139 kB
          zhixing
        4. 微信图片_20230827102251.png
          45 kB
          zhixing
        5. 微信图片_20230827102340.png
          29 kB
          zhixing
        6. 微信图片_20230827103545.png
          36 kB
          zhixing

        Activity

          People

            Unassigned Unassigned
            tommyjiang zhixing
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: