Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-16642

[SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      EditlogTailer cost a long time for selecting InputStreams from Journalnode while holding the write lock of FSNLock.
      During this period, 8020 handlers of Observer NameNode will be blocked by the FSN Lock.

      In theory, selecting inputstreams from JournalNode does not involve changing memory information in NameNode, so we can move the selecting out of the FSN Lock, and it can improve the throughput of Observer NameNode.

      Attachments

        Issue Links

          Activity

            People

              xuzq_zander ZanderXu
              xuzq_zander ZanderXu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 10m
                  2h 10m