Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20188

Evaluate and address performance delta between branch-1 and branch-2

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • None
    • Performance
    • None

    Description

      How does 2.0.0 compare to old versions? Is it faster, slower? There is rumor that it is much slower, that the problem is the asyncwal writing. Does in-memory compaction slow us down or speed us up? What happens when you enable offheaping?

      Keep notes here in this umbrella issue. Need to be able to say something about perf when 2.0.0 ships.

      Attachments

        1. YCSB_OPs.png
          32 kB
          Michael Stack
        2. YCSB_MEMSTORE.png
          29 kB
          Michael Stack
        3. YCSB_load.png
          42 kB
          Michael Stack
        4. YCSB_in-memory-compaction=NONE.ops.png
          28 kB
          Michael Stack
        5. YCSB_IN_MEMORY_COMPACTION=NONE.ops.png
          31 kB
          Michael Stack
        6. YCSB_GC_TIME.png
          24 kB
          Michael Stack
        7. YCSB_CPU.png
          46 kB
          Michael Stack
        8. workloadx
          3 kB
          Eshcar Hillel
        9. workloadx
          3 kB
          Eshcar Hillel
        10. tree.txt
          985 kB
          Michael Stack
        11. total.png
          23 kB
          Michael Stack
        12. run_ycsb.sh
          7 kB
          Michael Stack
        13. perregion.png
          48 kB
          Michael Stack
        14. lock.2.memsize2.c.20180403T160257Z.svg
          99 kB
          Michael Stack
        15. lock.127.workloadc.20180402T200918Z.svg
          63 kB
          Michael Stack
        16. ITBLL2.5B_1.2.7vs2.0.0_ops.png
          56 kB
          Michael Stack
        17. ITBLL2.5B_1.2.7vs2.0.0_ops_NOT_summing_regions.png
          91 kB
          Michael Stack
        18. ITBLL2.5B_1.2.7vs2.0.0_memstore.png
          23 kB
          Michael Stack
        19. ITBLL2.5B_1.2.7vs2.0.0_memheap.png
          81 kB
          Michael Stack
        20. ITBLL2.5B_1.2.7vs2.0.0_load.png
          112 kB
          Michael Stack
        21. ITBLL2.5B_1.2.7vs2.0.0_iops.png
          40 kB
          Michael Stack
        22. ITBLL2.5B_1.2.7vs2.0.0_gctime.png
          77 kB
          Michael Stack
        23. ITBLL2.5B_1.2.7vs2.0.0_cpu.png
          165 kB
          Michael Stack
        24. hits.png
          48 kB
          Michael Stack
        25. hits_with_fp_scheduler.png
          33 kB
          Michael Stack
        26. hbase-site.xml
          8 kB
          Michael Stack
        27. hbase-site.xml
          3 kB
          Eshcar Hillel
        28. hbase-env.sh
          8 kB
          Michael Stack
        29. HBASE-20188-xac.sh
          2 kB
          Eshcar Hillel
        30. HBASE-20188.sh
          2 kB
          Eshcar Hillel
        31. HBase 2.0 performance evaluation - throughput SSD_HDD.pdf
          49 kB
          Eshcar Hillel
        32. HBase 2.0 performance evaluation - Basic vs None_ system settings.pdf
          36 kB
          Eshcar Hillel
        33. HBase 2.0 performance evaluation - 8GB(1).pdf
          58 kB
          Eshcar Hillel
        34. HBase 2.0 performance evaluation - 8GB.pdf
          36 kB
          Eshcar Hillel
        35. flamegraph-1072.2.svg
          974 kB
          Michael Stack
        36. flamegraph-1072.1.svg
          1020 kB
          Michael Stack
        37. CAM-CONFIG-V01.patch
          3 kB
          Anastasia Braginsky

        Issue Links

          contains

          Sub-task - The sub-task of the issue HBASE-20710 extra cloneFamily() in Mutation.add(Cell)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case.

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-21879 Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HBASE-20337 Update the doc on how to setup shortcircuit reads; its stale

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-20411 Ameliorate MutableSegment synchronize

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link 1.2.7 vs 2.0.0 Flush History during YCSB Load using Client-Side Batching

          Web Link hbase1 to hbase2 compare with and without IN_MEMORY_COMPACTION and with and without MSLAB

          Web Link Profling log/notes

          Web Link Review Board (branch-2.0)

          Activity

            People

              Unassigned Unassigned
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              33 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: