Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-9662

compactionManager reporting wrong pendingtasks

Agile BoardAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Low
    • Resolution: Fixed
    • 2.0.17, 2.1.9
    • Legacy/CQL
    • None
    • Low

    Description

      Yesterday I upgraded my Cassandra cluster from 2.0.14 to 2.0.16, after upgrade, I am start seeing some strange behaviours of "PendingTasks" reporting.

      The Cassandra repository I am using is datastax, steps I performed for upgrade:

      yum update -y cassandra20

      The upgrade went fine, after upgrade cluster is operating okay. "nodetool info and nodetool status" results looked fine. "nodetool version" is reporting the correct version.

      But our monitoring system start reporting some crazy "pendingtasks". For example, "pending taks" for node1 sometimes jump from 0 to 15K for about 1 minute, then drop back to 0. This issue keeps occurring, didn't have this issue with 2.0.14. Our monitoring system is checking the value of "MBeans" -> "CompactionManager" -> "PendingTasks".

      Attachments

        Issue Links

        is duplicated by

        Bug - A problem which impairs or prevents the functions of the product. CASSANDRA-9683 Get mucher higher load and latencies after upgrading from 2.1.6 to cassandra 2.1.7

        • Normal -
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. CASSANDRA-9744 unrealistic pending compactions displayed

        • Normal -
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. CASSANDRA-9914 Millions of fake pending compaction tasks + high CPU

        • Normal -
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. CASSANDRA-11025 Too many compactions on certain node when too many empty tables are created

        • Normal -
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yukim Yuki Morishita Assign to me
            lazyadmin Tony Xu
            Yuki Morishita
            Benedict Elliott Smith
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment