Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-37086

Fix the R test of FPGrowthModel for Scala 2.13

Rank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0
    • ML, R, Tests
    • None

    Description

      Similar to the issue filed in SPARK-37059, the R test of FPGrowthModel assumes that the result records returned by FPGrowthModel.freqItemsets are sorted by a certain kind of order but it's wrong.
      As a result, the test fails with Scala 2.13.

       ══ Failed ══════════════════════════════════════════════════════════════════════
      ── 1. Failure (test_mllib_fpm.R:42:3): spark.fpGrowth ──────────────────────────
      `expected_itemsets` not equivalent to `itemsets`.
      Component “items”: Component 1: Component 1: 1 string mismatch
      Component “items”: Component 2: Length mismatch: comparison on first 1 components
      Component “items”: Component 2: Component 1: 1 string mismatch
      Component “items”: Component 3: Length mismatch: comparison on first 1 components
      Component “items”: Component 4: Length mismatch: comparison on first 1 components
      Component “items”: Component 4: Component 1: 1 string mismatch
      Component “items”: Component 5: Length mismatch: comparison on first 1 components
      Component “items”: Component 5: Component 1: 1 string mismatch
      Component “freq”: Mean relative difference: 0.5454545
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sarutak Kousuke Saruta
            sarutak Kousuke Saruta
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment