Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40412

limit(x,y) + 子查询 出现数据丢失和乱序问题

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete CommentsDelete
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 2.4.5
    • None
    • Shuffle
    • hive on spark

      hive 3.1.0

      spark 2.4.5

    • Important

    Description

      select * 

      from(

      select * from

      table

      limit 10,20

      )

      结果只有10条  并且不是第11条到第20条  顺序也不对

       

      select * from

      table

      limit 10,20

      结果是20条,顺序是11到第30条

      select * 

      from(

      select * from

      table

      order by id

      limit 10,20

      )

      结果是20条,且顺序也是11到30条

       

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            FengJia97 FengJia
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment