Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40412

limit(x,y) + 子查询 出现数据丢失和乱序问题

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 2.4.5
    • None
    • Shuffle
    • hive on spark

      hive 3.1.0

      spark 2.4.5

    • Important

    Description

      select * 

      from(

      select * from

      table

      limit 10,20

      )

      结果只有10条  并且不是第11条到第20条  顺序也不对

       

      select * from

      table

      limit 10,20

      结果是20条,顺序是11到第30条

      select * 

      from(

      select * from

      table

      order by id

      limit 10,20

      )

      结果是20条,且顺序也是11到30条

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            FengJia97 FengJia
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: