Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3593

updated impala from impala2.3 to impala 2.5 -v4709 sorternode becoming slower

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.5.0
    • Impala 2.5.0
    • Backend
    • None

    Description

      sql : select UNIX_TIMESTAMP( CAST(REQUEST_MIN AS STRING), 'yyyyMMddHHmm' ) * 1000 - 28800000 AS REQUEST_TS, REQUEST_MIN, MEMBERID, CATE3_ID, CASE WHEN ROW_NUM > 1 THEN 1 ELSE 0 END AS IS_REPURCHASE FROM ( SELECT REQUEST_MIN, MEMBERID, CATE3_ID, max(ROW_NUM) AS ROW_NUM FROM ( SELECT REQUEST_MIN, MEMBERID, CASE WHEN C.CATE3_ID IS NULL THEN -1 ELSE C.CATE3_ID END AS CATE3_ID, ROW_NUMBER() OVER(partition by REQUEST_MIN, MEMBERID, C.CATE3_ID order by REQUEST_MIN) AS ROW_NUM FROM ( select ORDERID, PRODUCTID FROM CP_ORDERDETAIL WHERE CREATEDATE >= '2016-05-17 00:00:00' AND CREATEDATE < '2016-05-23 14:11:00' ) OD INNER JOIN ( SELECT CAST(FROM_UNIXTIME(UNIX_TIMESTAMP(CREATEDATE), 'yyyyMMddHHmm') AS BIGINT ) AS REQUEST_MIN, ID, MEMBERID FROM CP_ORDERS WHERE CREATEDATE >= '2016-05-17 00:00:00' AND CREATEDATE < '2016-05-23 14:11:00' AND YN = 1 ) O ON OD.ORDERID = O.ID LEFT JOIN [SHUFFLE] CP_SKU S ON OD.PRODUCTID = S.SKU_ID LEFT JOIN [SHUFFLE] CP_PRODUCT P ON S.PRODUCT_ID = P.PRODUCT_ID LEFT JOIN CATES C ON P.CATEGORY_ID = C.CATE3_ID ) XX WHERE REQUEST_MIN >= 201605231410 group by REQUEST_MIN, MEMBERID, CATE3_ID ) xx

      just now I have no time to analysis why

      Attachments

        1. screenshot-2.png
          25 kB
          fishing
        2. screenshot-1.png
          185 kB
          fishing
        3. JDIM201605231549172.jpg
          132 kB
          fishing
        4. Cloudera Impala.html
          35 kB
          fishing
        5. after_update_sort_Cloudera Impala.html
          35 kB
          fishing

        Activity

          People

            Unassigned Unassigned
            fish0515_impala_49b1 fishing
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: