Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-32321

Temporal Join job missing condition after “ON”

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.18.0, 1.17.1
    • None
    • Table SQL / Gateway
    • None

    Description

      We have a SQL job, like this

      select ... from prod_kafka.f_alarm_tag_dev
       /*+ OPTIONS('scan.startup.mode' = 'latest-offset') */ as f 
      left join mysql_bnpmp.gem_bnpmp.f_a_alarm_filter
       /*+ OPTIONS('lookup.cache.max-rows' = '5000',
       'lookup.cache.ttl' = '30s') */
      FOR SYSTEM_TIME AS OF f.proctime ff  on ff.rule_type = 0 and f.ne_ip = ff.ip 

      We submit to flink 1.17.1 & 1.18 rc2 cluster with sql-gateway. We found job detail missing lookup condition (rule_type=0) 

        +- [1196]:LookupJoin(table=[mysql_bnpmp.gem_bnpmp.f_a_alarm_filter], joinType=[LeftOuterJoin], lookup=[ip=ne_ip], select=[event_id, 

      We submit same sql to flink 1.17.0 cluster with sql-gateway. There is (rule_type=0) lookup condition

        +- [3]:LookupJoin(table=[mysql_bnpmp.gem_bnpmp.f_a_alarm_filter], joinType=[LeftOuterJoin], lookup=[rule_type=0, ip=ne_ip], where=[(rule_type = 0)], select=[event_id, severity,

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            macdoor615 macdoor615
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: