Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22157

Hive Pushing Aggr extension to Druid

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.0, 3.0.0, 3.1.1, 3.1.2
    • None
    • Druid integration
    • None

    Description

      Currently Hive can not push aggr spec if one want to use customized extension in druid for the execution

      when using Hive, below query is been rewritten with no aggr defined 

      Explain  select  floor_day(`_time`),count(distinct visitor_id) as uv from druid group by floor_day(`_time`);

      .....

      "limitSpec":{"type":"default"},

      "aggregations":[],

      "intervals":["1900-01-01T00:00:00.000Z/3000-01-01T00:00:00.000Z"]

      ...... 

       

      But what one really need was 

       

      "aggregations": [

      { "type": "distinctCount", "name": "uv", "fieldName": "visitor_id" }

      ]

       

      and aggregations spec is using the druid-distinctcount extension.  

       

      If we can call Druid's Native UDAF from HiveSQL and been able push that into the generated Druid query spec, this would be a nice thing to power up the Hive-Druid Integration.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            liuyan liuyan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: