Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-2315

Local timestamps fields for Avro schema are not supported

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.14.0
    • None
    • parquet-avro
    • None

    Description

      Avro schema supports the creation of local timestampe fields:

      LocalTimestampMillis datetimeType = LogicalTypes.localTimestampMillis();
field = new Schema.Field(attrDesc.getAttributeName(), Schema.createUnion(datetimeType.addToSchema(Schema.create(Schema.Type.LONG), Schema.create(Schema.Type.NULL)), doc, null);

      But since there is no support in the AvroSchemaConverter.convertLogicalType method, these fields end up as BIGINT (as reported in e.g. Apache Drill).

      Attachments

        Activity

          People

            Unassigned Unassigned
            edi.gonzales Stefan Ziegler
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: