Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-3672

Data Provenance and DFS metadata

    XMLWordPrintableJSON

Details

    • Important

    Description

      My present query on Apache Drill is as follows -

      select
      CAST(columns[0] AS Integer) as ID,
      to_timestamp(SUBSTR(columns[10],1,14),'YYYYMMddHHmmss') as RecordDt
      from dfs.`/data/100Krows/`
      What I would like to do is get the modificationTime metadata for each of the .csv files in my folder as a column something like this -

      select
      CAST(columns[0] AS Integer) as ID,
      to_timestamp(SUBSTR(columns[10],1,14),'YYYYMMddHHmmss') as RecordDt,
      modificationTime as versionStartTime
      from dfs.`/data/100Krows/`
      The modificationTime along with filename metadata can be found when I run the following qry

      SHOW FILES in dfs.data
      Is there a way to achieve this in its current version 1.1 or 1.0?

      Attachments

        Activity

          People

            Unassigned Unassigned
            dakuji Ajith Dharwar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: