Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1468

incremental read support with clustering

    XMLWordPrintableJSON

Details

    Description

      As part of clustering, metadata such as hoodie_commit_time changes for records that are clustered. This is specific to SparkBulkInsertBasedRunClusteringStrategy implementation. Figure out a way to carry commit_time from original record to support incremental queries.

      Also, incremental queries dont work with 'replacecommit' used by clustering HUDI-1264. Change incremental query to work for replacecommits created by Clustering.

      Attachments

        Activity

          People

            309637554 liwei
            satishkotha satish
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: