Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-413

Run map/reduce job to populate initial index table if data table is big

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Resolution: Fixed
    • None
    • None
    • None
    • 282

    Description

      Instead of internally running an UPSERT SELECT to initially populate the index table when the data table is big, we should run a map/reduce job. That way, in the event of failure, the job can pick up where it left off. Plus users will have better visibility into the % completion. Once we start collecting stats, we'll have a better idea of the size of the data table when an index is created and can make the decision based on that.

      Attachments

        Activity

          People

            dhacker1341 Dave Hacker
            jamestaylor James R. Taylor
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: