Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4870 Extend Catalog metrics
  3. IMPALA-5963

Extend Catalog metrics to list tables that are being loaded along with the ones in the queue

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Catalog
    • None
    • ghx-label-7

    Description

      The Catalog log prints the information below which doesn't clearly show what tables are being loaded, how long is the queue and how far in the queue is a particular table.

      I0920 11:18:35.363430 25757 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:18:35.363581 25757 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:46.076735 25760 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:46.076875 25760 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:46.272711 25753 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:46.272855 25753 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:48.300680 25752 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:48.300765 25758 TableLoadingMgr.java:285] Loading next table from queue: mydb2.t2
      I0920 11:18:48.301048 25752 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:18:48.301106 25758 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:09.699975 25762 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:09.700096 25762 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:12.123028 25755 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:12.123165 25755 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:12.986537 25763 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:12.986656 25763 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:12.986994 25766 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:12.987102 25766 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:14.211904 25759 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:14.212038 25759 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:16.055563 25767 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      I0920 11:19:16.055711 25767 TableLoadingMgr.java:287] Remaining items in queue: 0. Loads in progress: 0
      I0920 11:19:16.059411 25754 TableLoadingMgr.java:285] Loading next table from queue: mydb.t1
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            mmokhtar Mostafa Mokhtar
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: