Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-885

Report task information in addition to progress

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.7.0, 0.8.0
    • 0.9.0
    • REPL, RSC
    • None
    • all

    Description

      It might be useful to include information about the number of tasks:

      • active
      • failed
      • completed
      • total

      And not just the progress (completed/total). In a similar manner to what is done now, these could be summation of each category for all stages of the statements job. The API could then return something like:

      { ..., "progress": 0.8, "tasks": {"active": 2, "completed": 8, "total": 10, "failed": 0 } }

      Users could then construct an indicator in the flavor of that in the spark UI. 

      Attachments

        Activity

          People

            Unassigned Unassigned
            arikm Arik W. Mitschang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: