Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • client
    • None

    Description

      Investigate current version of Apache Airflow regarding following:

      • how to define a DAG
        • nodes
        • edges
        • transitions
        • decision and fork / join nodes
        • checks on DAGness, and on completeness
      • how are connections between DAGs handled
        • state of one running / already finished DAG is respected by another DAG
      • creation / running process
        • what to define w/ Python code
        • and what using templates
        • inheritance in Python
        • third party libs in Python code while creating a DAG
        • how are DAGs stored and submitted / run
        • what patterns are used under the hood (builder, delegate, ...)
        • how is logic considered (Oozie EL functions)
      • how to schedule a DAG (Oozie Coordinators)
      • how to bundle these together (Oozie Bundles)

      Attachments

        Activity

          People

            daniel.becker Daniel Becker
            andras.piros Andras Piros
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 16h
                16h
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 16h
                16h