Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-890

Support Livy session restore for k8s

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • 0.9.0
    • None
    • None

    Description

      Currently, session restore is only supported for YARN, according to

      https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419

      Since Serverless Apache Spark service running on OKE (Oracle OCI), EKS (AWS), GKE (GCP), AKS (Azure) are getting more popular as a cost-effective alternative than YARN, it is needed to support session restore for k8s for both batch and interactive sessions.  

      Attachments

        Activity

          People

            Unassigned Unassigned
            dexterhu Dexter Hu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: