Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21382

Standalone K8s documentation does not explain usage of standby JobManagers

    XMLWordPrintableJSON

Details

    Description

      Our standalone K8s documentation mentions how to configure K8s HA services. It does not mention that this only works with a single JobManager. When using standby JobManagers, then the given deployment yamls won't work because the jobmanager.rpc.address is configured to be the jobmanager service.

      Changing the configuration to work is surprisingly difficult because of a lack of documentation. Moreover, it is quite difficult to pass in custom configuration values when using a ConfigMap for sharing Flink's flink-conf.yaml. The problem is that mounted ConfigMaps are not writable from a pod perspective. See this answer for how one could achieve it.

      I think we could improve our documentation to explain our users how to configure a standalone HA cluster with standby JobManagers.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-21082 Document how to start multiple JobManagers in HA mode for Kubernetes deployment

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-21432 Web UI -- Error - {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]}

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. FLINK-21685 Flink JobManager failed to restart from checkpoint in kubernetes HA setup

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. FLINK-21472 FencingTokenException: Fencing token mismatch

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #15248

          Activity

            People

              wangyang0918 Yang Wang
              trohrmann Till Rohrmann
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: