Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10222

Dataflow sets CPU limits on docker containers near zero so Java 11 only detects 1 CPU

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.26.0
    • runner-dataflow
    • None

    Description

      When specifying the worker-type as "n1-highcpu-4" the resulting thread number is 4 when the pipeline is compiled by Java8, and only 1 when the pipeline is compiled by Java11.

      Specifying numberOfWorkerHarnessThreads does not change amount of detected threads.

      Amount of available CPUs is received via "Runtime.getRuntime().availableProcessors()"

      Attachments

        Issue Links

          Activity

            People

              kenn Kenneth Knowles
              Ardagan Mikhail Gryzykhin
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: