Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3240

Quickstart examples archetype dependencies conflict for Apex on YARN

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • 2.0.0
    • 2.3.0
    • runner-apex
    • None

    Description

      The archetype builds a fat jar that includes the Apex runners dependencies, which transitively include YARN 2.6 (as that's what Apex 3.6 was built against). There will be a conflict if the Hadoop version on the cluster is more recent (like 2.7.3). Project needs to include the YARN version that matches the cluster.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. BEAM-2270 Examples archetype bundles Hadoop 2.6 in its jar for ApexRunner; cannot run on Hadoop 2.7?

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. BEAM-2113 Apex Runner is not able to submit any job to YARN

          • P0 - Outage blocking development and/or testing work; requires immediate and continuous attention
          • Resolved
          links to

          Web Link GitHub Pull Request #4402

          Activity

            People

              thw Thomas Weise
              thw Thomas Weise
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: