Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8876

Tests to confirm Hadoop version compatibility

Details

    • Test
    • Status: Resolved
    • P3
    • Resolution: Fixed
    • None
    • 2.27.0
    • build-system
    • None

    Description

      Add test(s) to confirm Hadoop version compatibility for hadoop_client library version against different users' environment.

      https://github.com/apache/beam/pull/10222#issuecomment-559158067

      Ismaël Mejía had an idea:

      After a quick review most of the major users and systems still support 2.7 and ‘even worse’ 2.6. So I was wondering how can we ensure that new patches on Hadoop modules don’t break backwards compatibility.

      One idea could be to add an extra set of tests that run the build for the provided previous versions of the dependencies. But I don’t have a clue how to do this in gradle. Do you by any chance? (Note that a fix for this will solve other compatibility issues we have with other systems and provided dependencies e.g. Spark and Kafka).

      Attachments

        Issue Links

          Activity

            People

              piotr-szuberski Piotr Szuberski
              suztomo Tomo Suzuki
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 6h 20m
                  6h 20m

                  Slack

                    Issue deployment