Details
-
Test
-
Status: Resolved
-
P3
-
Resolution: Fixed
-
None
-
None
Description
Add test(s) to confirm Hadoop version compatibility for hadoop_client library version against different users' environment.
https://github.com/apache/beam/pull/10222#issuecomment-559158067
Ismaël Mejía had an idea:
After a quick review most of the major users and systems still support 2.7 and ‘even worse’ 2.6. So I was wondering how can we ensure that new patches on Hadoop modules don’t break backwards compatibility.
One idea could be to add an extra set of tests that run the build for the provided previous versions of the dependencies. But I don’t have a clue how to do this in gradle. Do you by any chance? (Note that a fix for this will solve other compatibility issues we have with other systems and provided dependencies e.g. Spark and Kafka).
Attachments
Issue Links
- is required by
-
BEAM-8569 Support Hadoop 3 on Beam
- Triage Needed
- links to