Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-4131

Reduce apache commons collections direct dependencies

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 0.10.0, 0.9.3
    • None
    • None

    Description

      Tez has limited use of direct apache commons collects, but ships both commons collections 3 and 4

      Dependent jars
      commons-collections-3.2.2.jar
      commons-collections4-4.1.jar
      
      Usage
      $ git grep org.apache.commons.coll
      tez-api/src/main/java/org/apache/tez/dag/api/DAG.java:import org.apache.commons.collections4.BidiMap;
      tez-api/src/main/java/org/apache/tez/dag/api/DAG.java:import org.apache.commons.collections4.bidimap.DualLinkedHashBidiMap;
      tez-dag/src/main/java/org/apache/tez/dag/app/TaskCommunicatorManager.java:import org.apache.commons.collections4.ListUtils;
      tez-mapreduce/src/main/java/org/apache/tez/mapreduce/hadoop/mapred/MRCounters.java:import org.apache.commons.collections.IteratorUtils;
      tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/DagInfo.java:import org.apache.commons.collections.BidiMap;
      tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/DagInfo.java:import org.apache.commons.collections.bidimap.DualHashBidiMap;
      

      Likely, we can either converge on either commons collections 3 or 4 or remove them all together if a viable substitute for the bidirectional maps can be found.

      Attachments

        1. TEZ-4131.1.patch
          4 kB
          Butao Zhang
        2. TEZ-4131.2.patch
          3 kB
          Butao Zhang
        3. TEZ-4131.3.patch
          4 kB
          Butao Zhang
        4. TEZ-4131.4.patch
          4 kB
          Butao Zhang

        Activity

          People

            zhangbutao Butao Zhang
            jeagles Jonathan Turner Eagles
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: