Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11369

Commons.compress throws an IllegalArgumentException with large uids after 1.21

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • client
    • Reviewed

    Description

      Encountering COMPRESS-587 with large uids/gids in hadoop-mapreduce-client-uploader/src/main/java/org/apache/hadoop/mapred/uploader/FrameworkUploader.java:

      22/09/13 06:39:05 INFO uploader.FrameworkUploader: Adding /cs/cloudera/opt/cloudera/cm/lib/plugins/event-publish-7.7.1-shaded.jar
Exception in thread "main" java.lang.IllegalArgumentException: group id '5049047' is too big ( > 2097151 ). Use STAR or POSIX extensions to overcome this limit

      A workaround is to specifically set bignumber mode to BIGNUMBER_POSIX or BIGNUMBER_STAR on the instance.

      Attachments

        Issue Links

          links to

          Web Link GitHub Pull Request #5116

          Activity

            People

              bteke Benjamin Teke
              bteke Benjamin Teke
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: