[Java][Packaging] Nigthly build is generating excessive jars

Since June 24 the nightly build is generating multiple jars for the same module.

In that example: https://github.com/ursacomputing/crossbow/releases/tag/nightly-packaging-2022-06-24-0-github-java-jars you can find three different jars for the arrow-gandiva.

I looked at the scripts for java build, the jinja macros that upload the artifacts, and the YAML file that defines the job for java jars, and all files were not changed recently. Maybe it is a problem inside the environment where the job is running.