Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22207

Tez: SplitGenerator throws NumberFormatException when "dfs.block.size" on cluster is "128m"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.1.0, 3.1.0
    • 4.0.0-alpha-1
    • Hive, Tez
    • None

    Description

      When the value of "dfs.block.size" on the cluster is "128m" in place of actual bytes as Long, then Tez job fails with NumberFormatException:

      java.lang.NumberFormatException: For input string: "128m" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Long.parseLong(Long.java:589) at java.lang.Long.parseLong(Long.java:631) at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1539) at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:194) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
      

      Attachments

        1. HIVE-22207.2.patch
          1 kB
          Naresh P R
        2. HIVE-22207.1.patch
          1 kB
          Naresh P R
        3. HIVE-22207.patch
          0.9 kB
          Naresh P R

        Activity

          People

            nareshpr Naresh P R
            praneetsharma Praneet Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: