Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8140

TableMapReduceUtils#addDependencyJar fails when nested inside another MR job

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.98.0, 0.95.0
    • mapreduce
    • None
    • Reviewed

    Description

      TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job to make sure dependencies of the job are shipped to the cluster. The code depends on finding an actual jar file containing the necessary classes. This is not always the case, for instance, when run at the end of another mapreduce job. In that case, dependency jars have already been shipped to the cluster and expanded in the parent job's run folder. Those dependencies are there, just not available as jars.

      Attachments

        Issue Links

        is related to

        Sub-task - The sub-task of the issue HBASE-8147 Add Integration Test for "The HCat Scenario"

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. HBASE-8146 IntegrationTestBigLinkedList does not work on distributed setup

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. HBASE-8158 Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job"

        • Major - Major loss of function.
        • Closed

        Documentation - Documentation or Website HCATALOG-623 Understanding how to use the HBase bulk import feature

        • Major - Major loss of function.
        • Resolved
        relates to

        Documentation - Documentation or Website HCATALOG-623 Understanding how to use the HBase bulk import feature

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ndimiduk Nick Dimiduk Assign to me
            ndimiduk Nick Dimiduk
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment