Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1151

Ability to configure auxiliary services from HDFS-based JAR files

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      I would like to install an auxiliary service in Hadoop YARN without actually installing files/services on every node in the system. Discussions on the user@ list indicate that this is not easily done. The reason we want an auxiliary service is that our application has some persistent-data components that are not appropriate for HDFS. In fact, they are somewhat analogous to the mapper output of MapReduce's shuffle, which is what led me to auxiliary-services in the first place. It would be much easier if we could just place our service's JARs in HDFS.

      Attachments

        1. [YARN-1151] [Design] Configure auxiliary services from HDFS-based JAR files.pdf
          45 kB
          Xuan Gong
        2. YARN-1151.1.patch
          14 kB
          Xuan Gong
        3. YARN-1151.2.patch
          19 kB
          Xuan Gong
        4. YARN-1151.3.patch
          20 kB
          Xuan Gong
        5. YARN-1151.4.patch
          26 kB
          Xuan Gong
        6. YARN-1151.5.patch
          26 kB
          Xuan Gong
        7. YARN-1151.6.patch
          26 kB
          Xuan Gong
        8. YARN-1151.branch-2.poc.2.patch
          14 kB
          Xuan Gong
        9. YARN-1151.branch-2.poc.3.patch
          19 kB
          Xuan Gong
        10. YARN-1151.branch-2.poc.patch
          19 kB
          Xuan Gong

        Issue Links

          Activity

            People

              xgong Xuan Gong
              john.lilley@redpoint.net john lilley
              Votes:
              0 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: