Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
Description
Since YARN is designed to not only work with Java, it is quite difficult and cumbersome to correctly setup a YARN application. For Java-based ones, it should be easier; there should be something like the MR2 Job API. My proposal is the following:
- Have a basic Job / Application object, e.g. YarnApplication, which could be instantiated and configured the following:
final Configuration conf = ... final YarnApplication app = YarnApplication.getInstance(conf); app.setContainerClassName(MyContainer.class); app.setJarByClass(MyContainer.class);
- There should be a means to send and receive messages between container and AppMaster
- The container should be able to report progress and state to the AppMaster
- Bonus: A simplified WebAppMaster should start a web application and have its URL automatically proxied when run