Cluster High utilization module design

When you create an Interpreter process in Zeppelin-Server, you can create an Interpreter process in another Zeppelin-Server from a remote server with cluster resources, and establish a session.

1. Server resource reporting

Zeppelin-Server collects server hardware CPU and memory usage, periodically reports to the cluster, and stores metadata in Cluster MetaData.

2. Create an interpreter process remotely

When Zeppelin-Server creates an Interpreter process, first find out the server with idle resources from Cluster MetaData, and create an Interpreter process remotely through Thrift.

3. Reuse the Interpreter process

When Zeppelin-Server creates an Interpreter process, it first looks up the Cluster MetaData to see if the required Interpreter process already exists. If it already exists, it obtains the IP and port of the Interpreter process's Thrift through the Cluster MetaData to create the user's note and Interpreter. Session association;