Shulou(Shulou.com)06/01 Report--

This article introduces the knowledge of "what are the rpc components of Flink". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

Flink uses akka to implement rpc services. There are several important components: RpcServer, RpcService, AkkaRpcActor, RpcEndpoint.

These components serve the following purposes:

(1) RpcEndpoint

Provide specific rpc services. The main implementations are ResourceManager and TaskExecutor

① YarnResourceManager is a service started in an AM container that holds ResourceManager and NodeManager clients

② TaskExecutor is the class in the NM container that starts taskmanager

(2) AkkaRpcService

Provides a service class for rpc. The class holds ActorSystem instance and Supervisor instance internally. Supervisor contains SupervisorActor instances, and SupervisorActor is used to create other Actor, which can be understood as the root Actor. When RpcEndpoint is constructed, the RpcServer instance is obtained through the startServer () method of AkkaRpcService.

Public RpcServer startServer (C rpcEndpoint) {checkNotNull (rpcEndpoint, "rpc endpoint"); final SupervisorActor.ActorRegistration actorRegistration = registerAkkaRpcActor (rpcEndpoint); final ActorRef actorRef = actorRegistration.getActorRef (); final CompletableFuture actorTerminationFuture = actorRegistration.getTerminationFuture (); LOG.info ("Starting RPC endpoint for {} at {}.", rpcEndpoint.getClass (). GetName (), actorRef.path ()) Final String akkaAddress = AkkaUtils.getAkkaURL (actorSystem, actorRef); final String hostname; Option host = actorRef.path (). Address (). Host (); if (host.isEmpty ()) {hostname = "localhost";} else {hostname = host.get () } Set

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.