WO2020253347A1

WO2020253347A1 - Container cluster management method, device and system

Info

Publication number: WO2020253347A1
Application number: PCT/CN2020/085388
Authority: WO
Inventors: 卢道和; 杨军; 黎君; 吴翼水; 陈广镇; 李焕; 胡仲臣; 周佳振
Original assignee: 深圳前海微众银行股份有限公司
Priority date: 2019-06-17
Filing date: 2020-04-17
Publication date: 2020-12-24
Also published as: CN110290189B; CN110290189A

Abstract

A container cluster management method, device, and system, which relate to the technical field of finance. An application release request sent by a tool platform is received, the application release request comprising a server identification in a target container cluster identification and a target container cluster corresponding to a program file of an application to be released, an application identification to be released and the application to be released. A first format conversion algorithm is used to convert the format of the application release request into a readable format of the target container cluster corresponding to the target container cluster identification, and obtain a format-converted application release request; the format-converted application release request is sent to the target container cluster corresponding to the target container cluster identification. The application release request is used to instruct the target container cluster to execute a release operation for the program file of the application to be released in a server corresponding to the server identification.

Description

一种容器集群管理方法、装置及***Container cluster management method, device and system

相关申请的交叉引用Cross references to related applications

本申请要求在2019年06月17日提交中国专利局、申请号为201910519992.1、申请名称为“一种容器集群管理方法、装置及***”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on June 17, 2019, the application number is 201910519992.1, and the application name is "a container cluster management method, device and system", the entire content of which is incorporated by reference In this application.

技术领域Technical field

本申请涉及金融科技(Fintech)的云计算领域，尤其涉及一种容器集群管理方法、装置及***。This application relates to the cloud computing field of Fintech, and in particular to a container cluster management method, device and system.

背景技术Background technique

随着计算机技术的发展，越来越多的技术(大数据、分布式、区块链Blockchain、人工智能等)应用在金融领域，传统金融业正在逐步向金融科技(Fintech)转变。Kubernetes是Google开源的容器集群管理***。在应用容器引擎Docker技术的基础上，为容器化的应用提供部署运行、资源调度、服务发现和动态伸缩等一系列完整功能，提高了大规模容器集群管理的便捷性。Kubernetes的方式是通过部署容器方式实现，每个容器之间互相隔离，每个容器有自己的文件***，容器之间进程不会相互影响，能区分计算资源。相对于虚拟机，容器能快速部署，由于容器是与底层设施、机器文件***解耦的，故其能在不同云、不同版本操作***间进行迁移。With the development of computer technology, more and more technologies (Big Data, Distributed, Blockchain, Artificial Intelligence, etc.) are applied in the financial field, and the traditional financial industry is gradually changing to Fintech. Kubernetes is Google's open source container cluster management system. Based on the application container engine Docker technology, it provides a series of complete functions such as deployment and operation, resource scheduling, service discovery, and dynamic scaling for containerized applications, which improves the convenience of large-scale container cluster management. The Kubernetes method is implemented by deploying containers. Each container is isolated from each other, and each container has its own file system. The processes between the containers will not affect each other and can distinguish computing resources. Compared with virtual machines, containers can be deployed quickly. Since containers are decoupled from underlying facilities and machine file systems, they can be migrated between different clouds and different versions of operating systems.

传统非容器化的***架构，如金融业务的***架构，其应用部署方式是在虚拟机或物理服务器上通过插件或脚本来安装应用，应用的运行、配置、管理、所有生存周期将与当前操作***绑定，且应用的资源调度和管理，应用的发布和监控等功能的实现，需要一整套固定的流程和工具平台相配合。The traditional non-containerized system architecture, such as the system architecture of financial business, its application deployment method is to install the application through plug-ins or scripts on the virtual machine or physical server. The operation, configuration, management, and all life cycles of the application will be the same as the current operation System binding, and the realization of application resource scheduling and management, application release and monitoring and other functions require a set of fixed processes and tool platforms to cooperate.

然而，由于Kubernetes无法直接集成非容器化***架构的固定流程与上述工具平台相配合，导致无法通过引入Kubernetes将非容器化的***架构演化为容器化架构，故需要对非容器架构进行大量的重构和改造，以实现将非容器化***架构演化为容器化架构，显然管理成本较高。However, because Kubernetes cannot directly integrate the fixed process of the non-containerized system architecture with the above tool platform, it is impossible to evolve the non-containerized system architecture into a containerized architecture by introducing Kubernetes. Therefore, a large amount of rework on the non-containerized architecture is required. The construction and transformation to realize the evolution of non-containerized system architecture to containerized architecture is obviously higher in management costs.

发明内容Summary of the invention

本申请实施例提供一种容器集群管理方法、装置及***，解决了现有技术中需要对非容器架构进行大量的重构和改造，实现将非容器化***架构演化为容器化架构而导致管理成本高的问题。The embodiments of the application provide a container cluster management method, device, and system, which solves the need for a large amount of reconstruction and transformation of non-container architectures in the prior art, and realizes the evolution of the non-containerized system architecture to the containerized architecture, resulting in management The problem of high cost.

第一方面，本申请实施例提供了一种容器集群管理方法，该方法可以包括：In the first aspect, an embodiment of the present application provides a container cluster management method, and the method may include:

接收工具平台发送的应用发布请求，所述应用发布请求包括待发布应用的程序文件、待发布应用标识和所述待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，所述容器集群标识对应的容器集群的可读格式与所述工具平台的可读格式的不同；Receive an application publishing request sent by the tool platform, the application publishing request including the program file of the application to be published, the application identifier to be published, the target container cluster identifier corresponding to the application to be published and the server identifier in the target container cluster, the container The readable format of the container cluster corresponding to the cluster identifier is different from the readable format of the tool platform;

采用第一格式转换算法，将所述应用发布请求的格式转换为所述目标容器集群标识对应的目标容器集群的可读格式，得到格式转换后的应用发布请求；The first format conversion algorithm is adopted to convert the format of the application publishing request into a readable format of the target container cluster corresponding to the target container cluster identifier to obtain the application publishing request after the format conversion;

向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用发布请求，所述应用发布请求用于指示所述目标容器集群对所述服务器标识对应的服务器中的所述待发布应用的程序文件执行发布操作。The application publishing request after the format conversion is sent to the target container cluster corresponding to the target container cluster identifier, where the application publishing request is used to instruct the target container cluster to respond to the to-be-published server in the server corresponding to the server identifier The application's program file performs the publishing operation.

在一个可选的实现中，接收工具平台发送的应用发布请求之前，所述方法还包括：In an optional implementation, before receiving the application publishing request sent by the tool platform, the method further includes:

接收所述工具平台发送的资源申请请求，所述资源申请请求包括待发布应用的程序文件的资源需求信息、所述待发布应用标识和目标容器集群的可用资源信息，所述目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的；Receive a resource application request sent by the tool platform, where the resource application request includes resource requirement information of the program file of the application to be published, the identification of the application to be published, and the available resource information of the target container cluster, where the target container cluster is The tool platform is determined according to the container cluster identifier applied by the business system;

根据所述待发布应用的资源需求信息，采用预设资源分配规则，对所述目标容器集群的可用资源信息进行分配，得到所述待发布应用在所述目标容器集群中所属服务器的服务器标识，所述目标容器集群的可用资源信息不小于所述程序文件的资源需求信息；According to the resource requirement information of the application to be published, using preset resource allocation rules, the available resource information of the target container cluster is allocated to obtain the server identifier of the server to which the application to be published belongs in the target container cluster, The available resource information of the target container cluster is not less than the resource requirement information of the program file;

向所述工具平台发送所述待发布应用对应的目标容器集群标识、所述服务器标识和使用资源的分配结果。Sending the target container cluster identifier corresponding to the application to be released, the server identifier, and the allocation result of the used resources to the tool platform.

在一个可选的实现中，所述方法还包括：In an optional implementation, the method further includes:

接收所述工具平台发送的应用处理请求，所述应用处理请求包括待处理应用的程序文件、所述程序文件的资源需求信息、待处理应用标识和所述待处理应用对应的目标容器集群标识和相应服务器标识，其中，所述目标容器集群标识对应的目标容器集群的可读格式与所述工具平台的可读格式的不同，所述程序文件包括对所述待处理应用进行升级、扩容和删除处理的文件；Receive an application processing request sent by the tool platform, where the application processing request includes the program file of the application to be processed, the resource requirement information of the program file, the identifier of the application to be processed, and the target container cluster identifier corresponding to the application to be processed, and The corresponding server identifier, wherein the readable format of the target container cluster corresponding to the target container cluster identifier is different from the readable format of the tool platform, and the program file includes upgrading, expanding and deleting the application to be processed Files processed;

若所述目标容器集群标识对应的目标容器集群的可用资源信息不小于所述待处理应用的程序文件的资源需求信息，则采用所述第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群的可读格式，得到格式转换后的应用处理请求；If the available resource information of the target container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file of the application to be processed, the first format conversion algorithm is used to convert the format of the application processing request Obtain the application processing request after format conversion for the readable format of the target container cluster;

向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用处理请求，所述应用处理请求用于指示所述容器集群对所述服务器标识对应的服务器中的所述待处理应用执行所述程序文件。Send the format-converted application processing request to the target container cluster corresponding to the target container cluster identifier, where the application processing request is used to instruct the container cluster to respond to the application to be processed in the server corresponding to the server identifier Execute the program file.

采集预设的待监控容器集群标识对应的容器集群的监控信息，所述监控信息包括所述容器集群的工作状态信息；Collecting preset monitoring information of the container cluster corresponding to the identifier of the container cluster to be monitored, where the monitoring information includes working status information of the container cluster;

采用第二格式转换算法，将所述监控信息的格式转换为所述工具平台的预设可读格式；Using a second format conversion algorithm to convert the format of the monitoring information into a preset readable format of the tool platform;

向所述工具平台发送格式转换后的监控信息。The monitoring information after format conversion is sent to the tool platform.

在一个可选的实现中，采集预设的待监控容器集群标识对应的容器集群的监控信息，包括：In an optional implementation, collecting the monitoring information of the container cluster corresponding to the preset container cluster identifier to be monitored includes:

根据预设采集周期，周期性的采集预设的待监控容器集群标识对应的容器集群的监控信息。According to the preset collection period, periodically collect the monitoring information of the container cluster corresponding to the preset container cluster identifier to be monitored.

第二方面，本申请实施例提供了一种管理装置，该装置可以包括：接收单元、格式转换单元和发送单元；In the second aspect, an embodiment of the present application provides a management device, which may include: a receiving unit, a format conversion unit, and a sending unit;

所述接收单元，用于接收工具平台发送的应用发布请求，所述应用发布请求包括待发布应用的程序文件、待发布应用标识和所述待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，所述容器集群标识对应的容器集群的可读格式与所述工具平台的可读格式的不同；The receiving unit is configured to receive an application publishing request sent by a tool platform, the application publishing request including the program file of the application to be published, the application identifier to be published, and the target container cluster identifier corresponding to the application to be published and the target container cluster The readable format of the container cluster corresponding to the container cluster identifier is different from the readable format of the tool platform;

所述格式转换单元，用于采用第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群标识对应的目标容器集群的预设可读格式，得到格式转换后的应用处理请求；The format conversion unit is configured to use a first format conversion algorithm to convert the format of the application processing request into a preset readable format of the target container cluster corresponding to the target container cluster identifier to obtain the application processing after the format conversion request;

所述发送单元，用于向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用发布请求，所述应用发布请求用于指示所述目标容器集群对所述服务器标识对应的服务器中的所述待发布应用的程序文件执行发布操作。The sending unit is configured to send the application publishing request after the format conversion to the target container cluster corresponding to the target container cluster identifier, and the application publishing request is used to instruct the target container cluster to correspond to the server identifier The program file of the application to be released in the server performs a publishing operation.

在一个可选的实现中，所述装置还包括分配单元；In an optional implementation, the device further includes a distribution unit;

所述接收单元，还用于接收所述工具平台发送的资源申请请求，所述资源申请请求包括待发布应用的程序文件的资源需求信息、所述待发布应用标识和目标容器集群的可用资源信息，所述目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的；The receiving unit is further configured to receive a resource application request sent by the tool platform, where the resource application request includes resource requirement information of the program file of the application to be published, the identification of the application to be published, and the available resource information of the target container cluster , The target container cluster is determined by the tool platform according to the container cluster identifier applied by the business system;

所述分配单元，用于根据所述待发布应用的资源需求信息，采用预设资源分配规则，对所述目标容器集群的可用资源信息进行分配，得到所述待发布应用在所述目标容器集群中所属服务器的服务器标识，所述目标容器集群标识对应的容器集群的可用资源信息不小于所述程序文件的资源需求信息；The allocation unit is configured to allocate the available resource information of the target container cluster according to the resource requirement information of the application to be published and adopt a preset resource allocation rule to obtain that the application to be published is in the target container cluster The server identifier of the server to which the target container cluster belongs, and the available resource information of the container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file;

所述发送单元，还用于向所述工具平台发送所述待发布应用对应的目标容器集群标识、所述服务器标识和使用资源的分配结果。The sending unit is further configured to send the target container cluster identification corresponding to the application to be released, the server identification, and the allocation result of the used resources to the tool platform.

在一个可选的实现中，所述接收单元，还用于接收所述工具平台发送的应用处理请求，所述应用处理请求包括待处理应用的程序文件、所述程序文件的资源需求信息、待处理应用标识和所述待处理应用对应的目标容器集群标识和相应服务器标识，其中，所述目标容器集群标识对应的目标容器集群的可读格式与所述工具平台的可读格式的不同，所述程序文件包括对所述待处理应用进行升级、扩容和删除处理的文件；In an optional implementation, the receiving unit is further configured to receive an application processing request sent by the tool platform, where the application processing request includes a program file of the application to be processed, resource requirement information of the program file, and The processing application identifier and the target container cluster identifier corresponding to the application to be processed and the corresponding server identifier, wherein the readable format of the target container cluster corresponding to the target container cluster identifier is different from the readable format of the tool platform, so The program file includes files for upgrading, expanding, and deleting the application to be processed;

所述格式转换单元，还用于若所述目标容器集群标识对应的目标容器集群的可用资源信息不小于所述待处理应用的程序文件的资源需求信息，则采用所述第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群的可读格式，得到格式转换后的应用处理请求；The format conversion unit is further configured to use the first format conversion algorithm if the available resource information of the target container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file of the application to be processed, Converting the format of the application processing request into a readable format of the target container cluster to obtain the application processing request after the format conversion;

所述发送单元，还用于向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用处理请求，所述应用处理请求用于指示所述容器集群对所述服务器标识对应的服务器中的所述待处理应用执行所述程序文件。The sending unit is further configured to send the application processing request after the format conversion to the target container cluster corresponding to the target container cluster identifier, and the application processing request is used to instruct the container cluster to correspond to the server identifier The application to be processed in the server executes the program file.

在一个可选的实现中，所述装置还包括采集单元；In an optional implementation, the device further includes a collection unit;

所述采集单元，还用于采集预设的待监控容器集群标识对应的容器集群的监控信息，所述监控信息包括所述容器集群的工作状态信息；The collection unit is further configured to collect monitoring information of a container cluster corresponding to a preset container cluster identifier to be monitored, where the monitoring information includes working status information of the container cluster;

所述格式转换单元，还用于采用第二格式转换算法，将所述监控信息的格式转换为所述工具平台的预设可读格式；The format conversion unit is further configured to use a second format conversion algorithm to convert the format of the monitoring information into a preset readable format of the tool platform;

所述发送单元，还用于向所述工具平台发送格式转换后的监控信息。The sending unit is further configured to send the monitoring information after format conversion to the tool platform.

第三方面，本申请实施例提供了一种管理***，所述***包括：工具平台、容器集群管理装置和容器集群；In a third aspect, an embodiment of the present application provides a management system, the system includes: a tool platform, a container cluster management device, and a container cluster;

所述工具平台，用于获取初始应用发布请求，所述初始应用发布请求包括对待发布应用标识和待发布应用的程序文件，并查询出所述待发布应用标识对应的目标容器集群标识，并向所述容器集群管理装置发送应用发布请求，所述应用发布请求包括所述待发布应用的程序文件、所述待发布应用标识和所述待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，所述目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的；所述目标容器集群标识对应的目标容器集群的可用资源信息不小于所述程序文件的资源需求信息；The tool platform is used to obtain an initial application release request, the initial application release request includes the application identification to be released and the program file of the application to be released, and the target container cluster identification corresponding to the application identification to be released is queried and sent to The container cluster management device sends an application publishing request, the application publishing request includes the program file of the application to be published, the application identifier to be published, the target container cluster identifier corresponding to the application to be published, and the target container cluster Server identifier, the target container cluster is determined by the tool platform according to the container cluster identifier applied by the business system; the available resource information of the target container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file;

所述容器集群管理装置，用于采用第一格式转换算法，将接收的所述应用发布请求的格式转换为所述目标容器集群标识对应的目标容器集群的预设可读格式；向所述目标容器集群标识对应的目标容器集群发送格式转换后的应用发布请求；The container cluster management device is configured to use a first format conversion algorithm to convert the format of the received application publishing request into a preset readable format of the target container cluster corresponding to the target container cluster identifier; The target container cluster corresponding to the container cluster identifier sends the application publishing request after format conversion;

所述容器集群，用于接收所述格式转换后的应用发布请求，并对所述服务器标识对应的服务器中的所述待发布应用的程序文件执行发布操作。The container cluster is configured to receive the application publishing request after the format conversion, and perform a publishing operation on the program file of the application to be published in the server corresponding to the server identifier.

第四方面，本申请实施例提供了一种电子设备，该电子设备包括处理器、通信接口、存储器和通信总线，其中，处理器，通信接口，存储器通过通信总线完成相互间的通信；In a fourth aspect, an embodiment of the present application provides an electronic device that includes a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;

存储器，用于存放计算机程序；Memory, used to store computer programs;

处理器，用于执行存储器上所存放的程序时，实现上述第一方面中任一所述的方法步骤。The processor is configured to implement the method steps in any one of the foregoing first aspect when executing the program stored in the memory.

第五方面，本申请实施例提供了一种计算机可读存储介质，该计算机可读存储介质内存储有计算机程序，所述计算机程序被处理器执行时实现上述第一方面中任一所述的方法步骤。In the fifth aspect, the embodiments of the present application provide a computer-readable storage medium that stores a computer program in the computer-readable storage medium. When the computer program is executed by a processor, the computer program implements any one of the foregoing aspects of the first aspect. Method steps.

第六方面，本申请实施例提供了一种计算机程序产品，所述计算机程序产品包括存储在计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行第一方面中任一所述的方法步骤。In a sixth aspect, embodiments of the present application provide a computer program product, the computer program product includes a computer program stored on a computer-readable storage medium, the computer program includes program instructions, when the program instructions are executed by a computer At the time, the computer is caused to execute any of the method steps in the first aspect.

本发明实施例提到的上述方法在接收工具平台发送的应用发布请求，应用发布请求包括待发布应用的程序文件、待发布应用标识和待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，目标容器集群标识对应的目标容器集群的可读格式与工具平台的可读格式的不同；采用第一格式转换算法，将应用发布请求的格式转换为目标容器集群标识对应的目标容器集群的可读格式，得到格式转换后的应用发布请求；向目标容器集群标识对应的目标容器集群发送格式转换后的应用发布请求，应用发布请求用于指示目标容器集群对服务器标识对应的服务器中的待发布应用的程序文件执行发布操作。与现有技术相比，该方法实现了原非容器化架构的工具平台与原容器集群相配合，即实现了将非容器化***架构演化为容器化架构，避免了对非容器化***架构的重构和改造，降低了容器集群的管理成本。The foregoing method mentioned in the embodiment of the present invention receives an application publishing request sent by a tool platform. The application publishing request includes the program file of the application to be published, the application identifier to be published, and the target container cluster identifier corresponding to the application to be published and the target container cluster. Server identifier, the readable format of the target container cluster corresponding to the target container cluster identifier is different from the readable format of the tool platform; the first format conversion algorithm is used to convert the format of the application release request to the target container cluster corresponding to the target container cluster identifier The application publishing request after the format conversion is obtained in the readable format of the target container cluster; the application publishing request after the format conversion is sent to the target container cluster corresponding to the target container cluster identifier. The application publishing request is used to instruct the target container cluster to The program file of the application to be released performs the release operation. Compared with the prior art, this method realizes the cooperation of the tool platform of the original non-containerized architecture with the original container cluster, that is, realizes the evolution of the non-containerized system architecture into the containerized architecture, and avoids the need for non-containerized system architecture. Refactoring and transformation have reduced the management cost of the container cluster.

附图说明Description of the drawings

图1为本发明实施例提供的一种容器集群管理方法应用的管理***架构图；FIG. 1 is an architecture diagram of a management system application of a container cluster management method provided by an embodiment of the present invention;

图2为本发明实施例提供的一种容器集群管理方法的流程示意图；2 is a schematic flowchart of a container cluster management method provided by an embodiment of the present invention;

图3为本发明实施例提供的一种对容器集群中应用的资源配置进行管理的方法流程示意图；3 is a schematic flow chart of a method for managing resource configuration of applications in a container cluster according to an embodiment of the present invention;

图4为本发明实施例提供的一种对容器集群的工作状态进行监控管理的方法流程示意图；4 is a schematic flowchart of a method for monitoring and managing the working status of a container cluster according to an embodiment of the present invention;

图5为本发明实施例提供的另一种对容器集群中应用的资源配置进行管理的方法流程示意图；5 is a schematic flowchart of another method for managing resource configuration of applications in a container cluster according to an embodiment of the present invention;

图6为本发明实施例提供的一种对容器集群中应用分布请求进行管理的方法流程示意图；6 is a schematic flow diagram of a method for managing application distribution requests in a container cluster according to an embodiment of the present invention;

图7为本发明实施例提供的另一种对容器集群的工作状态进行监控管理的方法流程示意图；7 is a schematic flowchart of another method for monitoring and managing the working status of a container cluster according to an embodiment of the present invention;

图8为本发明实施例提供的一种管理装置的结构示意图；FIG. 8 is a schematic structural diagram of a management device provided by an embodiment of the present invention;

图9为本发明实施例提供的一种电子设备的结构示意图。FIG. 9 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本申请一部分实施例，并不是全部的实施例。基于本申请实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present application.

本发明实施例提供的容器集群管理方法可以应用在图1所示的管理***架构中，该***架构可以是任意一种容器集群***。下面以容器集群***为Kubernetes为例进行说明。The container cluster management method provided by the embodiment of the present invention can be applied to the management system architecture shown in FIG. 1, and the system architecture can be any container cluster system. The following takes the container cluster system as Kubernetes as an example.

Kubernetes，简称K8s，是用8代替8个字符"ubernete"而成的缩写。其是一个开源的，用于管理云平台，如服务器，中多个主机上的容器化的应用，具有完备的容器集群管理能力，多扩多层次的安全防护和准入机制、多租户应用支撑能力、透明的服务注册和发现机制、内建智能负载均衡器、强大的故障发现和自我修复能力、服务滚动升级和在线扩容能力、可扩展的资源自动调度机制以及多粒度的资源配额管理能力。同时Kubernetes提供完善的管理工具，涵盖了包括开发、部署测试、运维监控在内的各个环节。Kubernetes, abbreviated as K8s, is an abbreviation made by replacing the 8 characters "ubernete" with 8. It is an open source that is used to manage containerized applications on multiple hosts in cloud platforms, such as servers. It has complete container cluster management capabilities, multi-layered security protection and access mechanisms, and multi-tenant application support. Capability, transparent service registration and discovery mechanism, built-in intelligent load balancer, powerful fault detection and self-repair capabilities, service rolling upgrade and online expansion capabilities, scalable resource automatic scheduling mechanism, and multi-granular resource quota management capabilities. At the same time, Kubernetes provides comprehensive management tools, covering all aspects including development, deployment testing, operation and maintenance monitoring.

在Kubernetes中可以创建多个容器，形成容器集群，每个容器里面可运行一个应用实例，然后通过预设的负载均衡策略，实现对应用实例的管理、发现、访问。In Kubernetes, multiple containers can be created to form a container cluster. Each container can run an application instance, and then through a preset load balancing strategy, the management, discovery, and access to the application instance can be realized.

该***架构可以包括：工具平台、容器集群管理装置和Kubernetes的容器集群。The system architecture may include: a tool platform, a container cluster management device, and a Kubernetes container cluster.

Kubernetes的容器集群可以包括至少一个容器集群，如可以将一个互联网数据中心(International Data Centre，IDC)定义为一个Kubenetes的容器集群，如图1所示Kubernetes的容器集群包括IDC1和IDC2两个容器集群。由于一个容器包含一个应用，这让Kubernetes对容器的管理等同于对应用部署的管理。其中，容器集群会部署在物理机器上，且共享物理机器(或称“容器母机”)上的使用资源。每个容器集群包含若干个服务器，这些服务器分布在不同的服务器机架上。The Kubernetes container cluster may include at least one container cluster. For example, an Internet Data Center (IDC) can be defined as a Kubenetes container cluster. As shown in Figure 1, the Kubernetes container cluster includes two container clusters IDC1 and IDC2. . Since a container contains an application, Kubernetes' management of the container is equivalent to the management of application deployment. Among them, the container cluster will be deployed on physical machines and share the resources used on the physical machines (or "container parent machines"). Each container cluster contains several servers, which are distributed on different server racks.

工具平台，为与管理终端或业务***进行信息交互的平台；用于获取Kubernetes容器集群层中每个容器集群的已使用的资源信息、业务***为待分配资源应用申请的目标容器集群标识，以及待分配资源应用的资源需求信息，并向容器集群管理装置发送资源申请请求，资源申请请求包括目标容器集群已使用的资源信息、待发布应用标识和待分配资源的应用的资源需求信息等信息。以及，接收业务***发送的初始应用发布请求，初始应用发布请求包括待发布应用的应用标识、待发布应用的程序文件等信息，并查询该应用标识对应的该待发布应用对应的目标容器集群标识、服务器标识和该待发布应用的资源分配信息，之后向容器集群管理装置发送应用发布请求，该应用发布请求包括待发布应用的程序文件、待发布应用标识和待发布应用对应的目标容器集群标识、服务器标识。The tool platform is a platform for information interaction with management terminals or business systems; it is used to obtain the used resource information of each container cluster in the Kubernetes container cluster layer, the target container cluster identifier applied by the business system for the application of resources to be allocated, and The resource requirement information of the resource application to be allocated is sent, and a resource application request is sent to the container cluster management device. The resource application request includes information such as resource information used by the target container cluster, identification of the application to be released, and resource requirement information of the application to be allocated. And, receiving the initial application publishing request sent by the business system, the initial application publishing request including the application identification of the application to be published, the program file of the application to be published, and other information, and querying the target container cluster identification corresponding to the application to be published corresponding to the application identification , The server identification and the resource allocation information of the application to be published, and then send an application publishing request to the container cluster management device, the application publishing request includes the program file of the application to be published, the application identification to be published and the target container cluster identification corresponding to the application to be published , Server ID.

其中，业务***，用于根据实际情况生成对容器集群中应用的升级、扩容、下线等业务操作请求，以及向工具平台发送初始应用处理请求，初始应用处理请求包括待处理应用的程序文件、程序文件的资源需求信息和待处理应用标识。Among them, the business system is used to generate business operation requests such as upgrades, expansions, and offline of applications in the container cluster according to actual conditions, and to send initial application processing requests to the tool platform. The initial application processing requests include the program files of the application to be processed, The resource requirement information of the program file and the identification of the application to be processed.

可选地，业务***可以向工具平台发送的待分配资源的应用的初始资源申请请求，初始资源申请请求包括待分配资源的应用的资源需求信息、申请的容器集群标识和该应用的应用标识，该待分配资源的应用为预加载的新应用，即创建新容器。Optionally, the business system may send an initial resource application request of the application to be allocated resources to the tool platform, where the initial resource application request includes resource demand information of the application to be allocated resources, the container cluster identification applied for, and the application identification of the application, The application to which the resource is to be allocated is a preloaded new application, that is, a new container is created.

可选地，工具平台可以获取用户通过前端浏览器输入的待分配应用的资源需求信息、申请的容器集群标识和该应用的应用标识，或可以通过接收业务层发送的初始资源申请请求获取待分配应用的资源需求信息、申请的容器集群标识和该应用的应用标识。Optionally, the tool platform can obtain the resource requirement information of the application to be allocated by the user input through the front-end browser, the applied container cluster identification and the application identification of the application, or can obtain the to-be allocated by receiving the initial resource application request sent by the business layer The resource requirement information of the application, the applied container cluster identification and the application identification of the application.

可选地，工具平台，还用于记录执行的各个过程，以用于后期的审计工作。Optionally, the tool platform is also used to record various execution processes for later audit work.

在一个例子中，以业务***为金融业务***为例，如图1所示，其工具平台可以包括IT服务管理(IT Service Management，ITSM)、配置管理数据库(Configuration Management Database，CMDB)、自动化运维平台AOMP、信息管理数据库(Information Management System，IMS)等。In an example, taking the business system as a financial business system as an example, as shown in Figure 1, its tool platform can include IT Service Management (ITSM), Configuration Management Database (CMDB), and automated operation. Maintenance platform AOMP, information management database (Information Management System, IMS), etc.

ITSM，用于接收管理终端发送的用户或技术人员的输入信息，该输入信息可以是预加载的新应用的相关信息，以及从CMDB中获取当前至少一个容器集群的多项指标，如容器集群所在的数据通信网络(Data Communication Network，DCN)、应用域、当前已使用的资源信息等，当前已使用的资源信息包括容器集群所在容器母机的IP地址，CPU使用量、内存使用量、磁盘使用量，容器实例的IP地址等。ITSM is used to receive input from users or technicians sent by the management terminal. The input can be information about new applications that are pre-loaded, and multiple indicators of at least one container cluster are obtained from the CMDB, such as the location of the container cluster. Data Communication Network (DCN), application domains, currently used resource information, etc. The currently used resource information includes the IP address of the container host computer where the container cluster is located, CPU usage, memory usage, and disk usage , The IP address of the container instance, etc.

CMDB，用于存储各应用的配置信息，该配置信息可以包括各应用所属容器集群的标识、各应用的资源分配信息和各应用的应用标识等信息。The CMDB is used to store configuration information of each application. The configuration information may include information such as the identifier of the container cluster to which each application belongs, the resource allocation information of each application, and the application identifier of each application.

AOMP，用于接收业务***发送的包括应用标识的初始应用发布请求，并获取该应用标识对应的容器集群的资源分配信息，并向容器集群管理装置发送应用发布请求。AOMP is used to receive the initial application publishing request including the application identifier sent by the business system, obtain resource allocation information of the container cluster corresponding to the application identifier, and send the application publishing request to the container cluster management device.

IMS，用于接收容器集群管理装置发送的监控信息，以使用户或技术人员了解容器集群的当前工作状态。IMS is used to receive monitoring information sent by the container cluster management device, so that users or technicians can understand the current working status of the container cluster.

可选地，工具平台的上述各个组件均可以记录各自的执行过程，以用于后期的审计工作。Optionally, each of the above-mentioned components of the tool platform can record their respective execution processes for later audit work.

如图1所示，容器集群管理装置可以包括资源管理器(We Container System-Resource Manager，wcs-rm)、服务网关(We Container System-Gateway，wcs-gateway)、监控数据上报器(Intelligent Monitor System-reporter，ims-reporter)。As shown in Figure 1, the container cluster management device may include a resource manager (We Container System-Resource Manager, wcs-rm), a service gateway (We Container System-Gateway, wcs-gateway), and a monitoring data reporter (Intelligent Monitor System). -reporter, ims-reporter).

wcs-rm，用于接收工具平台发送的资源申请请求，该资源申请请求包括待发布应用的程序文件的资源需求信息、待发布应用标识和目标容器集群的可用资源信息，目标容器集群是工具平台根据业务***申请的容器集群标识确定的，并根据存储的目标容器集群的总资源信息和该目标容器集群已使用的资源信息，获取该目标容器集群的可用资源信息，或者，直接获取工具平台发送的待资源分配应用的资源需求信息和业务***申请的容器集群标识，以及该容器集群标识对应的目标容器集群的可用资源信息。之后，根据待分配应用的资源需求信息，采用预设资源分配规则，对目标容器集群的可用资源信息进行分配，得到待资源分配应用在目标容器集群中被分配的服务器，从而得到待资源分配应用的资源分配信息，资源分配信息包括待资源分配应用对应的目标容器集群标识、目标容器集群中服务器的服务器标识，以及使用资源的分配比例等信息，容器集群标识为Kubernetes的至少一个容器集群中该应用所属容器集群的标识，并向工具平台发送分配结果，该分配结果可以是分配失败的指示信息，也可以是分配成功的指示信息和待分配应用的资源分配信息。wcs-rm, used to receive the resource application request sent by the tool platform. The resource application request includes the resource requirement information of the program file of the application to be published, the application identifier to be published and the available resource information of the target container cluster. The target container cluster is the tool platform Determined according to the container cluster identifier applied by the business system, and according to the stored total resource information of the target container cluster and the resource information used by the target container cluster, obtain the available resource information of the target container cluster, or directly obtain the tool platform to send The resource requirement information of the application to be allocated for resource allocation and the container cluster identifier applied by the business system, and the available resource information of the target container cluster corresponding to the container cluster identifier. After that, according to the resource demand information of the application to be allocated, the preset resource allocation rules are used to allocate the available resource information of the target container cluster to obtain the server to be allocated in the target container cluster for the resource allocation application, thereby obtaining the resource allocation application The resource allocation information includes the target container cluster identifier corresponding to the application to be allocated for the resource, the server identifier of the server in the target container cluster, and the allocation ratio of the resources used. The container cluster identifier is the at least one container cluster in Kubernetes The identifier of the container cluster to which the application belongs, and the allocation result is sent to the tool platform. The allocation result may be the indication information of the allocation failure, or the indication information of the successful allocation and the resource allocation information of the application to be allocated.

可选的，wcs-rm，还可以用于检测目标容器集群的可用资源信息是否大于升级、扩容、下线等操作对应的程序文件的资源需求信息，以使Kubernetes的容器集群对容器集群标识对应的容器集群中的应用进行管理。Optionally, wcs-rm can also be used to detect whether the available resource information of the target container cluster is greater than the resource requirement information of the program files corresponding to operations such as upgrade, expansion, and offline, so that the container cluster of Kubernetes corresponds to the container cluster identifier Manage applications in the container cluster.

其中，预设资源分配规则是由技术人员根据实际情况预先设定，其设定原则是依据：(1)满足高可用的需求，即确保业务的容器应用实例尽可能均匀地分布在不同的机架和服务器上，以降低由于交换机或服务器故障导致的对业务的负面影响；(2)使每一台容器母机上的资源存量尽可能均衡，提高资源使用率，以避免出现诸如CPU已经耗尽而内存仍然大量盈余的场景。Among them, the preset resource allocation rules are pre-set by technicians according to the actual situation. The setting principles are based on: (1) Meet the requirements of high availability, that is, ensure that the container application instances of the business are distributed as evenly as possible on different machines. In order to reduce the negative impact on the business caused by the failure of the switch or server; (2) Make the resource inventory on each container host computer as balanced as possible, and increase the resource utilization rate to avoid the occurrence of CPU exhaustion. A scene where memory is still surplus.

可以理解的是，由于Kubernetes的容器集群中的资源调度模块支持的调度策略是受限的，导致该资源调度模块与工具平台不兼容，故可以将wcs-rm为应用分配资源的功能迁移到工具平台上。It is understandable that because the scheduling strategy supported by the resource scheduling module in the Kubernetes container cluster is limited, the resource scheduling module is incompatible with the tool platform, so the function of wcs-rm to allocate resources for the application can be migrated to the tool on the platform.

wcs-gateway，用于接收工具平台发送的应用发布请求，应用发布请求包括待发布应用的程序文件、待发布应用标识和待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，目标容器集群标识对应的目标容器集群的可读格式与工具平台的可读格式的不同；以及，向目标容器集群标识对应的目标容器集群发送经第一格式转换算法转换后的应用发布请求，其中，目标容器集群的可用资源信息不小于待发布应用的程序文件的资源需求信息。wcs-gateway, used to receive the application publishing request sent by the tool platform. The application publishing request includes the program file of the application to be published, the application identifier to be published, the target container cluster identifier corresponding to the application to be published, and the server identifier in the target container cluster. The readable format of the target container cluster corresponding to the container cluster identifier is different from the readable format of the tool platform; and, sending the application publishing request converted by the first format conversion algorithm to the target container cluster corresponding to the target container cluster identifier, wherein, The available resource information of the target container cluster is not less than the resource requirement information of the program file of the application to be released.

可选地，为了实现容器集群的高可用性，wcs-rm、wcs-gateway和ims-reporter都有冗余实例实现，故为了与容器集群实现高可用的通信，容器管理装置还可以包括容器管理***反向代理(We Container System NGINX，wcs-nginx)，用于向wcs-gateway分发应用发布请求和负载均衡。Optionally, in order to achieve high availability of the container cluster, wcs-rm, wcs-gateway and ims-reporter all have redundant instances to achieve, so in order to achieve high availability communication with the container cluster, the container management device may also include a container management system Reverse proxy (We Container System NGINX, wcs-nginx) is used to distribute application publishing requests and load balancing to wcs-gateway.

可以理解的是，若不存在wcs-gateway，则工具平台可以直接使用Kubernetes的容器集群的原生的应用程序接口(Application Program Interface，API)和Kubernetes的容器集群的耦合度将增加，但同时也将硬件运维相关的接口暴露给工具平台层，导致容器集群的运维复杂度增加和业务***的安全性不高的问题。It is understandable that if there is no wcs-gateway, the tool platform can directly use the native application program interface (Application Program Interface, API) of the Kubernetes container cluster and the coupling degree of the Kubernetes container cluster will increase, but it will also Interfaces related to hardware operation and maintenance are exposed to the tool platform layer, resulting in increased complexity of the operation and maintenance of the container cluster and low security of the business system.

ims-reporter，用于采集预设的待监控容器集群标识对应的容器集群的监控信息，监控信息包括容器集群的工作状态信息；采用第二格式转换算法，将监控信息的格式转换为工具平台的预设可读格式；向工具平台发送格式转换后的监控信息。ims-reporter, used to collect the preset monitoring information of the container cluster corresponding to the container cluster identifier to be monitored. The monitoring information includes the working status information of the container cluster; the second format conversion algorithm is used to convert the format of the monitoring information to the tool platform Preset a readable format; send the converted monitoring information to the tool platform.

可以理解的是，ims-reporter可以位于Kubernetes的容器集群外，也可以内置于Kubernetes的容器集群内，即以静态容器节点POD的方式部署在Kubernetes的容器集群内。It is understandable that ims-reporter can be located outside of the Kubernetes container cluster, or built into the Kubernetes container cluster, that is, deployed in the Kubernetes container cluster in the form of static container node POD.

Kubernetes的容器集群，用于接收容器集群管理装置，如wcs-gateway，发送的应用发布请求，并根据资源分配信息对待发布应用执行发布操作，即创建待发布应用对应的容器。The Kubernetes container cluster is used to receive application publishing requests sent by container cluster management devices, such as wcs-gateway, and perform publishing operations on the application to be published according to the resource allocation information, that is, to create a container corresponding to the application to be published.

为了实时了解服务器的工作状态，实现监控告警上报策略，ims-reporter，用于采集预设的待监控容器集群的标识对应的容器集群的监控信息，监控信息包括容器集群的工作状态信息，如故障或正常等状态，并向工具平台发送监控信息。In order to understand the working status of the server in real time and realize the monitoring alarm reporting strategy, ims-reporter is used to collect the monitoring information of the container cluster corresponding to the preset identifier of the container cluster to be monitored. The monitoring information includes the working status information of the container cluster, such as failure Or normal status, and send monitoring information to the tool platform.

本申请上述实施例提供的***通过在传统的工具平台和Kubernetes层增加容器集群管理装置可以使非容器架构转换成容器化架构，由此实现Kubernetes层与工具平台解耦，业务可以直接沿用传统的方式使用工具平台完成应用的发布、升级、扩容、下线等操作，这对于业务来说是无感知的，使工具平台的审计***和流程可以兼容容器化架构，不需对传统的非容器化架构进行重构，避免了大量的重构和改造。The system provided by the above-mentioned embodiment of the application can convert the non-container architecture into a containerized architecture by adding a container cluster management device to the traditional tool platform and Kubernetes layer, thereby realizing the decoupling of the Kubernetes layer and the tool platform, and the business can directly follow the traditional Ways to use the tool platform to complete the application release, upgrade, expansion, offline and other operations, which is imperceptible to the business, so that the audit system and process of the tool platform can be compatible with the containerized architecture, without the need for traditional non-containerized The architecture is refactored to avoid a lot of refactoring and transformation.

以下结合说明书附图对本申请的优选实施例进行说明，应当理解，此处所描述的优选实施例仅用于说明和解释本发明，并不用于限定本发明，并且在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。The preferred embodiments of the present application are described below in conjunction with the accompanying drawings of the specification. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, not to limit the present invention, and if there is no conflict, the present application The embodiments in and the features in the embodiments can be combined with each other.

图2为本发明实施例提供的一种容器集群的管理方法的流程示意图。如图2所示，该方法可以包括：FIG. 2 is a schematic flowchart of a method for managing a container cluster according to an embodiment of the present invention. As shown in Figure 2, the method may include:

步骤210、容器集群管理装置接收工具平台发送的应用发布请求。Step 210: The container cluster management device receives the application publishing request sent by the tool platform.

工具平台可以通过接收管理终端发送的用户或技术人员在工具平台上输入的初始应用发布请求而获取到初始应用发布请求，也可以是接收业务***发送的初始应用发布请求而获取到初始应用发布请求，本发明实施例在此不做限定。其中，工具平台获取的初始应用发布请求仅包含待发布应用标识和待发布应用的程序文件。The tool platform can obtain the initial application release request by receiving the initial application release request input by the user or technician on the tool platform sent by the management terminal, or it can obtain the initial application release request by receiving the initial application release request sent by the business system The embodiments of the present invention are not limited here. Among them, the initial application publishing request obtained by the tool platform only includes the identification of the application to be published and the program file of the application to be published.

工具平台在查询到待发布应用标识对应的目标容器集群标识和服务器标识后，向容器集群管理装置发送应用发布请求，该应用发布请求包括待发布应用的程序文件、待发布应用标识和待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识。After querying the target container cluster identifier and server identifier corresponding to the application identifier to be released, the tool platform sends an application publishing request to the container cluster management device. The application publishing request includes the program file of the application to be published, the application identifier to be published, and the application to be published. The corresponding target container cluster identifier and the server identifier in the target container cluster.

在执行该步骤之前，容器集群管理装置可以对容器集群中待发布应用的资源配置进行管理，如图3所示，包括：Before performing this step, the container cluster management device can manage the resource configuration of the application to be released in the container cluster, as shown in Figure 3, including:

步骤310、容器集群管理装置接收工具平台发送的资源申请请求。Step 310: The container cluster management device receives the resource application request sent by the tool platform.

资源申请请求可以包括待发布应用的程序文件的资源需求信息、待发布应用标识和目标容器集群的可用资源信息，目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的。The resource application request may include the resource requirement information of the program file of the application to be published, the identification of the application to be published, and the available resource information of the target container cluster. The target container cluster is determined by the tool platform according to the container cluster identification applied by the business system.

步骤320、容器集群管理装置根据待发布应用的资源需求信息，采用预设资源分配规则，对目标容器集群的可用资源信息进行分配，得到待发布应用的资源分配信息。Step 320: The container cluster management device uses preset resource allocation rules to allocate available resource information of the target container cluster according to the resource requirement information of the application to be published, and obtains the resource allocation information of the application to be published.

资源分配信息可以包括待发布应用在目标容器集群中所属服务器的服务器标识，待发布应用对应的容器集群标识和使用资源的分配比例等信息。目标容器集群的可用资源信息不小于程序文件的资源需求信息。The resource allocation information may include information such as the server identifier of the server to which the application to be published belongs in the target container cluster, the identifier of the container cluster corresponding to the application to be published, and the allocation ratio of used resources. The available resource information of the target container cluster is not less than the resource requirement information of the program file.

步骤330、容器集群管理装置向工具平台发送待发布应用对应的目标容器集群标识、服务器标识和使用资源的分配结果。Step 330: The container cluster management device sends the target container cluster identifier, server identifier, and resource allocation result corresponding to the application to be published to the tool platform.

其中，该待发布的容器集群标识对应的容器集群的可用资源信息不小于待发布应用的程序文件的资源需求信息。Wherein, the available resource information of the container cluster corresponding to the container cluster identifier to be published is not less than the resource requirement information of the program file of the application to be published.

可选地，除上述对容器集群中待发布应用的资源配置进行管理外，也可以人工对容器集群中待发布应用的资源配置进行管理，即人工为待分配的应用配置应用资源，本发明实施例再次不做限定。Optionally, in addition to the above-mentioned management of the resource configuration of the application to be published in the container cluster, the resource configuration of the application to be published in the container cluster can also be managed manually, that is, the application resources are manually configured for the application to be allocated. The implementation of the present invention The example is not limited again.

回到步骤210、工具平台向容器集群管理装置发送应用发布请求后，还可以记录执行的该操作，以用于生成审计日志。Returning to step 210, after the tool platform sends an application publishing request to the container cluster management device, it can also record the executed operation for generating an audit log.

步骤220、容器集群管理装置采用第一格式转换算法，将应用发布请求的格式转换为目标容器集群标识对应的目标容器集群的预设可读格式。Step 220: The container cluster management apparatus uses the first format conversion algorithm to convert the format of the application publishing request into a preset readable format of the target container cluster corresponding to the target container cluster identifier.

容器集群管理装置提取应用发布请求中各参数字段的参数与相应参数值，并获取容器集群标识对应的容器集群的预设可读格式，之后将提取的参数和相应参数值填入预设可读格式中，从而获取到容器集群可读的应用发布请求。The container cluster management device extracts the parameters and corresponding parameter values of each parameter field in the application release request, and obtains the preset readable format of the container cluster corresponding to the container cluster identifier, and then fills the extracted parameters and corresponding parameter values into the preset readable format In the format, the application publishing request readable by the container cluster is thus obtained.

例如，设工具平台的应用发布请求的格式为JOSN格式，容器集群的预设可读格式为Yaml(YAML Ain't a Markup Language)格式。For example, suppose the format of the application release request of the tool platform is the JOSN format, and the default readable format of the container cluster is the Yaml (YAML Ain't a Markup Language) format.

容器集群管理装置从JSON格式的应用发布请求中提取各参数字段的参数与相应参数值，如待发布应用标识、ID1，并将提取各参数字段的参数与相应参数值填入Yaml格式的相应位置，得到Yaml格式的应用发布请求，以使容器集群读取该应用发布请求。The container cluster management device extracts the parameters and corresponding parameter values of each parameter field from the application publishing request in JSON format, such as the application ID and ID1 to be published, and fills the extracted parameters and corresponding parameter values of each parameter field into the corresponding position in the Yaml format , Get the application publishing request in Yaml format, so that the container cluster can read the application publishing request.

步骤230、容器集群管理装置向目标容器集群标识对应的目标容器集群发送格式转换后的应用发布请求。Step 230: The container cluster management apparatus sends the application publishing request after format conversion to the target container cluster corresponding to the target container cluster identifier.

目标容器集群根据应用发布请求，对服务器标识对应的服务器中的待发布应用的程序文件执行发布操作。The target container cluster performs a publishing operation on the program file of the application to be published in the server corresponding to the server identifier according to the application publishing request.

可选地，容器集群管理装置还可以对容器集群的工作状态进行监控管理，实现告警上报管理，如图4所示，包括：Optionally, the container cluster management device can also monitor and manage the working status of the container cluster to implement alarm reporting management, as shown in Figure 4, including:

步骤410、容器集群管理装置采集预设的待监控容器集群标识对应的容器集群的监控信息。Step 410: The container cluster management apparatus collects preset monitoring information of the container cluster corresponding to the container cluster identifier to be monitored.

容器集群管理装置可以实时或周期性的从容器集群中的监控组件Prometheus中采集预设的待监控容器集群标识对应的容器集群的监控信息。其中，容器集群管理装置的采集频率可以根据实际情况设置。The container cluster management device can collect preset monitoring information of the container cluster corresponding to the container cluster identifier to be monitored from the monitoring component Prometheus in the container cluster in real time or periodically. Among them, the collection frequency of the container cluster management device can be set according to actual conditions.

该监控信息可以包括容器集群的工作状态信息。The monitoring information may include working status information of the container cluster.

步骤420、容器集群管理装置采用第二格式转换算法，将监控信息的格式转换为工具平台的预设可读格式。Step 420: The container cluster management device uses the second format conversion algorithm to convert the format of the monitoring information into a preset readable format of the tool platform.

容器集群管理装置提取监控信息中各参数字段的参数与相应参数值，并获取工具平台的预设可读格式，之后将提取的参数和相应参数值填入预设可读格式中，从而获取到工具平台可读的监控信息。The container cluster management device extracts the parameters and corresponding parameter values of each parameter field in the monitoring information, and obtains the preset readable format of the tool platform, and then fills the extracted parameters and corresponding parameter values into the preset readable format to obtain Monitoring information readable by the tool platform.

例如，设工具平台的应用发布请求的格式为JSON格式，容器集群的预设可读格式为Yaml格式。For example, suppose the format of the application publishing request of the tool platform is JSON format, and the default readable format of the container cluster is Yaml format.

容器集群管理装置从Yaml格式的监控信息中提取各参数字段的参数与相应参数值，如容器集群的工作状态、空闲状态，并将提取各参数字段的参数与相应参数值填入JOSN格式的相应位置，得到JOSN格式的监控信息，以使容器集群读取该监控信息。The container cluster management device extracts the parameters and corresponding parameter values of each parameter field from the monitoring information in the Yaml format, such as the working state and idle state of the container cluster, and fills the parameters and corresponding parameter values of the extracted parameter fields into the corresponding ones in the JOSN format Position, get the monitoring information in JOSN format so that the container cluster can read the monitoring information.

步骤430、容器集群管理装置向工具平台发送格式转换后的监控信息。Step 430: The container cluster management device sends the converted monitoring information to the tool platform.

技术人员或用户可在工具平台，如IMS，上配置告警策略，若容器集群管理装置，如ims-reporter，识别出监控信息中存在异常指标，如CPU过载，工具平台会触发相应的告警事件。Technicians or users can configure alarm policies on tool platforms, such as IMS. If container cluster management devices, such as ims-reporter, identify abnormal indicators in the monitoring information, such as CPU overload, the tool platform will trigger corresponding alarm events.

进一步的，对容器集群中应用的升级、扩容、下线(或称“删除”)等处理可以包括：Further, the processing of upgrading, expanding, and offline (or "deleting") applications in the container cluster may include:

容器集群管理装置接收工具平台发送的应用处理请求，应用处理请求包括待处理应用的程序文件、程序文件的资源需求信息、待处理应用标识和待处理应用对应的容器集群标识和相应服务器标识，其中，容器集群标识对应的容器集群的可读格式与工具平台的可读格式的不同，程序文件包括对待处理应用进行升级、扩容和删除处理的文件；The container cluster management device receives the application processing request sent by the tool platform. The application processing request includes the program file of the application to be processed, the resource requirement information of the program file, the identifier of the application to be processed, and the container cluster identifier and corresponding server identifier corresponding to the application to be processed, wherein The readable format of the container cluster corresponding to the container cluster identifier is different from the readable format of the tool platform. The program files include files for upgrading, expanding, and deleting the application to be processed;

若容器集群标识对应的容器集群的可用资源信息不小于程序文件的资源需求信息，则采用第一格式转换算法，将应用处理请求的格式转换为容器集群的可读格式，得到格式转换后的应用处理请求；If the available resource information of the container cluster corresponding to the container cluster identifier is not less than the resource requirement information of the program file, the first format conversion algorithm is used to convert the format of the application processing request into a readable format of the container cluster to obtain the converted application Processing request

之后，向容器集群标识对应的容器集群发送格式转换后的应用处理请求，应用处理请求用于指示容器集群对该服务器标识对应的服务器中的待处理应用执行程序文件。After that, the format-converted application processing request is sent to the container cluster corresponding to the container cluster identifier, and the application processing request is used to instruct the container cluster to execute the application file to be processed in the server corresponding to the server identifier.

进一步的，由上述图2-图4可知，该管理方法可以包括对应用资源配置的管理、对应用发布的管理，以及监控告警上报的管理。Furthermore, as can be seen from the foregoing Figures 2 to 4, the management method may include management of application resource configuration, management of application release, and management of monitoring alarm reporting.

在一个例子中，以工具平台可以包括ITSM、CMDB，容器集群管理装置包括wcs-rm为例，如图5所示，容器集群管理装置对容器集群中目标应用的资源配置进行管理可以包括：In an example, the tool platform may include ITSM and CMDB, and the container cluster management device includes wcs-rm as an example. As shown in FIG. 5, the container cluster management device to manage the resource configuration of the target application in the container cluster may include:

步骤501、ITSM向CMDB发送第一资源查询请求。Step 501: ITSM sends a first resource query request to the CMDB.

ITSM可以接收业务***发送的初始资源申请请求，初始资源申请请求可以包括待分配资源应用的资源需求信息、待分配资源应用标识和为待分配资源应用申请的容器集群标识，或可以接收用户输入的待分配资源应用的资源需求信息、待分配资源应用标识和为待分配资源应用申请的容器集群标识。之后ITSM向CMDB发送第一资源查询请求，以查询申请的容器集群标识对应的目标容器集群已使用的资源信息。ITSM can receive the initial resource application request sent by the business system. The initial resource application request can include the resource demand information of the resource application to be allocated, the resource application identifier to be allocated, and the container cluster identifier applied for the resource application to be allocated, or it can receive user input The resource requirement information of the resource application to be allocated, the resource application identifier to be allocated, and the container cluster identifier applied for the resource application to be allocated. After that, ITSM sends a first resource query request to the CMDB to query the resource information of the target container cluster corresponding to the applied container cluster identifier.

步骤502、CMDB向ITSM发送第一资源查询结果。Step 502: The CMDB sends the first resource query result to ITSM.

ITSM获取申请的容器集群标识对应的目标容器集群已使用的资源信息。ITSM obtains the used resource information of the target container cluster corresponding to the applied container cluster identifier.

或者，ITSM可以根据申请的容器集群标识对应的目标容器集群已使用的资源信息和存储的该目标容器集群的总资源信息，获取该目标容器集群可用资源信息。Alternatively, the ITSM may obtain the available resource information of the target container cluster according to the resource information used by the target container cluster corresponding to the applied container cluster identifier and the stored total resource information of the target container cluster.

步骤503、ITSM向wcs-rm发送资源申请请求。Step 503: ITSM sends a resource application request to wcs-rm.

资源申请请求可以包括待发布应用的程序文件的资源需求信息、待发布应用标识和目标容器集群的可用资源信息。The resource application request may include the resource requirement information of the program file of the application to be published, the identification of the application to be published, and the available resource information of the target container cluster.

wcs-rm根据总资源信息和已使用的资源信息，获取目标容器集群的可用资源信息。wcs-rm obtains the available resource information of the target container cluster according to the total resource information and the used resource information.

或者，该资源申请请求可以包括待分配资源应用的资源需求信息，以及工具平台统计的目标容器集群的可用资源信息。Alternatively, the resource application request may include resource requirement information of the resource application to be allocated, and available resource information of the target container cluster calculated by the tool platform.

也就是说，目标容器集群的可用资源信息可以由ITSM获取，也可以由wcs-rm获取，本发明实施例在此不做限定。In other words, the available resource information of the target container cluster can be obtained by ITSM or wcs-rm, which is not limited in this embodiment of the present invention.

步骤504、wcs-rm根据待发布应用的资源需求信息，采用预设资源分配规则，对目标容器集群的可用资源信息进行分配，得到待分配资源应用的资源分配信息。Step 504: The wcs-rm uses preset resource allocation rules to allocate the available resource information of the target container cluster according to the resource requirement information of the application to be released, and obtain the resource allocation information of the resource application to be allocated.

待发布应用的资源需求信息可以包括CPU使用量、内存使用量、磁盘使用量、容器实例的占用量等信息。The resource requirement information of the application to be released may include information such as CPU usage, memory usage, disk usage, and container instance usage.

wcs-rm按照预设资源分配规则中满足高可用的需求或资源均衡分配的规则，查找目标容器集群中可用资源信息不小于待发布应用的资源需求信息的服务器，将其确定为待发布应用所属的服务器，并获取待发布应用在该服务器上的使用资源的分配比例。According to the preset resource allocation rules, wcs-rm finds the server whose available resource information in the target container cluster is not less than the resource demand information of the application to be published according to the rules of meeting high availability requirements or resource balanced allocation in the preset resource allocation rules, and determines that it belongs to the application to be published Server, and obtain the allocation ratio of resources used by the application to be published on the server.

步骤505、wcs-rm向CMDB发送资源分配信息，并向ITSM发送资源申请响应。Step 505: wcs-rm sends resource allocation information to the CMDB, and sends a resource application response to ITSM.

资源申请响应用于指示ITSM资源分配是否成功。The resource request response is used to indicate whether the ITSM resource allocation is successful.

步骤506、CMDB存储资源分配信息。Step 506: The CMDB stores resource allocation information.

在一个例子中，以工具平台包括CMDB和AOMP，容器集群管理装置包括wcs-nginx和wcs-gateway为例，如图6所示，容器集群管理装置对应用发布的管理，可以包括：In an example, the tool platform includes CMDB and AOMP, and the container cluster management device includes wcs-nginx and wcs-gateway as an example. As shown in Figure 6, the container cluster management device manages application releases, which may include:

步骤601、AOMP获取初始应用发布请求。Step 601: AOMP obtains the initial application release request.

AOMP接收业务***发送的初始应用发布请求，或接收管理终端发送的技术人员或用户输入的初始应用发布请求，初始应用发布请求可以包括待发布应用的程序文件和待发布应用标识。AOMP receives the initial application publishing request sent by the business system, or the initial application publishing request input by the technician or user sent by the management terminal. The initial application publishing request may include the program file of the application to be published and the application identifier to be published.

步骤602、AOMP向CMDB发送第二资源查询请求。Step 602: AOMP sends a second resource query request to the CMDB.

第二资源查询请求可以包括待发布应用标识。The second resource query request may include the identification of the application to be released.

步骤603、CMDB根据待发布应用标识向AOMP发送第二资源查询结果。Step 603: The CMDB sends the second resource query result to the AOMP according to the application identifier to be released.

第二资源查询结果可以包括待发布应用对应的目标容器集群标识和服务器标识。The second resource query result may include the target container cluster identification and server identification corresponding to the application to be released.

步骤604、AOMP向wcs-nginx发送应用发布请求。Step 604: AOMP sends an application publishing request to wcs-nginx.

应用发布请求可以包括待发布应用的程序文件、待发布应用标识和待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识。The application publishing request may include the program file of the application to be published, the application identifier to be published, the target container cluster identifier corresponding to the application to be published, and the server identifier in the target container cluster.

步骤605、wcs-nginx向wcs-gateway发送应用发布请求。Step 605: wcs-nginx sends an application publishing request to wcs-gateway.

步骤606、wcs-gateway采用第一格式转换算法，将应用发布请求的格式转换为目标容器集群标识对应的目标容器集群的预设可读格式。Step 606: The wcs-gateway uses the first format conversion algorithm to convert the format of the application publishing request into a preset readable format of the target container cluster corresponding to the target container cluster identifier.

步骤607、wcs-gateway向目标容器集群的标识对应的目标容器集群发送格式转换后的应用发布请求。Step 607: The wcs-gateway sends the application publishing request after format conversion to the target container cluster corresponding to the identifier of the target container cluster.

步骤608、目标容器集群根据应用发布请求，对服务器标识对应的服务器中的待发布应用的程序文件执行发布操作。Step 608: The target container cluster performs a publishing operation on the program file of the application to be published in the server corresponding to the server identifier according to the application publishing request.

在一个例子中，以工具平台包括IMS，容器集群管理装置包括ims-reporter为例，如图7所示，容器集群管理装置对监控容器集群的工作状态进行管理，实现告警上报的管理，可以包括：In an example, taking the tool platform including IMS and the container cluster management device including ims-reporter as an example, as shown in Figure 7, the container cluster management device manages the working status of the monitoring container cluster and realizes the management of alarm reporting, which may include :

步骤701、ims-reporter采集预设的待监控容器集群标识对应的容器集群的监控信息。Step 701: The ims-reporter collects preset monitoring information of the container cluster corresponding to the identifier of the container cluster to be monitored.

ims-reporter主动向待监控容器集群采集监控信息。ims-reporter actively collects monitoring information from the container cluster to be monitored.

步骤702、ims-reporter采用第二格式转换算法，将监控信息的格式转换为IMS的预设可读格式。Step 702: The ims-reporter uses the second format conversion algorithm to convert the format of the monitoring information into a preset readable format of the IMS.

步骤703、向IMS发送格式转换后的监控信息。Step 703: Send the converted monitoring information to the IMS.

本发明实施例提高的上述方法在接收工具平台发送的应用发布请求，应用发布请求包括待发布应用的程序文件、待发布应用标识和待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，目标容器集群标识对应的目标容器集群的可读格式与工具平台的可读格式的不同；采用第一格式转换算法，将应用发布请求的格式转换为目标容器集群标识对应的目标容器集群的可读格式，得到格式转换后的应用发布请求；向目标容器集群标识对应的目标容器集群发送格式转换后的应用发布请求，应用发布请求用于指示目标容器集群对服务器标识对应的服务器中的待发布应用的程序文件执行发布操作。与现有技术相比，该方法实现了原非容器化架构的工具平台与原容器集群相配合，即实现了将非容器化***架构演化为容器化架构，避免了对非容器化***架构的重构和改造，降低了容器集群的管理成本。The above method improved by the embodiment of the present invention receives an application publishing request sent by a tool platform. The application publishing request includes the program file of the application to be published, the application identifier to be published, the target container cluster identifier corresponding to the application to be published, and the server in the target container cluster ID, the readable format of the target container cluster corresponding to the target container cluster ID is different from the readable format of the tool platform; the first format conversion algorithm is used to convert the format of the application release request to the target container cluster corresponding to the target container cluster ID The readable format is used to obtain the application publishing request after the format conversion; the application publishing request after the format conversion is sent to the target container cluster corresponding to the target container cluster identifier. The application publishing request is used to instruct the target container cluster to wait for the server in the server corresponding to the server identifier. The program file of the published application performs the publishing operation. Compared with the prior art, this method realizes the cooperation of the tool platform of the original non-containerized architecture with the original container cluster, that is, realizes the evolution of the non-containerized system architecture into the containerized architecture, and avoids the need for non-containerized system architecture. Refactoring and transformation have reduced the management cost of the container cluster.

可以理解的是，本发明上述实施例的方法可以应用在金融机构中的存款业务、贷款业务、同业业务等实际业务场景中，可以降低上述业务场景的管理成本。It is understandable that the method of the foregoing embodiment of the present invention can be applied to actual business scenarios such as deposit business, loan business, and interbank business in financial institutions, and can reduce the management cost of the foregoing business scenarios.

与上述方法对应的，本发明实施例还提供一种管理装置，如图8所示，该管理装置包括：接收单元810、格式转换单元820和发送单元830。Corresponding to the foregoing method, an embodiment of the present invention also provides a management device. As shown in FIG. 8, the management device includes: a receiving unit 810, a format conversion unit 820, and a sending unit 830.

接收单元810，用于接收工具平台发送的应用发布请求，所述应用发布请求包括待发布应用的程序文件、待发布应用标识和所述待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，所述目标容器集群标识对应的目标容器集群的可读格式与所述工具平台的可读格式的不同；The receiving unit 810 is configured to receive an application publishing request sent by the tool platform, where the application publishing request includes the program file of the application to be published, the application identifier to be published, and the target container cluster identifier corresponding to the application to be published and the target container cluster Server identifier, the readable format of the target container cluster corresponding to the target container cluster identifier is different from the readable format of the tool platform;

格式转换单元820，用于采用第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群标识对应的目标容器集群的预设可读格式，得到格式转换后的应用处理请求；The format conversion unit 820 is configured to use the first format conversion algorithm to convert the format of the application processing request into a preset readable format of the target container cluster corresponding to the target container cluster identifier to obtain the application processing request after the format conversion ；

发送单元830，用于向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用发布请求，所述应用发布请求用于指示所述目标容器集群对所述服务器标识对应的服务器中的所述待发布应用的程序文件执行发布操作。The sending unit 830 is configured to send the application publishing request after the format conversion to the target container cluster corresponding to the target container cluster identifier, where the application publishing request is used to instruct the target container cluster to send the server corresponding to the server identifier The program file of the application to be released in, executes the release operation.

在一个可选的实现中，所述装置还包括分配单元840；In an optional implementation, the device further includes an allocation unit 840;

接收单元810，还用于接收所述工具平台发送的资源申请请求，所述资源申请请求包括待发布应用的程序文件的资源需求信息、所述待发布应用标识和目标容器集群的可用资源信息，所述目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的；The receiving unit 810 is further configured to receive a resource application request sent by the tool platform, where the resource application request includes resource requirement information of the program file of the application to be published, the identification of the application to be published, and the available resource information of the target container cluster, The target container cluster is determined by the tool platform according to the container cluster identifier applied by the business system;

分配单元840，用于根据所述待发布应用的资源需求信息，采用预设资源分配规则，对所述目标容器集群的可用资源信息进行分配，得到所述待发布应用在所述目标容器集群中所属服务器的服务器标识，所述目标容器集群标识对应的容器集群的可用资源信息不小于所述程序文件的资源需求信息；The allocating unit 840 is configured to allocate the available resource information of the target container cluster according to the resource requirement information of the application to be published and using preset resource allocation rules to obtain that the application to be published is in the target container cluster The server identifier of the server to which it belongs, and the available resource information of the container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file;

发送单元830，还用于向所述工具平台发送所述待发布应用对应的目标容器集群标识、所述服务器标识和使用资源的分配结果。The sending unit 830 is further configured to send the target container cluster identification corresponding to the application to be published, the server identification, and the allocation result of the used resources to the tool platform.

在一个可选的实现中，接收单元810，还用于接收所述工具平台发送的应用处理请求，所述应用处理请求包括待处理应用的程序文件、所述程序文件的资源需求信息、待处理应用标识和所述待处理应用对应的容器集群标识和相应服务器标识，其中，所述容器集群标识对应的容器集群的可读格式与所述工具平台的可读格式的不同，所述程序文件包括对所述待处理应用进行升级、扩容和删除处理的文件；In an optional implementation, the receiving unit 810 is further configured to receive an application processing request sent by the tool platform. The application processing request includes the program file of the application to be processed, the resource requirement information of the program file, and the application processing request. The application identifier and the container cluster identifier corresponding to the application to be processed and the corresponding server identifier, wherein the readable format of the container cluster corresponding to the container cluster identifier is different from the readable format of the tool platform, and the program file includes Upgrade, expand, and delete files for the application to be processed;

格式转换单元820，还用于若所述目标容器集群标识对应的目标容器集群的可用资源信息不小于所述待处理应用的程序文件的资源需求信息，则采用所述第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群的可读格式，得到格式转换后的应用处理请求；The format conversion unit 820 is further configured to use the first format conversion algorithm if the available resource information of the target container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file of the application to be processed Converting the format of the application processing request into a readable format of the target container cluster to obtain the application processing request after the format conversion;

发送单元830，还用于向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用处理请求，所述应用处理请求用于指示所述容器集群对所述服务器标识对应的服务器中的所述待处理应用执行所述程序文件。The sending unit 830 is further configured to send the application processing request after the format conversion to the target container cluster corresponding to the target container cluster identifier, where the application processing request is used to instruct the container cluster to respond to the server corresponding to the server identifier. The to-be-processed application in executes the program file.

在一个可选的实现中，所述装置还包括采集单元850；In an optional implementation, the device further includes a collection unit 850;

采集单元850，还用于采集预设的待监控容器集群标识对应的容器集群的监控信息，所述监控信息包括所述容器集群的工作状态信息；The collection unit 850 is further configured to collect monitoring information of a container cluster corresponding to a preset container cluster identifier to be monitored, where the monitoring information includes working status information of the container cluster;

格式转换单元820，还用于采用第二格式转换算法，将所述监控信息的格式转换为所述工具平台的预设可读格式；The format conversion unit 820 is further configured to use a second format conversion algorithm to convert the format of the monitoring information into a preset readable format of the tool platform;

发送单元830，还用于向所述工具平台发送格式转换后的监控信息。The sending unit 830 is further configured to send the monitoring information after the format conversion to the tool platform.

本发明上述实施例提供的管理装置的各功能单元的功能，可以通过上述各方法步骤来实现，因此，本发明实施例提供的管理装置中的各个单元的具体工作过程和有益效果，在此不复赘述。The functions of each functional unit of the management device provided by the above-mentioned embodiment of the present invention can be realized by the above method steps. Therefore, the specific working process and beneficial effects of each unit in the management device provided by the embodiment of the present invention are not here. Repeat.

本发明实施例还提供了一种电子设备，如图9所示，包括处理器910、通信接口920、存储器930和通信总线940，其中，处理器910，通信接口920，存储器930通过通信总线940完成相互间的通信。An embodiment of the present invention also provides an electronic device, as shown in FIG. 9, including a processor 910, a communication interface 920, a memory 930, and a communication bus 940. The processor 910, the communication interface 920, and the memory 930 pass through the communication bus 940. Complete mutual communication.

存储器930，用于存放计算机程序；The memory 930 is used to store computer programs;

处理器910，用于执行存储器930上所存放的程序时，实现如下步骤：The processor 910 is configured to implement the following steps when executing the program stored in the memory 930:

采用第一格式转换算法，将所述应用发布请求的格式转换为所述目标容器集群标识对应的目标容器集群的可读格式，得到格式转换后的应用发布请求；Using the first format conversion algorithm to convert the format of the application publishing request into a readable format of the target container cluster corresponding to the target container cluster identifier to obtain the application publishing request after the format conversion;

上述提到的通信总线可以是外设部件互连标准(Peripheral Component Interconnect，PCI)总线或扩展工业标准结构(Extended Industry Standard Architecture，EISA)总线等。该通信总线可以分为地址总线、数据总线、控制总线等。为便于表示，图中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。The aforementioned communication bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The communication bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

通信接口用于上述电子设备与其他设备之间的通信。The communication interface is used for communication between the aforementioned electronic device and other devices.

存储器可以包括随机存取存储器(Random Access Memory，RAM)，也可以包括非易失性存储器(Non-Volatile Memory，NVM)，例如至少一个磁盘存储器。可选的，存储器还可以是至少一个位于远离前述处理器的存储装置。The memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage. Optionally, the memory may also be at least one storage device located far away from the foregoing processor.

上述的处理器可以是通用处理器，包括中央处理器(Central Processing Unit，CPU)、网络处理器(Network Processor，NP)等；还可以是数字信号处理器(Digital Signal Processing，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (DSP), a dedicated Circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

由于上述实施例中电子设备的各器件解决问题的实施方式以及有益效果可以参见图2-图4所示的实施例中的各步骤来实现，因此，本发明实施例提供的电子设备的具体工作过程和有益效果，在此不复赘述。Since the implementation manners and beneficial effects of the various components of the electronic device in the above embodiment to solve the problem can be achieved by referring to the steps in the embodiment shown in FIGS. 2 to 4, the specific work of the electronic device provided by the embodiment of the present invention The process and beneficial effects will not be repeated here.

在本发明提供的又一实施例中，还提供了一种计算机可读存储介质，该计算机可读存储介质中存储有指令，当其在计算机上运行时，使得计算机执行上述实施例中任一所述的容器集群的管理方法。In yet another embodiment provided by the present invention, a computer-readable storage medium is also provided. The computer-readable storage medium stores instructions that, when run on a computer, cause the computer to execute any of the above embodiments. The management method of the container cluster.

在本发明提供的又一实施例中，还提供了一种计算机程序产品，该计算机程序产品包括存储在计算机可读存储介质上的计算机程序，计算机程序包括程序指令，当程序指令被计算机执行时，使计算机执行上述实施例中任一所述的容器集群的管理方法。In yet another embodiment provided by the present invention, a computer program product is also provided. The computer program product includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, , Let the computer execute the container cluster management method described in any one of the above embodiments.

本领域内的技术人员应明白，本申请实施例中的实施例可提供为方法、***、或计算机程序产品。因此，本申请实施例中可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请实施例中可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments in the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the embodiments of the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes. .

本申请实施例中是参照根据本申请实施例中实施例的方法、设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The embodiments of the present application are described with reference to the flowcharts and/or block diagrams of the methods, equipment (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

尽管已描述了本申请实施例中的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本申请实施例中范围的所有变更和修改。Although the preferred embodiments of the embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.

显然，本领域的技术人员可以对本申请实施例中实施例进行各种改动和变型而不脱离本申请实施例中实施例的精神和范围。这样，倘若本申请实施例中实施例的这些修改和变型属于本申请实施例中权利要求及其等同技术的范围之内，则本申请实施例中也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. In this way, if these modifications and variations of the embodiments in the embodiments of the application fall within the scope of the claims in the embodiments of the application and their equivalent technologies, the embodiments of the application are also intended to include these modifications and variations.

Claims

一种容器集群管理方法，其特征在于，所述方法包括：A container cluster management method, characterized in that the method includes:

接收工具平台发送的应用发布请求，所述应用发布请求包括待发布应用的程序文件、待发布应用标识和所述待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，所述目标容器集群标识对应的目标容器集群的可读格式与所述工具平台的可读格式的不同；Receive an application publishing request sent by the tool platform, the application publishing request including the program file of the application to be published, the application identifier to be published, the target container cluster identifier corresponding to the application to be published and the server identifier in the target container cluster, the target The readable format of the target container cluster corresponding to the container cluster identifier is different from the readable format of the tool platform;

采用第一格式转换算法，将所述应用发布请求的格式转换为所述目标容器集群标识对应的目标容器集群的可读格式，得到格式转换后的应用发布请求；Using the first format conversion algorithm to convert the format of the application publishing request into a readable format of the target container cluster corresponding to the target container cluster identifier to obtain the application publishing request after the format conversion;

向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用发布请求，所述应用发布请求用于指示所述目标容器集群对所述服务器标识对应的服务器中的所述待发布应用的程序文件执行发布操作。The application publishing request after the format conversion is sent to the target container cluster corresponding to the target container cluster identifier, where the application publishing request is used to instruct the target container cluster to respond to the to-be-published server in the server corresponding to the server identifier The application's program file performs the publishing operation.
如权利要求1所述的方法，其特征在于，接收工具平台发送的应用发布请求之前，所述方法还包括：The method of claim 1, wherein before receiving the application publishing request sent by the tool platform, the method further comprises:

接收所述工具平台发送的资源申请请求，所述资源申请请求包括待发布应用的程序文件的资源需求信息、所述待发布应用标识和目标容器集群的可用资源信息，所述目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的；Receive a resource application request sent by the tool platform, where the resource application request includes resource requirement information of the program file of the application to be published, the identification of the application to be published, and the available resource information of the target container cluster, where the target container cluster is The tool platform is determined according to the container cluster identifier applied by the business system;

根据所述待发布应用的资源需求信息，采用预设资源分配规则，对所述目标容器集群的可用资源信息进行分配，得到所述待发布应用在所述目标容器集群中所属服务器的服务器标识，所述目标容器集群的可用资源信息不小于所述程序文件的资源需求信息；According to the resource requirement information of the application to be published, using preset resource allocation rules, the available resource information of the target container cluster is allocated to obtain the server identifier of the server to which the application to be published belongs in the target container cluster, The available resource information of the target container cluster is not less than the resource requirement information of the program file;

向所述工具平台发送所述待发布应用对应的目标容器集群标识、所述服务器标识和使用资源的分配结果。Sending the target container cluster identifier corresponding to the application to be released, the server identifier, and the allocation result of the used resources to the tool platform.
如权利要求1所述的方法，其特征在于，所述方法还包括：The method of claim 1, wherein the method further comprises:

接收所述工具平台发送的应用处理请求，所述应用处理请求包括待处理应用的程序文件、所述程序文件的资源需求信息、待处理应用标识和所述待处理应用对应的目标容器集群标识和相应服务器标识，其中，所述目标容器集群标识对应的目标容器集群的可读格式与所述工具平台的可读格式的不同，所述程序文件包括对所述待处理应用进行升级、扩容和删除处理的文件；Receive an application processing request sent by the tool platform, where the application processing request includes the program file of the application to be processed, the resource requirement information of the program file, the identifier of the application to be processed, and the target container cluster identifier corresponding to the application to be processed, and The corresponding server identifier, wherein the readable format of the target container cluster corresponding to the target container cluster identifier is different from the readable format of the tool platform, and the program file includes upgrading, expanding and deleting the application to be processed Files processed;

若所述目标容器集群标识对应的目标容器集群的可用资源信息不小于所述待处理应用的程序文件的资源需求信息，则采用所述第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群的可读格式，得到格式转换后的应用处理请求；If the available resource information of the target container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file of the application to be processed, the first format conversion algorithm is used to convert the format of the application processing request Obtain the application processing request after format conversion for the readable format of the target container cluster;

向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用处理请求，所述应用处理请求用于指示所述容器集群对所述服务器标识对应的服务器中的所述待处理应用执行所述程序文件。Send the format-converted application processing request to the target container cluster corresponding to the target container cluster identifier, where the application processing request is used to instruct the container cluster to respond to the application to be processed in the server corresponding to the server identifier Execute the program file.
如权利要求1-3任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1-3, wherein the method further comprises:

采集预设的待监控容器集群标识对应的容器集群的监控信息，所述监控信息包括所述容器集群的工作状态信息；Collecting preset monitoring information of the container cluster corresponding to the identifier of the container cluster to be monitored, where the monitoring information includes working status information of the container cluster;

采用第二格式转换算法，将所述监控信息的格式转换为所述工具平台的预设可读格式；Using a second format conversion algorithm to convert the format of the monitoring information into a preset readable format of the tool platform;

向所述工具平台发送格式转换后的监控信息。The monitoring information after format conversion is sent to the tool platform.
如权利要求4所述的方法，其特征在于，采集预设的待监控容器集群标识对应的容器集群的监控信息，包括：The method according to claim 4, wherein the collecting monitoring information of the container cluster corresponding to the preset container cluster identifier to be monitored comprises:

根据预设采集周期，周期性的采集预设的待监控容器集群标识对应的容器集群的监控信息。According to the preset collection period, periodically collect the monitoring information of the container cluster corresponding to the preset container cluster identifier to be monitored.
一种管理装置，其特征在于，所述装置包括：接收单元、格式转换单元和发送单元；A management device, characterized in that the device includes: a receiving unit, a format conversion unit, and a sending unit;

所述接收单元，用于接收工具平台发送的应用发布请求，所述应用发布请求包括待发布应用的程序文件、待发布应用标识和所述待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，所述目标容器集群标识对应的目标容器集群的可读格式与所述工具平台的可读格式的不同；The receiving unit is configured to receive an application publishing request sent by a tool platform, the application publishing request including the program file of the application to be published, the application identifier to be published, and the target container cluster identifier corresponding to the application to be published and the target container cluster The readable format of the target container cluster corresponding to the target container cluster identifier is different from the readable format of the tool platform;

所述格式转换单元，用于采用第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群标识对应的目标容器集群的预设可读格式，得到格式转换后的应用处理请求；The format conversion unit is configured to use a first format conversion algorithm to convert the format of the application processing request into a preset readable format of the target container cluster corresponding to the target container cluster identifier to obtain the application processing after the format conversion request;

所述发送单元，用于向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用发布请求，所述应用发布请求用于指示所述目标容器集群对所述服务器标识对应的服务器中的所述待发布应用的程序文件执行发布操作。The sending unit is configured to send the application publishing request after the format conversion to the target container cluster corresponding to the target container cluster identifier, and the application publishing request is used to instruct the target container cluster to correspond to the server identifier The program file of the application to be released in the server performs a publishing operation.
如权利要求6所述的装置，其特征在于，所述装置还包括分配单元；8. The device of claim 6, wherein the device further comprises a distribution unit;

所述接收单元，还用于接收所述工具平台发送的资源申请请求，所述资源申请请求包括待发布应用的程序文件的资源需求信息、所述待发布应用标识和目标容器集群的可用资源信息，所述目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的；The receiving unit is further configured to receive a resource application request sent by the tool platform, where the resource application request includes resource requirement information of the program file of the application to be published, the identification of the application to be published, and the available resource information of the target container cluster , The target container cluster is determined by the tool platform according to the container cluster identifier applied by the business system;

所述分配单元，用于根据所述待发布应用的资源需求信息，采用预设资源分配规则，对所述目标容器集群的可用资源信息进行分配，得到所述待发布应用在所述目标容器集群中所属服务器的服务器标识，所述目标容器集群标识对应的容器集群的可用资源信息不小于所述程序文件的资源需求信息；The allocation unit is configured to allocate the available resource information of the target container cluster according to the resource requirement information of the application to be published and adopt a preset resource allocation rule to obtain that the application to be published is in the target container cluster The server identifier of the server to which the target container cluster belongs, and the available resource information of the container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file;

所述发送单元，还用于向所述工具平台发送所述待发布应用对应的目标容器集群标识、所述服务器标识和使用资源的分配结果。The sending unit is further configured to send the target container cluster identification corresponding to the application to be released, the server identification, and the allocation result of the used resources to the tool platform.
如权利要求6所述的装置，其特征在于，所述接收单元，还用于接收所述工具平台发送的应用处理请求，所述应用处理请求包括待处理应用的程序文件、所述程序文件的资源需求信息、待处理应用标识和所述待处理应用对应的目标容器集群标识和相应服务器标识，其中，所述目标容器集群标识对应的目标容器集群的可读格式与所述工具平台的可读格式的不同，所述程序文件包括对所述待处理应用进行升级、扩容和删除处理的文件；The device according to claim 6, wherein the receiving unit is further configured to receive an application processing request sent by the tool platform, the application processing request including a program file of the application to be processed, and a file of the program file. The resource requirement information, the identification of the application to be processed, and the identification of the target container cluster corresponding to the application to be processed and the corresponding server identification, wherein the readable format of the target container cluster corresponding to the target container cluster identification and the readable format of the tool platform Different formats, the program files include files for upgrading, expanding, and deleting the application to be processed;

所述格式转换单元，还用于若所述目标容器集群标识对应的目标容器集群的可用资源信息不小于所述待处理应用的程序文件的资源需求信息，则采用所述第一格式转换算法，将所述应用处理请求的格式转换为所述目标容器集群的可读格式，得到格式转换后的应用处理请求；The format conversion unit is further configured to use the first format conversion algorithm if the available resource information of the target container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file of the application to be processed, Converting the format of the application processing request into a readable format of the target container cluster to obtain the application processing request after the format conversion;

所述发送单元，还用于向所述目标容器集群标识对应的目标容器集群发送所述格式转换后的应用处理请求，所述应用处理请求用于指示所述容器集群对所述服务器标识对应的服务器中的所述待处理应用执行所述程序文件。The sending unit is further configured to send the application processing request after the format conversion to the target container cluster corresponding to the target container cluster identifier, and the application processing request is used to instruct the container cluster to correspond to the server identifier The application to be processed in the server executes the program file.
如权利要求6-8任一项所述的装置，其特征在于，所述装置还包括采集单元；8. The device according to any one of claims 6-8, wherein the device further comprises a collection unit;

所述采集单元，还用于采集预设的待监控容器集群标识对应的容器集群的监控信息，所述监控信息包括所述容器集群的工作状态信息；The collection unit is further configured to collect monitoring information of a container cluster corresponding to a preset container cluster identifier to be monitored, where the monitoring information includes working status information of the container cluster;

所述格式转换单元，还用于采用第二格式转换算法，将所述监控信息的格式转换为所述工具平台的预设可读格式；The format conversion unit is further configured to use a second format conversion algorithm to convert the format of the monitoring information into a preset readable format of the tool platform;

所述发送单元，还用于向所述工具平台发送格式转换后的监控信息。The sending unit is further configured to send the monitoring information after format conversion to the tool platform.
一种管理***，其特征在于，所述***包括：工具平台、容器集群管理装置和容器集群；A management system, characterized in that the system includes: a tool platform, a container cluster management device, and a container cluster;

所述工具平台，用于获取初始应用发布请求，所述初始应用发布请求包括对待发布应用标识和待发布应用的程序文件，并查询出所述待发布应用标识对应的目标容器集群标识，并向所述容器集群管理装置发送应用发布请求，所述应用发布请求包括所述待发布应用的程序文件、所述待发布应用标识和所述待发布应用对应的目标容器集群标识和目标容器集群中的服务器标识，所述目标容器集群是所述工具平台根据业务***申请的容器集群标识确定的；所述目标容器集群标识对应的目标容器集群的可用资源信息不小于所述程序文件的资源需求信息；The tool platform is used to obtain an initial application release request, the initial application release request includes the application identification to be released and the program file of the application to be released, and the target container cluster identification corresponding to the application identification to be released is queried and sent to The container cluster management device sends an application publishing request, the application publishing request includes the program file of the application to be published, the application identifier to be published, the target container cluster identifier corresponding to the application to be published, and the target container cluster Server identifier, the target container cluster is determined by the tool platform according to the container cluster identifier applied by the business system; the available resource information of the target container cluster corresponding to the target container cluster identifier is not less than the resource requirement information of the program file;

所述容器集群管理装置，用于采用第一格式转换算法，将接收的所述应用发布请求的格式转换为所述目标容器集群标识对应的目标容器集群的预设可读格式；向所述目标容器集群标识对应的目标容器集群发送格式转换后的应用发布请求；The container cluster management device is configured to use a first format conversion algorithm to convert the format of the received application publishing request into a preset readable format of the target container cluster corresponding to the target container cluster identifier; The target container cluster corresponding to the container cluster identifier sends the application publishing request after format conversion;

所述容器集群，用于接收所述格式转换后的应用发布请求，并对所述服务器标识对应的服务器中的所述待发布应用的程序文件执行发布操作。The container cluster is configured to receive the application publishing request after the format conversion, and perform a publishing operation on the program file of the application to be published in the server corresponding to the server identifier.
一种电子设备，其特征在于，所述电子设备包括处理器、通信接口、存储器和通信总线，其中，处理器，通信接口，存储器通过通信总线完成相互间的通信；An electronic device, characterized in that the electronic device includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory complete mutual communication through the communication bus;

存储器，用于存放计算机程序；Memory, used to store computer programs;

处理器，用于执行存储器上所存储的程序时，实现权利要求1-5任一所述的方法步骤。The processor is configured to implement the method steps described in any one of claims 1-5 when executing the program stored in the memory.
一种计算机可读存储介质，其特征在于，所述计算机可读存储介质内存储有计算机程序，所述计算机程序被处理器执行时实现权利要求1-5任一所述的方法步骤。A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method steps of any one of claims 1-5 are realized.
一种计算机程序产品，其特征在于，所述计算机程序产品包括存储在计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行权利要求1-5任一所述的方法步骤。A computer program product, wherein the computer program product includes a computer program stored on a computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer, the computer Perform the method steps of any one of claims 1-5.