CN112422335A - Method, system, device and storage medium for realizing service link analysis based on micro-service architecture in technical middle station - Google Patents
Method, system, device and storage medium for realizing service link analysis based on micro-service architecture in technical middle station Download PDFInfo
- Publication number
- CN112422335A CN112422335A CN202011244058.2A CN202011244058A CN112422335A CN 112422335 A CN112422335 A CN 112422335A CN 202011244058 A CN202011244058 A CN 202011244058A CN 112422335 A CN112422335 A CN 112422335A
- Authority
- CN
- China
- Prior art keywords
- service
- link
- model
- business
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/145—Network analysis or design involving simulating, designing, planning or modelling of a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a system for realizing service link analysis based on a micro-service architecture in a technical middle desk, which comprises a service flow model, a micro-service deployment model and a service index model which are constructed according to a service link data meta-model, and a service link data model which reflects a service concept is formed to record full link information; acquiring full link information in a log file through a full link tracking log under a micro service architecture; and analyzing the service link, automatically identifying the service flow, and giving an analysis result according to the service dimension. The invention also relates to a method for realizing the service link analysis based on the micro-service architecture in the technical middle station. The method, the system, the device and the computer readable storage medium for realizing the service link analysis based on the micro-service architecture in the technical middle desk establish a service link data model, associate the service call link with the service concept by matching the service flow with the service call link, analyze the service call link from the service dimension, realize the analysis of the service link under the micro-service architecture and show the service condition information in a graphical mode.
Description
Technical Field
The invention relates to the field of micro service architecture, in particular to the field of full link tracking, and specifically relates to a method, a system and a device for realizing service link analysis based on micro service architecture in a technical middle station, and a computer readable storage medium thereof.
Background
The micro-service architecture is an architecture style developed by software architecture evolution, and decomposes a large single application program into small applications which are independently packaged and deployed, namely, functional modules of the micro-service architecture are distributed, deployed and operated and communicate with a lightweight mechanism (usually, an API of an HTTP resource). The complete service flow from the foreground to the background is processed and transmitted by a plurality of micro-services, so that the analysis of the service link needs to track the calling relationship and the service processing sequence among the micro-services, a complete calling chain is formed by tracking logs through the full link, and the information of the request content, the time consumption and the like of each processing step is recorded, so that the user experience analysis, the transaction full path monitoring and analysis, the end-to-end performance analysis, the system abnormity analysis, the system fault positioning and the like are performed.
In the micro-service architecture, service monitoring and problem analysis are realized through a full link trace log. It is necessary to know which micro-services are called by an interface and the order of the calls, and to string the micro-services to look like a chain, i.e., "call chain".
The realization of the call chain needs to use a sequence identifier for each micro service call, and then the service calls are arranged according to the size of the identifier, so that the call sequence can be clearly seen, and the identifier is 'SpaniD'.
The calling chain needs to know the specific calling request condition at a certain time, only the SpaniD is insufficient, a globally unique tracking identifier, namely the TraceId, needs to be generated in the first micro service receiving the external request, the TraceId is transmitted during the subsequent micro service calling, the TraceId is recorded when each called micro service outputs a log, and the recorded log is finally analyzed, so that all services called at this time can be found out according to the tracking identifier, and complete link tracking information is obtained.
According to the SpaniD, the sequence of the called micro-services can be analyzed, but the calling hierarchical relation cannot be analyzed, and a plurality of services can be called step by step or simultaneously called by the same service. Each call will note who called it, i.e. record "ParentId".
Therefore, the calling sequence and the hierarchy relation can be analyzed, but after the interface has a problem, a link with the problem cannot be found, generally, the time consumption for calling and executing is very long when a certain service has a problem, a time stamp is needed to calculate the time consumption for executing the service and is accurate to microsecond level, the time stamp when calling is initiated and the time stamp when the service returns are recorded, and therefore the time difference between calling initiation and service returning is calculated.
The total time consumption from service calling to service returning includes service execution time and network delay, and in practical application, the two types of time need to be analyzed so as to perform targeted optimization. We divide the process of calling and returning into the following four events:
1) the Client is called cs for short, and the Client initiates a call request to the server.
2) The Server Received, sr for short, means that the Server receives a call request from the client.
3) The Server set, ss for short, means that the Server has completed processing and is ready to return information to the client.
4) The Client Received, cr for short, means that the Client receives the return information of the server.
Recording the time stamp when these four events occur, the time consumption of each segment can be calculated, for example, sr minus cs is the network delay when calling, ss minus sr is the service execution time, cr minus ss is the delay of service response, and cr minus cs is the time when the whole service call is executed.
Besides the parameters, the Span block can also record other information, such as the name of the calling party service, the name of the called service, the returned result, the IP and the like, and finally, the information of the same Span Id is integrated to form a complete calling chain.
With the continuous development of technology, most background services nowadays have realized SOA, and the analysis of service links is directly simplified into the tracking of service call links, and the theoretical model of service link tracking under the current microservice architecture is basically derived from the Dapper paper of GOOGLE, i.e. Benjamin h.sigelman, Luiz Andr' e Barroso, Mike Burrows, Pat Stephenson, Manoj platform, Donald Beaver, Saul Jaspan and Chandan Shanbhag, etc. many technical experts in "Dapper, large-scale distributed system tracking system" (http:// biburgy. When a request of a user is processed by a plurality of subsystems in a system, the processing is carried out on different machines or even different clusters, and when the request processing is abnormal, the problem needs to be found quickly and accurately positioned to which link the problem is.
However, the Dapper only provides a theoretical model and simple implementation for solving the problem of request call, and has a single function, which is especially deficient in analyzing the service link. On the basis of the call request, a service instance, an aggregate request and a view forming a service instance level can express which other service instances one service instance depends on. Due to the complexity of the service, the subsequent requests caused by different request parameters are different, and meanwhile, the enterprise-level system is often deployed and operated in a cluster manner, and the same request and the subsequent requests caused by the same request do not always fall on the same service instance, so that the service link analysis based on the request is not obvious to a user, the service concept cannot be well expressed by calling the link, and the service-level analysis cannot be realized. Therefore, how to convert the call link into a service concept that can be understood and focused by the user is a matter of great research for those skilled in the art and is a central importance of the service link analysis scheme.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a method, a system and a device for realizing service link analysis based on a micro-service architecture in a technical middle station, which have the advantages of small error, intuition, clarity and wider application range, and a computer readable storage medium thereof.
In order to achieve the above object, the method, system, apparatus and computer readable storage medium for implementing service link analysis based on micro service architecture in the middle station of the technology of the present invention are as follows:
the method for realizing service link analysis based on the micro-service architecture in the technical middle station is mainly characterized by comprising the following steps:
(1) constructing a business process model, a micro-service deployment model and a business index model according to a business link data meta-model, and forming a business link data model reflecting a business concept to record full link information;
(2) acquiring full link information in a log file through a full link tracking log under a micro service architecture;
(3) and analyzing the service link, automatically identifying the service flow, and giving an analysis result according to the service dimension.
Preferably, the step (1) specifically comprises the following steps:
(1.1) establishing a business process model, and writing the business process model into the arrangement of activities and tasks in the business process;
(1.2) establishing a service deployment model, and writing a mapping relation among a deployment node, a service and a service instance;
and (1.3) establishing a business index model, and writing the mapping relation between the business process, the service and the business index.
Preferably, the step (2) specifically comprises the following steps:
(2.1) calling the service, receiving a calling request of a service calling party, and executing a specific service function of the service;
(2.2) recording technical log information when the service is called, recording corresponding service index data according to the service index model, and writing the corresponding service index data into a full link tracking log file;
(2.3) checking whether the service calling is finished, and if so, finishing the log information recording; otherwise, continue step (2.1).
Preferably, the step (3) specifically includes the following steps:
(3.1) respectively loading a business process model, a service deployment model and a business index model, and reading the information of each business process, the information of the service and the service instance of each deployment node and the business index information required by each service;
(3.2) synthesizing a business link data model, and assembling a business process model, a service deployment model and a business index model into a business link data model according to the incidence relation of each model element;
(3.3) reading the full link tracking log, and collecting link information to obtain a complete service call chain;
(3.4) identifying the business processes, comparing the business processes with the arrangement sequence of tasks in the business process model one by one according to the arrangement sequence of the service call chains, and matching the business processes corresponding to the service call chains;
(3.5) calculating a service index;
(3.6) displaying the calculated statistical index data through a visual graphical interface;
(3.7) checking whether the service link analysis is finished, if so, continuing to the step (3.3); otherwise, the procedure is ended.
Preferably, the step (3.5) specifically includes the following steps:
(3.5.1) according to the incidence relation of each model element, searching out the statistical indexes, the calculation formulas of the statistical indexes and each service index corresponding to the service process from the synthesized service link data model;
(3.5.2) retrieving all service index data required by the service process from the full link tracing log;
(3.5.3) calculating the statistical index data of the service process.
Preferably, the full link information in step (1) includes information and hierarchical relationships of business processes, activities, tasks, deployment nodes, services, service instances, statistical indicators, calculation formulas, services and business indicators.
The system for realizing service link analysis based on the micro-service architecture in the technical middle station is mainly characterized by comprising the following steps:
the service link data model building subsystem is used for respectively building a service flow model, a micro-service deployment model and a service index model and building a service link data model to record full link information;
the system comprises a service link data model building subsystem, a full link information collecting subsystem and a full link information tracking subsystem, wherein the service link data model building subsystem is used for establishing a service link data model;
and the service link analysis subsystem is connected with the acquisition full link information subsystem and used for automatically identifying the service flow according to the recorded service link data and giving an analysis result according to the service dimension.
Preferably, the service link data model building subsystem includes:
the business process construction module is used for arranging the business process according to the hierarchical relation of the business process, the activity and the task and storing the process information;
the service deployment model construction module is connected with the business process construction module and used for arranging and deploying architecture information according to the hierarchical relationship of the deployment nodes, the services and the service instances and storing the deployment architecture information;
and the service index model construction module is connected with the service deployment model construction module and used for planning the service information to be analyzed according to the hierarchical relation among the statistical indexes, the calculation formula, the service and the service indexes and storing the service information to be analyzed.
Preferably, the subsystem for collecting full link information comprises:
the full link information recording module is connected with the business link data model building subsystem and is used for recording full link tracking information and business link information of service calling into a full link tracking log;
and the service link data model processing module is connected with the full link information recording module and is used for identifying the service flow corresponding to each service call chain from the full link tracking log.
Preferably, the service link analysis subsystem includes:
the business link data model processing module is connected with the acquisition full link information subsystem and is used for acquiring the statistical index and the calculation formula corresponding to the business process and the business index information;
the service link information processing module is connected with the service link data model processing module and used for extracting the identified service index data related to the service process from the full link tracing log;
the service link analysis module is connected with the service link information processing module and used for calculating the statistical indexes of each service process one by one according to a calculation formula;
and the business link analysis module is connected with the business link analysis module and is used for displaying the statistical index data of each business process to a user.
The device for realizing the service link analysis processing based on the micro-service architecture is mainly characterized by comprising a memory for storing a program and a processor for executing the program, so as to realize the method for realizing the service link analysis based on the micro-service architecture in the technical middle station.
The computer readable storage medium is mainly characterized by comprising a program, wherein the program can be executed by a processor to complete the method for realizing the service link analysis based on the micro service architecture in the technical middle station.
By adopting the method, the system, the device and the computer readable storage medium for realizing the service link analysis based on the micro-service architecture in the technical middle desk, the service link data model is established, the service call link is associated with the service concept through matching the service flow with the service call link, and the service call link is analyzed from the service dimension, so that the service link analysis under the micro-service architecture is realized, and meanwhile, the service condition information can be displayed in a graphical mode.
Drawings
Fig. 1 is a schematic flow chart of full link information of a method for implementing service link analysis based on a micro service architecture in a platform in the technology of the present invention.
Fig. 2 is a schematic flow chart of a method for implementing service link analysis based on a micro service architecture in a platform in the technology of the present invention for establishing a service link data model.
Fig. 3 is a schematic flow chart of acquiring full link information of the method for implementing service link analysis based on the micro service architecture in the middle station in the technology of the present invention.
Fig. 4 is a schematic flow chart of service link analysis of the method for implementing service link analysis based on the micro service architecture in the middle station in the technology of the present invention.
Fig. 5 is a schematic structural diagram of a system for implementing service link analysis based on a micro service architecture in a middle station in the technology of the present invention.
Detailed Description
In order to more clearly describe the technical contents of the present invention, the following further description is given in conjunction with specific embodiments.
The method for realizing the service link analysis based on the micro-service architecture in the technical middle station comprises the following steps:
(1) constructing a business process model, a micro-service deployment model and a business index model according to a business link data meta-model, and forming a business link data model reflecting a business concept to record full link information;
(1.1) establishing a business process model, and writing the business process model into the arrangement of activities and tasks in the business process;
(1.2) establishing a service deployment model, and writing a mapping relation among a deployment node, a service and a service instance;
(1.3) establishing a business index model, and writing a mapping relation between a business process, a service and a business index;
(2) acquiring full link information in a log file through a full link tracking log under a micro service architecture;
(2.1) calling the service, receiving a calling request of a service calling party, and executing a specific service function of the service;
(2.2) recording technical log information when the service is called, recording corresponding service index data according to the service index model, and writing the corresponding service index data into a full link tracking log file;
(2.3) checking whether the service calling is finished, and if so, finishing the log information recording; otherwise, continuing the step (2.1);
(3) analyzing a service link, automatically identifying a service flow, and giving an analysis result according to service dimensionality;
(3.1) respectively loading a business process model, a service deployment model and a business index model, and reading the information of each business process, the information of the service and the service instance of each deployment node and the business index information required by each service;
(3.2) synthesizing a business link data model, and assembling a business process model, a service deployment model and a business index model into a business link data model according to the incidence relation of each model element;
(3.3) reading the full link tracking log, and collecting link information to obtain a complete service call chain;
(3.4) identifying the business processes, comparing the business processes with the arrangement sequence of tasks in the business process model one by one according to the arrangement sequence of the service call chains, and matching the business processes corresponding to the service call chains;
(3.5) calculating a service index;
(3.5.1) according to the incidence relation of each model element, searching out the statistical indexes, the calculation formulas of the statistical indexes and each service index corresponding to the service process from the synthesized service link data model;
(3.5.2) retrieving all service index data required by the service process from the full link tracing log;
(3.5.3) calculating to obtain each item of statistical index data of the business process;
(3.6) displaying the calculated statistical index data through a visual graphical interface;
(3.7) checking whether the service link analysis is finished, if so, continuing to the step (3.3); otherwise, the procedure is ended.
As a preferred embodiment of the present invention, the full link information in step (1) includes information and hierarchical relationships of a business process, an activity, a task, a deployment node, a service instance, a statistical indicator, a calculation formula, a service, and a business indicator.
The system for realizing the service link analysis based on the micro-service architecture in the technical middle station comprises the following steps:
the service link data model building subsystem is used for respectively building a service flow model, a micro-service deployment model and a service index model and building a service link data model to record full link information;
the system comprises a service link data model building subsystem, a full link information collecting subsystem and a full link information tracking subsystem, wherein the service link data model building subsystem is used for establishing a service link data model;
and the service link analysis subsystem is connected with the acquisition full link information subsystem and used for automatically identifying the service flow according to the recorded service link data and giving an analysis result according to the service dimension.
As a preferred embodiment of the present invention, the service link data model building subsystem includes:
the business process construction module is used for arranging the business process according to the hierarchical relation of the business process, the activity and the task and storing the process information;
the service deployment model construction module is connected with the business process construction module and used for arranging and deploying architecture information according to the hierarchical relationship of the deployment nodes, the services and the service instances and storing the deployment architecture information;
and the service index model construction module is connected with the service deployment model construction module and used for planning the service information to be analyzed according to the hierarchical relation among the statistical indexes, the calculation formula, the service and the service indexes and storing the service information to be analyzed.
As a preferred embodiment of the present invention, the subsystem for collecting full link information includes:
the full link information recording module is connected with the business link data model building subsystem and is used for recording full link tracking information and business link information of service calling into a full link tracking log;
and the service link data model processing module is connected with the full link information recording module and is used for identifying the service flow corresponding to each service call chain from the full link tracking log.
As a preferred embodiment of the present invention, the service link analysis subsystem includes:
the business link data model processing module is connected with the acquisition full link information subsystem and is used for acquiring the statistical index and the calculation formula corresponding to the business process and the business index information;
the service link information processing module is connected with the service link data model processing module and used for extracting the identified service index data related to the service process from the full link tracing log;
the service link analysis module is connected with the service link information processing module and used for calculating the statistical indexes of each service process one by one according to a calculation formula;
and the business link analysis module is connected with the business link analysis module and is used for displaying the statistical index data of each business process to a user.
As a preferred embodiment of the present invention, the apparatus for implementing service link analysis processing based on micro service architecture includes a memory for storing a program and a processor for executing the program, so as to implement the method for implementing service link analysis based on micro service architecture in the above-mentioned technical middle station.
As a preferred embodiment of the present invention, the computer readable storage medium includes a program, and the program is executable by a processor to perform the method for implementing service link analysis based on micro service architecture in the station in the above-mentioned technology.
In the specific implementation mode of the invention, an analysis method and an analysis system are provided for analyzing the service link of the application system under the micro-service architecture, and the method and the system can solve the problem that the conventional instance-level full-link tracking and analysis method and system based on the call request can only express the call relation of the service instance and cannot analyze from the service perspective which is easy to understand by a user.
The embodiment of the invention provides a service link analysis method under a micro-service architecture, which comprises the following steps:
firstly, constructing a service link data model:
different from the prior art, the method and the system for analyzing the service link under the micro-service architecture provided by the invention do not only record the calling information of the service, but construct a service flow model, a micro-service deployment model and a service index model according to the service link data meta model provided by the invention, and finally organically merge to form a service link data model capable of completely expressing a service concept to record the full-link information, specifically refer to fig. 1.
S101: the 'activity' is arranged for the 'business process', and each 'business' is composed of one to a plurality of 'activities'.
S102: to "activity" orchestrate "tasks, each" activity "consists of one to more" tasks ".
S103: "services" are specified for "tasks", each "task" being completed by one "service".
S104: and distributing services for the deployment nodes, wherein each deployment node can be deployed with a plurality of micro services.
S105: "service instances" are specified for a "service," and each "service" can run one to more "service instances" of that "service.
S106: a calculation formula is set for the statistical indexes, and each statistical index only has a unique calculation mode.
S107: binding each operation parameter of the calculation formula to specific service and service index, namely collecting specific service index of the specified service.
S108: and setting a statistical index of the service process to prepare for analyzing service link information from a service perspective.
Secondly, collecting full link information:
and recording information such as service call and the like in a log file in a full link log tracking mode under the micro-service architecture.
S201: link tracking information such as TraceId, SpaniD, ParentId, calling service name, called service name, IP address and the like is recorded in the called service instance.
S202: and recording service index data, such as transaction amount and the like, in the called service instance.
Thirdly, analyzing a service link:
different from the prior art, the service link analysis method and the system thereof under the micro-service architecture provided by the invention not only analyze technical information such as system topology and the like through service call information, but automatically identify a service flow through the analysis method and the recorded service link data provided by the invention and provide an analysis result according to service dimension.
S301: and extracting a complete service call chain from the full-link tracing log according to the information such as the TraceId, the SpaniD and the like.
S302: and comparing the service call chain with the business process, and identifying the business process corresponding to the service call chain according to the arrangement relation of the service in the service call chain and the arrangement relation of each node of the business process.
S303: and acquiring the statistical index and the calculation formula corresponding to the business process and the business index information from the business link data model.
S304: and extracting corresponding service index data from the full link tracing log.
S305: and calculating the statistical indexes of the business processes one by one according to a calculation formula.
S306: and displaying the service link analysis result.
The embodiment of the invention also provides a service link analysis system under the micro-service architecture by using the method, which comprises the following steps: a business process constructing module, a service deployment model constructing module, a business index model constructing module, a full link information recording module, a business link data model processing module, a business link analyzing module, a business link information processing module, a business index counting module and a business status information displaying module, please refer to fig. 5 specifically.
S401: the business process construction module arranges the business process according to the hierarchical relation of the business process, the activity and the task, and stores the process information in the business process construction module.
S402: the service deployment model construction module arranges deployment architecture information according to the hierarchical relation of 'deployment node-service instance', and stores the deployment architecture information in the service deployment model construction module.
S403: the business index model construction module plans the business information to be analyzed according to the hierarchical relation of the statistical index-calculation formula-service and business index, and stores the business information to be analyzed in the business index model construction module.
S404: and the full link information recording module continuously records the full link tracking information and the service link information called by the service into a full link tracking log during the running period of the micro service.
S405: and the business link data model processing module identifies the business process corresponding to each service call chain from the full link tracking log.
S406: and the business link data model processing module acquires the statistical index and the calculation formula corresponding to the business process and the business index information through the business index model construction module.
S407: and the service link information processing module extracts the identified service index data related to the service process from the full link tracking log through the full link information recording module.
S408: and the service link analysis module calculates the statistical indexes of each service flow one by one according to a calculation formula through the service index statistical module.
S409: and the business link analysis module displays the statistical index data of each business process to a user through the business condition information display module.
As shown in fig. 2, in order to analyze the service dimension of the service link by using the service link analysis method and system under the micro-service architecture provided by the embodiment of the present invention, a service link data model needs to be established, and the service invocation link is associated with the service concept, which specifically includes the following contents:
step 102: and establishing a business process model, and writing the arrangement of activities and tasks in the business process into a business process model file.
Step 103: and establishing a service deployment model, and writing the mapping relation of the deployment node, the service and the service instance into a service deployment model file.
Step 104: and establishing a business index model, and writing the mapping relation of the business process, the service and the business index into a business index model file.
And storing the service process model file, the service deployment model file and the service index model file in the system for subsequent service link analysis.
As shown in fig. 3, each service is in a ready state during the operation of the micro service architecture, and receives a request from a service caller at any time, which specifically includes the following contents:
step 202: and calling the service, receiving a calling request of a service calling party, and executing a specific service function of the service.
Step 203: and recording technical log information such as TraceId, SpanId, ParentId and the like when the service is called, recording corresponding service index data according to the service index model, and writing the service index data into a full link tracking log file.
Step 204: checking whether the service calling is finished or not, and finishing the log information recording if the service calling is finished; if not, repeating step 202-step 204.
As shown in fig. 4, after the full link trace log is formed, the system obtains an analysis result of the service link by analyzing and processing the full link trace log, which specifically includes the following contents:
step 302: and loading the business process model, and reading the information of each business process from the business process model file stored in the system.
Step 303: and loading a service deployment model, and reading the service and service instance information of each deployment node from a service deployment model file saved in the system.
Step 304: and loading the service index model, and reading service index information required by each service from the service index model file stored in the system.
Step 305: and synthesizing a business link data model, and assembling a business process model, a service deployment model and a business index model into the business link data model according to the incidence relation of each model element in the business link data meta model shown in fig. 1.
Step 306: and reading the full link tracking log, collecting link information, grouping according to the traceId, and sequencing according to the Spanisd to obtain a complete service call chain.
Step 307: and identifying the business process, comparing the business process with the arrangement sequence of tasks in the business process model one by one according to the arrangement sequence of the service call chain, and if each node of the service call chain can be matched with the current business process model, the current business process is the business process corresponding to the service call chain.
Step 308: and calculating the service index. After the business process corresponding to the service call chain is identified, according to the incidence relation of each model element in the business link data element model shown in fig. 1, the statistical index, the calculation formula of the statistical index and each business index corresponding to the business process are retrieved from the synthesized business link data model, then each business index data required by the business process is retrieved from the full link tracing log, and each statistical index data of the business process is obtained after calculation through the calculation formula.
Step 309: and displaying the service condition information, namely displaying the calculated statistical index data to a user through a visual graphical interface, for example, listing service analysis data including but not limited to service operation health degree (percentage of error rate of the service operation), service operation performance (time consumption of the service), hot service link (ratio of calling times of the first service links with the highest frequency), service volume (number of transaction strokes and transaction amount of the service), service frequency (number of transaction times of the service per day and number of active users per day), and the like.
Step 310: checking whether the service link analysis is finished or not, and if not, repeating the steps 306-310.
By adopting the method, the system, the device and the computer readable storage medium for realizing the service link analysis based on the micro-service architecture in the technical middle desk, the service link data model is established, the service call link is associated with the service concept through matching the service flow with the service call link, and the service call link is analyzed from the service dimension, so that the service link analysis under the micro-service architecture is realized, and meanwhile, the service condition information can be displayed in a graphical mode.
In this specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (12)
1. A method for realizing service link analysis based on micro service architecture in a technical middle station is characterized by comprising the following steps:
(1) constructing a business process model, a micro-service deployment model and a business index model according to a business link data meta-model, and forming a business link data model reflecting a business concept to record full link information;
(2) acquiring full link information in a log file through a full link tracking log under a micro service architecture;
(3) and analyzing the service link, automatically identifying the service flow, and giving an analysis result according to the service dimension.
2. The method for implementing service link analysis based on micro service architecture in technical middleboxes according to claim 1, wherein the step (1) specifically comprises the following steps:
(1.1) establishing a business process model, and writing the business process model into the arrangement of activities and tasks in the business process;
(1.2) establishing a service deployment model, and writing a mapping relation among a deployment node, a service and a service instance;
and (1.3) establishing a business index model, and writing the mapping relation between the business process, the service and the business index.
3. The method for implementing service link analysis based on micro service architecture in technical middleboxes of claim 1, wherein the step (2) specifically comprises the following steps:
(2.1) calling the service, receiving a calling request of a service calling party, and executing a specific service function of the service;
(2.2) recording technical log information when the service is called, recording corresponding service index data according to the service index model, and writing the corresponding service index data into a full link tracking log file;
(2.3) checking whether the service calling is finished, and if so, finishing the log information recording; otherwise, continue step (2.1).
4. The method for implementing service link analysis based on micro service architecture in technical middleboxes of claim 1, wherein the step (3) specifically comprises the following steps:
(3.1) respectively loading a business process model, a service deployment model and a business index model, and reading the information of each business process, the information of the service and the service instance of each deployment node and the business index information required by each service;
(3.2) synthesizing a business link data model, and assembling a business process model, a service deployment model and a business index model into a business link data model according to the incidence relation of each model element;
(3.3) reading the full link tracking log, and collecting link information to obtain a complete service call chain;
(3.4) identifying the business processes, comparing the business processes with the arrangement sequence of tasks in the business process model one by one according to the arrangement sequence of the service call chains, and matching the business processes corresponding to the service call chains;
(3.5) calculating a service index;
(3.6) displaying the calculated statistical index data through a visual graphical interface;
(3.7) checking whether the service link analysis is finished, if so, continuing to the step (3.3); otherwise, the procedure is ended.
5. The method for implementing service link analysis based on micro service architecture in technical middleboxes of claim 4, wherein the step (3.5) specifically comprises the following steps:
(3.5.1) according to the incidence relation of each model element, searching out the statistical indexes, the calculation formulas of the statistical indexes and each service index corresponding to the service process from the synthesized service link data model;
(3.5.2) retrieving all service index data required by the service process from the full link tracing log;
(3.5.3) calculating the statistical index data of the service process.
6. The method according to claim 1, wherein the full link information in step (1) includes information and hierarchical relationships of a business process, an activity, a task, a deployment node, a service instance, a statistical indicator, a calculation formula, a service, and a business indicator.
7. A system for realizing service link analysis based on micro service architecture in a technical middle station is characterized by comprising the following components:
the service link data model building subsystem is used for respectively building a service flow model, a micro-service deployment model and a service index model and building a service link data model to record full link information;
the system comprises a service link data model building subsystem, a full link information collecting subsystem and a full link information tracking subsystem, wherein the service link data model building subsystem is used for establishing a service link data model;
and the service link analysis subsystem is connected with the acquisition full link information subsystem and used for automatically identifying the service flow according to the recorded service link data and giving an analysis result according to the service dimension.
8. The system of claim 7, wherein the service link data model building subsystem comprises:
the business process construction module is used for arranging the business process according to the hierarchical relation of the business process, the activity and the task and storing the process information;
the service deployment model construction module is connected with the business process construction module and used for arranging and deploying architecture information according to the hierarchical relationship of the deployment nodes, the services and the service instances and storing the deployment architecture information;
and the service index model construction module is connected with the service deployment model construction module and used for planning the service information to be analyzed according to the hierarchical relation among the statistical indexes, the calculation formula, the service and the service indexes and storing the service information to be analyzed.
9. The system according to claim 7, wherein the subsystem for collecting full link information comprises:
the full link information recording module is connected with the business link data model building subsystem and is used for recording full link tracking information and business link information of service calling into a full link tracking log;
and the service link data model processing module is connected with the full link information recording module and is used for identifying the service flow corresponding to each service call chain from the full link tracking log.
10. The system of claim 7, wherein the service link analysis subsystem comprises:
the business link data model processing module is connected with the acquisition full link information subsystem and is used for acquiring the statistical index and the calculation formula corresponding to the business process and the business index information;
the service link information processing module is connected with the service link data model processing module and used for extracting the identified service index data related to the service process from the full link tracing log;
the service link analysis module is connected with the service link information processing module and used for calculating the statistical indexes of each service process one by one according to a calculation formula;
and the business link analysis module is connected with the business link analysis module and is used for displaying the statistical index data of each business process to a user.
11. An apparatus for implementing service link analysis processing based on micro service architecture, the apparatus comprising a memory for storing a program and a processor for executing the program, so as to implement the method for implementing service link analysis based on micro service architecture in a technical center station according to any one of claims 1 to 6.
12. A computer-readable storage medium, comprising a program executable by a processor to perform the method for implementing service link analysis based on micro service architecture in a technical center station according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011244058.2A CN112422335B (en) | 2020-11-10 | 2020-11-10 | Method, system, device and storage medium for realizing service link analysis based on micro-service architecture in technical middle station |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011244058.2A CN112422335B (en) | 2020-11-10 | 2020-11-10 | Method, system, device and storage medium for realizing service link analysis based on micro-service architecture in technical middle station |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112422335A true CN112422335A (en) | 2021-02-26 |
| CN112422335B CN112422335B (en) | 2023-02-21 |
Family
ID=74781009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011244058.2A Active CN112422335B (en) | 2020-11-10 | 2020-11-10 | Method, system, device and storage medium for realizing service link analysis based on micro-service architecture in technical middle station |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112422335B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112988718A (en) * | 2021-05-21 | 2021-06-18 | 睿至科技集团有限公司 | Method and system for automatically monitoring power |
| CN113052700A (en) * | 2021-03-26 | 2021-06-29 | 深圳前海微众银行股份有限公司 | Method and device for determining micro-service call chain |
| CN113688012A (en) * | 2021-09-09 | 2021-11-23 | 中国银行股份有限公司 | Call chain monitoring system and method |
| CN114338441A (en) * | 2021-12-28 | 2022-04-12 | 腾云悦智科技(深圳)有限责任公司 | Analysis method for intelligently identifying service link based on service flow |
| CN114546787A (en) * | 2022-04-22 | 2022-05-27 | 杭州乾冠数字物联技术有限公司 | Distributed system monitoring method and system and computer storage medium |
| CN114598622A (en) * | 2022-03-10 | 2022-06-07 | 平安科技（深圳）有限公司 | Data monitoring method and device, storage medium and computer equipment |
| CN114745295A (en) * | 2022-04-19 | 2022-07-12 | 京东科技控股股份有限公司 | Data acquisition method, device, equipment and readable storage medium |
| CN115037653A (en) * | 2022-06-28 | 2022-09-09 | 北京奇艺世纪科技有限公司 | Service flow monitoring method and device, electronic equipment and storage medium |
| CN115391233A (en) * | 2022-10-31 | 2022-11-25 | 深圳联友科技有限公司 | Accurate test method based on coverage rate analysis and link tracking |
| CN115757303A (en) * | 2022-11-14 | 2023-03-07 | 华青融天(北京)软件股份有限公司 | Index tracking method and device in distributed system |
| CN116049263A (en) * | 2023-03-31 | 2023-05-02 | 北京比格大数据有限公司 | Data call link tracking method, device and system, equipment and storage medium |
| CN116611749A (en) * | 2023-02-13 | 2023-08-18 | 国家电投集团数字科技有限公司 | Intelligent electric power data input method and system based on micro-service architecture |
| CN116882724A (en) * | 2023-07-13 | 2023-10-13 | 北京优特捷信息技术有限公司 | Method, device, equipment and medium for generating business process optimization scheme |
| CN116934067A (en) * | 2023-09-19 | 2023-10-24 | 广州信安数据有限公司 | Flow mining method, storage medium and equipment based on full-link monitoring data |
| CN117640544A (en) * | 2023-11-24 | 2024-03-01 | 苏州空天信息研究院 | Distributed service call management system and method thereof |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180159747A1 (en) * | 2016-12-05 | 2018-06-07 | General Electric Company | Automated feature deployment for active analytics microservices |
| US20180270327A1 (en) * | 2017-03-17 | 2018-09-20 | International Business Machines Corporation | Automatic interdependency resolution for micro-service deployments |
| US20190095599A1 (en) * | 2017-09-25 | 2019-03-28 | Splunk Inc. | Customizing a user behavior analytics deployment |
| CN109818823A (en) * | 2018-12-29 | 2019-05-28 | 北京奥鹏远程教育中心有限公司 | Full link trace system |
| CN109961204A (en) * | 2017-12-26 | 2019-07-02 | ***通信集团浙江有限公司 | Quality of service analysis method and system under a kind of micro services framework |
| CN110471949A (en) * | 2019-07-11 | 2019-11-19 | 阿里巴巴集团控股有限公司 | Data consanguinity analysis method, apparatus, system, server and storage medium |
| CN110535722A (en) * | 2019-08-27 | 2019-12-03 | 江苏瑞中数据股份有限公司 | A kind of full link operation and monitoring method of the micro services in cross-safety zone domain |
| CN110809017A (en) * | 2019-08-16 | 2020-02-18 | 云南电网有限责任公司玉溪供电局 | Data analysis application platform system based on cloud platform and micro-service framework |
| CN111143304A (en) * | 2019-11-20 | 2020-05-12 | 杭州端点网络科技有限公司 | Micro-service system abnormal log analysis method based on request link |
| CN111459766A (en) * | 2019-11-14 | 2020-07-28 | 国网浙江省电力有限公司信息通信分公司 | Calling chain tracking and analyzing method for micro-service system |
| WO2020211222A1 (en) * | 2019-04-15 | 2020-10-22 | 厦门市美亚柏科信息股份有限公司 | Method and device for providing micro-service based on data service platform, and storage medium |
-
2020
- 2020-11-10 CN CN202011244058.2A patent/CN112422335B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180159747A1 (en) * | 2016-12-05 | 2018-06-07 | General Electric Company | Automated feature deployment for active analytics microservices |
| US20180270327A1 (en) * | 2017-03-17 | 2018-09-20 | International Business Machines Corporation | Automatic interdependency resolution for micro-service deployments |
| US20190095599A1 (en) * | 2017-09-25 | 2019-03-28 | Splunk Inc. | Customizing a user behavior analytics deployment |
| CN109961204A (en) * | 2017-12-26 | 2019-07-02 | ***通信集团浙江有限公司 | Quality of service analysis method and system under a kind of micro services framework |
| CN109818823A (en) * | 2018-12-29 | 2019-05-28 | 北京奥鹏远程教育中心有限公司 | Full link trace system |
| WO2020211222A1 (en) * | 2019-04-15 | 2020-10-22 | 厦门市美亚柏科信息股份有限公司 | Method and device for providing micro-service based on data service platform, and storage medium |
| CN110471949A (en) * | 2019-07-11 | 2019-11-19 | 阿里巴巴集团控股有限公司 | Data consanguinity analysis method, apparatus, system, server and storage medium |
| CN110809017A (en) * | 2019-08-16 | 2020-02-18 | 云南电网有限责任公司玉溪供电局 | Data analysis application platform system based on cloud platform and micro-service framework |
| CN110535722A (en) * | 2019-08-27 | 2019-12-03 | 江苏瑞中数据股份有限公司 | A kind of full link operation and monitoring method of the micro services in cross-safety zone domain |
| CN111459766A (en) * | 2019-11-14 | 2020-07-28 | 国网浙江省电力有限公司信息通信分公司 | Calling chain tracking and analyzing method for micro-service system |
| CN111143304A (en) * | 2019-11-20 | 2020-05-12 | 杭州端点网络科技有限公司 | Micro-service system abnormal log analysis method based on request link |
Non-Patent Citations (1)
| Title |
|---|
| 张靖等: "基于微服务架构的电力客户服务应用构建研究", 《数字技术与应用》 * |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113052700A (en) * | 2021-03-26 | 2021-06-29 | 深圳前海微众银行股份有限公司 | Method and device for determining micro-service call chain |
| CN112988718B (en) * | 2021-05-21 | 2021-08-03 | 睿至科技集团有限公司 | Method and system for automatically monitoring power |
| CN112988718A (en) * | 2021-05-21 | 2021-06-18 | 睿至科技集团有限公司 | Method and system for automatically monitoring power |
| CN113688012A (en) * | 2021-09-09 | 2021-11-23 | 中国银行股份有限公司 | Call chain monitoring system and method |
| CN114338441A (en) * | 2021-12-28 | 2022-04-12 | 腾云悦智科技(深圳)有限责任公司 | Analysis method for intelligently identifying service link based on service flow |
| CN114598622A (en) * | 2022-03-10 | 2022-06-07 | 平安科技（深圳）有限公司 | Data monitoring method and device, storage medium and computer equipment |
| CN114598622B (en) * | 2022-03-10 | 2023-04-25 | 平安科技（深圳）有限公司 | Data monitoring method and device, storage medium and computer equipment |
| CN114745295A (en) * | 2022-04-19 | 2022-07-12 | 京东科技控股股份有限公司 | Data acquisition method, device, equipment and readable storage medium |
| CN114546787A (en) * | 2022-04-22 | 2022-05-27 | 杭州乾冠数字物联技术有限公司 | Distributed system monitoring method and system and computer storage medium |
| CN115037653B (en) * | 2022-06-28 | 2023-10-13 | 北京奇艺世纪科技有限公司 | Service flow monitoring method, device, electronic equipment and storage medium |
| CN115037653A (en) * | 2022-06-28 | 2022-09-09 | 北京奇艺世纪科技有限公司 | Service flow monitoring method and device, electronic equipment and storage medium |
| CN115391233A (en) * | 2022-10-31 | 2022-11-25 | 深圳联友科技有限公司 | Accurate test method based on coverage rate analysis and link tracking |
| CN115757303A (en) * | 2022-11-14 | 2023-03-07 | 华青融天(北京)软件股份有限公司 | Index tracking method and device in distributed system |
| CN115757303B (en) * | 2022-11-14 | 2024-05-03 | 华青融天(北京)软件股份有限公司 | Index tracking method and device in distributed system |
| CN116611749A (en) * | 2023-02-13 | 2023-08-18 | 国家电投集团数字科技有限公司 | Intelligent electric power data input method and system based on micro-service architecture |
| CN116611749B (en) * | 2023-02-13 | 2023-10-20 | 国家电投集团数字科技有限公司 | Intelligent electric power data input method and system based on micro-service architecture |
| CN116049263A (en) * | 2023-03-31 | 2023-05-02 | 北京比格大数据有限公司 | Data call link tracking method, device and system, equipment and storage medium |
| CN116882724A (en) * | 2023-07-13 | 2023-10-13 | 北京优特捷信息技术有限公司 | Method, device, equipment and medium for generating business process optimization scheme |
| CN116882724B (en) * | 2023-07-13 | 2024-06-11 | 北京优特捷信息技术有限公司 | Method, device, equipment and medium for generating business process optimization scheme |
| CN116934067A (en) * | 2023-09-19 | 2023-10-24 | 广州信安数据有限公司 | Flow mining method, storage medium and equipment based on full-link monitoring data |
| CN117640544A (en) * | 2023-11-24 | 2024-03-01 | 苏州空天信息研究院 | Distributed service call management system and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112422335B (en) | 2023-02-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112422335B (en) | Method, system, device and storage medium for realizing service link analysis based on micro-service architecture in technical middle station | |
| Mayer et al. | An approach to extract the architecture of microservice-based software systems | |
| CN106656536B (en) | Method and equipment for processing service calling information | |
| US9256412B2 (en) | Scheduled and quarantined software deployment based on dependency analysis | |
| US7290048B1 (en) | Method of semi-automatic data collection, data analysis, and model generation for the performance analysis of enterprise applications | |
| CN109857667A (en) | Automatic interface testing method, test device, test equipment and storage medium | |
| KR101300360B1 (en) | Distributed capture and aggregation of danamic application usage information | |
| US9697104B2 (en) | End-to end tracing and logging | |
| CN110334274A (en) | Information-pushing method, device, computer equipment and storage medium | |
| CN104956330A (en) | Workload distribution with resource awareness | |
| CN103365946B (en) | Database performance is analyzed | |
| CN109154937A (en) | The dynamic of inquiry response is transmitted as a stream | |
| CN105308592A (en) | Value based windows on relations in continuous data streams | |
| CN102571403A (en) | Realization method and device for general data quality control adapter | |
| CN111552728B (en) | Data processing method, system, terminal and storage medium of block chain | |
| CN110780856B (en) | Electricity data release platform based on micro-service | |
| CN112817834B (en) | Data table evaluation method and device | |
| WO2017201057A1 (en) | Multidimensional application monitoring visualization and search | |
| EP1709537A2 (en) | Method and apparatus for unified performance modeling with monitoring and analysis of complex systems | |
| CN101120322B (en) | Method, system for estimating transaction response times | |
| Romero et al. | Integration of DevOps practices on a noise monitor system with CircleCI and Terraform | |
| CN108694124A (en) | A kind of house prosperity transaction system test data building method and system based on Mock | |
| CN111158979A (en) | Service dial testing method, system, device and storage medium | |
| CN113435937B (en) | Advertisement creating method and device | |
| CN110764985A (en) | Method, system, equipment and readable storage medium for recording command line |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |