CN117201292B - Method capable of accurately positioning request call exception among micro services - Google Patents
Method capable of accurately positioning request call exception among micro services Download PDFInfo
- Publication number
- CN117201292B CN117201292B CN202311419564.4A CN202311419564A CN117201292B CN 117201292 B CN117201292 B CN 117201292B CN 202311419564 A CN202311419564 A CN 202311419564A CN 117201292 B CN117201292 B CN 117201292B
- Authority
- CN
- China
- Prior art keywords
- network
- micro
- service
- request
- calling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000012544 monitoring process Methods 0.000 claims abstract description 43
- 230000008569 process Effects 0.000 claims abstract description 17
- 239000000523 sample Substances 0.000 claims abstract description 17
- 238000005516 engineering process Methods 0.000 claims abstract description 5
- 230000002159 abnormal effect Effects 0.000 claims description 14
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000011835 investigation Methods 0.000 abstract 2
- 230000005856 abnormality Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 229910002056 binary alloy Inorganic materials 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Abstract
In the method, in the real-time tracking of the links which are mutually called among the micro services, probes are added in the starting process of the application program to load plug-ins, and in the compiling process of the application program, the plug-ins acquire calling link information among the micro services and network data corresponding to the call based on a byte code enhancement technology, the acquired network data are bound with the calling link information of the call request as micro service monitoring records and are continuously stored in a database, so that the network topology monitoring of the mutual call among the micro services is formed, the tracking and positioning of the network operation condition of the whole request access network are convenient, the accurate positioning and the investigation of the network information which is called among the services under the micro service architecture can be realized, and the problems that the network fault cannot be accurately positioned by the existing link tracking call and the investigation are inconvenient when the network fluctuates are solved.
Description
Technical Field
The invention belongs to the technical field of micro-service monitoring, and particularly relates to a method capable of accurately positioning request call exceptions among micro-services.
Background
With the development of medical informatization, microservice architecture products are continuously introduced. The micro-service architecture advocates that a single application is divided into a group of small micro-services, and the micro-services are mutually coordinated and matched to provide a final result for users. Each micro-service runs in an independent process, and the micro-service are communicated with each other by adopting a lightweight communication mechanism. Each micro-service is built around a specific business and can be deployed independently. Because the system becomes complicated after adopting the micro-service architecture, and the user is difficult to locate when requesting for errors, the micro-service monitoring system correspondingly appears, each node which the user requests to pass through is recorded, a complete micro-service call link log is formed, and when the request call abnormality occurs, the specific links of errors can be rapidly checked and located from the call micro-service call link log.
The requests between services under the micro-service architecture are more interactive, and span multiple virtualized servers or physical servers. Current hospital intelligent information systems typically combine with hospital networks to form an internal private network. In particular, the instability of the private network may occur in a good and bad condition, and when the micro-service call is slow, the existing network monitoring cannot determine whether the micro-service call on different servers is slow due to a program problem or abnormal fluctuation of the network among the servers. As shown in fig. 1, the existing network monitoring technology basically relies on a client to send network monitoring data to a server, or monitors a network switch to implement network monitoring. The prior art can only check the call link through Skywalking (APM), and cannot check the network operation condition in each micro service request process. In the existing network monitoring manner shown in fig. 2, the network operation condition of the call request when the a service initiates the request to the B service in the dashed line cannot be checked at all, and when the call of the request between the micro services is abnormal, the accurate positioning cannot be performed.
Disclosure of Invention
The invention aims to provide a method capable of accurately positioning the call abnormality of a request between micro services, which is used for solving the problem that the current micro service monitoring only forms a micro service call link log and cannot check the network running condition in the process of each micro service request, so that the call abnormality of the request between the micro services cannot be accurately positioned.
The invention provides a method for accurately positioning the call abnormality of a request among micro services, which comprises the following steps:
step 1, in a probe Skywalk-Agent capable of acquiring link information between micro services, a network information plug-in network SteamPlugin is newly added, in the process of each micro service request, IP information of a current application service is acquired, specific network message data is acquired based on the IP information of the service, then N-way handshake data is screened out based on the acquired network message data, and whether the current network has abnormal conditions or not is judged by combining the N-way handshake data of each time with reset network conditions;
and 2, adding a probe before the operation of an application program in a real-time link tracking process for calling the micro-services mutually so as to load an plugin, and continuously storing the micro-service monitoring record of each calling request in a database by the Skywalk-OAP service in the process of compiling the application program to form network topology monitoring for calling the micro-services mutually by acquiring the calling link plugin and acquiring a network information plugin to perform real-time capturing on network message data, converting the acquired network message data from binary system into decimal data, binding the calling link information of the calling request in the probe Skywalk-Agents as micro-service monitoring records, and then performing tracking and positioning on the running condition of the whole network access request and checking the abnormal calling condition of the micro-service request.
In the step 2, if the current network operates normally, the probe Skywalk-Agent only transmits the call link information acquired by the call request to the Skywalk-OAP service as a micro-service monitoring record; and (2) only when the current network has abnormal conditions, converting the abnormal network message data acquired in the step (1) into decimal data by acquiring a network information plug-in network SteamPlugin, binding the binary data with the calling link information of the current request in a probe Skywalk-Agent to be used as a micro-service monitoring record, and transmitting the micro-service monitoring record to the Skywalk-OAP service through the Skywalk-Agent, wherein the Skywalk-OAP service continuously stores the micro-service monitoring record of each calling request in a database to form network topology monitoring of inter-call between micro-services.
Based on the captured network message data, obtaining:
(1) TCP/IP network information including network handshake ACK, SYN, SEQ, packet size, execution duration, and other related information;
(2) PPS information for evaluating the forwarding capability of the system to the network, i.e. the transmission rate in units of network packets;
(3) Packet loss rate drop, i.e. the ratio of the number of lost data packets to the transmitted data set;
(4) Retransmission rate, i.e. the ratio used to represent the packets of the retransmission network;
(5) Error rate.
An electronic device, comprising: the processor executes the computer instructions, thereby executing any processing steps of the method capable of accurately positioning the micro inter-service request call exception.
A computer readable storage medium storing computer readable instructions that when executed perform any of the above-described processing steps of a method for accurately locating inter-microservice request call exceptions.
The invention binds the inter-calling link information between the micro services to the network operation condition in each request process to form the monitoring record, the continuous monitoring record is stored in the database to form the inter-calling network topology monitoring between the micro services, and the monitoring record is used as the basis for accurately positioning the inter-micro service request calling exception.
In the invention, in the process of compiling an application program into class, a probe (Skywalk-Agent) is added in the process of starting the application program to load an plugin, and the plugin acquires calling link information between micro services and network data corresponding to the calling based on a byte code enhancement technology, continuously stores the acquired calling link information of the network data binding the calling request in a database as a micro service monitoring record, forms network topology monitoring of the micro service calling, runs on the Skywalk-OAP service to check, and is convenient for tracking and positioning the running condition of the whole request access network, thereby accurately positioning the abnormal request call between the micro services, realizing the accurate positioning and the check of the network information of cross service call under the micro service architecture, and solving the problems that the prior link tracking call cannot accurately position network faults, cannot record and is inconvenient to investigate due to network instability when the network fluctuates.
Drawings
FIG. 1 is a diagram of a prior art microservice-based network monitoring architecture;
FIG. 2 is a schematic diagram of a call between microservices in existing network monitoring failing to view network operating conditions;
FIG. 3 is a flow chart of the invention for monitoring the skywalking-Agent implementation of loading multiple plug-ins;
FIG. 4 is a schematic diagram of a newly added network information plug-in network SteamPlugin in a skywalking-Agent of the present invention;
FIG. 5 is a flow chart of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail below with reference to the accompanying drawings, it being apparent that the described embodiments are only some, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
As shown in fig. 3 to 5, the first embodiment relates to a method for accurately locating a request call exception between micro services, which includes the following steps:
step 1, in a probe Skywalk-Agent capable of acquiring link information between micro services, a network information plug-in network SteamPlugin is newly added, in the process of each micro service request, IP information of the current application service is acquired, specific network message data is acquired based on the IP information of the service, the length, the mode, the timeout time and the like of the message are acquired, and then three-way handshake data are screened out based on the acquired network message data, and whether the current network has abnormal conditions or not is judged by combining the three-way handshake data of each time with the reset network conditions.
Based on the captured network message data, obtaining:
(1) TCP/IP network information including network handshake ACK, SYN, SEQ, packet size, execution duration, and other related information;
(2) PPS information Packet Per Second (packets/sec) for evaluating the forwarding capability of the system to the network, i.e., the transmission rate in network packets;
(3) Packet loss (drop), i.e., a ratio of the number of lost packets to the transmitted data set;
(4) Retransmission rate, i.e. the ratio used to represent the packets of the retransmission network;
(5) Error rate (error);
and 2, adding probes before the operation of the application program in a real-time link tracking process for calling each other between micro-services, loading the probes in a plug-in mode, and compiling the application program into class, wherein in the class process, through acquiring a calling link plug-in and based on a byte code enhancement technology, acquiring calling link information of the application program, and through acquiring a network information plug-in, capturing network message data such as network handshake, error rate and packet loss rate in real time, converting the acquired network message data from binary system into decimal data, binding the acquired network message data with calling link information of a calling request in a probe Skywalk-Agent, and then transmitting the acquired network message data to the Skywalk-OAP service as a micro-service monitoring record, wherein the micro-service monitoring record of each calling request is continuously stored in a database to form network topology monitoring for calling each other between the micro-services, and operating on the Skywalk-OAP service to check, so that the whole network message data required to be convenient to track the running condition of the whole request, and the micro-service can be accurately called.
If the storage amount of the monitoring record is considered, the above step 2 may also be performed: if the current network operates normally, the probe Skywalk-Agent only transmits the call link information acquired by the call request to Skywalk-OAP service as a micro-service monitoring record; and (2) only when the current network has an abnormal condition, acquiring network information plugin, converting the abnormal network message data acquired in the step (1) from binary into decimal data, combining the decimal data with the span Id or traceId of the call link information requested at the time in the Skywalk-agent, and sending the combined data to the Skywalk-OAP service through the Skywalk-agent, wherein the Skywalk-OAP service continuously stores the micro-service monitoring record of each call request in a database to form network topology monitoring of the inter-micro-service call, and operates on the Skywalk-OAP service to check, so that the whole network operation condition requested to be accessed is conveniently tracked and positioned, and the call abnormality of the inter-micro-service request can be accurately positioned.
Example two
The second embodiment of the present invention provides an electronic device, which may be the foregoing terminal device or server, or may be a terminal device or server connected to the foregoing terminal device or server to implement a method of the embodiment of the present invention.
The electronic device may include: a processor (e.g., CPU), a memory, a data acquisition device; the processor is connected with and controls the data acquisition device. The memory may store various instructions for performing the various processing functions and implementing the processing steps described in the methods of the previous embodiments.
Example III
The third embodiment of the present invention also provides a computer-readable storage medium having instructions stored therein, which when executed on a computer, cause the computer to perform the processing steps described in the method of the first embodiment.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (5)
1. The method capable of accurately positioning the request call exception between the micro services is characterized by comprising the following steps:
step 1, in a probe Skywalk-Agent capable of acquiring link information between micro services, a network information acquisition plug-in is newly added, the network information acquisition plug-in acquires IP information of a current application service in each micro service request process, specific network message data is acquired based on the IP information of the service, then N-way handshake data is screened out based on the acquired network message data, and whether the current network has abnormal conditions or not is judged by combining the N-way handshake data of each time with the reset network condition;
and 2, adding probes before the running of the application program in a real-time link tracking process for calling the micro-services mutually, loading the plug-ins, and continuously storing the micro-service monitoring record of each calling request in a database by the Skywalk-OAP service in the process of compiling the application program into class, acquiring calling link information of the application program based on a byte code enhancement technology, capturing network message data in real time by acquiring the network information plug-ins, converting the acquired network message data into decimal data from binary, binding calling link information of the calling request in the probe Skywalk-OAP as micro-service monitoring records, and then continuously storing the micro-service monitoring records of each calling request in the database to form network topology monitoring for calling the micro-services mutually, running on the Skywalk-OAP service for tracking and positioning the whole network access condition of the request, and checking out abnormal calling conditions of the micro-service requests.
2. The method for accurately positioning the inter-microservice request call exception according to claim 1, wherein in the step 2, if the current network is operating normally, the probe Skywalking-Agent only transmits the call link information acquired from the current call request to the Skywalking-OAP service as a microservice monitoring record; and (2) only when the current network has abnormal conditions, converting the abnormal network message data acquired in the step (1) into decimal data by acquiring a network information plug-in, binding the decimal data with the calling link information of the current request in a probe Skkaiding-Agent to be used as a micro-service monitoring record, and transmitting the micro-service monitoring record to the Skkaiding-OAP service through the Skkaiding-Agent, wherein the Skkaiding-OAP service continuously stores the micro-service monitoring record of each calling request in a database to form network topology monitoring called by each micro-service.
3. The method for accurately positioning the call exception of the inter-microservice request according to claim 1, wherein the method is characterized in that based on the captured network message data, the method comprises the following steps:
(1) TCP/IP network information including network handshake ACK, SYN, SEQ, packet size, execution duration;
(2) PPS information for evaluating the forwarding capability of the system to the network, i.e. the transmission rate in units of network packets;
(3) Packet loss rate drop, i.e. the ratio of the number of lost data packets to the transmitted data set;
(4) Retransmission rate, i.e. the ratio used to represent the packets of the retransmission network;
(5) Error rate.
4. An electronic device, comprising: a memory and a processor, said memory and said processor being communicatively coupled to each other, said memory storing computer instructions, said processor executing said computer instructions to perform a method for accurately locating inter-microservice request call exceptions as defined in any one of claims 1 to 3.
5. A computer readable storage medium storing computer readable instructions which when executed perform a method of accurately locating inter-microservice request call exceptions according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311419564.4A CN117201292B (en) | 2023-10-30 | 2023-10-30 | Method capable of accurately positioning request call exception among micro services |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311419564.4A CN117201292B (en) | 2023-10-30 | 2023-10-30 | Method capable of accurately positioning request call exception among micro services |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117201292A CN117201292A (en) | 2023-12-08 |
| CN117201292B true CN117201292B (en) | 2024-02-23 |
Family
ID=88994587
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311419564.4A Active CN117201292B (en) | 2023-10-30 | 2023-10-30 | Method capable of accurately positioning request call exception among micro services |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117201292B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118383A (en) * | 2013-02-01 | 2013-05-22 | 中国科学技术大学 | System and method for comprehensively supervising wireless access point state |
| CN111158995A (en) * | 2019-11-29 | 2020-05-15 | 武汉物易云通网络科技有限公司 | Method and system for realizing cross-system log tracking query based on skywalk and ELK platform |
| CN113965497A (en) * | 2021-10-20 | 2022-01-21 | 平安医疗健康管理股份有限公司 | Server abnormity identification method and device, computer equipment and readable storage medium |
| CN114039900A (en) * | 2021-11-03 | 2022-02-11 | 北京德塔精要信息技术有限公司 | Efficient network data packet protocol analysis method and system |
| CN114697232A (en) * | 2020-12-25 | 2022-07-01 | ***通信集团福建有限公司 | Skywalking probe index data acquisition system and method and electronic equipment |
| CN115174542A (en) * | 2022-07-01 | 2022-10-11 | 中国邮政储蓄银行股份有限公司 | Full-link acquisition method, acquisition device and acquisition system of business system |
| CN115220995A (en) * | 2022-06-06 | 2022-10-21 | 浙江华云信息科技有限公司 | Agent probe-based micro-service full-link analysis method |
| CN115237713A (en) * | 2022-07-22 | 2022-10-25 | 北京博睿宏远数据科技股份有限公司 | Application data acquisition method and device, computer equipment and storage medium |
| CN115865734A (en) * | 2022-12-02 | 2023-03-28 | 上海浦东发展银行股份有限公司 | Fault detection method, data generation method, device, equipment and medium |
| CN115878207A (en) * | 2021-09-27 | 2023-03-31 | 华为云计算技术有限公司 | Micro-service management method, device and system |
| CN116166505A (en) * | 2023-02-22 | 2023-05-26 | 优维科技(深圳)有限公司 | Monitoring platform, method, storage medium and equipment for dual-state IT architecture in financial industry |
| CN116232963A (en) * | 2023-02-20 | 2023-06-06 | 中银消费金融有限公司 | Link tracking method and system |
-
2023
- 2023-10-30 CN CN202311419564.4A patent/CN117201292B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118383A (en) * | 2013-02-01 | 2013-05-22 | 中国科学技术大学 | System and method for comprehensively supervising wireless access point state |
| CN111158995A (en) * | 2019-11-29 | 2020-05-15 | 武汉物易云通网络科技有限公司 | Method and system for realizing cross-system log tracking query based on skywalk and ELK platform |
| CN114697232A (en) * | 2020-12-25 | 2022-07-01 | ***通信集团福建有限公司 | Skywalking probe index data acquisition system and method and electronic equipment |
| CN115878207A (en) * | 2021-09-27 | 2023-03-31 | 华为云计算技术有限公司 | Micro-service management method, device and system |
| CN113965497A (en) * | 2021-10-20 | 2022-01-21 | 平安医疗健康管理股份有限公司 | Server abnormity identification method and device, computer equipment and readable storage medium |
| CN114039900A (en) * | 2021-11-03 | 2022-02-11 | 北京德塔精要信息技术有限公司 | Efficient network data packet protocol analysis method and system |
| CN115220995A (en) * | 2022-06-06 | 2022-10-21 | 浙江华云信息科技有限公司 | Agent probe-based micro-service full-link analysis method |
| CN115174542A (en) * | 2022-07-01 | 2022-10-11 | 中国邮政储蓄银行股份有限公司 | Full-link acquisition method, acquisition device and acquisition system of business system |
| CN115237713A (en) * | 2022-07-22 | 2022-10-25 | 北京博睿宏远数据科技股份有限公司 | Application data acquisition method and device, computer equipment and storage medium |
| CN115865734A (en) * | 2022-12-02 | 2023-03-28 | 上海浦东发展银行股份有限公司 | Fault detection method, data generation method, device, equipment and medium |
| CN116232963A (en) * | 2023-02-20 | 2023-06-06 | 中银消费金融有限公司 | Link tracking method and system |
| CN116166505A (en) * | 2023-02-22 | 2023-05-26 | 优维科技(深圳)有限公司 | Monitoring platform, method, storage medium and equipment for dual-state IT architecture in financial industry |
Non-Patent Citations (2)
| Title |
|---|
| 微服务故障诊断相关技术研究探讨;赵建涛;黄立松;;网络新媒体技术;20200115(第01期);全文 * |
| 微服务架构中服务监控***的设计与实现;王洪润;《中国优秀硕士学位论文全文数据库·信息科技辑》;20210515;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117201292A (en) | 2023-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Cinque et al. | Microservices monitoring with event logs and black box execution tracing | |
| US8732516B2 (en) | Method and system for providing customer controlled notifications in a managed network services system | |
| US11520683B2 (en) | Delta state tracking for event stream analysis | |
| US9172593B2 (en) | System and method for identifying problems on a network | |
| US7907599B2 (en) | Determination of SIP transport to reduce call setup delays | |
| US20070116184A1 (en) | Method for testing the integrity of a communication cable | |
| US20060246889A1 (en) | Wireless Data Device Performance Monitor | |
| CN112202635B (en) | Link monitoring method and device, storage medium and electronic device | |
| CN108683569A (en) | A kind of the business monitoring method and system of cloud service-oriented infrastructure | |
| CN104348661B (en) | The upload of network failure data, method of reseptance and equipment and recording method and system | |
| US8572245B1 (en) | Using the TCP window size for identifying packets and debugging | |
| CN117155832A (en) | Multi-terminal non-invasive recording playback test method and system for UDP transmission protocol | |
| CN117201292B (en) | Method capable of accurately positioning request call exception among micro services | |
| Cinque et al. | An exploratory study on zeroconf monitoring of microservices systems | |
| CN117061384A (en) | Fuzzy test method, device, equipment and medium | |
| CN114172796B (en) | Fault positioning method and related device for communication network | |
| CN114598622A (en) | Data monitoring method and device, storage medium and computer equipment | |
| CN112671822B (en) | Service request processing method, device, storage medium, server and system | |
| CN117255005B (en) | CDN-based service alarm processing method, device, equipment and medium | |
| US11477069B2 (en) | Inserting replay events in network production flows | |
| CN114363846B (en) | Method, system, device and medium for testing and checking 5G-SA charging and dialing of Internet of things | |
| CN115102854B (en) | Remote procedure call route management control method, system and equipment for micro-service | |
| CN113726865B (en) | Data transmission and collaboration system based on edge calculation | |
| CN112491637A (en) | Communication performance test method, first communication device, and computer-readable storage medium | |
| CN115391127A (en) | Dial testing method and device, storage medium and chip |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |