CN113656243B - Service index monitoring method, device, equipment and storage medium - Google Patents
Service index monitoring method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113656243B CN113656243B CN202110861842.6A CN202110861842A CN113656243B CN 113656243 B CN113656243 B CN 113656243B CN 202110861842 A CN202110861842 A CN 202110861842A CN 113656243 B CN113656243 B CN 113656243B
- Authority
- CN
- China
- Prior art keywords
- target
- service
- index
- business
- matching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 66
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000004364 calculation method Methods 0.000 claims abstract description 88
- 238000013507 mapping Methods 0.000 claims description 56
- 238000012806 monitoring device Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 238000007619 statistical method Methods 0.000 description 8
- 238000012546 transfer Methods 0.000 description 5
- 238000010276 construction Methods 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000004931 aggregating effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000002498 deadly effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3055—Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
- G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/327—Alarm or error message display
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses a method, a device, equipment and a storage medium for monitoring service indexes, wherein the method comprises the following steps: acquiring a business index rule of a target business, wherein the business index rule comprises the following steps: business index matching rules, business index calculation rules and threshold alarm rules; acquiring a service log of the target service; based on the service index matching rule, matching the service log with a target service index keyword to obtain a service index matching result; calculating the service index matching result based on the service index calculation rule to obtain a target service index; and monitoring the target business index based on the threshold alarming rule. By utilizing the technical scheme provided by the application, the service index can be accurately extracted through analyzing the service log by the pre-configured service index rule, so that the service running condition can be effectively monitored.
Description
Technical Field
The present application relates to the field of computer communications technologies, and in particular, to a method, an apparatus, a device, and a storage medium for monitoring a service index.
Background
With the progress and development of software construction technology, distributed systems are becoming more common, but obtaining business index data such as successful business processing and failure business processing in a large distributed system is a time-consuming and labor-consuming task. At present, the common practice is to collect and count key business indexes in the process of constructing a business system, write the key business indexes into a database, and monitor the business indexes based on the index values corresponding to the business indexes obtained by processing the business logs.
Because the method needs to collect and count the service indexes in the construction process of each service system, after the system construction is completed, if service updating occurs and the service indexes are changed, the service system needs to be modified, a great amount of labor cost is required to be input, the time is long, the efficiency is low, and the service operation condition cannot be effectively monitored in time, so that a more efficient technical scheme needs to be provided.
Disclosure of Invention
In order to solve the problems in the prior art, the application provides a business index monitoring method, a device, equipment and a storage medium. The technical scheme is as follows:
In one aspect, a method for monitoring a service index is provided, where the method includes:
acquiring a business index rule of a target business, wherein the business index rule comprises the following steps: business index matching rules, business index calculation rules and threshold alarm rules;
Acquiring a service log of the target service;
Based on the service index matching rule, matching the service log with a target service index keyword to obtain a service index matching result;
calculating the service index matching result based on the service index calculation rule to obtain a target service index;
And monitoring the target business index based on the threshold alarming rule.
In another aspect, a service indicator monitoring device is provided, where the device includes:
The service index configuration rule acquisition module is used for acquiring a service index rule of a target service, wherein the service index rule comprises the following components: business index matching rules, business index calculation rules and threshold alarm rules;
the service log acquisition module is used for acquiring the service log of the target service;
The business index matching module is used for matching the business logs with target business index keywords based on the business index matching rules to obtain business index matching results;
The business index calculation module is used for calculating the business index matching result based on the business index calculation rule to obtain a target business index;
and the business index monitoring module is used for monitoring the target business index based on the threshold alarming rule.
In another aspect, a traffic indicator monitoring device is provided, where the device includes a processor and a memory, where at least one instruction or at least one program is stored in the memory, where the at least one instruction or the at least one program is loaded and executed by the processor to implement a traffic indicator monitoring method as described above.
In another aspect, a computer readable storage medium is provided, where at least one instruction or at least one program is stored, where the at least one instruction or the at least one program is loaded and executed by a processor to implement a traffic indicator monitoring method as described above.
The method, the device, the equipment and the storage medium for monitoring the service index have the following technical effects:
The application obtains the business index rule of the target business, wherein the business index rule comprises the following steps: business index matching rules, business index calculation rules and threshold alarm rules; acquiring a service log of the target service; firstly, based on the service index matching rule, matching the service log with a target service index keyword to obtain a service index matching result; then, calculating the service index matching result based on the service index calculation rule to obtain a target service index; finally, based on the threshold alarming rule, the target service index is monitored, and the technical scheme can accurately extract the target service index through analysis of the service log by the pre-configured service index rule, so that effective monitoring of service operation conditions is realized, and service monitoring of stock systems and distributed service systems is more convenient.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions and advantages of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are only some embodiments of the application, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart of a method for monitoring a business index according to an embodiment of the present application;
Fig. 2 is a flow chart of a business index rule configuration method according to an embodiment of the present application;
FIG. 3 is a flow chart of a method for matching the business log with a target business index keyword based on the business index matching rule to obtain a business index matching result according to the embodiment of the present application;
FIG. 4 is a schematic flow chart of calculating the matching result of the business index to obtain the target business index based on the business index calculation rule according to the embodiment of the present application;
FIG. 5 is a schematic flow chart of monitoring the business index based on the threshold alarm rule according to the embodiment of the present application;
Fig. 6 is a flow chart of a method for reconfiguring a business index rule according to an embodiment of the present application;
fig. 7 is a schematic diagram of a service indicator monitoring device according to an embodiment of the present application;
fig. 8 is a hardware structure block diagram of a server of a method for monitoring a business index according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 1 is a schematic flow chart of a method for monitoring a service index according to an embodiment of the present application. It is noted that the present specification provides method operational steps as described in the examples or flowcharts, but may include more or fewer operational steps based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. In actual system or product execution, the methods illustrated in the embodiments or figures may be performed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment). As shown in fig. 1, the method may include:
S101, obtaining a service index rule of a target service, wherein the service index rule comprises the following steps: business index matching rules, business index calculation rules and threshold warning rules.
In this embodiment of the present disclosure, the business index rule may be a matching, calculating and monitoring rule of a business index. Specifically, the business index rule may include: business index matching rules, business index calculation rules and threshold alarm rules; the service index matching rule may be a matching condition set for generating a service index matching result corresponding to the target service, and the service index matching result may be used for measuring the association degree between the service log of the target service and the service index; the business index calculation rule may be a formula set for statistically analyzing the target business index; the target service index can be used for representing index parameters corresponding to the service index in the target service; the threshold alert rule may be a set of threshold comparison conditions for monitoring the target traffic index.
In a specific embodiment, as shown in fig. 2, the configuration process of the business index rule may include:
S201, responding to a service index matching rule configuration instruction of the target service, wherein the service index matching rule configuration instruction carries first preset mapping information, second preset mapping information and a service index keyword, the first preset mapping information represents a mapping relation between a log path and a service category, the second preset mapping information represents a mapping relation between the service category and a matching mode, and the service index matching rule is configured based on the first preset mapping information, the second preset mapping information and the service index keyword.
In this embodiment of the present disclosure, the above-mentioned business index matching rule may be used to determine, according to a log path, a business category, a matching manner, and a business index keyword, a business index matching result corresponding to a target business.
S203, responding to the service index calculation rule configuration instruction of the target service, wherein the service index calculation rule configuration instruction carries a primary service index calculation formula and a secondary service index calculation formula, and configuring the service index calculation rule based on the primary service index calculation formula and the secondary service index calculation formula.
In this embodiment of the present disclosure, the above-mentioned business index calculation rule may be used to analyze a multi-level business index calculation formula corresponding to a business index matching result, where the multi-level business index calculation formula may be preconfigured based on a business category and a business index keyword, and the multi-level business index calculation formula may include a primary business index calculation formula and a secondary business index calculation formula.
S205, responding to the threshold value alarm rule configuration instruction of the target service, wherein the threshold value alarm rule configuration instruction carries a preset threshold value and a preset comparison mode of each service index, and configuring the threshold value alarm rule based on the preset threshold value and the preset comparison mode of each service index.
In this embodiment of the present disclosure, the threshold alert rule may be used to alert and monitor each service indicator according to a preset threshold and a preset comparison manner of each service indicator.
S207, configuring the business index rule based on the business index matching rule, the business index calculation rule and the threshold alarm rule.
The above embodiment shows that the method for obtaining the business index rule by respectively configuring the business index matching rule, the business index calculation rule and the threshold value alarm rule and then aggregating reduces the coupling between the rules and improves the independence of the rules, thereby improving the convenience of independently updating and modifying the rules.
S103, obtaining the service log of the target service.
Specifically, the obtaining the service log of the target service may include:
1) Collecting the service log;
2) Storing the service log into a message queue;
3) And reading the service log from the message queue according to a preset reading period.
In the embodiment of the present disclosure, the service log of the distributed service system is collected by Filebeat (log file data collector), and the service log is transmitted to the Kafka (message engine system), and the service log is read from the Kafka (message engine system) according to a preset reading period, specifically, the preset reading period may be preset based on the service index monitoring requirement, for example, may be 10 minutes or 30 minutes.
S105, based on the service index matching rule, matching the service log with the target service index keyword to obtain a service index matching result.
In this embodiment of the present disclosure, as shown in fig. 3, the matching the service log with the target service index keyword based on the service index matching rule to obtain a service index matching result may include:
s301, determining a target log path of the service log.
S303, determining a target service class corresponding to the target log path based on first preset mapping information, wherein the first preset mapping information characterizes a mapping relation between the log path and the service class.
Specifically, the first mapping information between the log path and the service class may be preset in combination with the log storage information and the service classification information in the actual application.
S305, determining a target matching mode corresponding to the target service category based on second preset mapping information, wherein the second preset mapping information represents the mapping relation between the service category and the matching mode.
Specifically, the second mapping information between the service class and the matching mode can be preset by combining the service classification information and the service index statistical requirement in the practical application, and the matching mode can comprise accurate matching and fuzzy matching.
S307, the target business index key words are obtained according to the target business category and the target matching mode.
In the embodiment of the present disclosure, the service indicator keywords may be preset in combination with the statistical requirement of the service indicator in the actual application, and determine the target service indicator keywords in the service indicator keywords according to the target service category and the target matching manner. Specifically, the target business index keywords may include a target business index accurate keyword and a target business index fuzzy keyword, where the target business index accurate keyword may be an accurate statistics field for matching a business index, and the target business index fuzzy keyword may be a fuzzy statistics field for matching a business index.
In an alternative embodiment, when the target matching manner is exact matching, the target business index exact key is obtained based on the target business category, for example, when the target business category is a statistical user deposit operation, the target business index exact key may be "deposit operation", "deposit operation failure".
In another alternative embodiment, when the target matching manner is fuzzy matching, the target traffic index fuzzy keyword is acquired based on the target traffic class, for example, when the target traffic class is statistical user transaction operation, the target traffic index fuzzy keyword may be "XX operation", "XX operation failure".
S309, based on the target matching mode, matching the business log with the target business index keyword to obtain the business index matching result.
Specifically, the service index matching result may include a service index accurate matching result or a service index fuzzy matching result.
In an alternative embodiment, when the target matching mode is accurate matching, the service log and the target service index accurate keyword are subjected to keyword accurate matching to obtain a service index accurate matching result, for example, the service log contains relevant data of deposit operation, and when the target service index accurate keyword is "deposit operation", the keyword is set as "deposit operation" and is subjected to accurate matching with the service log to obtain deposit operation data; when the accurate keyword of the target business index is 'deposit operation failure', setting the keyword as 'deposit operation failure' and carrying out accurate matching with a business log to obtain deposit operation failure data.
Specifically, when the target matching mode is fuzzy matching, performing regular fuzzy matching on the service log and a target service index fuzzy keyword to obtain a service index fuzzy matching result, for example, the service log contains related data of transaction operation, and when the target service index fuzzy keyword is XX operation, setting a regular expression as '2 } operation' and performing fuzzy matching on the service log to obtain presentation operation data, deposit operation data and transfer operation data; when the target business index fuzzy keyword is 'XX operation failure', setting the regular expression as '2 operation failure' and carrying out fuzzy matching on the target business index fuzzy keyword and the business log, so that the presentation operation failure data, the deposit operation failure data and the transfer operation failure data can be obtained.
According to the embodiment, the target matching mode and the target service index keyword corresponding to the service log can be rapidly determined through various mapping information between the log path and the service category and between the service category and the matching mode, and the corresponding service index matching result is generated based on the target matching mode, so that the extraction efficiency of the service index is improved.
And S107, calculating the service index matching result based on the service index calculation rule to obtain a target service index.
In this embodiment of the present disclosure, the service index calculation rule may include a first-level service index calculation formula and a second-level service index calculation formula, and the target service index may include a target first-level service index and a target second-level service index. Specifically, the target primary service index may be an index parameter obtained by performing statistical analysis on a service index matching result, and the target secondary service index may be an index parameter obtained by performing statistical analysis on the primary service index.
In a specific embodiment, as shown in fig. 4, the calculating, based on the service index calculation rule, the service index matching result to obtain the target service index may include:
s401, calculating the service index matching result based on the first-level service index calculation formula to obtain the target first-level service index.
Specifically, the above-mentioned first-level business index calculation formula can be preset in combination with the statistical requirement of the first-level business index in practical application, and the calculation modes used can include, but are not limited to, counting, summing, maximum value calculation and minimum value calculation, and can also obtain more accurate business indexes by setting calculation periods. For example, when the business index matching result is the deposit operation data and the deposit operation failure data, the corresponding primary business index has a deposit operand and a deposit operation failure number, the preset deposit operand calculation formula is a counting formula, the deposit operand is obtained by counting the number of the deposit operation data in the business index result, and when the set calculation period is1 minute, the deposit operand per minute can be obtained; the preset deposit operation failure number calculation formula is a counting formula, the deposit operation failure number is obtained by counting the number of deposit operation failure data in the business index result, and when the set calculation period is 30 minutes, the deposit operation failure number per half hour can be obtained.
S403, when the target primary service index comprises at least two primary service indexes, judging whether the at least two primary service indexes have corresponding secondary service indexes.
In the embodiment of the present disclosure, each secondary service index is obtained by calculating at least two corresponding primary service indexes, and third mapping information is preset, where the third mapping information characterizes a mapping relationship between each secondary service index and at least two corresponding primary service indexes; and judging whether the at least two primary service indexes have corresponding secondary service indexes or not based on the third mapping information.
And S405, when the judgment is yes, calculating the at least two primary service indexes based on the secondary service index calculation formula to obtain the target secondary service index.
Specifically, the above-mentioned two-level business index calculation formula may be preset in combination with the statistical requirement of the two-level business index in practical application, and the calculation method used may include, but is not limited to, four operations. For example, when the primary service index has a deposit operand and a deposit operation failure number, determining whether a corresponding secondary service index exists based on the third mapping information; and the judgment result is that the deposit operation failure rate of the corresponding secondary service index exists in the deposit operation number and the deposit operation failure number, the preset calculation formula of the deposit operation failure rate of the secondary service index is the deposit operation failure number/the deposit operation number=the deposit operation failure rate, and the deposit operation failure rate of the secondary service index can be obtained by dividing the deposit operation failure number of the primary service index by the deposit operation number of the primary service index.
According to the embodiment, on the basis that the target primary service index is obtained by carrying out statistical analysis on the service index matching result, the target secondary service index is obtained by carrying out statistical analysis on the target primary service index, so that the effective monitoring of the target service in a higher dimension is realized, and the comprehensiveness of the target service monitoring is improved.
And S109, monitoring the target business index based on the threshold alarming rule.
In this embodiment of the present disclosure, as shown in fig. 5, the monitoring the service indicator based on the threshold alert rule may include:
s501, judging whether the target business index has a target threshold value.
Specifically, the target threshold can be set in combination with the running condition of the target service and the monitoring requirement of the target service index in the practical application.
And S503, when the target business index is judged to have the target threshold, determining a target comparison mode of the target threshold, wherein the target comparison mode comprises whether the target threshold is exceeded or whether the target threshold is lower or not.
Specifically, the target comparison mode may be preset in combination with the target threshold and the monitoring requirement of the target service index.
S505, when the target comparison mode is to compare whether the target threshold is exceeded, judging whether the target business index exceeds the target threshold.
And S507, triggering a monitoring alarm notification that the target business index exceeds the target threshold when the target business index exceeds the target threshold.
Specifically, when the target business index exceeds the target threshold, the triggered monitoring alarm notification can be sent to a preset alarm contact person, for example, the target threshold of the target business index of "deposit operation failure number" is 100, the target comparison mode is to compare whether the target threshold is exceeded or not, and the current deposit operation failure number is 120, and then the monitoring alarm notification of "deposit service error" is triggered and sent to the corresponding alarm contact person.
S509, when the target comparison mode is to compare whether the target traffic index is lower than the target threshold, judging whether the target traffic index is lower than the target threshold.
And S511, triggering a monitoring alarm notification that the target service index is lower than the target threshold when the target service index is determined to be lower than the target threshold.
Specifically, when the target business index is lower than the target threshold, the triggered monitoring alarm notification can be sent to a preset alarm contact person, for example, the target threshold of the target business index of 'transfer operation success rate' is 99%, the target comparison mode is to compare whether the target business index is lower than the target threshold, the current transfer operation success rate is 95%, the monitoring alarm notification of 'transfer service error' is triggered, and the monitoring alarm notification is sent to the corresponding alarm contact person.
In the embodiment of the present disclosure, the monitoring alarm level may be preset based on the actual monitoring requirement of the service index, where the monitoring alarm level may include, but is not limited to, a warning alarm, an error alarm and a deadly alarm, and the corresponding target threshold may be set for the monitoring alarm notifications of different alarm levels of the same service index respectively.
The above embodiment can be seen that, by monitoring the comparison result of the target service index and the target threshold value in different comparison manners, the pertinence of monitoring different target service indexes is improved, and further, the effective monitoring of the service running condition is realized.
In this embodiment of the present disclosure, as shown in fig. 6, the method for monitoring a service index may further include:
S601, in response to the target service updating instruction, updating the target service.
In practical application, the target service update instruction can be issued according to the practical service development requirement to update the target service.
S603, according to the updated target service, reconfiguring the service index rule of the updated target service.
In practical application, after the target service is updated, the service index rule of the updated target service needs to be reconfigured so as to monitor the corresponding service index in time, specifically, the specific step of reconfiguring the service index rule of the updated target service is similar to the step of configuring the service index rule in S201 to S207, and the specific step can be referred to the relevant description of configuring the service index rule in S201 to S207 and is not repeated herein.
The technical scheme provided by the embodiment of the application can be seen that, on one hand, by a method of respectively configuring the business index matching rule, the business index calculation rule and the threshold value alarm rule in advance and then aggregating to obtain the business index rule, the problems of large labor cost and low efficiency caused by the fact that the business index is determined in the construction process of the business system and the business system is revised when the business is updated in the related art are avoided, the coupling among the rules is reduced, the independence of the rules is improved, and the convenience of independently updating and revising the rules is improved; on the other hand, based on the service index matching rule, the service log is matched with the target service index keyword to obtain a service index matching result, so that the extraction efficiency of the service index is improved; on the other hand, on the basis of carrying out statistical analysis on the service index matching result to obtain a target primary service index, carrying out statistical analysis on the target primary service index to obtain a target secondary service index, and realizing effective monitoring on a higher dimension of the target service; on the other hand, the comparison results of the target service indexes and the target threshold value are monitored in different comparison modes, so that the pertinence of monitoring different target service indexes is improved, and further, the service running condition is effectively monitored.
An embodiment of the present application provides a service indicator monitoring device, as shown in fig. 7, where the device may include:
A service index configuration rule obtaining module 710, configured to obtain a service index rule of a target service, where the service index rule includes: business index matching rules, business index calculation rules and threshold alarm rules;
a service log obtaining module 720, configured to obtain a service log of the target service;
The business index matching module 730 is configured to match the business log with a target business index keyword based on the business index matching rule, so as to obtain a business index matching result;
The business index calculation module 740 is configured to calculate the business index matching result based on the business index calculation rule to obtain a target business index;
the business index monitoring module 750 is configured to monitor the target business index based on the threshold alarm rule.
In a specific embodiment, the apparatus may further include:
A service index matching rule configuration module, configured to respond to a service index matching rule configuration instruction of the target service, where the service index matching rule configuration instruction carries first preset mapping information, second preset mapping information and a service index keyword, where the first preset mapping information characterizes a mapping relationship between a log path and a service class, the second preset mapping information characterizes a mapping relationship between the service class and a matching mode, and configures the service index matching rule based on the first preset mapping information, the second preset mapping information and the service index keyword;
The service index calculation rule configuration module is used for responding to the service index calculation rule configuration instruction of the target service, wherein the service index calculation rule configuration instruction carries a primary service index calculation formula and a secondary service index calculation formula, and the service index calculation rule is configured based on the primary service index calculation formula and the secondary service index calculation formula;
the threshold alarm rule configuration module is used for responding to the threshold alarm rule configuration instruction of the target service, wherein the threshold alarm rule configuration instruction carries a preset threshold value and a preset comparison mode of each service index, and the threshold alarm rule is configured based on the preset threshold value and the preset comparison mode of each service index;
And the business index rule configuration module is used for configuring the business index rule based on the business index matching rule, the business index calculation rule and the threshold alarm rule.
In an embodiment of the present disclosure, the foregoing apparatus may further include:
the target service updating module is used for responding to the target service updating instruction and updating the target service;
and the service index rule reconfiguration module is used for reconfiguring the service index rule of the updated target service according to the updated target service.
In a specific embodiment, the service log obtaining module 720 may include:
The service log acquisition unit is used for acquiring the service log;
a service log storage unit for storing the service log into a message queue;
and the service log reading unit is used for reading the service log from the message queue according to a preset reading period.
In the embodiment of the present disclosure, the business index matching module 730 may include:
a target log path determining unit, configured to determine a target log path of the service log;
A target service class determining unit, configured to determine a target service class corresponding to the target log path based on first preset mapping information, where the first preset mapping information characterizes a mapping relationship between the log path and the service class;
a target matching mode determining unit, configured to determine a target matching mode corresponding to the target service class based on second preset mapping information, where the second preset mapping information characterizes a mapping relationship between the service class and the matching mode;
a target service index keyword unit, configured to obtain the target service index keyword according to the target service class and a target matching manner;
And the business index matching result unit is used for matching the business log with the target business index keyword based on the target matching mode to obtain the business index matching result.
In a specific embodiment, the service indicator calculation rule may include a primary service indicator calculation formula and a secondary service indicator calculation formula, the target service indicator may include a target primary service indicator and a target secondary service indicator, and the service indicator calculation module 740 may include:
The first-level business index calculation unit is used for calculating the business index matching result based on the first-level business index calculation formula to obtain the target first-level business index;
The secondary service index judging unit is used for judging whether the at least two primary service indexes have corresponding secondary service indexes when the target primary service indexes comprise at least two primary service indexes;
And the secondary service index calculation unit is used for calculating the at least two primary service indexes based on the secondary service index calculation formula to obtain the target secondary service index when the judgment is yes.
In the embodiment of the present disclosure, the business index monitoring module 750 may include:
A target threshold value judging unit for judging whether the target business index has a target threshold value;
a target comparison mode determining unit configured to determine a target comparison mode of the target threshold when it is determined that the target traffic index has the target threshold, where the target comparison mode includes comparing whether the target threshold is exceeded or whether the target threshold is lower than the target threshold;
The business index exceeds the target threshold value judging unit is used for judging whether the target business index exceeds the target threshold value or not when the target comparison mode is whether the target comparison mode exceeds the target threshold value or not;
the first monitoring alarm notification triggering unit is used for triggering the monitoring alarm notification that the target service index exceeds the target threshold when the target service index exceeds the target threshold;
a business index lower than a target threshold judging unit, configured to judge whether the target business index is lower than the target threshold when the target comparison mode is whether the comparison is lower than the target threshold;
and the second monitoring alarm notification triggering unit is used for triggering the monitoring alarm notification that the target service index is lower than the target threshold value when the target service index is judged to be lower than the target threshold value.
The embodiment of the application provides a business index monitoring device, which comprises a processor and a memory, wherein at least one instruction or at least one section of program is stored in the memory, and the at least one instruction or the at least one section of program is loaded and executed by the processor to realize the business index monitoring method provided by the embodiment of the method.
The memory may be used to store software programs and modules that the processor executes to perform various functional applications and data processing by executing the software programs and modules stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for functions, and the like; the storage data area may store data created according to the use of the above-described device, or the like. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide access to the memory by the processor.
The method embodiments provided by the embodiments of the present application may be performed in a mobile terminal, a computer terminal, a server, or a similar computing device, i.e., the computer device may include a mobile terminal, a computer terminal, a server, or a similar computing device. Taking the operation on a server as an example, fig. 8 is a block diagram of a hardware structure of a server of a method for monitoring a business index according to an embodiment of the present application. As shown in fig. 8, the server 800 may vary considerably in configuration or performance and may include one or more central processing units (Central Processing Units, CPU) 810 (the processor 810 may include, but is not limited to, a microprocessor MCU or a processing device such as a programmable logic device FPGA), a memory 830 for storing data, one or more storage mediums 820 (e.g., one or more mass storage devices) for storing applications 823 or data 822. Wherein memory 830 and storage medium 820 can be transitory or persistent. The program stored on the storage medium 820 may include one or more modules, each of which may include a series of instruction operations on a server. Still further, the central processor 810 may be arranged to communicate with the storage medium 820 and to execute a series of instruction operations in the storage medium 820 on the server 800. The server 800 may also include one or more power supplies 860, one or more wired or wireless network interfaces 850, one or more input/output interfaces 840, and/or one or more operating systems 821, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, and the like.
The input-output interface 840 may be used to receive or transmit data via a network. The specific example of the network described above may include a wireless network provided by a communication provider of the server 800. In one example, the input-output interface 840 includes a network adapter (Network Interface Controller, NIC) that may be connected to other network devices through a base station to communicate with the internet. In one example, the input-output interface 840 may be a Radio Frequency (RF) module for communicating with the internet wirelessly.
It will be appreciated by those of ordinary skill in the art that the configuration shown in fig. 8 is merely illustrative and is not intended to limit the configuration of the electronic device described above. For example, server 800 may also include more or fewer components than shown in fig. 8, or have a different configuration than shown in fig. 8.
The embodiment of the application also provides a storage medium, which can be arranged in a server to store at least one instruction or at least one section of program related to the business index monitoring method for implementing one of the method embodiments, and the at least one instruction or the at least one section of program is loaded and executed by the processor to implement the business index monitoring method provided by the method embodiments.
Alternatively, in this embodiment, the storage medium may be located in at least one network server among a plurality of network servers of the computer network. Alternatively, in the present embodiment, the storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
On one hand, the method of obtaining the business index rule by respectively configuring the business index matching rule, the business index calculation rule and the threshold value alarming rule in advance avoids the problems of large labor cost and low efficiency caused by the fact that the business index is determined in the construction process of the business system in the related technology and the business system is revised when the business is updated, reduces the coupling among the rules, improves the independence of the rules, and improves the convenience of independently updating and revising the rules; on the other hand, based on the service index matching rule, the service log is matched with the target service index keyword to obtain a service index matching result, so that the extraction efficiency of the service index is improved; on the other hand, on the basis of carrying out statistical analysis on the service index matching result to obtain a target primary service index, carrying out statistical analysis on the target primary service index to obtain a target secondary service index, and realizing effective monitoring on a higher dimension of the target service; on the other hand, the comparison results of the target service indexes and the target threshold value are monitored in different comparison modes, so that the pertinence of monitoring different target service indexes is improved, and further, the service running condition is effectively monitored.
It should be noted that: the sequence of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments. And the foregoing description has been directed to specific embodiments of this specification. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for apparatus, devices and storage medium embodiments, the description is relatively simple as it is substantially similar to method embodiments, with reference to the description of method embodiments in part.
Those of ordinary skill in the art will appreciate that all or a portion of the steps implementing the above embodiments may be implemented by hardware, or may be implemented by a program indicating that the relevant hardware is implemented, where the program may be stored on a computer readable storage medium, where the storage medium may be a read only memory, a magnetic disk or optical disk, etc.
The foregoing description of the preferred embodiments of the application is not intended to be limiting, but rather is intended to cover all modifications, equivalents, alternatives, and improvements that fall within the spirit and scope of the application.
Claims (9)
1. A business index monitoring method, the method comprising:
Acquiring a business index rule of a target business, wherein the business index rule comprises the following steps: business index matching rules, business index calculation rules and threshold alarm rules; the business index matching rule is configured with first preset mapping information, second preset mapping information and business index keywords, wherein the first preset mapping information represents the mapping relation between a log path and a business category, and the second preset mapping information represents the mapping relation between the business category and a matching mode;
determining a target log path of a service log of the target service;
Determining a target service class corresponding to the target log path and a target matching mode corresponding to the target service class based on the first preset mapping information and the second preset mapping information;
Acquiring a target service index keyword according to the target service class and the target matching mode;
Based on the target matching mode, matching the service log with the target service index keyword to obtain a service index matching result; the service index matching result is used for measuring the association degree of the service log of the target service and the service index;
calculating the service index matching result based on the service index calculation rule to obtain a target service index;
And monitoring the target business index based on the threshold alarming rule.
2. The method according to claim 1, wherein the method further comprises:
Responding to a service index matching rule configuration instruction of the target service, wherein the service index matching rule configuration instruction carries the first preset mapping information, the second preset mapping information and the service index keyword, and configures the service index matching rule based on the first preset mapping information, the second preset mapping information and the service index keyword;
Or, responding to a service index calculation rule configuration instruction of the target service, wherein the service index calculation rule configuration instruction carries a primary service index calculation formula and a secondary service index calculation formula, and configures the service index calculation rule based on the primary service index calculation formula and the secondary service index calculation formula;
or, responding to a threshold alarm rule configuration instruction of the target service, wherein the threshold alarm rule configuration instruction carries a preset threshold value and a preset comparison mode of each service index, and configures the threshold alarm rule based on the preset threshold value and the preset comparison mode of each service index;
And configuring the business index rule based on the business index matching rule, the business index calculation rule and the threshold alarm rule.
3. The method according to claim 1 or 2, wherein the service index matching result includes a service index exact matching result or a service index fuzzy matching result, and the matching the service log with the target service index keyword based on the target matching manner, to obtain the service index matching result includes:
When the target matching mode is accurate matching, performing keyword accurate matching on the service log and target service index accurate keywords to obtain a service index accurate matching result;
Or alternatively, the first and second heat exchangers may be,
And when the target matching mode is fuzzy matching, performing regular fuzzy matching on the service log and the target service index fuzzy keywords to obtain a service index fuzzy matching result.
4. The method according to claim 1 or 2, wherein when the business index calculation rule includes a primary business index calculation formula and a secondary business index calculation formula, the target business index includes a target primary business index and a target secondary business index, and the calculating the business index matching result based on the business index calculation rule includes:
Calculating the service index matching result based on the first-level service index calculation formula to obtain the target first-level service index;
when the target primary service index comprises at least two primary service indexes, judging whether the at least two primary service indexes have corresponding secondary service indexes or not;
and when the judgment is yes, calculating the at least two primary service indexes based on the secondary service index calculation formula to obtain the target secondary service index.
5. The method according to claim 1 or 2, wherein monitoring the target traffic indicator based on the threshold alert rule comprises:
Judging whether the target business index has a target threshold value or not;
When the target business index is judged to have the target threshold value, determining a target comparison mode of the target threshold value, wherein the target comparison mode comprises whether the target threshold value is exceeded or whether the target threshold value is lower or not;
When the target comparison mode is whether the target threshold value is exceeded or not, judging whether the target business index exceeds the target threshold value or not;
Triggering a monitoring alarm notification that the target business index exceeds the target threshold when the target business index exceeds the target threshold;
When the target comparison mode is whether the comparison is lower than the target threshold value, judging whether the target business index is lower than the target threshold value;
and triggering a monitoring alarm notification that the target business index is lower than the target threshold when the target business index is judged to be lower than the target threshold.
6. The method according to claim 2, wherein the method further comprises:
updating the target service in response to a target service update instruction;
And reconfiguring service index rules of the updated target service according to the updated target service.
7. A traffic index monitoring device, the device comprising:
The service index configuration rule acquisition module is used for acquiring a service index rule of a target service, wherein the service index rule comprises the following components: business index matching rules, business index calculation rules and threshold alarm rules; the business index matching rule is configured with first preset mapping information, second preset mapping information and business index keywords, wherein the first preset mapping information represents the mapping relation between a log path and a business category, and the second preset mapping information represents the mapping relation between the business category and a matching mode;
a target log path determining module, configured to determine a target log path of a service log of the target service;
A target matching mode module, configured to determine a target service class corresponding to the target log path and a target matching mode corresponding to the target service class based on the first preset mapping information and the second preset mapping information;
the target business index keyword acquisition module is used for acquiring target business index keywords according to the target business categories and the target matching modes;
The business index matching module is used for matching the business log with the target business index keywords based on the target matching mode to obtain a business index matching result; the service index matching result is used for measuring the association degree of the service log of the target service and the service index;
The business index calculation module is used for calculating the business index matching result based on the business index calculation rule to obtain a target business index;
and the business index monitoring module is used for monitoring the target business index based on the threshold alarming rule.
8. A traffic indicator monitoring device, characterized in that it comprises a processor and a memory, in which at least one instruction or at least one program is stored, which is loaded and executed by the processor to implement the traffic indicator monitoring method according to any of claims 1 to 6.
9. A computer readable storage medium having stored therein at least one instruction or at least one program loaded and executed by a processor to implement the traffic indicator monitoring method according to any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110861842.6A CN113656243B (en) | 2021-07-28 | 2021-07-28 | Service index monitoring method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110861842.6A CN113656243B (en) | 2021-07-28 | 2021-07-28 | Service index monitoring method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113656243A CN113656243A (en) | 2021-11-16 |
| CN113656243B true CN113656243B (en) | 2024-05-31 |
Family
ID=78478932
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110861842.6A Active CN113656243B (en) | 2021-07-28 | 2021-07-28 | Service index monitoring method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113656243B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114863364B (en) * | 2022-05-20 | 2023-03-07 | 碧桂园生活服务集团股份有限公司 | Security detection method and system based on intelligent video monitoring |
| CN117033117B (en) * | 2023-07-05 | 2024-07-12 | 广州市玄武无线科技股份有限公司 | Real-time service monitoring management method, system, electronic equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811344A (en) * | 2014-01-23 | 2015-07-29 | 阿里巴巴集团控股有限公司 | Network dynamic service monitoring method and apparatus |
| CN106161060A (en) * | 2015-04-07 | 2016-11-23 | 腾讯科技（深圳）有限公司 | Data monitoring method and device |
| CN106302015A (en) * | 2016-08-16 | 2017-01-04 | 华青融天（北京）技术股份有限公司 | A kind of service condition monitoring method, device and system |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| CN108491310A (en) * | 2018-03-26 | 2018-09-04 | 北京九章云极科技有限公司 | A kind of daily record monitoring method and system |
| WO2019140828A1 (en) * | 2018-01-17 | 2019-07-25 | 平安科技（深圳）有限公司 | Electronic apparatus, method for querying logs in distributed system, and storage medium |
| CN110333983A (en) * | 2019-05-31 | 2019-10-15 | 口口相传(北京)网络技术有限公司 | Business monitoring and searching service monitoring method and device |
| CN111861472A (en) * | 2020-07-30 | 2020-10-30 | 中国工商银行股份有限公司 | Service monitoring processing method and device |
-
2021
- 2021-07-28 CN CN202110861842.6A patent/CN113656243B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811344A (en) * | 2014-01-23 | 2015-07-29 | 阿里巴巴集团控股有限公司 | Network dynamic service monitoring method and apparatus |
| CN106161060A (en) * | 2015-04-07 | 2016-11-23 | 腾讯科技（深圳）有限公司 | Data monitoring method and device |
| CN106302015A (en) * | 2016-08-16 | 2017-01-04 | 华青融天（北京）技术股份有限公司 | A kind of service condition monitoring method, device and system |
| CN107992398A (en) * | 2017-12-22 | 2018-05-04 | 宜人恒业科技发展（北京）有限公司 | The monitoring method and monitoring system of a kind of operation system |
| WO2019140828A1 (en) * | 2018-01-17 | 2019-07-25 | 平安科技（深圳）有限公司 | Electronic apparatus, method for querying logs in distributed system, and storage medium |
| CN108491310A (en) * | 2018-03-26 | 2018-09-04 | 北京九章云极科技有限公司 | A kind of daily record monitoring method and system |
| CN110333983A (en) * | 2019-05-31 | 2019-10-15 | 口口相传(北京)网络技术有限公司 | Business monitoring and searching service monitoring method and device |
| CN111861472A (en) * | 2020-07-30 | 2020-10-30 | 中国工商银行股份有限公司 | Service monitoring processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113656243A (en) | 2021-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113656243B (en) | Service index monitoring method, device, equipment and storage medium | |
| CN111064614B (en) | Fault root cause positioning method, device, equipment and storage medium | |
| CN110147387B (en) | Root cause analysis method, root cause analysis device, root cause analysis equipment and storage medium | |
| CN106095639A (en) | A kind of cluster subhealth state method for early warning and system | |
| WO2015136624A1 (en) | Application performance monitoring method and device | |
| CN110830438A (en) | Abnormal log warning method and device and electronic equipment | |
| CN113051147A (en) | Database cluster monitoring method, device, system and equipment | |
| CN107122669A (en) | A kind of method and apparatus for assessing leaking data risk | |
| CN111090807B (en) | Knowledge graph-based user identification method and device | |
| CN112953738B (en) | Root cause alarm positioning system, method and device and computer equipment | |
| CN112181767A (en) | Method and device for determining software system exception and storage medium | |
| US9235463B2 (en) | Device and method for fault management of smart device | |
| CN113271224A (en) | Node positioning method and device, storage medium and electronic device | |
| CN113125903A (en) | Line loss anomaly detection method, device, equipment and computer-readable storage medium | |
| CN106951360B (en) | Data statistical integrity calculation method and system | |
| CN114265927A (en) | Data query method and device, storage medium and electronic device | |
| CN110909129A (en) | Abnormal complaint event identification method and device | |
| CN114780358A (en) | Detection method and detection device for abnormal operation behaviors | |
| CN113504996A (en) | Load balance detection method, device, equipment and storage medium | |
| CN112784025A (en) | Method and device for determining target event | |
| CN112612679A (en) | System running state monitoring method and device, computer equipment and storage medium | |
| CN114742371A (en) | Business process management system and method thereof | |
| CN108763007B (en) | Identification method and device for step counting abnormal equipment and server | |
| CN113254672A (en) | Abnormal account identification method, system, equipment and readable storage medium | |
| CN114781674B (en) | Method and device for positioning faults of wind power equipment, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |