CN110502404B - Early warning processing method based on data management platform and related equipment - Google Patents
Early warning processing method based on data management platform and related equipment Download PDFInfo
- Publication number
- CN110502404B CN110502404B CN201910660102.9A CN201910660102A CN110502404B CN 110502404 B CN110502404 B CN 110502404B CN 201910660102 A CN201910660102 A CN 201910660102A CN 110502404 B CN110502404 B CN 110502404B
- Authority
- CN
- China
- Prior art keywords
- early warning
- rule
- information
- task
- event
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/327—Alarm or error message display
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Infusion, Injection, And Reservoir Apparatuses (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to the field of pedestal operation and maintenance, and particularly discloses an early warning processing method based on a data management platform and related equipment, wherein the method comprises the following steps: executing a rule task of a data management platform, and detecting an execution result of the rule task of the data management platform; when the execution result of the data management platform rule task is execution failure, generating an early warning event; and generating task failure related information associated with the early warning event, and sending early warning information corresponding to the early warning event. The invention provides a basis for solving the subsequent problems by recording the reason of the execution failure of the rule in detail, reduces the time for processing the problems and improves the efficiency.
Description
Technical Field
The application relates to the field of pedestal operation and maintenance, in particular to an early warning processing method based on a data management platform and related equipment.
Background
The existing data management platform can monitor and manage the data quality aiming at all historical data and incremental data, and the integrity, consistency, timeliness and accuracy of the data are guaranteed. Meanwhile, the data processing flow and each business link are monitored, and the abnormity is timely found, processed, the problem is found, the problem is tracked, and the problem is solved. And provides a data quality analysis report for the overall data quality and business links.
The data management platform comprises a monitoring early warning page used for displaying early warning information to a user when rule execution fails, monitoring rules configured in the platform are regularly executed every day, an early warning event is triggered when rule execution fails, but the early warning event only prompts on the page or only sends a mail to give an early warning notice, and the prompt and mail notice do not contain the reason of specific task failure, so that the platform cannot record the reason of problem generation, the user can not follow the reason when the early warning event is processed, the processing time of the user is increased, and the efficiency is low.
Disclosure of Invention
The application aims to overcome the defects of the prior art and provide an early warning processing method and related equipment based on a data management platform, and the reason of rule execution failure is recorded in detail, so that the basis is provided for subsequent problem solving, the time for processing the problem is shortened, and the efficiency is improved.
In order to achieve the purpose, the technical scheme of the application provides an early warning processing method based on a data management platform and related equipment.
The application discloses an early warning processing method based on a data management platform, which comprises the following steps:
executing a rule task of a data management platform, and detecting an execution result of the rule task of the data management platform;
when the execution result of the data management platform rule task is execution failure, generating an early warning event;
and generating task failure related information associated with the early warning event, and sending early warning information corresponding to the early warning event.
Preferably, after the generating the task failure related information associated with the early warning event and sending the early warning information corresponding to the early warning event, the method includes:
and processing the early warning event according to the task failure related information associated with the early warning event, and deleting the early warning information corresponding to the early warning event after the early warning event is processed.
Preferably, the executing the rule task of the data governance platform and detecting the execution result of the rule task of the data governance platform includes:
acquiring a plurality of rule tasks of a data management platform;
executing a plurality of rule tasks of the data governance platform regularly;
and detecting the execution result of each rule task in the multiple rule tasks of the data governance platform.
Preferably, when the execution result of the data governance platform rule task is execution failure, generating an early warning event, including:
and when the rule tasks of the data management platform are multiple and the execution result of at least one rule task in the rule tasks of the data management platform is execution failure, generating an early warning event corresponding to the rule task which is execution failure.
Preferably, after the generating the task failure related information associated with the early warning event and sending the early warning information corresponding to the early warning event, the method includes:
when the early warning event is processed, inquiring the task failure related information according to the early warning event;
and processing the early warning event according to the inquired task failure related information.
Preferably, after the generating the task failure related information associated with the early warning event and sending the early warning information corresponding to the early warning event, the method includes:
when the early warning event is processed in a delayed manner, setting an expiration date and timing, and deleting the early warning information corresponding to the early warning event processed in a delayed manner;
and after the expiration deadline is overtime, sending the early warning information corresponding to the delayed processing early warning event again.
Preferably, after the generating the task failure related information associated with the early warning event and sending the early warning information corresponding to the early warning event, the method includes:
when a plurality of early warning events are processed, inquiring task failure related information of the early warning events;
comparing the task failure related information of the plurality of early warning events;
and when the task failure related information is matched, performing batch processing on the early warning events corresponding to the matched task failure related information.
The application also discloses early warning processing apparatus based on data administration platform, the device includes:
a rule execution module: setting the rule task of a data management platform to be executed, and detecting the execution result of the rule task of the data management platform;
an early warning event generation module: setting to generate an early warning event when the execution result of the data management platform rule task is execution failure;
the early warning event processing module: and setting to generate task failure related information associated with the early warning event and sending early warning information corresponding to the early warning event.
The application also discloses a computer device, which comprises a memory and a processor, wherein the memory is stored with computer readable instructions, and when the computer readable instructions are executed by one or more processors, the one or more processors execute the steps of the early warning processing method.
The application also discloses a storage medium which can be read and written by the processor, the storage medium stores computer instructions, and the computer instructions, when executed by one or more processors, enable the one or more processors to execute the steps of the early warning processing method.
The beneficial effect of this application is: according to the method and the device, the reason of rule execution failure is recorded in detail, a basis is provided for subsequent problem solving, the time for processing problems is shortened, the efficiency is improved, batch processing is carried out on failure rules caused by the same reason, and the efficiency of event processing is improved.
Drawings
Fig. 1 is a schematic flow chart of an early warning processing method based on a data governance platform according to an embodiment of the present application;
fig. 2 is a schematic flow chart of an early warning processing method based on a data governance platform according to an embodiment of the present application;
fig. 3 is a schematic flow chart of an early warning processing method based on a data governance platform according to an embodiment of the present application;
fig. 4 is a schematic flow chart of an early warning processing method based on a data governance platform according to an embodiment of the present application;
fig. 5 is a schematic flow chart of an early warning processing method based on a data governance platform according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an early warning processing apparatus based on a data governance platform according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The flow of the early warning processing method based on the data management platform in the embodiment of the application is shown in fig. 1, and the embodiment of the application comprises the following steps:
step s101, executing a rule task of a data management platform, and detecting an execution result of the rule task of the data management platform;
specifically, the data management platform monitors and manages the data quality of all historical data and incremental data of the data lake, and guarantees the integrity, consistency, timeliness and accuracy of the data. Meanwhile, the data processing flow and each business link of the data lake are monitored, the abnormity is timely found, processed, the problem is found, the problem is tracked, the problem is solved, and a data quality analysis report is provided for the whole data quality and business links.
Specifically, the rule task is a rule formulated for monitoring the data governance platform, and the rule format includes a logical data expression, for example, a > B; the logical operation can also be performed by a plurality of expressions through logical operators, such as a > B & & B < C & & C > E; but does not support the simultaneous performance of multiple logical operations on one expression, e.g., a > B < C.
Specifically, the expression of the rule includes a constant, a rule term, an operator, and a mathematical function. Wherein, constant refers to a digital constant, such as 124.5, and also supports scientific counting methods, such as 1.25E 9; the rule term includes some aggregation functions, such as SUM, COUNT, AVG, MAX, etc., but these aggregation functions only provide for the result of the rule term to use; the usage format of the rule items is: the [ rule item number ], e.g., [ C00001] ═ 1, so that writing guarantees that a rule item only returns one row and one column, otherwise an exception is thrown; the usage format of the rule item may also be: an [ aggregation function (rule term number) alias ], such as [ AVG (c00001.val1) ] > 1000; the operators comprise arithmetic operation, comparison operation and logic operation; wherein the arithmetic operations include addition, subtraction, multiplication, division, etc.; the comparison operations include equal to, less than, greater than, etc.; logical operations include AND, OR, and the like; the mathematical functions include some commonly used functions such as sine functions, cosine functions, and power functions.
Specifically, after the rules are determined, corresponding monitoring rule tasks may be configured on the data administration platform according to the rules, where the configured monitoring rule tasks may be one or multiple, and if multiple monitoring rule tasks are configured, the multiple monitoring rule tasks are all executed.
Specifically, after the rules are determined, corresponding monitoring rule tasks can be configured on the data management platform through the rules, and after the monitoring rule tasks are configured, the corresponding monitoring rule tasks can be executed.
Specifically, after the monitoring rule task is executed, two execution results are generated, one is successful execution, and the other is failed execution, when the monitoring rule is failed execution, a corresponding early warning event is generated, and an operator works every day to check the early warning events, process the early warning events, and record problem information.
Step s102, when the execution result of the data governance platform rule task is execution failure, generating an early warning event;
specifically, when the execution result of the data governance platform rule task is execution failure, a corresponding early warning event is generated; the early warning event comprises information such as state, event ID, business link, rule item, early warning content, early warning level, early warning time and the like.
Specifically, when the execution result of one rule task of the data management platform is execution failure, one or more early warning events are generated, wherein the multiple early warning events are displayed in an early warning event list form, so that the early warning events can be conveniently inquired according to field information, and the early warning events can also be processed in batch.
Specifically, the rule item information in the early warning event includes rule details for triggering early warning, a detail button appears when the rule item is clicked, and the rule item information can be entered into a detail page for checking after the detail button is clicked; the detail page comprises information such as execution records, related early warning events, related rule items and the like; the execution record information comprises field information such as dependency rules, execution plans, execution results, execution types and the like, and the historical execution record of the monitoring rule can be seen through the execution record information; the related rule item information comprises field information such as a rule item ID, a rule item name, rule item contents, a target type and a monitoring target, the details of the rule item can be seen through the related rule item information, and the rule item can jump into a rule item maintenance page by clicking each rule item record; the related early warning events comprise field information such as event ID, business links, early warning content, early warning events and the like, all the early warning events triggered by the rule can be seen through the related early warning event information, and the early warning page can be jumped to by clicking each record.
And step s103, generating task failure related information associated with the early warning event, and sending early warning information corresponding to the early warning event.
Specifically, after an early warning event is generated on the data management platform, task failure related information associated with the early warning event may also be generated, where the task failure related information includes failure reasons and problem classifications, the failure reasons include reasons for monitoring that a rule task fails to be executed, that is, why the early warning event is generated, for example, by monitoring a rule "R01172 macro domestic index data comparison", a rule expression is "[ C01775] ═ C01776 ]", and after the rule is executed, if an early warning event is triggered, then for the triggered early warning event, the reason for the macro domestic index data comparison failure is specifically explained; the problem classification refers to a category of which problem the early warning event belongs to, for example, which business link the early warning event belongs to; the task failure related information corresponds to the early warning events one by one; when a plurality of early warning events are processed, task failure related information of the early warning events can be compared, and if the task failure related information is matched, the early warning events matched with the task failure related information can be processed in batches.
Specifically, after an early warning event is generated on the data management platform, early warning information corresponding to the early warning event can be sent; the early warning information can be displayed through a page or sent through an email; if the early warning event occurs, the user can be prompted on the page through an exclamation mark or other warning marks; if the notification is through the mail, a mailbox receiving address can be set on the data management platform in advance, and once an early warning event is generated and early warning information is sent, the mailbox address can be obtained and sent.
Specifically, the early warning information may include information of one or more early warning events, after the monitoring rule task is executed, only one early warning event is present, the early warning information may only include information of one early warning event when the early warning information is sent, and if there are multiple early warning events, the sent early warning information may include information of the multiple early warning events.
Specifically, after the early warning event is processed, the early warning event may have several different processing states, such as ignoring, delayed processing, processed, and the like; wherein, the neglected state aims at false alarm, which indicates that the early warning event is not abnormal time; the delay processing state aims at the early warning event to be delayed in time processing, and when the early warning event is delayed, the delay processing time can be input; the processed state is for a successfully processed early warning event.
In the embodiment, the reason of rule execution failure is recorded in detail when the early warning event is generated, so that a basis is provided for subsequent problem solving, the time for problem processing is shortened, and the efficiency is improved.
In one embodiment, after the step s103 of generating the task failure related information associated with the warning event and sending the warning information corresponding to the warning event, the method includes:
and processing the early warning event according to the task failure related information associated with the early warning event, and deleting the early warning information corresponding to the early warning event after the early warning event is processed.
Specifically, when early warning information is seen on an early warning page or an early warning mail is received, the early warning page can be entered to check an early warning event list, when the early warning event in the early warning event list is processed, task failure related information corresponding to the early warning event to be processed can be checked, and the early warning event is processed according to the task failure related information related to the early warning event.
Specifically, before the early warning event is processed, the state of the early warning event may be unprocessed, and after the early warning event is processed, the early warning event may have several different processing states, such as ignoring, delayed processing, processed and the like; wherein, the neglected state aims at false alarm, which indicates that the early warning event is not abnormal time; the delay processing state aims at the early warning event to be delayed in time processing, and when the early warning event is delayed, the delay processing time can be input; the processed state aims at the early warning event which is processed successfully; by judging the processing state of the early warning event, if the early warning event is ignored, delayed or processed, the early warning information corresponding to the early warning event can be deleted.
In this embodiment, the processing efficiency of the operator can be improved by identifying the processing state of the early warning event and deleting the early warning information.
Fig. 2 is a schematic flow chart of an early warning processing method based on a data governance platform according to an embodiment of the present application, where as shown in the drawing, in step s101, a rule task of the data governance platform is executed, and an execution result of the rule task of the data governance platform is detected, where the execution result includes:
step s201, acquiring a plurality of rule tasks of a data management platform;
specifically, after the rules are determined, corresponding monitoring rule tasks may be configured on the data governance platform according to the rules, where the configured monitoring rule tasks may be one or multiple, and if multiple monitoring rule tasks are configured, the multiple monitoring rule tasks are all executed.
Step s202, regularly executing a plurality of rule tasks of the data governance platform;
specifically, if a plurality of monitoring rule tasks are configured on the data governance platform, the plurality of monitoring rule tasks are required to be executed, the monitoring rule tasks configured in the data governance platform can be automatically executed at regular time every day, that is, a time can be preset on the data governance platform, and the plurality of monitoring rule tasks can be automatically executed after the time point arrives every day.
And step s203, detecting the execution result of each rule task in the multiple rule tasks of the data governance platform.
Specifically, after the monitoring rule task is executed, two execution results are generated, one is successful execution, and the other is failed execution, when the monitoring rule is failed execution, a corresponding early warning event is generated, and an operator works every day to check the early warning events, process the early warning events, and record problem information.
In the embodiment, the workload of operators can be reduced and the working efficiency can be improved by automatically executing the rule tasks and detecting the result.
In one embodiment, in step s102, when the execution result of the data governance platform rule task is an execution failure, generating an early warning event, including:
and when the rule tasks of the data management platform are multiple and the execution result of at least one rule task in the rule tasks of the data management platform is execution failure, generating an early warning event corresponding to the rule task which is execution failure.
Specifically, when the monitoring rule tasks of the data management platform are successfully executed, no early warning event is generated, but if the monitoring rule tasks of the data management platform have multiple items, and the execution result of at least one monitoring rule task is execution failure, an early warning event is generated, wherein when one monitoring rule task is execution failure, one or more early warning events are generated.
In the embodiment, the early warning event is identified by the execution state of the rule task, so that the identification efficiency of the early warning event can be improved.
Fig. 3 is a schematic flow chart of an early warning processing method based on a data management platform according to an embodiment of the present application, where as shown in the drawing, after the step s103 generates task failure related information associated with the early warning event and sends early warning information corresponding to the early warning event, the method includes:
step s301, when the early warning event is processed, querying the task failure related information according to the early warning event;
specifically, after the task failure related information is generated, the task failure related information is associated with the early warning event, for example, each early warning event in an early warning event list is linked to a corresponding page, and the corresponding page displays the task failure related information related to the early warning event, so that when the early warning event is processed, the task failure related information can be queried according to the early warning event.
Step s302, processing the early warning event according to the queried task failure related information.
Specifically, the task failure related information includes failure reasons and problem classifications, where the failure reasons include reasons why the monitoring rule task fails to execute, that is, why an early warning event is generated, for example, by monitoring rule "R01172 macro domestic index data comparison", a rule expression is "[ C01775] ═ C01776 ]", and after the above rule is executed, if an early warning event is triggered, the reason that the macro domestic index data comparison fails is specifically explained for the triggered early warning event; the problem classification refers to a category of which problem the early warning event belongs to, for example, which business link the early warning event belongs to; the task failure related information corresponds to the early warning events one by one; when a plurality of early warning events are processed, task failure related information of the early warning events can be compared, and if the task failure related information is matched, the early warning events matched with the task failure related information can be processed in batches.
In the embodiment, the early warning event is processed through the task failure related information, so that the processing efficiency can be improved.
Fig. 4 is a schematic flow chart of an early warning processing method based on a data management platform according to an embodiment of the present application, where as shown in the drawing, in step s103, after generating task failure related information associated with the early warning event and sending early warning information corresponding to the early warning event, the method includes:
step s401, when the early warning event is delayed, setting a deadline and timing, and deleting the early warning information corresponding to the delayed early warning event;
specifically, when the early warning event is delayed, an expiration period may be set for the delayed early warning event, and timing is started, and after the early warning event is delayed, the processing state of the delayed early warning event is changed from unprocessed to delayed processing, and at this time, the early warning information corresponding to the delayed early warning event may be deleted.
And step s402, after the expiration date is overtime, sending the early warning information corresponding to the delayed processing early warning event again.
Specifically, when the expiration date is expired, for example, when the originally set expiration date is 12/31/2018, the time-out period is expired by 12/31/2018, and the warning information corresponding to the delayed-processing warning event may be sent again.
In this embodiment, the early warning event is delayed, so that the flexibility of processing can be improved.
Fig. 5 is a schematic flow chart of an early warning processing method based on a data management platform according to an embodiment of the present application, where as shown in the drawing, after the step s103 generates task failure related information associated with the early warning event and sends early warning information corresponding to the early warning event, the method includes:
step s501, when a plurality of early warning events are processed, inquiring task failure related information of the plurality of early warning events;
specifically, the early warning event list may include a plurality of early warning events, and when a plurality of early warning events are to be processed, task failure related information of the plurality of early warning events may be checked first to obtain failure causes and problem classifications of the plurality of early warning events.
Step s502, comparing the task failure related information of the plurality of early warning events;
specifically, after the task failure related information of the plurality of early warning events is acquired, failure reasons and problem classifications in the task failure related information of the plurality of early warning events are compared, that is, whether the failure reasons of the plurality of early warning events are the same or not, if all the failure reasons are caused by the same rule, is judged; whether the problem classifications are the same, whether the problem classifications belong to the same service node, and the like.
Step s503, when the relevant task failure information is matched, performing batch processing on the early warning events corresponding to the matched relevant task failure information.
Specifically, when the task failure related information of the plurality of early warning events is compared, if the task failure related information of the early warning event is completely matched, the early warning events with completely matched task failure related information can be processed in batch.
In the embodiment, the early warning events are processed in batch by comparing the information related to the task failure of the early warning events, so that the processing efficiency can be improved.
The early warning processing apparatus structure based on data governance platform of this application embodiment is shown in fig. 6, includes:
a rule execution module 601, an early warning event generation module 602 and an early warning event processing module 603; the rule execution module 601 is connected to the early warning event generation module 602, and the early warning event generation module 602 is connected to the early warning event processing module 603; the rule execution module 601 is configured to execute a rule task of a data governance platform, and detect an execution result of the rule task of the data governance platform; the early warning event generating module 602 is configured to generate an early warning event when the execution result of the data governance platform rule task is an execution failure; the early warning event processing module 603 is configured to generate task failure related information associated with the early warning event and send early warning information corresponding to the early warning event.
The embodiment of the present application further discloses a computer device, which includes a memory and a processor, where the memory stores computer readable instructions, and when the computer readable instructions are executed by one or more of the processors, the one or more of the processors execute the steps in the warning processing method in each of the above embodiments.
The embodiment of the present application further discloses a storage medium, where the storage medium can be read and written by a processor, and the memory stores computer readable instructions, and when the computer readable instructions are executed by one or more processors, the one or more processors execute the steps in the warning processing method in the foregoing embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by a computer program, which may be stored in a computer readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, and these are all within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An early warning processing method based on a data management platform is characterized by comprising the following steps:
executing a rule task of a data management platform, and detecting an execution result of the rule task of the data management platform;
when the execution result of the data management platform rule task is execution failure, generating an early warning event; the early warning event comprises state information, event ID information, business link information, rule item information, early warning content information, early warning level information and early warning time information; the rule item information in the early warning event comprises rule details for triggering early warning, a detail button is generated when the rule item information is clicked, and the detail button is clicked and then enters a detail page for checking; the detail page comprises execution record information, related early warning event information and related rule item information; the execution record information comprises dependency rule field information, execution plan field information, execution result field information and execution type field information, and the historical execution record of the monitoring rule is seen through the execution record information;
and generating task failure related information associated with the early warning event, and sending early warning information corresponding to the early warning event.
2. The data governance platform-based early warning processing method according to claim 1, wherein after generating task failure related information associated with the early warning event and sending early warning information corresponding to the early warning event, the method comprises:
and processing the early warning event according to the task failure related information associated with the early warning event, and deleting the early warning information corresponding to the early warning event after the early warning event is processed.
3. The data governance platform-based early warning processing method of claim 1, wherein said executing a data governance platform rules task and detecting the result of said data governance platform rules task execution comprises:
acquiring a plurality of rule tasks of a data management platform;
executing a plurality of rule tasks of the data governance platform regularly;
and detecting the execution result of each rule task in the multiple rule tasks of the data governance platform.
4. The data governance platform-based early warning processing method according to claim 1, wherein when the execution result of the data governance platform rule task is execution failure, generating an early warning event comprises:
and when the rule tasks of the data management platform are multiple and the execution result of at least one rule task in the rule tasks of the data management platform is execution failure, generating an early warning event corresponding to the rule task which is execution failure.
5. The data governance platform-based early warning processing method according to claim 1, wherein after generating task failure related information associated with the early warning event and sending early warning information corresponding to the early warning event, the method comprises:
when the early warning event is processed, inquiring the task failure related information according to the early warning event;
and processing the early warning event according to the inquired task failure related information.
6. The data governance platform-based early warning processing method according to claim 1, wherein after generating task failure related information associated with the early warning event and sending early warning information corresponding to the early warning event, the method comprises:
when the early warning event is processed in a delayed manner, setting an expiration date and timing, and deleting the early warning information corresponding to the early warning event processed in a delayed manner;
and after the expiration deadline is overtime, sending the early warning information corresponding to the delayed processing early warning event again.
7. The data governance platform-based early warning processing method according to claim 1, wherein after generating task failure related information associated with the early warning event and sending early warning information corresponding to the early warning event, the method comprises:
when a plurality of early warning events are processed, inquiring task failure related information of the early warning events;
comparing the task failure related information of the plurality of early warning events;
and when the task failure related information is matched, performing batch processing on the early warning events corresponding to the matched task failure related information.
8. The utility model provides an early warning processing apparatus based on data governance platform which characterized in that, the device includes:
a rule execution module: setting the rule task of a data management platform to be executed, and detecting the execution result of the rule task of the data management platform;
an early warning event generation module: setting to generate an early warning event when the execution result of the data management platform rule task is execution failure; the early warning event comprises state information, event ID information, business link information, rule item information, early warning content information, early warning level information and early warning time information; the rule item information in the early warning event comprises rule details for triggering early warning, a detail button is generated when the rule item information is clicked, and the detail button is clicked and then enters a detail page for checking; the detail page comprises execution record information, related early warning event information and related rule item information; the execution record information comprises dependency rule field information, execution plan field information, execution result field information and execution type field information, and the historical execution record of the monitoring rule is seen through the execution record information;
the early warning event processing module: and setting to generate task failure related information associated with the early warning event and sending early warning information corresponding to the early warning event.
9. A computer device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by one or more of the processors, cause the one or more processors to perform the steps of the warning processing method of any one of claims 1 to 7.
10. A storage medium readable by a processor, the storage medium storing computer instructions which, when executed by one or more processors, cause the one or more processors to perform the steps of the warning processing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910660102.9A CN110502404B (en) | 2019-07-22 | 2019-07-22 | Early warning processing method based on data management platform and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910660102.9A CN110502404B (en) | 2019-07-22 | 2019-07-22 | Early warning processing method based on data management platform and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110502404A CN110502404A (en) | 2019-11-26 |
| CN110502404B true CN110502404B (en) | 2022-05-31 |
Family
ID=68586702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910660102.9A Active CN110502404B (en) | 2019-07-22 | 2019-07-22 | Early warning processing method based on data management platform and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110502404B (en) |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4575020B2 (en) * | 2004-04-28 | 2010-11-04 | 三菱電機株式会社 | Failure analysis device |
| JP5542398B2 (en) * | 2009-09-30 | 2014-07-09 | 株式会社日立製作所 | Root cause analysis result display method, apparatus and system for failure |
| CN101958804B (en) * | 2010-09-20 | 2014-05-28 | 中兴通讯股份有限公司 | Method for promoting warning processing efficiency, server and system |
| CN104112056B (en) * | 2013-04-18 | 2017-11-21 | 腾讯科技（深圳）有限公司 | The fault detection method and system of data processing |
| CN104991814A (en) * | 2015-06-19 | 2015-10-21 | 北京奇虎科技有限公司 | Task execution result acquiring method and system |
| CN106603317A (en) * | 2017-02-20 | 2017-04-26 | 山东浪潮商用***有限公司 | Alarm monitoring strategy analysis method based on data mining technology |
| CN107357713B (en) * | 2017-07-20 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Event management display method and system |
| CN107562601A (en) * | 2017-09-12 | 2018-01-09 | 郑州云海信息技术有限公司 | A kind of alarm method and device |
| CN109783322A (en) * | 2018-11-22 | 2019-05-21 | 远光软件股份有限公司 | A kind of monitoring analysis system and its method of enterprise information system operating status |
-
2019
- 2019-07-22 CN CN201910660102.9A patent/CN110502404B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110502404A (en) | 2019-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7856575B2 (en) | Collaborative troubleshooting computer systems using fault tree analysis | |
| CN110908883B (en) | User portrait data monitoring method, system, equipment and storage medium | |
| US20110218843A1 (en) | Non intrusive system and method for monitoring business processes | |
| CN103631713A (en) | ERP software automated testing system and method | |
| CN108073499B (en) | Application program testing method and device | |
| US9019095B2 (en) | Systems and methods for integrating alarm processing and presentation of alarms for a power generation system | |
| CN105404581A (en) | Database evaluation method and device | |
| CN110262955B (en) | Application performance monitoring tool based on pinpoint | |
| CN108304276B (en) | Log processing method and device and electronic equipment | |
| CN111768097A (en) | Method, device and system for monitoring task execution state and storage medium | |
| CN112256548B (en) | Abnormal data monitoring method and device, server and storage medium | |
| US20040153821A1 (en) | Error condition handling | |
| CN111400294B (en) | Data anomaly monitoring method, device and system | |
| CN113342608A (en) | Method and device for monitoring streaming computing engine task | |
| CN110502404B (en) | Early warning processing method based on data management platform and related equipment | |
| CN115794479B (en) | Log data processing method and device, electronic equipment and storage medium | |
| CN116680147A (en) | Operation monitoring method and device of LED display screen and electronic equipment | |
| US9183388B2 (en) | Injustice detecting system, injustice detecting device and injustice detecting method | |
| Sebu et al. | Business activity monitoring solution to detect deviations in business process execution | |
| CN115834172A (en) | Database risk warning method, device, equipment and storage medium | |
| CN111143325B (en) | Data acquisition monitoring method, monitoring device and readable storage medium | |
| CN112965793B (en) | Identification analysis data-oriented data warehouse task scheduling method and system | |
| CN115083030A (en) | Service inspection method and device and electronic equipment | |
| JP6142881B2 (en) | Failure notification system, failure notification method, failure notification device, failure notification program, and recording medium | |
| CN112579276A (en) | Task operation visualization system for big data platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |