WO2020215543A1 - Auxiliary data locating method and device, computer device and storage medium - Google Patents

Auxiliary data locating method and device, computer device and storage medium Download PDF

Info

Publication number
WO2020215543A1
WO2020215543A1 PCT/CN2019/101899 CN2019101899W WO2020215543A1 WO 2020215543 A1 WO2020215543 A1 WO 2020215543A1 CN 2019101899 W CN2019101899 W CN 2019101899W WO 2020215543 A1 WO2020215543 A1 WO 2020215543A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
abnormal
landing
tag
content
Prior art date
Application number
PCT/CN2019/101899
Other languages
French (fr)
Chinese (zh)
Inventor
王洲洋
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2020215543A1 publication Critical patent/WO2020215543A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766Error or fault reporting or storing
    • G06F11/0772Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766Error or fault reporting or storing
    • G06F11/0781Error filtering or prioritizing based on a policy defined by the user or on a policy defined by a hardware/software module, e.g. according to a severity level

Definitions

  • This application relates to the field of data processing technology, and in particular to a data-assisted positioning method, device, computer equipment and storage medium.
  • the location of abnormal data is usually performed manually by developers. After a series of time-consuming actions such as manually querying logs, viewing business codes or production data, the abnormal data is located. How to improve the locating efficiency of abnormal data has become an urgent problem to be solved.
  • the embodiments of the present application provide a data-assisted positioning method, device, computer equipment, and storage medium to solve the problem of how to improve the positioning efficiency of abnormal data.
  • a data-assisted positioning method includes:
  • the abnormal data location request includes the location time period
  • filter Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, and the abnormal record includes data tags and error information;
  • the error message, the abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
  • a data-assisted positioning device includes:
  • the receiving positioning request module is used to receive the abnormal data positioning request sent by the client, and the abnormal data positioning request includes the positioning time period;
  • Screening abnormal record module used to screen at least one abnormal record in the positioning time period based on the abnormal data record table, the abnormal record includes data label and error information;
  • the abnormal landing table module which is used to obtain the abnormal data landing table corresponding to the abnormal record based on the error information
  • Obtain the data landing table module which is used to obtain the target data landing table of the recorded data tag based on the data tag;
  • the field content extraction module is used to query the interface log database based on the access data interface corresponding to the data tag. If there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field content corresponding to at least one specified field from the abnormal log ;
  • the filter result acquisition module is used to filter the content of the target field using preset filter rules and obtain the filter result. If the filter result is the report processing result, the target field and the content of the target field are encapsulated to form error information;
  • the sending positioning data module is used to form the auxiliary positioning data from the error message, the abnormal data landing table and the target data landing table, and to send the auxiliary positioning data to the client.
  • a computer device includes a memory, a processor, and computer readable instructions stored in the memory and capable of running on the processor, wherein the processor implements the following steps when the processor executes the computer readable instructions:
  • the abnormal data location request includes the location time period
  • filter Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, and the abnormal record includes data tags and error information;
  • the error message, the abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
  • One or more non-volatile readable storage media storing computer-readable instructions.
  • the computer-readable instructions When executed by one or more processors, the one or more processors perform the following steps:
  • the abnormal data location request includes the location time period
  • filter Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, and the abnormal record includes data tags and error information;
  • the error message, the abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
  • FIG. 1 is a schematic diagram of an application environment of a data-assisted positioning method in an embodiment of the present application
  • FIG. 2 is a flowchart of a data-assisted positioning method in an embodiment of the present application
  • FIG. 3 is another flowchart of a data-assisted positioning method in an embodiment of the present application.
  • FIG. 5 is another flowchart of a data-assisted positioning method in an embodiment of the present application.
  • FIG. 6 is another flowchart of a data-assisted positioning method in an embodiment of the present application.
  • FIG. 7 is another flowchart of a data-assisted positioning method in an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a data-assisted positioning device in an embodiment of the present application.
  • Fig. 9 is a schematic diagram of a computer device in an embodiment of the present application.
  • the data-assisted positioning method provided by the embodiments of the present application can be applied in an application environment as shown in FIG. 1.
  • the data-assisted positioning method is applied in a data-assisted positioning system.
  • the data-assisted positioning system includes a client and a server. Communicate with the server through the network.
  • the client is also called the client, which refers to the program that corresponds to the server and provides local services for the client.
  • the client can be installed on, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices and other computer devices.
  • the server can be implemented as an independent server or a server cluster composed of multiple servers.
  • a data-assisted positioning method is provided.
  • the method is applied to the server in FIG. 1 as an example for description, which specifically includes the following steps:
  • the abnormal data location request is a request sent by the developer to the server through the client to assist in the location of abnormal data.
  • Abnormal data is data that is not written or written in the normal format when the system receives externally written batch data.
  • the positioning time period that is, the positioning period, can be set to 24 hours or more in this embodiment, which is not limited here.
  • developers can initiate abnormal data positioning requests to the server at the end of each positioning cycle.
  • the server may set the abnormal data location request as a timed task, or it may be the server receiving a real-time task sent by the developer through the client.
  • step S10 the server can accept the abnormal data locating request sent by the client, extract the locating time period carried in the abnormal data locating request, and prepare filtering conditions for subsequent filtering in the abnormal data record table.
  • the abnormal data record table is an information query table that records all error data written to the system.
  • the abnormal record is the basic unit that constitutes the abnormal data record table.
  • Each basic record includes data tags and error information.
  • the error information includes abnormal landing time and abnormal landing table.
  • the data label is the attribute label to which each data content belongs, such as the user name, the insured or the insured subject, etc.
  • the abnormal data record table is an information query table that records all the error data written to the system
  • the server in order to process the abnormal data location request received by the current server, the server can record the abnormal data based on the location time period obtained in step S10 Obtain all abnormal records belonging to the positioning time period from the table.
  • the server may filter and obtain at least one abnormal record within the positioning time period, so as to more accurately locate the abnormal data.
  • the abnormal data landing table is a data table in which the current data tag is not successfully written.
  • step S30 the server can obtain a data identifier such as "write to" based on the corresponding position in the error message, and obtain the abnormal data landing table that the data tag is not successfully written, so that subsequent developers can obtain the correct content corresponding to the data tag.
  • a data identifier such as "write to” based on the corresponding position in the error message
  • the target data landing table is to correctly write the current data tags into all the data tables of the system. Specifically, there should be more than one table for each data tag written in the system. If the server can obtain the target data landing table corresponding to the data tag, it can obtain the correct tag content corresponding to the data tag in the target data landing table, and write the tag content into the abnormal data landing table.
  • step S40 the server can obtain the correct target data landing table to be written into the current data tag, so as to facilitate subsequent data correction of the abnormal data landing table.
  • the access data interface is an interface for applying the label content corresponding to the current data label to the input data included in a certain module of the system, and the method interface of a certain module of the system.
  • the log database is a database that records the operating data of each data interface included in each module of the system.
  • the exception log is the basic unit that constitutes the log database.
  • Each module generates an exception log corresponding to the application of the module, which is convenient for subsequent developers to perform data verification and investigation based on the exception log.
  • the designated field is a field for recording abnormal data generation, such as but not limited to: userid, method, time, message, or exception.
  • the content of the target field is the type of error that may be recorded in each specified field. Understandably, in order to maintain a stable operation of the system, when an error occurs in the access data interface, it can be divided into negligible errors and reportable errors. Based on this, the server can classify the content of the target field corresponding to each designated field into ignorable error content and error content that should be reported. That is, when an error occurs in the access data interface, it should be recorded in the exception log according to the error type.
  • the server may query the interface log database based on the access data interface corresponding to the data tag, extract the target field content corresponding to at least one specified field from the abnormal log, and further locate the error type corresponding to the data tag, so that the positioning range is more accurate.
  • the preset screening rule is a rule that specifies whether the content of the target field should be reported or ignored.
  • the Exception class has an important subclass RuntimeException.
  • the RuntimeException class and its subclasses represent errors caused by "JVM common operations". If you try to use a null value object reference, divide by zero, or the array is out of bounds, a runtime exception will be thrown respectively. At this time, the content of the target field corresponding to the Exception does not belong to the error constituted by the data tag, and can be designated as a negligible error by the preset filtering rules.
  • Filtering results include reporting processing results and ignoring processing results. Understandably, after the screening by the preset screening rule, if the content of the corresponding target field is a negligible error, the processing result is ignored. Otherwise, the processing result is reported.
  • the error message is an information package formed by encapsulating the target field and the content of the target field to form the error message.
  • the server may filter the content of the target field based on preset filtering rules, obtain the filtering result, and report the filtering result as the target field and the content of the target field of the report processing result, so that the developer does not need to find the corresponding system
  • the module directly locates the abnormal data based on the error message.
  • the error message, the abnormal data landing table, and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
  • the auxiliary positioning data is positioning information including error information, abnormal data landing table, and target data landing table.
  • step S70 the server merges and sends all related content that may include abnormal data and abnormal data to the client, so that the client can locate the abnormal data based on the content sent by the server.
  • the server can assist in locating the data tags corresponding to the abnormal records by obtaining the abnormal records within the specified time period, including the positioning in the abnormal data landing table and the abnormal log corresponding to the access data interface. Locate, combine all the abnormal data of auxiliary positioning information and the related content of abnormal data to the client, so that the developers of the client can locate the abnormal data based on the content sent by the server, and improve the efficiency of abnormal data locating And positioning accuracy, avoiding developers to manually track abnormal data.
  • step S40 based on the data tag, obtaining the target data landing table of the recorded data tag specifically includes the following steps:
  • the landing information data table is an information sum table that stores each data tag and its associated successful landing historical data landing table.
  • the data tag userID it can be queried in the landing information data table.
  • the data tag has been successfully landed (recorded and stored correctly) in the five historical data landing tables of table1, table2, table3, table4 and table5. That is, table1, table2, table3, table4, and table5 are historical data landing tables corresponding to userID.
  • the historical data landing table is all the data tables that correctly write the current data tags into the server. Specifically, there may be more than one table written in the server for each type of data tag.
  • the server records the historical data landing table corresponding to each data tag in the landing information data table, and can obtain any correct tag content corresponding to the data tag in the historical data landing table, which facilitates the subsequent writing of the tag content to abnormal data Landing table.
  • the server may query the landing information data table based on the data tag, extract the historical data landing table corresponding to the data tag, and prepare a data basis for the subsequent server to perform statistics based on the historical data landing table.
  • the landing quantity is the number of historical data landing tables that each data tag is correctly written in the server.
  • the data tag userID the data tag has successfully landed in the five historical data landing tables of table1, table2, table3, table4 and table5 (correctly recorded and stored), that is, the historical data landing table corresponding to the data tag
  • the number of landings is 5.
  • the alarm state is the alarm risk level given by the server based on the landing data, including but not limited to the safe state, the dangerous state, and the high-risk state.
  • the server can set the number of landings corresponding to each alarm state according to the actual application. such as:
  • the number of landings is less than 2, and the alarm state is safe
  • the number of landings is less than 4, and the alarm state is dangerous
  • the number of landings is less than 6, and the alarm state is a high-risk state.
  • the server may obtain the alarm status corresponding to the data tag based on the number of landings in the historical data landing table, which is beneficial for subsequent developers to adopt corresponding data correction strategies based on the alarm status.
  • the alarm status and all historical data landing tables are associated and stored to form a target data landing table.
  • step S43 the server associates and stores all historical data landing tables and alarm states obtained in steps S41 and S42, respectively, to form a target data landing table, which is convenient for developers to intuitively obtain each data tag corresponding to the data tag based on the target data landing table.
  • the server may query the landing information data table based on the data tag, extract the historical data landing table corresponding to the data tag, and prepare a data basis for the subsequent server to perform statistics based on the historical data landing table.
  • the server associates and stores all historical data landing tables and alarm states to form a target data landing table, which is convenient for developers to intuitively obtain each historical data landing table corresponding to the data tag based on the target data landing table for data query, and based on the alarm status Take corresponding data correction strategies.
  • step S42 based on the number of landings in the historical data landing table, obtaining the alarm status corresponding to the data tag specifically includes the following steps:
  • the alarm state corresponding to the data tag is acquired as a high-risk state.
  • the server may pre-set the first number threshold as the maximum value that determines that the number of the historical data landing table corresponding to the data tag belongs to the high-risk state.
  • the second quantity threshold is the minimum value for determining that the quantity of the historical data landing table corresponding to the data tag belongs to the safe state. The number of historical data landing tables between the first number threshold and the second number threshold corresponds to the dangerous state.
  • step S421 when the server determines that the landing number of the historical data landing table is less than the first number threshold, it can obtain the alarm state corresponding to the data tag as a high-risk state, and the high-risk state is used to subsequently cause the developer to modify the data corresponding to the data tag.
  • the content is highly valued and corresponding content correction strategies are adopted.
  • the alarm state corresponding to the data tag is acquired as a dangerous state.
  • step S422 when the server determines that the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, the alarm state corresponding to the data tag can be acquired as a dangerous state, and the dangerous state is used for subsequent development The personnel pay attention to the data content corresponding to the data tag and adopt the corresponding content correction strategy.
  • the alarm state corresponding to the data tag is acquired as a safe state.
  • step S423 when the server determines that the landing number of the historical data landing table is not less than the second number threshold, it can obtain the alarm status corresponding to the data tag as a safe state, which is used to subsequently remind developers that they can use the successful landing Correct the corresponding label content in the abnormal data landing table in the historical data information table.
  • the server can obtain the alarm status corresponding to the data tag according to the number of landings corresponding to the historical data landing table, and according to different alarm statuses, it can subsequently remind developers to adopt corresponding content correction strategies.
  • the data-assisted positioning method further specifically includes the following steps:
  • the timed task is that the server executes the specified task at the specified time.
  • the timed task is specifically the task of correcting the abnormal data landing table.
  • the library that comes with jdk there are two techniques to realize timing tasks.
  • One is to use Timer, and the other is ScheduledThreadPoolExecutor. By submitting a TimerTask task to the Timer, and at the same time specifying how long to start execution and the execution cycle, the timing task can be started.
  • Timer The principle of Timer is that when the Timer is initialized, a thread is started inside the timer and a priority queue is initialized.
  • the priority queue uses the technology of the smallest heap to put the task with the earliest execution time on the top of the heap.
  • a task is generated and then inserted into the priority queue. Finally, the thread inside the timer will get the task from the top of the heap in the priority queue. After getting the task, it will first determine whether the current system has reached the execution time in a hurry. If it does, set the next execution time and adjust the heap, and then execute the task. . If the execution time is not reached, the thread continues to sleep.
  • the correction time period is the time specified by the server to correct the abnormal data landing table.
  • the server may extract the correction record table in the correction time period based on the specified time of the timing task, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record table.
  • the data modification record table is an information table that records the developers to modify each abnormal data record table. Understandably, in order to facilitate subsequent server data screening based on data in the data correction table, each record in each data correction record table should also include the developer's correction time.
  • the server can filter out all abnormal data landing tables corrected in the correction time period.
  • the server may obtain at least one correction record for data correction in the correction time period based on the data correction record table, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record.
  • the server checks the content and format of the corrected content corresponding to the data tag in the abnormal data landing table.
  • the content and format meet the data input requirements, that is, the abnormal data landing table is not written correctly.
  • the content corresponding to the data tag has been revised.
  • the abnormal data landing table is no longer an abnormal data landing table. It should be updated to the historical data landing table corresponding to the data tag and added to the landing information data table.
  • the server may correct the label content corresponding to the data tag in the abnormal data landing table, and add the corrected abnormal data landing table as a new historical data landing table to the landing information data table in time to maintain landing information The real-time and reliability of the data table.
  • the server may extract the correction record table in the correction time period based on the specified time of the timing task, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record table.
  • the server may obtain at least one correction record for data correction within the correction time period based on the data correction record table, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record.
  • the server can modify the tag content corresponding to the data tag in the abnormal data landing table, and add the corrected abnormal data landing table as a new historical data landing table to the landing information data table in time to keep the landing information data table real-time Sex and reliability.
  • step S50 the interface log database is queried based on the access data interface corresponding to the data tag. If there is an abnormal log corresponding to the abnormal record in the interface log database, the specific steps include the following steps:
  • the access data interface is the method interface corresponding to the label content corresponding to the data label when the method is called.
  • the server configures an interface ID for each access data interface.
  • the server may obtain the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag, so that the subsequent server can query the abnormal log of the corresponding interface in the interface log database based on the interface ID.
  • the abnormal landing time is the time when the server fails to correctly write the tag content corresponding to the data tag into the abnormal data landing table.
  • the abnormality record includes the abnormal landing time corresponding to each data tag.
  • the server may obtain the corresponding abnormal landing time based on the abnormal record, so that the subsequent server can screen data in the interface log database based on the abnormal landing time.
  • the interface log database records the calling situation corresponding to each access data interface in the server, and whether the label content corresponding to the called data label is written in the correct database.
  • the server may query in the interface log database based on the interface ID to obtain an abnormal log matching the landing time of the abnormality, and achieve precise positioning of the access data interface that may have a tag error corresponding to the written data tag.
  • the server may obtain the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag, so that the subsequent server can query the abnormal log of the corresponding interface in the interface log database based on the interface ID.
  • the server can obtain the corresponding abnormal landing time based on the abnormal record, so that the subsequent server can filter the data in the interface log database based on the abnormal landing time.
  • the server can query the interface log database based on the interface ID to obtain the exception log that matches the landing time of the exception, and achieve precise positioning of the access data interface that may have a tag error corresponding to the data tag.
  • step S60 the content of the target field is filtered using a preset filtering rule to obtain the filtering result, which specifically includes the following steps:
  • the preset screening rule is a rule that specifies whether the content of the target field should be reported or ignored.
  • the Exception class has an important subclass RuntimeException.
  • the RuntimeException class and its subclasses represent errors caused by "JVM common operations". If you try to use a null value object reference, divide by zero, or the array is out of bounds, a runtime exception will be thrown respectively. At this time, the content of the target field corresponding to the Exception does not belong to the error constituted by the data tag, and can be designated as a negligible error by the preset filtering rules.
  • the alarm requirement is the content of a specified type of target field preset by the server that meets the reporting requirement.
  • the abnormal errors generated by each access data interface recorded in the abnormal log include abnormalities caused by multiple reasons. Among them, some abnormalities belong to the normal category, and the server does not need to report general abnormalities or abnormalities not caused by the label content corresponding to the data label. At this time, the server can set a filtering rule, compare the content of the target field in the exception log with the filtering rule, and determine whether the content of the target field is an alarm requirement.
  • step S61 the server filters the content of the target field using a preset filtering rule, and judges whether the content of the target field meets the alarm requirement corresponding to the specified field, so that the subsequent server can filter the content of the target field that only needs to be reported.
  • the obtained filtering result is the report processing result.
  • the filtering result includes the report processing result and the ignore prompt result.
  • the report processing result is the result of reporting the filtering result to the developer.
  • the result of the ignore prompt is that the content of the target field does not need to be reported and ignored.
  • step S62 the server matches the content of the target field to the alarm requirements corresponding to the specified field, and the obtained filtering result is the report processing result, which is convenient for the subsequent server to send the report processing result to the developer for abnormal data location and abnormal data correction .
  • the obtained filtering result is the result of ignoring the prompt.
  • the server may determine that the content of the target field does not meet the alarm requirement corresponding to the designated field, and the obtained filtering result is the result of ignoring the prompt, and there is no need to report the content of the target field, which improves the timeliness of assisting in locating abnormal data.
  • the server filters the content of the target field using preset filtering rules, and judges whether the content of the target field meets the alarm requirements corresponding to the specified field, which facilitates the subsequent server to filter out the content of the target field that only needs to be reported.
  • the server matches the content of the target field to the alarm requirements corresponding to the specified field, and the obtained filtering result is the report processing result, which is convenient for the subsequent server to send the report processing result to the developer for abnormal data location and abnormal data correction.
  • the server can determine that the content of the target field does not meet the alarm requirements corresponding to the specified field, and the obtained filtering result is the result of ignoring the prompt, and there is no need to report the content of the target field, which improves the timeliness of assisted positioning abnormal data.
  • the server can assist in positioning the data tags corresponding to the abnormal records by obtaining abnormal records within a specified time period, including the positioning in the abnormal data landing table and the corresponding data in the access data interface. Locating in the abnormal log, combining all the obtained auxiliary locating information abnormal data and abnormal data related content to the client, so that the developer of the client can locate the abnormal data based on the content sent by the server and improve the abnormality
  • the positioning efficiency and positioning accuracy of the data prevent developers from manually tracking abnormal data.
  • the server may query the landing information data table based on the data tag, extract the historical data landing table corresponding to the data tag, and prepare a data basis for the subsequent server to perform statistics based on the historical data landing table.
  • the server associates and stores all historical data landing tables and alarm states to form a target data landing table, which is convenient for developers to intuitively obtain each historical data landing table corresponding to the data tag based on the target data landing table for data query, and based on the alarm status Take corresponding data correction strategies.
  • the server can obtain the alarm status corresponding to the data tag according to the number of landings corresponding to the historical data landing table, and according to different alarm states, it can subsequently remind developers to adopt corresponding content correction strategies.
  • the server may extract the correction record table in the correction time period based on the specified time of the timing task, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record table.
  • the server may obtain at least one correction record for data correction within the correction time period based on the data correction record table, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record.
  • the server can modify the tag content corresponding to the data tag in the abnormal data landing table, and add the corrected abnormal data landing table as a new historical data landing table to the landing information data table in time to keep the landing information data table real-time Sex and reliability.
  • the server may obtain the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag, so that the subsequent server can query the abnormal log of the corresponding interface in the interface log database based on the interface ID.
  • the server can obtain the corresponding abnormal landing time based on the abnormal record, so that the subsequent server can filter the data in the interface log database based on the abnormal landing time.
  • the server can query the interface log database based on the interface ID to obtain the exception log that matches the landing time of the exception, and achieve precise positioning of the access data interface that may have a tag error corresponding to the data tag.
  • the server filters the content of the target field using preset filtering rules, and judges whether the content of the target field meets the alarm requirements corresponding to the specified field, so that the subsequent server can filter the content of the target field that only needs to be reported.
  • the server matches the content of the target field to the alarm requirements corresponding to the specified field, and the obtained filtering result is the report processing result, which is convenient for the subsequent server to send the report processing result to the developer for abnormal data location and abnormal data correction.
  • the server can determine that the content of the target field does not meet the alarm requirements corresponding to the specified field, and the obtained filtering result is the result of ignoring the prompt, and there is no need to report the content of the target field, which improves the timeliness of assisted positioning of abnormal data.
  • a data-assisted positioning device corresponds to the data-assisted positioning method in the above-mentioned embodiment one-to-one.
  • the data-assisted positioning device includes a positioning request receiving module 10, a screening abnormal record module 20, an abnormal landing table acquiring module 30, a data landing table acquiring module 40, a field content extracting module 50, a filtering result acquiring module 60, and Send the positioning data module 70.
  • the detailed description of each functional module is as follows:
  • a positioning request receiving module 10 configured to receive an abnormal data positioning request sent by a client, where the abnormal data positioning request includes a positioning time period;
  • a screening abnormality record module 20 configured to screen at least one abnormality record in the positioning time period based on the abnormality data record table, the abnormality record including a data tag and error information;
  • An abnormal landing table obtaining module 30 configured to obtain an abnormal data landing table corresponding to the abnormal record based on the error information
  • Obtaining data landing table module 40 configured to obtain a target data landing table recording the data tag based on the data tag;
  • the field content extraction module 50 is configured to query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract from the abnormal log The content of the target field corresponding to at least one specified field;
  • the filter result obtaining module 60 is configured to filter the content of the target field by using preset screening rules and obtain the filtering result. If the filtering result is a report processing result, encapsulate the target field and the content of the target field to form Error message;
  • the positioning data sending module 70 is configured to form auxiliary positioning data from the error message, the abnormal data landing table, and the target data landing table, and send the auxiliary positioning data to the client.
  • the data acquisition table module 40 includes a historical data acquisition table unit 41, an alarm state acquisition unit 42 and a data data acquisition table unit 43.
  • the historical landing table extraction unit 41 is configured to query landing information data tables based on the data tags and extract the historical data landing tables corresponding to the data tags;
  • the alarm state obtaining unit 42 is configured to obtain the alarm state corresponding to the data tag based on the landing quantity of the historical data landing table;
  • a data landing table unit 43 is formed to store the alarm status and all the historical data landing tables in association to form a target data landing table.
  • the unit for obtaining an alarm state includes a subunit for obtaining a safe state, a subunit for obtaining a dangerous state, and a subunit for obtaining a high-risk state.
  • the acquiring security status subunit is used for acquiring the alarm status corresponding to the data tag as a high-risk status if the number of landings in the historical data landing table is less than the first number threshold.
  • the dangerous state obtaining subunit is used for obtaining the alarm state corresponding to the data tag as the dangerous state if the landing quantity of the historical data landing table is not less than the first quantity threshold and less than the second quantity threshold.
  • the acquiring high-risk state subunit is used to acquire the alarm state corresponding to the data tag as the safe state if the landing number of the historical data landing table is not less than the second number threshold.
  • the data-assisted positioning device further includes a module for obtaining timing tasks, a module for obtaining correction records, and a module for adding historical landing tables.
  • Obtain the timing task module which is used to acquire the timing task, and the timing task includes the correction time period.
  • the obtaining correction record module is used for obtaining at least one correction record for data correction in the correction time period based on the data correction record table, and the correction record includes a data tag and an abnormal data landing table.
  • Add the historical landing table module which is used to detect the content corresponding to the data tag based on the abnormal data landing table. If the content detection is successful, add the abnormal data landing table as a new historical data landing table to the landing information data table in.
  • the field content extraction module includes an interface ID acquisition unit, a landing time acquisition unit, and an exception log acquisition unit.
  • the interface ID acquiring unit is used to acquire the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag.
  • the acquisition time unit is used to obtain the abnormal landing time corresponding to the data tag based on the abnormal record.
  • the abnormal log obtaining unit is used to query the interface log database based on the interface ID to obtain the abnormal log matching the abnormal landing time.
  • the filtering result obtaining module includes a unit for determining compliance, a unit for obtaining a report result, and a unit for obtaining an ignored result.
  • the compliant determination unit is used to filter the content of the target field using preset filtering rules, and determine whether the content of the target field meets the alarm requirements corresponding to the specified field.
  • the report result obtaining unit is configured to, if the content of the target field meets the alarm requirement corresponding to the specified field, the obtained filtering result is the report processing result.
  • the obtained filtering result is the ignore prompt result.
  • Each module in the above-mentioned data-assisted positioning device can be implemented in whole or in part by software, hardware and a combination thereof.
  • the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
  • a computer device is provided.
  • the computer device may be a server, and its internal structure diagram may be as shown in FIG. 9.
  • the computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus.
  • the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system, computer readable instructions, and a database.
  • the internal memory provides an environment for the operation of the operating system and computer-readable instructions in the non-volatile storage medium.
  • the database of the computer equipment is used for data related to the data-assisted positioning method.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the computer-readable instruction is executed by the processor to realize a data-assisted positioning method.
  • the processor executes the computer-readable instructions, the following steps are implemented: receiving an abnormal data location request sent by the client ,
  • the abnormal data location request includes the location time period; based on the abnormal data record table, filter at least one abnormal record in the location time period, the abnormal record includes data tags and error information; based on the error information, obtain the abnormal data landing table corresponding to the abnormal record ; Based on the data tag, obtain the target data landing table of the recorded data tag; query the interface log database based on the access data interface corresponding to the data tag.
  • the target data landing table of the recorded data tag is obtained.
  • the processor executes the computer-readable instruction, the following steps are implemented: query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag Table: Based on the number of historical data landing tables, obtain the alarm status corresponding to the data label; store the alarm status and all historical data landing tables in association to form the target data landing table.
  • the alarm status corresponding to the data tag is obtained, and the processor executes the following steps when executing the computer-readable instruction: if the landing quantity of the historical data landing table is less than the first quantity threshold , The alarm state corresponding to the data tag is obtained as a high-risk state; if the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, then the alarm state corresponding to the data tag is obtained as a dangerous state ; If the landing number of the historical data landing table is not less than the second number threshold, then the alarm state corresponding to the data tag is acquired as a safe state.
  • the processor after sending the auxiliary positioning data to the client, the processor further implements the following steps when executing the computer-readable instructions: obtaining a timed task, the timed task includes a correction time period; and obtaining at least one time period based on the data correction record table Perform data correction correction records during the correction time period.
  • the correction records include data tags and abnormal data landing tables; based on the abnormal data landing tables, the content corresponding to the data tags is checked. If the content detection is successful, the abnormal data The landing table is added to the landing information data table as a new historical data landing table.
  • the interface log database is queried based on the access data interface corresponding to the data tag. If there is an abnormal log corresponding to the abnormal record in the interface log database, the processor executes the following steps when executing the computer-readable instruction: corresponding based on the data tag Obtain the interface ID corresponding to the access data interface; obtain the abnormal landing time corresponding to the data tag based on the abnormal record; query the interface log database based on the interface ID to obtain the abnormal log matching the abnormal landing time.
  • the content of the target field is filtered using a preset filtering rule to obtain the filtering result.
  • the processor executes a computer-readable instruction, the following steps are implemented: filtering the content of the target field using the preset filtering rule to determine the target Whether the content of the field meets the alarm requirements corresponding to the specified field; if the content of the target field meets the alarm requirements corresponding to the specified field, the obtained filtering result is the report processing result; if the content of the target field does not meet the alarm corresponding to the specified field If required, the obtained filtering result is the result of ignoring the prompt.
  • one or more non-volatile readable storage media storing computer readable instructions, when the computer readable instructions are executed by one or more processors, cause the one or more processors to perform the following steps : Receive the abnormal data location request sent by the client, the abnormal data location request includes the location time period; based on the abnormal data record table, filter at least one abnormal record in the location time period, the abnormal record includes data tags and error information; based on the error information , Obtain the abnormal data landing table corresponding to the abnormal record; Based on the data tag, obtain the target data landing table of the recorded data tag; query the interface log database based on the access data interface corresponding to the data tag, if there is a corresponding abnormal record in the interface log database Exception log, extract the target field content corresponding to at least one specified field from the exception log; filter the target field content using preset filtering rules to obtain the filtering result, if the filtering result is the report processing result, encapsulate the target field and target The field content forms the error message; the error message, the abnormal data
  • the target data landing table of the recorded data tag is acquired, so that one or more processors perform the following steps: query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag ; Based on the number of historical data landing tables, obtain the alarm status corresponding to the data tag; store the alarm status and all historical data landing tables in association to form the target data landing table.
  • the alarm status corresponding to the data tag is obtained, so that one or more processors execute the following steps: if the landing number of the historical data landing table is less than the first number threshold, Obtain the alarm state corresponding to the data tag as a high-risk state; if the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, then the alarm state corresponding to the data tag is obtained as a dangerous state; If the landing number of the historical data landing table is not less than the second number threshold, the alarm state corresponding to the data tag is acquired as a safe state.
  • one or more processors are caused to perform the following steps: obtain a timed task, the timed task includes a correction time period; based on the data correction record table, obtain at least one Correction records for data correction during the correction period.
  • the correction records include data tags and abnormal data landing tables; based on the abnormal data landing tables, the content corresponding to the data tags is checked. If the content detection is successful, the abnormal data will be dropped.
  • the table is added as a new historical data landing table to the landing information data table.
  • the interface log database is queried based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, one or more processors perform the following steps: Access the data interface to obtain the interface ID corresponding to the access data interface; obtain the abnormal landing time corresponding to the data tag based on the abnormal record; query the interface log database based on the interface ID to obtain the abnormal log matching the abnormal landing time.
  • the content of the target field is filtered using a preset filtering rule to obtain the filtering result, so that one or more processors perform the following steps: filtering the content of the target field using the preset filtering rule to determine the target field Whether the content meets the alarm requirement corresponding to the specified field; if the content of the target field meets the alarm requirement corresponding to the specified field, the obtained filtering result is the report processing result; if the content of the target field does not meet the alarm requirement corresponding to the specified field , The obtained filtering result is the ignore prompt result.
  • Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Testing And Monitoring For Control Systems (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

An auxiliary data locating method and device, a computer device and a storage medium. The auxiliary data locating method comprises: filtering, on the basis of an anomaly data record table, to obtain at least one anomaly record in a locating period; acquiring, on the basis of error information, an anomaly data landing table corresponding to the anomaly record (S30); acquiring, on the basis of a data label of the record, a target data landing table of the data label (S40); if an anomaly log corresponding to the anomaly record is found in an interface log database, extracting, from the anomaly log, a target field content corresponding to at least one specified field; filtering the target field content by using a preset filtering rule, and if the filtering result indicates that the processing result should be reported, generating error report information; generating auxiliary locating data by using the error report information, the anomaly data landing table and the target data landing table, and sending the auxiliary locating data to a client (S70). The auxiliary data locating method can improve the efficiency and accuracy of locating anomaly data.

Description

数据辅助定位方法、装置、计算机设备及存储介质Data auxiliary positioning method, device, computer equipment and storage medium
本申请以2019年04月26日提交的申请号为201910346057.X,名称为“数据辅助定位方法、装置、计算机设备及存储介质”的中国发明申请为基础,并要求其优先权。This application is based on the Chinese invention application with the application number 201910346057.X and titled "data-assisted positioning method, device, computer equipment and storage medium" filed on April 26, 2019, and claims priority.
技术领域Technical field
本申请涉及数据处理技术领域,尤其涉及一种数据辅助定位方法、装置、计算机设备及存储介质。This application relates to the field of data processing technology, and in particular to a data-assisted positioning method, device, computer equipment and storage medium.
背景技术Background technique
随着***开发的功能越来越丰富,开发人员编写的代码也随之增多,甚至达到千万行数量级。当对包括多个数据接口的***接入大量数据时,可能会产生未正确写入的异常数据也即不符合预期值的数据。As the functions of system development become more and more abundant, the code written by developers also increases, even reaching the order of tens of millions of lines. When a large amount of data is accessed to a system that includes multiple data interfaces, abnormal data that is incorrectly written, that is, data that does not meet the expected value may be generated.
而目前对异常数据进行定位通常是由开发人员手动操作,经过一系列耗时的手工查询日志、查看业务代码或生产数据等动作,对异常数据进行定位。如何提高异常数据的定位效率成为亟待解决的问题。At present, the location of abnormal data is usually performed manually by developers. After a series of time-consuming actions such as manually querying logs, viewing business codes or production data, the abnormal data is located. How to improve the locating efficiency of abnormal data has become an urgent problem to be solved.
发明内容Summary of the invention
本申请实施例提供一种数据辅助定位方法、装置、计算机设备及存储介质,以解决如何提高异常数据的定位效率的问题。The embodiments of the present application provide a data-assisted positioning method, device, computer equipment, and storage medium to solve the problem of how to improve the positioning efficiency of abnormal data.
一种数据辅助定位方法,包括:A data-assisted positioning method includes:
接收客户端发送的异常数据定位请求,异常数据定位请求包括定位时间段;Receive the abnormal data location request sent by the client, the abnormal data location request includes the location time period;
基于异常数据记录表,筛选在定位时间段内的至少一条异常记录,异常记录包括数据标签和错误信息;Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, and the abnormal record includes data tags and error information;
基于错误信息,获取异常记录对应的异常数据落地表;Based on the error information, obtain the abnormal data landing table corresponding to the abnormal record;
基于数据标签,获取记录数据标签的目标数据落地表;Based on the data tag, obtain the target data landing table of the recorded data tag;
基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,则从异常日志中提取至少一个指定字段对应的目标字段内容;Query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field content corresponding to at least one specified field from the abnormal log;
采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,若过滤结果为上报处理结果,则封装目标字段和目标字段内容形成报错信息;Use preset filtering rules to filter the content of the target field to obtain the filtering result. If the filtering result is the report processing result, the target field and the content of the target field are encapsulated to form an error message;
将报错信息、异常数据落地表和目标数据落地表形成辅助定位数据,将辅助定位数据发送给客户端。The error message, the abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
一种数据辅助定位装置,包括:A data-assisted positioning device includes:
接收定位请求模块,用于接收客户端发送的异常数据定位请求,异常数据定位请求包括定位时间段;The receiving positioning request module is used to receive the abnormal data positioning request sent by the client, and the abnormal data positioning request includes the positioning time period;
筛选异常记录模块,用于基于异常数据记录表,筛选在定位时间段内的至少一条异常记录,异常记录包括数据标签和错误信息;Screening abnormal record module, used to screen at least one abnormal record in the positioning time period based on the abnormal data record table, the abnormal record includes data label and error information;
获取异常落地表模块,用于基于错误信息,获取异常记录对应的异常数据落地表;Obtain the abnormal landing table module, which is used to obtain the abnormal data landing table corresponding to the abnormal record based on the error information;
获取数据落地表模块,用于基于数据标签,获取记录数据标签的目标数据落地表;Obtain the data landing table module, which is used to obtain the target data landing table of the recorded data tag based on the data tag;
提取字段内容模块,用于基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,则从异常日志中提取至少一个指定字段对应的目标字段内容;The field content extraction module is used to query the interface log database based on the access data interface corresponding to the data tag. If there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field content corresponding to at least one specified field from the abnormal log ;
获取过滤结果模块,用于采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,若过滤结果为上报处理结果,则封装目标字段和目标字段内容形成报错信息;The filter result acquisition module is used to filter the content of the target field using preset filter rules and obtain the filter result. If the filter result is the report processing result, the target field and the content of the target field are encapsulated to form error information;
发送定位数据模块,用于将报错信息、异常数据落地表和目标数据落地表形成辅助定位数据,将辅助定位数据发送给客户端。The sending positioning data module is used to form the auxiliary positioning data from the error message, the abnormal data landing table and the target data landing table, and to send the auxiliary positioning data to the client.
一种计算机设备,包括存储器、处理器以及存储在存储器中并可在处理器上运行的计算机可读指令,其特征在于,处理器执行计算机可读指令时实现如下步骤:A computer device includes a memory, a processor, and computer readable instructions stored in the memory and capable of running on the processor, wherein the processor implements the following steps when the processor executes the computer readable instructions:
接收客户端发送的异常数据定位请求,异常数据定位请求包括定位时间段;Receive the abnormal data location request sent by the client, the abnormal data location request includes the location time period;
基于异常数据记录表,筛选在定位时间段内的至少一条异常记录,异常记录包括数据标签和错误信息;Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, and the abnormal record includes data tags and error information;
基于错误信息,获取异常记录对应的异常数据落地表;Based on the error information, obtain the abnormal data landing table corresponding to the abnormal record;
基于数据标签,获取记录数据标签的目标数据落地表;Based on the data tag, obtain the target data landing table of the recorded data tag;
基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,则从异常日志中提取至少一个指定字段对应的目标字段内容;Query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field content corresponding to at least one specified field from the abnormal log;
采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,若过滤结果为上报处理结果,则封装目标字段和目标字段内容形成报错信息;Use preset filtering rules to filter the content of the target field to obtain the filtering result. If the filtering result is the report processing result, the target field and the content of the target field are encapsulated to form an error message;
将报错信息、异常数据落地表和目标数据落地表形成辅助定位数据,将辅助定位数据发送给客户端。The error message, the abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
一个或多个存储有计算机可读指令的非易失性可读存储介质,计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行如下步骤:One or more non-volatile readable storage media storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors perform the following steps:
接收客户端发送的异常数据定位请求,异常数据定位请求包括定位时间段;Receive the abnormal data location request sent by the client, the abnormal data location request includes the location time period;
基于异常数据记录表,筛选在定位时间段内的至少一条异常记录,异常记录包括数据标签和错误信息;Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, and the abnormal record includes data tags and error information;
基于错误信息,获取异常记录对应的异常数据落地表;Based on the error information, obtain the abnormal data landing table corresponding to the abnormal record;
基于数据标签,获取记录数据标签的目标数据落地表;Based on the data tag, obtain the target data landing table of the recorded data tag;
基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,则从异常日志中提取至少一个指定字段对应的目标字段内容;Query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field content corresponding to at least one specified field from the abnormal log;
采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,若过滤结果为上报处理结果,则封装目标字段和目标字段内容形成报错信息;Use preset filtering rules to filter the content of the target field to obtain the filtering result. If the filtering result is the report processing result, the target field and the content of the target field are encapsulated to form an error message;
将报错信息、异常数据落地表和目标数据落地表形成辅助定位数据,将辅助定位数据发送给客户端。The error message, the abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
本申请的一个或多个实施例的细节在下面的附图和描述中提出,本申请的其他特征和优点将从说明书、附图以及权利要求变得明显。The details of one or more embodiments of the present application are presented in the following drawings and description, and other features and advantages of the present application will become apparent from the description, drawings and claims.
附图说明Description of the drawings
为了更清楚地说明本申请实施例的技术方案,下面将对本申请实施例的描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.
图1是本申请一实施例中数据辅助定位方法的应用环境示意图;FIG. 1 is a schematic diagram of an application environment of a data-assisted positioning method in an embodiment of the present application;
图2是本申请一实施例中数据辅助定位方法的流程图;2 is a flowchart of a data-assisted positioning method in an embodiment of the present application;
图3是本申请一实施例中数据辅助定位方法的另一流程图;FIG. 3 is another flowchart of a data-assisted positioning method in an embodiment of the present application;
图4是本申请一实施例中数据辅助定位方法的另一流程图;4 is another flowchart of the data-assisted positioning method in an embodiment of the present application;
图5是本申请一实施例中数据辅助定位方法的另一流程图;FIG. 5 is another flowchart of a data-assisted positioning method in an embodiment of the present application;
图6是本申请一实施例中数据辅助定位方法的另一流程图;FIG. 6 is another flowchart of a data-assisted positioning method in an embodiment of the present application;
图7是本申请一实施例中数据辅助定位方法的另一流程图;FIG. 7 is another flowchart of a data-assisted positioning method in an embodiment of the present application;
图8是本申请一实施例中数据辅助定位装置的示意图;FIG. 8 is a schematic diagram of a data-assisted positioning device in an embodiment of the present application;
图9是本申请一实施例中计算机设备的示意图。Fig. 9 is a schematic diagram of a computer device in an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.
本申请实施例提供的数据辅助定位方法,可应用在如图1的应用环境中,该数据辅助定位方法应用在数据辅助定位***中,该数据辅助定位***包括客户端和服务器,其中,客户端通过网络与服务器进行通信。客户端又称为用户端,是指与服务器相对应,为客户端提供本地服务的程序。该客户端可安装在但不限于各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备等计算机设备上。服务器可以用独立的服务器或者是多个服务器组成的服务器集群来实现。The data-assisted positioning method provided by the embodiments of the present application can be applied in an application environment as shown in FIG. 1. The data-assisted positioning method is applied in a data-assisted positioning system. The data-assisted positioning system includes a client and a server. Communicate with the server through the network. The client is also called the client, which refers to the program that corresponds to the server and provides local services for the client. The client can be installed on, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices and other computer devices. The server can be implemented as an independent server or a server cluster composed of multiple servers.
在一实施例中,如图2所示,提供一种数据辅助定位方法,以该方法应用在图1中的服务器为例进行说明,具体包括如下步骤:In an embodiment, as shown in FIG. 2, a data-assisted positioning method is provided. The method is applied to the server in FIG. 1 as an example for description, which specifically includes the following steps:
S10.接收客户端发送的异常数据定位请求,异常数据定位请求包括定位时间段。S10. Receive an abnormal data location request sent by the client, where the abnormal data location request includes a location time period.
其中,异常数据定位请求是开发人员通过客户端向服务器发送的辅助定位异常数据的请求。Among them, the abnormal data location request is a request sent by the developer to the server through the client to assist in the location of abnormal data.
异常数据是在***接收外部写入的批量数据时,未写入或未按正常格式写入的数据。Abnormal data is data that is not written or written in the normal format when the system receives externally written batch data.
定位时间段也即定位周期,于本实施例,可设置为24小时或更多,此处不做限定。为了便于开发人员集中时间处理定位异常数据,开发人员可在每上个定位周期结束时向服务器发起异常数据定位请求。The positioning time period, that is, the positioning period, can be set to 24 hours or more in this embodiment, which is not limited here. In order to facilitate developers to concentrate time on processing abnormal positioning data, developers can initiate abnormal data positioning requests to the server at the end of each positioning cycle.
具体地,本实施例中,服务器可将该异常数据定位请求设置为定时任务,也可为服务器接收开发人员通过客户端发送的实时任务。Specifically, in this embodiment, the server may set the abnormal data location request as a timed task, or it may be the server receiving a real-time task sent by the developer through the client.
步骤S10中,服务器可接受客户端发送的异常数据定位请求,提取该异常数据定位请求中携带的定位时间段,为后续在异常数据记录表中进行筛选准备筛选条件。In step S10, the server can accept the abnormal data locating request sent by the client, extract the locating time period carried in the abnormal data locating request, and prepare filtering conditions for subsequent filtering in the abnormal data record table.
S20.基于异常数据记录表,筛选在所述定位时间段内的至少一条异常记录,所述异常记录包括数据标签和错误信息。S20. Filter at least one abnormal record in the positioning time period based on the abnormal data record table, where the abnormal record includes a data tag and error information.
其中,异常数据记录表是记录所有写入***的错误数据的信息查询表。Among them, the abnormal data record table is an information query table that records all error data written to the system.
异常记录是构成异常数据记录表的基本单位,每个基础记录包括数据标签和错误信息等。其中,错误信息包括异常落地时间和异常落地表等。The abnormal record is the basic unit that constitutes the abnormal data record table. Each basic record includes data tags and error information. Among them, the error information includes abnormal landing time and abnormal landing table.
数据标签是每种数据内容所属的属性标签,比如,用户名,投保人或投保标的等。The data label is the attribute label to which each data content belongs, such as the user name, the insured or the insured subject, etc.
具体地,因异常数据记录表是记录所有写入***的错误数据的信息查询表,为了对当前服务器接收的异常数据定位请求进行处理,服务器可基于步骤S10获得的定位时间段,在异常数据记录表中获取所有属于该定位时间段的异常记录。Specifically, because the abnormal data record table is an information query table that records all the error data written to the system, in order to process the abnormal data location request received by the current server, the server can record the abnormal data based on the location time period obtained in step S10 Obtain all abnormal records belonging to the positioning time period from the table.
步骤S20中,服务器可在定位时间段内筛选得到至少一条异常记录,将异常数据的定位范围更精确化。In step S20, the server may filter and obtain at least one abnormal record within the positioning time period, so as to more accurately locate the abnormal data.
S30.基于所述错误信息,获取所述异常记录对应的异常数据落地表。S30. Based on the error information, obtain an abnormal data landing table corresponding to the abnormal record.
其中,异常数据落地表是将当前数据标签未成功写入的数据表。Among them, the abnormal data landing table is a data table in which the current data tag is not successfully written.
步骤S30中,服务器可基于错误信息中对应的位置获数据标识比如“write to”等,获取该数据标签未成功写入的异常数据落地表,便于后续开发人员获取该数据标签对应的正确的内容时,对该异常数据落地表进行数据更新。In step S30, the server can obtain a data identifier such as "write to" based on the corresponding position in the error message, and obtain the abnormal data landing table that the data tag is not successfully written, so that subsequent developers can obtain the correct content corresponding to the data tag. When the abnormal data landing table is updated.
S40.基于所述数据标签,获取记录所述数据标签的目标数据落地表。S40. Obtain a target data landing table recording the data tag based on the data tag.
其中,目标数据落地表是将当前的数据标签正确写入***的所有数据表。具体地,每种数据标签写入***内的表应不止一个表。若服务器可获取数据标签对应的目标数据落地表,可在目标数据落地表中获取该数据标签对应的正确的标签内容,并将该标签内容可写 入异常数据落地表。Among them, the target data landing table is to correctly write the current data tags into all the data tables of the system. Specifically, there should be more than one table for each data tag written in the system. If the server can obtain the target data landing table corresponding to the data tag, it can obtain the correct tag content corresponding to the data tag in the target data landing table, and write the tag content into the abnormal data landing table.
步骤S40中,服务器可获取将写入当前数据标签正确的目标数据落地表,便于后续对异常数据落地表进行数据修正。In step S40, the server can obtain the correct target data landing table to be written into the current data tag, so as to facilitate subsequent data correction of the abnormal data landing table.
S50.基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,则从所述异常日志中提取至少一个指定字段对应的目标字段内容。S50. Query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract at least one specified field corresponding to the abnormal log Target field content.
其中,接入数据接口是将当前数据标签对应的标签内容应用到***某个模块中包括的输入数据的接口,***某个模块的方法接口等。Among them, the access data interface is an interface for applying the label content corresponding to the current data label to the input data included in a certain module of the system, and the method interface of a certain module of the system.
日志数据库是记录***每个模块包括的各个数据接口的运行数据的数据库。The log database is a database that records the operating data of each data interface included in each module of the system.
异常日志是构成日志数据库的基本单位,每个模块依据该模块的应用会对应产生异常日志,便于后续开发人员基于异常日志进行数据校验排查等。The exception log is the basic unit that constitutes the log database. Each module generates an exception log corresponding to the application of the module, which is convenient for subsequent developers to perform data verification and investigation based on the exception log.
于本实施例,指定字段是记录异常数据产生的字段,比如包括但不限于:userid、method、time、message或exception等。In this embodiment, the designated field is a field for recording abnormal data generation, such as but not limited to: userid, method, time, message, or exception.
目标字段内容是每个指定字段可能记录的错误类型。可以理解地,为了***保持稳健运行,接入数据接口在出现错误时,可分为可忽略错误和应上报错误。基于此,服务器可将每个指定字段对应的目标字段内容进行分类,区分为可忽略错误内容和应上报错误内容。也即当接入数据接口在出现错误时,应根据错误类型记录在异常日志中。The content of the target field is the type of error that may be recorded in each specified field. Understandably, in order to maintain a stable operation of the system, when an error occurs in the access data interface, it can be divided into negligible errors and reportable errors. Based on this, the server can classify the content of the target field corresponding to each designated field into ignorable error content and error content that should be reported. That is, when an error occurs in the access data interface, it should be recorded in the exception log according to the error type.
步骤S50中,服务器可基于数据标签对应的接入数据接口查询接口日志数据库,从异常日志中提取至少一个指定字段对应的目标字段内容,将数据标签对应的错误类型进行进一步定位,使得定位范围更加精确。In step S50, the server may query the interface log database based on the access data interface corresponding to the data tag, extract the target field content corresponding to at least one specified field from the abnormal log, and further locate the error type corresponding to the data tag, so that the positioning range is more accurate.
S60.采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,若所述过滤结果为上报处理结果,则封装所述目标字段和所述目标字段内容形成报错信息。S60. Filter the content of the target field using a preset filtering rule to obtain a filtering result, and if the filtering result is a report processing result, encapsulate the target field and the content of the target field to form error information.
其中,预设筛选规则是规定目标字段内容应上报还是可忽略的规则。比如,Exception类有一个重要的子类RuntimeException。RuntimeException类及其子类表示“JVM常用操作”引发的错误。若试图使用空值对象引用、除数为零或数组越界,则分别引发运行时异常。此时,该Exception对应的目标字段内容不属于数据标签构成的错误,可被预设筛选规则指定为可忽略的错误。Among them, the preset screening rule is a rule that specifies whether the content of the target field should be reported or ignored. For example, the Exception class has an important subclass RuntimeException. The RuntimeException class and its subclasses represent errors caused by "JVM common operations". If you try to use a null value object reference, divide by zero, or the array is out of bounds, a runtime exception will be thrown respectively. At this time, the content of the target field corresponding to the Exception does not belong to the error constituted by the data tag, and can be designated as a negligible error by the preset filtering rules.
过滤结果包括上报处理结果和忽略处理结果。可以理解地,当经过预设筛选规则的筛选,若对应的目标字段内容属于可忽略的错误,则为忽略处理结果。反之则为上报处理结果。Filtering results include reporting processing results and ignoring processing results. Understandably, after the screening by the preset screening rule, if the content of the corresponding target field is a negligible error, the processing result is ignored. Otherwise, the processing result is reported.
报错信息是封装目标字段和目标字段内容形成报错信息形成的信息封装包。The error message is an information package formed by encapsulating the target field and the content of the target field to form the error message.
步骤S60中,服务器可基于预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,将过滤结果为上报处理结果的目标字段和目标字段内容进行上报,便于开发人员无需查找对应的***模块,直接根据报错信息进行异常数据的定位。In step S60, the server may filter the content of the target field based on preset filtering rules, obtain the filtering result, and report the filtering result as the target field and the content of the target field of the report processing result, so that the developer does not need to find the corresponding system The module directly locates the abnormal data based on the error message.
S70.将所述报错信息、所述异常数据落地表和所述目标数据落地表形成辅助定位数据,将所述辅助定位数据发送给所述客户端。S70. The error message, the abnormal data landing table, and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
其中,辅助定位数据是包括报错信息、异常数据落地表和目标数据落地表的定位信息。Among them, the auxiliary positioning data is positioning information including error information, abnormal data landing table, and target data landing table.
步骤S70中,服务器将所有可能包括异常数据和异常数据发生异常的相关内容合并发送给客户端,便于客户端基于服务器发送的内容即可进行异常数据定位的工作。In step S70, the server merges and sends all related content that may include abnormal data and abnormal data to the client, so that the client can locate the abnormal data based on the content sent by the server.
步骤S10至S70中,服务器可通过获取指定时间段内的异常记录,将异常记录对应的数据标签进行辅助定位,包括在异常数据落地表中的定位和在接入数据接口对应的异常日志中进行定位,将所有得到的辅助定位信息异常数据和异常数据发生异常的相关内容合并发送给客户端,便于客户端的开发人员基于服务器发送的内容即可进行异常数据定位的工作,提高异常数据的定位效率和定位准确性,避免开发人员手动跟踪异常数据。In steps S10 to S70, the server can assist in locating the data tags corresponding to the abnormal records by obtaining the abnormal records within the specified time period, including the positioning in the abnormal data landing table and the abnormal log corresponding to the access data interface. Locate, combine all the abnormal data of auxiliary positioning information and the related content of abnormal data to the client, so that the developers of the client can locate the abnormal data based on the content sent by the server, and improve the efficiency of abnormal data locating And positioning accuracy, avoiding developers to manually track abnormal data.
在一实施例中,如图3所示,在步骤S40中,基于数据标签,获取记录数据标签的目 标数据落地表,具体包括如下步骤:In one embodiment, as shown in Fig. 3, in step S40, based on the data tag, obtaining the target data landing table of the recorded data tag specifically includes the following steps:
S41.基于数据标签查询落地信息数据表中,提取数据标签对应的历史数据落地表。S41. Query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag.
其中,落地信息数据表是存储每一数据标签和其关联的成功落地的历史数据落地表的信息总和表。比如,对于数据标签userID来说,可在落地信息数据表中查询到,该数据标签已在table1、table2、table3、table4和table5五个历史数据落地表中成功落地(正确记录并存储),也即table1、table2、table3、table4和table5是userID对应的历史数据落地表。Among them, the landing information data table is an information sum table that stores each data tag and its associated successful landing historical data landing table. For example, for the data tag userID, it can be queried in the landing information data table. The data tag has been successfully landed (recorded and stored correctly) in the five historical data landing tables of table1, table2, table3, table4 and table5. That is, table1, table2, table3, table4, and table5 are historical data landing tables corresponding to userID.
历史数据落地表是将当前数据标签正确写入服务器的所有数据表。具体地,每种数据标签写入服务器内的表可能不止一个。服务器在落地信息数据表中记录每一数据标签对应的历史数据落地表,可在历史数据落地表中获取该数据标签对应的任一个正确的标签内容,利于后续将该标签内容可写入异常数据落地表中。The historical data landing table is all the data tables that correctly write the current data tags into the server. Specifically, there may be more than one table written in the server for each type of data tag. The server records the historical data landing table corresponding to each data tag in the landing information data table, and can obtain any correct tag content corresponding to the data tag in the historical data landing table, which facilitates the subsequent writing of the tag content to abnormal data Landing table.
步骤S41中,服务器可基于数据标签查询落地信息数据表中,提取数据标签对应的历史数据落地表,为后续服务器基于历史数据落地表进行统计准备数据基础。In step S41, the server may query the landing information data table based on the data tag, extract the historical data landing table corresponding to the data tag, and prepare a data basis for the subsequent server to perform statistics based on the historical data landing table.
S42.基于历史数据落地表的落地数量,获取与数据标签相对应的警报状态。S42. Obtain the alarm status corresponding to the data tag based on the number of landings in the historical data landing table.
其中,落地数量是每一数据标签在服务器中被正确写入的历史数据落地表的个数。比如,对于数据标签userID来说,该数据标签已在table1、table2、table3、table4和table5五个历史数据落地表中成功落地(正确记录并存储),也即该数据标签对应的历史数据落地表的落地数量为5。Among them, the landing quantity is the number of historical data landing tables that each data tag is correctly written in the server. For example, for the data tag userID, the data tag has successfully landed in the five historical data landing tables of table1, table2, table3, table4 and table5 (correctly recorded and stored), that is, the historical data landing table corresponding to the data tag The number of landings is 5.
警报状态是服务器基于落地数据给出的警报风险级别,包括但不限于安全状态、危险状态和高危状态。具体地,当数据标签仅在服务器中1个历史数据落地表中进行记录时,可能出现已保存的数据标签对应的标签内容与同一数据标签对应的在异常数据记录表需要修正的标签内容出现不兼容等情况,也即此时难以将已存的标签内容对异常数据记录表进行修正和参考。服务器可依据实际应用情况设定每一警报状态对应的落地数量。比如:The alarm state is the alarm risk level given by the server based on the landing data, including but not limited to the safe state, the dangerous state, and the high-risk state. Specifically, when the data tag is only recorded in one historical data landing table in the server, it may appear that the tag content corresponding to the saved data tag and the tag content corresponding to the same data tag that need to be corrected in the abnormal data recording table appear incorrect. Compatibility, that is, it is difficult to modify and refer to the abnormal data record table with the stored label content at this time. The server can set the number of landings corresponding to each alarm state according to the actual application. such as:
落地数量小于2,警报状态为安全状态;The number of landings is less than 2, and the alarm state is safe;
落地数量小于4,警报状态为危险状态;The number of landings is less than 4, and the alarm state is dangerous;
落地数量小于6,警报状态为高危状态等。The number of landings is less than 6, and the alarm state is a high-risk state.
步骤S42中,服务器可基于历史数据落地表的落地数量,获取与数据标签相对应的警报状态,利于后续开发人员基于该警报状态采取对应的数据修正策略。In step S42, the server may obtain the alarm status corresponding to the data tag based on the number of landings in the historical data landing table, which is beneficial for subsequent developers to adopt corresponding data correction strategies based on the alarm status.
S43.关联存储警报状态和所有历史数据落地表,形成目标数据落地表。S43. The alarm status and all historical data landing tables are associated and stored to form a target data landing table.
步骤S43中,服务器将步骤S41和步骤S42中分别得到的所有历史数据落地表和警报状态进行关联存储,形成目标数据落地表,便于开发人员基于该目标数据落地表直观地获取数据标签对应的每一历史数据落地表进行数据查询,并基于警报状态采取对应的数据修正策略。In step S43, the server associates and stores all historical data landing tables and alarm states obtained in steps S41 and S42, respectively, to form a target data landing table, which is convenient for developers to intuitively obtain each data tag corresponding to the data tag based on the target data landing table. A historical data landing table for data query, and corresponding data correction strategy based on the alarm state.
步骤S41至S43中,服务器可基于数据标签查询落地信息数据表中,提取数据标签对应的历史数据落地表,为后续服务器基于历史数据落地表进行统计准备数据基础。服务器将所有历史数据落地表和警报状态进行关联存储,形成目标数据落地表,便于开发人员基于该目标数据落地表直观地获取数据标签对应的每一历史数据落地表进行数据查询,并基于警报状态采取对应的数据修正策略。In steps S41 to S43, the server may query the landing information data table based on the data tag, extract the historical data landing table corresponding to the data tag, and prepare a data basis for the subsequent server to perform statistics based on the historical data landing table. The server associates and stores all historical data landing tables and alarm states to form a target data landing table, which is convenient for developers to intuitively obtain each historical data landing table corresponding to the data tag based on the target data landing table for data query, and based on the alarm status Take corresponding data correction strategies.
在一实施例中,如图4所示,在步骤S42中,基于历史数据落地表的落地数量,获取与数据标签相对应的警报状态,具体包括如下步骤:In one embodiment, as shown in FIG. 4, in step S42, based on the number of landings in the historical data landing table, obtaining the alarm status corresponding to the data tag specifically includes the following steps:
S421.若历史数据落地表的落地数量小于第一数量阈值,则获取与数据标签相对应的警报状态为高危状态。S421. If the landing number of the historical data landing table is less than the first number threshold, the alarm state corresponding to the data tag is acquired as a high-risk state.
于本实施例,服务器可预先将第一数量阈值设置为判定数据标签对应的历史数据落地表的落地数量属于高危状态的最大值。可以理解地,第二数量阈值是判定数据标签对应的历史数据落地表的落地数量属于安全状态的最小值。介于第一数量阈值和第二数量阈值之 间的历史数据落地表的落地数量则对应危险状态。In this embodiment, the server may pre-set the first number threshold as the maximum value that determines that the number of the historical data landing table corresponding to the data tag belongs to the high-risk state. Understandably, the second quantity threshold is the minimum value for determining that the quantity of the historical data landing table corresponding to the data tag belongs to the safe state. The number of historical data landing tables between the first number threshold and the second number threshold corresponds to the dangerous state.
步骤S421中,当服务器判定历史数据落地表的落地数量小于第一数量阈值时,可获取与数据标签相对应的警报状态为高危状态,该高危状态用以后续引起开发人员修正数据标签对应的数据内容的高度重视,采取对应的内容修正策略。In step S421, when the server determines that the landing number of the historical data landing table is less than the first number threshold, it can obtain the alarm state corresponding to the data tag as a high-risk state, and the high-risk state is used to subsequently cause the developer to modify the data corresponding to the data tag. The content is highly valued and corresponding content correction strategies are adopted.
S422.若历史数据落地表的落地数量不小于第一数量阈值,且小于第二数量阈值,则获取与数据标签相对应的警报状态为危险状态。S422. If the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, then the alarm state corresponding to the data tag is acquired as a dangerous state.
步骤S422中,当服务器判定历史数据落地表的落地数量不小于第一数量阈值,且小于第二数量阈值,可获取与数据标签相对应的警报状态为危险状态,该危险状态用以后续引起开发人员修正数据标签对应的数据内容的重视,采取对应的内容修正策略。In step S422, when the server determines that the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, the alarm state corresponding to the data tag can be acquired as a dangerous state, and the dangerous state is used for subsequent development The personnel pay attention to the data content corresponding to the data tag and adopt the corresponding content correction strategy.
S423.若历史数据落地表的落地数量不小于第二数量阈值,则获取与数据标签相对应的警报状态为安全状态。S423. If the landing number of the historical data landing table is not less than the second number threshold, the alarm state corresponding to the data tag is acquired as a safe state.
步骤S423中,当服务器判定历史数据落地表的落地数量不小于第二数量阈值时,可获取与数据标签相对应的警报状态为安全状态,该安全状态用以后续提示开发人员可借助已成功落地的历史数据信息表修正异常数据落地表中对应的标签内容。In step S423, when the server determines that the landing number of the historical data landing table is not less than the second number threshold, it can obtain the alarm status corresponding to the data tag as a safe state, which is used to subsequently remind developers that they can use the successful landing Correct the corresponding label content in the abnormal data landing table in the historical data information table.
步骤S421至S423中,服务器可根据历史数据落地表对应的落地数量,获取与数据标签相对应的警报状态,根据不同的警报状态用以后续提醒开发人员采取对应的内容修正策略。In steps S421 to S423, the server can obtain the alarm status corresponding to the data tag according to the number of landings corresponding to the historical data landing table, and according to different alarm statuses, it can subsequently remind developers to adopt corresponding content correction strategies.
在一实施例中,如图5所示,在步骤S70之后,在将辅助定位数据发送给客户端之后,数据辅助定位方法还具体包括如下步骤:In an embodiment, as shown in FIG. 5, after step S70, after the auxiliary positioning data is sent to the client, the data-assisted positioning method further specifically includes the following steps:
S701.获取定时任务,定时任务包括修正时间段。S701. Obtain a timed task, where the timed task includes a correction time period.
其中,定时任务是服务器在指定时间执行指定的任务,于本实施例,定时任务具体为修正异常数据落地表的任务。在jdk自带的库中,有两种技术可以实现定时任务。一种是使用Timer,另外一个则是ScheduledThreadPoolExecutor。通过给Timer提交一个TimerTask的任务,同时指定多久后开始执行以及执行周期,即可开启定时任务。Among them, the timed task is that the server executes the specified task at the specified time. In this embodiment, the timed task is specifically the task of correcting the abnormal data landing table. In the library that comes with jdk, there are two techniques to realize timing tasks. One is to use Timer, and the other is ScheduledThreadPoolExecutor. By submitting a TimerTask task to the Timer, and at the same time specifying how long to start execution and the execution cycle, the timing task can be started.
Timer的原理为初始化Timer时,timer内部会启动一个线程,并且初始化一个优先级队列,该优先级队列使用了最小堆的技术来将最早执行时间的任务放在堆顶。The principle of Timer is that when the Timer is initialized, a thread is started inside the timer and a priority queue is initialized. The priority queue uses the technology of the smallest heap to put the task with the earliest execution time on the top of the heap.
当调用ScheduledThreadPoolExecutor方法时,就是生成一个任务然后***到该优先级队列中。最后,timer内部的线程会从优先级队列的堆顶获取任务,获取到任务后,先判断当前***赶时间是否到达执行时间,如果到达则先设置下一次的执行时间并调整堆,然后执行任务。如果没到执行时间则线程继续休眠。When the ScheduledThreadPoolExecutor method is called, a task is generated and then inserted into the priority queue. Finally, the thread inside the timer will get the task from the top of the heap in the priority queue. After getting the task, it will first determine whether the current system has reached the execution time in a hurry. If it does, set the next execution time and adjust the heap, and then execute the task. . If the execution time is not reached, the thread continues to sleep.
修正时间段是服务器指定获取的修正异常数据落地表的时间。The correction time period is the time specified by the server to correct the abnormal data landing table.
步骤S701中,服务器可基于定时任务的指定时间提取在修正时间段内的修正记录表,为后续服务器基于该修正记录表更新落地信息数据表准备数据基础。In step S701, the server may extract the correction record table in the correction time period based on the specified time of the timing task, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record table.
S702.基于数据修正记录表,获取至少一个在修正时间段内进行数据修正的修正记录,修正记录包括数据标签和异常数据落地表。S702. Obtain at least one correction record for data correction within the correction time period based on the data correction record table, and the correction record includes a data tag and an abnormal data landing table.
其中,数据修正记录表是记录开发人员修正每一异常数据记录表的信息表。可以理解地,为了便于后续服务器基于数据修正表中的数据进行数据筛选,每一数据修正记录表中的每一记录还应包括开发人员的修正时间。Among them, the data modification record table is an information table that records the developers to modify each abnormal data record table. Understandably, in order to facilitate subsequent server data screening based on data in the data correction table, each record in each data correction record table should also include the developer's correction time.
具体地,服务器基于数据修正记录表中的修正时间,可筛选出在修正时间段内修正的所有异常数据落地表。Specifically, based on the correction time in the data correction record table, the server can filter out all abnormal data landing tables corrected in the correction time period.
步骤S702中,服务器可基于数据修正记录表,获取至少一个在修正时间段内进行数据修正的修正记录,为后续服务器基于该修正记录更新落地信息数据表准备数据基础。In step S702, the server may obtain at least one correction record for data correction in the correction time period based on the data correction record table, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record.
S703.基于异常数据落地表,对数据标签对应的内容进行内容检测,若内容检测为记录成功,则将异常数据落地表作为新的历史数据落地表添加到落地信息数据表中。S703. Perform content detection on the content corresponding to the data tag based on the abnormal data landing table. If the content detection is successful, add the abnormal data landing table as a new historical data landing table to the landing information data table.
具体地,服务器将异常数据落地表中数据标签对应的修正后的修正内容进行内容和格 式的检测,当内容和格式都符合数据输入要求时,也即异常数据落地表中原来未正确写入的数据标签对应的内容已经被修正,此时异常数据落地表已不再是异常数据落地表,应更新为该数据标签对应的历史数据落地表,添加到落地信息数据表中。Specifically, the server checks the content and format of the corrected content corresponding to the data tag in the abnormal data landing table. When the content and format meet the data input requirements, that is, the abnormal data landing table is not written correctly. The content corresponding to the data tag has been revised. At this time, the abnormal data landing table is no longer an abnormal data landing table. It should be updated to the historical data landing table corresponding to the data tag and added to the landing information data table.
步骤S703中,服务器可将数据标签对应的标签内容在异常数据落地表中修正后,及时将该修正后的异常数据落地表作为新的历史数据落地表添加到落地信息数据表中,保持落地信息数据表的实时性和可靠性。In step S703, the server may correct the label content corresponding to the data tag in the abnormal data landing table, and add the corrected abnormal data landing table as a new historical data landing table to the landing information data table in time to maintain landing information The real-time and reliability of the data table.
步骤S701至S703中,服务器可基于定时任务的指定时间提取在修正时间段内的修正记录表,为后续服务器基于该修正记录表更新落地信息数据表准备数据基础。服务器可基于数据修正记录表,获取至少一个在修正时间段内进行数据修正的修正记录,为后续服务器基于该修正记录更新落地信息数据表准备数据基础。服务器可将数据标签对应的标签内容在异常数据落地表中修正后,及时将该修正后的异常数据落地表作为新的历史数据落地表添加到落地信息数据表中,保持落地信息数据表的实时性和可靠性。In steps S701 to S703, the server may extract the correction record table in the correction time period based on the specified time of the timing task, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record table. The server may obtain at least one correction record for data correction within the correction time period based on the data correction record table, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record. The server can modify the tag content corresponding to the data tag in the abnormal data landing table, and add the corrected abnormal data landing table as a new historical data landing table to the landing information data table in time to keep the landing information data table real-time Sex and reliability.
在一实施例中,如图6所示,在步骤S50中,基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,具体包括如下步骤:In one embodiment, as shown in FIG. 6, in step S50, the interface log database is queried based on the access data interface corresponding to the data tag. If there is an abnormal log corresponding to the abnormal record in the interface log database, the specific steps include the following steps:
S51.基于数据标签对应的接入数据接口,获取接入数据接口对应的接口ID。S51. Obtain an interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag.
其中,接入数据接口是数据标签对应的标签内容在被方法调用时对应的方法接口。为了便于区别每一数据接口,服务器给每一接入数据接口分别配置一接口ID。Among them, the access data interface is the method interface corresponding to the label content corresponding to the data label when the method is called. In order to distinguish each data interface, the server configures an interface ID for each access data interface.
步骤S51中,服务器可基于数据标签对应的接入数据接口,获取接入数据接口对应的接口ID,便于后续服务器基于该接口ID在接口日志数据库中进行对应接口的异常日志进行查询。In step S51, the server may obtain the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag, so that the subsequent server can query the abnormal log of the corresponding interface in the interface log database based on the interface ID.
S52.基于异常记录,获取数据标签对应的异常落地时间。S52. Obtain the abnormal landing time corresponding to the data tag based on the abnormal record.
其中,异常落地时间是服务器未将数据标签对应的标签内容正确写入异常数据落地表的时间。异常记录包括每一数据标签对应的异常落地时间。Among them, the abnormal landing time is the time when the server fails to correctly write the tag content corresponding to the data tag into the abnormal data landing table. The abnormality record includes the abnormal landing time corresponding to each data tag.
步骤S52中,服务器可基于该异常记录获取对应的异常落地时间,便于后续服务器基于该异常落地时间在接口日志数据库中进行数据筛选。In step S52, the server may obtain the corresponding abnormal landing time based on the abnormal record, so that the subsequent server can screen data in the interface log database based on the abnormal landing time.
S53.基于接口ID在接口日志数据库中进行查询,获取与异常落地时间匹配的异常日志。S53. Query the interface log database based on the interface ID, and obtain an exception log that matches the exception landing time.
其中,接口日志数据库记录服务器中每一接入数据接口对应的调用情况,以及调用的数据标签对应的标签内容是否写入正确等情况的数据库。Among them, the interface log database records the calling situation corresponding to each access data interface in the server, and whether the label content corresponding to the called data label is written in the correct database.
异常日志是服务器基于接口ID和异常落地时间在接口日志数据库中进行数据筛查后得到的日志。比如,针对接口ID=JK00100,服务器首先基于该接口ID在接口日志数据库中查询到所有有关该接口ID的接口日志;然后服务器基于异常落地时间为2019年1月15日,筛选出该接口ID对应的接口日志中于2019年1月15日产生的接口日志作为异常日志。The anomaly log is a log obtained by the server after data screening in the interface log database based on the interface ID and the time of the exception landing. For example, for the interface ID=JK00100, the server first queries all interface logs related to the interface ID in the interface log database based on the interface ID; then the server filters out the interface ID corresponding to the interface ID based on the exception landing time on January 15, 2019 The interface log generated on January 15, 2019 in the interface log is regarded as the exception log.
步骤S53中,服务器可基于接口ID在接口日志数据库中进行查询,获取与异常落地时间匹配的异常日志,将可能出现写入数据标签对应的标签错误的接入数据接口实现定位精准化。In step S53, the server may query in the interface log database based on the interface ID to obtain an abnormal log matching the landing time of the abnormality, and achieve precise positioning of the access data interface that may have a tag error corresponding to the written data tag.
步骤S51至S53中,服务器可基于数据标签对应的接入数据接口,获取接入数据接口对应的接口ID,便于后续服务器基于该接口ID在接口日志数据库中进行对应接口的异常日志进行查询。服务器可基于该异常记录获取对应的异常落地时间,便于后续服务器基于该异常落地时间在接口日志数据库中进行数据筛选。服务器可基于接口ID在接口日志数据库中进行查询,获取与异常落地时间匹配的异常日志,将可能出现写入数据标签对应的标签错误的接入数据接口实现定位精准化。In steps S51 to S53, the server may obtain the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag, so that the subsequent server can query the abnormal log of the corresponding interface in the interface log database based on the interface ID. The server can obtain the corresponding abnormal landing time based on the abnormal record, so that the subsequent server can filter the data in the interface log database based on the abnormal landing time. The server can query the interface log database based on the interface ID to obtain the exception log that matches the landing time of the exception, and achieve precise positioning of the access data interface that may have a tag error corresponding to the data tag.
在一实施例中,如图7所示,在步骤S60中,采用预设的筛选规则对目标字段内容进 行过滤,获取过滤结果,具体包括如下步骤:In one embodiment, as shown in FIG. 7, in step S60, the content of the target field is filtered using a preset filtering rule to obtain the filtering result, which specifically includes the following steps:
S61.采用预设的筛选规则对目标字段内容进行过滤,判断目标字段内容是否符合与指定字段相对应的报警要求。S61. Filter the content of the target field using a preset filtering rule, and determine whether the content of the target field meets the alarm requirements corresponding to the specified field.
其中,预设筛选规则是规定目标字段内容应上报还是可忽略的规则。比如,Exception类有一个重要的子类RuntimeException。RuntimeException类及其子类表示“JVM常用操作”引发的错误。若试图使用空值对象引用、除数为零或数组越界,则分别引发运行时异常。此时,该Exception对应的目标字段内容不属于数据标签构成的错误,可被预设筛选规则指定为可忽略的错误。Among them, the preset screening rule is a rule that specifies whether the content of the target field should be reported or ignored. For example, the Exception class has an important subclass RuntimeException. The RuntimeException class and its subclasses represent errors caused by "JVM common operations". If you try to use a null value object reference, divide by zero, or the array is out of bounds, a runtime exception will be thrown respectively. At this time, the content of the target field corresponding to the Exception does not belong to the error constituted by the data tag, and can be designated as a negligible error by the preset filtering rules.
报警要求是服务器预先设定的符合上报要求的指定种类的目标字段内容。The alarm requirement is the content of a specified type of target field preset by the server that meets the reporting requirement.
具体地,异常日志中记录的每一接入数据接口产生的异常错误包括多种原因造成的异常。其中,有些异常属于正常范畴,服务器无需将一般异常或者不是由于数据标签对应的标签内容造成的异常进行上报。此时,服务器可设定筛选规则,将异常日志中目标字段内容与筛选规则进行对比,判定目标字段内容是否属于报警要求。Specifically, the abnormal errors generated by each access data interface recorded in the abnormal log include abnormalities caused by multiple reasons. Among them, some abnormalities belong to the normal category, and the server does not need to report general abnormalities or abnormalities not caused by the label content corresponding to the data label. At this time, the server can set a filtering rule, compare the content of the target field in the exception log with the filtering rule, and determine whether the content of the target field is an alarm requirement.
步骤S61中,服务器采用预设的筛选规则对目标字段内容进行过滤,判断目标字段内容是否符合与指定字段相对应的报警要求,利于后续服务器筛选出仅需上报的目标字段内容。In step S61, the server filters the content of the target field using a preset filtering rule, and judges whether the content of the target field meets the alarm requirement corresponding to the specified field, so that the subsequent server can filter the content of the target field that only needs to be reported.
S62.若目标字段内容符合与指定字段相对应的报警要求,则获取的过滤结果为上报处理结果。S62. If the content of the target field meets the alarm requirement corresponding to the specified field, the obtained filtering result is the report processing result.
其中,过滤结果包括上报处理结果和忽略提示结果。可以理解地,上报处理结果是将过滤结果形成报告上报给开发人员的结果。忽略提示结果为该目标字段内容无需进行上报忽略即可。Among them, the filtering result includes the report processing result and the ignore prompt result. Understandably, the report processing result is the result of reporting the filtering result to the developer. The result of the ignore prompt is that the content of the target field does not need to be reported and ignored.
步骤S62中,服务器将目标字段内容符合与指定字段相对应的报警要求,则获取的过滤结果为上报处理结果,便于后续服务器将给上报处理结果发送给开发人员,进行异常数据定位和异常数据修正。In step S62, the server matches the content of the target field to the alarm requirements corresponding to the specified field, and the obtained filtering result is the report processing result, which is convenient for the subsequent server to send the report processing result to the developer for abnormal data location and abnormal data correction .
S63.若目标字段内容不符合与指定字段相对应的报警要求,则获取的过滤结果为忽略提示结果。S63. If the content of the target field does not meet the alarm requirement corresponding to the specified field, the obtained filtering result is the result of ignoring the prompt.
步骤S63中,服务器可将目标字段内容不符合与指定字段相对应的报警要求,则获取的过滤结果为忽略提示结果,无需将该目标字段内容进行上报,提高辅助定位异常数据的时效性。In step S63, the server may determine that the content of the target field does not meet the alarm requirement corresponding to the designated field, and the obtained filtering result is the result of ignoring the prompt, and there is no need to report the content of the target field, which improves the timeliness of assisting in locating abnormal data.
步骤S61至S63中,服务器采用预设的筛选规则对目标字段内容进行过滤,判断目标字段内容是否符合与指定字段相对应的报警要求,利于后续服务器筛选出仅需上报的目标字段内容。服务器将目标字段内容符合与指定字段相对应的报警要求,则获取的过滤结果为上报处理结果,便于后续服务器将给上报处理结果发送给开发人员,进行异常数据定位和异常数据修正。服务器可将目标字段内容不符合与指定字段相对应的报警要求,则获取的过滤结果为忽略提示结果,无需将该目标字段内容进行上报,提高辅助定位异常数据的时效性。In steps S61 to S63, the server filters the content of the target field using preset filtering rules, and judges whether the content of the target field meets the alarm requirements corresponding to the specified field, which facilitates the subsequent server to filter out the content of the target field that only needs to be reported. The server matches the content of the target field to the alarm requirements corresponding to the specified field, and the obtained filtering result is the report processing result, which is convenient for the subsequent server to send the report processing result to the developer for abnormal data location and abnormal data correction. The server can determine that the content of the target field does not meet the alarm requirements corresponding to the specified field, and the obtained filtering result is the result of ignoring the prompt, and there is no need to report the content of the target field, which improves the timeliness of assisted positioning abnormal data.
本实施例提供的数据辅助定位方法,服务器可通过获取指定时间段内的异常记录,将异常记录对应的数据标签进行辅助定位,包括在异常数据落地表中的定位和在接入数据接口对应的异常日志中进行定位,将所有得到的辅助定位信息异常数据和异常数据发生异常的相关内容合并发送给客户端,便于客户端的开发人员基于服务器发送的内容即可进行异常数据定位的工作,提高异常数据的定位效率和定位准确性,避免开发人员手动跟踪异常数据。In the data-assisted positioning method provided by this embodiment, the server can assist in positioning the data tags corresponding to the abnormal records by obtaining abnormal records within a specified time period, including the positioning in the abnormal data landing table and the corresponding data in the access data interface. Locating in the abnormal log, combining all the obtained auxiliary locating information abnormal data and abnormal data related content to the client, so that the developer of the client can locate the abnormal data based on the content sent by the server and improve the abnormality The positioning efficiency and positioning accuracy of the data prevent developers from manually tracking abnormal data.
进一步地,服务器可基于数据标签查询落地信息数据表中,提取数据标签对应的历史数据落地表,为后续服务器基于历史数据落地表进行统计准备数据基础。服务器将所有历史数据落地表和警报状态进行关联存储,形成目标数据落地表,便于开发人员基于该目标 数据落地表直观地获取数据标签对应的每一历史数据落地表进行数据查询,并基于警报状态采取对应的数据修正策略。Further, the server may query the landing information data table based on the data tag, extract the historical data landing table corresponding to the data tag, and prepare a data basis for the subsequent server to perform statistics based on the historical data landing table. The server associates and stores all historical data landing tables and alarm states to form a target data landing table, which is convenient for developers to intuitively obtain each historical data landing table corresponding to the data tag based on the target data landing table for data query, and based on the alarm status Take corresponding data correction strategies.
进一步地,服务器可根据历史数据落地表对应的落地数量,获取与数据标签相对应的警报状态,根据不同的警报状态用以后续提醒开发人员采取对应的内容修正策略。Further, the server can obtain the alarm status corresponding to the data tag according to the number of landings corresponding to the historical data landing table, and according to different alarm states, it can subsequently remind developers to adopt corresponding content correction strategies.
进一步地,服务器可基于定时任务的指定时间提取在修正时间段内的修正记录表,为后续服务器基于该修正记录表更新落地信息数据表准备数据基础。服务器可基于数据修正记录表,获取至少一个在修正时间段内进行数据修正的修正记录,为后续服务器基于该修正记录更新落地信息数据表准备数据基础。服务器可将数据标签对应的标签内容在异常数据落地表中修正后,及时将该修正后的异常数据落地表作为新的历史数据落地表添加到落地信息数据表中,保持落地信息数据表的实时性和可靠性。Further, the server may extract the correction record table in the correction time period based on the specified time of the timing task, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record table. The server may obtain at least one correction record for data correction within the correction time period based on the data correction record table, and prepare a data basis for the subsequent server to update the landing information data table based on the correction record. The server can modify the tag content corresponding to the data tag in the abnormal data landing table, and add the corrected abnormal data landing table as a new historical data landing table to the landing information data table in time to keep the landing information data table real-time Sex and reliability.
进一步地,服务器可基于数据标签对应的接入数据接口,获取接入数据接口对应的接口ID,便于后续服务器基于该接口ID在接口日志数据库中进行对应接口的异常日志进行查询。服务器可基于该异常记录获取对应的异常落地时间,便于后续服务器基于该异常落地时间在接口日志数据库中进行数据筛选。服务器可基于接口ID在接口日志数据库中进行查询,获取与异常落地时间匹配的异常日志,将可能出现写入数据标签对应的标签错误的接入数据接口实现定位精准化。Further, the server may obtain the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag, so that the subsequent server can query the abnormal log of the corresponding interface in the interface log database based on the interface ID. The server can obtain the corresponding abnormal landing time based on the abnormal record, so that the subsequent server can filter the data in the interface log database based on the abnormal landing time. The server can query the interface log database based on the interface ID to obtain the exception log that matches the landing time of the exception, and achieve precise positioning of the access data interface that may have a tag error corresponding to the data tag.
进一步地,服务器采用预设的筛选规则对目标字段内容进行过滤,判断目标字段内容是否符合与指定字段相对应的报警要求,利于后续服务器筛选出仅需上报的目标字段内容。服务器将目标字段内容符合与指定字段相对应的报警要求,则获取的过滤结果为上报处理结果,便于后续服务器将给上报处理结果发送给开发人员,进行异常数据定位和异常数据修正。服务器可将目标字段内容不符合与指定字段相对应的报警要求,则获取的过滤结果为忽略提示结果,无需将该目标字段内容进行上报,提高辅助定位异常数据的时效性。Further, the server filters the content of the target field using preset filtering rules, and judges whether the content of the target field meets the alarm requirements corresponding to the specified field, so that the subsequent server can filter the content of the target field that only needs to be reported. The server matches the content of the target field to the alarm requirements corresponding to the specified field, and the obtained filtering result is the report processing result, which is convenient for the subsequent server to send the report processing result to the developer for abnormal data location and abnormal data correction. The server can determine that the content of the target field does not meet the alarm requirements corresponding to the specified field, and the obtained filtering result is the result of ignoring the prompt, and there is no need to report the content of the target field, which improves the timeliness of assisted positioning of abnormal data.
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiment of the present application.
在一实施例中,提供一种数据辅助定位装置,该数据辅助定位装置与上述实施例中数据辅助定位方法一一对应。如图8所示,该数据辅助定位装置包括接收定位请求模块10、筛选异常记录模块20、获取异常落地表模块30、获取数据落地表模块40、提取字段内容模块50、获取过滤结果模块60和发送定位数据模块70。各功能模块详细说明如下:In one embodiment, a data-assisted positioning device is provided, and the data-assisted positioning device corresponds to the data-assisted positioning method in the above-mentioned embodiment one-to-one. As shown in Figure 8, the data-assisted positioning device includes a positioning request receiving module 10, a screening abnormal record module 20, an abnormal landing table acquiring module 30, a data landing table acquiring module 40, a field content extracting module 50, a filtering result acquiring module 60, and Send the positioning data module 70. The detailed description of each functional module is as follows:
接收定位请求模块10,用于接收客户端发送的异常数据定位请求,所述异常数据定位请求包括定位时间段;A positioning request receiving module 10, configured to receive an abnormal data positioning request sent by a client, where the abnormal data positioning request includes a positioning time period;
筛选异常记录模块20,用于基于异常数据记录表,筛选在所述定位时间段内的至少一条异常记录,所述异常记录包括数据标签和错误信息;A screening abnormality record module 20, configured to screen at least one abnormality record in the positioning time period based on the abnormality data record table, the abnormality record including a data tag and error information;
获取异常落地表模块30,用于基于所述错误信息,获取所述异常记录对应的异常数据落地表;An abnormal landing table obtaining module 30, configured to obtain an abnormal data landing table corresponding to the abnormal record based on the error information;
获取数据落地表模块40,用于基于所述数据标签,获取记录所述数据标签的目标数据落地表;Obtaining data landing table module 40, configured to obtain a target data landing table recording the data tag based on the data tag;
提取字段内容模块50,用于基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,则从所述异常日志中提取至少一个指定字段对应的目标字段内容;The field content extraction module 50 is configured to query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract from the abnormal log The content of the target field corresponding to at least one specified field;
获取过滤结果模块60,用于采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,若所述过滤结果为上报处理结果,则封装所述目标字段和所述目标字段内容形成报错信息;The filter result obtaining module 60 is configured to filter the content of the target field by using preset screening rules and obtain the filtering result. If the filtering result is a report processing result, encapsulate the target field and the content of the target field to form Error message;
发送定位数据模块70,用于将所述报错信息、所述异常数据落地表和所述目标数据落地表形成辅助定位数据,将所述辅助定位数据发送给所述客户端。The positioning data sending module 70 is configured to form auxiliary positioning data from the error message, the abnormal data landing table, and the target data landing table, and send the auxiliary positioning data to the client.
优选地,该获取数据落地表模块40包括提取历史落地表单元41、获取警报状态单元 42和形成数据落地表单元43。Preferably, the data acquisition table module 40 includes a historical data acquisition table unit 41, an alarm state acquisition unit 42 and a data data acquisition table unit 43.
提取历史落地表单元41,用于基于所述数据标签查询落地信息数据表中,提取所述数据标签对应的历史数据落地表;The historical landing table extraction unit 41 is configured to query landing information data tables based on the data tags and extract the historical data landing tables corresponding to the data tags;
获取警报状态单元42,用于基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态;The alarm state obtaining unit 42 is configured to obtain the alarm state corresponding to the data tag based on the landing quantity of the historical data landing table;
形成数据落地表单元43,用于关联存储所述警报状态和所有所述历史数据落地表,形成目标数据落地表。A data landing table unit 43 is formed to store the alarm status and all the historical data landing tables in association to form a target data landing table.
优选地,该获取警报状态单元包括获取安全状态子单元、获取危险状态子单元和获取高危状态子单元。Preferably, the unit for obtaining an alarm state includes a subunit for obtaining a safe state, a subunit for obtaining a dangerous state, and a subunit for obtaining a high-risk state.
获取安全状态子单元,用于若历史数据落地表的落地数量小于第一数量阈值,则获取与数据标签相对应的警报状态为高危状态。The acquiring security status subunit is used for acquiring the alarm status corresponding to the data tag as a high-risk status if the number of landings in the historical data landing table is less than the first number threshold.
获取危险状态子单元,用于若历史数据落地表的落地数量不小于第一数量阈值,且小于第二数量阈值,则获取与数据标签相对应的警报状态为危险状态。The dangerous state obtaining subunit is used for obtaining the alarm state corresponding to the data tag as the dangerous state if the landing quantity of the historical data landing table is not less than the first quantity threshold and less than the second quantity threshold.
获取高危状态子单元,用于若历史数据落地表的落地数量不小于第二数量阈值,则获取与数据标签相对应的警报状态为安全状态。The acquiring high-risk state subunit is used to acquire the alarm state corresponding to the data tag as the safe state if the landing number of the historical data landing table is not less than the second number threshold.
优选地,该数据辅助定位装置还包括获取定时任务模块、获取修正记录模块和添加历史落地表模块。Preferably, the data-assisted positioning device further includes a module for obtaining timing tasks, a module for obtaining correction records, and a module for adding historical landing tables.
获取定时任务模块,用于获取定时任务,定时任务包括修正时间段。Obtain the timing task module, which is used to acquire the timing task, and the timing task includes the correction time period.
获取修正记录模块,用于基于数据修正记录表,获取至少一个在修正时间段内进行数据修正的修正记录,修正记录包括数据标签和异常数据落地表。The obtaining correction record module is used for obtaining at least one correction record for data correction in the correction time period based on the data correction record table, and the correction record includes a data tag and an abnormal data landing table.
添加历史落地表模块,用于基于异常数据落地表,对数据标签对应的内容进行内容检测,若内容检测为记录成功,则将异常数据落地表作为新的历史数据落地表添加到落地信息数据表中。Add the historical landing table module, which is used to detect the content corresponding to the data tag based on the abnormal data landing table. If the content detection is successful, add the abnormal data landing table as a new historical data landing table to the landing information data table in.
优选地,该提取字段内容模块包括获取接口ID单元、获取落地时间单元和获取异常日志单元。Preferably, the field content extraction module includes an interface ID acquisition unit, a landing time acquisition unit, and an exception log acquisition unit.
获取接口ID单元,用于基于数据标签对应的接入数据接口,获取接入数据接口对应的接口ID。The interface ID acquiring unit is used to acquire the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag.
获取落地时间单元,用于基于异常记录,获取数据标签对应的异常落地时间。The acquisition time unit is used to obtain the abnormal landing time corresponding to the data tag based on the abnormal record.
获取异常日志单元,用于基于接口ID在接口日志数据库中进行查询,获取与异常落地时间匹配的异常日志。The abnormal log obtaining unit is used to query the interface log database based on the interface ID to obtain the abnormal log matching the abnormal landing time.
优选地,该获取过滤结果模块包括判定符合要求单元、获取上报结果单元和获取忽略结果单元。Preferably, the filtering result obtaining module includes a unit for determining compliance, a unit for obtaining a report result, and a unit for obtaining an ignored result.
判定符合要求单元,用于采用预设的筛选规则对目标字段内容进行过滤,判断目标字段内容是否符合与指定字段相对应的报警要求。The compliant determination unit is used to filter the content of the target field using preset filtering rules, and determine whether the content of the target field meets the alarm requirements corresponding to the specified field.
获取上报结果单元,用于若目标字段内容符合与指定字段相对应的报警要求,则获取的过滤结果为上报处理结果。The report result obtaining unit is configured to, if the content of the target field meets the alarm requirement corresponding to the specified field, the obtained filtering result is the report processing result.
获取忽略结果单元,用于若目标字段内容不符合与指定字段相对应的报警要求,则获取的过滤结果为忽略提示结果。Obtaining the ignore result unit, used for if the content of the target field does not meet the alarm requirement corresponding to the specified field, the obtained filtering result is the ignore prompt result.
关于数据辅助定位装置的具体限定可以参见上文中对于数据辅助定位方法的限定,在此不再赘述。上述数据辅助定位装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。For the specific definition of the data-assisted positioning device, please refer to the above definition of the data-assisted positioning method, which will not be repeated here. Each module in the above-mentioned data-assisted positioning device can be implemented in whole or in part by software, hardware and a combination thereof. The foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
在一实施例中,提供了一种计算机设备,该计算机设备可以是服务器,其内部结构图可以如图9所示。该计算机设备包括通过***总线连接的处理器、存储器、网络接口和数 据库。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作***、计算机可读指令和数据库。该内存储器为非易失性存储介质中的操作***和计算机可读指令的运行提供环境。该计算机设备的数据库用于数据辅助定位方法相关的数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机可读指令被处理器执行时以实现一种数据辅助定位方法。In an embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. 9. The computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer readable instructions, and a database. The internal memory provides an environment for the operation of the operating system and computer-readable instructions in the non-volatile storage medium. The database of the computer equipment is used for data related to the data-assisted positioning method. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer-readable instruction is executed by the processor to realize a data-assisted positioning method.
在一实施例中,包括存储器、处理器以及存储在存储器中并可在处理器上运行的计算机可读指令,处理器执行计算机可读指令时实现如下步骤:接收客户端发送的异常数据定位请求,异常数据定位请求包括定位时间段;基于异常数据记录表,筛选在定位时间段内的至少一条异常记录,异常记录包括数据标签和错误信息;基于错误信息,获取异常记录对应的异常数据落地表;基于数据标签,获取记录数据标签的目标数据落地表;基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,则从异常日志中提取至少一个指定字段对应的目标字段内容;采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,若过滤结果为上报处理结果,则封装目标字段和目标字段内容形成报错信息;将报错信息、异常数据落地表和目标数据落地表形成辅助定位数据,将辅助定位数据发送给客户端。In an embodiment, it includes a memory, a processor, and computer-readable instructions stored in the memory and running on the processor. When the processor executes the computer-readable instructions, the following steps are implemented: receiving an abnormal data location request sent by the client , The abnormal data location request includes the location time period; based on the abnormal data record table, filter at least one abnormal record in the location time period, the abnormal record includes data tags and error information; based on the error information, obtain the abnormal data landing table corresponding to the abnormal record ; Based on the data tag, obtain the target data landing table of the recorded data tag; query the interface log database based on the access data interface corresponding to the data tag. If there is an abnormal log corresponding to the abnormal record in the interface log database, extract at least from the abnormal log The content of the target field corresponding to a specified field; filter the content of the target field using preset filtering rules to obtain the filtering result. If the filtering result is the report processing result, the target field and the content of the target field are encapsulated to form an error message; the error message, The abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
在一实施例中,基于数据标签,获取记录数据标签的目标数据落地表,处理器执行计算机可读指令时实现如下步骤:基于数据标签查询落地信息数据表中,提取数据标签对应的历史数据落地表;基于历史数据落地表的落地数量,获取与数据标签相对应的警报状态;关联存储警报状态和所有历史数据落地表,形成目标数据落地表。In one embodiment, based on the data tag, the target data landing table of the recorded data tag is obtained. When the processor executes the computer-readable instruction, the following steps are implemented: query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag Table: Based on the number of historical data landing tables, obtain the alarm status corresponding to the data label; store the alarm status and all historical data landing tables in association to form the target data landing table.
在一实施例中,基于历史数据落地表的落地数量,获取与数据标签相对应的警报状态,处理器执行计算机可读指令时实现如下步骤:若历史数据落地表的落地数量小于第一数量阈值,则获取与数据标签相对应的警报状态为高危状态;若历史数据落地表的落地数量不小于第一数量阈值,且小于第二数量阈值,则获取与数据标签相对应的警报状态为危险状态;若历史数据落地表的落地数量不小于第二数量阈值,则获取与数据标签相对应的警报状态为安全状态。In one embodiment, based on the landing quantity of the historical data landing table, the alarm status corresponding to the data tag is obtained, and the processor executes the following steps when executing the computer-readable instruction: if the landing quantity of the historical data landing table is less than the first quantity threshold , The alarm state corresponding to the data tag is obtained as a high-risk state; if the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, then the alarm state corresponding to the data tag is obtained as a dangerous state ; If the landing number of the historical data landing table is not less than the second number threshold, then the alarm state corresponding to the data tag is acquired as a safe state.
在一实施例中,在将辅助定位数据发送给客户端之后,处理器执行计算机可读指令时还实现如下步骤:获取定时任务,定时任务包括修正时间段;基于数据修正记录表,获取至少一个在修正时间段内进行数据修正的修正记录,修正记录包括数据标签和异常数据落地表;基于异常数据落地表,对数据标签对应的内容进行内容检测,若内容检测为记录成功,则将异常数据落地表作为新的历史数据落地表添加到落地信息数据表中。In one embodiment, after sending the auxiliary positioning data to the client, the processor further implements the following steps when executing the computer-readable instructions: obtaining a timed task, the timed task includes a correction time period; and obtaining at least one time period based on the data correction record table Perform data correction correction records during the correction time period. The correction records include data tags and abnormal data landing tables; based on the abnormal data landing tables, the content corresponding to the data tags is checked. If the content detection is successful, the abnormal data The landing table is added to the landing information data table as a new historical data landing table.
在一实施例中,基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,处理器执行计算机可读指令时实现如下步骤:基于数据标签对应的接入数据接口,获取接入数据接口对应的接口ID;基于异常记录,获取数据标签对应的异常落地时间;基于接口ID在接口日志数据库中进行查询,获取与异常落地时间匹配的异常日志。In one embodiment, the interface log database is queried based on the access data interface corresponding to the data tag. If there is an abnormal log corresponding to the abnormal record in the interface log database, the processor executes the following steps when executing the computer-readable instruction: corresponding based on the data tag Obtain the interface ID corresponding to the access data interface; obtain the abnormal landing time corresponding to the data tag based on the abnormal record; query the interface log database based on the interface ID to obtain the abnormal log matching the abnormal landing time.
在一实施例中,采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,处理器执行计算机可读指令时实现如下步骤:采用预设的筛选规则对目标字段内容进行过滤,判断目标字段内容是否符合与指定字段相对应的报警要求;若目标字段内容符合与指定字段相对应的报警要求,则获取的过滤结果为上报处理结果;若目标字段内容不符合与指定字段相对应的报警要求,则获取的过滤结果为忽略提示结果。In one embodiment, the content of the target field is filtered using a preset filtering rule to obtain the filtering result. When the processor executes a computer-readable instruction, the following steps are implemented: filtering the content of the target field using the preset filtering rule to determine the target Whether the content of the field meets the alarm requirements corresponding to the specified field; if the content of the target field meets the alarm requirements corresponding to the specified field, the obtained filtering result is the report processing result; if the content of the target field does not meet the alarm corresponding to the specified field If required, the obtained filtering result is the result of ignoring the prompt.
在一实施例中,一个或多个存储有计算机可读指令的非易失性可读存储介质,计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行如下步骤:接收客户端发送的异常数据定位请求,异常数据定位请求包括定位时间段;基于异常数据记录表,筛选在定位时间段内的至少一条异常记录,异常记录包括数据标签和错误信息;基于错误信 息,获取异常记录对应的异常数据落地表;基于数据标签,获取记录数据标签的目标数据落地表;基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,则从异常日志中提取至少一个指定字段对应的目标字段内容;采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,若过滤结果为上报处理结果,则封装目标字段和目标字段内容形成报错信息;将报错信息、异常数据落地表和目标数据落地表形成辅助定位数据,将辅助定位数据发送给客户端。In an embodiment, one or more non-volatile readable storage media storing computer readable instructions, when the computer readable instructions are executed by one or more processors, cause the one or more processors to perform the following steps : Receive the abnormal data location request sent by the client, the abnormal data location request includes the location time period; based on the abnormal data record table, filter at least one abnormal record in the location time period, the abnormal record includes data tags and error information; based on the error information , Obtain the abnormal data landing table corresponding to the abnormal record; Based on the data tag, obtain the target data landing table of the recorded data tag; query the interface log database based on the access data interface corresponding to the data tag, if there is a corresponding abnormal record in the interface log database Exception log, extract the target field content corresponding to at least one specified field from the exception log; filter the target field content using preset filtering rules to obtain the filtering result, if the filtering result is the report processing result, encapsulate the target field and target The field content forms the error message; the error message, the abnormal data landing table and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
在一实施例中,基于数据标签,获取记录数据标签的目标数据落地表,使得一个或多个处理器执行如下步骤:基于数据标签查询落地信息数据表中,提取数据标签对应的历史数据落地表;基于历史数据落地表的落地数量,获取与数据标签相对应的警报状态;关联存储警报状态和所有历史数据落地表,形成目标数据落地表。In one embodiment, based on the data tag, the target data landing table of the recorded data tag is acquired, so that one or more processors perform the following steps: query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag ; Based on the number of historical data landing tables, obtain the alarm status corresponding to the data tag; store the alarm status and all historical data landing tables in association to form the target data landing table.
在一实施例中,基于历史数据落地表的落地数量,获取与数据标签相对应的警报状态,使得一个或多个处理器执行如下步骤:若历史数据落地表的落地数量小于第一数量阈值,则获取与数据标签相对应的警报状态为高危状态;若历史数据落地表的落地数量不小于第一数量阈值,且小于第二数量阈值,则获取与数据标签相对应的警报状态为危险状态;若历史数据落地表的落地数量不小于第二数量阈值,则获取与数据标签相对应的警报状态为安全状态。In one embodiment, based on the landing number of the historical data landing table, the alarm status corresponding to the data tag is obtained, so that one or more processors execute the following steps: if the landing number of the historical data landing table is less than the first number threshold, Obtain the alarm state corresponding to the data tag as a high-risk state; if the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, then the alarm state corresponding to the data tag is obtained as a dangerous state; If the landing number of the historical data landing table is not less than the second number threshold, the alarm state corresponding to the data tag is acquired as a safe state.
在一实施例中,在将辅助定位数据发送给客户端之后,使得一个或多个处理器还执行如下步骤:获取定时任务,定时任务包括修正时间段;基于数据修正记录表,获取至少一个在修正时间段内进行数据修正的修正记录,修正记录包括数据标签和异常数据落地表;基于异常数据落地表,对数据标签对应的内容进行内容检测,若内容检测为记录成功,则将异常数据落地表作为新的历史数据落地表添加到落地信息数据表中。In one embodiment, after the auxiliary positioning data is sent to the client, one or more processors are caused to perform the following steps: obtain a timed task, the timed task includes a correction time period; based on the data correction record table, obtain at least one Correction records for data correction during the correction period. The correction records include data tags and abnormal data landing tables; based on the abnormal data landing tables, the content corresponding to the data tags is checked. If the content detection is successful, the abnormal data will be dropped. The table is added as a new historical data landing table to the landing information data table.
在一实施例中,基于数据标签对应的接入数据接口查询接口日志数据库,若在接口日志数据库存在与异常记录对应的异常日志,使得一个或多个处理器执行如下步骤:基于数据标签对应的接入数据接口,获取接入数据接口对应的接口ID;基于异常记录,获取数据标签对应的异常落地时间;基于接口ID在接口日志数据库中进行查询,获取与异常落地时间匹配的异常日志。In one embodiment, the interface log database is queried based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, one or more processors perform the following steps: Access the data interface to obtain the interface ID corresponding to the access data interface; obtain the abnormal landing time corresponding to the data tag based on the abnormal record; query the interface log database based on the interface ID to obtain the abnormal log matching the abnormal landing time.
在一实施例中,采用预设的筛选规则对目标字段内容进行过滤,获取过滤结果,使得一个或多个处理器执行如下步骤:采用预设的筛选规则对目标字段内容进行过滤,判断目标字段内容是否符合与指定字段相对应的报警要求;若目标字段内容符合与指定字段相对应的报警要求,则获取的过滤结果为上报处理结果;若目标字段内容不符合与指定字段相对应的报警要求,则获取的过滤结果为忽略提示结果。In one embodiment, the content of the target field is filtered using a preset filtering rule to obtain the filtering result, so that one or more processors perform the following steps: filtering the content of the target field using the preset filtering rule to determine the target field Whether the content meets the alarm requirement corresponding to the specified field; if the content of the target field meets the alarm requirement corresponding to the specified field, the obtained filtering result is the report processing result; if the content of the target field does not meet the alarm requirement corresponding to the specified field , The obtained filtering result is the ignore prompt result.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机可读指令来指令相关的硬件来完成,该计算机可读指令可存储于一非易失性计算机可读取存储介质中,该计算机可读指令在执行时,可包括如上述各方法的实施例的流程。其中,本申请各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through computer-readable instructions. The computer-readable instructions can be stored in a non-volatile computer readable. In the storage medium, when the computer-readable instructions are executed, they may include the procedures of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database, or other media used in each embodiment of the present application may include non-volatile and/or volatile memory. Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上 描述的全部或者部分功能。Those skilled in the art can clearly understand that for the convenience and conciseness of description, only the division of the above-mentioned functional units and modules is used as an example. In practical applications, the above-mentioned functions can be allocated to different functional units and modules as required. Module completion means dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above.
以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。The above embodiments are only used to illustrate the technical solutions of the application, but not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still compare the previous embodiments. The recorded technical solutions are modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and shall be included in the application Within the scope of protection.

Claims (20)

  1. 一种数据辅助定位方法,其特征在于,包括:A data-assisted positioning method is characterized in that it includes:
    接收客户端发送的异常数据定位请求,所述异常数据定位请求包括定位时间段;Receiving an abnormal data location request sent by the client, where the abnormal data location request includes a location time period;
    基于异常数据记录表,筛选在所述定位时间段内的至少一条异常记录,所述异常记录包括数据标签和错误信息;Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, the abnormal record including a data tag and error information;
    基于所述错误信息,获取所述异常记录对应的异常数据落地表;Based on the error information, obtain an abnormal data landing table corresponding to the abnormal record;
    基于所述数据标签,获取记录所述数据标签的目标数据落地表;Based on the data tag, acquiring a target data landing table that records the data tag;
    基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,则从所述异常日志中提取至少一个指定字段对应的目标字段内容;Query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field corresponding to at least one specified field from the abnormal log content;
    采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,若所述过滤结果为上报处理结果,则封装所述目标字段和所述目标字段内容形成报错信息;Filtering the content of the target field using a preset filtering rule to obtain a filtering result, and if the filtering result is a report processing result, encapsulating the target field and the content of the target field to form error information;
    将所述报错信息、所述异常数据落地表和所述目标数据落地表形成辅助定位数据,将所述辅助定位数据发送给所述客户端。The error message, the abnormal data landing table, and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
  2. 如权利要求1所述的数据辅助定位方法,其特征在于,所述基于所述数据标签,获取记录所述数据标签的目标数据落地表,包括:The data-assisted positioning method according to claim 1, wherein the acquiring and recording the target data landing table of the data tag based on the data tag comprises:
    基于所述数据标签查询落地信息数据表中,提取所述数据标签对应的历史数据落地表;Query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag;
    基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态;Obtain the alarm status corresponding to the data tag based on the landing number of the historical data landing table;
    关联存储所述警报状态和所有所述历史数据落地表,形成目标数据落地表。The alarm state and all the historical data landing tables are associated and stored to form a target data landing table.
  3. 如权利要求2所述的数据辅助定位方法,其特征在于,所述基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态,包括:The data-assisted positioning method according to claim 2, wherein the obtaining the alarm status corresponding to the data tag based on the landing count of the historical data landing table comprises:
    若所述历史数据落地表的落地数量小于第一数量阈值,则获取与所述数据标签相对应的警报状态为高危状态;If the landing quantity of the historical data landing table is less than the first quantity threshold, acquiring the alarm state corresponding to the data tag is a high-risk state;
    若所述历史数据落地表的落地数量不小于所述第一数量阈值,且小于第二数量阈值,则获取与所述数据标签相对应的警报状态为危险状态;If the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, acquiring the alarm state corresponding to the data tag as a dangerous state;
    若所述历史数据落地表的落地数量不小于所述第二数量阈值,则获取与所述数据标签相对应的警报状态为安全状态。If the landing quantity of the historical data landing table is not less than the second quantity threshold, the alarm state corresponding to the data tag is acquired as a safe state.
  4. 如权利要求2所述的数据辅助定位方法,其特征在于,在所述将所述辅助定位数据发送给所述客户端之后,所述数据辅助定位方法还包括:The data-assisted positioning method according to claim 2, wherein after said sending the auxiliary positioning data to the client, the data-assisted positioning method further comprises:
    获取定时任务,所述定时任务包括修正时间段;Acquiring a timing task, where the timing task includes a correction time period;
    基于数据修正记录表,获取至少一个在所述修正时间段内进行数据修正的修正记录,所述修正记录包括数据标签和异常数据落地表;Based on the data correction record table, acquiring at least one correction record for data correction within the correction time period, the correction record including a data tag and an abnormal data landing table;
    基于所述异常数据落地表,对所述数据标签对应的内容进行内容检测,若内容检测为记录成功,则将所述异常数据落地表作为新的历史数据落地表添加到所述落地信息数据表中。Based on the abnormal data landing table, content detection is performed on the content corresponding to the data tag, and if the content detection is successful, the abnormal data landing table is added to the landing information data table as a new historical data landing table in.
  5. 如权利要求1所述的数据辅助定位方法,其特征在于,所述基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,包括:The data-assisted positioning method of claim 1, wherein the interface log database is queried based on the access data interface corresponding to the data tag, and if there is an abnormality corresponding to the abnormal record in the interface log database Log, including:
    基于所述数据标签对应的接入数据接口,获取所述接入数据接口对应的接口ID;Obtaining the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag;
    基于所述异常记录,获取所述数据标签对应的异常落地时间;Based on the abnormal record, obtain the abnormal landing time corresponding to the data tag;
    基于所述接口ID在所述接口日志数据库中进行查询,获取与所述异常落地时间匹配的异常日志。Query in the interface log database based on the interface ID, and obtain an abnormal log matching the abnormal landing time.
  6. 如权利要求1所述的数据辅助定位方法,其特征在于,所述采用预设的筛选规则对 所述目标字段内容进行过滤,获取过滤结果,包括:The data-assisted positioning method according to claim 1, wherein the filtering the content of the target field using a preset filtering rule to obtain the filtering result comprises:
    采用预设的筛选规则对所述目标字段内容进行过滤,判断所述目标字段内容是否符合与所述指定字段相对应的报警要求;Filtering the content of the target field using a preset filtering rule, and determining whether the content of the target field meets the alarm requirement corresponding to the designated field;
    若所述目标字段内容符合与所述指定字段相对应的报警要求,则获取的所述过滤结果为上报处理结果;If the content of the target field meets the alarm requirement corresponding to the designated field, the obtained filtering result is the report processing result;
    若所述目标字段内容不符合与所述指定字段相对应的报警要求,则获取的所述过滤结果为忽略提示结果。If the content of the target field does not meet the alarm requirement corresponding to the designated field, the obtained filtering result is an ignore prompt result.
  7. 一种数据辅助定位装置,其特征在于,包括:A data-assisted positioning device, characterized in that it comprises:
    接收定位请求模块,用于接收客户端发送的异常数据定位请求,所述异常数据定位请求包括定位时间段;A positioning request receiving module, configured to receive an abnormal data positioning request sent by a client, where the abnormal data positioning request includes a positioning time period;
    筛选异常记录模块,用于基于异常数据记录表,筛选在所述定位时间段内的至少一条异常记录,所述异常记录包括数据标签和错误信息;A screening abnormal record module, configured to screen at least one abnormal record in the positioning time period based on the abnormal data record table, the abnormal record including a data tag and error information;
    获取异常落地表模块,用于基于所述错误信息,获取所述异常记录对应的异常数据落地表;An abnormal landing table acquiring module, configured to obtain an abnormal data landing table corresponding to the abnormal record based on the error information;
    获取数据落地表模块,用于基于所述数据标签,获取记录所述数据标签的目标数据落地表;An acquiring data landing table module, configured to obtain a target data landing table that records the data tag based on the data tag;
    提取字段内容模块,用于基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,则从所述异常日志中提取至少一个指定字段对应的目标字段内容;The field content extraction module is used to query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract at least from the abnormal log The content of the target field corresponding to a specified field;
    获取过滤结果模块,用于采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,若所述过滤结果为上报处理结果,则封装所述目标字段和所述目标字段内容形成报错信息;The filter result obtaining module is used to filter the content of the target field using preset screening rules to obtain the filter result. If the filter result is a report processing result, encapsulate the target field and the content of the target field to form an error report information;
    发送定位数据模块,用于将所述报错信息、所述异常数据落地表和所述目标数据落地表形成辅助定位数据,将所述辅助定位数据发送给所述客户端。The positioning data sending module is used to form auxiliary positioning data from the error message, the abnormal data landing table and the target data landing table, and to send the auxiliary positioning data to the client.
  8. 如权利要求7所述的数据辅助定位装置,其特征在于,所述获取数据落地表模块,包括:7. The data-assisted positioning device according to claim 7, wherein the module for acquiring data landing table comprises:
    提取历史落地表单元,用于基于所述数据标签查询落地信息数据表中,提取所述数据标签对应的历史数据落地表;An extracting historical landing table unit for querying landing information data tables based on the data tags and extracting the historical data landing tables corresponding to the data tags;
    获取警报状态单元,用于基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态;An obtaining alarm state unit, configured to obtain an alarm state corresponding to the data tag based on the landing number of the historical data landing table;
    形成数据落地表单元,用于关联存储所述警报状态和所有所述历史数据落地表,形成目标数据落地表。A data landing table unit is formed to store the alarm status and all the historical data landing tables in association to form a target data landing table.
  9. 一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现如下步骤:A computer device comprising a memory, a processor, and computer-readable instructions stored in the memory and capable of running on the processor, wherein the processor executes the computer-readable instructions as follows step:
    接收客户端发送的异常数据定位请求,所述异常数据定位请求包括定位时间段;Receiving an abnormal data location request sent by the client, where the abnormal data location request includes a location time period;
    基于异常数据记录表,筛选在所述定位时间段内的至少一条异常记录,所述异常记录包括数据标签和错误信息;Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, the abnormal record including a data tag and error information;
    基于所述错误信息,获取所述异常记录对应的异常数据落地表;Based on the error information, obtain an abnormal data landing table corresponding to the abnormal record;
    基于所述数据标签,获取记录所述数据标签的目标数据落地表;Based on the data tag, acquiring a target data landing table that records the data tag;
    基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,则从所述异常日志中提取至少一个指定字段对应的目标字段内容;Query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field corresponding to at least one specified field from the abnormal log content;
    采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,若所述过滤结果为上报处理结果,则封装所述目标字段和所述目标字段内容形成报错信息;Filtering the content of the target field using a preset filtering rule to obtain a filtering result, and if the filtering result is a report processing result, encapsulating the target field and the content of the target field to form error information;
    将所述报错信息、所述异常数据落地表和所述目标数据落地表形成辅助定位数据,将所述辅助定位数据发送给所述客户端。The error message, the abnormal data landing table, and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
  10. 如权利要求9所述的计算机设备,其特征在于,所述基于所述数据标签,获取记录所述数据标签的目标数据落地表,所述处理器执行所述计算机可读指令时实现如下步骤:9. The computer device according to claim 9, wherein the data tag is based on the data tag to obtain a target data landing table that records the data tag, and the processor executes the following steps when the computer readable instruction is executed:
    基于所述数据标签查询落地信息数据表中,提取所述数据标签对应的历史数据落地表;Query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag;
    基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态;Obtain the alarm status corresponding to the data tag based on the landing number of the historical data landing table;
    关联存储所述警报状态和所有所述历史数据落地表,形成目标数据落地表。The alarm state and all the historical data landing tables are associated and stored to form a target data landing table.
  11. 如权利要求10所述的计算机设备,其特征在于,所述基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态,所述处理器执行所述计算机可读指令时实现如下步骤:The computer device according to claim 10, wherein the alarm status corresponding to the data tag is acquired based on the number of landings in the historical data landing table, and the processor executes the computer-readable instruction When implementing the following steps:
    若所述历史数据落地表的落地数量小于第一数量阈值,则获取与所述数据标签相对应的警报状态为高危状态;If the landing quantity of the historical data landing table is less than the first quantity threshold, acquiring the alarm state corresponding to the data tag is a high-risk state;
    若所述历史数据落地表的落地数量不小于所述第一数量阈值,且小于第二数量阈值,则获取与所述数据标签相对应的警报状态为危险状态;If the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, acquiring the alarm state corresponding to the data tag as a dangerous state;
    若所述历史数据落地表的落地数量不小于所述第二数量阈值,则获取与所述数据标签相对应的警报状态为安全状态。If the landing quantity of the historical data landing table is not less than the second quantity threshold, the alarm state corresponding to the data tag is acquired as a safe state.
  12. 如权利要求10所述的计算机设备,其特征在于,在所述将所述辅助定位数据发送给所述客户端之后,所述处理器执行所述计算机可读指令时还实现如下步骤:10. The computer device according to claim 10, wherein after said sending said auxiliary positioning data to said client, said processor further implements the following steps when executing said computer-readable instruction:
    获取定时任务,所述定时任务包括修正时间段;Acquiring a timing task, where the timing task includes a correction time period;
    基于数据修正记录表,获取至少一个在所述修正时间段内进行数据修正的修正记录,所述修正记录包括数据标签和异常数据落地表;Based on the data correction record table, acquiring at least one correction record for data correction within the correction time period, the correction record including a data tag and an abnormal data landing table;
    基于所述异常数据落地表,对所述数据标签对应的内容进行内容检测,若内容检测为记录成功,则将所述异常数据落地表作为新的历史数据落地表添加到所述落地信息数据表中。Based on the abnormal data landing table, content detection is performed on the content corresponding to the data tag, and if the content detection is successful, the abnormal data landing table is added to the landing information data table as a new historical data landing table in.
  13. 如权利要求9所述的计算机设备,其特征在于,所述基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,所述处理器执行所述计算机可读指令时实现如下步骤:The computer device according to claim 9, wherein the query interface log database is based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, When the processor executes the computer-readable instructions, the following steps are implemented:
    基于所述数据标签对应的接入数据接口,获取所述接入数据接口对应的接口ID;Obtaining the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag;
    基于所述异常记录,获取所述数据标签对应的异常落地时间;Based on the abnormal record, obtain the abnormal landing time corresponding to the data tag;
    基于所述接口ID在所述接口日志数据库中进行查询,获取与所述异常落地时间匹配的异常日志。Query in the interface log database based on the interface ID, and obtain an abnormal log matching the abnormal landing time.
  14. 如权利要求9所述的计算机设备,其特征在于,所述采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,所述处理器执行所述计算机可读指令时实现如下步骤:The computer device according to claim 9, wherein the content of the target field is filtered using a preset filtering rule to obtain a filtering result, and the processor executes the following steps when executing the computer-readable instruction :
    采用预设的筛选规则对所述目标字段内容进行过滤,判断所述目标字段内容是否符合与所述指定字段相对应的报警要求;Filtering the content of the target field using a preset filtering rule, and determining whether the content of the target field meets the alarm requirement corresponding to the designated field;
    若所述目标字段内容符合与所述指定字段相对应的报警要求,则获取的所述过滤结果为上报处理结果;If the content of the target field meets the alarm requirement corresponding to the designated field, the obtained filtering result is the report processing result;
    若所述目标字段内容不符合与所述指定字段相对应的报警要求,则获取的所述过滤结果为忽略提示结果。If the content of the target field does not meet the alarm requirement corresponding to the designated field, the obtained filtering result is an ignore prompt result.
  15. 一个或多个存储有计算机可读指令的非易失性可读存储介质,其特征在于,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:One or more non-volatile readable storage media storing computer readable instructions, wherein when the computer readable instructions are executed by one or more processors, the one or more processors execute The following steps:
    接收客户端发送的异常数据定位请求,所述异常数据定位请求包括定位时间段;Receiving an abnormal data location request sent by the client, where the abnormal data location request includes a location time period;
    基于异常数据记录表,筛选在所述定位时间段内的至少一条异常记录,所述异常记录包括数据标签和错误信息;Based on the abnormal data record table, filter at least one abnormal record in the positioning time period, the abnormal record including a data tag and error information;
    基于所述错误信息,获取所述异常记录对应的异常数据落地表;Based on the error information, obtain an abnormal data landing table corresponding to the abnormal record;
    基于所述数据标签,获取记录所述数据标签的目标数据落地表;Based on the data tag, acquiring a target data landing table that records the data tag;
    基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,则从所述异常日志中提取至少一个指定字段对应的目标字段内容;Query the interface log database based on the access data interface corresponding to the data tag, and if there is an abnormal log corresponding to the abnormal record in the interface log database, extract the target field corresponding to at least one specified field from the abnormal log content;
    采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,若所述过滤结果为上报处理结果,则封装所述目标字段和所述目标字段内容形成报错信息;Filtering the content of the target field using a preset filtering rule to obtain a filtering result, and if the filtering result is a report processing result, encapsulating the target field and the content of the target field to form error information;
    将所述报错信息、所述异常数据落地表和所述目标数据落地表形成辅助定位数据,将所述辅助定位数据发送给所述客户端。The error message, the abnormal data landing table, and the target data landing table form auxiliary positioning data, and the auxiliary positioning data is sent to the client.
  16. 如权利要求15所述的非易失性可读存储介质,其特征在于,所述基于所述数据标签,获取记录所述数据标签的目标数据落地表,使得所述一个或多个处理器执行如下步骤:The non-volatile readable storage medium according to claim 15, wherein the target data landing table that records the data tag is obtained based on the data tag, so that the one or more processors execute The following steps:
    基于所述数据标签查询落地信息数据表中,提取所述数据标签对应的历史数据落地表;Query the landing information data table based on the data tag, and extract the historical data landing table corresponding to the data tag;
    基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态;Obtain the alarm status corresponding to the data tag based on the landing number of the historical data landing table;
    关联存储所述警报状态和所有所述历史数据落地表,形成目标数据落地表。The alarm state and all the historical data landing tables are associated and stored to form a target data landing table.
  17. 如权利要求16所述的非易失性可读存储介质,其特征在于,所述基于所述历史数据落地表的落地数量,获取与所述数据标签相对应的警报状态,使得所述一个或多个处理器执行如下步骤:The non-volatile readable storage medium according to claim 16, wherein the alarm status corresponding to the data tag is obtained based on the number of landings of the historical data landing table, so that the one or Multiple processors perform the following steps:
    若所述历史数据落地表的落地数量小于第一数量阈值,则获取与所述数据标签相对应的警报状态为高危状态;If the landing quantity of the historical data landing table is less than the first quantity threshold, acquiring the alarm state corresponding to the data tag is a high-risk state;
    若所述历史数据落地表的落地数量不小于所述第一数量阈值,且小于第二数量阈值,则获取与所述数据标签相对应的警报状态为危险状态;If the landing number of the historical data landing table is not less than the first number threshold and less than the second number threshold, acquiring the alarm state corresponding to the data tag as a dangerous state;
    若所述历史数据落地表的落地数量不小于所述第二数量阈值,则获取与所述数据标签相对应的警报状态为安全状态。If the landing quantity of the historical data landing table is not less than the second quantity threshold, the alarm state corresponding to the data tag is acquired as a safe state.
  18. 如权利要求16所述的非易失性可读存储介质,其特征在于,在所述将所述辅助定位数据发送给所述客户端之后,使得所述一个或多个处理器还执行如下步骤:The non-volatile readable storage medium according to claim 16, wherein after the sending of the auxiliary positioning data to the client, the one or more processors are caused to further execute the following steps :
    获取定时任务,所述定时任务包括修正时间段;Acquiring a timing task, where the timing task includes a correction time period;
    基于数据修正记录表,获取至少一个在所述修正时间段内进行数据修正的修正记录,所述修正记录包括数据标签和异常数据落地表;Based on the data correction record table, acquiring at least one correction record for data correction within the correction time period, the correction record including a data tag and an abnormal data landing table;
    基于所述异常数据落地表,对所述数据标签对应的内容进行内容检测,若内容检测为记录成功,则将所述异常数据落地表作为新的历史数据落地表添加到所述落地信息数据表中。Based on the abnormal data landing table, content detection is performed on the content corresponding to the data tag, and if the content detection is successful, the abnormal data landing table is added to the landing information data table as a new historical data landing table in.
  19. 如权利要求15所述的非易失性可读存储介质,其特征在于,所述基于所述数据标签对应的接入数据接口查询接口日志数据库,若在所述接口日志数据库存在与所述异常记录对应的异常日志,使得所述一个或多个处理器执行如下步骤:The non-volatile readable storage medium according to claim 15, wherein the interface log database is queried based on the access data interface corresponding to the data tag, and if there is an abnormality in the interface log database, Record the corresponding exception log, so that the one or more processors execute the following steps:
    基于所述数据标签对应的接入数据接口,获取所述接入数据接口对应的接口ID;Obtaining the interface ID corresponding to the access data interface based on the access data interface corresponding to the data tag;
    基于所述异常记录,获取所述数据标签对应的异常落地时间;Based on the abnormal record, obtain the abnormal landing time corresponding to the data tag;
    基于所述接口ID在所述接口日志数据库中进行查询,获取与所述异常落地时间匹配的异常日志。Query in the interface log database based on the interface ID, and obtain an abnormal log matching the abnormal landing time.
  20. 如权利要求15所述的非易失性可读存储介质,其特征在于,所述采用预设的筛选规则对所述目标字段内容进行过滤,获取过滤结果,使得所述一个或多个处理器执行如下步骤:The non-volatile readable storage medium according to claim 15, wherein the content of the target field is filtered using a preset filtering rule to obtain the filtering result, so that the one or more processors Perform the following steps:
    采用预设的筛选规则对所述目标字段内容进行过滤,判断所述目标字段内容是否符合 与所述指定字段相对应的报警要求;Filtering the content of the target field using a preset filtering rule, and determining whether the content of the target field meets the alarm requirement corresponding to the specified field;
    若所述目标字段内容符合与所述指定字段相对应的报警要求,则获取的所述过滤结果为上报处理结果;If the content of the target field meets the alarm requirement corresponding to the designated field, the obtained filtering result is the report processing result;
    若所述目标字段内容不符合与所述指定字段相对应的报警要求,则获取的所述过滤结果为忽略提示结果。If the content of the target field does not meet the alarm requirement corresponding to the designated field, the obtained filtering result is an ignore prompt result.
PCT/CN2019/101899 2019-04-26 2019-08-22 Auxiliary data locating method and device, computer device and storage medium WO2020215543A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910346057.X 2019-04-26
CN201910346057.XA CN110162420B (en) 2019-04-26 2019-04-26 Data auxiliary positioning method and device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2020215543A1 true WO2020215543A1 (en) 2020-10-29

Family

ID=67640144

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/101899 WO2020215543A1 (en) 2019-04-26 2019-08-22 Auxiliary data locating method and device, computer device and storage medium

Country Status (2)

Country Link
CN (1) CN110162420B (en)
WO (1) WO2020215543A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110781231B (en) * 2019-09-19 2023-07-21 平安科技(深圳)有限公司 Database-based batch import method, device, equipment and storage medium
CN111104480A (en) * 2019-11-30 2020-05-05 广东新瑞世纪科技有限公司 Innovative AI intelligent text processing system
CN111190906B (en) * 2019-12-31 2023-06-20 全球能源互联网研究院有限公司 Sensor network data anomaly detection method
CN111666491B (en) * 2020-04-28 2024-05-03 平安科技(深圳)有限公司 Abnormal data query method, device, computer equipment and storage medium
CN111782728B (en) * 2020-06-30 2024-02-02 北京金山云网络技术有限公司 Data synchronization method, device, electronic equipment and medium
CN113761015B (en) * 2020-10-22 2023-09-05 北京京东振世信息技术有限公司 Log processing method, device, system and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0357573B1 (en) * 1988-08-31 1995-09-13 International Business Machines Corporation Input/output device service alert function
CN105868036A (en) * 2015-12-14 2016-08-17 乐视网信息技术(北京)股份有限公司 Exception determination method and apparatus
CN108011752A (en) * 2017-11-21 2018-05-08 江苏天联信息科技发展有限公司 Fault locating analysis method and device, computer-readable recording medium
CN108880847A (en) * 2017-05-16 2018-11-23 北京微影时代科技有限公司 A kind of method and device of positioning failure
CN109522206A (en) * 2018-09-26 2019-03-26 平安科技(深圳)有限公司 Abnormal data localization method, device, computer equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8156084B2 (en) * 2008-01-17 2012-04-10 International Business Machines Corporation Transfer of data from positional data sources to partitioned databases in restartable environments
CN108920364A (en) * 2018-06-21 2018-11-30 深圳壹账通智能科技有限公司 Software defect positioning method, device, terminal and computer readable storage medium
CN109325865B (en) * 2018-08-13 2023-10-27 中国平安人寿保险股份有限公司 Exception handling method, exception handling device, computer equipment and storage medium
CN109359026A (en) * 2018-08-15 2019-02-19 中国平安人寿保险股份有限公司 Log reporting method, device, electronic equipment and computer readable storage medium
CN109634818A (en) * 2018-10-24 2019-04-16 中国平安人寿保险股份有限公司 Log analysis method, system, terminal and computer readable storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0357573B1 (en) * 1988-08-31 1995-09-13 International Business Machines Corporation Input/output device service alert function
CN105868036A (en) * 2015-12-14 2016-08-17 乐视网信息技术(北京)股份有限公司 Exception determination method and apparatus
CN108880847A (en) * 2017-05-16 2018-11-23 北京微影时代科技有限公司 A kind of method and device of positioning failure
CN108011752A (en) * 2017-11-21 2018-05-08 江苏天联信息科技发展有限公司 Fault locating analysis method and device, computer-readable recording medium
CN109522206A (en) * 2018-09-26 2019-03-26 平安科技(深圳)有限公司 Abnormal data localization method, device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN110162420A (en) 2019-08-23
CN110162420B (en) 2022-10-11

Similar Documents

Publication Publication Date Title
WO2020215543A1 (en) Auxiliary data locating method and device, computer device and storage medium
WO2020119434A1 (en) Method and apparatus for interface data processing, method and apparatus for automated testing, device, and medium
WO2021169270A1 (en) Server fault pre-warning method, device, computer apparatus, and storage medium
US10073683B2 (en) System and method for providing software build violation detection and self-healing
WO2018045756A1 (en) Fault localization platform, fault localization method and device
CN112910945A (en) Request link tracking method and service request processing method
WO2021218178A1 (en) Automatic report generation method, device, computer apparatus, and storage medium
CN110489310B (en) Method and device for recording user operation, storage medium and computer equipment
CN108038039B (en) Method for recording log and micro-service system
WO2020253741A1 (en) Method and device for checking status of manual client by using error samples
US11966412B2 (en) Blockchain data processing method and apparatus, device, and readable storage medium
CN110175099B (en) Interface change prompting method and device, computer equipment and storage medium
CN111611009A (en) Database script management method and device, computer equipment and storage medium
WO2019047565A1 (en) Task processing method, device, computer device, and storage medium
CN110716878A (en) Automatic interface testing method, device and system
WO2019104891A1 (en) Method and device for importing and exporting report, storage medium, and terminal
CN110737594A (en) Database standard conformance testing method and device for automatically generating test cases
CN112306833A (en) Application program crash statistical method and device, computer equipment and storage medium
WO2020211233A1 (en) Method and device for batch data editing, computer device, and storage medium
US20190377762A1 (en) Systems and methods for improved transactional mainframes
CN113886590A (en) Data summarizing method and device, computer equipment and storage medium
CN107301125B (en) Method and device for searching root error and electronic equipment
CN113609230A (en) Data synchronization abnormity warning method and device, computer equipment and storage medium
CN113760491A (en) Task scheduling system, method, equipment and storage medium
WO2020253044A1 (en) Service configuration method and apparatus, and computer device and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19925909

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19925909

Country of ref document: EP

Kind code of ref document: A1