WO2021013058A1 - Exception prompting method, apparatus, system and device for big data product, and medium - Google Patents

Exception prompting method, apparatus, system and device for big data product, and medium Download PDF

Info

Publication number
WO2021013058A1
WO2021013058A1 PCT/CN2020/102541 CN2020102541W WO2021013058A1 WO 2021013058 A1 WO2021013058 A1 WO 2021013058A1 CN 2020102541 W CN2020102541 W CN 2020102541W WO 2021013058 A1 WO2021013058 A1 WO 2021013058A1
Authority
WO
WIPO (PCT)
Prior art keywords
error code
error
abnormality
big data
information
Prior art date
Application number
PCT/CN2020/102541
Other languages
French (fr)
Chinese (zh)
Inventor
尹强
刘有
王和平
黄山
杨峙岳
邸帅
卢道和
Original Assignee
深圳前海微众银行股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海微众银行股份有限公司 filed Critical 深圳前海微众银行股份有限公司
Publication of WO2021013058A1 publication Critical patent/WO2021013058A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3065Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3086Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves the use of self describing data formats, i.e. metadata, markup languages, human readable formats
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/32Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/321Display for diagnostics, e.g. diagnostic result display, self-test user interface

Definitions

  • This application relates to the field of big data technology of financial technology (Fintech), and in particular to abnormal notification methods, devices, systems, equipment and media of big data products.
  • Java Exception carries a long list of exception stack information. This error reporting method is more complicated for operation and maintenance personnel who are new to big data products, and even operation and maintenance personnel with a certain big data product foundation need to spend a long time. In order to understand the cause of the abnormality, obviously, the existing abnormal prompting method takes a long time to locate and solve the problem, and the efficiency is relatively low.
  • This application proposes an abnormal prompting method, device, system, equipment and medium for big data products, which aims to solve the inconvenience of operation and maintenance personnel to view due to the complicated and irregular error information of current big data products, and the cost is relatively high. It takes a long time to understand the technical problem of the abnormal cause.
  • the present application provides an abnormal prompting method for big data products.
  • the abnormal prompting method for big data products is applied to an abnormal prompting device.
  • the abnormal prompting method for big data products includes the following steps:
  • an error code processor is instantiated according to the abnormality and error code mapping relationship table through the error code client SDK;
  • the error information is processed by the error code processor to obtain and output an error code and an error description that match the error information.
  • the step of invoking the error code client SDK and requesting the error code server through the error code client SDK to the error code server corresponding to the abnormality and error code mapping table of the big data product includes:
  • the error code synchronizer in the error code client SDK is used to request the error code server for the mapping relationship between the abnormality and the error code corresponding to the big data product.
  • the error code processor includes: a log file processor, a log information processor, and an exception processor;
  • the step of processing the error information by the error code processor to obtain and output an error code and an error description that match the error information includes:
  • the log file processor is used to parse the log file to obtain and output an error code and error description matching the log file;
  • the log information is parsed by the log information processor to obtain and output an error code and error description that match the log information;
  • the abnormal object is parsed by the abnormal processor to obtain and output an error code and an error description matching the abnormal object.
  • the step of processing the error information by the error code processor to obtain and output an error code and an error description that match the error information includes:
  • the method includes:
  • mapping table update request is sent to the error code server, so that the operation and maintenance personnel can update the abnormality and error code mapping relationship table according to the error information in the mapping table update request.
  • the present application also provides an abnormality prompting device for a big data product, the abnormality prompting device of the big data product is set in an abnormality prompting device, and the abnormality prompting device for the big data product includes:
  • the detection and acquisition module is used to acquire error information corresponding to the abnormality when an abnormality is detected in the big data product;
  • the calling request module is used to call the error code client SDK, and request the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
  • An instantiation module which is used to instantiate an error code processor according to the abnormality and error code mapping relationship table through the error code client SDK when the request for the abnormality and error code mapping relationship table is successful;
  • the matching output module is configured to process the error information through the error code processor to obtain and output an error code and an error description that match the error information.
  • the call request module includes:
  • the calling unit is used to obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
  • the request unit is configured to request the error code server for the mapping relationship table between the abnormality and the error code corresponding to the big data product through the error code synchronizer in the error code client SDK.
  • the error code processor includes: a log file processor, a log information processor, and an exception processor;
  • the matching output module includes:
  • the first output module is configured to, when the error information is a log file, parse the log file through the log file processor to obtain and output an error code and error description that match the log file;
  • the second output unit is configured to, when the error information is log information, parse the log information through the log information processor to obtain and output an error code and an error description that match the log information;
  • the third output unit is configured to, when the error information is an abnormal object, parse the abnormal object through the abnormal processor to obtain and output an error code and error description matching the abnormal object.
  • the matching output module includes:
  • a processing judgment unit configured to process the error information according to a preset regular expression through the error code processor, and determine whether there is an error code and an error description that match the error information;
  • the information output unit is configured to output the error code and the error description if there is an error code and an error description that match the error information.
  • the abnormal notification device of the big data product includes:
  • a request generating module configured to generate a mapping table update request containing the error information if there is no error code and error description matching the error information;
  • the request sending module is configured to send the mapping table update request to the error code server, so that the operation and maintenance personnel can update the abnormal and error code mapping relationship table according to the error information in the mapping table update request.
  • the present application also provides an abnormality prompt system for big data products.
  • the abnormality prompt system for big data products includes a communication-connected abnormality prompt device and an error code server. The system implements the following steps:
  • an abnormality notification device When an abnormality notification device detects an abnormality in a big data product, obtain the error information corresponding to the abnormality;
  • the abnormality prompting device invokes the error code client SDK, and requests the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
  • the error code server receives the request sent by the error code client SDK, and the error code server obtains the abnormality and error code mapping table corresponding to the product identifier according to the product identifier of the big data product in the request and sends it to the exception Reminder device
  • the abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
  • the abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
  • the abnormality prompting device calls the error code client SDK, and requests the error code server through the error code client SDK to the error code server corresponding to the big data product after the step of including: :
  • the abnormality notification device does not receive the abnormality and error code mapping table sent by the error code server for a preset period of time, and the abnormality notification device generates a mapping table update request containing the error information, and sends the mapping table update request to all The error code server;
  • the error code server When the error code server receives the mapping table update request, obtain the error information corresponding to the mapping table update request, and the product identifier of the big data product corresponding to the error information;
  • the error code server outputs an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information;
  • the error code server receives the abnormality and error code mapping relationship input based on the update window, and the error code server updates the abnormality and error code mapping relationship to the abnormality and error code mapping relationship table corresponding to the product identification;
  • the error code server sends the updated mapping relationship table between the abnormality and the error code to the abnormality prompting device;
  • the abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
  • the abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
  • the present application also provides an abnormal prompting device for a big data product.
  • the abnormality prompting device for a big data product includes: a memory, a processor, and a memory, a processor, and storage on the memory and available on the processor.
  • the abnormal prompting program of the big data product running on the computer when the abnormal prompting program of the big data product is executed by the processor, realizes the steps of the abnormal prompting method of the big data product as described above.
  • the present application also provides a computer-readable storage medium that stores an abnormality prompt program for a big data product, and the abnormality prompt program for a big data product is executed by a processor When realizing the steps of the abnormal prompt method for big data products as described above.
  • This application provides a method, device, system, equipment, and medium for prompting abnormalities of big data products.
  • the error information corresponding to the abnormality is obtained; the error code client SDK is called, and the error code client SDK is used to request the big data product from the error code server Corresponding anomaly and error code mapping relationship table; when the request for the anomaly and error code mapping relationship table is successful, the error code client SDK is used to instantiate an error code processor according to the exception and error code mapping relationship table;
  • the error information is processed by the error code processor to obtain and output an error code and an error description that match the error information.
  • the error information generated when the big data product is abnormal is converted into a standardized error code and error description and output.
  • the operation and maintenance personnel can follow the error code and Error description quickly locates exceptions, understands the cause of the exception and handles the exception, which improves efficiency; on the other hand, it reduces the professional requirements for operation and maintenance personnel, and ordinary operation and maintenance personnel handle the abnormality of big data products, thereby reducing labor costs .
  • FIG. 1 is a schematic diagram of a device structure of a hardware operating environment involved in a solution of an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a first embodiment of an abnormal notification method for a big data product according to the application;
  • FIG. 3 is a schematic diagram of a specific scenario of a second embodiment of an abnormal prompting method for a big data product of the application
  • FIG. 4 is a schematic flowchart of a fourth embodiment of an abnormal notification method for a big data product according to the application.
  • FIG. 5 is a schematic diagram of functional modules of an embodiment of an abnormal prompting device for a big data product of the application
  • FIG. 6 is a schematic diagram of functional modules of another embodiment of an abnormality prompting device for a big data product of the application.
  • FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application.
  • the abnormal prompting device of the big data product in the embodiment of the present application may be a terminal; as shown in FIG. 1, the abnormal prompting device of the big data product may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, and a memory 1005, Communication bus 1002.
  • the communication bus 1002 is used to implement connection and communication between these components.
  • the user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage.
  • the memory 1005 may also be a storage device independent of the foregoing processor 1001.
  • FIG. 1 does not constitute a limitation on the device, and may include more or fewer components than those shown in the figure, or a combination of certain components, or different component arrangements.
  • computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a computer program corresponding to abnormal prompts of big data products.
  • the network interface 1004 is mainly used to connect to the error code server and perform data communication with the error code server; the user interface 1003 is mainly used to connect to the client and perform data communication with the client; and the processor 1001 can It is used to call the computer program corresponding to the abnormal prompt of the big data product stored in the memory 1005, and execute the operation in the following abnormal prompt method of the big data product.
  • Fig. 2 is a schematic flowchart of a first embodiment of a method for prompting an abnormality of a big data product according to the application, and the method includes:
  • Step S10 when an abnormality is detected in the big data product, obtain error information corresponding to the abnormality.
  • the abnormal prompting method for big data products is applied to abnormal prompting equipment.
  • the abnormal prompting equipment processes the error information output when the big data product is abnormal, and generates a unified and concise error code and error description for easy viewing by operation and maintenance personnel ,specifically:
  • the abnormality notification device detects the status of big data products (also called Hadoop ecosystem products) in real time.
  • Big data products such as Spark, Hive, etc.
  • Spark is a distributed computing framework that uses memory for data calculation
  • Hive is a Hadoop-based Data warehouse tools.
  • the abnormality notification device When the abnormality notification device receives the error information sent by the big data product, the abnormality notification device detects the abnormality of the big data product, and the abnormality notification device obtains the error information corresponding to the abnormality. At this time, the abnormality notification device does not directly output the error information, but Process the error message to generate a simple and readable error code and error description.
  • the error code is pre-defined error identification information, which can be compared with the 404 status code that appears when accessing the web page.
  • the 404 status code is an http status code, and the error code is set for the abnormality of big data products Error identification information; in addition, the error code is set with an error description, which refers to the description information of the error reason, error location, or error type.
  • error code is set with an error description, which refers to the description information of the error reason, error location, or error type.
  • the error description corresponding to the 404 status code is the requested The page does not exist or has been deleted! It is understandable that the error code and error description in this embodiment can be customized by the operation and maintenance personnel of the big data product.
  • the abnormal notification device is installed in a financial institution (financial machines include banking institutions, insurance institutions, securities institutions, etc.), and the abnormal notification device accesses Hive corresponding to the financial institution to obtain the financial bill information stored in Hive. If Hive fails to provide normal feedback For the financial bill information, Hive sends error information to the abnormality notification device, and the abnormality notification device receives the error information feedback from Hive for processing, and obtains the error code and error description corresponding to the error information.
  • the abnormal prompting device processes the error information and generates a simple and easy-to-read error code and error description, which specifically includes:
  • Step S20 Invoke the error code client SDK, and request the error code server through the error code client SDK to request the abnormality and error code mapping table corresponding to the big data product.
  • terminal error code SDK software development kit, software development kit, SDK is a collection of development tools used by software engineers to build application software for specific software packages, software frameworks, hardware platforms, operating systems, etc.
  • terminal error code SDK can be understood as used for error information analysis Java SDK and/or Python SDK.
  • step S20 includes:
  • Step a1 Obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
  • Step a2 through the error code synchronizer in the error code client SDK, request the error code server for the abnormality and error code mapping table corresponding to the big data product.
  • the abnormal prompting device obtains the product ID of the big data product, and determines the error code server corresponding to the product ID.
  • the product ID corresponding to the big data product Hive is 001
  • the abnormal prompting device obtains the error code server corresponding to 001
  • the node information (Host) and interface information (Port) of the error code server the abnormal prompt device calls the error code client SDK according to the node information and interface information, and sends the error code server to the error code server through the error code synchronizer in the error code client SDK.
  • Request a mapping relationship table of exceptions and error codes corresponding to big data products.
  • the error code synchronizer and error code manager are set in the error code client SDK.
  • the error code synchronizer refers to the preset for request
  • the virtual module of the abnormal and error code mapping table, the error code synchronizer can periodically or irregularly request the abnormal and error code mapping table from the error code server;
  • the error code manager refers to the preset used to manage exceptions and error codes
  • the virtual module of the mapping table, the error code processor can manage different abnormal and error code mapping tables.
  • the error code client SDK first requests the error code manager for the mapping relationship between the exception and the error code, the error code manager receives the request of the error code client SDK, and the error code manager queries whether there is a corresponding request Exception and error code mapping relationship table; if there is currently a request corresponding exception and error code mapping relationship table, the error code manager will send the request corresponding exception and error code mapping relationship table to the error code client SDK, if it does not currently exist The requested exception and error code mapping relationship table, the error code manager requests the error code server for the corresponding exception and error code mapping table of the big data product through the error code synchronizer.
  • the abnormality and error code mapping table is set in the error code server, on the one hand, the abnormality and error code mapping table can be updated effectively in real time, and on the other hand, the storage space occupancy rate of the abnormal notification device can be reduced.
  • the error code client SDK is preset in the abnormality prompting device, and the error code client SDK requests the error code server to process the error information according to the abnormality and error code mapping table. Specifically :
  • Step S30 when the request for the abnormality and error code mapping relationship table is successful, an error code processor is instantiated according to the abnormality and error code mapping relationship table through the error code client SDK.
  • the abnormality prompting device instantiates the error code processor through the error code client SDK according to the abnormality and error code mapping table, that is, the error code client SDK obtains the exception and
  • the program segment of the error code processor is preset in the error code mapping table, and the program segment is instantiated (in object-oriented programming, the process of creating an object with a class is usually called instantiation) to obtain each error Code processor, where the error code processor can be understood as a virtual module for processing error information, and the type of error code processor is not specifically limited.
  • Step S40 processing the error information by the error code processor to obtain and output an error code and an error description that match the error information.
  • step b1 the error code processor processes the error information according to a preset regular expression, and judges whether there is an error code and an error description that match the error information;
  • step b2 if there is an error code and an error description that match the error information, output the error code and the error description.
  • a regular expression is preset in the error code processor corresponding to the abnormality prompting device, and the abnormality prompting device uses the error code processor to compare the error information with the preset error codes and presets according to the regular expression.
  • the error description is compared to determine whether there is an error code and error description that match the error message; if there is no error code and error description that match the error message, it means that the error code and error description corresponding to the error message are not preset.
  • the abnormal prompting device cannot handle the error message, and the abnormal prompting device directly outputs the error message; if there is an error code and error description that match the error message, the error code and error description are output.
  • mapping relationship code in the abnormal and error code mapping relationship table as follows:
  • Get Error Regex returns a regular expression and matches the error information through the regular expression. If there is an error code and error description that match the error information, the matched error code and error description are output. In addition, the exception prompts the device to intercept and match Part of the key field information in the error message received, and the key field information is added to get Error Desc to facilitate more accurate error description later.
  • the abnormality notification device calls the error code client SDK to convert the error information generated when the big data product is abnormal into a standardized error code and error description and output it.
  • the error code and error description it is convenient for operation and maintenance personnel to view, so that operation and maintenance personnel According to the error code and error description, it can quickly locate anomalies, understand the cause of the anomaly and handle the anomaly, thereby improving efficiency; on the other hand, it reduces the professional requirements for operation and maintenance personnel, and ordinary operation and maintenance personnel deal with the abnormality of big data products. Reduce labor costs.
  • This embodiment is a refinement of step S40 in the first embodiment.
  • a specific implementation method for the error code processor to process the error information to obtain the error code and error description is given, including:
  • the log file processor is used to parse the log file to obtain and output an error code and error description matching the log file;
  • the log information is parsed by the log information processor to obtain and output an error code and error description that match the log information;
  • the abnormal object is parsed by the abnormal processor to obtain and output an error code and an error description matching the abnormal object.
  • the error code processor includes: a log file processor, a log information processor, and an exception processor; the steps for the error code processor to process error information, specifically:
  • the exception notification device parses the log file through the log file processor to obtain the Java Exception corresponding to the log file.
  • the exception notification device compares the Java Exception with the preset error codes and presets. Set each error description to compare, get the error code and error description that match the log file and output it.
  • the abnormal prompting device determines that the error information is log information
  • the abnormal prompting device parses the log information through the log information processor to obtain The error code and error description matching the log information are output; in the same way, when the error message is an abnormal object, the exception notification device parses the abnormal object through the exception handler to obtain and output the error code and error description matching the abnormal object.
  • the abnormality prompting device instantiates different types of error code processors according to the abnormality and error code mapping relationship table, and uses the different types of error code processors to process the error information to obtain the error code and error description matching the error information, so that The handling of error messages is more optimized and more efficient.
  • This embodiment is a step after step S40 in the first embodiment.
  • the difference between this embodiment and the foregoing embodiment lies in:
  • mapping table update request is sent to the error code server, so that the operation and maintenance personnel can update the abnormality and error code mapping relationship table according to the error information in the mapping table update request.
  • the abnormality notification device determines that there is no matching error code and error description with the error information
  • the abnormality notification device determines that the error information is not predefined.
  • the abnormality notification device generates a mapping table update request containing the error information, and the abnormality notification device will include
  • the error information mapping table update request is sent to the error code server, so that the operation and maintenance personnel can update the abnormal and error code mapping relationship table according to the error information in the mapping table update request.
  • the abnormal prompting device when the abnormal prompting device does not match the error code and error description corresponding to the error information, the abnormal prompting device generates a mapping table update request containing the error information and sends it to the error code server, so that the operation and maintenance personnel can real-time Update the abnormal and error code mapping relationship table, so that the error information can be quickly processed according to the updated abnormal and error code mapping relationship table.
  • Fig. 4 is a schematic flowchart of a fourth embodiment of an abnormality prompting method for a big data product according to this application.
  • the abnormality prompting method for a big data product in this embodiment includes the following steps:
  • Step S50 upon receiving the mapping table update request, obtain the error information corresponding to the mapping table update request, and the product identifier of the big data product corresponding to the error information.
  • the abnormal prompting method for big data products in this embodiment is applied to the error code server.
  • the error code server receives the mapping table update request.
  • the triggering method of the mapping table update request is not specifically limited, that is, the mapping table update request may be triggered by the user actively , It can also be triggered automatically by the error code server.
  • the error code server When the error code server receives the mapping table update request, the error code server obtains the error information corresponding to the mapping table update request, and the error information corresponds to the product identifier of the big data product.
  • the product identifier refers to information identifying the big data product.
  • Step S60 Output an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information.
  • the error code server outputs an update window containing error information, that is, the error code server sends the update window to a preset operation and maintenance terminal, so that the operation and maintenance personnel corresponding to the operation and maintenance terminal can set the mapping relationship between the exception and the error code according to the error information.
  • Step S70 receiving the mapping relationship between the abnormality and the error code input based on the update window, and updating the mapping relationship between the abnormality and the error code to the abnormal and error code mapping relationship table corresponding to the product identification.
  • the error code server receives the mapping relationship between the exception and the error code input based on the update window, and the error code server updates the mapping relationship between the exception and the error code to the mapping relationship table of the exception and the error code corresponding to the product identification to realize the mapping relationship between the exception and the error code. Update. It is understandable that when a big data product is newly added, a new abnormality and error code mapping relationship table can be created on the error code server. In this embodiment, the error code server can update the abnormality and error code mapping relationship table in real time. Ensure real-time data processing.
  • Fig. 5 is a schematic diagram of functional modules of an embodiment of an abnormality prompting device for a big data product of this application.
  • the abnormality prompting device of the big data product is set in an abnormality prompting device, and the abnormality prompting device of the big data product includes:
  • the detection and acquisition module 10 is configured to obtain error information corresponding to the abnormality when an abnormality is detected in the big data product;
  • the call request module 20 is used to call the error code client SDK, and request the error code server through the error code client SDK to request the abnormality and error code mapping table corresponding to the big data product;
  • the instantiation module 30 is configured to instantiate an error code processor according to the abnormality and error code mapping relationship table through the error code client SDK when the request for the abnormality and error code mapping relationship table is successful;
  • the matching output module 40 is configured to process the error information through the error code processor to obtain and output an error code and an error description that match the error information.
  • the call request module 30 includes:
  • the calling unit is used to obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
  • the request unit is configured to request the error code server for the mapping relationship table between the abnormality and the error code corresponding to the big data product through the error code synchronizer in the error code client SDK.
  • the error code processor includes: a log file processor, a log information processor, and an exception processor;
  • the matching output module 40 includes:
  • the first output module is configured to, when the error information is a log file, parse the log file through the log file processor to obtain and output an error code and error description that match the log file;
  • the second output unit is configured to, when the error information is log information, parse the log information through the log information processor to obtain and output an error code and an error description that match the log information;
  • the third output unit is configured to, when the error information is an abnormal object, parse the abnormal object through the abnormal processor to obtain and output an error code and error description matching the abnormal object.
  • the matching output module 40 includes:
  • a processing judgment unit configured to process the error information according to a preset regular expression through the error code processor, and determine whether there is an error code and an error description that match the error information;
  • the information output unit is configured to output the error code and the error description if there is an error code and an error description that match the error information.
  • the abnormal notification device of the big data product includes:
  • a request generating module configured to generate a mapping table update request containing the error information if there is no error code and error description matching the error information;
  • the request sending module is configured to send the mapping table update request to the error code server, so that the operation and maintenance personnel can update the abnormal and error code mapping relationship table according to the error information in the mapping table update request.
  • FIG. 6 is a schematic diagram of functional modules of another embodiment of an abnormal prompting device for a big data product of the application.
  • the abnormal prompting device of the big data product is set in an error code server, and the abnormal prompting device of the big data product includes :
  • the request receiving module 50 is configured to obtain the error information corresponding to the mapping table update request and the product identifier of the big data product corresponding to the error information when the mapping table update request is received;
  • the window output module 60 is configured to output an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information;
  • the mapping update module 70 is configured to receive the abnormality and error code mapping relationship input based on the update window, and update the abnormality and error code mapping relationship to the abnormality and error code mapping relationship table corresponding to the product identifier.
  • the abnormal prompting system of the big data product includes a communication-connected abnormal prompting device and an error code server.
  • the abnormal prompting system of the big data product implements The following steps:
  • an abnormality notification device When an abnormality notification device detects an abnormality in a big data product, obtain the error information corresponding to the abnormality;
  • the abnormality prompting device invokes the error code client SDK, and requests the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
  • the error code server receives the request sent by the error code client SDK, and the error code server obtains the abnormality and error code mapping table corresponding to the product identifier according to the product identifier of the big data product in the request and sends it to the exception Reminder device
  • the abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
  • the abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
  • the abnormality notification device does not receive the abnormality and error code mapping table sent by the error code server for a preset period of time, and the abnormality notification device generates a mapping table update request containing the error information, and sends the mapping table update request to all The error code server;
  • the error code server When the error code server receives the mapping table update request, obtain the error information corresponding to the mapping table update request, and the product identifier of the big data product corresponding to the error information;
  • the error code server outputs an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information;
  • the error code server receives the abnormality and error code mapping relationship input based on the update window, and the error code server updates the abnormality and error code mapping relationship to the abnormality and error code mapping relationship table corresponding to the product identification;
  • the error code server sends the updated mapping relationship table between the abnormality and the error code to the abnormality prompting device;
  • the abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
  • the abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
  • the abnormal prompting device and the error code server in the abnormal prompting system of the above-mentioned big data product interact to implement the various embodiments of the abnormal prompting method of the big data product of the present application, which will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Human Computer Interaction (AREA)
  • Debugging And Monitoring (AREA)

Abstract

An exception prompting method, apparatus, system and device for a big data product, and a medium. The prompting method comprises: when it is detected that a big data product has an exception, acquiring error information corresponding to the exception (S10); calling an error code client SDK, and requesting, by means of the error code client SDK and from an error code server, an exception and error code mapping relationship table corresponding to the big data product (S20); when the exception and error code mapping relationship table is successfully requested, instantiating, by means of the error code client SDK, an error code processor according to the exception and error code mapping relationship table (S30); and processing error information by means of the error code processor to obtain an error code and an error description which match the error information, and outputting the error code and the error description (S40).

Description

大数据产品的异常提示方法、装置、***、设备及介质Method, device, system, equipment and medium for prompting abnormality of big data products
本申请要求于2019年7月19日申请的、申请号为201910658814.7、名称为“大数据产品的异常提示方法、装置、***、设备及介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on July 19, 2019, the application number is 201910658814.7, and the name is "Methods, devices, systems, equipment and media for abnormal notification of big data products", the entire contents of which are incorporated by reference Incorporated in this application.
技术领域Technical field
本申请涉及金融科技(Fintech)的大数据技术领域,尤其涉及大数据产品的异常提示方法、装置、***、设备及介质。This application relates to the field of big data technology of financial technology (Fintech), and in particular to abnormal notification methods, devices, systems, equipment and media of big data products.
背景技术Background technique
随着互联网技术,尤其是互联网金融科技(Fintech)的飞速发展,越来越多的技术(大数据、分布式、区块链Blockchain、人工智能等)应用在金融领域。With the rapid development of Internet technology, especially Internet financial technology (Fintech), more and more technologies (big data, distributed, blockchain, artificial intelligence, etc.) are applied in the financial field.
在大数据Hadoop生态圈的各大数据产品,如Hive、Spark等产品广泛地应用在金融领域,当前Hadoop生态圈的各大数据产品出现异常时,都是抛出一个Java Exception(Java错误),Java Exception中携带一长串的异常堆栈信息,这种报错方式对刚接触大数据产品的运维人员来说较为复杂,甚至有一定大数据产品基础的运维人员也需要花费较长的时间,才能理解异常原因,显然,现有的异常提示方式,定位问题并解决问题所花费的时间比较长,效率比较低。The big data products in the big data Hadoop ecosystem, such as Hive, Spark and other products, are widely used in the financial field. When the current big data products in the Hadoop ecosystem are abnormal, they all throw a Java Exception (Java error). Java Exception carries a long list of exception stack information. This error reporting method is more complicated for operation and maintenance personnel who are new to big data products, and even operation and maintenance personnel with a certain big data product foundation need to spend a long time. In order to understand the cause of the abnormality, obviously, the existing abnormal prompting method takes a long time to locate and solve the problem, and the efficiency is relatively low.
技术解决方案Technical solutions
本申请提出一种大数据产品的异常提示方法、装置、***、设备及介质,旨在解决由于当前大数据产品的错误信息较为复杂且不规范,导致运维人员查看不方便,且需要花费较长的时间才可以了解异常原因的技术问题。This application proposes an abnormal prompting method, device, system, equipment and medium for big data products, which aims to solve the inconvenience of operation and maintenance personnel to view due to the complicated and irregular error information of current big data products, and the cost is relatively high. It takes a long time to understand the technical problem of the abnormal cause.
为实现上述目的,本申请提供一种大数据产品的异常提示方法,所述大数据产品的异常提示方法应用于异常提示设备,所述大数据产品的异常提示方法包括如下步骤:In order to achieve the above objective, the present application provides an abnormal prompting method for big data products. The abnormal prompting method for big data products is applied to an abnormal prompting device. The abnormal prompting method for big data products includes the following steps:
在检测到大数据产品出现异常时,获取所述异常对应的错误信息;When an abnormality is detected in a big data product, obtaining error information corresponding to the abnormality;
调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;Invoke the error code client SDK, and request the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
在所述异常与错误码映射关系表请求成功时,通过所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;When the request for the abnormality and error code mapping relationship table is successful, an error code processor is instantiated according to the abnormality and error code mapping relationship table through the error code client SDK;
通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The error information is processed by the error code processor to obtain and output an error code and an error description that match the error information.
在一实施例中,所述调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表的步骤,包括:In an embodiment, the step of invoking the error code client SDK and requesting the error code server through the error code client SDK to the error code server corresponding to the abnormality and error code mapping table of the big data product includes:
获取所述大数据产品的产品标识,确定所述产品标识对应的错误码服务器,根据所述错误码服务器的节点信息和接口信息,调用错误码客户端SDK;Obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
通过所述错误码客户端SDK中的错误码同步器,向所述错误码服务器请求所述大数据产品对应的异常与错误码映射关系表。The error code synchronizer in the error code client SDK is used to request the error code server for the mapping relationship between the abnormality and the error code corresponding to the big data product.
在一实施例中,所述错误码处理器包括:日志文件处理器、日志信息处理器和异常处理器;In an embodiment, the error code processor includes: a log file processor, a log information processor, and an exception processor;
所述通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出的步骤,包括:The step of processing the error information by the error code processor to obtain and output an error code and an error description that match the error information includes:
在所述错误信息是日志文件时,通过所述日志文件处理器解析所述日志文件,得到与所述日志文件匹配的错误码和错误描述并输出;When the error information is a log file, the log file processor is used to parse the log file to obtain and output an error code and error description matching the log file;
在所述错误信息是日志信息时,通过所述日志信息处理器解析所述日志信息,得到与所述日志信息匹配的错误码和错误描述并输出;When the error information is log information, the log information is parsed by the log information processor to obtain and output an error code and error description that match the log information;
在所述错误信息是异常对象时,通过所述异常处理器解析所述异常对象,得到与所述异常对象匹配的错误码和错误描述并输出。When the error information is an abnormal object, the abnormal object is parsed by the abnormal processor to obtain and output an error code and an error description matching the abnormal object.
在一实施例中,所述通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出的步骤,包括:In an embodiment, the step of processing the error information by the error code processor to obtain and output an error code and an error description that match the error information includes:
通过所述错误码处理器根据预设的正则表达式处理所述错误信息,判断是否存在与所述错误信息匹配的错误码和错误描述;Processing the error information according to a preset regular expression by the error code processor, and determining whether there is an error code and an error description that match the error information;
若存在与所述错误信息匹配的错误码和错误描述,则输出所述错误码和所述错误描述。If there is an error code and an error description that match the error information, output the error code and the error description.
在一实施例中,所述通过所述错误码处理器根据预设的正则表达式处理所述错误信息,判断是否存在与所述错误信息匹配的错误码和错误描述的步骤之后,包括:In an embodiment, after the step of processing the error information by the error code processor according to a preset regular expression to determine whether there is an error code and an error description matching the error information, the method includes:
若不存在与所述错误信息匹配的错误码和错误描述,则生成包含所述错误信息的映射表更新请求;If there is no error code and error description that match the error information, generate a mapping table update request containing the error information;
将所述映射表更新请求发送至所述错误码服务器,以使运维人员根据所述映射表更新请求中的所述错误信息更新所述异常与错误码映射关系表。The mapping table update request is sent to the error code server, so that the operation and maintenance personnel can update the abnormality and error code mapping relationship table according to the error information in the mapping table update request.
此外,为实现上述目的,本申请还提供一种大数据产品的异常提示装置,所述大数据产品的异常提示装置设置于异常提示设备,所述大数据产品的异常提示装置包括:In addition, in order to achieve the above object, the present application also provides an abnormality prompting device for a big data product, the abnormality prompting device of the big data product is set in an abnormality prompting device, and the abnormality prompting device for the big data product includes:
检测获取模块,用于在检测到大数据产品出现异常时,获取所述异常对应的错误信息;The detection and acquisition module is used to acquire error information corresponding to the abnormality when an abnormality is detected in the big data product;
调用请求模块,用于调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;The calling request module is used to call the error code client SDK, and request the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
实例化模块,用于在所述异常与错误码映射关系表请求成功时,通过所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;An instantiation module, which is used to instantiate an error code processor according to the abnormality and error code mapping relationship table through the error code client SDK when the request for the abnormality and error code mapping relationship table is successful;
匹配输出模块,用于通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The matching output module is configured to process the error information through the error code processor to obtain and output an error code and an error description that match the error information.
在一实施例中,所述调用请求模块,包括:In an embodiment, the call request module includes:
调用单元,用于获取所述大数据产品的产品标识,确定所述产品标识对应的错误码服务器,根据所述错误码服务器的节点信息和接口信息,调用错误码客户端SDK;The calling unit is used to obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
请求单元,用于通过所述错误码客户端SDK中的错误码同步器,向所述错误码服务器请求所述大数据产品对应的异常与错误码映射关系表。The request unit is configured to request the error code server for the mapping relationship table between the abnormality and the error code corresponding to the big data product through the error code synchronizer in the error code client SDK.
在一实施例中,所述错误码处理器包括:日志文件处理器、日志信息处理器和异常处理器;In an embodiment, the error code processor includes: a log file processor, a log information processor, and an exception processor;
所述匹配输出模块,包括:The matching output module includes:
第一输出模块,用于在所述错误信息是日志文件时,通过所述日志文件处理器解析所述日志文件,得到与所述日志文件匹配的错误码和错误描述并输出;The first output module is configured to, when the error information is a log file, parse the log file through the log file processor to obtain and output an error code and error description that match the log file;
第二输出单元,用于在所述错误信息是日志信息时,通过所述日志信息处理器解析所述日志信息,得到与所述日志信息匹配的错误码和错误描述并输出;The second output unit is configured to, when the error information is log information, parse the log information through the log information processor to obtain and output an error code and an error description that match the log information;
第三输出单元,用于在所述错误信息是异常对象时,通过所述异常处理器解析所述异常对象,得到与所述异常对象匹配的错误码和错误描述并输出。The third output unit is configured to, when the error information is an abnormal object, parse the abnormal object through the abnormal processor to obtain and output an error code and error description matching the abnormal object.
在一实施例中,所述匹配输出模块,包括:In an embodiment, the matching output module includes:
处理判断单元,用于通过所述错误码处理器根据预设的正则表达式处理所述错误信息,判断是否存在与所述错误信息匹配的错误码和错误描述;A processing judgment unit, configured to process the error information according to a preset regular expression through the error code processor, and determine whether there is an error code and an error description that match the error information;
信息输出单元,用于若存在与所述错误信息匹配的错误码和错误描述,则输出所述错误码和所述错误描述。The information output unit is configured to output the error code and the error description if there is an error code and an error description that match the error information.
在一实施例中,所述的大数据产品的异常提示装置,包括:In an embodiment, the abnormal notification device of the big data product includes:
请求生成模块,用于若不存在与所述错误信息匹配的错误码和错误描述,则生成包含所述错误信息的映射表更新请求;A request generating module, configured to generate a mapping table update request containing the error information if there is no error code and error description matching the error information;
请求发送模块,用于将所述映射表更新请求发送至所述错误码服务器,以使运维人员根据所述映射表更新请求中的所述错误信息更新所述异常与错误码映射关系表。The request sending module is configured to send the mapping table update request to the error code server, so that the operation and maintenance personnel can update the abnormal and error code mapping relationship table according to the error information in the mapping table update request.
此外,为实现上述目的,本申请还提供一种大数据产品的异常提示***,所述大数据产品的异常提示***包括通信连接的异常提示设备和错误码服务器,所述大数据产品的异常提示***,实现以下步骤:In addition, in order to achieve the above-mentioned purpose, the present application also provides an abnormality prompt system for big data products. The abnormality prompt system for big data products includes a communication-connected abnormality prompt device and an error code server. The system implements the following steps:
异常提示设备在检测到大数据产品出现异常时,获取所述异常对应的错误信息;When an abnormality notification device detects an abnormality in a big data product, obtain the error information corresponding to the abnormality;
异常提示设备调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;The abnormality prompting device invokes the error code client SDK, and requests the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
错误码服务器接收所述错误码客户端SDK发送的请求,所述错误码服务器根据所述请求中大数据产品的产品标识,获取所述产品标识对应的异常与错误码映射关系表并发送至异常提示设备;The error code server receives the request sent by the error code client SDK, and the error code server obtains the abnormality and error code mapping table corresponding to the product identifier according to the product identifier of the big data product in the request and sends it to the exception Reminder device
异常提示设备接收错误码服务器发送的所述异常与错误码映射关系表,异常提示设备中的所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;The abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
异常提示设备通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
在一实施例中,所述异常提示设备调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表的步骤之后,包括:In one embodiment, the abnormality prompting device calls the error code client SDK, and requests the error code server through the error code client SDK to the error code server corresponding to the big data product after the step of including: :
异常提示设备预设时间段没有接收所述错误码服务器发送的异常与错误码映射关系表,异常提示设备生成包含所述错误信息的映射表更新请求,并将所述映射表更新请求发送至所述错误码服务器;The abnormality notification device does not receive the abnormality and error code mapping table sent by the error code server for a preset period of time, and the abnormality notification device generates a mapping table update request containing the error information, and sends the mapping table update request to all The error code server;
错误码服务器在接收到映射表更新请求时,获取所述映射表更新请求对应的错误信息,及所述错误信息对应大数据产品的产品标识;When the error code server receives the mapping table update request, obtain the error information corresponding to the mapping table update request, and the product identifier of the big data product corresponding to the error information;
错误码服务器输出包含所述错误信息的更新窗口,以使运维人员根据所述错误信息设置异常与错误码映射关系;The error code server outputs an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information;
错误码服务器接收基于所述更新窗口输入的异常与错误码映射关系,错误码服务器将所述异常与错误码映射关系更新到所述产品标识对应的异常与错误码映射关系表;The error code server receives the abnormality and error code mapping relationship input based on the update window, and the error code server updates the abnormality and error code mapping relationship to the abnormality and error code mapping relationship table corresponding to the product identification;
错误码服务器将更新后的所述异常与错误码映射关系表并发送至所述异常提示设备;The error code server sends the updated mapping relationship table between the abnormality and the error code to the abnormality prompting device;
异常提示设备接收错误码服务器发送的所述异常与错误码映射关系表,异常提示设备中的所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;The abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
异常提示设备通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
此外,为实现上述目的,本申请还提供一种大数据产品的异常提示设备,所述大数据产品的异常提示设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的大数据产品的异常提示程序,所述大数据产品的异常提示程序被所述处理器执行时实现如上所述的大数据产品的异常提示方法的步骤。In addition, in order to achieve the above-mentioned object, the present application also provides an abnormal prompting device for a big data product. The abnormality prompting device for a big data product includes: a memory, a processor, and a memory, a processor, and storage on the memory and available on the processor. The abnormal prompting program of the big data product running on the computer, when the abnormal prompting program of the big data product is executed by the processor, realizes the steps of the abnormal prompting method of the big data product as described above.
此外,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有大数据产品的异常提示程序,所述大数据产品的异常提示程序被处理器执行时实现如上所述的大数据产品的异常提示方法的步骤。In addition, in order to achieve the above-mentioned object, the present application also provides a computer-readable storage medium that stores an abnormality prompt program for a big data product, and the abnormality prompt program for a big data product is executed by a processor When realizing the steps of the abnormal prompt method for big data products as described above.
本申请提供一种大数据产品的异常提示方法、装置、***、设备及介质。本申请实施例中,在检测到大数据产品出现异常时,获取所述异常对应的错误信息;调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;在所述异常与错误码映射关系表请求成功时,通过所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。本实施例中通过调用错误码客户端SDK,将大数据产品异常时生成的错误信息转化为规范化的错误码和错误描述并输出,一方面可以运维人员查看,使得运维人员根据错误码和错误描述快速地定位异常,了解异常原因并处理异常,提高了效率;另外一方面降低了对运维人员专业性的要求,普通的运维人员就处理大数据产品的异常,从而减少了人力成本。This application provides a method, device, system, equipment, and medium for prompting abnormalities of big data products. In the embodiment of the present application, when an abnormality is detected in a big data product, the error information corresponding to the abnormality is obtained; the error code client SDK is called, and the error code client SDK is used to request the big data product from the error code server Corresponding anomaly and error code mapping relationship table; when the request for the anomaly and error code mapping relationship table is successful, the error code client SDK is used to instantiate an error code processor according to the exception and error code mapping relationship table; The error information is processed by the error code processor to obtain and output an error code and an error description that match the error information. In this embodiment, by calling the error code client SDK, the error information generated when the big data product is abnormal is converted into a standardized error code and error description and output. On the one hand, it can be viewed by the operation and maintenance personnel, so that the operation and maintenance personnel can follow the error code and Error description quickly locates exceptions, understands the cause of the exception and handles the exception, which improves efficiency; on the other hand, it reduces the professional requirements for operation and maintenance personnel, and ordinary operation and maintenance personnel handle the abnormality of big data products, thereby reducing labor costs .
附图说明Description of the drawings
图1是本申请实施例方案涉及的硬件运行环境的设备结构示意图;FIG. 1 is a schematic diagram of a device structure of a hardware operating environment involved in a solution of an embodiment of the present application;
图2为本申请大数据产品的异常提示方法第一实施例的流程示意图;FIG. 2 is a schematic flowchart of a first embodiment of an abnormal notification method for a big data product according to the application;
图3为本申请大数据产品的异常提示方法第二实施例的具体场景示意图;FIG. 3 is a schematic diagram of a specific scenario of a second embodiment of an abnormal prompting method for a big data product of the application;
图4为本申请大数据产品的异常提示方法第四实施例的流程示意图;FIG. 4 is a schematic flowchart of a fourth embodiment of an abnormal notification method for a big data product according to the application;
图5为本申请大数据产品的异常提示装置一实施例的功能模块示意图;FIG. 5 is a schematic diagram of functional modules of an embodiment of an abnormal prompting device for a big data product of the application;
图6为本申请大数据产品的异常提示装置另一实施例的功能模块示意图。FIG. 6 is a schematic diagram of functional modules of another embodiment of an abnormality prompting device for a big data product of the application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
本发明的实施方式Embodiments of the invention
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, and are not used to limit the application.
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的设备结构示意图。As shown in FIG. 1, FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application.
本申请实施例大数据产品的异常提示设备可以是终端;如图1所示,该大数据产品的异常提示设备可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。The abnormal prompting device of the big data product in the embodiment of the present application may be a terminal; as shown in FIG. 1, the abnormal prompting device of the big data product may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, and a memory 1005, Communication bus 1002. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage. Optionally, the memory 1005 may also be a storage device independent of the foregoing processor 1001.
本领域技术人员可以理解,图1中示出的设备结构并不构成对设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the structure of the device shown in FIG. 1 does not constitute a limitation on the device, and may include more or fewer components than those shown in the figure, or a combination of certain components, or different component arrangements.
如图1所示,作为一种计算机可读存储介质(计算机可读存储介质又叫计算机存储介质、计算机介质、可读介质、可读存储介质、或者直接叫介质等,计算机可读存储介质可以是非易失性可读存储介质,如RAM、磁碟、光盘)的存储器1005中可以包括操作***、网络通信模块、用户接口模块以及大数据产品的异常提示对应的计算机程序。As shown in Figure 1, as a computer-readable storage medium (computer-readable storage medium is also called computer storage medium, computer medium, readable medium, readable storage medium, or directly called medium, etc., computer-readable storage medium may The memory 1005, which is a non-volatile readable storage medium, such as RAM, magnetic disk, and optical disk, may include an operating system, a network communication module, a user interface module, and a computer program corresponding to abnormal prompts of big data products.
在图1所示的设备中,网络接口1004主要用于连接错误码服务器,与错误码服务器进行数据通信;用户接口1003主要用于连接客户端,与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的大数据产品的异常提示对应的计算机程序,并执行下述大数据产品的异常提示方法中的操作。In the device shown in Figure 1, the network interface 1004 is mainly used to connect to the error code server and perform data communication with the error code server; the user interface 1003 is mainly used to connect to the client and perform data communication with the client; and the processor 1001 can It is used to call the computer program corresponding to the abnormal prompt of the big data product stored in the memory 1005, and execute the operation in the following abnormal prompt method of the big data product.
其中,在所述处理器上运行的大数据产品的异常提示程序被执行时所实现的方法可参照下述本申请大数据产品的异常提示方法各个实施例。For the method implemented when the abnormal prompt program of the big data product running on the processor is executed, refer to the following embodiments of the abnormal prompt method of the big data product of the present application.
基于上述硬件结构,提出本申请大数据产品的异常提示方法实施例。Based on the above hardware structure, an embodiment of the abnormal prompting method for the big data product of this application is proposed.
参照图2,图2为本申请大数据产品的异常提示方法第一实施例的流程示意图,所述方法包括:Referring to Fig. 2, Fig. 2 is a schematic flowchart of a first embodiment of a method for prompting an abnormality of a big data product according to the application, and the method includes:
步骤S10,在检测到大数据产品出现异常时,获取所述异常对应的错误信息。Step S10, when an abnormality is detected in the big data product, obtain error information corresponding to the abnormality.
本实施例中,大数据产品的异常提示方法应用于异常提示设备,异常提示设备对大数据产品异常时输出的错误信息进行处理,生成统一简洁的错误码和错误描述,以方便运维人员查看,具体地:In this embodiment, the abnormal prompting method for big data products is applied to abnormal prompting equipment. The abnormal prompting equipment processes the error information output when the big data product is abnormal, and generates a unified and concise error code and error description for easy viewing by operation and maintenance personnel ,specifically:
异常提示设备实时地检测大数据产品(又叫Hadoop生态圈产品)的状态,大数据产品如Spark、Hive等,Spark是一种使用内存进行数据计算的分布式计算框架;Hive是一种基于Hadoop的数据仓库工具。The abnormality notification device detects the status of big data products (also called Hadoop ecosystem products) in real time. Big data products such as Spark, Hive, etc., Spark is a distributed computing framework that uses memory for data calculation; Hive is a Hadoop-based Data warehouse tools.
异常提示设备在接收到大数据产品发送的错误信息时,异常提示设备检测到大数据产品异常,异常提示设备获取异常对应的错误信息,此时,异常提示设备不直接输出该错误信息,而是将该错误信息处理生成简单易读的错误码和错误描述。When the abnormality notification device receives the error information sent by the big data product, the abnormality notification device detects the abnormality of the big data product, and the abnormality notification device obtains the error information corresponding to the abnormality. At this time, the abnormality notification device does not directly output the error information, but Process the error message to generate a simple and readable error code and error description.
可以理解的是,错误码为预先定义的错误标识信息,可以用访问网络页面时出现的404状态码进行类比,404状态码是一种http状态码,而错误码为针对大数据产品异常设置的错误标识信息;此外,错误码对应设置有错误描述,错误描述是指错误原因、错误位置或者错误类型等的描述信息,继续以404状态码为例,404状态码对应的错误描述为所请求的页面不存在或已被删除!可以理解的是,本实施例中的错误码和错误描述可以由大数据产品的运维人员进行自定义。It is understandable that the error code is pre-defined error identification information, which can be compared with the 404 status code that appears when accessing the web page. The 404 status code is an http status code, and the error code is set for the abnormality of big data products Error identification information; in addition, the error code is set with an error description, which refers to the description information of the error reason, error location, or error type. Continue to take the 404 status code as an example. The error description corresponding to the 404 status code is the requested The page does not exist or has been deleted! It is understandable that the error code and error description in this embodiment can be customized by the operation and maintenance personnel of the big data product.
例如,异常提示设备设置于金融机构(金融机包括银行机构、保险机构、证券机构等),异常提示设备访问金融机构对应的Hive,以获取Hive中保存的财务账单信息,若Hive不可以正常反馈该财务账单信息,则Hive发送错误信息至异常提示设备,异常提示设备接收Hive反馈的错误信息进行处理,得到错误信息对应的错误码和错误描述。For example, the abnormal notification device is installed in a financial institution (financial machines include banking institutions, insurance institutions, securities institutions, etc.), and the abnormal notification device accesses Hive corresponding to the financial institution to obtain the financial bill information stored in Hive. If Hive fails to provide normal feedback For the financial bill information, Hive sends error information to the abnormality notification device, and the abnormality notification device receives the error information feedback from Hive for processing, and obtains the error code and error description corresponding to the error information.
本实施例中异常提示设备处理错误信息,生成简单易读的错误码和错误描述,具体地,包括:In this embodiment, the abnormal prompting device processes the error information and generates a simple and easy-to-read error code and error description, which specifically includes:
步骤S20,调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表。Step S20: Invoke the error code client SDK, and request the error code server through the error code client SDK to request the abnormality and error code mapping table corresponding to the big data product.
本实施例中,异常提示设备中预先设置终端错误码SDK(software development kit,软件开发工具包,SDK是软件工程师为特定的软件包、软件框架、硬件平台、操作***等建立应用软件时的开发工具的集合),终端错误码SDK可以理解为用于错误信息分析的Java SDK和/或Python SDK。In this embodiment, the terminal error code SDK (software development kit, software development kit, SDK is a collection of development tools used by software engineers to build application software for specific software packages, software frameworks, hardware platforms, operating systems, etc.), terminal error code SDK can be understood as used for error information analysis Java SDK and/or Python SDK.
具体地,步骤S20包括:Specifically, step S20 includes:
步骤a1,获取所述大数据产品的产品标识,确定所述产品标识对应的错误码服务器,根据所述错误码服务器的节点信息和接口信息,调用错误码客户端SDK;Step a1: Obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
步骤a2,通过所述错误码客户端SDK中的错误码同步器,向所述错误码服务器请求所述大数据产品对应的异常与错误码映射关系表。Step a2, through the error code synchronizer in the error code client SDK, request the error code server for the abnormality and error code mapping table corresponding to the big data product.
本实施例中,异常提示设备获取大数据产品的产品标识,确定产品标识对应的错误码服务器,例如,大数据产品Hive对应的产品标识为001,异常提示设备获取001对应的错误码服务器,及错误码服务器的节点信息(Host)和接口信息(Port),异常提示设备根据节点信息和接口信息,调用错误码客户端SDK,通过错误码客户端SDK中的错误码同步器,向错误码服务器请求大数据产品对应的异常与错误码映射关系表。In this embodiment, the abnormal prompting device obtains the product ID of the big data product, and determines the error code server corresponding to the product ID. For example, the product ID corresponding to the big data product Hive is 001, and the abnormal prompting device obtains the error code server corresponding to 001, and The node information (Host) and interface information (Port) of the error code server, the abnormal prompt device calls the error code client SDK according to the node information and interface information, and sends the error code server to the error code server through the error code synchronizer in the error code client SDK. Request a mapping relationship table of exceptions and error codes corresponding to big data products.
可以理解的是,由于异常与错误码映射关系表是动态更新的,因此,错误码客户端SDK中设置有错误码同步器和错误码管理器,错误码同步器是指预先设置的用于请求异常与错误码映射关系表的虚拟模块,错误码同步器可以定期或者不定期地向错误码服务器请求异常与错误码映射关系表;错误码管理器是指预先设置的用于管理异常与错误码映射关系表的虚拟模块,错误码处理器可以对不同的异常与错误码映射关系表进行管理。It is understandable that because the mapping relationship between exceptions and error codes is dynamically updated, the error code synchronizer and error code manager are set in the error code client SDK. The error code synchronizer refers to the preset for request The virtual module of the abnormal and error code mapping table, the error code synchronizer can periodically or irregularly request the abnormal and error code mapping table from the error code server; the error code manager refers to the preset used to manage exceptions and error codes The virtual module of the mapping table, the error code processor can manage different abnormal and error code mapping tables.
即,本实施例中错误码客户端SDK先向错误码管理器请求异常与错误码映射关系表,错误码管理器接收误码客户端SDK的请求,错误码管理器查询当前是否存在请求对应的异常与错误码映射关系表;若当前存在请求对应的异常与错误码映射关系表,则错误码管理器将请求对应的异常与错误码映射关系表发送至错误码客户端SDK,若当前不存在请求的异常与错误码映射关系表,错误码管理器通过错误码同步器,向错误码服务器请求大数据产品对应的异常与错误码映射关系表。That is, in this embodiment, the error code client SDK first requests the error code manager for the mapping relationship between the exception and the error code, the error code manager receives the request of the error code client SDK, and the error code manager queries whether there is a corresponding request Exception and error code mapping relationship table; if there is currently a request corresponding exception and error code mapping relationship table, the error code manager will send the request corresponding exception and error code mapping relationship table to the error code client SDK, if it does not currently exist The requested exception and error code mapping relationship table, the error code manager requests the error code server for the corresponding exception and error code mapping table of the big data product through the error code synchronizer.
此外,本实施例中将异常与错误码映射关系表设置于错误码服务器,一方面可以实时有效地更新异常与错误码映射关系表,另外一方面可以减少异常提示设备存储空间的占用率。In addition, in this embodiment, the abnormality and error code mapping table is set in the error code server, on the one hand, the abnormality and error code mapping table can be updated effectively in real time, and on the other hand, the storage space occupancy rate of the abnormal notification device can be reduced.
本实施例中异常提示设备中预先设置错误码客户端SDK,通过错误码客户端SDK向错误码服务器请求异常与错误码映射关系表,以根据异常与错误码映射关系表处理错误信息,具体地:In this embodiment, the error code client SDK is preset in the abnormality prompting device, and the error code client SDK requests the error code server to process the error information according to the abnormality and error code mapping table. Specifically :
步骤S30,在所述异常与错误码映射关系表请求成功时,通过所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器。Step S30, when the request for the abnormality and error code mapping relationship table is successful, an error code processor is instantiated according to the abnormality and error code mapping relationship table through the error code client SDK.
异常提示设备在异常与错误码映射关系表请求成功时,异常提示设备通过错误码客户端SDK根据异常与错误码映射关系表实例化出错误码处理器,即,错误码客户端SDK获取异常与错误码映射关系表中预先设置的错误码处理器的程序段,并将程序段进行实例化(在面向对象的编程中,通常把用类创建对象的过程称为实例化),从而得到各个错误码处理器,其中,错误码处理器可以理解为处理错误信息的虚拟模块,错误码处理器的类型不作具体限定。When the request of the abnormality and error code mapping table is successful, the abnormality prompting device instantiates the error code processor through the error code client SDK according to the abnormality and error code mapping table, that is, the error code client SDK obtains the exception and The program segment of the error code processor is preset in the error code mapping table, and the program segment is instantiated (in object-oriented programming, the process of creating an object with a class is usually called instantiation) to obtain each error Code processor, where the error code processor can be understood as a virtual module for processing error information, and the type of error code processor is not specifically limited.
步骤S40,通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。Step S40, processing the error information by the error code processor to obtain and output an error code and an error description that match the error information.
具体地,包括:Specifically, it includes:
步骤      b1,通过所述错误码处理器根据预设的正则表达式处理所述错误信息,判断是否存在与所述错误信息匹配的错误码和错误描述;In step b1, the error code processor processes the error information according to a preset regular expression, and judges whether there is an error code and an error description that match the error information;
步骤      b2,若存在与所述错误信息匹配的错误码和错误描述,则输出所述错误码和所述错误描述。In step b2, if there is an error code and an error description that match the error information, output the error code and the error description.
本实施例中,异常提示设备对应的错误码处理器中预设有正则表达式,异常提示设备利用错误码处理器按照正则表达式,将错误信息与预设的各错误码和预设的各错误描述进行比对,判断是否存在与错误信息匹配的错误码和错误描述;若不存在与错误信息匹配的错误码和错误描述,则说明没有预先设置该错误信息对应的错误码和错误描述,异常提示设备不可以处理该错误信息,异常提示设备直接输出该错误信息;若存在与错误信息匹配的错误码和错误描述,则输出错误码和错误描述。In this embodiment, a regular expression is preset in the error code processor corresponding to the abnormality prompting device, and the abnormality prompting device uses the error code processor to compare the error information with the preset error codes and presets according to the regular expression. The error description is compared to determine whether there is an error code and error description that match the error message; if there is no error code and error description that match the error message, it means that the error code and error description corresponding to the error message are not preset. The abnormal prompting device cannot handle the error message, and the abnormal prompting device directly outputs the error message; if there is an error code and error description that match the error message, the error code and error description are output.
为了方便理解进行举例说明,下列程序段为异常与错误码映射关系表中一个映射关系的代码如下:In order to facilitate understanding, the following program segment is a mapping relationship code in the abnormal and error code mapping relationship table as follows:
interface ErrorCode {interface ErrorCode {
       Regex getErrorRegex();Regex getErrorRegex();
       int getErrorCode();Int getErrorCode();
       String getErrorDesc();String getErrorDesc();
}}
Get Error Regex返回一个正则表达式,并通过该正则表达式匹配错误信息,若存在与错误信息匹配的错误码和错误描述,则输出匹配到的错误码和错误描述,此外,异常提示设备截取匹配到的错误信息中的部分关键字段信息,并将该关键字段信息补充到get Error Desc里面,以方便后期更加准确地进行错误描述。Get Error Regex returns a regular expression and matches the error information through the regular expression. If there is an error code and error description that match the error information, the matched error code and error description are output. In addition, the exception prompts the device to intercept and match Part of the key field information in the error message received, and the key field information is added to get Error Desc to facilitate more accurate error description later.
本实施例中异常提示设备通过调用错误码客户端SDK,将大数据产品异常时生成的错误信息转化为规范化的错误码和错误描述并输出,一方面可以方便运维人员查看,使得运维人员根据错误码和错误描述快速地定位异常,了解异常原因并处理异常,提高了效率;另外一方面降低了对运维人员专业性的要求,普通的运维人员就处理大数据产品的异常,从而减少了人力成本。In this embodiment, the abnormality notification device calls the error code client SDK to convert the error information generated when the big data product is abnormal into a standardized error code and error description and output it. On the one hand, it is convenient for operation and maintenance personnel to view, so that operation and maintenance personnel According to the error code and error description, it can quickly locate anomalies, understand the cause of the anomaly and handle the anomaly, thereby improving efficiency; on the other hand, it reduces the professional requirements for operation and maintenance personnel, and ordinary operation and maintenance personnel deal with the abnormality of big data products. Reduce labor costs.
进一步地,基于本申请大数据产品的异常提示方法的第一实施例,提出了本申请大数据产品的异常提示方法的第二实施例。Further, based on the first embodiment of the method for prompting abnormalities of big data products of the present application, a second embodiment of the method for prompting abnormalities of big data products of the present application is proposed.
本实施例是第一实施例中步骤S40的细化,本实施例中给出了错误码处理器处理错误信息得到错误码和错误描述的具体实现方式,包括:This embodiment is a refinement of step S40 in the first embodiment. In this embodiment, a specific implementation method for the error code processor to process the error information to obtain the error code and error description is given, including:
在所述错误信息是日志文件时,通过所述日志文件处理器解析所述日志文件,得到与所述日志文件匹配的错误码和错误描述并输出;When the error information is a log file, the log file processor is used to parse the log file to obtain and output an error code and error description matching the log file;
在所述错误信息是日志信息时,通过所述日志信息处理器解析所述日志信息,得到与所述日志信息匹配的错误码和错误描述并输出;When the error information is log information, the log information is parsed by the log information processor to obtain and output an error code and error description that match the log information;
在所述错误信息是异常对象时,通过所述异常处理器解析所述异常对象,得到与所述异常对象匹配的错误码和错误描述并输出。When the error information is an abnormal object, the abnormal object is parsed by the abnormal processor to obtain and output an error code and an error description matching the abnormal object.
本实施例中,错误码处理器包括:日志文件处理器、日志信息处理器和异常处理器;错误码处理器处理错误信息的步骤,具体地:In this embodiment, the error code processor includes: a log file processor, a log information processor, and an exception processor; the steps for the error code processor to process error information, specifically:
参照图3,异常提示设备确定错误信息是日志文件时,异常提示设备通过日志文件处理器解析日志文件,得到日志文件对应的Java Exception,异常提示设备将Java Exception与预设的各错误码和预设的各错误描述进行比对,得到与日志文件匹配的错误码和错误描述并输出,同理,异常提示设备确定错误信息是日志信息时,异常提示设备通过日志信息处理器解析日志信息,得到与日志信息匹配的错误码和错误描述并输出;同理,异常提示设备在错误信息是异常对象时,通过异常处理器解析异常对象,得到与异常对象匹配的错误码和错误描述并输出。Referring to Figure 3, when the exception notification device determines that the error information is a log file, the exception notification device parses the log file through the log file processor to obtain the Java Exception corresponding to the log file. The exception notification device compares the Java Exception with the preset error codes and presets. Set each error description to compare, get the error code and error description that match the log file and output it. Similarly, when the abnormal prompting device determines that the error information is log information, the abnormal prompting device parses the log information through the log information processor to obtain The error code and error description matching the log information are output; in the same way, when the error message is an abnormal object, the exception notification device parses the abnormal object through the exception handler to obtain and output the error code and error description matching the abnormal object.
本实施例中异常提示设备根据异常与错误码映射关系表实例化出不同类型的错误码处理器,并利用不同类型错误码处理器处理错误信息,得到错误信息匹配的错误码和错误描述,使得错误信息的处理方式更加优化,效率更高。In this embodiment, the abnormality prompting device instantiates different types of error code processors according to the abnormality and error code mapping relationship table, and uses the different types of error code processors to process the error information to obtain the error code and error description matching the error information, so that The handling of error messages is more optimized and more efficient.
进一步地,基于本申请大数据产品的异常提示方法上述实施例,提出本申请大数据产品的异常提示方法的第三实施例。Further, based on the above-mentioned embodiments of the method for prompting anomaly of a big data product of this application, a third embodiment of the method for prompting anomaly of a big data product of the present application is proposed.
本实施例是第一实施例中步骤S40的之后的步骤,本实施例与上述实施例的区别在于:This embodiment is a step after step S40 in the first embodiment. The difference between this embodiment and the foregoing embodiment lies in:
若不存在与所述错误信息匹配的错误码和错误描述,则生成包含所述错误信息的映射表更新请求;If there is no error code and error description that match the error information, generate a mapping table update request containing the error information;
将所述映射表更新请求发送至所述错误码服务器,以使运维人员根据所述映射表更新请求中的所述错误信息更新所述异常与错误码映射关系表。The mapping table update request is sent to the error code server, so that the operation and maintenance personnel can update the abnormality and error code mapping relationship table according to the error information in the mapping table update request.
异常提示设备在确定不存在与错误信息匹配错误码和错误描述时,异常提示设备判定该错误信息未预先定义,此时,异常提示设备生成包含错误信息的映射表更新请求,异常提示设备将包含错误信息的映射表更新请求发送至错误码服务器,以使运维人员根据映射表更新请求中的错误信息更新异常与错误码映射关系表。When the abnormality notification device determines that there is no matching error code and error description with the error information, the abnormality notification device determines that the error information is not predefined. At this time, the abnormality notification device generates a mapping table update request containing the error information, and the abnormality notification device will include The error information mapping table update request is sent to the error code server, so that the operation and maintenance personnel can update the abnormal and error code mapping relationship table according to the error information in the mapping table update request.
本实施例中,异常提示设备在没有匹配到错误信息对应的错误码和错误描述时,异常提示设备生成包含错误信息的映射表更新请求,并发送至错误码服务器,使得运维人员可以实时地更新异常与错误码映射关系表,使得错误信息可以按照更新的异常与错误码映射关系表,进行快速地处理。In this embodiment, when the abnormal prompting device does not match the error code and error description corresponding to the error information, the abnormal prompting device generates a mapping table update request containing the error information and sends it to the error code server, so that the operation and maintenance personnel can real-time Update the abnormal and error code mapping relationship table, so that the error information can be quickly processed according to the updated abnormal and error code mapping relationship table.
参照图4,图4为本申请大数据产品的异常提示方法第四实施例的流程示意图,本实施例中所述大数据产品的异常提示方法包括如下步骤:Referring to Fig. 4, Fig. 4 is a schematic flowchart of a fourth embodiment of an abnormality prompting method for a big data product according to this application. The abnormality prompting method for a big data product in this embodiment includes the following steps:
步骤S50,在接收到映射表更新请求时,获取所述映射表更新请求对应的错误信息,及所述错误信息对应大数据产品的产品标识。Step S50, upon receiving the mapping table update request, obtain the error information corresponding to the mapping table update request, and the product identifier of the big data product corresponding to the error information.
本实施例中的大数据产品的异常提示方法应用于错误码服务器,错误码服务器接收映射表更新请求,映射表更新请求的触发方式不作具体限定,即,映射表更新请求可以是用户主动触发的,还可以是错误码服务器自动触发的。The abnormal prompting method for big data products in this embodiment is applied to the error code server. The error code server receives the mapping table update request. The triggering method of the mapping table update request is not specifically limited, that is, the mapping table update request may be triggered by the user actively , It can also be triggered automatically by the error code server.
错误码服务器在接收到映射表更新请求时,错误码服务器获取映射表更新请求对应的错误信息,及错误信息对应大数据产品的产品标识,产品标识是指标识大数据产品的信息。When the error code server receives the mapping table update request, the error code server obtains the error information corresponding to the mapping table update request, and the error information corresponds to the product identifier of the big data product. The product identifier refers to information identifying the big data product.
步骤S60,输出包含所述错误信息的更新窗口,以使运维人员根据所述错误信息设置异常与错误码映射关系。Step S60: Output an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information.
错误码服务器输出包含错误信息的更新窗口,即,错误码服务器发送更新窗口至预设的运维终端,以使运维终端对应的运维人员根据错误信息设置异常与错误码映射关系。The error code server outputs an update window containing error information, that is, the error code server sends the update window to a preset operation and maintenance terminal, so that the operation and maintenance personnel corresponding to the operation and maintenance terminal can set the mapping relationship between the exception and the error code according to the error information.
步骤S70,接收基于所述更新窗口输入的异常与错误码映射关系,将所述异常与错误码映射关系更新到所述产品标识对应的异常与错误码映射关系表。Step S70, receiving the mapping relationship between the abnormality and the error code input based on the update window, and updating the mapping relationship between the abnormality and the error code to the abnormal and error code mapping relationship table corresponding to the product identification.
错误码服务器接收基于更新窗口输入的异常与错误码映射关系,错误码服务器将异常与错误码映射关系更新到产品标识对应的异常与错误码映射关系表中,以实现异常与错误码映射关系表的更新。可以理解的是,在新增大数据产品时,可以在错误码服务器上创建新的异常与错误码映射关系表,在本实施例中错误码服务器可以实时地更新异常与错误码映射关系表,保证数据处理的实时性。The error code server receives the mapping relationship between the exception and the error code input based on the update window, and the error code server updates the mapping relationship between the exception and the error code to the mapping relationship table of the exception and the error code corresponding to the product identification to realize the mapping relationship between the exception and the error code. Update. It is understandable that when a big data product is newly added, a new abnormality and error code mapping relationship table can be created on the error code server. In this embodiment, the error code server can update the abnormality and error code mapping relationship table in real time. Ensure real-time data processing.
参照图5,图5为本申请大数据产品的异常提示装置一实施例的功能模块示意图,所述大数据产品的异常提示装置设置于异常提示设备,所述大数据产品的异常提示装置包括:Referring to Fig. 5, Fig. 5 is a schematic diagram of functional modules of an embodiment of an abnormality prompting device for a big data product of this application. The abnormality prompting device of the big data product is set in an abnormality prompting device, and the abnormality prompting device of the big data product includes:
检测获取模块10,用于在检测到大数据产品出现异常时,获取所述异常对应的错误信息;The detection and acquisition module 10 is configured to obtain error information corresponding to the abnormality when an abnormality is detected in the big data product;
调用请求模块20,用于调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;The call request module 20 is used to call the error code client SDK, and request the error code server through the error code client SDK to request the abnormality and error code mapping table corresponding to the big data product;
实例化模块30,用于在所述异常与错误码映射关系表请求成功时,通过所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;The instantiation module 30 is configured to instantiate an error code processor according to the abnormality and error code mapping relationship table through the error code client SDK when the request for the abnormality and error code mapping relationship table is successful;
匹配输出模块40,用于通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The matching output module 40 is configured to process the error information through the error code processor to obtain and output an error code and an error description that match the error information.
在一实施例中,所述调用请求模块30,包括:In an embodiment, the call request module 30 includes:
调用单元,用于获取所述大数据产品的产品标识,确定所述产品标识对应的错误码服务器,根据所述错误码服务器的节点信息和接口信息,调用错误码客户端SDK;The calling unit is used to obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
请求单元,用于通过所述错误码客户端SDK中的错误码同步器,向所述错误码服务器请求所述大数据产品对应的异常与错误码映射关系表。The request unit is configured to request the error code server for the mapping relationship table between the abnormality and the error code corresponding to the big data product through the error code synchronizer in the error code client SDK.
在一实施例中,所述错误码处理器包括:日志文件处理器、日志信息处理器和异常处理器;In an embodiment, the error code processor includes: a log file processor, a log information processor, and an exception processor;
所述匹配输出模块40,包括:The matching output module 40 includes:
第一输出模块,用于在所述错误信息是日志文件时,通过所述日志文件处理器解析所述日志文件,得到与所述日志文件匹配的错误码和错误描述并输出;The first output module is configured to, when the error information is a log file, parse the log file through the log file processor to obtain and output an error code and error description that match the log file;
第二输出单元,用于在所述错误信息是日志信息时,通过所述日志信息处理器解析所述日志信息,得到与所述日志信息匹配的错误码和错误描述并输出;The second output unit is configured to, when the error information is log information, parse the log information through the log information processor to obtain and output an error code and an error description that match the log information;
第三输出单元,用于在所述错误信息是异常对象时,通过所述异常处理器解析所述异常对象,得到与所述异常对象匹配的错误码和错误描述并输出。The third output unit is configured to, when the error information is an abnormal object, parse the abnormal object through the abnormal processor to obtain and output an error code and error description matching the abnormal object.
在一实施例中,所述匹配输出模块40,包括:In an embodiment, the matching output module 40 includes:
处理判断单元,用于通过所述错误码处理器根据预设的正则表达式处理所述错误信息,判断是否存在与所述错误信息匹配的错误码和错误描述;A processing judgment unit, configured to process the error information according to a preset regular expression through the error code processor, and determine whether there is an error code and an error description that match the error information;
信息输出单元,用于若存在与所述错误信息匹配的错误码和错误描述,则输出所述错误码和所述错误描述。The information output unit is configured to output the error code and the error description if there is an error code and an error description that match the error information.
在一实施例中,所述的大数据产品的异常提示装置,包括:In an embodiment, the abnormal notification device of the big data product includes:
请求生成模块,用于若不存在与所述错误信息匹配的错误码和错误描述,则生成包含所述错误信息的映射表更新请求;A request generating module, configured to generate a mapping table update request containing the error information if there is no error code and error description matching the error information;
请求发送模块,用于将所述映射表更新请求发送至所述错误码服务器,以使运维人员根据所述映射表更新请求中的所述错误信息更新所述异常与错误码映射关系表。The request sending module is configured to send the mapping table update request to the error code server, so that the operation and maintenance personnel can update the abnormal and error code mapping relationship table according to the error information in the mapping table update request.
上述各程序模块所执行的方法可参照本申请大数据产品的异常提示方法各个实施例,此处不再赘述。For the methods executed by the above-mentioned program modules, please refer to the various embodiments of the abnormal prompting method of the big data product of this application, which will not be repeated here.
参照图6,图6为本申请大数据产品的异常提示装置另一实施例的功能模块示意图,所述大数据产品的异常提示装置设置于错误码服务器,所述大数据产品的异常提示装置包括:Referring to Figure 6, Figure 6 is a schematic diagram of functional modules of another embodiment of an abnormal prompting device for a big data product of the application. The abnormal prompting device of the big data product is set in an error code server, and the abnormal prompting device of the big data product includes :
请求接收模块50,用于在接收到映射表更新请求时,获取所述映射表更新请求对应的错误信息,及所述错误信息对应大数据产品的产品标识;The request receiving module 50 is configured to obtain the error information corresponding to the mapping table update request and the product identifier of the big data product corresponding to the error information when the mapping table update request is received;
窗口输出模块60,用于输出包含所述错误信息的更新窗口,以使运维人员根据所述错误信息设置异常与错误码映射关系;The window output module 60 is configured to output an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information;
映射更新模块70,用于接收基于所述更新窗口输入的异常与错误码映射关系,将所述异常与错误码映射关系更新到所述产品标识对应的异常与错误码映射关系表。The mapping update module 70 is configured to receive the abnormality and error code mapping relationship input based on the update window, and update the abnormality and error code mapping relationship to the abnormality and error code mapping relationship table corresponding to the product identifier.
上述各程序模块所执行的方法可参照本申请大数据产品的异常提示方法各个实施例,此处不再赘述。For the methods executed by the above-mentioned program modules, please refer to the various embodiments of the abnormal prompting method of the big data product of this application, which will not be repeated here.
进一步地,在本申请大数据产品的异常提示***一实施例中,所述大数据产品的异常提示***包括通信连接的异常提示设备和错误码服务器,所述大数据产品的异常提示***,实现以下步骤:Further, in an embodiment of the abnormal prompting system for big data products of the present application, the abnormal prompting system of the big data product includes a communication-connected abnormal prompting device and an error code server. The abnormal prompting system of the big data product implements The following steps:
异常提示设备在检测到大数据产品出现异常时,获取所述异常对应的错误信息;When an abnormality notification device detects an abnormality in a big data product, obtain the error information corresponding to the abnormality;
异常提示设备调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;The abnormality prompting device invokes the error code client SDK, and requests the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
错误码服务器接收所述错误码客户端SDK发送的请求,所述错误码服务器根据所述请求中大数据产品的产品标识,获取所述产品标识对应的异常与错误码映射关系表并发送至异常提示设备;The error code server receives the request sent by the error code client SDK, and the error code server obtains the abnormality and error code mapping table corresponding to the product identifier according to the product identifier of the big data product in the request and sends it to the exception Reminder device
异常提示设备接收错误码服务器发送的所述异常与错误码映射关系表,异常提示设备中的所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;The abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
异常提示设备通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
进一步地,在本申请大数据产品的异常提示***一实施例的基础上提出了大数据产品的异常提示***另一实施例:Further, on the basis of an embodiment of the abnormal prompt system for big data products of the present application, another embodiment of the abnormal prompt system for big data products is proposed:
本实施例与本申请大数据产品的异常提示***上述实施例的区别在于:The difference between this embodiment and the above-mentioned embodiment of the abnormal prompt system for big data products of this application is:
异常提示设备预设时间段没有接收所述错误码服务器发送的异常与错误码映射关系表,异常提示设备生成包含所述错误信息的映射表更新请求,并将所述映射表更新请求发送至所述错误码服务器;The abnormality notification device does not receive the abnormality and error code mapping table sent by the error code server for a preset period of time, and the abnormality notification device generates a mapping table update request containing the error information, and sends the mapping table update request to all The error code server;
错误码服务器在接收到映射表更新请求时,获取所述映射表更新请求对应的错误信息,及所述错误信息对应大数据产品的产品标识;When the error code server receives the mapping table update request, obtain the error information corresponding to the mapping table update request, and the product identifier of the big data product corresponding to the error information;
错误码服务器输出包含所述错误信息的更新窗口,以使运维人员根据所述错误信息设置异常与错误码映射关系;The error code server outputs an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information;
错误码服务器接收基于所述更新窗口输入的异常与错误码映射关系,错误码服务器将所述异常与错误码映射关系更新到所述产品标识对应的异常与错误码映射关系表;The error code server receives the abnormality and error code mapping relationship input based on the update window, and the error code server updates the abnormality and error code mapping relationship to the abnormality and error code mapping relationship table corresponding to the product identification;
错误码服务器将更新后的所述异常与错误码映射关系表并发送至所述异常提示设备;The error code server sends the updated mapping relationship table between the abnormality and the error code to the abnormality prompting device;
异常提示设备接收错误码服务器发送的所述异常与错误码映射关系表,异常提示设备中的所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;The abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
异常提示设备通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
上述大数据产品的异常提示***中异常提示设备和错误码服务器交互实现本申请大数据产品的异常提示方法各个实施例,此处不再赘述。The abnormal prompting device and the error code server in the abnormal prompting system of the above-mentioned big data product interact to implement the various embodiments of the abnormal prompting method of the big data product of the present application, which will not be repeated here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者***不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者***所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者***中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, It also includes other elements not explicitly listed, or elements inherent to the process, method, article, or system. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are for description only, and do not represent the superiority of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disk, optical disk), including several instructions to make a terminal device (can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of this application, or directly or indirectly used in other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (10)

  1. 一种大数据产品的异常提示方法,其中,所述大数据产品的异常提示方法应用于异常提示设备,所述大数据产品的异常提示方法包括如下步骤:A method for prompting abnormalities of big data products, wherein the method for prompting abnormalities of big data products is applied to abnormal prompting equipment, and the method for prompting abnormalities of big data products includes the following steps:
    在检测到大数据产品出现异常时,获取所述异常对应的错误信息;When an abnormality is detected in a big data product, obtaining error information corresponding to the abnormality;
    调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;Invoke the error code client SDK, and request the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
    在所述异常与错误码映射关系表请求成功时,通过所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;When the request for the abnormality and error code mapping relationship table is successful, an error code processor is instantiated according to the abnormality and error code mapping relationship table through the error code client SDK;
    通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The error information is processed by the error code processor to obtain and output an error code and an error description that match the error information.
  2. 如权利要求1所述的大数据产品的异常提示方法,其中,所述调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表的步骤,包括:The method for prompting an abnormality of a big data product according to claim 1, wherein the error code client SDK is invoked, and the error code client SDK requests the error code server for the abnormality and error code corresponding to the big data product The steps of the mapping table include:
    获取所述大数据产品的产品标识,确定所述产品标识对应的错误码服务器,根据所述错误码服务器的节点信息和接口信息,调用错误码客户端SDK;Obtain the product identifier of the big data product, determine the error code server corresponding to the product identifier, and call the error code client SDK according to the node information and interface information of the error code server;
    通过所述错误码客户端SDK中的错误码同步器,向所述错误码服务器请求所述大数据产品对应的异常与错误码映射关系表。The error code synchronizer in the error code client SDK is used to request the error code server for the mapping relationship between the abnormality and the error code corresponding to the big data product.
  3. 如权利要求1所述的大数据产品的异常提示方法,其中,所述错误码处理器包括:日志文件处理器、日志信息处理器和异常处理器;3. The method for prompting an exception for a big data product according to claim 1, wherein the error code processor comprises: a log file processor, a log information processor, and an exception processor;
    所述通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出的步骤,包括:The step of processing the error information by the error code processor to obtain and output an error code and an error description that match the error information includes:
    在所述错误信息是日志文件时,通过所述日志文件处理器解析所述日志文件,得到与所述日志文件匹配的错误码和错误描述并输出;When the error information is a log file, the log file processor is used to parse the log file to obtain and output an error code and error description matching the log file;
    在所述错误信息是日志信息时,通过所述日志信息处理器解析所述日志信息,得到与所述日志信息匹配的错误码和错误描述并输出;When the error information is log information, the log information is parsed by the log information processor to obtain and output an error code and error description that match the log information;
    在所述错误信息是异常对象时,通过所述异常处理器解析所述异常对象,得到与所述异常对象匹配的错误码和错误描述并输出。When the error information is an abnormal object, the abnormal object is parsed by the abnormal processor to obtain and output an error code and an error description matching the abnormal object.
  4. 如权利要求1至3任意一项所述的大数据产品的异常提示方法,其中,所述通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出的步骤,包括:The method for prompting an abnormality of a big data product according to any one of claims 1 to 3, wherein the error information is processed by the error code processor to obtain an error code and an error description that match the error information And output steps, including:
    通过所述错误码处理器根据预设的正则表达式处理所述错误信息,判断是否存在与所述错误信息匹配的错误码和错误描述;Processing the error information according to a preset regular expression by the error code processor, and determining whether there is an error code and an error description that match the error information;
    若存在与所述错误信息匹配的错误码和错误描述,则输出所述错误码和所述错误描述。If there is an error code and an error description that match the error information, output the error code and the error description.
  5. 如权利要求4所述的大数据产品的异常提示方法,其中,所述通过所述错误码处理器根据预设的正则表达式处理所述错误信息,判断是否存在与所述错误信息匹配的错误码和错误描述的步骤之后,包括:The method for prompting an abnormality of a big data product according to claim 4, wherein the error code processor processes the error information according to a preset regular expression to determine whether there is an error matching the error information After the code and error description steps, include:
    若不存在与所述错误信息匹配的错误码和错误描述,则生成包含所述错误信息的映射表更新请求;If there is no error code and error description that match the error information, generate a mapping table update request containing the error information;
    将所述映射表更新请求发送至所述错误码服务器,以使运维人员根据所述映射表更新请求中的所述错误信息更新所述异常与错误码映射关系表。The mapping table update request is sent to the error code server, so that the operation and maintenance personnel can update the abnormality and error code mapping relationship table according to the error information in the mapping table update request.
  6. 一种大数据产品的异常提示装置,其中,所述大数据产品的异常提示装置设置于异常提示设备,所述大数据产品的异常提示装置包括:An abnormality prompting device for a big data product, wherein the abnormality prompting device for the big data product is set in an abnormality prompting device, and the abnormality prompting device for the big data product includes:
    检测获取模块,用于在检测到大数据产品出现异常时,获取所述异常对应的错误信息;The detection and acquisition module is used to acquire error information corresponding to the abnormality when an abnormality is detected in the big data product;
    调用请求模块,用于调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;The calling request module is used to call the error code client SDK, and request the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
    实例化模块,用于在所述异常与错误码映射关系表请求成功时,通过所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;An instantiation module, which is used to instantiate an error code processor according to the abnormality and error code mapping relationship table through the error code client SDK when the request for the abnormality and error code mapping relationship table is successful;
    匹配输出模块,用于通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The matching output module is configured to process the error information through the error code processor to obtain and output an error code and an error description that match the error information.
  7. 一种大数据产品的异常提示***,其中,所述大数据产品的异常提示***包括通信连接的异常提示设备和错误码服务器,所述大数据产品的异常提示***,实现以下步骤:An abnormal prompting system for a big data product, wherein the abnormal prompting system for a big data product includes a communication-connected abnormal prompting device and an error code server, and the abnormal prompting system for a big data product implements the following steps:
    异常提示设备在检测到大数据产品出现异常时,获取所述异常对应的错误信息;When an abnormality notification device detects an abnormality in a big data product, obtain the error information corresponding to the abnormality;
    异常提示设备调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表;The abnormality prompting device invokes the error code client SDK, and requests the error code server through the error code client SDK to request the corresponding abnormality and error code mapping table of the big data product;
    错误码服务器接收所述错误码客户端SDK发送的请求,所述错误码服务器根据所述请求中大数据产品的产品标识,获取所述产品标识对应的异常与错误码映射关系表并发送至异常提示设备;The error code server receives the request sent by the error code client SDK, and the error code server obtains the abnormality and error code mapping table corresponding to the product identifier according to the product identifier of the big data product in the request and sends it to the exception Reminder device
    异常提示设备接收错误码服务器发送的所述异常与错误码映射关系表,异常提示设备中的所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;The abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
    异常提示设备通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
  8. 如权利要求7所述的大数据产品的异常提示***,其中,所述异常提示设备调用错误码客户端SDK,通过所述错误码客户端SDK向错误码服务器请求所述大数据产品对应的异常与错误码映射关系表的步骤之后,包括:The abnormality notification system for big data products according to claim 7, wherein the abnormality notification device invokes the error code client SDK, and requests the error code server for the abnormality corresponding to the big data product through the error code client SDK After the steps of the mapping relationship table with error codes, include:
    异常提示设备预设时间段没有接收所述错误码服务器发送的异常与错误码映射关系表,异常提示设备生成包含所述错误信息的映射表更新请求,并将所述映射表更新请求发送至所述错误码服务器;The abnormality notification device does not receive the abnormality and error code mapping table sent by the error code server for a preset period of time, and the abnormality notification device generates a mapping table update request containing the error information, and sends the mapping table update request to all The error code server;
    错误码服务器在接收到映射表更新请求时,获取所述映射表更新请求对应的错误信息,及所述错误信息对应大数据产品的产品标识;When the error code server receives the mapping table update request, obtain the error information corresponding to the mapping table update request, and the product identifier of the big data product corresponding to the error information;
    错误码服务器输出包含所述错误信息的更新窗口,以使运维人员根据所述错误信息设置异常与错误码映射关系;The error code server outputs an update window containing the error information, so that the operation and maintenance personnel can set the mapping relationship between the exception and the error code according to the error information;
    错误码服务器接收基于所述更新窗口输入的异常与错误码映射关系,错误码服务器将所述异常与错误码映射关系更新到所述产品标识对应的异常与错误码映射关系表;The error code server receives the abnormality and error code mapping relationship input based on the update window, and the error code server updates the abnormality and error code mapping relationship to the abnormality and error code mapping relationship table corresponding to the product identification;
    错误码服务器将更新后的所述异常与错误码映射关系表并发送至所述异常提示设备;The error code server sends the updated mapping relationship table between the abnormality and the error code to the abnormality prompting device;
    异常提示设备接收错误码服务器发送的所述异常与错误码映射关系表,异常提示设备中的所述错误码客户端SDK根据所述异常与错误码映射关系表实例化出错误码处理器;The abnormality prompting device receives the abnormality and error code mapping relationship table sent by the error code server, and the error code client SDK in the abnormality prompting device instantiates an error code processor according to the abnormality and error code mapping relationship table;
    异常提示设备通过所述错误码处理器处理所述错误信息,得到与所述错误信息匹配的错误码和错误描述并输出。The abnormality notification device processes the error information through the error code processor, and obtains and outputs an error code and an error description that match the error information.
  9. 一种大数据产品的异常提示设备,其中,所述大数据产品的异常提示设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的大数据产品的异常提示程序,所述大数据产品的异常提示程序被所述处理器执行时实现如权利要求1至5中任一项所述的大数据产品的异常提示方法的步骤。An abnormality prompting device for a big data product, wherein the abnormality prompting device for the big data product includes: a memory, a processor, and an abnormality prompt for a big data product that is stored in the memory and can run on the processor A program, when the abnormal prompt program of the big data product is executed by the processor, the steps of the abnormal prompt method of the big data product according to any one of claims 1 to 5 are realized.
  10. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有大数据产品的异常提示程序,所述大数据产品的异常提示程序被处理器执行时实现如权利要求1至5中任一项所述的大数据产品的异常提示方法的步骤。A computer-readable storage medium, wherein an abnormal prompt program of a big data product is stored on the computer-readable storage medium, and the abnormal prompt program of the big data product is implemented by a processor as in claims 1 to 5 Any of the steps of the method for prompting abnormalities of big data products.
PCT/CN2020/102541 2019-07-19 2020-07-17 Exception prompting method, apparatus, system and device for big data product, and medium WO2021013058A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910658814.7A CN110347560B (en) 2019-07-19 2019-07-19 Method, device, system, equipment and medium for prompting abnormity of big data product
CN201910658814.7 2019-07-19

Publications (1)

Publication Number Publication Date
WO2021013058A1 true WO2021013058A1 (en) 2021-01-28

Family

ID=68179477

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/102541 WO2021013058A1 (en) 2019-07-19 2020-07-17 Exception prompting method, apparatus, system and device for big data product, and medium

Country Status (2)

Country Link
CN (1) CN110347560B (en)
WO (1) WO2021013058A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113626234A (en) * 2021-06-30 2021-11-09 济南浪潮数据技术有限公司 Exception handling method and device, electronic equipment and readable storage medium
CN115994097A (en) * 2023-03-22 2023-04-21 云账户技术(天津)有限公司 Method and device for generating abnormal cash-out use cases based on error codes
CN117235107A (en) * 2023-11-10 2023-12-15 恒生电子股份有限公司 Data access processing method and device, electronic equipment and storage medium

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110347560B (en) * 2019-07-19 2022-04-26 深圳前海微众银行股份有限公司 Method, device, system, equipment and medium for prompting abnormity of big data product
CN110928715A (en) * 2019-10-22 2020-03-27 北京字节跳动网络技术有限公司 Method, device, medium and electronic equipment for prompting error description information
CN112861529A (en) * 2019-11-27 2021-05-28 北京沃东天骏信息技术有限公司 Method and device for managing error codes
CN110825072B (en) * 2019-11-29 2020-08-28 安徽江淮汽车集团股份有限公司 Automobile fault diagnosis method, equipment, storage medium and device
CN110908699B (en) * 2019-11-29 2024-01-23 中国银行股份有限公司 Error code processing method, device, equipment and readable storage medium
CN111274060B (en) * 2020-02-10 2023-07-28 广州虎牙科技有限公司 Method, device, equipment and storage medium for determining memory exception
CN111988384B (en) * 2020-08-10 2022-08-30 北京百度网讯科技有限公司 Information transmission method and device, electronic equipment and storage medium
CN112148596B (en) * 2020-09-15 2024-03-22 北京百度网讯科技有限公司 Method and device for generating error reporting content of deep learning framework
CN112486823B (en) * 2020-11-30 2023-06-09 建信金融科技有限责任公司 Error code verification method and device, electronic equipment and readable storage medium
CN112446011B (en) * 2020-12-02 2023-06-02 视若飞信息科技(上海)有限公司 Watermark identification and error code copyright judgment method
CN112559233B (en) * 2020-12-14 2023-01-10 中国建设银行股份有限公司 Method, device, equipment and computer readable medium for identifying fault type
CN112685211B (en) * 2021-01-04 2024-06-04 北京金山云网络技术有限公司 Error information display method and device, electronic equipment and medium
CN114357028A (en) * 2021-12-31 2022-04-15 宁波舜宇智能科技有限公司 Abnormal state detection method and device for state machine, electronic device and storage medium
CN114418019A (en) * 2022-01-24 2022-04-29 平安科技(深圳)有限公司 Method, device and equipment for processing defect task and storage medium
CN115454697B (en) * 2022-09-15 2023-04-07 中航信移动科技有限公司 Information processing method and device for service exception, electronic equipment and storage medium
CN115904792A (en) * 2023-01-06 2023-04-04 恒丰银行股份有限公司 Self-adaptive self-interpretation error code processing method, system, terminal and memory
CN116010016A (en) * 2023-03-27 2023-04-25 北京沐融信息科技股份有限公司 Method, device, electronic equipment and medium for switching abnormal languages of service by system
CN117556809B (en) * 2024-01-11 2024-03-29 上海银基信息安全技术股份有限公司 Parameter verification result generation method and device, verification platform and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102810077A (en) * 2012-06-29 2012-12-05 北京奇虎科技有限公司 Abnormal hardware detecting method and device
CN104199819A (en) * 2014-07-03 2014-12-10 北京思特奇信息技术股份有限公司 WEB system error processing method and device
CN104503918A (en) * 2015-01-12 2015-04-08 北京国双科技有限公司 Handling method and device for abnormal information
CN109146095A (en) * 2018-08-24 2019-01-04 深圳壹账通智能科技有限公司 The treating method and apparatus of multiservice system problem
CN109445770A (en) * 2018-10-16 2019-03-08 武汉斗鱼网络科技有限公司 A kind of processing method of error code, device, medium and equipment
US20190196795A1 (en) * 2017-12-21 2019-06-27 Sas Institute Inc. Automated streaming data model generation
CN110347560A (en) * 2019-07-19 2019-10-18 深圳前海微众银行股份有限公司 Abnormal prompt method, apparatus, system, equipment and the medium of big data product

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002328816A (en) * 2001-04-27 2002-11-15 Ntt Data Corp Information collection method, server and program
CN107038041B (en) * 2016-12-27 2021-03-02 创新先进技术有限公司 Data processing method, error code dynamic compatibility method, device and system
CN108170551B (en) * 2018-01-03 2021-06-22 深圳壹账通智能科技有限公司 Crawler system based front-end and back-end error processing method, server and storage medium
CN108920364A (en) * 2018-06-21 2018-11-30 深圳壹账通智能科技有限公司 Software defect positioning method, device, terminal and computer readable storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102810077A (en) * 2012-06-29 2012-12-05 北京奇虎科技有限公司 Abnormal hardware detecting method and device
CN104199819A (en) * 2014-07-03 2014-12-10 北京思特奇信息技术股份有限公司 WEB system error processing method and device
CN104503918A (en) * 2015-01-12 2015-04-08 北京国双科技有限公司 Handling method and device for abnormal information
US20190196795A1 (en) * 2017-12-21 2019-06-27 Sas Institute Inc. Automated streaming data model generation
CN109146095A (en) * 2018-08-24 2019-01-04 深圳壹账通智能科技有限公司 The treating method and apparatus of multiservice system problem
CN109445770A (en) * 2018-10-16 2019-03-08 武汉斗鱼网络科技有限公司 A kind of processing method of error code, device, medium and equipment
CN110347560A (en) * 2019-07-19 2019-10-18 深圳前海微众银行股份有限公司 Abnormal prompt method, apparatus, system, equipment and the medium of big data product

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113626234A (en) * 2021-06-30 2021-11-09 济南浪潮数据技术有限公司 Exception handling method and device, electronic equipment and readable storage medium
CN115994097A (en) * 2023-03-22 2023-04-21 云账户技术(天津)有限公司 Method and device for generating abnormal cash-out use cases based on error codes
CN115994097B (en) * 2023-03-22 2023-05-16 云账户技术(天津)有限公司 Method and device for generating abnormal cash-out use cases based on error codes
CN117235107A (en) * 2023-11-10 2023-12-15 恒生电子股份有限公司 Data access processing method and device, electronic equipment and storage medium
CN117235107B (en) * 2023-11-10 2024-01-26 恒生电子股份有限公司 Data access processing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN110347560A (en) 2019-10-18
CN110347560B (en) 2022-04-26

Similar Documents

Publication Publication Date Title
WO2021013058A1 (en) Exception prompting method, apparatus, system and device for big data product, and medium
CN111309374B (en) Micro-service system and service calling method in micro-service system
US7536697B2 (en) Integrating enterprise support systems
US8700781B2 (en) Automated processing of service requests using structured messaging protocols
US20060193321A1 (en) System and method for continuously provisioning a mobile device
US9098827B2 (en) Interactive query tool
CN104636678B (en) The method and system of management and control is carried out under a kind of cloud computing environment to terminal device
CN101388903B (en) Mobile enterprise IT standardization management platform
US9154580B2 (en) Connection management in a computer networking environment
WO2021000416A1 (en) Micro-service early warning method and apparatus based on management platform, and computer device
US8938680B2 (en) Methods and apparatus for E-mail-based management of virtualized environments
WO2019223099A1 (en) Application program calling method and system
CN114513762B (en) Service processing method, device, electronic equipment and computer readable medium
US20240214472A1 (en) Communication protocol conversion method, and device, system, and gateway device
KR100601023B1 (en) Integrated communication server and method
US7711518B2 (en) Methods, systems and computer program products for providing system operational status information
CN110661717A (en) Current limiting method and device and electronic equipment
CN112596931A (en) Cross-process communication method and device, electronic equipment and storage medium
CN111163074B (en) Gateway service control method and device
CN111694620A (en) Interaction method, device and equipment of third-party service and computer storage medium
CN108768727B (en) Method for accessing third-party service, electronic device and readable storage medium
WO2023125755A1 (en) Service request processing method and apparatus based on large-scale cluster, and device and medium
WO2023208132A1 (en) Api conversion system and access request processing method therefor, and electronic device and medium
CN115951923B (en) Subscription event management method, display system, device and storage medium
CN113342845B (en) Data synchronization method, computer device and readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20843046

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20843046

Country of ref document: EP

Kind code of ref document: A1