CN114564354A - Database performance monitoring method and device, electronic equipment and storage medium - Google Patents

Database performance monitoring method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114564354A
CN114564354A CN202210176084.9A CN202210176084A CN114564354A CN 114564354 A CN114564354 A CN 114564354A CN 202210176084 A CN202210176084 A CN 202210176084A CN 114564354 A CN114564354 A CN 114564354A
Authority
CN
China
Prior art keywords
data
target evaluation
process data
attribute
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210176084.9A
Other languages
Chinese (zh)
Inventor
谭洁帆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Agricultural Bank of China
Original Assignee
Agricultural Bank of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Agricultural Bank of China filed Critical Agricultural Bank of China
Priority to CN202210176084.9A priority Critical patent/CN114564354A/en
Publication of CN114564354A publication Critical patent/CN114564354A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3089Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3096Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents wherein the means or processing minimize the use of computing system or of computing system component resources, e.g. non-intrusive monitoring which minimizes the probe effect: sniffing, intercepting, indirectly deriving the monitored data from other directly available data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/32Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/323Visualisation of programs or trace data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3476Data logging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80Database-specific techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/805Real-time
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/865Monitoring of software

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Hardware Design (AREA)
  • Mathematical Physics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention discloses a database performance monitoring method and device, electronic equipment and a storage medium. The method comprises the following steps: when a data query request is received, recording process data generated when the data query request is processed; carrying out standardized processing on the process data to obtain target evaluation data; processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute; and performing association display on the target evaluation data and the target evaluation attribute. The problems that in the prior art, monitoring results are determined through manual query of SQL statements and based on the relation between certain performance parameters and reference threshold values, monitoring efficiency is low, cost is high, and accuracy of determining the monitoring results is poor are solved, timeliness and intuitiveness of database performance monitoring are improved while accuracy of determining the monitoring results is improved, performance maintenance is timely and efficiently carried out on the database, and cost waste is reduced.

Description

Database performance monitoring method and device, electronic equipment and storage medium
Technical Field
The embodiment of the invention relates to a computer processing technology, in particular to a database performance monitoring method, a database performance monitoring device, electronic equipment and a storage medium.
Background
With the development of technology digitization, data in an information system is increasingly huge, and in the process of data processing, a database processing system, such as SQL (Structured Query Language), is usually needed, so that when data processing is performed by using SQL, the data processing is fast and convenient. However, if the database is abnormal, the processing efficiency of the enterprise system is greatly affected, and further, cost loss is caused, so that the monitoring of the processing performance of the database is more and more important.
At present, in the method for monitoring the performance of the database in the prior art, a developer generally performs manual query on SQL statements and corresponding execution process data item by item, after acquiring the process data of a certain SQL statement, performance parameters in the process data are extracted, and when the data of a certain performance parameter exceeds a reference threshold, a user is prompted. However, in database application, with the development of business, a large number of complex SQL statements exist, and performance parameters are more and more abundant, and this way of determining a monitoring result through manual query of the SQL statements and based on the relationship between a certain performance parameter and a reference threshold value is not only low in efficiency and high in labor cost, but also extremely low in accuracy of determination of the monitoring result, so that the database cannot be timely and accurately maintained, and the problem of cost loss is caused.
Disclosure of Invention
Embodiments of the present invention provide a database performance monitoring method and apparatus, an electronic device, and a storage medium, so as to improve accuracy of determining a monitoring result, improve timeliness and intuition of database performance monitoring, achieve effects of timely and efficiently performing performance maintenance on a database, and reduce cost waste.
In a first aspect, an embodiment of the present invention provides a database performance monitoring method, where the method includes:
when a data query request is received, recording process data generated when the data query request is processed;
carrying out standardization processing on the process data to obtain target evaluation data for process evaluation;
processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute;
and performing relevant display on the target evaluation data and the target evaluation attribute.
In a second aspect, an embodiment of the present invention further provides a database performance monitoring apparatus, where the apparatus includes:
the process data recording module is used for recording process data generated when a data query request is processed when the data query request is received;
the target evaluation data determining module is used for carrying out standardized processing on the process data to obtain target evaluation data for process evaluation;
the target evaluation attribute determining module is used for processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute;
and the association display module is used for performing association display on the target evaluation data and the target evaluation attribute.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a database performance monitoring method as in any of the embodiments of the invention.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the database performance monitoring method according to any one of the embodiments of the present invention.
The technical scheme of the embodiment of the invention records the process data generated when the data query request is processed when the data query request is received, further normalizes the process data to obtain the target evaluation data for process evaluation, further processes the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain the target evaluation attribute, and performs associated display on the target evaluation data and the target evaluation attribute, thereby solving the problems of low monitoring efficiency, high cost and poor accuracy of monitoring result determination caused by manual query of SQL statements and the relation between a certain performance parameter and a reference threshold value in the prior art, realizing the normalization processing of the process data generated when the data query request is processed to obtain the target evaluation data for process evaluation, and then, the target evaluation attribute is determined based on the process data corresponding to each configuration item to be evaluated in the target evaluation data, the accuracy of determining the monitoring result is improved, meanwhile, the target evaluation data and the target evaluation attribute are displayed in a correlation mode, the timeliness and the intuitiveness of database performance monitoring are improved, the database is timely and efficiently maintained in performance, and the technical effect of reducing cost waste is achieved.
Drawings
In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, a brief description is given below of the drawings used in describing the embodiments. It should be clear that the described figures are only views of some of the embodiments of the invention to be described, not all, and that for a person skilled in the art, other figures can be derived from these figures without inventive effort.
Fig. 1 is a flowchart of a database performance monitoring method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a database performance monitoring method according to a second embodiment of the present invention;
fig. 3 is a block diagram of a database performance monitoring apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a database performance monitoring method according to an embodiment of the present invention, where this embodiment is applicable to monitoring database performance, and the method may be executed by a database performance monitoring apparatus according to an embodiment of the present invention, where the apparatus may be implemented in a software and/or hardware manner, and optionally, implemented by an electronic device, where the electronic device may be a mobile terminal, a PC terminal, a server terminal, or the like. The apparatus may be configured in a computing device, and the method for monitoring performance of a database provided in this embodiment specifically includes the following steps:
s110, when a data query request is received, recording process data generated when the data query request is processed.
The process data may be understood as execution data generated when a request operation is executed, such as an execution time length, a read request time length, a queried data amount, and the like, and the request operation may be an operation of adding, deleting, changing, querying, and the like to data.
In practical applications, a data query request may be considered to be received when a user triggers a control on a client page using an input device. For example, the data query request may be a select request corresponding to data query, a delete request corresponding to data deletion, an insert request corresponding to data addition, or an update request corresponding to data modification, and the input device may include at least one of a physical keyboard, a virtual keyboard, a sound collection device, a handwriting device, and a touch screen. At this time, a series of execution data generated when the data query request operation is executed may be recorded as the process data.
It should be noted that, when a data query request is received, process data generated when the data query request is processed is recorded, and a mechanism that needs to track the execution process of the data query request may also be set when the data query request is received, so that all process data generated when the data query request is processed is accurately and conveniently recorded based on the tracking mechanism.
Optionally, when a data query request is received, recording process data generated when the data query request is processed, including: when a data query request generated based on a trigger operation of a user is received, the execution process of the data query request is tracked, and process data generated when the data query request is processed is recorded.
In this embodiment, when a user triggers a control on a client page by using an input device, a request for operating a database, that is, a data query request, may be generated, and then an execution process of the data query request may be tracked by using a data acquisition tool, and process data generated when the data query request is processed may be recorded and obtained. For example, in an actual application, when a data query request is received, an SQL statement in the data query request to be executed may be transmitted as a parameter into a preset trace script, and at this time, an SQL _ trace (data collection tool) may be opened in the script for tracing an execution process of the SQL statement. After the system executes the SQL statement, a trace file (trace file) recording process data may be generated in the script, and it may be considered that the process data generated when the data query request is processed is obtained.
And S120, carrying out normalization processing on the process data to obtain target evaluation data for process evaluation.
The target evaluation data may be understood as parameter data for evaluating the performance of the database. Optionally, the target evaluation data may include, but is not limited to, a trace time length, a processor processing time length, a physical reading number, a number of query data records, a number of query data blocks, a number of modification data blocks, and the like.
It should be noted that, because there is no formatted data information in the information of the original trace file obtained based on the sql _ trace (data collection tool) trace record, readability is poor. In order to improve the accuracy of monitoring the performance of the Database, the Trace file can be converted into a normalized file format through a TKPROF (Trace Kernel Profile) tool carried by Oracle (Oracle Database, relational Database), so that the complexity of the Trace file is reduced, the Trace file is easy to understand and view, the performance of the Database is evaluated based on the converted normalized file data, and the evaluation accuracy is improved.
Specifically, after the trace file recorded with the process data is obtained, the TKPROF tool may be used to perform normalization on the process data in the trace file to obtain the trace file with high readability, for example, the normalization may be extraction, and data used for evaluating the performance of the database may be extracted from the process data to serve as target evaluation data, so that the performance of the processing process of the database may be subsequently evaluated based on the target evaluation data.
It should be noted that, before the process data is extracted and processed to obtain the target evaluation data for process evaluation, a plurality of SQL performance parameters may be preset according to actual requirements to accurately evaluate the performance of the database, so that after the process data is obtained, data matched with the preset parameters may be extracted from the process data to serve as the target evaluation data for evaluating the performance of the database.
Optionally, the normalizing the process data to obtain target evaluation data for process evaluation includes: and carrying out standardized processing on the process data based on at least one preset configuration item to obtain target evaluation data.
The preset configuration item may be understood as preset parameter information for evaluating the performance of the database, and for example, optionally, the preset configuration item may be tracking duration or physical reading times.
In practical application, the trace file containing the process data can be subjected to standardized processing by using a TKPROF tool, for example, the process data can be extracted based on a preset configuration item to obtain the process data containing the performance parameters of the evaluation database, and the process data is used as target evaluation data, so that the trace file with high readability is obtained correspondingly. It should be noted that the trace file processed by the TKPROF tool may include processing data for performing three parts, namely, parse, execute, and fetch, on each SQL statement. The parse step is to convert the SQL statement into an execution plan, e.g., to check for the correct authorization and the presence of tables, columns, and other referenced objects that need to be used. The execute step is actually an Oracle executed statement, which modifies data for insert, update, delete operations, and determines only the selected record for select operations. The fetch step returns the record obtained in the query statement, which is performed only by the select statement. Further, the analysis of each SQL statement can be seen in the normalized trace file, for example, the number of times each SQL statement is analyzed by parse, execute, fetch; when each SQL statement is in park, execute, fetch, the time length of cpu (central processing unit) consumed is in units of seconds; each SQL statement consumes the total duration of parse, execute and fetch; the number of blocks physically read from the data file on the disk; in a consistency reading mode, the number of buffers obtained by each SQL statement in case of parse, execute and fetch, wherein the buffers in the consistency mode are used for providing a snapshot of consistency reading for a long-time running transaction and are cached in a state stored at the head; the number of buffers obtained in the current mode, if a new cache is found in the cache region enough for the current transaction in the current mode, the buffers are all read into the cache region; the number of records returned by each SQL statement is in fetch step for select statement, and in execute step for insert, update and delete operation. Accordingly, the process data in the normalized trace file can be used as the target evaluation data.
S130, processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute.
In practical applications, after the target evaluation data is obtained, each performance evaluation parameter in the target evaluation data may be used as a configuration item to be evaluated, such as a tracking duration, a processor processing duration, a physical reading time, a number of query data records, a number of query data blocks, a number of modified data blocks, and the like. At this time, the process data corresponding to each configuration item to be evaluated may be evaluated, for example, by performing comparison processing, comparing each process data with preset threshold data, and determining whether each process data is abnormal, so as to obtain an evaluation result, that is, it may be considered that the target evaluation attribute is obtained. In order to improve the accuracy of determining the evaluation result, the process data corresponding to each configuration item to be evaluated may also be input into a performance evaluation model trained in advance, each process data is processed based on an evaluation function in the performance evaluation model, and the evaluation result is output as a target evaluation attribute.
In practical application, after the target evaluation data is obtained, the target evaluation data is also contained in the trace file after the normalization processing, and accordingly, the target evaluation data in the trace file can be analyzed, so that each configuration item to be evaluated and corresponding process data in the target evaluation data are obtained, and the performance of the database is evaluated based on the process data corresponding to each configuration item to be evaluated.
Optionally, processing process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute, including: analyzing the target evaluation data to obtain at least one configuration item to be evaluated; and performing fusion processing on the process data corresponding to each configuration item to be evaluated to obtain a target evaluation attribute.
In this embodiment, the target evaluation data provided by the normalized trace file may be analyzed to obtain information of each configuration item to be evaluated and corresponding process data in the target evaluation data, and then the process data corresponding to each configuration item to be evaluated may be input into a pre-trained performance evaluation model, and each process data is subjected to fusion processing based on an evaluation function in the performance evaluation model, for example, the evaluation function may be an evaluation function
Figure BDA0003520315720000091
Wherein S may be expressed as a target evaluation attribute; count may be expressed as the number of times the SQL statement is executed; the elapsed can be expressed as the total time length consumed in the park, execute and fetch, namely the tracking time length, wherein the tracking time length comprises the CPU consumption time length and the waiting time length; disk may be expressed as physical read times; row may be expressed as the number of query data records; the query may represent the number of data blocks read for the query statement; current may represent the number of data blocks read for the change statement. Further, a target evaluation attribute S may be output based on the evaluation function. It should be noted that, in practical applications, the setting of the evaluation function may be determined by a technician according to an actual working condition, and the technical solution is not limited to this.
It should be further noted that, some units of the process data corresponding to each configuration item to be evaluated include time and some units of the process data include quantity, and in order to improve the accuracy of fusion, normalization processing may be performed on each process data, and after process data with the same unit is obtained, fusion processing is performed on the process data corresponding to each configuration item to be evaluated, so as to obtain the target evaluation attribute.
Optionally, performing fusion processing on process data corresponding to each configuration item to be evaluated to obtain a target evaluation attribute, including: if the units of the process data corresponding to the configuration items to be evaluated are not consistent, performing normalization processing on the process data to obtain processed process data; and performing fusion processing on the processed process data to obtain the target evaluation attribute.
In practical application, the units of the process data corresponding to the configuration items to be evaluated can be compared, if the units are not consistent, the process data can be normalized by using an algorithm, so that the units of the process data are consistent, the process data after the normalization processing can be fused by using the algorithm, the target evaluation attribute is obtained, and the accuracy of result determination is improved.
It should be noted that, in a scene of monitoring the performance of the database, if an abnormality is found, and correspondingly, the abnormality may be notified to a developer, so that the developer can detect the database in time, thereby avoiding affecting the application and improving the timeliness of monitoring.
Optionally, after processing at least one to-be-used configuration parameter in the target evaluation data to obtain a target evaluation attribute corresponding to the execution data, the method further includes: and if the numerical value in the target evaluation attribute exceeds a preset evaluation threshold value, determining prompt information for process early warning based on the target evaluation attribute and corresponding target evaluation data.
In practical application, the target evaluation attribute and a preset evaluation threshold value of a numerical value in the target evaluation attribute can be compared in real time, when the numerical value in the target evaluation attribute exceeds the preset evaluation threshold value, the target evaluation attribute and corresponding target evaluation data can be filled into a preset reminding form, and the filled reminding form is used as prompt information for process early warning, so that a developer can quickly position and detect faults of a database based on information on the form.
S140, carrying out association display on the target evaluation data and the target evaluation attribute.
In this embodiment, after the target evaluation data and the corresponding target evaluation attribute are obtained, the two items of data may be pushed to the client for associated display, for example, an SQL performance display system may be developed in advance, and the target evaluation data and the corresponding target evaluation attribute may be visually displayed at the front end of a system webpage, for example, a mapping table page may be displayed for a user to view, so as to improve the intuitiveness and convenience of database performance monitoring.
It should be noted that, when the value in the target evaluation attribute exceeds the preset evaluation threshold, it may indicate that an abnormality occurs, and correspondingly, the determined prompt information for performing process early warning based on the target evaluation attribute and the corresponding target evaluation data may also be pushed to the client for display. The prompt message can also be sent to the device corresponding to the developer in the form of short message, voice or mail. Therefore, developers can visually and timely obtain abnormal information, and the timeliness of monitoring is improved.
Optionally, the associating and displaying the target evaluation data and the target evaluation attribute includes: and pushing the target evaluation data, the target evaluation attribute and the corresponding prompt information to the target equipment for associated display.
In practical application, if the value in the target evaluation attribute exceeds the preset evaluation threshold, the prompt information corresponding to the target evaluation attribute, the target evaluation attribute and the corresponding target evaluation data are pushed together to the target device for associated display. Optionally, the prompt information may be a prompt form containing the target evaluation attribute and the corresponding target evaluation data; or a callout prompt, such as adding a warning mark, enlarging a font, changing a font color, highlighting a font, etc., for the abnormal target evaluation attribute and the corresponding target evaluation data on the display screen of the target device.
According to the technical scheme of the embodiment, when a data query request is received, process data generated when the data query request is processed is recorded, the process data is further subjected to standardized processing, target evaluation data for process evaluation is obtained, process data corresponding to each configuration item to be evaluated in the target evaluation data is further processed, a target evaluation attribute is obtained, and the target evaluation data and the target evaluation attribute are displayed in an associated manner, so that the problems of low monitoring efficiency, high cost and poor accuracy of monitoring result determination caused by manual query of SQL statements and relation between a certain performance parameter and a reference threshold value in the prior art are solved, the purpose of carrying out standardized processing on the process data generated when the data query request is processed is achieved, and the target evaluation data for process evaluation is obtained, and then, determining a target evaluation attribute based on process data corresponding to each configuration item to be evaluated in the target evaluation data, improving the accuracy of determining a monitoring result, and simultaneously carrying out associated display on the target evaluation data and the target evaluation attribute, so that the timeliness and intuitiveness of database performance monitoring are improved, and the technical effects of timely and efficiently carrying out performance maintenance on the database and reducing cost waste are achieved.
Example two
As an alternative embodiment of the foregoing embodiment, fig. 2 is a schematic diagram of a database performance monitoring method according to a second embodiment of the present invention. Specifically, the following details can be referred to.
Referring to fig. 2, when a data query request (SQL statement) is received, the SQL statement to be executed is transmitted into a script as a parameter, when a parameter identifier is detected, an SQL _ trace (data tracking tool) is opened in the script, and after specific SQL is executed and processed, a trace file is generated based on process data generated when SQL is processed by the SQL _ trace record, wherein the trace file includes the process data. Because the original trace file has poor readability, the trace file can be converted into a normalized file format through a TKPROF (trace Kernel profile) tool carried by oracle to obtain the normalized trace file, meanwhile, the normalized trace file is analyzed and data extracted based on a preset configuration item, where the preset configuration item may be a count indicating how many times the current operation is executed, a tracking time (elapsed indicating a time duration shared by the current operations, including a cpu time duration consumed and a waiting time duration), a processor processing time (cpu, a time duration consumed by the current operation), a physical reading time (disk, a physical reading of the current operation), a query data record number (row, a data record number processed by the current operation), a read data block number (query & current, a data block number read in the current operation manner, a query data block number and a modified data block number, respectively), and the like. Further, target evaluation data may be obtained,
on the basis of the scheme, by analyzing the target evaluation data provided by the trace file, since the elapsed includes the cpu processing time length and the waiting time length, the cpu processing time length is not considered separately. The target evaluation data may be processed based on an evaluation function to obtain a target evaluation attribute, where the evaluation function may be:
Figure BDA0003520315720000131
wherein S may be expressed as a target evaluation attribute; count may be expressed as the number of times the SQL statement is executed; an elapsed can be expressed as the total time length consumed in chase, execute and fetch, namely the tracking time length, wherein the tracking time length comprises the CPU consumption time length and the waiting time length; disk may be expressed as a physical read number; row may be expressed as the number of query data records; the query may represent the number of data blocks read for the query statement; current may represent the number of data blocks read for the change statement; (count + elapsed + disk + query + current)totalCan be used forThe process data is represented as the sum of the process data corresponding to each configuration item to be evaluated, such as count, elapsed, disk, query and current. Further, a target evaluation attribute S may be output based on the evaluation function. It should be noted that, if the units of the process data corresponding to the configuration items to be evaluated in the target evaluation data are different, normalization processing may be performed on each process data, and then the process data after normalization processing is processed based on the evaluation function, so as to obtain the target evaluation attribute.
On the basis of the scheme, an SQL performance display system can be developed, and then the target evaluation data and the target evaluation attribute can be associated and visually displayed at the front end of a system webpage for a user to check.
According to the technical scheme of the embodiment, when a data query request is received, process data generated when the data query request is processed is recorded, the process data is further subjected to standardized processing, target evaluation data for process evaluation is obtained, process data corresponding to each configuration item to be evaluated in the target evaluation data is further processed, a target evaluation attribute is obtained, and the target evaluation data and the target evaluation attribute are displayed in an associated manner, so that the problems of low monitoring efficiency, high cost and poor accuracy of monitoring result determination caused by manual query of SQL statements and relation between a certain performance parameter and a reference threshold value in the prior art are solved, the purpose of carrying out standardized processing on the process data generated when the data query request is processed is achieved, and the target evaluation data for process evaluation is obtained, and then, determining a target evaluation attribute based on process data corresponding to each configuration item to be evaluated in the target evaluation data, improving the accuracy of determining a monitoring result, and simultaneously carrying out associated display on the target evaluation data and the target evaluation attribute, so that the timeliness and intuitiveness of database performance monitoring are improved, and the technical effects of timely and efficiently carrying out performance maintenance on the database and reducing cost waste are achieved.
EXAMPLE III
Fig. 3 is a block diagram of a database performance monitoring apparatus according to a third embodiment of the present invention. The device includes: a process data recording module 310, a target evaluation data determination module 320, a target evaluation attribute determination module 330, and an association presentation module 340.
The process data recording module 310 is configured to record, when a data query request is received, process data generated when the data query request is processed; a target evaluation data determining module 320, configured to perform normalization processing on the process data to obtain target evaluation data for process evaluation; the target evaluation attribute determining module 330 is configured to process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute; and the association display module 340 is configured to perform association display on the target evaluation data and the target evaluation attribute.
According to the technical scheme of the embodiment, when a data query request is received, process data generated when the data query request is processed is recorded, the process data is further subjected to standardized processing, target evaluation data for process evaluation is obtained, process data corresponding to each configuration item to be evaluated in the target evaluation data is further processed, a target evaluation attribute is obtained, and the target evaluation data and the target evaluation attribute are displayed in an associated manner, so that the problems of low monitoring efficiency, high cost and poor accuracy of monitoring result determination caused by manual query of SQL statements and relation between a certain performance parameter and a reference threshold value in the prior art are solved, the purpose of carrying out standardized processing on the process data generated when the data query request is processed is achieved, and the target evaluation data for process evaluation is obtained, and then, determining a target evaluation attribute based on process data corresponding to each configuration item to be evaluated in the target evaluation data, improving the accuracy of determining a monitoring result, and simultaneously carrying out associated display on the target evaluation data and the target evaluation attribute, so that the timeliness and intuitiveness of database performance monitoring are improved, and the technical effects of timely and efficiently carrying out performance maintenance on the database and reducing cost waste are achieved.
On the basis of the above device, optionally, the process data recording module 310 includes a process data recording unit.
And the process data recording unit is used for tracking the execution process of the data query request and recording process data generated when the data query request generated based on the trigger operation of the user is received.
On the basis of the above device, optionally, the target evaluation data determining module 320 includes a target evaluation data determining unit.
And the target evaluation data determining unit is used for carrying out standardized processing on the process data based on at least one preset configuration item to obtain target evaluation data.
On the basis of the foregoing apparatus, optionally, the target evaluation attribute determining module 330 includes a unit for determining a configuration item to be evaluated and a unit for determining a target evaluation attribute.
The to-be-evaluated configuration item determining unit is used for analyzing the target evaluation data to obtain at least one to-be-evaluated configuration item;
and the target evaluation attribute determining unit is used for performing fusion processing on the process data corresponding to each configuration item to be evaluated to obtain a target evaluation attribute.
On the basis of the foregoing apparatus, optionally, the target evaluation attribute determining unit includes a data normalization subunit and a target evaluation attribute determining subunit.
The data normalization subunit is used for performing normalization processing on each process data to obtain each processed process data if the units of the process data corresponding to each configuration item to be evaluated are inconsistent;
and the target evaluation attribute determining subunit is used for performing fusion processing on the processed process data to obtain a target evaluation attribute.
On the basis of the above device, optionally, the target evaluation attribute determination module 330 further includes a prompt information determination unit.
And the prompt information determining unit is used for determining prompt information for process early warning based on the target evaluation attribute and corresponding target evaluation data if the value in the target evaluation attribute exceeds a preset evaluation threshold value.
On the basis of the above device, optionally, the association display module 340 includes an association display unit.
And the association display unit is used for pushing the target evaluation data, the target evaluation attribute and the corresponding prompt information to target equipment for association display.
The database performance monitoring device provided by the embodiment of the invention can execute the database performance monitoring method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the embodiment of the invention.
Example four
Fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention. FIG. 4 illustrates a block diagram of an exemplary electronic device 40 suitable for use in implementing embodiments of the present invention. The electronic device 40 shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention.
As shown in fig. 4, electronic device 40 is embodied in the form of a general purpose computing device. The components of electronic device 40 may include, but are not limited to: one or more processors or processing units 401, a system memory 402, and a bus 403 that couples the various system components (including the system memory 402 and the processing unit 401).
Bus 403 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Electronic device 40 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 40 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 402 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)404 and/or cache memory 405. The electronic device 40 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 406 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 403 by one or more data media interfaces. Memory 402 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 408 having a set (at least one) of program modules 407 may be stored, for example, in memory 402, such program modules 407 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 407 generally perform the functions and/or methods of the described embodiments of the invention.
The electronic device 40 may also communicate with one or more external devices 409 (e.g., keyboard, pointing device, display 410, etc.), one or more devices that enable a user to interact with the electronic device 60, and/or any devices (e.g., network card, modem, etc.) that enable the electronic device 40 to communicate with one or more other computing devices. Such communication may be through input/output (I/O) interfaces 411. Also, the electronic device 40 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 412. As shown, the network adapter 412 communicates with the other modules of the electronic device 40 over the bus 403. It should be understood that although not shown in FIG. 4, other hardware and/or software modules may be used in conjunction with electronic device 40, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 401 executes various functional applications and data processing by executing programs stored in the system memory 402, for example, to implement the database performance monitoring method provided by the embodiment of the present invention.
EXAMPLE five
A fifth embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for database performance monitoring. The method comprises the following steps:
when a data query request is received, recording process data generated when the data query request is processed;
carrying out standardization processing on the process data to obtain target evaluation data for process evaluation;
processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute;
and performing relevant display on the target evaluation data and the target evaluation attribute.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (10)

1. A database performance monitoring method, comprising:
when a data query request is received, recording process data generated when the data query request is processed;
carrying out standardization processing on the process data to obtain target evaluation data for process evaluation;
processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute;
and performing relevant display on the target evaluation data and the target evaluation attribute.
2. The method of claim 1, wherein recording process data generated when the data query request is processed when the data query request is received comprises:
when a data query request generated based on a trigger operation of a user is received, tracking the execution process of the data query request, and recording process data generated when the data query request is processed.
3. The method of claim 1, wherein normalizing the process data to obtain target assessment data for process assessment comprises:
and carrying out standardized processing on the process data based on at least one preset configuration item to obtain target evaluation data.
4. The method according to claim 1, wherein the processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute comprises:
analyzing the target evaluation data to obtain at least one configuration item to be evaluated;
and performing fusion processing on the process data corresponding to each configuration item to be evaluated to obtain a target evaluation attribute.
5. The method according to claim 4, wherein the fusing the process data corresponding to each configuration item to be evaluated to obtain the target evaluation attribute comprises:
if the units of the process data corresponding to the configuration items to be evaluated are not consistent, performing normalization processing on the process data to obtain processed process data;
and performing fusion processing on the processed process data to obtain the target evaluation attribute.
6. The method according to claim 1, further comprising, after processing at least one configuration parameter to be used in the target evaluation data to obtain a target evaluation attribute corresponding to the execution data:
and if the numerical value in the target evaluation attribute exceeds a preset evaluation threshold value, determining prompt information for process early warning based on the target evaluation attribute and corresponding target evaluation data.
7. The method of claim 6, wherein the associating and presenting the target evaluation data and the target evaluation attribute comprises:
and pushing the target evaluation data, the target evaluation attribute and the corresponding prompt information to target equipment for associated display.
8. A database performance monitoring apparatus, comprising:
the process data recording module is used for recording process data generated when the data query request is processed when the data query request is received;
the target evaluation data determining module is used for carrying out standardized processing on the process data to obtain target evaluation data for process evaluation;
the target evaluation attribute determining module is used for processing the process data corresponding to each configuration item to be evaluated in the target evaluation data to obtain a target evaluation attribute;
and the association display module is used for performing association display on the target evaluation data and the target evaluation attribute.
9. An electronic device, characterized in that the device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the database performance monitoring method of any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of database performance monitoring according to any one of claims 1 to 7.
CN202210176084.9A 2022-02-25 2022-02-25 Database performance monitoring method and device, electronic equipment and storage medium Pending CN114564354A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210176084.9A CN114564354A (en) 2022-02-25 2022-02-25 Database performance monitoring method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210176084.9A CN114564354A (en) 2022-02-25 2022-02-25 Database performance monitoring method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114564354A true CN114564354A (en) 2022-05-31

Family

ID=81716768

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210176084.9A Pending CN114564354A (en) 2022-02-25 2022-02-25 Database performance monitoring method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114564354A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115841275A (en) * 2022-12-07 2023-03-24 北京鸿鹄元数科技有限公司 Physical examination method and device based on AI data management level

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115841275A (en) * 2022-12-07 2023-03-24 北京鸿鹄元数科技有限公司 Physical examination method and device based on AI data management level
CN115841275B (en) * 2022-12-07 2023-09-05 北京鸿鹄元数科技有限公司 Physical examination method and device based on AI (advanced technology attachment) data management level

Similar Documents

Publication Publication Date Title
CN109471851B (en) Data processing method, device, server and storage medium
CN109524070B (en) Data processing method and device, electronic equipment and storage medium
WO2020237877A1 (en) Log monitoring method and apparatus, terminal, and storage medium
CN113268427B (en) Crash analysis method and system for binary program
CN112989151B (en) Data blood relationship display method and device, electronic equipment and storage medium
CN103098048A (en) SQL enumerator
CN113760891B (en) Data table generation method, device, equipment and storage medium
CN110990445A (en) Data processing method, device, equipment and medium
US20230065492A1 (en) Method for obtaining browser running data, electronic device, and storage medium
WO2023125032A1 (en) Scientific research data change review method based on data snapshot, and server
CN110781063B (en) Method, device, equipment and storage medium for measuring first screen time of web page
CN115391322A (en) Data checking method, device, equipment, storage medium and program product
CN110597704A (en) Application program pressure testing method, device, server and medium
CN108446235A (en) In conjunction with the fuzz testing critical data localization method of path label data variation
CN114564354A (en) Database performance monitoring method and device, electronic equipment and storage medium
CN114595765A (en) Data processing method and device, electronic equipment and storage medium
WO2020232900A1 (en) System test method and apparatus, computer device and storage medium
CN111913922A (en) Binary structured log generation method, device, equipment and storage medium
CN113792138A (en) Report generation method and device, electronic equipment and storage medium
CN113010208A (en) Version information generation method, version information generation device, version information generation equipment and storage medium
CN113553309A (en) Log template determination method and device, electronic equipment and storage medium
CN113076358A (en) Report generation method, device, equipment and storage medium
CN111784176A (en) Data processing method, device, server and medium
CN116126808A (en) Behavior log recording method, device, computer equipment and storage medium
CN113791860B (en) Information conversion method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination