CN113419807A - Multi-brand disk drive performance fusion display method and system - Google Patents
Multi-brand disk drive performance fusion display method and system Download PDFInfo
- Publication number
- CN113419807A CN113419807A CN202110751803.0A CN202110751803A CN113419807A CN 113419807 A CN113419807 A CN 113419807A CN 202110751803 A CN202110751803 A CN 202110751803A CN 113419807 A CN113419807 A CN 113419807A
- Authority
- CN
- China
- Prior art keywords
- disk
- performance data
- performance
- brand
- disk unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000004927 fusion Effects 0.000 title claims abstract description 25
- 238000005070 sampling Methods 0.000 claims abstract description 34
- 238000006243 chemical reaction Methods 0.000 claims abstract description 17
- 230000002159 abnormal effect Effects 0.000 claims description 23
- 238000001914 filtration Methods 0.000 claims description 22
- 238000000586 desensitisation Methods 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 18
- 230000015654 memory Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 9
- 238000007781 pre-processing Methods 0.000 claims description 9
- 238000012423 maintenance Methods 0.000 abstract description 10
- 238000007726 management method Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 5
- 230000002776 aggregation Effects 0.000 description 3
- 238000004220 aggregation Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012216 screening Methods 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 230000008439 repair process Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 101100190466 Caenorhabditis elegans pid-3 gene Proteins 0.000 description 1
- 101000609957 Homo sapiens PTB-containing, cubilin and LRP1-interacting protein Proteins 0.000 description 1
- 101150109471 PID2 gene Proteins 0.000 description 1
- 102100039157 PTB-containing, cubilin and LRP1-interacting protein Human genes 0.000 description 1
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000002547 anomalous effect Effects 0.000 description 1
- 238000012550 audit Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a method and a system for fusing and displaying performance of a multi-brand disk drive, wherein the method comprises the following steps: determining the sampling time for acquiring the performance data of each disk unit according to the operating parameters of each brand of disk unit and the operating parameters of the server connected with each disk unit; acquiring the full performance data of each disk unit according to the sampling time of the performance data of each disk unit; converting the full performance data of each disk unit into a uniform format representation by using a standardized template; and displaying the performance data after the format conversion of each disk unit in a centralized manner. The method can realize the fusion display of the performance of the multi-brand disk drives, avoids the gap that the disk drives of different brands are not communicated with each other in the centralized storage technical scheme, effectively solves the problem of operation and maintenance management of large-scale centralized disk drives, has better universality and is convenient for fault positioning.
Description
Technical Field
The invention relates to the field of disk drive management, in particular to a method and a system for displaying the performance fusion of multi-brand disk drives.
Background
In recent years, with the rapid development of data center construction and services, the scales of various brands and models of disk drives of data centers are becoming larger, and the disk drives are used for storing data generated by the data centers and also used for users to inquire the data stored in the disk drives. How to rapidly and safely display the running data of the disk drive as required becomes an important subject of centralized storage, operation and maintenance management.
The existing solution and the existing problems are as follows:
1) each disk drive brand has a performance management platform, the quality and the displayed data level are different, and the performance of the disk drives of each brand cannot be uniformly displayed;
2) the performance management platform of each brand of disk machine is a black river for customers, and the data security of the customers cannot be effectively protected;
3) performance data collection and display often consume the performance of the disk drive, and the existing scheme cannot judge whether the current running state of the disk drive is suitable for collecting data.
Disclosure of Invention
The method is used for solving the problems that in the prior art, management of disk drives of all brands is incompatible and the performance of the disk drives cannot be displayed uniformly in a data center.
In order to solve the technical problem, a first aspect of the present disclosure provides a method for displaying performance fusion of multiple brands of disk drives, including:
determining the sampling time of the performance data of each disk unit according to the operating parameters of the disk units of each brand and the operating parameters of the servers connected with the disk units;
acquiring the full performance data of each disk unit according to the sampling time of the performance data of each disk unit;
converting the full performance data of each disk unit into a uniform format representation by using a standardized template;
and displaying the performance data after the format conversion of each disk unit in a centralized manner.
In a further embodiment of this document, before converting the full performance data of each disk drive into a uniform format representation using the standardized template, the method further includes:
and preprocessing the full performance data of each disk unit, wherein the preprocessing comprises security filtering and desensitization processing.
In a further embodiment of the present disclosure, the performing security filtering and desensitizing process on the performance data of each disk drive includes:
filtering data irrelevant to performance in the full performance data of each disk unit;
desensitizing the filtered performance data of each disk unit.
In a further embodiment of this document, before converting the full performance data of each disk drive into a uniform format representation using the standardized template, the method further includes:
grouping the full performance data of all disk units according to the customer display demand instruction;
and removing the personalized data of each brand of disk drives in each group and storing the data in a database.
In a further embodiment of this document, after converting the full performance data of each disk drive into a uniform format representation by using a standardized template, the method further includes:
matching the performance data after the format conversion of each disk unit with a preset abnormal rule;
and if the matching is successful, performing exception alarm according to the matched exception rule.
As a further embodiment herein, the method for displaying the fusion of the performance of the multi-brand disk drives further includes:
acquiring the operating parameters of the disk drives of all brands according to the management systems of the disk drives of all brands;
and acquiring the operating parameters of the servers connected with the disk drives according to the software and hardware information of the servers connected with the disk drives.
As a further embodiment herein, determining a sampling time for acquiring performance data of each disk drive according to an operating parameter of each brand of disk drive and an operating parameter of a server to which the disk drive is connected includes:
determining a first load of each disk unit according to the operation parameters of each brand of disk unit;
determining a second load of each disk unit according to the operation parameters of the server connected with the disk units;
and comparing the first load capacity and the second load capacity of the same disk unit with a preset reference value, and determining the sampling time for acquiring the performance data of each disk unit according to the comparison result.
A second aspect of the present disclosure provides a system for fusing and displaying performance of multiple brands of disk drives, including:
the condition information acquisition and judgment module is used for determining the sampling time of the performance data of each disk unit according to the operation parameters of the disk units of each brand and the operation parameters of the servers connected with the disk units;
the acquisition module is used for acquiring the full performance data of each disk unit according to the sampling time of the performance data of each disk unit;
the performance data processing module is used for converting the full performance data of each disk unit into a uniform format for representation by utilizing a standardized template;
and the performance display output module is used for displaying the performance data after the format conversion of each disk unit in a centralized manner.
A third aspect of the present disclosure provides a computer device, including a memory, a processor, and a computer program stored on the memory, where the computer program is executed by the processor to execute the instructions of the method for displaying the fusion of multi-brand disk drive performance according to any of the foregoing embodiments.
A fourth aspect of the present disclosure provides a computer storage medium, on which a computer program is stored, where the computer program is executed by a processor of a computer device to execute the instructions of the method for fusing and displaying the performance of multiple brands of disk drives according to any of the foregoing embodiments.
According to the method and the system for displaying the performance fusion of the multi-brand disk drives, the sampling time for acquiring the performance data of each disk drive is determined according to the operating parameters of the disk drives of all brands and the operating parameters of the servers connected with the disk drives, and the performance data of the disk drives can be acquired under the condition that the performance of the disk drives is not affected. Collecting the full performance data of each disk unit according to the sampling time of the performance data of each disk unit; converting the full performance data of each disk unit into a uniform format representation by using a standardized template; the performance data after the format conversion of each disk unit is displayed in a centralized manner, the gap that the centralized storage technical scheme is not communicated with each other can be avoided, the operation and maintenance management problem of large-scale centralized disk units is effectively solved, the universality is better, and meanwhile, the fault location is convenient.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a first schematic diagram illustrating a method for fusing and displaying performance of multi-brand disk drives according to an embodiment of the present disclosure;
FIG. 2 is a second schematic diagram illustrating a method for fusing and displaying performance of multi-brand disk drives according to an embodiment of the present disclosure;
FIG. 3 illustrates a flow diagram of a process for aggregated screening of performance data according to embodiments herein;
FIG. 4 is a third schematic diagram illustrating a method for fusing and displaying performance of multi-brand disk drives according to an embodiment of the present disclosure;
FIG. 5 is a diagram illustrating a first structure of a multi-brand disk drive performance fusion presentation system according to an embodiment of the present disclosure;
FIG. 6 is a second block diagram illustrating a multi-brand disk drive performance fusion presentation system according to an embodiment of the present disclosure;
FIG. 7 is a third architectural diagram illustrating a multi-brand disk drive performance fusion presentation system according to an embodiment of the present disclosure;
FIG. 8 is a fourth block diagram illustrating a multi-brand disk drive performance fusion presentation system according to an embodiment of the present disclosure;
FIG. 9 is a flowchart illustrating a method for fusing and displaying performance of multi-brand disk drives according to an embodiment of the present disclosure;
FIG. 10 is a block diagram illustrating a computer device according to an embodiment of the present disclosure.
Description of the symbols of the drawings:
501. a condition information acquisition and determination module;
502. an acquisition module;
503. a performance data processing module;
504, a performance display output module;
505. a safety filter module;
506. a convergence module;
507. a fault analysis module;
1002. a computer device;
1004. a processor;
1006. a memory;
1008. a drive mechanism;
1010. an input/output module;
1012. an input device;
1014. an output device;
1016. a presentation device;
1018. a graphical user interface;
1020. a network interface;
1022. a communication link;
1024. a communication bus.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments herein without making any creative effort, shall fall within the scope of protection.
The present specification provides method steps as described in the examples or flowcharts, but may include more or fewer steps based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual system or apparatus product executes, it can execute sequentially or in parallel according to the method shown in the embodiment or the figures.
It should be noted that the method and the system for displaying the performance fusion of the multi-brand disk drives described herein can be used in the financial field, and can also be used in any field other than the financial field.
In an embodiment of the present disclosure, a method for displaying performance fusion of multiple brands of disk drives is provided, which is used to solve the problems in the prior art that each brand of disk drive has its own performance management platform, the quality is not uniform with the displayed data hierarchy, and the performance of each brand of disk drive cannot be uniformly displayed. Specifically, as shown in fig. 1, the method for displaying the performance fusion of the multi-brand disk drives includes:
and step 110, acquiring the operation parameters of the disk drives of all brands and the operation parameters of the servers connected with the disk drives.
In this step, the operating parameters of the disk drives of the respective brands can be acquired according to the management systems of the disk drives of the respective brands. And acquiring the operating parameters of the servers connected with the disk drives according to the software and hardware information of the servers connected with the disk drives.
In particular, the servers connected to the disk drives described herein assume computing functions. Brands of disk drives described herein refer to disk drives in data centers, including data centers for industries such as finance, power, education, etc., where the data centers are used to communicate, accelerate, present, compute, store data information over internet network infrastructure, including servers and disk drives, etc.
Brands of disk drives include, but are not limited to, Huaye, HDS, Macrofir, IBM, and the like. Each disk unit is connected with a plurality of servers.
The operation parameters of the disk unit are used to determine the current load condition of the disk unit, including but not limited to conventional index parameters (these parameters are often parameters commonly used in the industry without affecting the performance of the disk unit) of the management page of the disk unit, such as IOPS, read delay, utilization rate of a CPU of a controller, alarm information, and the like.
The server operation parameters are used for indirectly determining the load of the disk drive, including but not limited to read-write parameters, and may be represented by multiple dimensions of applications and systems in the server, even hardware, such as IOPS (Input/Output Operations Per Second, the number of read-write Operations Per Second), service trigger amount of the applications, CPU utilization, the number of servers on which the disk drive is hung down, and the like.
The operation parameters of each brand of disk drives and the operation parameters of the servers connected to the disk drives, which are obtained in this step, may be data in a past period of time (for example, one month or two months), and the range of the obtained data is not limited herein, and may be specified according to actual situations when being implemented specifically.
And step 120, determining the sampling time for acquiring the performance data of each disk unit according to the operation parameters of each brand of disk unit and the operation parameters of the server connected with each disk unit.
The sampling time of the performance data of the disk drive determined in the step is the sampling time which does not influence the performance of the disk drive, and the performance data of the disk drive is acquired at the sampling time determined in the step, so that the performance of the disk drive can not be influenced, and the normal work of the disk drive is ensured.
And step 130, collecting the total performance data of each disk unit according to the sampling time of the performance data of each disk unit.
In this step, different disk drives have different ways of acquiring the full-scale performance information, and the full-scale performance data can be acquired by adopting the existing technical line, and the technical line is stored in the disk drives and is a collection way for collecting the full-scale performance data. In specific implementation, the disk drive controller background system can be logged in to copy the performance files one by one.
The full performance data mainly comprises information such as running logs, utilization rate and the like. The operation log records diagnosis information, alarm events, equipment logs, configuration files, audit logs and the like. The diagnostic information includes a bottom operating system log of 2 sp, including all logs of kernel and user, which is a main log of problem location. The alarm event comprises historical alarm event records, and all historical alarms are recorded in the csv file. The device log comprises an odsp log and records related logs of the upper layer of the software, including configuration and fault records. The configuration file comprises a series of xml storage configuration files, all stored configuration information can be obtained, and a user can restore the storage configuration in some special cases. And (4) auditing logs: and (4) logging in by the user, operating the record, and recording the operation behavior information of the user.
The formats of the full performance data of different disk drives are different, and if the unified management is to be realized, the formats of the full performance data of different disk drives need to be converted. The collected full performance data of each disk drive is gathered in a centralized manner, and is stored in a database for processing in subsequent steps.
And 140, converting the full performance data of each disk drive into a uniform format representation by using a standardized template.
In detail, the standardized template is shown in table one, in which a standard identifier of each performance and a personalized identifier of the performance in each brand of disk drive are stored, and the standard identifier of each performance may be a redefined identifier or a personalized identifier of the performance in one brand of disk drives. The standardized template can be determined by pre-analyzing the full-scale performance data of each brand of disk drive.
The identifier described herein is, for example, a name, an ID, or the like, which is not limited in any way.
Watch 1
| Performance of | Standard mark | Brand 1 personalized mark | Brand 2 personalized mark | Brand 3 personalized mark |
| Properties 1 | SID | PID1 | PID2 | PID3 |
| …… | …… | …… | …… | …… |
The performance data after the standardization processing is stored in a database so as to be called when the centralized display is carried out.
And 150, collectively displaying the performance data after the format conversion of each disk unit.
In this embodiment, through the steps 110 to 120, the performance data of the disk drive can be collected under the condition that the performance of the disk drive is not affected. Through the steps 130 to 150, the gap that the centralized storage technical schemes are not communicated with each other can be avoided, the operation and maintenance management problem of the large-scale centralized disk machine is effectively solved, the universality is better, and meanwhile, the fault location is convenient.
In an embodiment of this document, the determining, in step 110, a sampling time for acquiring performance data of each disk drive according to an operating parameter of each brand of disk drive and an operating parameter of a server to which the disk drive is connected includes:
and step 111, according to the operation parameters of the disk drives of all brands. And determining a first load capacity of each disk unit. Specifically, the first load amount may be calculated by the following formula:
Q1＝aX+bY+cZ；
wherein, X is the IOPS of the whole machine, Y is the read time delay, Z is the utilization rate of the CPU of the controller, wherein, a, b and c can be set according to the actual situation by the adjusting coefficient obtained by analyzing the operation parameters of the history disk machine, and the specific value is not limited in the text.
And step 112, determining a second load of each disk unit according to the operation parameters of the server connected with the disk unit. Specifically, the second load amount may be calculated by the following formula:
wherein X is the IOPS of the server, Y is the service triggering quantity of the application, Z is the CPU utilization rate of the server, and i is the number of the servers hung down by the disk machine; the r, s and t are adjustment coefficients obtained by analyzing the operation parameters of the server connected with the historical disk unit, and can be set according to actual conditions, and specific values of the adjustment coefficients are not limited in the text.
And 113, comparing the first load capacity and the second load capacity of the same disk unit with a preset reference value, and determining the sampling time for acquiring the performance data of each disk unit according to the comparison result.
Specifically, when the first load capacity and the second load capacity of the same disk drive are both within the predetermined reference value range, the performance data of the disk drive can be collected in real time. When one of the first load capacity and the second load capacity of the same disk drive is not within the preset reference value range, the performance data of the disk drive is collected in real time after the first load capacity and the second load capacity are both within the preset reference value range.
Considering that the busy degree of the service processing also has a certain influence on the performance of the disk unit, further, the step 113 determines, according to the comparison result, the sampling time for acquiring the performance data of each disk unit further includes: and determining the sampling time for acquiring the performance data of each disk unit according to the comparison result of each disk unit and the sensitivity of the application in the server connected with each disk unit.
The sensitivity of the application in the server refers to the grade of the service processed by the application in the server, and the service with high grade (for example, the service with the grade higher than the preset value) needs to adopt the data collected by peak error, that is, the data is collected when the service is not processed, and the service with low grade (for example, the service with the grade lower than the preset value) can be collected when the service is processed without peak error.
In some embodiments, the sampling time for collecting the performance data of each disk unit may be determined according to the rule shown in table two below.
Watch two
The second table is only an exemplary illustration, and in specific implementation, the determination rule of the sampling time may be adjusted according to actual conditions. The predetermined load amount and the predetermined service level described herein may be set according to actual situations, and specific values thereof are not limited herein.
In an embodiment of this document, as shown in fig. 2, in order to protect client security, after the step 130 is executed to collect the full performance data of each disk drive according to the sampling time of the performance data of each disk drive, and before the step 140 is executed to convert the full performance data of each disk drive into a unified format representation by using a standardized template, the method further includes:
and step 140', carrying out security filtering and desensitization treatment on the total performance data of each disk unit.
In the step 130, the total performance data of the disk drive collected inevitably mixes with the information of the client, and in this step, the security filtering can be implemented by setting a security filtering rule, and the security filtering rule is mainly used for filtering data irrelevant to the performance. The safety filtering rules can be set according to actual conditions, and the safety filtering rules are not limited in the text.
Desensitizing the filtered performance data of each disk unit. In particular, the desensitization algorithm can be used for desensitization treatment according to one of the following methods: hash desensitization, masking desensitization, replacement desensitization, transformation desensitization, encryption desensitization, data decryption, shuffling desensitization, and the like, and the specific desensitization algorithm is not limited herein.
According to the embodiment, the safety filtering and desensitization processing are carried out on the full performance data of the disk unit, so that information leakage can be avoided to threaten the safety of a client.
In this embodiment, in order to improve the display efficiency of the performance data and achieve customized display for the client, the data obtained after the security filtering and desensitization processing in step 140' needs to be gathered, screened and sorted. Specifically, as shown in fig. 3, the convergent screening process includes:
In this step, the customer display requirement instruction is used to indicate a customer display requirement, such as monthly display, annual display, data display within a predetermined time period, or display of key information. In specific implementation, a customer can input a display requirement instruction through a setting page, an input frame for displaying requirements of a user or options for displaying the requirements are arranged in the setting page, and the specific input mode of the customer display requirement instruction is not limited in the text.
And step 302, removing the personalized data of each brand of disk drive in each group and storing the data in a database.
Specifically, the personalized data is, for example, information unique to the disk drive, such as a disk drive data profile, and specific content of the personalized data is not limited herein. In specific implementation, the personalized data of the disk unit can be further specified by a client when a display requirement instruction is input.
The data display method and the data display device can perform customized display according to the requirements of customers, and due to the fact that the data are displayed in a grouped mode, personalized data are removed from displayed data, data display efficiency can be improved, the customers can conveniently position information which the customers want to know, and user experience is improved.
In an embodiment of this document, in order to improve the processing efficiency of the abnormal data, as shown in fig. 4, after the step 140 uses a standardized template to convert the full performance data of each disk drive into a uniform format representation, the method further includes:
and step 141, matching the performance data after the format conversion of each disk unit with a preset abnormal rule, and if the matching is successful, executing step 142.
And 142, performing abnormity alarm according to the matched abnormity rule.
In the step, an alarm form can be determined according to the abnormal threshold value met by the performance parameter, and an alarm is given according to the alarm form.
Specifically, the exception rule is shown in table three, which is only an exemplary illustration and is not a limitation on the exception rule. In general, the exception rule is provided with an exception threshold and an alarm form of each performance parameter, each performance parameter may correspond to a plurality of exception thresholds and alarm forms, the exception threshold corresponding to each performance parameter has a different value, the alarm forms corresponding to different exception thresholds are also different, the exception thresholds and the alarm forms are related to the exception degree, and this document is not limited specifically.
The anomaly threshold may be determined by human experience or analysis of historical anomaly data, for example, to be no greater than a certain value (e.g., 50), above which data is anomalous. The alarm forms include but are not limited to short messages, emails, voice reminders, screen displays, and the like.
Watch III
When the step 141 is implemented, the successfully matched performance data is further sent to the fault analysis platform as abnormal data, the fault analysis platform gives a fault repair suggestion, and the repair suggestion, the abnormal data and the position information are sent to operation and maintenance personnel.
In some embodiments, the process of analyzing the abnormal data by the fault analysis platform includes:
(1) the abnormal data is classified, for example, the abnormal data is classified into a hardware abnormality and a software abnormality, and further classified into a temporary error reporting class without intervention, a system planned change class and a hardware fault class requiring timely maintenance.
(2) And respectively corresponding to the parts which can be in failure according to the abnormal category.
The method mainly aims at hardware abnormity, and mainly aims to distinguish whether abnormal data is error report pointing to a memory, a hard disk or a network card, the determination of a fault component can be determined by analyzing historical data, the incidence relation between an abnormal category and the fault component can be determined by analyzing the historical data, and the component which is possibly in fault can be determined by the incidence relation and the abnormal category.
In practice, this step may be performed to identify the failed component as shown in Table four below.
Watch four
In this embodiment, in order to facilitate the client to obtain the information of interest, before the step 141 matches the performance data after format conversion of each disk drive with the preset exception rule, the method further includes:
step 141' screens out customer-specified parameters from the format-converted performance data.
The client can specify parameters according to own subjective awareness, and the parameters specified by the client are parameters concerned by the client, such as the distribution rate and the actual utilization rate of the disk lun.
In one embodiment, the step 150 can present the performance data after the format conversion of each disk drive according to the customer requirement.
Based on the same inventive concept, a system for displaying the performance fusion of multiple brands of disk drives is also provided, as described in the following embodiments. Because the principle of solving the problems of the multi-brand disk drive performance fusion display system is similar to the multi-brand disk drive performance fusion display method, the multi-brand disk drive performance fusion display system can be implemented by referring to the multi-brand disk drive performance fusion display method, and repeated parts are not repeated.
Specifically, as shown in fig. 5, the system for displaying the performance fusion of multiple brands of disk drives includes:
the condition information obtaining and determining module 501 is configured to determine a sampling time for acquiring performance data of each disk unit according to an operation parameter of each brand of disk unit and an operation parameter of a server connected to the disk unit.
The collecting module 502 is configured to collect the full performance data of each disk unit according to the sampling time of the performance data of each disk unit.
And the performance data processing module 503 is configured to convert the full performance data of each disk drive into a uniform format representation by using a standardized template.
And a performance display output module 504, configured to centrally display the performance data after format conversion of each disk unit.
In detail, data of each module in the multi-brand disk drive performance fusion display system is circulated in an information flow mode.
The embodiment can acquire the performance data of the disk unit under the condition that the performance of the disk unit is not influenced, can avoid the gap that the centralized storage technical scheme is not communicated with each other, effectively solves the problem of operation and maintenance management of large-scale centralized disk units, has better universality and is convenient for fault positioning.
In a further embodiment of this document, as shown in fig. 6, the system for fusing and displaying the performance of multiple brands of disk drives further includes: the security filtering module 505 is configured to perform preprocessing on the full performance data of each disk unit acquired by the acquisition module 502, where the preprocessing includes: safe filtration and desensitization treatment. Specifically, the preprocessing of the performance data of each disk unit includes: filtering data irrelevant to performance in the full performance data of each disk unit; desensitizing the filtered performance data of each disk unit.
In a further embodiment of this document, as shown in fig. 7, the system for fusing and displaying the performance of multiple brands of disk drives further includes: the aggregation module 506 is configured to perform aggregation processing on the preprocessed data output by the security filter module 505, and specifically, the aggregation processing process includes: grouping the preprocessed performance data of all disk units according to a customer display demand instruction; and removing the personalized data of each brand of disk drives in each group and storing the data in a database. In a further embodiment of the present disclosure, the performance data processing module 503 matches the performance data after format conversion of each disk drive with a preset exception rule, and if the matching is successful, the successfully matched performance data is used as exception data, and an exception alarm is performed according to the matched exception rule. The exception rule, the matching process, and the exception warning process may refer to the foregoing embodiments, and will not be described in detail herein.
In a further embodiment of this document, as shown in fig. 8, the system for fusing and displaying the performance of multiple brands of disk drives further includes: a fault analysis module 507, configured to classify the abnormal data output by the performance data processing module 503; according to the abnormal category, respectively corresponding to the components which are possible to have faults; and sending the possible fault components to operation and maintenance personnel so that the operation and maintenance personnel can timely eliminate the fault.
The method and the system for displaying the performance fusion of the multi-brand disk drives can achieve the following technical effects:
(1) the performance data of the disk drives can be collected under the condition that the performance of the disk drives is not influenced by determining the sampling time of the performance data according to the operation parameters of the disk drives and the operation parameters of the servers connected with the disk drives.
(2) By converting the performance data of each disk unit into a uniform format, the centralized management of multiple brands of disk units can be realized, and the operation and maintenance management problem of large-scale centralized disk units is effectively solved.
(3) By carrying out security filtering and desensitization processing on the performance data of the disk unit, information leakage can be avoided to threaten the security of a client.
(4) By matching the performance data after format conversion with the preset abnormal rule, the abnormity can be found in time and an alarm is given, and meanwhile, the abnormal data can also guide fault positioning.
In order to more clearly illustrate the technical solution herein, a detailed and complete description is provided below by using a specific embodiment, specifically, as shown in fig. 9, the method for displaying the performance fusion of multiple brands of disk drives includes:
And step 902, determining the sampling time for acquiring the performance data of each disk unit according to the operating parameters of each brand of disk unit and the operating parameters of the server connected with each disk unit.
Specifically, step 902 further includes: determining the load capacity of each disk unit according to the operation parameters of the disk units of each brand and the operation parameters of servers connected with the disk units; and determining the sampling time for acquiring the performance data of each disk unit according to the load capacity of each disk unit.
And step 903, collecting the total performance data of each disk unit according to the sampling time of the performance data of each disk unit.
And 904, carrying out safety filtering and desensitization treatment on the full performance data of each disk unit.
Specifically, step 904 further includes: the safety filtering is realized by setting a safety filtering rule; desensitizing the filtered performance data of each disk unit.
And step 905, aggregating, screening and sorting the data obtained after the safety filtering and desensitization treatment.
Specifically, step 905 further includes: grouping the preprocessed performance data of all disk units according to a customer display demand instruction; and removing the personalized data of each brand of disk drives in each group and storing the data in a database.
Specifically, step 907 further includes: and matching the performance data after the format conversion of each disk unit with a preset abnormal rule, if the matching is successful, taking the successfully matched performance data as abnormal data, and performing abnormal alarm according to the matched abnormal rule.
And 908, collectively displaying the performance data after the format conversion of each disk unit.
At step 909, the anomaly data is analyzed to determine components that may fail.
In an embodiment herein, a computer device is further provided for executing the method for fusing and presenting the performance of the multi-brand disk drives according to any of the foregoing embodiments, and specifically, as shown in fig. 10, the computer device 1002 may include one or more processors 1004, such as one or more Central Processing Units (CPUs), each of which may implement one or more hardware threads. The computer device 1002 may also include any memory 1006 for storing any kind of information, such as code, settings, data, etc. For example, and without limitation, the memory 1006 may include any one or more of the following in combination: any type of RAM, any type of ROM, flash memory devices, hard disks, optical disks, etc. More generally, any memory may use any technology to store information. Further, any memory may provide volatile or non-volatile retention of information. Further, any memory may represent fixed or removable components of computer device 1002. In one case, when the processor 1004 executes the associated instructions, which are stored in any memory or combination of memories, the computer device 1002 can perform any of the operations of the associated instructions. The computer device 1002 also includes one or more drive mechanisms 1008, such as a hard disk drive mechanism, an optical disk drive mechanism, or the like, for interacting with any memory.
Corresponding to the methods in fig. 1-4, the embodiments herein also provide a computer-readable storage medium having stored thereon a computer program, which, when executed by a processor, performs the steps of the above-described method.
Embodiments herein also provide computer readable instructions, wherein when executed by a processor, a program thereof causes the processor to perform the method as shown in fig. 1-4.
It should be understood that, in various embodiments herein, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments herein.
It should also be understood that, in the embodiments herein, the term "and/or" is only one kind of association relation describing an associated object, meaning that three kinds of relations may exist. For example, a and/or B, may represent: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided herein, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electric, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purposes of the embodiments herein.
In addition, functional units in the embodiments herein may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present invention may be implemented in a form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The principles and embodiments of this document are explained herein using specific examples, which are presented only to aid in understanding the methods and their core concepts; meanwhile, for the general technical personnel in the field, according to the idea of this document, there may be changes in the concrete implementation and the application scope, in summary, this description should not be understood as the limitation of this document.
Claims (10)
1. A multi-brand disk drive performance fusion display method is characterized by comprising the following steps:
determining the sampling time of the performance data of each disk unit according to the operating parameters of the disk units of each brand and the operating parameters of the servers connected with the disk units;
acquiring the full performance data of each disk unit according to the sampling time of the performance data of each disk unit;
converting the full performance data of each disk unit into a uniform format representation by using a standardized template;
and displaying the performance data after the format conversion of each disk unit in a centralized manner.
2. The method for fusing and displaying the performance of the multi-brand disk drives according to claim 1, wherein the step of determining the sampling time of the performance data of each disk drive according to the operating parameters of each brand of disk drive and the operating parameters of the server connected with the disk drive comprises the following steps:
determining a first load of each disk unit according to the operation parameters of each brand of disk unit;
determining a second load of each disk unit according to the operation parameters of the server connected with the disk units;
and comparing the first load capacity and the second load capacity of the same disk unit with a preset reference value, and determining the sampling time for acquiring the performance data of each disk unit according to the comparison result.
3. The method for fusing and displaying the performance of the multi-brand disk drives according to claim 1, wherein before converting the full performance data of each disk drive into a uniform format representation by using a standardized template, the method further comprises:
preprocessing the full performance data of each disk unit, wherein the preprocessing comprises the following steps: safe filtration and desensitization treatment.
4. The method for fusing and displaying the performance of the multi-brand disk drives according to claim 3, wherein the preprocessing of the performance data of each disk drive comprises the following steps:
filtering data irrelevant to performance in the full performance data of each disk unit;
desensitizing the filtered performance data of each disk unit.
5. The method for fusing and displaying the performance of the multi-brand disk drives according to claim 3, wherein after preprocessing the full performance data of each disk drive, the method further comprises the following steps:
grouping the preprocessed performance data of all disk units according to a customer display demand instruction;
and removing the personalized data of each brand of disk drives in each group and storing the data in a database.
6. The method for fusing and displaying the performance of the multi-brand disk drives according to claim 1, wherein after converting the full performance data of each disk drive into a uniform format representation by using a standardized template, the method further comprises:
matching the performance data after the format conversion of each disk unit with a preset abnormal rule;
and if the matching is successful, performing exception alarm according to the matched exception rule.
7. The method for fusing and displaying the performance of the multi-brand disk drives according to claim 1, further comprising:
acquiring the operating parameters of the disk drives of all brands according to the management systems of the disk drives of all brands;
and acquiring the operating parameters of the servers connected with the disk drives according to the software and hardware information of the servers connected with the disk drives.
8. The utility model provides a multi-brand disk unit performance fuses display system which characterized in that includes:
the condition information acquisition and judgment module is used for determining the sampling time of the performance data of each disk unit according to the operation parameters of the disk units of each brand and the operation parameters of the servers connected with the disk units;
the acquisition module is used for acquiring the full performance data of each disk unit according to the sampling time of the performance data of each disk unit;
the performance data processing module is used for converting the full performance data of each disk unit into a uniform format for representation by utilizing a standardized template;
and the performance display output module is used for displaying the performance data after the format conversion of each disk unit in a centralized manner.
9. A computer device comprising a memory, a processor, and a computer program stored on the memory, wherein the computer program, when executed by the processor, performs the instructions of the method of any one of claims 1-7.
10. A computer storage medium on which a computer program is stored, characterized in that the computer program, when being executed by a processor of a computer device, executes instructions of a method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110751803.0A CN113419807A (en) | 2021-07-02 | 2021-07-02 | Multi-brand disk drive performance fusion display method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110751803.0A CN113419807A (en) | 2021-07-02 | 2021-07-02 | Multi-brand disk drive performance fusion display method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113419807A true CN113419807A (en) | 2021-09-21 |
Family
ID=77720122
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110751803.0A Pending CN113419807A (en) | 2021-07-02 | 2021-07-02 | Multi-brand disk drive performance fusion display method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113419807A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107302449A (en) * | 2017-06-13 | 2017-10-27 | 中国工商银行股份有限公司 | Intelligent monitoring statistics and alarm processing system and method |
| CN108509488A (en) * | 2018-02-08 | 2018-09-07 | 华青融天（北京）技术股份有限公司 | Method and device shown in service feature data and performance data of server collection |
| CN109783319A (en) * | 2019-01-17 | 2019-05-21 | 珠海金山网络游戏科技有限公司 | A kind of method of server and process performance index grab sampling and generation report |
-
2021
- 2021-07-02 CN CN202110751803.0A patent/CN113419807A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107302449A (en) * | 2017-06-13 | 2017-10-27 | 中国工商银行股份有限公司 | Intelligent monitoring statistics and alarm processing system and method |
| CN108509488A (en) * | 2018-02-08 | 2018-09-07 | 华青融天（北京）技术股份有限公司 | Method and device shown in service feature data and performance data of server collection |
| CN109783319A (en) * | 2019-01-17 | 2019-05-21 | 珠海金山网络游戏科技有限公司 | A kind of method of server and process performance index grab sampling and generation report |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7743128B2 (en) | Method and system for visualizing network performance characteristics | |
| US8352867B2 (en) | Predictive monitoring dashboard | |
| US9372748B2 (en) | Evaluating reliability of a software module using development life cycle | |
| US7788198B2 (en) | Method for detecting anomalies in server behavior using operational performance and failure mode monitoring counters | |
| CN111209131A (en) | Method and system for determining fault of heterogeneous system based on machine learning | |
| Nair et al. | Learning a hierarchical monitoring system for detecting and diagnosing service issues | |
| US20060074621A1 (en) | Apparatus and method for prioritized grouping of data representing events | |
| CN103761173A (en) | Log based computer system fault diagnosis method and device | |
| US8918345B2 (en) | Network analysis system | |
| CN104574219A (en) | System and method for monitoring and early warning of operation conditions of power grid service information system | |
| US8209410B2 (en) | System and method for storage management | |
| US11126501B2 (en) | Method, device and program product for avoiding a fault event of a disk array | |
| CN113434575B (en) | Data attribution processing method, device and storage medium based on data warehouse | |
| US20050188269A1 (en) | System and method for providing a health model for software | |
| CN112433928A (en) | Fault prediction method, device, equipment and storage medium of storage equipment | |
| CN107317708B (en) | Monitoring method and device for court business application system | |
| CN117974034A (en) | RPA-based automatic acquisition and integration method and system for science and technology project contract payment information | |
| CN113239007B (en) | Multi-level heterogeneous log transaction analysis method, system, equipment and storage medium | |
| CN117056172B (en) | Data integration method and system for system integration middle station | |
| CN113419807A (en) | Multi-brand disk drive performance fusion display method and system | |
| CN112416896A (en) | Data abnormity warning method and device, storage medium and electronic device | |
| CN117421735A (en) | Mining evaluation method based on big data vulnerability mining | |
| CN112465397A (en) | Audit data analysis method and device | |
| CN111178855A (en) | Electric quantity data monitoring method | |
| CN109933798A (en) | A kind of audit log analysis method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |