CN118093345A

CN118093345A - Performance capacity assessment method, device, apparatus, storage medium, and program product

Info

Publication number: CN118093345A
Application number: CN202410356561.9A
Authority: CN
Inventors: 郭晟
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2024-03-27
Filing date: 2024-03-27
Publication date: 2024-05-28

Abstract

The present disclosure provides a performance capacity assessment method, apparatus, device, medium, and program product, which may be applied to the software testing technology field, the financial technology field, or other related fields. The method comprises the following steps: acquiring a program change list of an application system; code calling link analysis is carried out on the programs in the program change list, and a performance test range and a database table list corresponding to each program are determined; determining the pressure measurement element information corresponding to the program according to the performance test range and the database table list; determining a test asset result corresponding to the interface service according to the name of the interface service corresponding to the program in the performance test range; establishing an association relationship among the performance test range, the pressure test element information and the test asset result corresponding to each program in the program change list; and performing performance capacity evaluation on the target change program by using the association relation to obtain an evaluation result corresponding to the target change program.

Description

Performance capacity assessment method, device, apparatus, storage medium, and program product

Technical Field

The present disclosure relates to the field of software testing technology, financial technology, or other related fields, and more particularly, to a performance capacity assessment method, apparatus, device, storage medium, and program product.

Background

Because the information provided by the application system is limited, and each item of asset information is scattered in the respective application management system, a certain degree of information island effect exists, when a tester performs performance capacity assessment on the system, a large amount of communication confirmation and manual retrieval work are needed for associating each item of asset information, the whole assessment work is time-consuming and labor-consuming, the work efficiency is low, the accuracy of the performance capacity assessment result is seriously dependent on the familiarity and the working experience of developers and testers on the application system, the risk of range omission or inaccurate assessment exists, and the assessment quality is uncontrollable.

Disclosure of Invention

In view of the foregoing, the present disclosure provides a performance capacity assessment method, apparatus, device, storage medium, and program product.

According to a first aspect of the present disclosure, there is provided a performance capacity assessment method, including: acquiring a program change list of an application system;

code calling link analysis is carried out on the programs in the program change list, and a performance test range and a database table list corresponding to each program are determined;

Determining the pressure measurement element information corresponding to the program according to the performance test range and the database list;

Determining a test asset result corresponding to the interface service according to the name of the interface service corresponding to the program in the performance test range;

establishing an association relationship among a performance test range, pressure test element information and a test asset result corresponding to each program in the program change list; and

And performing performance capacity evaluation on the target change program by using the association relation to obtain an evaluation result corresponding to the target change program.

A second aspect of the present disclosure provides a performance capacity assessment apparatus, comprising: the system comprises an acquisition module, a first determination module, a second determination module, a third determination module, a building module and an evaluation module. The acquisition module is used for acquiring a program change list of the application system. And the first determining module is used for carrying out code call link analysis on the programs in the program change list and determining a performance test range and a database table list corresponding to each program. And the second determining module is used for determining the pressure measurement element information corresponding to the program according to the performance test range and the database table list. And the third determining module is used for determining the test asset result corresponding to the interface service according to the name of the interface service corresponding to the program in the performance test range. And the establishing module is used for establishing an association relation among the performance test range, the pressure test element information and the test asset result corresponding to each program in the program change list. And the evaluation module is used for evaluating the performance and the capacity of the target change program by utilizing the association relation to obtain an evaluation result corresponding to the target change program.

A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the method.

A fourth aspect of the present disclosure also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the above method.

A fifth aspect of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the method described above.

According to the performance capacity assessment method, the device, the equipment, the storage medium and the program product provided by the disclosure, the code call link analysis is carried out on the programs in the program change list of the application system to obtain the performance test range, the pressure test element information and the test asset result corresponding to each program, so that the association relation among the data of each application system can be established, when the tester carries out the performance capacity assessment on the target change program, the established association relation can be used for rapidly acquiring the assessment result, the rapid assessment on the target change program is realized, the working efficiency is greatly improved, the maturity requirements of the performance capacity assessment work on the development/tester are greatly reduced, and the accuracy and the credibility of the assessment result are improved

Drawings

The foregoing and other objects, features and advantages of the disclosure will be more apparent from the following description of embodiments of the disclosure with reference to the accompanying drawings, in which:

FIG. 1 schematically illustrates an application scenario diagram of a performance capacity assessment method according to an embodiment of the present disclosure;

FIG. 2 schematically illustrates a flow chart of a performance capacity assessment method according to an embodiment of the present disclosure;

FIG. 3 schematically illustrates a schematic diagram of a link of a program according to an embodiment of the disclosure;

FIG. 4 schematically illustrates a schematic diagram of a service interface information presentation interface in an interface service information registration system according to an embodiment of the present disclosure;

FIG. 5 schematically illustrates a schematic diagram of a business function inventory according to an embodiment of the disclosure;

FIG. 6 schematically illustrates a schematic diagram of a table statistics interface, according to an embodiment of the present disclosure;

FIG. 7 schematically illustrates a schematic diagram of a test script information presentation interface, according to an embodiment of the present disclosure;

FIG. 8 schematically illustrates a structural schematic of an auxiliary assessment tool according to an embodiment of the present disclosure;

fig. 9 schematically shows a block diagram of a performance capacity assessment apparatus according to an embodiment of the present disclosure; and

Fig. 10 schematically illustrates a block diagram of an electronic device adapted to implement a performance capacity assessment method according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is only exemplary and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the concepts of the present disclosure.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a convention should be interpreted in accordance with the meaning of one of skill in the art having generally understood the convention (e.g., "a system having at least one of A, B and C" would include, but not be limited to, systems having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

In the technical solution of the present disclosure, the related user information (including, but not limited to, user personal information, user image information, user equipment information, such as location information, etc.) and data (including, but not limited to, data for analysis, stored data, displayed data, etc.) are information and data authorized by the user or sufficiently authorized by each party, and the related data is collected, stored, used, processed, transmitted, provided, disclosed, applied, etc. in compliance with relevant laws and regulations and standards, necessary security measures are taken, no prejudice to the public order colloquia is provided, and corresponding operation entries are provided for the user to select authorization or rejection.

In the scenario of using personal information to make an automated decision, the method, the device and the system provided by the embodiment of the disclosure provide corresponding operation inlets for users, so that the users can choose to agree or reject the automated decision result; if the user selects refusal, the expert decision flow is entered. The expression "automated decision" here refers to an activity of automatically analyzing, assessing the behavioral habits, hobbies or economic, health, credit status of an individual, etc. by means of a computer program, and making a decision. The expression "expert decision" here refers to an activity of making a decision by a person who is specializing in a certain field of work, has specialized experience, knowledge and skills and reaches a certain level of expertise.

In the process of implementing the present disclosure, it is found that the current core program/large table program change (add/modify) performance capacity assessment workflow is: the system automatically pulls up the current version program change list from the distributed version control system, then identifies the program list to be evaluated by combining the registered application core program list and the related large-table program list, and pushes the program list to a tester for evaluation through the system.

However, when the tester performs performance capacity evaluation on the system, because the information provided by the system is limited, only basic information such as program name, program path, program modifier, modification time and the like is included, and the whole evaluation work is time-consuming and labor-consuming. The testers generally need to communicate with the developer to confirm the interfaces or functions affected by the programs, how much the data amount of the tables contained in the programs is on the production environment, and then the development side information is converted into the test side information by experience and accumulation and searching information on each application management system. Therefore, the problem of low working efficiency exists in the related technology, and the accuracy of the evaluation result is seriously dependent on the familiarity degree and working experience of developers and testers on an application system, so that the risk of range omission or inaccurate evaluation exists, and the evaluation quality is uncontrollable.

To this end, an embodiment of the present disclosure provides a performance capacity assessment method, including: acquiring a program change list of an application system; code calling link analysis is carried out on the programs in the program change list, and a performance test range and a database table list corresponding to each program are determined; determining the pressure measurement element information corresponding to the program according to the performance test range and the database table list; determining a test asset result corresponding to the interface service according to the name of the interface service corresponding to the program in the performance test range; establishing an association relationship among the performance test range, the pressure test element information and the test asset result corresponding to each program in the program change list; and performing performance capacity evaluation on the target change program by using the association relation to obtain an evaluation result corresponding to the target change program.

Fig. 1 schematically illustrates an application scenario diagram of a performance capacity assessment method according to an embodiment of the present disclosure.

As shown in fig. 1, an application scenario 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used as a medium to provide communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send messages or the like. Various communication client applications, such as shopping class applications, web browser applications, search class applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only) may be installed on the terminal devices 101, 102, 103.

The terminal devices 101, 102, 103 may be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.

The server 105 may be a server providing various services, such as a background management server (by way of example only) providing support for websites browsed by users using the terminal devices 101, 102, 103. The background management server may analyze and process the received data such as the user request, and feed back the processing result (e.g., the web page, information, or data obtained or generated according to the user request) to the terminal device.

For example, the server 105 may obtain a program change list of the application system, so as to perform code call link analysis on the programs in the program change list, determine a performance test range and a database table list corresponding to each program, so that the press test element information corresponding to the program can be determined according to the performance test range and the database table list, and determine the test asset result corresponding to the interface service according to the name of the interface service corresponding to the program in the performance test range, so that an association relationship can be established between the performance test range, the press test element information and the test asset result corresponding to each program in the program change list, and finally, performance capacity evaluation can be performed on the target change program by using the association relationship, so as to obtain the evaluation result corresponding to the target change program.

It should be noted that, the performance capacity assessment method provided by the embodiments of the present disclosure may be generally performed by the server 105. Accordingly, the performance capacity assessment apparatus provided by the embodiments of the present disclosure may be generally provided in the server 105. The performance capacity assessment method provided by the embodiments of the present disclosure may also be performed by a server or a server cluster that is different from the server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the server 105. Accordingly, the performance capacity assessment apparatus provided by the embodiments of the present disclosure may also be provided in a server or a server cluster that is different from the server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the server 105.

It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

The performance capacity evaluation method of the disclosed embodiment will be described in detail below by fig. 2 to 8 based on the scenario described in fig. 1.

Fig. 2 schematically illustrates a flow chart of a performance capacity assessment method according to an embodiment of the present disclosure.

As shown in fig. 2, the method 200 includes operations S210 to S260.

In operation S210, a program change list of the application system is acquired.

According to an embodiment of the present disclosure, a program change list of an application system may be obtained from an existing performance capacity evaluation system, where the application system may include at least one system, and a core program/large table program with changed code may be recorded in the program change list.

In operation S220, code call link analysis is performed on the programs in the program change list, and a performance test range and a database table list corresponding to each program are determined.

According to embodiments of the present disclosure, the programs in the program change list may be core programs or large table programs with code changes. For each program recorded in the program change list, code call link analysis can be performed on the program to determine a performance test range corresponding to the program by analyzing call relations in the program, wherein the performance test range can represent performance influenced by the change of the program, namely, the range for testing the program subsequently; the program may be analyzed to determine a corresponding performance test range using an analysis tool for code call link analysis.

According to the embodiment of the disclosure, the database table list related to the whole link of the program can be obtained by performing code call link analysis on the program, wherein the database table list records all the tables of the databases related to the link of the program.

In operation S230, the crush test element information corresponding to the program is determined according to the performance test range and the database table list.

According to an embodiment of the present disclosure, the pressure measurement element information may include basic data and table data amount information corresponding to the program. According to the performance test range, basic data can be determined; according to the database table list, table data amount information can be determined, wherein corresponding table data amount information exists for each table recorded in the database table list; the table data amount information may characterize the amount of data the table relates to in a production environment.

In operation S240, a test asset result corresponding to the interface service is determined according to the name of the interface service corresponding to the program in the performance test scope.

According to an embodiment of the present disclosure, an interface service corresponding to the program, that is, an interface service affected by a code change of the program may be included in the performance test scope. The test asset results corresponding to the interface service may be queried based on the name of the interface service. The test assets not only comprise all test documents output in the test process, but also comprise test experience, skills, thinking and the like accumulated by a test team; the test asset results may include querying a test asset corresponding to the interface service.

In operation S250, an association relationship is established between the performance test range, the pressure test element information, and the test asset result corresponding to each program in the program change list.

According to the embodiment of the present disclosure, the performance test range, the pressure test element information, and the test asset result for each program recorded in the program change list may be obtained through the above-described operations S220 to S240. Because the performance test range, the pressure test element information and the test asset result are all scattered in the respective management systems, in order to avoid the need of acquiring corresponding data from each management system and associating the data during each evaluation, the association relationship between the performance test range, the pressure test element information and the test asset result corresponding to each program obtained through the operations S220 to S240 can be established.

In operation S260, performance capacity evaluation is performed on the target modification program by using the association relationship, and an evaluation result corresponding to the target modification program is obtained.

According to the embodiment of the disclosure, based on the established association relationship, performance capacity evaluation can be directly performed on the target change program to obtain a corresponding evaluation result. The target change program can represent a core program or a large table program of which the code is changed, and the change can refer to the new addition or modification of the code.

According to the embodiment of the disclosure, the code call link analysis is performed on the programs in the program change list of the application system to obtain the performance test range, the pressure test element information and the test asset result corresponding to each program, so that the association relation between the data of each application system can be established, when the tester evaluates the performance capacity of the target change program, the evaluation result can be obtained rapidly through the established association relation, the rapid evaluation of the target change program is realized, the working efficiency is greatly improved, the maturity requirement of the performance capacity evaluation work on the developer/tester is greatly reduced, and the accuracy and the reliability of the evaluation result are improved.

According to an embodiment of the present disclosure, a performance test scope includes an interface service and a business function corresponding to a program, code call link analysis is performed on the program in a program change list, and a performance test scope and a database table list corresponding to each program are determined, including: code call link analysis is carried out on the program to obtain a full link call relation and a database table list corresponding to the program; determining an entry program corresponding to the program according to the full link call relationship; and according to the portal program, inquiring to obtain interface service and business function corresponding to the program.

According to an embodiment of the present disclosure, the performance test scope may include interface services and business functions corresponding to a program, that is, interface services and business functions specifically affected due to code modification of the program, wherein each of the interface services and business functions may include a plurality of.

According to embodiments of the present disclosure, a manifest of program changes for a core program/large table program may be obtained from a performance capacity assessment system. For each program in the program change list, code call link analysis can be performed on the program, and a full link call relation and a database table list corresponding to the program can be obtained.

According to embodiments of the present disclosure, the portal program of the program may be determined through the full link call relationship, i.e., the portal program may be found from the entire link of the program.

Fig. 3 schematically illustrates a schematic diagram of a link of a program according to an embodiment of the present disclosure.

As shown in fig. 3, the class C method in the link 300 is where the code segment of the program that changed this time is located.

According to the embodiment of the present disclosure, code call link analysis is performed on the link 300 of the program, so that a full link call relationship corresponding to the program can be obtained, where the full link call relationship is: the C-type C method calls a C-type B method and an A-type C method, the C-type B method calls an A-type A method, and the A-type C method calls an B-type B method. Thus, based on the full link call relationship, two portals of the program can be obtained: class a methods and class B methods.

According to an embodiment of the present disclosure, each interface service is recorded in the interface service information registration system, and each service function is recorded in the service function list. By the service interface information in the interface service information registration system and the service information in the service function list, the specific influence of the code change of the program on the interface service and the service function can be judged, the specific performance test range can be automatically identified by a tester, and the interface service and the service function corresponding to the program can be tested later.

According to the embodiments of the present disclosure, an interface service corresponding to a program may be queried in an interface service information registration system based on a portal program; the business function corresponding to the program can be queried in the business function list based on the portal program, so that the performance test range corresponding to the program is obtained.

Fig. 4 schematically shows a schematic diagram of a service interface information presentation interface in an interface service information registration system according to an embodiment of the present disclosure.

As shown in fig. 4, the service interface information display interface 400 can display basic information such as an interface english name, an interface chinese name, a service and interface type, an interface class name, and a method name, etc. by performing a query in the interface service information registration system according to the portal program. The service interface information presentation interface 400 may also display the applications, the service groups, the service classifications, the maintenance applications, the development languages, the security levels, the distributed service framework types, the service hierarchies, and the service levels.

According to the embodiment of the disclosure, the english name of the interface in the service interface information is formed by combining the interface type and the method name, and the interface class name and the method name correspond to the portal program, that is, the interface service corresponding to the program can be queried from the service interface information display interface 400.

Fig. 5 schematically shows a schematic diagram of a business function list according to an embodiment of the disclosure.

As shown in fig. 5, a service function, and a function code, path, and name corresponding to the service function may be included in the service function list 500. From the service function list 500, a service function corresponding to the program can be obtained by searching through an entry program.

For example, the service functions may include service functions such as service management, general query, report query, and payment clearing, and for the service function of service management, the name of the corresponding service function may include credential basic information maintenance, special account maintenance, and form summary reporting; for the service function of general inquiry, the name of the corresponding service function can comprise direct payment evidence inquiry, a loan evidence inquiry, an authorized payment evidence inquiry, a real payment evidence inquiry and a clearing evidence inquiry; for the report to inquire about the service function, the names of the corresponding service functions can comprise a limit account notification book, a financial payment service statistics table and a payment fund calculation detail table; for a payment clearing such a business function, the name of the corresponding business function may include clearing credentials and direct payment credential maintenance.

According to the embodiment of the disclosure, the portal program corresponding to the program can be obtained through analysis by calling the link analysis by the code, so that the corresponding interface service and business function can be obtained according to the portal program, namely, the interface service and business function which are specifically influenced by the code modification of the program are judged, and the subsequent specific performance test range of the program can be determined.

According to an embodiment of the present disclosure, the pressure measurement element information includes basic data and table data amount information, and determining the pressure measurement element information corresponding to the program according to the performance test range and the database table list includes: acquiring production operation and maintenance data corresponding to a performance test range; according to the production operation and maintenance data and the function model, calculating to obtain basic data corresponding to the program; and inquiring to obtain the table data amount information corresponding to the program in the production environment according to the database table list.

According to an embodiment of the present disclosure, the pressure measurement element information may include base data and table data amount information. Basic data can be obtained according to the performance test range; the table data amount information can be obtained according to the database table list.

According to the embodiment of the present disclosure, for each program in the program change list, based on the performance test range obtained in the above operation S220, the generated operation and maintenance data corresponding to the business function and the interface service may be automatically acquired from the production operation and maintenance system according to the business function and the interface service in the performance test range. The production operation and maintenance data can comprise information such as service window time, daily transaction amount, transaction average response time, registered user number, online user number and the like; the production operation and maintenance system is provided with operation platforms such as a full-system monitoring platform and the like for monitoring and counting the scheduling conditions of the interface service and the business function, so that the production operation and maintenance data can be directly obtained from the production operation and maintenance system according to the corresponding business function and the interface service.

According to the embodiment of the disclosure, the basic data can be obtained through calculation according to the production operation and maintenance data and the corresponding function model, wherein the basic data can comprise information such as the number of concurrent users, transaction TPS, the amount of processing data and the like.

According to the embodiment of the disclosure, the concurrency user number of the service peak period obtained through calculation can be calculated according to the online user number, the registered user number and a function model for calculating the concurrency user number.

For example, the ratio of the online user number in the service peak period to the registered user number of the system is a, the ratio of the concurrent user number to the online user number is b, and the following relationship exists: concurrent user number = b online user number; online user number = a registered user number; the number of concurrent users=a×b×the number of registered users.

The number of registered users can represent the total number of registered users of the system, and the registered users can not log in the server for a long time; the number of online users may represent the total number of users online simultaneously; the number of concurrent users may characterize the total number of users simultaneously making requests at a time.

According to the embodiment of the disclosure, the calculated business peak period transaction rate TPS may be based on the service window time and the daily average transaction amount and a function model for the transaction rate TPS calculation.

For example, a system that serves 8 hours a day, i.e. the service window time is 8 hours, the daily transaction amount is 10 tens of thousands, and the transaction rate TPS reaches the following value to meet the requirement: peak transaction rate tps= (100000 x 80%)/(8 x 20% x3600) =13.89 pens/sec.

According to an embodiment of the present disclosure, the relationship between the number of concurrent users, the transaction response time, and the transaction rate TPS may be as follows: TPS = transaction total/total duration without delay; total amount of transactions = (total duration/CRT) VU _s; deducing: tps=vu _s/CRT. Wherein TPS is the number of transaction completed in unit time(s); CRT experiences response time(s) for the customer; VU _s is the number of concurrent users.

According to the embodiment of the disclosure, the database table list related to the whole link of the program can be obtained by analyzing the code call link of the program, so that table data amount information in a production environment can be obtained from a production operation and maintenance system according to the database table list.

Fig. 6 schematically illustrates a schematic diagram of a table statistics interface according to an embodiment of the present disclosure.

As shown in fig. 6, the table statistics interface 600 can present information such as application name, object to which it belongs, table name, table status, table data amount, data block number, and IP. Instance names, record average lengths, whether partition tables and last analysis dates, etc. can also be presented.

According to embodiments of the present disclosure, there are different table statistics interfaces for different types of databases. In the case where the type of database is type 1, a table statistics interface 600 is shown. Database types may include Oracle and MySQL.

According to embodiments of the present disclosure, a table statistics interface under a corresponding type may be selected based on the type of database to which the database table listing corresponds. According to the database table list, the application name, the object, the table space, the table state, the table name and the table data volume corresponding to each table related to the program are larger than those written in the table statistics information interface 600, and the table data volume information of a certain table related to the program is obtained by clicking "inquiry". The corresponding information can also be continuously input by clicking the "reset parameter" to query the table data amount information of another table.

According to the embodiment of the disclosure, corresponding production operation and maintenance data can be acquired for interface service and business functions in the performance test range, so that basic data of the program can be obtained through calculation by generating the operation and maintenance data and utilizing a corresponding function model; and obtaining the table data amount information according to the database table list so as to be used for judging the data amount required to be supplemented by the paving data.

According to an embodiment of the present disclosure, determining a test asset result corresponding to an interface service according to a name of the interface service corresponding to a program in a performance test scope includes: marking test cases and test scripts stored in the test asset system with interface service names; and inquiring the test asset system through the name of the interface service corresponding to the program to obtain a test asset result corresponding to the interface service.

According to the embodiment of the disclosure, the test cases and test scripts are stored in the test asset system, and the test cases and test scripts in the test asset system can be marked in advance according to the corresponding interface service names, namely, for a certain interface service, the test cases and test scripts corresponding to the interface service stored in the test asset system can be marked by the names of the interface service.

According to the embodiment of the disclosure, for each program in the program change list, whether a corresponding test case or test script exists in the test asset system can be automatically searched according to the name of the interface service corresponding to the program in the performance test scope.

According to embodiments of the present disclosure, test cases and test scripts may be included in the test asset results. By querying the test asset system, test cases and test scripts corresponding to the interface service may not be available, in which case the test asset results are null.

FIG. 7 schematically illustrates a schematic diagram of a test script information presentation interface, according to an embodiment of the present disclosure.

As shown in fig. 7, the test asset system may be queried by the name of the interface service, and in the case that a corresponding test script can be queried, a test script information presentation interface 700 may be obtained.

According to an embodiment of the present disclosure, the test script information presentation interface 700 may display script id, script name, application name, creation time, and pressure test cloud platform id of the test script, etc. information to use the corresponding test script for a subsequent test process based on the test script information.

According to the embodiment of the disclosure, the test cases and the test scripts are marked according to the corresponding interface service names in the test asset system in advance, so that the corresponding test asset results can be obtained directly through the interface service names, and whether the ready test cases or the test scripts can be reused or not can be determined conveniently.

According to an embodiment of the present disclosure, performance capacity evaluation is performed on a target modification program by using an association relationship, to obtain an evaluation result corresponding to the target modification program, including: and inquiring the association relation through the name of the target change program, and displaying the evaluation result corresponding to the target change program.

According to the embodiment of the disclosure, the performance test range, the pressure test element information and the test asset result of each program are recorded in the association relation. Based on the established association relationship, the evaluation result corresponding to the target change program can be directly displayed by inputting the name of the target change program modified at this time in the search field. The evaluation result may include a performance test range, pressure test element information, and a test asset result corresponding to the target modification program.

According to the embodiment of the disclosure, based on the established association relationship, the corresponding evaluation result can be obtained and displayed quickly through the name of the target change program, so that the working efficiency is improved, and the accuracy and the reliability of the evaluation result are improved.

According to an embodiment of the present disclosure, the evaluation result includes table data amount information corresponding to the target change program, and the performance capacity evaluation method further includes: comparing the bottom data quantity of the target change program in the production environment with the table data quantity information to obtain a comparison result; under the condition that the comparison result representation bottoming data quantity does not meet the preset condition, the bottoming data is counted until the comparison result representation bottoming data quantity meets the preset condition.

According to the embodiment of the disclosure, the table data amount information corresponding to the target change program in the evaluation result can assist the tester in evaluating whether the bottom laying data amount in the production environment meets the requirement or not, and whether the synchronous production data amount, namely the number of productions, is needed.

According to the embodiment of the disclosure, the bottom data amount of the target change program in the production environment is compared with the table data amount information, so that a comparison result which can embody the data amount relation between the bottom data amount and the table data table information is obtained.

According to embodiments of the present disclosure, in order to keep the performance test environment consistent with the on-line, the amount of flooring data and the amount of table data should be kept aligned, i.e., the amount of flooring data and the amount of table data should be consistent, and thus, the preset condition may be that the amount of flooring data is consistent with the amount of data of the amount of table data.

According to the embodiment of the disclosure, under the condition that the comparison result represents that the bottom laying data quantity does not meet the preset condition, namely, under the condition that the bottom laying data quantity is inconsistent with the table data quantity, the bottom laying data is required to be manufactured until the comparison result represents that the bottom laying data quantity meets the preset condition, namely, until the bottom laying data quantity is consistent with the table data quantity.

According to the embodiment of the disclosure, the table data amount information in the evaluation result is compared with the bottom paving data amount in the generating environment to judge whether the bottom paving data amount meets the preset condition, so that under the condition that the preset condition is not met, the number of the bottom paving data is counted based on the data amount required to be supplemented by the bottom paving data until the preset condition is met, the performance testing environment is kept consistent with the on-line environment, and the real condition of the generating environment is more met.

According to an embodiment of the present disclosure, the evaluation result includes a test asset result, and the performance capacity evaluation method further includes: when the test asset result includes a test case or a test script, the test case or the test script corresponding to the target modification program is multiplexed.

According to the embodiment of the disclosure, the reusable condition of the test asset can be obtained according to the existence of the test cases and the test scripts in the test asset result in the evaluation result. In the case where test cases or test scripts are included in the test asset results, the test asset reusability condition is that there are ready test cases and test scripts for reuse; in the case where test cases and test scripts are not included in the test asset results, the test asset may be reusable in the sense that no existing test cases and test scripts are available for reuse.

According to the embodiment of the disclosure, when the corresponding test case or test script exists in the test asset result in the evaluation result, the corresponding test case or test script can be multiplexed to process the target change program, so that the working efficiency is improved.

Fig. 8 schematically illustrates a structural schematic of an auxiliary evaluation tool according to an embodiment of the present disclosure.

As shown in fig. 8, the auxiliary assessment tool 800 can include a test scope analysis component 810, a pressure measurement element assessment component 820, a test asset retrieval component 830, and an assessment results presentation component 840.

According to an embodiment of the present disclosure, the above-described operation S220 may be performed by the test range analysis component 810, the above-described operation S230 may be performed by the pressure measurement element evaluation component 820, and the above-described operation S240 may be performed by the test asset retrieval component 830.

According to an embodiment of the present disclosure, the association relationship obtained by performing the above operation S250 may be stored in the evaluation result display component 840 such that the above operation S260 is performed by the evaluation result display component 840.

According to embodiments of the present disclosure, the auxiliary assessment tool 800 may provide testing scope analysis, pressure test element assessment, and test asset retrieval for the three large blocks of core capabilities by leveraging the data and assets multiplexed by existing production operation and maintenance testing systems based on the analysis tool for code call link analysis and the base capabilities of the knowledge graph.

Based on the existing discrete storage in each business application system and the local application development assets and test assets, the association retrieval among the assets of each application system is completed through the technologies of code calling link analysis and the like, namely, the association relation is established.

When a tester carries out performance capacity assessment on core program/large-scale program change, the system and the method provide one-stop visual information retrieval capability, so that when the tester carries out performance capacity assessment work, the tester can quickly retrieve information such as corresponding interface service, business function, related list and list data amount, corresponding manual/automatic cases, a funnelcloud performance test script and the like through changing the names of the programs, the problem of previous 'what to measure' and 'how to measure' pain points is solved, and the working efficiency is greatly improved.

Based on the performance capacity assessment method, the disclosure also provides a performance capacity assessment device. The device will be described in detail below in connection with fig. 9.

Fig. 9 schematically shows a block diagram of a performance capacity assessment apparatus according to an embodiment of the present disclosure.

As shown in fig. 9, the performance capacity assessment apparatus 900 of this embodiment includes an acquisition module 910, a first determination module 920, a second determination module 930, a third determination module 940, a setup module 950, and an assessment module 960.

The acquiring module 910 is configured to acquire a program change list of the application system. In an embodiment, the obtaining module 910 may be configured to perform the operation S210 described above, which is not described herein.

The first determining module 920 is configured to perform code call link analysis on the programs in the program change list, and determine a performance test range and a database table list corresponding to each program. In an embodiment, the first determining module 920 may be configured to perform the operation S220 described above, which is not described herein.

The second determining module 930 is configured to determine the pressure measurement element information corresponding to the program according to the performance testing range and the database table list. In an embodiment, the second determining module 930 may be configured to perform the operation S230 described above, which is not described herein.

The third determining module 940 is configured to determine a test asset result corresponding to the interface service according to the name of the interface service corresponding to the program in the performance test scope. In an embodiment, the third determining module 940 may be configured to perform the operation S240 described above, which is not described herein.

The establishing module 950 is configured to establish an association relationship among the performance testing range, the pressure testing element information and the test asset result corresponding to each program in the program change list. In an embodiment, the establishing module 950 may be configured to perform the operation S250 described above, which is not described herein.

The evaluation module 960 is configured to perform performance capacity evaluation on the target modification program by using the association relationship, so as to obtain an evaluation result corresponding to the target modification program. In an embodiment, the evaluation module 960 may be used to perform the operation S260 described above, which is not described herein.

According to an embodiment of the present disclosure, the performance test range includes interface services and business functions corresponding to a program, and the first determining module 920 includes an analyzing unit, a determining unit, and a first querying unit.

And the analysis unit is used for carrying out code call link analysis on the program to obtain a full link call relation and a database table list corresponding to the program.

And the determining unit is used for determining the entry program corresponding to the program according to the full-link call relation.

And the first query unit is used for querying and obtaining interface service and business functions corresponding to the program according to the entry program.

According to an embodiment of the present disclosure, the pressure measurement element information includes basic data and table data amount information, and the second determining module 930 includes an acquiring unit, a calculating unit, and a second querying unit.

And the acquisition unit is used for acquiring the production operation and maintenance data corresponding to the performance test range.

And the calculation unit is used for calculating and obtaining basic data corresponding to the program according to the production operation and maintenance data and the function model.

And the second query unit is used for querying and obtaining the table data amount information corresponding to the program in the production environment according to the database table list.

According to an embodiment of the present disclosure, the third determination module 940 includes a marking unit and an obtaining unit.

And the marking unit is used for marking the test cases and the test scripts stored in the test asset system by the interface service name.

And the obtaining unit is used for inquiring the test asset system through the name of the interface service corresponding to the program to obtain a test asset result corresponding to the interface service.

According to an embodiment of the present disclosure, the assessment module 960 includes a presentation unit.

And the display unit is used for inquiring the association relation through the name of the target change program and displaying the evaluation result corresponding to the target change program.

According to an embodiment of the present disclosure, the evaluation result includes table data amount information corresponding to the target change program, and the evaluation module 960 further includes a comparison unit and a number of make unit.

And the comparison unit is used for comparing the bottom data quantity of the target change program in the production environment with the table data quantity information to obtain a comparison result.

The counting unit is used for counting the bottom laying data under the condition that the comparison result representation bottom laying data quantity does not meet the preset condition, until the comparison result representation bottom laying data quantity meets the preset condition.

According to an embodiment of the present disclosure, the evaluation results include test asset results, and the evaluation module 960 further includes a multiplexing unit.

And the multiplexing unit is used for multiplexing the test cases or the test scripts corresponding to the target change program when the test case or the test script is included in the test asset result.

According to an embodiment of the present disclosure, any of the acquisition module 910, the first determination module 920, the second determination module 930, the third determination module 940, the establishment module 950, and the evaluation module 960 may be combined in one module to be implemented, or any of them may be split into a plurality of modules. Or at least some of the functionality of one or more of the modules may be combined with, and implemented in, at least some of the functionality of other modules. According to embodiments of the present disclosure, at least one of the acquisition module 910, the first determination module 920, the second determination module 930, the third determination module 940, the setup module 950, and the evaluation module 960 may be implemented at least in part as hardware circuitry, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or as hardware or firmware in any other reasonable manner of integrating or packaging the circuitry, or as any one of or a suitable combination of any of the three. Or at least one of the acquisition module 910, the first determination module 920, the second determination module 930, the third determination module 940, the creation module 950, and the evaluation module 960 may be at least partially implemented as a computer program module, which, when executed, may perform the corresponding functions.

As shown in fig. 10, an electronic device 1000 according to an embodiment of the present disclosure includes a processor 1001 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1002 or a program loaded from a storage section 1008 into a Random Access Memory (RAM) 1003. The processor 1001 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or an associated chipset and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. The processor 1001 may also include on-board memory for caching purposes. The processor 1001 may include a single processing unit or multiple processing units for performing different actions of the method flows according to embodiments of the present disclosure.

In the RAM 1003, various programs and data necessary for the operation of the electronic apparatus 1000 are stored. The processor 1001, the ROM 1002, and the RAM 1003 are connected to each other by a bus 1004. The processor 1001 performs various operations of the method flow according to the embodiment of the present disclosure by executing programs in the ROM 1002 and/or the RAM 1003. Note that the program may be stored in one or more memories other than the ROM 1002 and the RAM 1003. The processor 1001 may also perform various operations of the method flow according to the embodiments of the present disclosure by executing programs stored in the one or more memories.

According to an embodiment of the disclosure, the electronic device 1000 may also include an input/output (I/O) interface 1005, the input/output (I/O) interface 1005 also being connected to the bus 1004. The electronic device 1000 may also include one or more of the following components connected to the I/O interface 1005: an input section 1006 including a keyboard, a mouse, and the like; an output portion 1007 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), etc., and a speaker, etc.; a storage portion 1008 including a hard disk or the like; and a communication section 1009 including a network interface card such as a LAN card, a modem, or the like. The communication section 1009 performs communication processing via a network such as the internet. The drive 1010 is also connected to the I/O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is installed as needed in the drive 1010, so that a computer program read out therefrom is installed as needed in the storage section 1008.

The present disclosure also provides a computer-readable storage medium that may be embodied in the apparatus/device/system described in the above embodiments; or may exist alone without being assembled into the apparatus/device/system. The computer-readable storage medium carries one or more programs which, when executed, implement methods in accordance with embodiments of the present disclosure.

According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example, but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, the computer-readable storage medium may include ROM 1002 and/or RAM 1003 and/or one or more memories other than ROM 1002 and RAM 1003 described above.

Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the methods shown in the flowcharts. The program code, when executed in a computer system, causes the computer system to perform the methods provided by embodiments of the present disclosure.

The above-described functions defined in the system/apparatus of the embodiments of the present disclosure are performed when the computer program is executed by the processor 1001. The systems, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the disclosure.

In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted in the form of signals on a network medium, distributed, and downloaded and installed via the communication section 1009, and/or installed from the removable medium 1011. The computer program may include program code that may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 1009, and/or installed from the removable medium 1011. The above-described functions defined in the system of the embodiments of the present disclosure are performed when the computer program is executed by the processor 1001. The systems, devices, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the disclosure.

According to embodiments of the present disclosure, program code for performing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, such computer programs may be implemented in high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. Programming languages include, but are not limited to, such as Java, c++, python, "C" or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Those skilled in the art will appreciate that the features recited in the various embodiments of the disclosure and/or in the claims may be provided in a variety of combinations and/or combinations, even if such combinations or combinations are not explicitly recited in the disclosure. In particular, the features recited in the various embodiments of the present disclosure and/or the claims may be variously combined and/or combined without departing from the spirit and teachings of the present disclosure. All such combinations and/or combinations fall within the scope of the present disclosure.

The embodiments of the present disclosure are described above. These examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the embodiments cannot be used advantageously in combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be made by those skilled in the art without departing from the scope of the disclosure, and such alternatives and modifications are intended to fall within the scope of the disclosure.

Claims

1. A method of performance capacity assessment, the method comprising:

Acquiring a program change list of an application system;

determining the pressure measurement element information corresponding to the program according to the performance test range and the database table list;

And performing performance capacity evaluation on the target change program by utilizing the association relation to obtain an evaluation result corresponding to the target change program.

2. The method of claim 1, wherein the performance test scope includes interface services and business functions corresponding to the programs, wherein the performing code call link analysis on the programs in the program change list to determine the performance test scope and database table list corresponding to each of the programs includes:

Code calling link analysis is carried out on the program to obtain a full-link calling relation corresponding to the program and the database table list;

Determining an entry program corresponding to the program according to the full link call relationship;

And according to the portal program, inquiring to obtain interface service and business function corresponding to the program.

3. The method according to claim 1, wherein the press-measured element information includes basic data and table data amount information, and the determining press-measured element information corresponding to the program based on the performance test range and the database table list includes:

acquiring production operation and maintenance data corresponding to the performance test range;

According to the production operation and maintenance data and the function model, calculating to obtain basic data corresponding to the program; and

And inquiring and obtaining table data amount information corresponding to the program in the production environment according to the database table list.

4. The method of claim 1, wherein determining the test asset result corresponding to the interface service according to the name of the interface service corresponding to the program in the performance test scope comprises:

Marking test cases and test scripts stored in the test asset system with interface service names;

And inquiring the test asset system through the name of the interface service corresponding to the program to obtain a test asset result corresponding to the interface service.

5. The method according to claim 1, wherein performing performance capacity evaluation on the target change program by using the association relationship to obtain an evaluation result corresponding to the target change program includes:

inquiring the association relation through the name of the target change program, and displaying an evaluation result corresponding to the target change program.

6. The method of claim 5, wherein the evaluation result includes table data amount information corresponding to the target change program, the method further comprising:

comparing the bottom laying data quantity of the target change program in the production environment with the table data quantity information to obtain a comparison result; and

And under the condition that the comparison result represents that the bottom laying data quantity does not meet the preset condition, the number of the bottom laying data is created until the comparison result represents that the bottom laying data quantity meets the preset condition.

7. The method of claim 1 or 5, wherein the assessment results comprise test asset results, the method further comprising:

and multiplexing the test cases or test scripts corresponding to the target change program when the test asset result comprises the test cases or the test scripts.

8. A performance capacity assessment apparatus, the apparatus comprising:

the acquisition module is used for acquiring a program change list of the application system;

The first determining module is used for carrying out code calling link analysis on the programs in the program change list and determining a performance test range and a database table list corresponding to each program;

The second determining module is used for determining the pressure measurement element information corresponding to the program according to the performance test range and the database table list;

a third determining module, configured to determine a test asset result corresponding to an interface service corresponding to the program according to a name of the interface service in the performance testing range;

the establishing module is used for establishing an association relationship among the performance test range, the pressure test element information and the test asset result corresponding to each program in the program change list; and

And the evaluation module is used for evaluating the performance and the capacity of the target change program by utilizing the association relation to obtain an evaluation result corresponding to the target change program.

9. An electronic device, comprising:

one or more processors;

A memory for storing one or more computer programs,

Characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, realizes the steps of the method according to any one of claims 1-7.

11. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, realizes the steps of the method according to any one of claims 1-7.