CN116882622A - Method and system for accurately determining test range - Google Patents
Method and system for accurately determining test range Download PDFInfo
- Publication number
- CN116882622A CN116882622A CN202310789320.9A CN202310789320A CN116882622A CN 116882622 A CN116882622 A CN 116882622A CN 202310789320 A CN202310789320 A CN 202310789320A CN 116882622 A CN116882622 A CN 116882622A
- Authority
- CN
- China
- Prior art keywords
- demand
- nonfunctional
- functional
- self
- evaluation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 49
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000011156 evaluation Methods 0.000 claims abstract description 51
- 230000008859 change Effects 0.000 claims abstract description 42
- 238000004519 manufacturing process Methods 0.000 claims abstract description 17
- 238000013210 evaluation model Methods 0.000 claims abstract description 14
- 239000011159 matrix material Substances 0.000 claims abstract description 13
- 238000004364 calculation method Methods 0.000 claims abstract description 10
- 238000000275 quality assurance Methods 0.000 claims abstract description 10
- 238000004590 computer program Methods 0.000 claims description 16
- 238000013507 mapping Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 12
- 238000013468 resource allocation Methods 0.000 claims description 10
- 238000003860 storage Methods 0.000 claims description 10
- 238000004458 analytical method Methods 0.000 claims description 8
- 238000011990 functional testing Methods 0.000 claims description 8
- 238000011002 quantification Methods 0.000 claims description 7
- 230000000149 penetrating effect Effects 0.000 claims description 5
- 238000005516 engineering process Methods 0.000 claims description 4
- 238000013461 design Methods 0.000 claims description 3
- 238000012502 risk assessment Methods 0.000 claims description 3
- 230000035515 penetration Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000012827 research and development Methods 0.000 description 3
- 239000000872 buffer Substances 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/067—Enterprise or organisation modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/06—Asset management; Financial planning or analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Development Economics (AREA)
- General Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Game Theory and Decision Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Educational Administration (AREA)
- Tourism & Hospitality (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Technology Law (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to a method and a system for accurately determining a test range, which are used for establishing a non-functional risk self-evaluation table aiming at scheduling requirements of an application system; the method comprises the steps of establishing a demand evaluation model, and dividing the demand evaluation model into demand disassembly, demand standard penetration and numerical calculation; comparing the quantified demand tracking matrix baselines, and identifying the demand of the current production scheduling change; according to the feedback non-functional risk self-evaluation table self-evaluation result, establishing an instantiation result of a non-functional quality assurance necessity evaluation model in the current period: combining the system performance file, performing secondary rechecking on the quantized result of the demand assessment model, and outputting a correction result; the method and the system can help testers accurately identify the service requirement influence range, influence scene, typical transaction and the like before carrying out nonfunctional quality guarantee work, ensure the effectiveness and the necessity of test implementation actions, and furthest reduce the occurrence of incomplete test or introduction of new nonfunctional quality risks caused by manual experience limitation or one-sided.
Description
Technical Field
The invention relates to the technical field of nonfunctional quality assurance in the financial industry, in particular to a method and a system for accurately determining a test range.
Background
The existing nonfunctional quality assurance work in the financial industry depends on business requirement research documents and manual experience analysis and development; in the sensitive state research and development mode, the influence analysis of the frequent version iteration on the performance capacity and stability of the system depends on subjective judgment of a responsible person.
However, the nonfunctional quality assurance work in the prior art has the following defects: human experience determines the iterative influence range of the requirement, and has limitation; the version production period is shortened due to frequent requirement change, the implementation period is shortened, and the uncontrollability of the system stability risk is increased.
Disclosure of Invention
In order to solve the defects in the prior art, the invention provides a method and a system for accurately determining a test range, which can be used for automatically associating quality influence boundary analysis based on hit rate modeling; under a sensitive state research and development period, the increment demand influence range can be accurately identified, so that the system performance capacity stability is improved.
In order to achieve the above object, the present invention adopts the technical scheme that:
a method for accurately determining a test range, comprising:
s1, when an application system is newly built or reconfigured, a system nonfunctional capacity file is created;
s2, establishing a non-functional risk self-evaluation table aiming at scheduling requirements of an application system; the non-functional risk self-evaluation table comprises a plurality of major classes, and each major class comprises a plurality of minor classes;
s3, establishing a mapping relation between each subclass in the nonfunctional risk self-evaluation table and each asset item in the system nonfunctional capability file; setting the influence degree coefficient of the asset items of the nonfunctional capacity file under the corresponding subclasses in the nonfunctional risk self-evaluation table according to the classification of the application system;
s4, based on whether the scheduling demands need to be subjected to non-functional tests, application system changing conditions and a non-functional risk self-evaluation table, evaluating risks of non-functional changes through a demand evaluation model to obtain a quantitative result of the demand evaluation model and a demand tracking matrix base line for comparison and quantification;
s5, based on a comparison and quantification demand tracking matrix baseline, identifying the demand of the current production schedule change, and dismantling and marking the changed demand through a demand evaluation model, wherein dismantling sub-items comprise non-functional index change, affected typical business transaction change and system technical architecture change;
s6, establishing an instantiation result of a non-functional quality assurance necessity demand assessment model in the current period according to the fed-back non-functional risk self-assessment table self-assessment result;
s7, combining the system nonfunctional capacity file to carry out secondary recheck on the quantitative result of the demand evaluation model to obtain a calibration result, and if the calibration result is changed, changing a base line; if the data is unchanged, notifying the asset library system and the Devops pipeline to carry out regression testing.
Further, the asset items of the non-functional capability profile include: physical architecture topology of the application system, hardware resource configuration, key technology component model selection and version, nonfunctional capability design index, key business scenario, key transaction list, production server resource list and test result baseline.
Further, the self-evaluation item of the non-functional risk self-evaluation table includes: l major classes, each major class comprising 1-n minor classes and at least 1 most typical minor class O is set in each major class; setting a basic score K for each major class; each subclass score was designed as a step grade, recorded in steps 0, 1, 2, 3.
Further, the step S4 includes the sub-steps of:
s41, disassembling the scheduling requirement into a quantized requirement and a non-quantized requirement, wherein the quantized requirement comprises: a data index of the non-functional test requirement and a resource allocation list of the test environment; the non-quantized requirements include: a non-functional risk self-evaluation table;
s42, respectively establishing mapping relations between quantized requirements and unquantized requirements and asset items in the system nonfunctional capability file, performing data processing calculation, and integrating processing results into evaluation items which can be compared with the capability file;
aiming at quantitative requirements, calculating a proportionality coefficient according to a resource allocation list of a test environment and a production server resource list of a system nonfunctional capacity file, carrying out normalized standard-crossing calculation on nonfunctional test indexes according to the linear capacity expansion capacity of the system and the proportionality coefficient of a production test environment resource difference, and evaluating the capacity requirement under the condition of producing the same resource allocation;
and calculating the influence value of each category of the non-functional risk self-evaluation table on the non-functional capability of the application system according to the non-quantitative requirement, and calculating the influence degree of the system on the application system based on the influence degree coefficient of the category.
Further, the step S6 includes the sub-steps of: removing the corresponding subclass with score of 0; if the key subclass score is 0, the major base score value is decremented by 1; sorting the subclasses under each major class according to the score; and taking a trend analysis graph of the key demand hit rate with the highest ranking score, and modeling the demand hit rate.
Further, the secondary rechecking includes: and (3) checking the baseline change condition of the typical nonfunctional case of the system, checking the baseline change condition of the historical index of the system and checking the defensive baseline condition of the current-period coordinate of the system.
The invention also relates to a system for precisely determining the test range, which is characterized by comprising:
the system nonfunctional capacity file creation module is used for creating a system nonfunctional capacity file when the application system is newly built or reconfigured;
the non-functional risk self-evaluation table establishing module is used for establishing a non-functional risk self-evaluation table aiming at the scheduling requirement of the application system; the non-functional risk self-evaluation table comprises a plurality of major classes, and each major class comprises a plurality of minor classes;
the mapping relation establishing module is used for establishing a mapping relation between each subclass in the nonfunctional risk self-evaluation table and each asset item in the system nonfunctional capability file; setting the influence degree coefficient of the asset items of the nonfunctional capacity file under the corresponding subclasses in the nonfunctional risk self-evaluation table according to the classification of the application system;
the risk assessment module is used for assessing risks of non-functional changes through the demand assessment model based on whether the scheduling demands need to be subjected to non-functional tests, application system changing conditions and a non-functional risk self-assessment table, so as to obtain a demand assessment model quantification result and a contrast quantified demand tracking matrix baseline;
the scheduling change demand identification module is used for tracking a matrix baseline based on the compared and quantified demands, identifying the demands of the current production scheduling change, and disassembling and penetrating the changed demands through the demand assessment model; the disassembly sub item comprises a non-functional index change, an affected typical business transaction change and a system technical architecture change;
the instantiation establishing module is used for establishing an instantiation result of the non-functional quality assurance necessity requirement assessment model in the current period according to the fed-back non-functional risk self-assessment table self-assessment result;
the secondary rechecking module is used for carrying out secondary rechecking on the quantitative result of the demand assessment model by combining with the system nonfunctional capacity file to obtain a calibration result, and if the calibration result is changed, the baseline is changed; if the data is unchanged, notifying the asset library system and the Devops pipeline to carry out regression testing.
The invention also relates to a computer readable storage medium, characterized in that the storage medium has stored thereon a computer program which, when executed by a processor, implements the above-mentioned method of determining a test range accurately.
The invention also relates to an electronic device, which is characterized by comprising a processor and a memory;
the memory is used for storing a system nonfunctional capacity file and a nonfunctional risk self-evaluation table;
the processor is used for executing the method for precisely determining the test range by calling the system nonfunctional capability file and the nonfunctional risk self-evaluation table.
The invention also relates to a computer program product comprising a computer program and/or instructions, characterized in that the computer program and/or instructions, when executed by a processor, implement the steps of the method for precisely determining a test range as described above.
The beneficial effects of the invention are as follows:
by adopting the method and the system for accurately determining the test range, provided by the invention, the increment requirement influence range can be accurately identified under the development period of the sensitive state, so that the analysis method for improving the performance and capacity stability of the system is provided; an automated associated quality impact boundary analysis method based on hit rate modeling; the technical scheme of the non-functional quality guarantee technology is improved under the sensitive state research and development period of the financial industry; by automatically analyzing and judging the time sequence demand tracking matrix, more accurate demand influence boundary calculation results can be deduced. The method and the system for precisely determining the testing range can help testers to precisely identify the service requirement influence range, influence scenes, typical transactions and the like before carrying out nonfunctional quality guarantee work, ensure the effectiveness and the necessity of test implementation actions, and furthest reduce the occurrence of the condition that the test is incomplete or new nonfunctional quality risks are introduced due to the limitation of manual experience or one-sided.
Drawings
FIG. 1 is a flow chart of a method for precisely determining a test range according to the present invention.
FIG. 2 is a schematic diagram of a system for precisely determining a test range according to the present invention.
Detailed Description
For a clearer understanding of the present invention, reference will be made to the following detailed description taken in conjunction with the accompanying drawings and examples.
The first aspect of the present invention relates to a method for precisely determining a test range, wherein the flow of the steps of the method is as shown in fig. 1, and the method comprises the following steps:
1. and for the application system, creating a system non-functional capability file when the application system is newly built or reconfigured. The non-functional capability file comprises the physical architecture topology, hardware resource allocation, key technical component selection and version, non-functional capability design indexes, key business scenes, key transaction lists, test result baselines and other assets of the application system, and after the application system is put into operation, the data of the operation stage are updated to serve as operation state assets;
2. aiming at the scheduling requirement of an application system, a non-functional risk self-evaluation table is established, wherein the self-evaluation item comprises; l major classes, L not divisible by 2; each major class includes 1-n minor classes; setting at least 1 most typical minor class O in each major class; each subclass grading is designed as a step grade, and is recorded in steps of 0, 1, 2 and 3; each major class sets a base score K. The above was used as baseline data; each subclass in the self-evaluation table establishes a mapping relation with an asset item in a nonfunctional capability file of the system, and related asset items in the capability file set the influence degree coefficient of the capability by the related subclass according to the classification of the application system;
3. when the application system creates a schedule to perform function optimization, aiming at whether the schedule needs to perform non-function test, automatically evaluating the risk of non-function change according to the change condition of the application system and the feedback of a non-function risk self-evaluation table. The demand assessment model is divided into three parts of demand disassembly, demand through marks and numerical calculation:
(1) And (5) disassembling is required. The method comprises the steps of decomposing contents in scheduling demands into two parts, namely a quantized demand and a non-quantized demand, wherein the quantized demand comprises data indexes of the non-functional test demands, a resource allocation list of a test environment and the like; the non-quantitative requirement mainly refers to a non-functional risk self-evaluation table;
(2) The requirements are through. The demand standard penetrating module respectively establishes mapping relation between the disassembled quantitative demand and the unquantized demand and the content in the application system nonfunctional capacity file, invokes the numerical calculation module to perform data processing, and integrates the processing result into a standard-opposite evaluation item of the capacity file;
(3) And (5) calculating numerical values. Aiming at the quantitative demand part, calculating a proportionality coefficient according to a resource allocation list of a test environment and a production server resource list in a system file, carrying out normalized standard-crossing calculation on indexes of a nonfunctional test according to the linear capacity expansion capacity of the system and the proportionality coefficient of the resource difference of the production test environment, and evaluating the capacity requirement under the condition of producing the same resource allocation; aiming at the unquantized demand part, according to the calculation method in the step 5, calculating the influence value of each category on the unfunctional capacity of the application system, and calculating the influence degree of the category on the system based on the influence degree coefficient of the category on the system, so as to realize the conversion of the unquantized demand into the quantifiable evaluation demand;
4. comparing the quantified demand tracking matrix baselines (formed by quantifying demand evaluation through a 3 rd point), identifying the demand of the change of the current production schedule, dismantling and penetrating the changed demand through a demand evaluation model, wherein dismantling sub items comprise non-functional index change, affected typical business transaction change, system technical architecture change and the like;
5. according to the feedback non-functional risk self-evaluation table self-evaluation result, establishing an instantiation result of a non-functional quality assurance necessity evaluation model in the current period:
removing the corresponding subclass with score of 0; if the key subclass score is 0, the major base score value is decremented by 1; sorting the subclasses under each major class according to the score;
taking a trend analysis chart of the key demand hit rate with the highest ranking score, and modeling the demand hit rate;
6. and combining the system performance file, performing secondary rechecking on the quantized result of the demand evaluation model, and outputting a checking result:
checking the change condition of the base line of the typical nonfunctional case of the system, and changing the base line if the change condition occurs;
checking the change condition of the system historical index baseline, and changing the baseline if the change condition occurs;
the system defends against the baseline condition verification at the current coordinate, and changes the baseline if the current coordinate changes.
7. If no change occurs, the asset library system is notified and the Devops pipeline performs a regression test.
8. If a change occurs:
revealing a baseline change risk;
informing a scheduling responsible person that a work cycle reservation test needs to be additionally arranged;
an incremental test implementation is initiated.
Another aspect of the present invention further relates to a system for precisely determining a test range, whose structure is shown in fig. 2, including:
the system nonfunctional capacity file creation module is used for creating a system nonfunctional capacity file when the application system is newly built or reconfigured;
the non-functional risk self-evaluation table establishing module is used for establishing a non-functional risk self-evaluation table aiming at the scheduling requirement of the application system; the non-functional risk self-evaluation table comprises a plurality of major classes, and each major class comprises a plurality of minor classes;
the mapping relation establishing module is used for establishing a mapping relation between each subclass in the nonfunctional risk self-evaluation table and each asset item in the system nonfunctional capability file; setting the influence degree coefficient of the asset items of the nonfunctional capacity file under the corresponding subclasses in the nonfunctional risk self-evaluation table according to the classification of the application system;
the risk assessment module is used for assessing risks of non-functional changes through the demand assessment model based on whether the scheduling demands need to be subjected to non-functional tests, application system changing conditions and a non-functional risk self-assessment table, so as to obtain a demand assessment model quantification result and a contrast quantified demand tracking matrix baseline;
the scheduling change demand identification module is used for tracking a matrix baseline based on the compared and quantified demands, identifying the demands of the current production scheduling change, and disassembling and penetrating the changed demands through the demand assessment model; the disassembly sub item comprises a non-functional index change, an affected typical business transaction change and a system technical architecture change;
the instantiation establishing module is used for establishing an instantiation result of the non-functional quality assurance necessity requirement assessment model in the current period according to the fed-back non-functional risk self-assessment table self-assessment result;
the secondary rechecking module is used for carrying out secondary rechecking on the quantitative result of the demand assessment model by combining with the system nonfunctional capacity file to obtain a calibration result, and if the calibration result is changed, the baseline is changed; if the data is unchanged, notifying the asset library system and the Devops pipeline to carry out regression testing.
By using the system, the above-mentioned operation processing method can be executed and the corresponding technical effects can be achieved.
The embodiments of the present invention also provide a computer-readable storage medium capable of implementing all the steps of the method in the above embodiments, the computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements all the steps of the method in the above embodiments.
The embodiment of the invention also provides an electronic device for executing the method, which is used as an implementation device of the method, and at least comprises a processor and a memory, wherein data and related computer programs required by the execution method, such as a system nonfunctional capacity file, a nonfunctional risk self-evaluation table and the like, are stored in the memory, and all the steps of the implementation method are executed by calling the data and the programs in the memory by the processor, so that corresponding technical effects are obtained.
Preferably, the electronic device may comprise a bus architecture, and the bus may comprise any number of interconnected buses and bridges, the buses linking together various circuits, including the one or more processors and memory. The bus may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., as are well known in the art and, therefore, will not be further described herein. The bus interface provides an interface between the bus and the receiver and transmitter. The receiver and the transmitter may be the same element, i.e. a transceiver, providing a unit for communicating with various other systems over a transmission medium. The processor is responsible for managing the bus and general processing, while the memory may be used to store data used by the processor in performing operations.
Additionally, the electronic device may further include a communication module, an input unit, an audio processor, a display, a power supply, and the like. The processor (or controllers, operational controls) employed may comprise a microprocessor or other processor device and/or logic devices that receives inputs and controls the operation of the various components of the electronic device; the memory may be one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a nonvolatile memory, or other suitable means, may store the above-mentioned related data information, may further store a program for executing the related information, and the processor may execute the program stored in the memory to realize information storage or processing, etc.; the input unit is used for providing input to the processor, and can be a key or a touch input device; the power supply is used for providing power for the electronic equipment; the display is used for displaying display objects such as images and characters, and may be, for example, an LCD display. The communication module is a transmitter/receiver that transmits and receives signals via an antenna. The communication module (transmitter/receiver) is coupled to the processor to provide an input signal and to receive an output signal, which may be the same as in the case of a conventional mobile communication terminal. Based on different communication technologies, a plurality of communication modules, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, etc., may be provided in the same electronic device. The communication module (transmitter/receiver) is also coupled to the speaker and microphone via the audio processor to provide audio output via the speaker and to receive audio input from the microphone to implement the usual telecommunications functions. The audio processor may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor is also coupled to the central processor so that sound can be recorded on the host through the microphone and sound stored on the host can be played through the speaker.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a system for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
The foregoing is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions easily contemplated by those skilled in the art within the scope of the present invention should be included in the scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.
Claims (10)
1. A method for accurately determining a test range, comprising:
s1, when an application system is newly built or reconfigured, a system nonfunctional capacity file is created;
s2, establishing a non-functional risk self-evaluation table aiming at scheduling requirements of an application system; the non-functional risk self-evaluation table comprises a plurality of major classes, and each major class comprises a plurality of minor classes;
s3, establishing a mapping relation between each subclass in the nonfunctional risk self-evaluation table and each asset item in the system nonfunctional capability file; setting the influence degree coefficient of the asset items of the nonfunctional capacity file under the corresponding subclasses in the nonfunctional risk self-evaluation table according to the classification of the application system;
s4, based on whether the scheduling demands need to be subjected to non-functional tests, application system changing conditions and a non-functional risk self-evaluation table, evaluating risks of non-functional changes through a demand evaluation model to obtain a quantitative result of the demand evaluation model and a demand tracking matrix base line for comparison and quantification;
s5, based on a comparison and quantification demand tracking matrix baseline, identifying the demand of the current production schedule change, and dismantling and marking the changed demand through a demand evaluation model, wherein dismantling sub-items comprise non-functional index change, affected typical business transaction change and system technical architecture change;
s6, establishing an instantiation result of a non-functional quality assurance necessity demand assessment model in the current period according to the fed-back non-functional risk self-assessment table self-assessment result;
s7, combining the system nonfunctional capacity file to carry out secondary recheck on the quantitative result of the demand evaluation model to obtain a calibration result, and if the calibration result is changed, changing a base line; if the data is unchanged, notifying the asset library system and the Devops pipeline to carry out regression testing.
2. The method of claim 1, wherein the asset items of the non-functional capability profile comprise: physical architecture topology of the application system, hardware resource configuration, key technology component model selection and version, nonfunctional capability design index, key business scenario, key transaction list, production server resource list and test result baseline.
3. The method of claim 1, wherein the self-scoring of the non-functional risk self-scoring table comprises: l major classes, each major class comprising 1-n minor classes and at least 1 most typical minor class O is set in each major class; setting a basic score K for each major class; each subclass score was designed as a step grade, recorded in steps 0, 1, 2, 3.
4. The method according to claim 1, wherein the step S4 comprises the sub-steps of:
s41, disassembling the scheduling requirement into a quantized requirement and a non-quantized requirement, wherein the quantized requirement comprises: a data index of the non-functional test requirement and a resource allocation list of the test environment; the non-quantized requirements include: a non-functional risk self-evaluation table;
s42, respectively establishing mapping relations between quantized requirements and unquantized requirements and asset items in the system nonfunctional capability file, performing data processing calculation, and integrating processing results into evaluation items which can be compared with the capability file;
aiming at quantitative requirements, calculating a proportionality coefficient according to a resource allocation list of a test environment and a production server resource list of a system nonfunctional capacity file, carrying out normalized standard-crossing calculation on nonfunctional test indexes according to the linear capacity expansion capacity of the system and the proportionality coefficient of a production test environment resource difference, and evaluating the capacity requirement under the condition of producing the same resource allocation;
and calculating the influence value of each category of the non-functional risk self-evaluation table on the non-functional capability of the application system according to the non-quantitative requirement, and calculating the influence degree of the system on the application system based on the influence degree coefficient of the category.
5. The method according to claim 1, wherein said step S6 comprises the sub-steps of: removing the corresponding subclass with score of 0; if the key subclass score is 0, the major base score value is decremented by 1; sorting the subclasses under each major class according to the score; and taking a trend analysis graph of the key demand hit rate with the highest ranking score, and modeling the demand hit rate.
6. The method of claim 1, wherein the secondary rechecking comprises: and (3) checking the baseline change condition of the typical nonfunctional case of the system, checking the baseline change condition of the historical index of the system and checking the defensive baseline condition of the current-period coordinate of the system.
7. A system for accurately determining a test range, comprising:
the system nonfunctional capacity file creation module is used for creating a system nonfunctional capacity file when the application system is newly built or reconfigured;
the non-functional risk self-evaluation table establishing module is used for establishing a non-functional risk self-evaluation table aiming at the scheduling requirement of the application system; the non-functional risk self-evaluation table comprises a plurality of major classes, and each major class comprises a plurality of minor classes;
the mapping relation establishing module is used for establishing a mapping relation between each subclass in the nonfunctional risk self-evaluation table and each asset item in the system nonfunctional capability file; setting the influence degree coefficient of the asset items of the nonfunctional capacity file under the corresponding subclasses in the nonfunctional risk self-evaluation table according to the classification of the application system;
the risk assessment module is used for assessing risks of non-functional changes through the demand assessment model based on whether the scheduling demands need to be subjected to non-functional tests, application system changing conditions and a non-functional risk self-assessment table, so as to obtain a demand assessment model quantification result and a contrast quantified demand tracking matrix baseline;
the scheduling change demand identification module is used for tracking a matrix baseline based on the compared and quantified demands, identifying the demands of the current production scheduling change, and disassembling and penetrating the changed demands through the demand assessment model; the disassembly sub item comprises a non-functional index change, an affected typical business transaction change and a system technical architecture change;
the instantiation establishing module is used for establishing an instantiation result of the non-functional quality assurance necessity requirement assessment model in the current period according to the fed-back non-functional risk self-assessment table self-assessment result;
the secondary rechecking module is used for carrying out secondary rechecking on the quantitative result of the demand assessment model by combining with the system nonfunctional capacity file to obtain a calibration result, and if the calibration result is changed, the baseline is changed; if the data is unchanged, notifying the asset library system and the Devops pipeline to carry out regression testing.
8. A computer-readable storage medium, characterized in that the storage medium has stored thereon a computer program which, when executed by a processor, implements the method of determining a test range accurately according to any of claims 1 to 6.
9. An electronic device comprising a processor and a memory;
the memory is used for storing a system nonfunctional capacity file and a nonfunctional risk self-evaluation table;
the processor is configured to execute the method for precisely determining a test range according to any one of claims 1 to 6 by calling a system nonfunctional capability profile and a nonfunctional risk self-evaluation table.
10. A computer program product comprising a computer program and/or instructions which, when executed by a processor, implement the steps of the method of determining a test range accurately as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310789320.9A CN116882622A (en) | 2023-06-30 | 2023-06-30 | Method and system for accurately determining test range |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310789320.9A CN116882622A (en) | 2023-06-30 | 2023-06-30 | Method and system for accurately determining test range |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116882622A true CN116882622A (en) | 2023-10-13 |
Family
ID=88259634
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310789320.9A Pending CN116882622A (en) | 2023-06-30 | 2023-06-30 | Method and system for accurately determining test range |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116882622A (en) |
-
2023
- 2023-06-30 CN CN202310789320.9A patent/CN116882622A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11755319B2 (en) | Code development management system | |
| US7747987B1 (en) | System and method of analyzing risk in risk-based software testing | |
| US20150067648A1 (en) | Preparing an optimized test suite for testing an application under test in single or multiple environments | |
| CN109933520B (en) | Software development testing method and device, computer device and storage medium | |
| Rawat et al. | Survey on impact of software metrics on software quality | |
| US20130275949A1 (en) | Testing operations of software | |
| US20090070734A1 (en) | Systems and methods for monitoring software application quality | |
| US11544176B1 (en) | Systems and methods for automatically assessing and conforming software development modules to accessibility guidelines in real-time | |
| CN110888625B (en) | Method for controlling code quality based on demand change and project risk | |
| US20150178647A1 (en) | Method and system for project risk identification and assessment | |
| CN110688536A (en) | Label prediction method, device, equipment and storage medium | |
| US20220327452A1 (en) | Method for automatically updating unit cost of inspection by using comparison between inspection time and work time of crowdsourcing-based project for generating artificial intelligence training data | |
| CN113485988A (en) | Data quality monitoring method and device and computer readable storage medium | |
| CN112905435B (en) | Workload assessment method, device, equipment and storage medium based on big data | |
| CN112882934B (en) | Test analysis method and system based on defect growth | |
| CN114493249A (en) | Road construction full-period management method, system, terminal and storage medium for road engineering supervision | |
| CN116610583A (en) | SCA tool maturity evaluation method, SCA tool maturity evaluation device, SCA tool maturity evaluation equipment, SCA tool maturity evaluation medium and SCA tool maturity evaluation product | |
| CN116882622A (en) | Method and system for accurately determining test range | |
| KR20120111618A (en) | Apparatus and method for testing plc command | |
| CN113094095B (en) | Agile development progress determining method and device | |
| CN114925895A (en) | Maintenance equipment prediction method, terminal and storage medium | |
| CN112380798B (en) | Parameter checking method, device, equipment and storage medium | |
| TWI819239B (en) | Product substance inspection system and product substance inspection method | |
| CN116431490A (en) | Business risk testing method and system for correlation weight adjustment | |
| CN117421311A (en) | Data verification method, device, equipment and storage medium based on artificial intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |