CN115545677B - Online process specification detection method and system based on automatic case execution condition - Google Patents
Online process specification detection method and system based on automatic case execution condition Download PDFInfo
- Publication number
- CN115545677B CN115545677B CN202211481713.5A CN202211481713A CN115545677B CN 115545677 B CN115545677 B CN 115545677B CN 202211481713 A CN202211481713 A CN 202211481713A CN 115545677 B CN115545677 B CN 115545677B
- Authority
- CN
- China
- Prior art keywords
- automatic
- execution condition
- case
- execution
- reason
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Computer Hardware Design (AREA)
- Operations Research (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Marketing (AREA)
- Economics (AREA)
- Data Mining & Analysis (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides an online process specification detection method and system based on an automatic case execution condition, wherein the method comprises the following steps: configuring a corresponding relation between an automatic case testing suite and a statistical dimension; automatically executing an automated case test; counting the execution condition of the automatic use case according to the statistical dimension; after receiving an indication that a pre-release test submitted by a tester is completed, calling an automatic case execution condition, detecting whether the automatic execution condition of the tester accords with a set rule, and if not, counting unexecuted cases and/or reasons of execution failure; if the reason is not filled in, or the reason is a program reason, returning to automatically execute the automatic case testing step until the automatic execution condition meets the set rule or the reason is a non-program reason. The invention can automatically count the data of the execution condition of the automatic case in the online process, and provides data support for the automatic test management work.
Description
Technical Field
The embodiment of the invention relates to the field of software testing, in particular to an online flow specification detection method and system based on an automatic case execution condition.
Background
The developed system needs to be tested by an online process before being formally deployed in a production environment, and the standardization and automation of the online process can influence the stability of the system after online deployment and the quality condition of delivered products.
At present, in the online process of systems of many companies, regression testing is adopted to verify whether other related functional modules can still operate normally after program codes of a certain part of functional modules are changed.
However, the execution condition of the automatic case in the current online process is manually detected, data for automatically counting the execution condition of the automatic case is lacked, data support is lacked in the automatic test management work, and the requirements for analyzing and improving the automatic test work in the online process cannot be met.
Disclosure of Invention
The embodiment of the invention provides an online process specification detection method and system based on an automatic case execution condition, which are used for solving the problems that data support is lacked in automatic test management work in an online process, and the requirements of analysis and improvement of the automatic test work in the online process cannot be met.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides an online process specification detection method based on an automatic use case execution condition, including:
configuring a corresponding relation between an automatic case testing suite and a statistical dimension; the statistical dimensions include at least: a tester;
automatically executing an automated case test;
counting the execution condition of the automatic use case according to the statistical dimension;
after receiving an indication that the pre-release test submitted by the tester is completed, calling an automatic case execution condition, detecting whether the automatic execution condition of the tester accords with a set rule, and if not, counting unexecuted cases and/or reasons of execution failure; the pre-release test is the last test link in the online process;
if the reason is not filled in, or the reason is a program reason, returning to automatically execute the automatic case testing step until the automatic execution condition meets the set rule or the reason is a non-program reason.
Optionally, the executing the automated case test includes:
adding the automatic case test suite into a timing task;
and automatically executing the automatic case test at regular time.
Optionally, the statistical dimension further includes at least one of:
item, execution environment, and execution date.
Optionally, the statistical automation use case execution condition includes:
and carrying out statistics on the execution condition of the automatic use case at regular time.
Optionally, before the submitting the pre-release test is completed, the method includes:
and recording and tracking links of the online process.
Optionally, the automatic use case execution condition includes at least one of the following:
the total number of the use cases, the number of the executed use cases, the number of the unexecuted use cases, the activity, the total execution times, the success times, the failure times and the success rate;
wherein the activity = (number of execution use cases/total number of use cases) × 100%, and the success rate = (number of successes/total number of execution times) × 100%.
In a second aspect, an embodiment of the present invention provides an online process specification detection system based on an automatic use case execution condition, including:
the first processing module is used for configuring the corresponding relation between the automatic case testing suite and the statistical dimension; the statistical dimensions include at least: testing personnel;
the second processing module is used for automatically executing the automatic case test;
the third processing module is used for counting the execution condition of the automatic use case according to the counting dimension;
the first detection module is used for calling the automatic case execution condition after receiving the indication that the pre-release test submitted by the tester is completed, detecting whether the automatic execution condition of the tester accords with a set rule or not, and counting the unexecuted cases and/or the reason of execution failure if the automatic execution condition of the tester does not accord with the set rule; the pre-release test is the last test link in the online process;
and the second detection module is used for returning to the step of automatically executing the automatic case test if the reason is not filled or the reason is a program reason until the automatic execution condition meets the set rule or the reason is a non-program reason.
Optionally, the online process specification detection system based on the execution condition of the automatic use case further includes:
and the fourth processing module is used for recording and tracking links of the online process.
In a third aspect, an embodiment of the present invention provides an electronic device, including: the detection method comprises a processor, a memory and a program which is stored on the memory and can run on the processor, wherein when the program is executed by the processor, the steps of the detection method based on the online flow specification of the automatic case execution situation according to the first aspect are realized.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for detecting an online flow specification based on an execution condition of an automation use case according to the first aspect are implemented.
In the embodiment of the invention, the execution condition of the automatic case is counted according to the statistical dimension, so that data support is provided for the automatic test management work in the online process. In the pre-issuing stage, whether the automatic execution condition of the tester accords with a set rule or not is detected, if not, the reason is counted until the automatic execution condition accords with the set rule or the reason is a non-program reason, so that the requirements of analysis and improvement of automatic test work in the online process are met.
Drawings
Various additional advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a flow diagram of an online flow specification detection method based on an automated case execution situation according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a working process of executing the online process specification detection by the online process specification detection system based on the automatic case execution condition according to the embodiment of the present invention;
FIG. 3 is a schematic structural diagram of an online process specification detection system based on an automated case execution situation according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
Referring to fig. 1 and fig. 2, an embodiment of the present invention provides an online process specification detection method based on an automatic case execution condition, including:
step 11: configuring a corresponding relation between an automatic case testing suite and a statistical dimension; the statistical dimensions include at least: testing personnel;
the automatic case testing suite is a set of testing cases, and a series of testing cases serving the same testing purpose or the same operating environment are combined through the automatic case testing suite.
Step 12: automatically executing an automated case test;
optionally, adding the automated case testing suite into a timing task; and automatically executing the automatic case test at regular time.
Step 13: counting the execution condition of the automatic use case according to the statistical dimension;
optionally, the statistical automation use case execution condition includes: counting the execution condition of the automatic use case at regular time;
after the execution of the statistical automation use case, the method further comprises the following steps: and providing an external query interface.
Step 14: after receiving an indication that the pre-release test submitted by the tester is completed, calling an automatic case execution condition, detecting whether the automatic execution condition of the tester accords with a set rule, and if not, counting unexecuted cases and/or reasons of execution failure; the pre-release test is the last test link in the online process;
the automatic case calling execution condition can be realized by inquiring the external inquiry interface;
the pre-release test is the transition from the test environment to the production environment and is used for solving the problem of chain reaction caused by online deployment and version abnormity due to inconsistency between the test environment and the production environment.
Step 15: if the reason is not filled in, or the reason is a program reason, returning to automatically execute the automatic case testing step until the automatic execution condition meets the set rule or the reason is a non-program reason.
Optionally, the program reason includes at least one of:
bug unresolved and problems were found in regression.
And if the automatic execution condition meets the set rule or the reason is non-program reason, displaying that the indication that the pre-release test of the tester is completed is successfully submitted.
In the embodiment of the invention, the execution condition of the automatic case is counted according to the statistical dimension, so that data support is provided for the automatic test management work in the online process. In the pre-issuing stage, whether the automatic execution condition of the tester accords with a set rule or not is detected, if not, the reason is counted until the automatic execution condition accords with the set rule or the reason is a non-program reason, and therefore the requirements of analyzing and improving the automatic test work in the online process are met.
In an embodiment of the present invention, in order to provide more diversified statistical information, optionally, the statistical dimension further includes at least one of the following:
item, execution environment, and execution date.
Optionally, before the submitting the pre-release test is completed, the method includes:
and recording and tracking links of the online process.
The link of the online process comprises at least one of the following steps: a testing stage, a pre-issuing stage and a formal on-line.
Optionally, the automatic use case execution condition includes at least one of the following:
the total number of the use cases, the number of the executed use cases, the number of the unexecuted use cases, the activity, the total execution times, the success times, the failure times and the success rate;
wherein the activity = (number of execution use cases/total number of use cases) × 100%, and the success rate = (number of successes/total number of execution times) × 100%.
Optionally, the predetermined rule may be: the activity is greater than 95% and the success rate is greater than 90%.
Optionally, the reason further includes at least one of: submitted to test night and in test.
Referring to fig. 3, the present invention further provides an online process specification detection system 30 based on the execution of the automatic use case, which includes:
the first processing module 31 is configured to configure a corresponding relationship between an automation case test suite and a statistical dimension; the statistical dimensions include at least: testing personnel;
the second processing module 32 is used for automatically executing the automated case test;
a third processing module 33, configured to count the execution conditions of the automation use cases according to the statistical dimensions;
the first detection module 34 is configured to, after receiving an indication that a pre-release test submitted by the tester is completed, invoke an automated case execution condition, detect whether the automated execution condition of the tester meets a predetermined rule, and if not, count unexecuted cases and/or cause of execution failure; the pre-release test is the last test link in the online process;
the second detection module 35 is configured to, if the reason is not filled in, or the reason is a program reason, return to the step of automatically executing the automated case test until the automated execution condition meets the predetermined rule or the reason is a non-program reason.
Optionally, the online process specification detection system 30 based on the execution condition of the automated use case further includes:
and the fourth processing module is used for recording and tracking links of the online process.
Optionally, the second processing module 32 is further configured to add the automation case test suite to a timing task; and automatically executing the automatic case test at regular time.
Optionally, the statistical dimension further includes at least one of: item, execution environment, and execution date.
Optionally, the third processing module 33 is further configured to perform timing statistics on the execution condition of the automation use case.
Optionally, the automatic use case execution condition includes at least one of the following:
the total number of the use cases, the number of the executed use cases, the number of the unexecuted use cases, the activity, the total execution times, the success times, the failure times and the success rate;
wherein the activity = (number of execution use cases/total number of use cases) × 100%, and the success rate = (number of successes/total number of execution times) × 100%.
Referring to fig. 4, an embodiment of the present invention further provides an electronic device 40, which includes a processor 41, a memory 42, and a computer program stored in the memory 42 and capable of running on the processor 41, where the computer program, when executed by the processor 41, implements each process of the above-mentioned on-line process specification detection method embodiment based on the execution condition of the automatic use case, and can achieve the same technical effect, and is not described herein again to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned online flow specification detection method embodiment based on the execution condition of the automatic use case, and can achieve the same technical effect, and in order to avoid repetition, the detailed description is omitted here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. An online process specification detection method based on an automatic case execution condition is characterized by comprising the following steps:
configuring a corresponding relation between an automatic case testing suite and a statistical dimension; the statistical dimensions include at least: testing personnel;
automatically executing an automated case test;
counting the execution condition of the automatic use case according to the statistical dimension;
after receiving an indication that a pre-release test submitted by the tester is completed, calling an automatic case execution condition, detecting whether the automatic execution condition of the tester meets a set rule, and if not, counting unexecuted cases and/or reasons of execution failure; the pre-release test is the last test link in the online process;
if the reason is not filled in or is a program reason, returning to the step of automatically executing the automatic case test until the automatic execution condition meets the set rule or the reason is a non-program reason.
2. The method of claim 1, wherein the performing automated case testing comprises:
adding the automatic case test suite into a timing task;
and automatically executing the automatic case test at regular time.
3. The method of claim 1, wherein the statistical dimensions further comprise at least one of:
project, execution environment, and execution date.
4. The method of claim 1, wherein the statistical automation use case execution comprises:
and carrying out statistics on the execution condition of the automatic use case at regular time.
5. The method of claim 1, wherein the submitting the pre-release test before having completed comprises:
and recording and tracking links of the online process.
6. The method of claim 1, wherein the automated use case execution comprises at least one of:
the total number of use cases, the number of executed use cases, the number of unexecuted use cases, the liveness, the total execution times, the success times, the failure times and the success rate;
wherein, the activity = (number of execution use cases/total number of use cases) × 100%, and the success rate = (number of success times/total number of execution times) × 100%.
7. An online flow specification detection system based on an automatic case execution condition is characterized by comprising:
the first processing module is used for configuring the corresponding relation between the automatic case testing suite and the statistical dimension; the statistical dimensions include at least: testing personnel;
the second processing module is used for automatically executing the automatic case test;
the third processing module is used for counting the execution condition of the automatic use case according to the counting dimension;
the first detection module is used for calling the automatic case execution condition after receiving the indication that the pre-release test submitted by the tester is completed, detecting whether the automatic execution condition of the tester accords with a set rule or not, and counting the unexecuted cases and/or the reason of execution failure if the automatic execution condition of the tester does not accord with the set rule; the pre-release test is the last test link in the online process;
and the second detection module is used for returning to the step of automatically executing the automatic case test if the reason is not filled or the reason is a program reason until the automatic execution condition meets the set rule or the reason is a non-program reason.
8. The system of claim 7, further comprising:
and the fourth processing module is used for recording and tracking links of the online process.
9. An electronic device, comprising; a processor, a memory and a program stored on the memory and executable on the processor, wherein the program, when executed by the processor, implements the steps of the method for detecting an online flow specification based on an execution situation of an automation use case according to any one of claims 1 to 6.
10. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements the steps of the method for detecting an online flow specification based on an execution condition of an automation use case according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211481713.5A CN115545677B (en) | 2022-11-24 | 2022-11-24 | Online process specification detection method and system based on automatic case execution condition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211481713.5A CN115545677B (en) | 2022-11-24 | 2022-11-24 | Online process specification detection method and system based on automatic case execution condition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115545677A CN115545677A (en) | 2022-12-30 |
| CN115545677B true CN115545677B (en) | 2023-04-07 |
Family
ID=84721245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211481713.5A Active CN115545677B (en) | 2022-11-24 | 2022-11-24 | Online process specification detection method and system based on automatic case execution condition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115545677B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106484624A (en) * | 2016-10-21 | 2017-03-08 | 天津海量信息技术股份有限公司 | The method of testing of interface automatic test |
| CN110018963A (en) * | 2019-04-11 | 2019-07-16 | 苏州浪潮智能科技有限公司 | A kind of test method, system and electronic equipment and storage medium |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8812424B2 (en) * | 2009-07-21 | 2014-08-19 | International Business Machines Corporation | Semantic web technologies in system automation |
| US20120192162A1 (en) * | 2011-01-20 | 2012-07-26 | Fujitsu Limited | Optimizing Handlers for Application-Specific Operations for Validating C++ Programs Using Symbolic Execution |
| CN104866426B (en) * | 2015-05-28 | 2017-10-17 | 华北计算技术研究所 | Software test integrated control method and system |
| CN108932191A (en) * | 2017-05-23 | 2018-12-04 | 北京嘀嘀无限科技发展有限公司 | Automated testing method, system, computer equipment and readable storage medium storing program for executing |
| CN107861864A (en) * | 2017-08-25 | 2018-03-30 | 平安普惠企业管理有限公司 | Automated testing method, system and computer-readable recording medium |
| CN109062817B (en) * | 2018-10-15 | 2022-06-03 | 网宿科技股份有限公司 | Automatic testing method and system |
| CN111026654A (en) * | 2019-11-28 | 2020-04-17 | 广州华资软件技术有限公司 | Automatic testing method based on interface |
| CN113448826A (en) * | 2020-03-26 | 2021-09-28 | 中移物联网有限公司 | Software automation test system and method |
| CN114546749A (en) * | 2022-02-27 | 2022-05-27 | 山东云海国创云计算装备产业创新中心有限公司 | Chip random test case regression method, device, equipment and readable medium |
-
2022
- 2022-11-24 CN CN202211481713.5A patent/CN115545677B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106484624A (en) * | 2016-10-21 | 2017-03-08 | 天津海量信息技术股份有限公司 | The method of testing of interface automatic test |
| CN110018963A (en) * | 2019-04-11 | 2019-07-16 | 苏州浪潮智能科技有限公司 | A kind of test method, system and electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115545677A (en) | 2022-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109062809B (en) | Online test case generation method and device and electronic equipment | |
| CN107766236B (en) | Test task automatic management method, device, equipment and storage medium | |
| CN111506341B (en) | Software configuration information detection method, device and system | |
| CN114064208A (en) | Method and device for detecting application service state, electronic equipment and storage medium | |
| CN111045927A (en) | Performance test evaluation method and device, computer equipment and readable storage medium | |
| CN112799953A (en) | Interface testing method and device, computer equipment and storage medium | |
| CN110990289B (en) | Method and device for automatically submitting bug, electronic equipment and storage medium | |
| CN111240981A (en) | Interface testing method, system and platform | |
| CN111767218B (en) | Automatic test method, equipment and storage medium for continuous integration | |
| CN111767213B (en) | Database check point testing method and device, electronic equipment and storage medium | |
| CN112084108A (en) | Test script generation method and device and related components | |
| CN115545677B (en) | Online process specification detection method and system based on automatic case execution condition | |
| CN115576831A (en) | Test case recommendation method, device, equipment and storage medium | |
| CN110618943B (en) | Security service test method and device, electronic equipment and readable storage medium | |
| CN108845932B (en) | Unit testing method and device of network library, storage medium and terminal | |
| CN109800170B (en) | Test method, test equipment and readable storage medium based on API test platform | |
| CN113342600A (en) | Method and device for monitoring program dependent plug-in | |
| CN113010417A (en) | Script execution method and device based on automatic test | |
| CN113094277A (en) | Chip test case management method and device | |
| CN110688173A (en) | Positioning method and device of components in cross-platform interface framework and electronic equipment | |
| CN114598588B (en) | Server fault determination method and device and terminal equipment | |
| CN112115046B (en) | Software fault positioning method, device and terminal | |
| CN112486823B (en) | Error code verification method and device, electronic equipment and readable storage medium | |
| CN113778801B (en) | Method and device for reporting start event, electronic equipment and storage medium | |
| CN116401113B (en) | Environment verification method, device and medium for heterogeneous many-core architecture acceleration card |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |