CN102495804A - Automatic software testing method - Google Patents
Automatic software testing method Download PDFInfo
- Publication number
- CN102495804A CN102495804A CN2011104439955A CN201110443995A CN102495804A CN 102495804 A CN102495804 A CN 102495804A CN 2011104439955 A CN2011104439955 A CN 2011104439955A CN 201110443995 A CN201110443995 A CN 201110443995A CN 102495804 A CN102495804 A CN 102495804A
- Authority
- CN
- China
- Prior art keywords
- test
- case
- test assignment
- priority
- assignment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention provides an automatic software testing method. Automatic test tasks and test cases of each automatic test task are optimally sequenced, so that the execution efficiency of the whole automatic test process can be effectively improved.
Description
Technical field
The present invention relates to software testing technology, particularly relate to a kind of software automated testing method.
Background technology
Software automated testing is simulated manual testing procedure exactly, carries out the test procedure with certain programming language establishment, the execution of control tested software, the process of completion software test.
In recent years along with technological particularly high-efficiency automatic test frame technology and the outstanding automated test tool appearance of development of software automated testing; Largely improved the development efficiency of automatic test script, the development ability of grasping automatic test script has become a tester's basic skills.
The execution of test case is test assignment to be set in sequence according to the user in the existing automated testing method.Widespread use along with automatic test script; The automatic test task that test macro will be carried out increases, and each automatic test task will comprise a plurality of automatic test cases, therefore; Correspondingly; The automatic test cases quantity that test macro will be carried out constantly increases, and like this, will cause the execution efficient of test script to begin to descend.
Summary of the invention
In view of this, fundamental purpose of the present invention is to provide a kind of software automated testing method, and this method can effectively improve automatic test efficient.
In order to achieve the above object, the technical scheme of the present invention's proposition is:
A kind of software automated testing method, this method may further comprise the steps:
A, the preset priority of basis are confirmed strategy, confirm the current priority that needs each test assignment of execution;
B, for each said test assignment, according to preset use case organization optimization strategy, the quantity and the execution sequence of all use-cases that this test assignment is comprised are optimized, and obtain the use-case optimal combination sequence of this test assignment;
C, according to the priority descending of said each test assignment, all test assignments are sorted; According to the incidence relation between current test client quantity N and said each test assignment; Be divided into the N child queues according to the principle of the task balance test assignment after with said ordering; Each said subqueue is corresponding with different test clients respectively; Wherein, onrelevant relation between the test assignment of different sub formation, and the order of test assignment is the descending of said priority in each subqueue;
D, for each said subqueue; Each test assignment that it comprised is replaced with corresponding said use-case optimal combination sequence respectively; Obtain the pairing use-case formation of this subqueue, and on the corresponding test client of this subqueue, carry out each use-case in the said use-case formation successively.
In sum; The software automated testing method that the present invention proposes; Execution sequence through test case that automatic test task and each robotization test assignment are comprised is optimized ordering, can effectively improve the execution efficient of whole automatic test course.
Description of drawings
Fig. 1 is the schematic flow sheet of the embodiment of the invention one.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, will combine accompanying drawing and specific embodiment that the present invention is done to describe in detail further below.
Core concept of the present invention is: consider between characteristic and the task of test assignment and use-case or the factors such as correlation degree between use-case; Execution sequence and quantity to test assignment and use-case are optimized; Adopt means such as reducing reruning of a plurality of identical use-cases, improve the integral body of automatic test and carry out efficient.
Fig. 1 is the schematic flow sheet of the embodiment of the invention one, and is as shown in Figure 1, and this embodiment comprises:
This step is confirmed the priority of test assignment, will help in subsequent step, based on this task executions order being optimized, to improve task executions efficient.
Here, said priority confirms that strategy can be provided with according to actual needs in advance.Preferably, can comprise:
If said test assignment is preserved the empirical value of same test task in current test macro; Then, confirm the priority of this test assignment according to this empirical value and preset empirical value and priority mapping relation, otherwise; According to the dynamic create-rule of the priority of current preset; Confirm the priority of this test assignment, if current do not have a dynamic create-rule of said priority, the initial priority of appointment is as the priority of this test assignment when then the tester being imported this test assignment; If this test assignment does not have initial priority, then preset default priorities is set to the priority of this test assignment.
Said empirical value can be priority during the same test task that write down in the test macro is the last when carrying out required time or the last the execution.
In practical application; The dynamic create-rule of said priority can be provided with through user interface by the tester in advance; Can consider following Several Factors when specifically rule being set: type under the test assignment; The use-case quantity that test assignment comprises, with the correlation degree of other test assignments and the default priorities size of test assignment, the tester can select the combination of above-mentioned one or more factors to formulate the suitable dynamic create-rule of priority according to actual needs.
In addition; Under considering test assignment, during type, specifically can consider: 1) be user acceptance test or general module test 2 from following several types) be functional test or performance test 3) be foreground or background test task 4) be simple business or complicated business.Preferably, the ratio latter's that the former priority can be provided with in the above-mentioned several types height is carried out efficient with the integral body that improves task.In practical application, can confirm priority according to type under the test assignment according to above-mentioned order, for example, when a test assignment can't confirm user acceptance test still be the general module test be that priority is confirmed in functional test or performance test then according to it.
Preferably; In order further to improve task executions efficient; Can split big task, like this, the execution time difference that can guarantee different task is not too big; And then after the task queue after can guaranteeing after this will optimize was configured on each test client successively, the task execution time of each test client can not differ greatly because of the use-case number that different task comprises and have bigger difference.
, can split when realizing above-mentioned thought concrete, make the use-case quantity that test assignment comprised after the fractionation be no more than said threshold value M for the test assignment of the quantity that comprises use-case greater than predetermined threshold value M.
Here, for threshold value M, it is more little that M is provided with; The number of tasks that needs to split also can be many more, and correspondingly algorithm complex also can increase, still; Task is carried out optimized distribution on each test client accuracy also can improve; Otherwise it is big more that M is provided with, and the effect that improves the integral body execution efficient of task can be more little.Particularly, those skilled in the art can be provided with suitable M value according to actual needs.
Here, utilize said use-case organization optimization strategy, the use-case of each test assignment is optimized, can improve the execution efficient of test assignment.
Preferably, said use-case organization optimization strategy can comprise: for identical plural use-case, only keep the use-case that ranks the first; According to the incidence relation between use-case, the use-case that needs are carried out earlier is arranged in corresponding the needs before the use-case that the back carries out.
In above-mentioned use-case organization optimization strategy, for identical plural use-case, only keep the use-case that ranks the first, promptly only keep minimum one of sequence number in all identical use-cases, such as, the use-case sequence does
A1、B2、A3、C4、A5、D6、A7、E8
After carrying out optimization process, become A1, B2, C3, D4, E5, therefore reduced the execution of three use-cases.(annotate: A, B... are the identification number of use-case, and back numerical value is the sequence number of use-case in formation)
Here, when carrying out the division of N child queues, need observe the principle of each subqueue task balance, balanced with the execution time of guaranteeing each subqueue, thus the integral body that can improve test assignment is carried out efficient.
Concrete realization in the face of this step is illustrated down.
At first, reading the priority that will carry out test assignment, is that the priority of the test assignment of T1, T2, T3, T4, T5, T6 is respectively like identification number ID: 1,3,2,2,3,1.
Then, the test assignment of high priority being come the front generates a new robotization and carries out formation and be exactly: T1, T6, T3, T4, T2, T5.
Next, according to the quantity and the task correlation degree data cases of client the division of subqueue is carried out in above-mentioned formation (T1, T6, T3, T4, T2, T5) again.If the test client resource ID is C1, C2, C3, task correlation degree data show that T2 must wait T3 to execute the execution of becoming a useful person, T4 and T5 and other task does not have incidence relation, and are following through three child queues that obtain after optimization and the decomposition:
C1：T1、T4
C2：T6、T5
C3：T3、T2
Further, in order to improve the dirigibility of automatic test, obtain the pairing use-case formation of subqueue in this step after, the tester can adjust the use-case formation of sorting according to actual needs.Particularly, test macro can pass through the test and management interface, and with the use-case formation of said subqueue and the test assignment under each use-case wherein, notice is given the tester, and said tester revises said use-case formation according to current test needs.Then, test client is carried out based on revised use-case formation and is got final product.The method that concrete test client is carried out use-case is identical with existing system, repeats no more at this.
Further, can also add up this needed time and being kept in the test macro when carrying out of each said test assignment,, confirm priority to help it so that next same test task when carrying out, offers this test assignment as empirical value.
In sum, more than being merely preferred embodiment of the present invention, is not to be used to limit protection scope of the present invention.All within spirit of the present invention and principle, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (7)
1. a software automated testing method is characterized in that, this method may further comprise the steps:
A, the preset priority of basis are confirmed strategy, confirm the current priority that needs each test assignment of execution;
B, for each said test assignment, according to preset use case organization optimization strategy, the quantity and the execution sequence of all use-cases that this test assignment is comprised are optimized, and obtain the use-case optimal combination sequence of this test assignment;
C, according to the priority descending of said each test assignment, all test assignments are sorted; According to the incidence relation between current test client quantity N and said each test assignment; Be divided into the N child queues according to the principle of the task balance test assignment after with said ordering; Each said subqueue is corresponding with different test clients respectively; Wherein, onrelevant relation between the test assignment of different sub formation, and the order of test assignment is the descending of said priority in each subqueue;
D, for each said subqueue; Each test assignment that it comprised is replaced with corresponding said use-case optimal combination sequence respectively; Obtain the pairing use-case formation of this subqueue, and on the corresponding test client of this subqueue, carry out each use-case in the said use-case formation successively.
2. method according to claim 1 is characterized in that, said method further comprises before the said step a:
For the test assignment of the quantity that comprises use-case greater than predetermined threshold value M, split, make the use-case quantity that test assignment comprised after the fractionation be no more than said threshold value M.
3. method according to claim 1 is characterized in that, priority described in the step a confirms that strategy comprises:
If said test assignment is preserved the empirical value of same test task in current test macro; Then, confirm the priority of this test assignment according to this empirical value and preset empirical value and priority mapping relation, otherwise; According to the dynamic create-rule of the priority of current preset; Confirm the priority of this test assignment, if current do not have a dynamic create-rule of said priority, the initial priority of appointment is as the priority of this test assignment when then the tester being imported this test assignment; If this test assignment does not have initial priority, then preset default priorities is set to the priority of this test assignment.
4. method according to claim 1 is characterized in that, empirical value described in the step a is: the priority during the last the execution when required time or the last the execution.
5. method according to claim 1 is characterized in that, the organization optimization of use-case described in step b strategy comprises:
For identical plural use-case, only keep the use-case that ranks the first; According to the incidence relation between use-case, the use-case that needs are carried out earlier is arranged in corresponding the needs before the use-case that the back carries out.
6. method according to claim 1 is characterized in that, carries out in the said steps d further comprising before the said execution:
Through the test and management interface, with the use-case formation of said subqueue and the test assignment under each use-case wherein, notice is given the tester, and said tester revises said use-case formation according to current test needs.
7. method according to claim 1 is characterized in that, further comprises when carrying out said execution in the said steps d: add up this needed time and preserving when carrying out of each said test assignment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104439955A CN102495804A (en) | 2011-12-27 | 2011-12-27 | Automatic software testing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104439955A CN102495804A (en) | 2011-12-27 | 2011-12-27 | Automatic software testing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102495804A true CN102495804A (en) | 2012-06-13 |
Family
ID=46187629
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011104439955A Pending CN102495804A (en) | 2011-12-27 | 2011-12-27 | Automatic software testing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102495804A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103838673A (en) * | 2014-03-05 | 2014-06-04 | 广东小天才科技有限公司 | Automatic testing method and device |
| CN104461877A (en) * | 2014-11-27 | 2015-03-25 | 百度在线网络技术（北京）有限公司 | Software testing method and device |
| CN105094511A (en) * | 2014-05-20 | 2015-11-25 | 富士通株式会社 | Test case generating method and test case generating device |
| CN105468503A (en) * | 2014-08-06 | 2016-04-06 | 腾讯科技（深圳）有限公司 | Software test method and device |
| CN105511951A (en) * | 2016-01-06 | 2016-04-20 | 上海斐讯数据通信技术有限公司 | Task scheduling method and task scheduling system for automatic WIFI performance test platform |
| WO2016188170A1 (en) * | 2015-10-22 | 2016-12-01 | 中兴通讯股份有限公司 | Test method and device, apparatus and computer storage medium |
| CN106603789A (en) * | 2016-12-12 | 2017-04-26 | 青岛海信移动通信技术股份有限公司 | Method and system to increase equipment testing efficiency |
| CN103593373B (en) * | 2012-08-16 | 2018-09-07 | 北京百度网讯科技有限公司 | A kind of method and apparatus for search results ranking |
| CN108628730A (en) * | 2017-03-15 | 2018-10-09 | 阿里巴巴集团控股有限公司 | Method for testing software, device and system and electronic equipment |
| CN108763093A (en) * | 2018-06-01 | 2018-11-06 | 政采云有限公司 | A kind of automated testing method and system |
| CN108932191A (en) * | 2017-05-23 | 2018-12-04 | 北京嘀嘀无限科技发展有限公司 | Automated testing method, system, computer equipment and readable storage medium storing program for executing |
| CN111176819A (en) * | 2019-12-31 | 2020-05-19 | 苏州长光华医生物医学工程有限公司 | Sample test pipeline task scheduling method, system and computer storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010011370A1 (en) * | 1998-09-03 | 2001-08-02 | Elsa L. Gunter | Interactive software testing system and method |
| US20030110474A1 (en) * | 2001-12-06 | 2003-06-12 | International Business Machines Corporation | System for coverability analysis |
| CN101094120A (en) * | 2007-07-04 | 2007-12-26 | 中兴通讯股份有限公司 | Automatic test system and method based on network stack system |
| CN101217418A (en) * | 2007-12-28 | 2008-07-09 | 西安西电捷通无线网络通信有限公司 | A multitask dispatching method applied in network performance test |
| CN101227350A (en) * | 2008-02-03 | 2008-07-23 | 中兴通讯股份有限公司 | System for parallel executing automatization test based on priority level scheduling and method thereof |
| CN101986278A (en) * | 2010-10-29 | 2011-03-16 | 中国计量科学研究院 | Automatic testing method and system for electronic equipment |
| CN102063376A (en) * | 2011-02-16 | 2011-05-18 | 哈尔滨工程大学 | Test case selection method |
| CN102214139A (en) * | 2011-06-01 | 2011-10-12 | 北京航空航天大学 | Automatic test performance control and debugging method facing distributed system |
-
2011
- 2011-12-27 CN CN2011104439955A patent/CN102495804A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010011370A1 (en) * | 1998-09-03 | 2001-08-02 | Elsa L. Gunter | Interactive software testing system and method |
| US20030110474A1 (en) * | 2001-12-06 | 2003-06-12 | International Business Machines Corporation | System for coverability analysis |
| CN101094120A (en) * | 2007-07-04 | 2007-12-26 | 中兴通讯股份有限公司 | Automatic test system and method based on network stack system |
| CN101217418A (en) * | 2007-12-28 | 2008-07-09 | 西安西电捷通无线网络通信有限公司 | A multitask dispatching method applied in network performance test |
| CN101227350A (en) * | 2008-02-03 | 2008-07-23 | 中兴通讯股份有限公司 | System for parallel executing automatization test based on priority level scheduling and method thereof |
| CN101986278A (en) * | 2010-10-29 | 2011-03-16 | 中国计量科学研究院 | Automatic testing method and system for electronic equipment |
| CN102063376A (en) * | 2011-02-16 | 2011-05-18 | 哈尔滨工程大学 | Test case selection method |
| CN102214139A (en) * | 2011-06-01 | 2011-10-12 | 北京航空航天大学 | Automatic test performance control and debugging method facing distributed system |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103593373B (en) * | 2012-08-16 | 2018-09-07 | 北京百度网讯科技有限公司 | A kind of method and apparatus for search results ranking |
| CN103838673A (en) * | 2014-03-05 | 2014-06-04 | 广东小天才科技有限公司 | Automatic testing method and device |
| CN105094511A (en) * | 2014-05-20 | 2015-11-25 | 富士通株式会社 | Test case generating method and test case generating device |
| CN105468503A (en) * | 2014-08-06 | 2016-04-06 | 腾讯科技（深圳）有限公司 | Software test method and device |
| CN105468503B (en) * | 2014-08-06 | 2019-10-22 | 腾讯科技（深圳）有限公司 | A kind of method for testing software and its equipment |
| CN104461877A (en) * | 2014-11-27 | 2015-03-25 | 百度在线网络技术（北京）有限公司 | Software testing method and device |
| CN104461877B (en) * | 2014-11-27 | 2018-03-02 | 百度在线网络技术（北京）有限公司 | Method for testing software and software testing device |
| WO2016188170A1 (en) * | 2015-10-22 | 2016-12-01 | 中兴通讯股份有限公司 | Test method and device, apparatus and computer storage medium |
| CN105511951B (en) * | 2016-01-06 | 2019-07-05 | 上海斐讯数据通信技术有限公司 | A kind of method for scheduling task and system of WIFI performance automation test platform |
| CN105511951A (en) * | 2016-01-06 | 2016-04-20 | 上海斐讯数据通信技术有限公司 | Task scheduling method and task scheduling system for automatic WIFI performance test platform |
| CN106603789A (en) * | 2016-12-12 | 2017-04-26 | 青岛海信移动通信技术股份有限公司 | Method and system to increase equipment testing efficiency |
| CN108628730A (en) * | 2017-03-15 | 2018-10-09 | 阿里巴巴集团控股有限公司 | Method for testing software, device and system and electronic equipment |
| CN108932191A (en) * | 2017-05-23 | 2018-12-04 | 北京嘀嘀无限科技发展有限公司 | Automated testing method, system, computer equipment and readable storage medium storing program for executing |
| CN108763093A (en) * | 2018-06-01 | 2018-11-06 | 政采云有限公司 | A kind of automated testing method and system |
| CN111176819A (en) * | 2019-12-31 | 2020-05-19 | 苏州长光华医生物医学工程有限公司 | Sample test pipeline task scheduling method, system and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102495804A (en) | Automatic software testing method | |
| CN106802826B (en) | Service processing method and device based on thread pool | |
| CN106371918B (en) | Task cluster schedule management method and device | |
| CN104239154B (en) | Job scheduling method and job scheduler in a kind of Hadoop clusters | |
| CN103701934B (en) | Resource optimal scheduling method and virtual machine host machine optimal selection method | |
| CN106445675B (en) | B2B platform distributed application scheduling and resource allocation method | |
| CN105260237B (en) | The task scheduling system and its dispatching method of heterogeneous polynuclear platform | |
| CN106980532A (en) | A kind of job scheduling method and device | |
| CN103838627B (en) | Workflow dispatching method based on workflow throughput maximization | |
| CN103679388B (en) | Production scheduling method and production scheduling system | |
| CN105912387A (en) | Method and device for dispatching data processing operation | |
| CN103023980B (en) | A kind of method and system of cloud platform processes user service request | |
| CN106709628A (en) | Production scheduling method and production scheduling system | |
| CN107193655B (en) | Big data processing-oriented fair resource scheduling method based on utility function | |
| CN110187956A (en) | A kind of the layering real-time task scheduling method and system of multiple agent platform | |
| CN102917014B (en) | Resource regulating method and device | |
| Qiu et al. | Cost-minimizing preemptive scheduling of mapreduce workloads on hybrid clouds | |
| CN110362391A (en) | Resource regulating method, device, electronic equipment and storage medium | |
| CN106776025A (en) | A kind of computer cluster job scheduling method and its device | |
| CN110347602A (en) | Multitask script execution and device, electronic equipment and readable storage medium storing program for executing | |
| CN103595654A (en) | HQoS implementation method, device and network equipment based on multi-core CPUs | |
| CN106487889B (en) | A kind of task towards cloud data center and data aggregate dispositions method | |
| CN107423914A (en) | A kind of method for scheduling task and system based on cloud manufacture | |
| CN107423122A (en) | A kind of complicated O＆M operation layout and scheduling system and method | |
| WO2019029721A1 (en) | Task scheduling method, apparatus and device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120613 |