CN103092756A - Interactive automated testing system and method thereof - Google Patents
Interactive automated testing system and method thereof Download PDFInfo
- Publication number
- CN103092756A CN103092756A CN2013100055758A CN201310005575A CN103092756A CN 103092756 A CN103092756 A CN 103092756A CN 2013100055758 A CN2013100055758 A CN 2013100055758A CN 201310005575 A CN201310005575 A CN 201310005575A CN 103092756 A CN103092756 A CN 103092756A
- Authority
- CN
- China
- Prior art keywords
- test
- automatic
- control end
- case
- action
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 464
- 238000000034 method Methods 0.000 title claims abstract description 111
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 47
- 238000013515 script Methods 0.000 claims abstract description 34
- 230000009471 action Effects 0.000 claims description 86
- 230000008569 process Effects 0.000 claims description 43
- 238000012956 testing procedure Methods 0.000 claims description 42
- 238000012545 processing Methods 0.000 claims description 26
- 238000007726 management method Methods 0.000 claims description 24
- 238000013461 design Methods 0.000 claims description 13
- 238000013142 basic testing Methods 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 9
- 238000005516 engineering process Methods 0.000 claims description 9
- 230000006870 function Effects 0.000 claims description 9
- 239000003795 chemical substances by application Substances 0.000 claims description 7
- 230000000694 effects Effects 0.000 claims description 6
- 238000011084 recovery Methods 0.000 claims description 6
- 230000002159 abnormal effect Effects 0.000 claims description 5
- 230000003993 interaction Effects 0.000 claims description 5
- 239000002245 particle Substances 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000007689 inspection Methods 0.000 claims description 3
- 238000012856 packing Methods 0.000 claims description 3
- 230000000717 retained effect Effects 0.000 claims description 3
- 230000033764 rhythmic process Effects 0.000 claims description 3
- 230000014509 gene expression Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000002950 deficient Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 239000012467 final product Substances 0.000 description 2
- 230000035800 maturation Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004321 preservation Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000013522 software testing Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013524 data verification Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention discloses an interactive automated testing system and a method of the interactive automated testing system. The interactive automated testing system comprises a test master control end which is respectively connected with an automatic use-case editor and a plurality of agent actuating ends. The automatic use-case editor is connected with an interface record module through a recorded control library file. The automatic use-case editor and the test master control end are provided with a similar natural language manager. The interactive automated testing system and the method of the interactive automated testing system firstly solves the problem how to achieve generation and usage of temporary storage data variable, and how the interactive automated testing system achieves unified management of life cycles of the data variable when a traditional mode that a programming script drives an automated testing is abandoned so as to achieve high-speed generation of an automated testing use-case, and secondly solves the problems that how to automatically and accurately marking positions of occurrences of issues on a picture after the automated testing carries out an automatic screenshot, and how to accurately and detailedly scripting the problems, and meanwhile a issue script is printed on the picture and is used as issue remark of the picture.
Description
Technical field
The present invention relates to the design and development field of software automated testing field instrument, particularly a kind of interactive automatic test the build tool.
Background technology
No matter current main flow testing tool is the automated test tool of increasing income, or the business automation testing tool, is all directly to use certain programming language, carries out test script and writes and debug, and then script is carried out automatic test at unit.These automatic tests due to its capture ability to defective, robustness and the adaptability to changing, all depend on the result of writing of script.But, the restriction of the complexity constraints of single test script and testing cost benefit, can not script write too complicated.So current automated test tool can only be used for the regression test of software when mature and stable.In test process, " accident " mistake that script reckons without on principle, can't accomplish effectively to catch and automatically process.
Because current testing tool is substantially all carried out design for unit, so, the Business Stream use-case test that is difficult to set up reciprocal process between many machines.And the test of the Business Stream of this respect, the but Core Feature of the functional requirement of software test often.
Due to automatic test script, be with certain language, be built in the mode of programming.So, the building process of automatic test, from design test framework and structure debugging test script, the process to the setup test data has expended plenty of time and resource, makes automatic test be difficult to demonstrate significant cost benefit.
Summary of the invention
In order to solve the problems of the technologies described above, the invention provides a kind of interactive automation test system and method thereof.
For realizing above-mentioned technical purpose, reach above-mentioned technique effect, the present invention is achieved through the following technical solutions:
A kind of interactive automation test system, comprise a test overhead control end (main control end), described test overhead control end is connected with respectively a robotization use-case editing machine and several act on behalf of actuating station, described robotization use-case editing machine connects an interface by the widget library file of recording and records module, described robotization use-case editing machine and described test master control end are used and can by senior robotization language editing machine, action command be encoded and be resolved;
Described senior robotization language editing machine does not need service condition redirect, circulation etc. that the statement of programmable features is arranged, and completes the checking of test result and catching or the operations such as cycle calculations, circular wait of test errors; To logical process such as the calculating of the catching of the judgement of test result, graunch, test result, circular waits, by the proprietary module of test macro, automatically complete; Senior robotization language focuses on succinct, understandable, standard, and each manual test of describing test case near the mode of natural language needs the concrete operational motion of implementing and checking action;
All controls and the interface sectional drawing that module is recorded measurand recorded at described interface, and packing is encapsulated in widget library, generates and tests the master control end and act on behalf of actuating station and carry out use for robotization use-case editing machine use-case; Wherein,
Comprise measurand and changed redirecting technique and the automatic test detail time statistics of identifying;
Described object identification redirecting technique refers to after object is recorded to library of object, begins to design various automatic test cases.When if the measurand version changes, do not need again to record library of object, the dependence test use-case calcellation that does not also need to rely on this library of object rewrites.But the relevant recognition property weight of the change object of library of object is suitably adjusted, make execution module can again identify this control, relevant test case still continues to use.(because the Attribute Recognition weight of giving tacit consent to arranges, be to optimize to arrange, the simple attribute change of general measurand does not need to carry out the adjustment of Attribute Recognition weight, gets final product the control that Direct Recognition goes out change) in the ordinary course of things.This measurand redirecting technique, make automated test tool, possessed certain Intelligent Recognition ability, can with the cost of minimum (, adapt to fast the change of measurand, thereby make Software Testing Tool, really can be applied in software not full ripe stage also, enlarged the application (traditional automatic test can only be applied to the recurrence test to the constant module of maturation) of automated test tool.
Described automatic test duration statistics, it is automated test tool, automatically before carrying out, test action records the time, after test action is carried out fully, then record the time, its mistiming is namely that precise time is carried out in test action, in like manner, can according to setting, can record the network time of action command transmission, the various details times of tested software operational process such as data response time.These times can be used for doing the various performance evaluations of tested software accurately.The detail record of this time can after test, as the test log report, together be submitted to log system.
Described robotization use-case editing machine loads the interface and records the widget library that module is recorded, generate automatic test cases, and simulate the overall picture that shows system under test (SUT) on the interface, and directly choose tested control to facilitate the Test Sample Design personnel, generate action or inspection that this control is carried out;
Described test master control end is recorded the automatic test cases that widget library that module records and robotization use-case editing machine generate to the interface and is loaded into system, execution is according to the setting of widget library and configuration file, carry out measurand identification, assigning executing the task in automatic test cases carries out to acting on behalf of actuating station, simultaneously, result log and the corresponding sectional drawing after the actuating station execution action acted on behalf of in acceptance, preserves into journal file; The master control end can also be arranged to concurrent state, respectively act on behalf of actuating station with what the concurrent test use-case sent to appointment simultaneously, act on behalf of the test action that actuating station is carried out appointment simultaneously, and with daily record and the corresponding sectional drawing of each self-operating, send to the master control end, by master control end classification storage.
The described actuating station connecting test master control end of acting on behalf of, and receive the control operational motion that execution test master control end sends over, result and screenshotss after operating simultaneously, and picture is marked automatically, send to test master control end.
Described robotization use-case editing machine is recorded module for directly accessing, automatic test is recorded and carried out to the operation module.
Described natural language manager is resolved each test action statement of generated natural language (or other language-specific) test case, parses denomination of dive, action object and action parameter morpheme, sends into corresponding function interface and carries out.
Described natural language manager is Chinese and English two kinds of natural languages.
Described English natural language is to refine take English test case common expressions as model to process, and meets English test case expression custom commonly used.
Described Chinese natural language is to refine take Chinese test case common expressions as model to process, and meets Chinese test case expression custom commonly used.
A kind of interactive automated testing method comprises automatic defining variable, the method for storage and the transmission of data; The implementation method of custom variable in interactive text; The testing procedure logout is in the management method of test macro; The method of automatic sectional drawing mark; Automatic log chain map interlinking sheet; Automatic generation and submission that test report, test are summed up; The interactive text of test concrete steps action granularity; The accurate statistics of testing procedure time; Automatic allocation for test is moved to the implementation method of each actuating station of network interaction; Automatic handling procedure mistake, the implementation method of recovery test site; Wherein:
Described automatic defining variable, in the method for storage and the transmission of data, the range of application of described custom variable is included single machine test and the test of multimachine interactivity, in the test of multimachine interactivity, use that can the same variable of Multi-computer Sharing, described custom variable is in the test run term of validity, and is transparent to related proxy actuating station; Described custom variable is managed automatically by test macro when test run; Described custom variable can (but being not limited to) be divided into three ranks according to effect and range of application, that is: system-level, Business Stream level and test case level; System-level referring to when the operation of whole test, all effective; The Business Stream level is namely when the Business Stream test run at place, all effective; The test case level is namely all effective when residing test case operation;
The implementation method of described custom variable in interactive text, shown in Figure 2, in the automatic test cases compiling procedure, certain test action needs to grasp, store, calculate or compare the data message at interface, buffer memory of this informational needs is that carrier keeps in, and then the checking according to use-case requires calculation; Different from variable declarations in programmed scripts is that dynamic variable is automatically to be created by the use-case editing machine in the automatic test cases step, and can be as required, the setting of the change term of validity; In the automatic test cases runtime, these described dynamic variables, by the unified management of test run master control end, when beginning, its term of validity creates, and when surpassing its term of validity, automatically remove, under multi-machine surroundings, dynamic variable creates in a certain network test terminal, this dynamic variable is directly shared by test run master control end (main control end) in network of relation test terminal in this term of validity, carries out any complex calculations operation, the new data that produces equally also can be shared by other dependence test terminals;
Described testing procedure logout refers to that in the management method of test macro test macro can be retained the relevant information of this step when the testing procedure action command occurs, and after actuating station is completed smoothly again, returns to all object informations that this step is carried out until this step; Main control end is with the related Step Information of realizing preservation of this return message, and the relevant information that needs of generating pictures hyperlink, detailed description, execution time, execution machine, use-case name, Business Stream name, and according to the design of preserving pattern, format is saved in web page files, XML file, database or in other test result management systems;
The method of described automatic sectional drawing mark, shown in Figure 3, that the test terminal is in the process of test, according to the sectional drawing trigger condition of setting, current screen is carried out sectional drawing, simultaneously, the object that problem will occur on picture carries out picture frame or highlighted processing, according to the concrete condition of the problem of generation, the appropriate location on picture adds the explanatory notes to problem again;
Described automatic log chain map interlinking sheet, that sectional drawing filename and this testing procedure information that will produce in test process is associated, and generation related information, then this information is sent to log management module, generated by this module, in this step operation result explanation, contain the test result document of this picture link;
Automatic generation and submission that described test report, test are summed up, refer to that test report is gathered and analyzed by the test and management module, generate respectively test result document and test summary document, subsequently according to the interface setting, the test result automatic lifting is sent in the bug management system of appointment, and the test final report that will generate, be submitted in the document system of appointment;
The interactive text of described test concrete steps action granularity, mainly for realizing the dirigibility of interactive text maximum, make each concrete test action of network multi-endpoint in system under test (SUT), can closely cooperate, thereby reflect the most really system under test (SUT) at certain concrete net environment, real service data and operation logic;
The accurate statistics of described testing procedure time, it is the system time at system under test (SUT), in correct situation of correcting, with the execution time of each action of test process, carry out the accurate statistics of Millisecond, and be recorded in the execution information of each step of test report, so that the test later stage is carried out the comprehensive assessment of the factors such as software performance, hardware environment;
described automatic allocation for test is moved to the implementation method of each actuating station of network interaction, in automatic test cases, each test action indicates the another name of acting on behalf of actuating station of this action of operation, when operation, system carries out the association of system's real IP with these another name unifications, after this, system is according to selected procotol, the test action information command is sent to respectively the actuating station of acting on behalf of of appointment, the agent side of network test terminal, according to order, carry out test action, and the result after test action is carried out sends to the test main control end, after main control end is fed back after receiving test result, proceed the transmission of next test command, at last, main control end is according to test result, feedback information is arranged, analyze and be recorded as the test log document, document is summed up in test analysis document and test,
Described automatic handling procedure mistake, recover in the implementation method of test site, automatically the implementation method of handling procedure mistake is abnormal rule to occur according to tested software and system, the logic that mistake is closed judges and operation steps, be packaged into special automatic processing module, this module is also simultaneously automatically to record Operation Log and operation sectional drawing, and coordinates the actuating logic of testing procedure, and unification sends to the master control end with result; Automatically the implementation method of recovering test site is software to be closed and the operation rule of auto-initiation is write as one and independently operated script, when running into software error, i.e. and this script of Automatically invoked, thus reach the purpose of automatic recovery test site; Automatically recover test site and process, equally automatically record the operating process daily record and carry out necessary operation sectional drawing.
Further, the granularity of described interactive text is basic test action statement; Described granularity is the minimum particle size of automated test tool action, and described granularity can make many and act on behalf of actuating station, can cooperatively interact the most closely, completes the test request of action and the result judgement of a test case, forms a basic test case.
Further, no matter described test macro basic framework uses cloud or other network technologies, all need a main control end, coordinate a plurality of test related network devices, by carrying out basic test action, form all test actions and a result judgement that complete test case is required, thereby complete a basic test case.
Further, the execution of described test scene also needs a main control end, and main control end sequentially arranges according to the use-case of test scene, coordinates the operation of test case, and generates the running log of this scene.
Further, described automatic sectional drawing mark be test macro in operational process, to the problem found or the committed step operation result of test, carry out automatic sectional drawing, and automatically mark out the position that problem occurs on picture, print explanation and note to this problem simultaneously on picture.The picture name of sectional drawing and testing procedure explanation are understood tested system auto-associating, and are preserved in the document of test result daily record.
Further, the accurate statistics of described testing procedure time is to record the time by the test agent end before testing procedure is carried out, time record again the testing procedure successful execution after this testing procedure is carried out after, the mistiming of two times, namely the accurately consuming time of testing procedure execution, time, rear time of execution, network test instruction transmitting time etc. before test execution, all can obtain according to actual needs simultaneously.
Further, described main control end, automatic device IP associated configuration according to network node, testing procedure is sent to the actuating station of acting on behalf of on the network equipment of appointment, by act on behalf of actuating station complete carry out test action after, return to the test result of this step of main control end, main control end sends to next test action order the actuating station of acting on behalf of of next appointment again according to the step order of test case; Rhythm and the test result of the whole interactive text of main control end integrated management, and preserve into the test result document.
Further, described automatic wrong processing capacity for system's error situation, is mounted in and acts on behalf of actuating station operation, according to the dialog box of makeing mistakes of the system that moves the Closing Law customization.When running into system mistake, i.e. this function of Automatically invoked, thus reach the automatic wrong purpose of processing.Error processing procedure equally automatically records the operating process daily record and carries out necessary operation sectional drawing.
Further, described automatic wrong processing capacity is for the default error box situation of software, write the dialog box Closing Law of makeing mistakes of software as one independently to operate script, when running into software error, i.e. this script of Automatically invoked, thus reach the automatic wrong purpose of processing.Error processing procedure equally automatically records the operating process daily record and carries out necessary operation sectional drawing.
Beneficial effect of the present invention is, because its embodiment principle is different from legacy test system, make the structure speed of software automated testing greatly improve, building difficulty reduces again simultaneously greatly, also reduce simultaneously the Capability Requirement to the automatic test personnel, and solved the difficult problem of the insurmountable network software system interactive text of traditional test instrument.Specific as follows:
1, this system adopts the direct recording widget library, and coordinate the sectional drawing at tested interface, GUI (the Graphical User Interface that can show tested program fully, graphic user interface) profile at interface, it is more directly perceived when the tester is operated on this interface, feel similar with direct control on tested software, new technology has reduced at page furbishing spends the stand-by period that system under test (SUT) refreshes when slow.
2, tester's click right on the control that the virtual interface of the tested software that testing tool is showed is wanted to operate, any action or the data check that can select this control to carry out, automatically generate this test statement by instrument, it is equivalent making the generation of automatic test action statement and traditional mode speed of recording action.But on the formation speed of data check statement, due to the work of having removed hand-written script and debug script from, improved efficiency can be more than 2～10 times of traditional approach.
3, the test statement that generates adopts the grammer custom of similar natural language, the test case statement that reads like and manually write as, make automatic test and manual test can adopt same test case, allow the tightr of manual test and automatic test combination, sentence structure is simple, has reduced the complexity of use-case debugging.After this use-case generates, need hardly debugging well to carry out.Simultaneously, also making the pure manual test personnel that are ignorant of programming need not training can skilled design automation test case.Both improve speed and quality that script generates, greatly reduced again the cost of human resources.
4, abnormal automatically catching and processing capacity.The traditional test instrument needs oneself to preset test operation where can run into for which graunch, and write out complete processing scripts and debug by just completing, and, the script edit person is due to the reason of experience and time, can't all the graunch situations in a test script all be designed into script, make the script sky be born with and possess a lot of defectives, running into the situation that script do not relate to just can't process, need manual intervention just can continue operation, the effect of automated execution is had a greatly reduced quality.
This system has graunch self-verifying function, which graunch can occur after making the tester save each action executing of design use-case, and how to process the wrong Code Design time.
5, this system adopts Console (test master control end)-Agent (acting on behalf of actuating station) framework implementation of test cases, Console controls each test action of each Agent end, makes automatic test can directly carry out interactive service current test use-case between B/S or C/S (or other network technologies such as cloud build network software) system multiple terminals.These test cases are exactly often the core use-case of this software operation current test, and traditional automated test tool can't be supported this function.
6, this system adopts automatic daily record and sectional drawing function, makes any details in test process, can both record accurately strictly according to the facts.The user need to not add the statements such as log recording, screenshotss, judgement be nested yet in testing procedure, reduced to greatest extent complexity and workload that automatic test cases builds.
7, this system adopts dynamic data storage technology (dynamic variable technology), makes data transmission and data verification between test case inside and test case, becomes simple and convenient, makes the structure of test case more efficient.
8, automatic exception catching and record: the abnormal or mistake of the tested software that actuating station occurs in running into any implementation, actuating station all can catch automatically, and charges to the test execution daily record.This process is that the automatic test personnel need not to do the consideration of this respect when generating test use case automatically, and these have saved a large amount of working times, improves the formation efficiency of robotization use-case.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, for can clearer understanding technological means of the present invention, and can be implemented according to the content of instructions, below describes in detail with preferred embodiment of the present invention.The specific embodiment of the present invention is provided by following examples.
Description of drawings
Fig. 1 is system structural framework figure of the present invention;
Fig. 2 is the workflow diagram that dynamic variable of the present invention realizes;
Fig. 3 is automatic sectional drawing marking Function process flow diagram of the present invention.
Number in the figure explanation: 1, test overhead control end, 2, robotization use-case editing machine, 3, act on behalf of actuating station, 4, the interface records module.
Embodiment
For technological means, creation characteristic that the present invention is realized, reach purpose and effect is easy to understand, below in conjunction with diagram and specific embodiment, further set forth the present invention.
Shown in Figure 1, a kind of interactive automation test system, comprise a test overhead control end 1, described test overhead control end 1 is connected with respectively a robotization use-case editing machine 2 and several act on behalf of actuating station 3, described robotization use-case editing machine 2 connects an interface by the widget library file of recording and records module 4, described robotization use-case editing machine 2 and described test master control end 1 are used senior robotization language editing machine, and action command is encoded and resolved;
Described senior robotization language editing machine does not need service condition redirect, circulation etc. that the statement of programmable features is arranged, and completes the checking of test result and catching or the operations such as cycle calculations, circular wait of test errors; To logical process such as the calculating of the catching of the judgement of test result, graunch, test result, circular waits, by the proprietary module of test macro, automatically complete; Senior robotization language focuses on succinct, understandable, standard, and each manual test of describing test case near the mode of natural language needs the concrete operational motion of implementing and checking action;
All controls and the interface sectional drawing that module 4 is recorded measurand recorded at described interface, and packing is encapsulated in widget library, generates and tests the master control end and act on behalf of actuating station and carry out use for robotization use-case editing machine use-case; Wherein,
Comprise measurand and changed redirecting technique and the automatic test detail time statistics of identifying;
Described object identification redirecting technique refers to after object is recorded to library of object, begins to design various automatic test cases.When if the measurand version changes, do not need again to record library of object, the dependence test use-case calcellation that does not also need to rely on this library of object rewrites.But the relevant recognition property weight of the change object of library of object is suitably adjusted, make execution module can again identify this control, relevant test case still continues to use.(because the Attribute Recognition weight of giving tacit consent to arranges, be to optimize to arrange, the simple attribute change of general measurand does not need to carry out the adjustment of Attribute Recognition weight, gets final product the control that Direct Recognition goes out change) in the ordinary course of things.This measurand redirecting technique, make automated test tool, possessed certain Intelligent Recognition ability, can with the cost of minimum (, adapt to fast the change of measurand, thereby make Software Testing Tool, really can be applied in software not full ripe stage also, enlarged the application (traditional automatic test can only be applied to the recurrence test to the constant module of maturation) of automated test tool.
Described automatic test duration statistics, it is automated test tool, automatically before carrying out, test action records the time, after test action is carried out fully, then record the time, its mistiming is namely that precise time is carried out in test action, in like manner, can according to setting, can record the network time of action command transmission, the various details times of tested software operational process such as data response time.These times can be used for doing the various performance evaluations of tested software accurately.The detail record of this time can after test, as the test log report, together be submitted to log system.
Described robotization use-case editing machine 2 loads the interface and records the widget library that module is recorded, generate automatic test cases, and simulate the overall picture that shows system under test (SUT) on the interface, and directly choose tested control to facilitate the Test Sample Design personnel, generate action or inspection that this control is carried out;
Described test master control end 1 is recorded the automatic test cases that widget library that module records and robotization use-case editing machine generate to the interface and is loaded into system, execution is according to the setting of widget library and configuration file, carry out measurand identification, assigning executing the task in automatic test cases carries out to acting on behalf of actuating station, simultaneously, result log and the corresponding sectional drawing after the actuating station execution action acted on behalf of in acceptance, preserves into journal file; The master control end can also be arranged to concurrent state, respectively act on behalf of actuating station with what the concurrent test use-case sent to appointment simultaneously, act on behalf of the test action that actuating station is carried out appointment simultaneously, and with daily record and the corresponding sectional drawing of each self-operating, send to the master control end, by master control end classification storage.
The described actuating station 3 connecting test master control ends of acting on behalf of, and receive the control operational motion that execution test master control end sends over, the result after operating simultaneously and screenshotss send to test master control end.
Described robotization use-case editing machine 2 is recorded module for directly accessing, automatic test is recorded and carried out to the operation module.
Described natural language manager is resolved each test action statement of generated natural language test case, parses denomination of dive, action object and action parameter morpheme, sends into corresponding function interface and carries out.
Described natural language manager is Chinese and English two kinds of natural languages.
Described English natural language is to refine take English test case common expressions as model to process, and meets English test case expression custom commonly used.
Described Chinese natural language is to refine take Chinese test case common expressions as model to process, and meets Chinese test case expression custom commonly used.
A kind of interactive automated testing method comprises automatic defining variable, the method for storage and the transmission of data; The implementation method of custom variable in interactive text; The testing procedure logout is in the management method of test macro; The method of automatic sectional drawing mark; Automatic log chain map interlinking sheet; Automatic generation and submission that test report, test are summed up; The interactive text of test concrete steps action granularity; The accurate statistics of testing procedure time; Automatic allocation for test is moved to the implementation method of each actuating station of network interaction; Automatic handling procedure mistake, the implementation method of recovery test site; Wherein:
Described automatic defining variable, in the method for storage and the transmission of data, the range of application of described custom variable is included single machine test and the test of multimachine interactivity, in the test of multimachine interactivity, use that can the same variable of Multi-computer Sharing, described custom variable is in the test run term of validity, and is transparent to related proxy actuating station; Described custom variable is managed automatically by test macro when test run; Described custom variable can be divided into three ranks according to effect and range of application, that is: system-level, Business Stream level and test case level; System-level referring to when the operation of whole test, all effective; The Business Stream level is namely when the Business Stream test run at place, all effective; The test case level is namely all effective when residing test case operation;
The implementation method of described custom variable in interactive text, in the automatic test cases compiling procedure, certain test action needs to grasp, store, calculate or compare the data message at interface, buffer memory of this informational needs is that carrier keeps in, and then the checking according to use-case requires calculation; Different from variable declarations in programmed scripts is that dynamic variable is automatically to be created by the use-case editing machine in the automatic test cases step, and can be as required, the setting of the change term of validity; In the automatic test cases runtime, these described dynamic variables are by the unified management of test run master control end, when beginning, its term of validity creates, and when surpassing its term of validity, automatically remove, under multi-machine surroundings, dynamic variable creates in a certain network test terminal, this dynamic variable is directly shared by test run master control end in network of relation test terminal in this term of validity, carries out any complex calculations operation, the new data that produces equally also can be shared by other dependence test terminals;
Described testing procedure logout refers to that in the management method of test macro test macro can be retained the relevant information of this step when the testing procedure action command occurs, and after actuating station is completed smoothly again, returns to all object informations that this step is carried out until this step; Main control end is with the related Step Information of realizing preservation of this return message, and the relevant information that needs of generating pictures hyperlink, detailed description, execution time, execution machine, use-case name, Business Stream name, and according to the design of preserving pattern, format is saved in web page files, XML file, database or in other test result management systems;
The method of described automatic sectional drawing mark, that the test terminal is in the process of test, according to the sectional drawing trigger condition of setting, current screen is carried out sectional drawing, simultaneously, the object that problem will occur on picture carries out picture frame or highlighted processing, then according to the concrete condition that problem occurs, appropriate location on picture adds the explanatory notes to problem;
Described automatic log chain map interlinking sheet, that sectional drawing filename and this testing procedure information that will produce in test process is associated, and generation related information, then this information is sent to log management module, generated by this module, in this step operation result explanation, contain the test result document of this picture link;
Automatic generation and submission that described test report, test are summed up, refer to that test report is gathered and analyzed by the test and management module, generate respectively test result document and test summary document, subsequently according to the interface setting, the test result automatic lifting is sent in the bug management system of appointment, and the test final report that will generate, be submitted in the document system of appointment;
The interactive text of described test concrete steps action granularity, mainly for realizing the dirigibility of interactive text maximum, make each concrete test action of network multi-endpoint in system under test (SUT), can closely cooperate, thereby react the most really system under test (SUT) at certain concrete net environment, real service data and operation logic;
The accurate statistics of described testing procedure time, it is the system time at system under test (SUT), in correct situation of correcting, with the execution time of each action of test process, carry out the accurate statistics of Millisecond, and be recorded in the execution information of each step of test report, so that the test later stage is carried out the comprehensive assessment of the factors such as software performance, hardware environment;
described automatic allocation for test is moved to the implementation method of each actuating station of network interaction, in automatic test cases, each test action indicates the another name of acting on behalf of actuating station of this action of operation, when operation, system carries out the association of system's real IP with these another name unifications, after this, system is according to selected procotol, the test action information command is sent to respectively the actuating station of acting on behalf of of appointment, the agent side of network test terminal, according to order, carry out test action, and the result after test action is carried out sends to the test main control end, after main control end is fed back after receiving test result, proceed the transmission of next test command, at last, main control end is according to test result, feedback information is arranged, analyze and be recorded as the test log document, document is summed up in test analysis document and test,
Described automatic handling procedure mistake, recover in the implementation method of test site, automatically the implementation method of handling procedure mistake is abnormal rule to occur according to tested software and system, the logic that mistake is closed judges and operation steps, be packaged into special automatic processing module, this module is also simultaneously automatically to record Operation Log and operation sectional drawing, and coordinates the actuating logic of testing procedure, and unification sends to the master control end with result; Automatically the implementation method of recovering test site is software to be closed and the operation rule of auto-initiation is write as one and independently operated script, when running into software error, i.e. and this script of Automatically invoked, thus reach the purpose of automatic recovery test site; Automatically recover test site and process, equally automatically record the operating process daily record and carry out necessary operation sectional drawing.
Further, the granularity of described interactive text is basic test action statement; Described granularity is the minimum particle size of automated test tool action, and described granularity can make many and act on behalf of actuating station, can cooperatively interact the most closely, completes the test request of action and the result judgement of a test case, forms a basic test case.
Further, no matter described test macro basic framework uses cloud or other network technologies, all need a main control end, coordinate a plurality of test related network devices, by carrying out basic test action, form all test actions and a result judgement that complete test case is required, thereby complete a basic test case.
Further, the execution of described test scene also needs a main control end, and main control end sequentially arranges according to the use-case of test scene, coordinates the operation of test case, and generates into the running log of this scene.
Further, described automatic sectional drawing mark be test macro in operational process, to the problem found or the committed step operation result of test, carry out automatic sectional drawing, and automatically mark out the position that problem occurs on picture, print explanation and note to this problem simultaneously on picture.The picture name of sectional drawing and testing procedure explanation are understood tested system auto-associating, and are preserved in the document of test result daily record.
Further, the accurate statistics of described testing procedure time is to record the time by the test agent end before testing procedure is carried out, time record again the testing procedure successful execution after this testing procedure is carried out after, the mistiming of two times, namely the accurately consuming time of testing procedure execution, time, rear time of execution, network test instruction transmitting time etc. before test execution, all can obtain according to actual needs simultaneously.
Further, described main control end, automatic device IP associated configuration according to network node, testing procedure is sent to the actuating station of acting on behalf of on the network equipment of appointment, by act on behalf of actuating station complete carry out test action after, return to the test result of this step of main control end, main control end sends to next test action order the actuating station of acting on behalf of of next appointment again according to the step order of test case; Rhythm and the test result of the whole interactive text of main control end integrated management, and preserve into the test result document.
Further, described automatic wrong processing capacity for system's error situation, is mounted in and acts on behalf of actuating station operation, according to the dialog box of makeing mistakes of the system that moves the Closing Law customization.When running into system mistake, i.e. this function of Automatically invoked, thus reach the automatic wrong purpose of processing.Error processing procedure equally automatically records the operating process daily record and carries out necessary operation sectional drawing.
Further, described automatic wrong processing capacity is for the default error box situation of software, write the dialog box Closing Law of makeing mistakes of software as one independently to operate script, when running into software error, i.e. this script of Automatically invoked, thus reach the automatic wrong purpose of processing.Error processing procedure equally automatically records the operating process daily record and carries out necessary operation sectional drawing.
The above is only preferred case study on implementation of the present invention, is not limited to the present invention, and for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (10)
1. interactive automation test system, it is characterized in that: comprise a test overhead control end (1), described test overhead control end (1) is connected with respectively a robotization use-case editing machine (2) and several act on behalf of actuating station (3), described robotization use-case editing machine (2) connects an interface by the widget library file of recording and records module (4), and described robotization use-case editing machine (2) and described test master control end (1) are used senior robotization language editing machine;
Described senior robotization language editing machine does not need service condition redirect, circulation etc. that the statement of programmable features is arranged, and completes the checking of test result and catching or the operations such as cycle calculations, circular wait of test errors; To logical process such as the calculating of the catching of the judgement of test result, graunch, test result, circular waits, by the proprietary module of test macro, automatically complete; Senior robotization language focuses on succinct, understandable, standard, and each manual test of describing test case near the mode of natural language needs the concrete operational motion of implementing and checking action;
All controls and the interface sectional drawing that module (4) is recorded measurand recorded at described interface, and packing is encapsulated in widget library, generates and tests the master control end and act on behalf of actuating station and carry out use for robotization use-case editing machine use-case;
Described robotization use-case editing machine (2) loads the interface and records the widget library that module is recorded, generate automatic test cases, and simulate the overall picture that shows system under test (SUT) on the interface, and directly choose tested control to facilitate the Test Sample Design personnel, generate action or inspection that this control is carried out;
Described test master control end (1) is recorded the automatic test cases that widget library that module records and robotization use-case editing machine generate to the interface and is loaded into system, execution is according to the setting of widget library and configuration file, assign executing the task to acting on behalf of actuating station in automatic test cases, act on behalf of actuating station and carry out other operations of measurand identification or appointment, the master control end, result log and the corresponding sectional drawing after the actuating station execution action acted on behalf of in acceptance, preserves into journal file; The master control end can also be arranged to concurrent state, respectively act on behalf of actuating station with what the concurrent test use-case sent to appointment simultaneously, act on behalf of the test action that actuating station is carried out appointment simultaneously, and with daily record and the corresponding sectional drawing of each self-operating, send to the master control end, by master control end classification storage.
Described actuating station (3) the connecting test master control end of acting on behalf of, and receive the control operational motion that execution test master control end sends over, the result after operating simultaneously and screenshotss send to test master control end.
2. an interactive automated test tool technical method, is characterized in that, comprises automatic defining variable, the method for storage and the transmission of data; The implementation method of custom variable in interactive text; The testing procedure logout is in the management method of test macro; The method of automatic sectional drawing mark; Automatic log chain map interlinking sheet; Automatic generation and submission that test report, test are summed up; The interactive text of test concrete steps action granularity; The accurate statistics of testing procedure time; Automatic allocation for test is moved to the implementation method of each actuating station of network; Automatic handling procedure mistake, the implementation method of recovery test site; Wherein:
Described automatic defining variable, in the method for storage and the transmission of data, the range of application of described custom variable is included single machine test and the test of multimachine interactivity, in the test of multimachine interactivity, use that can the same variable of Multi-computer Sharing, described custom variable is (the variable life cycle can be in the whole test run phase, can be also in the operation life cycle of certain Business Stream or certain test case) in the variable life cycle term of validity, and is transparent to related proxy actuating station; Described custom variable is managed automatically by test macro when test run; Described custom variable can (but being not limited to) be divided into three ranks according to effect and range of application, that is: system-level, Business Stream level and test case level; System-level referring to when the operation of whole test, all effective; The Business Stream level is namely when the Business Stream test run at place, all effective; The test case level is namely all effective when residing test case operation;
The implementation method of described custom variable in interactive text, in the automatic test cases compiling procedure, certain test action needs to grasp, store, calculate or compare the data message at interface, buffer memory of this informational needs is that carrier keeps in, and then the checking according to use-case requires calculation; Different from variable declarations in programmed scripts is, dynamic variable is automatically to be created by the use-case editing machine in the automatic test cases step, and can be as required, and the change life term of validity arranges, in life cycle, also can a plurality of related proxy actuating stations transparent sharing; In the automatic test cases runtime, these described dynamic variables are by the unified management of test run master control end, when beginning, its term of validity creates, and when surpassing its term of validity, automatically remove, under multi-machine surroundings, dynamic variable creates in a certain network test terminal, this dynamic variable is directly shared by test run master control end in network of relation test terminal in this term of validity, carries out any complex calculations operation, the new data that produces equally also can be shared by other dependence test terminals;
Described testing procedure logout is in the management method of test macro, refer to when the testing procedure action command sends, test macro can be retained the relevant information of this step, and until this step after actuating station is completed smoothly again, actuating station is returned to all object informations that this step carries out to main control end; Main control end is with the related relevant information of should moving of this return message, the association of performing step information, the requirement of then recording according to test log, preserve into relational document, and the information of the relevant needs such as generating pictures hyperlink, detailed description, execution time, execution machine, use-case name, Business Stream title; Then, according to the requirement that arranges of preserving pattern, format is saved in web page files, XML file, database or in other test result management systems;
The method of described automatic sectional drawing mark, that the test terminal is in the process of test, according to the sectional drawing trigger condition of setting, current screen is carried out sectional drawing, simultaneously, the object that problem will occur on picture carries out picture frame or highlighted processing, then according to the concrete condition that problem occurs, appropriate location on picture adds the explanatory notes to problem;
Described automatic log chain map interlinking sheet, that sectional drawing filename and this testing procedure information that will produce in test process is associated, and generation related information, then this information is sent to log management module, generated by this module, in this step operation result explanation, contain the test result document of this picture link;
Automatic generation and submission that described test report, test are summed up, refer to that test report is gathered and analyzed by the test and management module, generate respectively test result document and test summary document, subsequently according to the interface setting, the test result automatic lifting is sent in the bug management system of appointment, and the test final report that will generate, be submitted in the document system of appointment;
The granularity of described interactive text reaches the elemental motion of step, this minimum particle size, mainly for realizing the dirigibility of interactive text maximum, make each concrete test action of network multi-endpoint in system under test (SUT), can closely cooperate, thereby react the most truly system under test (SUT) at certain concrete net environment, real service data and operation conditions;
The accurate statistics of described testing procedure time, it is the system time at system under test (SUT), in correct situation of correcting, with the execution time of each action of test process, carry out the accurate statistics of Millisecond, and be recorded in the execution information of each step of test report, so that the test later stage is carried out the comprehensive assessment of the factors such as software performance, hardware environment;
described automatic allocation for test is moved to the implementation method of each actuating station of network interaction, in automatic test cases, each test action indicates the another name of actuating station, when operation, system carries out the association of system's real IP with these another name unifications, after this, system is according to selected procotol, the test action information command is sent to respectively the actuating station (acting on behalf of actuating station) of appointment, actuating station is according to order, carry out test action, and the result after test action is carried out sends to the test main control end, main control end is after receiving the feedback of test result, proceed the transmission of next test command, at last, main control end is according to test result, feedback information is arranged, analyze and be recorded as the test log document, document is summed up in test analysis document and test,
Described automatic handling procedure mistake, recover in the implementation method of test site, automatically the implementation method of handling procedure mistake is abnormal rule to occur according to tested software and system, the logic that mistake is closed judges and operation steps, be packaged into special wrong processing module, this module forgive simultaneously automatically record Operation Log and the operation sectional drawing; Automatically the implementation method of recovering test site is software to be closed and the operation rule of auto-initiation is write as one and independently operated script, when running into software error, i.e. and this script of Automatically invoked, thus reach the purpose of automatic recovery test site; Automatically recover test site and process, equally automatically record the operating process daily record and carry out necessary operation sectional drawing.
3. interactive automation test system according to claim 2, it is characterized in that: the granularity of described interactive text is the most basic test action; Described granularity is the minimum particle size of automated test tool action, and described granularity makes many to act on behalf of actuating station, can cooperatively interact the most closely, completes the test request of action and the result judgement of a test case, forms a basic test case.
4. interactive automation test system according to claim 2, it is characterized in that, no matter described test macro basic framework uses cloud or other network technologies, all need a main control end, coordinate a plurality of test related proxy actuating stations, by carrying out basic test action, act on behalf of actuating station feedback execution result to main control end, form all test actions and a result judgement that complete test case is required, thereby complete a basic test case.
5. interactive automation test system according to claim 2, is characterized in that, the execution of described test scene, also need a main control end, main control end sequentially arranges according to the use-case of test scene, coordinates the operation of test case, and generates into the running log of this scene.
6. interactive automation test system according to claim 2, it is characterized in that, described automatic sectional drawing mark is that test macro is in operational process, to the problem of discovery or the committed step operation result of test, carry out automatic sectional drawing, and automatically mark out the position that problem occurs on picture, print explanation and note to this problem simultaneously on picture; The picture name of sectional drawing and testing procedure explanation are understood tested system auto-associating, and are preserved in the document of test result daily record.
7. interactive automation test system according to claim 2, it is characterized in that, the accurate statistics of described testing procedure time, it is the time record action executing by the test agent end before testing procedure is carried out before, time record again the testing procedure successful execution after this testing procedure is carried out after, the mistiming of two times, namely the accurately consuming time of testing procedure execution, according to the method, before test execution, time, rear time of execution, network test instruction transmitting time etc., all can obtain according to actual needs.
8. interactive automation test system according to claim 2, it is characterized in that, described main control end, automatic device IP associated configuration according to network node, testing procedure is sent to the actuating station of acting on behalf of on the network equipment of appointment, by act on behalf of actuating station complete carry out test action after, return to the test result of this step of main control end, main control end sends to next test action order the actuating station of acting on behalf of of next appointment again according to the step order of test case; Order, rhythm and the test result of the whole interactive text of main control end integrated management, and preserve into the test result document.
9. interactive automation test system according to claim 2, it is characterized in that, described automatic wrong processing capacity is for system's error situation, be mounted in and act on behalf of actuating station operation, according to the dialog box of makeing mistakes of the system that moves the Closing Law customization; When running into system mistake, i.e. this function of Automatically invoked, thus reach the automatic wrong purpose of processing; Error processing procedure equally automatically records the operating process daily record and carries out necessary operation sectional drawing.
10. interactive automation test system according to claim 2, it is characterized in that, described automatic wrong processing capacity, for the default error box situation of software, write the dialog box Closing Law of makeing mistakes of software as one independently to operate script, when running into software error, i.e. this script of Automatically invoked, thus reach the automatic wrong purpose of processing; Error processing procedure equally automatically records the operating process daily record and carries out necessary operation sectional drawing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310005575.8A CN103092756B (en) | 2013-01-08 | A kind of interactive automation test system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310005575.8A CN103092756B (en) | 2013-01-08 | A kind of interactive automation test system and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103092756A true CN103092756A (en) | 2013-05-08 |
| CN103092756B CN103092756B (en) | 2016-11-30 |
Family
ID=
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103279416A (en) * | 2013-05-30 | 2013-09-04 | 浪潮(北京)电子信息产业有限公司 | Storage software automated testing system and method |
| CN103928038A (en) * | 2014-04-29 | 2014-07-16 | 广东欧珀移动通信有限公司 | Electronic equipment test recording and playing back method |
| CN104391783A (en) * | 2014-07-24 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Software debugging method and device |
| CN104572444A (en) * | 2014-12-10 | 2015-04-29 | 网易（杭州）网络有限公司 | Cloud testing platform for game performance and testing method for cloud testing platform |
| CN104750881A (en) * | 2013-12-26 | 2015-07-01 | 联芯科技有限公司 | Automatic test method and system |
| CN104820603A (en) * | 2015-05-22 | 2015-08-05 | 上海卓易科技股份有限公司 | Automatic screenshot method and system in global positioning system (GPS) map navigation |
| CN105335278A (en) * | 2014-06-16 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Testing method and device |
| CN105824747A (en) * | 2015-01-27 | 2016-08-03 | 程文彬 | Cloud service system for software automated testing |
| CN105868112A (en) * | 2016-03-29 | 2016-08-17 | 上海斐讯数据通信技术有限公司 | Interactive automatic testing method and system |
| CN105975387A (en) * | 2015-12-09 | 2016-09-28 | 乐视移动智能信息技术（北京）有限公司 | Method and device for capturing terminal debugging information |
| CN106028367A (en) * | 2016-06-23 | 2016-10-12 | 惠州Tcl移动通信有限公司 | Automatic testing method and system based on CMWrun testing platform |
| CN106209439A (en) * | 2016-06-30 | 2016-12-07 | 腾讯科技（深圳）有限公司 | Service link automatization covering method and device |
| CN106598829A (en) * | 2015-10-15 | 2017-04-26 | 腾讯科技（深圳）有限公司 | Webpage automation test method and apparatus |
| CN106682910A (en) * | 2015-11-04 | 2017-05-17 | ***通信集团公司 | Information processing method, system and related equipment |
| CN106708488A (en) * | 2015-11-17 | 2017-05-24 | 中兴通讯股份有限公司 | Multi-application debugging system and method |
| CN106933723A (en) * | 2017-03-10 | 2017-07-07 | 郑州云海信息技术有限公司 | A kind of measurement result storage method for being applied to Network Analyzer |
| CN107038113A (en) * | 2016-10-19 | 2017-08-11 | 惠州Tcl移动通信有限公司 | A kind of method and system for recording mobile terminal test process |
| CN107239284A (en) * | 2017-05-31 | 2017-10-10 | 河南思维轨道交通技术研究院有限公司 | A kind of graphical intelligent test use-case and cycle tests preparation method |
| CN107451056A (en) * | 2017-07-31 | 2017-12-08 | 深圳乐信软件技术有限公司 | Monitor the method and device of interface testing result |
| CN107463497A (en) * | 2017-07-24 | 2017-12-12 | 微梦创科网络科技（中国）有限公司 | Record the method and system of BUG in Mobile solution |
| CN107608877A (en) * | 2017-08-11 | 2018-01-19 | 上海巍擎信息技术有限责任公司 | A kind of automation application program interface method of testing and test system based on machine learning |
| CN107783876A (en) * | 2016-08-29 | 2018-03-09 | 博彦科技股份有限公司 | Across the service test method and device of actuating station |
| CN107966643A (en) * | 2017-10-18 | 2018-04-27 | 中山大学 | The Interactive Visualization device and its implementation of a kind of real-time testing data |
| CN108197033A (en) * | 2018-01-24 | 2018-06-22 | 智慧海派科技有限公司 | A kind of method that automatic test result notifies related personnel automatically |
| CN108984406A (en) * | 2018-07-12 | 2018-12-11 | 郑州云海信息技术有限公司 | A kind of method and system of automatic Verification BMC console KVM stability |
| CN109003602A (en) * | 2018-09-10 | 2018-12-14 | 百度在线网络技术（北京）有限公司 | Test method, device, equipment and the computer-readable medium of speech production |
| CN109101431A (en) * | 2018-09-26 | 2018-12-28 | 深圳壹账通智能科技有限公司 | A kind of testing case management, computer readable storage medium and terminal device |
| CN109213672A (en) * | 2017-07-07 | 2019-01-15 | 博彦科技股份有限公司 | Dialog box removing method, device, storage medium and processor |
| CN109359053A (en) * | 2018-12-18 | 2019-02-19 | 上海科梁信息工程股份有限公司 | Generation method and relevant apparatus, the test macro and storage medium of test report |
| CN109783379A (en) * | 2019-01-03 | 2019-05-21 | 广州云测信息技术有限公司 | Script execution method of specifying error and device |
| CN109818833A (en) * | 2019-03-14 | 2019-05-28 | 北京信而泰科技股份有限公司 | A kind of ethernet test system and ethernet test method |
| CN109871326A (en) * | 2019-02-13 | 2019-06-11 | 广州云测信息技术有限公司 | A kind of method and apparatus that script is recorded |
| CN110119356A (en) * | 2019-05-09 | 2019-08-13 | 网易（杭州）网络有限公司 | The test method and device of program |
| CN110147327A (en) * | 2019-05-23 | 2019-08-20 | 浙江传媒学院 | A kind of web automatic test management method based on more granularities |
| CN110287090A (en) * | 2019-05-08 | 2019-09-27 | 聚融医疗科技(杭州)有限公司 | A kind of automated testing method and system of ultrasound software |
| CN110737599A (en) * | 2019-10-18 | 2020-01-31 | 付彪 | Front-end automatic regression testing system and method based on picture comparison technology |
| CN110908889A (en) * | 2018-09-17 | 2020-03-24 | 千寻位置网络有限公司 | Automatic testing method and device and control equipment |
| CN111026667A (en) * | 2019-12-09 | 2020-04-17 | 北京乐学帮网络技术有限公司 | Script execution method and device and electronic equipment |
| CN111026657A (en) * | 2019-12-02 | 2020-04-17 | 海南车智易通信息技术有限公司 | Method, computing device and medium for testing application in mobile terminal |
| CN111309604A (en) * | 2020-02-07 | 2020-06-19 | Tcl移动通信科技（宁波）有限公司 | Offline automatic testing method and system, storage medium and mobile terminal |
| CN111352826A (en) * | 2018-12-24 | 2020-06-30 | 上海云扩信息科技有限公司 | Automatic generation method and tool for interface test case |
| CN111445555A (en) * | 2020-02-27 | 2020-07-24 | 科华恒盛股份有限公司 | Oscilloscope waveform automatic generation method and device and terminal equipment |
| CN111639026A (en) * | 2020-05-25 | 2020-09-08 | 上海中通吉网络技术有限公司 | Interface test method, device and system |
| CN111949551A (en) * | 2020-09-01 | 2020-11-17 | 网易（杭州）网络有限公司 | Application program testing method, device, equipment and storage medium |
| CN112241359A (en) * | 2019-07-18 | 2021-01-19 | 腾讯科技（深圳）有限公司 | Equipment testing method and equipment |
| CN112256554A (en) * | 2019-07-22 | 2021-01-22 | 腾讯科技（深圳）有限公司 | Method and equipment for testing based on scene test case |
| CN112631210A (en) * | 2019-09-24 | 2021-04-09 | 罗克韦尔自动化技术公司 | System, programming method and computer medium for developing industrial control program |
| CN113221508A (en) * | 2021-06-03 | 2021-08-06 | 京东科技控股股份有限公司 | Feedback information acquisition method and device, electronic equipment and storage medium |
| CN113961534A (en) * | 2021-12-21 | 2022-01-21 | 荣耀终端有限公司 | Method and electronic equipment for generating log file |
| CN114205273A (en) * | 2020-08-26 | 2022-03-18 | 腾讯科技（深圳）有限公司 | System testing method, device and equipment and computer storage medium |
| CN114416457A (en) * | 2022-03-30 | 2022-04-29 | 百信信息技术有限公司 | Computer aging centralized detection management method and device, electronic equipment and medium |
| WO2022237253A1 (en) * | 2021-05-11 | 2022-11-17 | 华为云计算技术有限公司 | Test case generation method, apparatus and device |
| US12001818B2 (en) | 2019-09-24 | 2024-06-04 | Rockwell Automation Technologies, Inc. | Extensible IDE platform with open APIs |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101227350A (en) * | 2008-02-03 | 2008-07-23 | 中兴通讯股份有限公司 | System for parallel executing automatization test based on priority level scheduling and method thereof |
| US20080244323A1 (en) * | 2007-03-27 | 2008-10-02 | Tim Kelso | Program Test System |
| CN101339534A (en) * | 2008-06-17 | 2009-01-07 | 金蝶软件（中国）有限公司 | Software test apparatus and test method |
| CN102156673A (en) * | 2011-04-20 | 2011-08-17 | 北京航空航天大学 | Test case description oriented GUI (Graphical User Interface) automatic test system and test method thereof |
| CN102508775A (en) * | 2011-10-31 | 2012-06-20 | 彭勇 | Interactive automation test system |
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080244323A1 (en) * | 2007-03-27 | 2008-10-02 | Tim Kelso | Program Test System |
| CN101227350A (en) * | 2008-02-03 | 2008-07-23 | 中兴通讯股份有限公司 | System for parallel executing automatization test based on priority level scheduling and method thereof |
| CN101339534A (en) * | 2008-06-17 | 2009-01-07 | 金蝶软件（中国）有限公司 | Software test apparatus and test method |
| CN102156673A (en) * | 2011-04-20 | 2011-08-17 | 北京航空航天大学 | Test case description oriented GUI (Graphical User Interface) automatic test system and test method thereof |
| CN102508775A (en) * | 2011-10-31 | 2012-06-20 | 彭勇 | Interactive automation test system |
Cited By (71)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103279416A (en) * | 2013-05-30 | 2013-09-04 | 浪潮(北京)电子信息产业有限公司 | Storage software automated testing system and method |
| CN104750881B (en) * | 2013-12-26 | 2018-12-11 | 联芯科技有限公司 | A kind of automated testing method and system |
| CN104750881A (en) * | 2013-12-26 | 2015-07-01 | 联芯科技有限公司 | Automatic test method and system |
| CN103928038A (en) * | 2014-04-29 | 2014-07-16 | 广东欧珀移动通信有限公司 | Electronic equipment test recording and playing back method |
| CN103928038B (en) * | 2014-04-29 | 2017-06-30 | 广东欧珀移动通信有限公司 | The test recording of electronic equipment and back method |
| CN105335278A (en) * | 2014-06-16 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Testing method and device |
| CN104391783A (en) * | 2014-07-24 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Software debugging method and device |
| CN104572444A (en) * | 2014-12-10 | 2015-04-29 | 网易（杭州）网络有限公司 | Cloud testing platform for game performance and testing method for cloud testing platform |
| CN105824747A (en) * | 2015-01-27 | 2016-08-03 | 程文彬 | Cloud service system for software automated testing |
| CN104820603A (en) * | 2015-05-22 | 2015-08-05 | 上海卓易科技股份有限公司 | Automatic screenshot method and system in global positioning system (GPS) map navigation |
| CN106598829A (en) * | 2015-10-15 | 2017-04-26 | 腾讯科技（深圳）有限公司 | Webpage automation test method and apparatus |
| CN106682910B (en) * | 2015-11-04 | 2020-09-08 | ***通信集团公司 | Information processing method, system and related equipment |
| CN106682910A (en) * | 2015-11-04 | 2017-05-17 | ***通信集团公司 | Information processing method, system and related equipment |
| CN106708488A (en) * | 2015-11-17 | 2017-05-24 | 中兴通讯股份有限公司 | Multi-application debugging system and method |
| CN105975387A (en) * | 2015-12-09 | 2016-09-28 | 乐视移动智能信息技术（北京）有限公司 | Method and device for capturing terminal debugging information |
| CN105868112A (en) * | 2016-03-29 | 2016-08-17 | 上海斐讯数据通信技术有限公司 | Interactive automatic testing method and system |
| CN106028367A (en) * | 2016-06-23 | 2016-10-12 | 惠州Tcl移动通信有限公司 | Automatic testing method and system based on CMWrun testing platform |
| CN106209439B (en) * | 2016-06-30 | 2019-09-13 | 腾讯科技（深圳）有限公司 | Service link automates covering method and device |
| CN106209439A (en) * | 2016-06-30 | 2016-12-07 | 腾讯科技（深圳）有限公司 | Service link automatization covering method and device |
| CN107783876A (en) * | 2016-08-29 | 2018-03-09 | 博彦科技股份有限公司 | Across the service test method and device of actuating station |
| CN107038113A (en) * | 2016-10-19 | 2017-08-11 | 惠州Tcl移动通信有限公司 | A kind of method and system for recording mobile terminal test process |
| CN106933723A (en) * | 2017-03-10 | 2017-07-07 | 郑州云海信息技术有限公司 | A kind of measurement result storage method for being applied to Network Analyzer |
| CN107239284A (en) * | 2017-05-31 | 2017-10-10 | 河南思维轨道交通技术研究院有限公司 | A kind of graphical intelligent test use-case and cycle tests preparation method |
| CN109213672A (en) * | 2017-07-07 | 2019-01-15 | 博彦科技股份有限公司 | Dialog box removing method, device, storage medium and processor |
| CN107463497A (en) * | 2017-07-24 | 2017-12-12 | 微梦创科网络科技（中国）有限公司 | Record the method and system of BUG in Mobile solution |
| CN107451056A (en) * | 2017-07-31 | 2017-12-08 | 深圳乐信软件技术有限公司 | Monitor the method and device of interface testing result |
| CN107608877B (en) * | 2017-08-11 | 2021-04-09 | 上海巍擎信息技术有限责任公司 | Automatic application program interface testing method and system based on machine learning |
| CN107608877A (en) * | 2017-08-11 | 2018-01-19 | 上海巍擎信息技术有限责任公司 | A kind of automation application program interface method of testing and test system based on machine learning |
| CN107966643B (en) * | 2017-10-18 | 2020-09-29 | 中山大学 | Interactive visualization device for real-time test data and implementation method thereof |
| CN107966643A (en) * | 2017-10-18 | 2018-04-27 | 中山大学 | The Interactive Visualization device and its implementation of a kind of real-time testing data |
| CN108197033A (en) * | 2018-01-24 | 2018-06-22 | 智慧海派科技有限公司 | A kind of method that automatic test result notifies related personnel automatically |
| CN108984406A (en) * | 2018-07-12 | 2018-12-11 | 郑州云海信息技术有限公司 | A kind of method and system of automatic Verification BMC console KVM stability |
| CN109003602A (en) * | 2018-09-10 | 2018-12-14 | 百度在线网络技术（北京）有限公司 | Test method, device, equipment and the computer-readable medium of speech production |
| CN109003602B (en) * | 2018-09-10 | 2020-03-24 | 百度在线网络技术（北京）有限公司 | Voice product testing method, device, equipment and computer readable medium |
| CN110908889A (en) * | 2018-09-17 | 2020-03-24 | 千寻位置网络有限公司 | Automatic testing method and device and control equipment |
| CN109101431A (en) * | 2018-09-26 | 2018-12-28 | 深圳壹账通智能科技有限公司 | A kind of testing case management, computer readable storage medium and terminal device |
| CN109359053A (en) * | 2018-12-18 | 2019-02-19 | 上海科梁信息工程股份有限公司 | Generation method and relevant apparatus, the test macro and storage medium of test report |
| CN111352826A (en) * | 2018-12-24 | 2020-06-30 | 上海云扩信息科技有限公司 | Automatic generation method and tool for interface test case |
| CN111352826B (en) * | 2018-12-24 | 2024-05-03 | 上海云扩信息科技有限公司 | Automatic interface test case generation method and tool |
| CN109783379A (en) * | 2019-01-03 | 2019-05-21 | 广州云测信息技术有限公司 | Script execution method of specifying error and device |
| CN109871326A (en) * | 2019-02-13 | 2019-06-11 | 广州云测信息技术有限公司 | A kind of method and apparatus that script is recorded |
| CN109818833A (en) * | 2019-03-14 | 2019-05-28 | 北京信而泰科技股份有限公司 | A kind of ethernet test system and ethernet test method |
| CN110287090A (en) * | 2019-05-08 | 2019-09-27 | 聚融医疗科技(杭州)有限公司 | A kind of automated testing method and system of ultrasound software |
| CN110119356A (en) * | 2019-05-09 | 2019-08-13 | 网易（杭州）网络有限公司 | The test method and device of program |
| CN110119356B (en) * | 2019-05-09 | 2024-02-23 | 网易（杭州）网络有限公司 | Program testing method and device |
| CN110147327B (en) * | 2019-05-23 | 2023-04-18 | 浙江传媒学院 | Multi-granularity-based web automatic test management method |
| CN110147327A (en) * | 2019-05-23 | 2019-08-20 | 浙江传媒学院 | A kind of web automatic test management method based on more granularities |
| CN112241359B (en) * | 2019-07-18 | 2024-04-23 | 腾讯科技（深圳）有限公司 | Equipment testing method and equipment |
| CN112241359A (en) * | 2019-07-18 | 2021-01-19 | 腾讯科技（深圳）有限公司 | Equipment testing method and equipment |
| CN112256554A (en) * | 2019-07-22 | 2021-01-22 | 腾讯科技（深圳）有限公司 | Method and equipment for testing based on scene test case |
| CN112256554B (en) * | 2019-07-22 | 2023-06-16 | 腾讯科技（深圳）有限公司 | Method and equipment for testing based on scene test cases |
| US12001818B2 (en) | 2019-09-24 | 2024-06-04 | Rockwell Automation Technologies, Inc. | Extensible IDE platform with open APIs |
| CN112631210B (en) * | 2019-09-24 | 2024-01-30 | 罗克韦尔自动化技术公司 | System, programming method and computer medium for developing industrial control program |
| CN112631210A (en) * | 2019-09-24 | 2021-04-09 | 罗克韦尔自动化技术公司 | System, programming method and computer medium for developing industrial control program |
| CN110737599A (en) * | 2019-10-18 | 2020-01-31 | 付彪 | Front-end automatic regression testing system and method based on picture comparison technology |
| CN111026657B (en) * | 2019-12-02 | 2023-05-26 | 海南车智易通信息技术有限公司 | Method, computing device and medium for testing application in mobile terminal |
| CN111026657A (en) * | 2019-12-02 | 2020-04-17 | 海南车智易通信息技术有限公司 | Method, computing device and medium for testing application in mobile terminal |
| CN111026667A (en) * | 2019-12-09 | 2020-04-17 | 北京乐学帮网络技术有限公司 | Script execution method and device and electronic equipment |
| CN111309604B (en) * | 2020-02-07 | 2023-10-03 | Tcl移动通信科技（宁波）有限公司 | Offline automatic test method, system, storage medium and mobile terminal |
| CN111309604A (en) * | 2020-02-07 | 2020-06-19 | Tcl移动通信科技（宁波）有限公司 | Offline automatic testing method and system, storage medium and mobile terminal |
| CN111445555A (en) * | 2020-02-27 | 2020-07-24 | 科华恒盛股份有限公司 | Oscilloscope waveform automatic generation method and device and terminal equipment |
| CN111639026A (en) * | 2020-05-25 | 2020-09-08 | 上海中通吉网络技术有限公司 | Interface test method, device and system |
| CN114205273B (en) * | 2020-08-26 | 2023-09-15 | 腾讯科技（深圳）有限公司 | System test method, device and equipment and computer storage medium |
| CN114205273A (en) * | 2020-08-26 | 2022-03-18 | 腾讯科技（深圳）有限公司 | System testing method, device and equipment and computer storage medium |
| CN111949551A (en) * | 2020-09-01 | 2020-11-17 | 网易（杭州）网络有限公司 | Application program testing method, device, equipment and storage medium |
| WO2022237253A1 (en) * | 2021-05-11 | 2022-11-17 | 华为云计算技术有限公司 | Test case generation method, apparatus and device |
| CN113221508A (en) * | 2021-06-03 | 2021-08-06 | 京东科技控股股份有限公司 | Feedback information acquisition method and device, electronic equipment and storage medium |
| CN113961534A (en) * | 2021-12-21 | 2022-01-21 | 荣耀终端有限公司 | Method and electronic equipment for generating log file |
| CN113961534B (en) * | 2021-12-21 | 2022-05-10 | 荣耀终端有限公司 | Method and electronic equipment for generating log file |
| CN114416457B (en) * | 2022-03-30 | 2022-07-12 | 百信信息技术有限公司 | Computer aging centralized detection management method and device, electronic equipment and medium |
| CN114416457A (en) * | 2022-03-30 | 2022-04-29 | 百信信息技术有限公司 | Computer aging centralized detection management method and device, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110764753B (en) | Business logic code generation method, device, equipment and storage medium | |
| CN110309071B (en) | Test code generation method and module, and test method and system | |
| CN107844424B (en) | Model-based testing system and method | |
| CN103441900B (en) | Centralized cross-platform automatization test system and control method thereof | |
| CN102508775A (en) | Interactive automation test system | |
| CN104778124A (en) | Automatic testing method for software application | |
| CN106227654B (en) | A kind of test platform | |
| CN107526676B (en) | Cross-system test method and device | |
| CN110221815B (en) | Automatic generation method of control software model based on ontology | |
| CN103605556A (en) | Virtual test subject integrally-constructing system and method | |
| CN102866944A (en) | Pressure testing system and method | |
| Tahvili et al. | Functional dependency detection for integration test cases | |
| CN115658529A (en) | Automatic testing method for user page and related equipment | |
| CN112506778A (en) | WEB user interface automatic test method, device, equipment and storage medium | |
| CN109542444A (en) | Monitoring method, device, server and the storage medium of JAVA application | |
| CN113919158A (en) | Simulation method and device for flight control panel and storage medium | |
| CN109471637B (en) | Circuit diagram examination script debugging method | |
| CN116719579A (en) | AI model observability realization method and device, electronic equipment and storage medium | |
| Balsamo et al. | Software performance: state of the art and perspectives | |
| CN111324332A (en) | Big data task processing method and system, electronic device and storage medium | |
| CN112784417B (en) | Avionics distributed joint simulation method and system based on SysML | |
| CN103092756A (en) | Interactive automated testing system and method thereof | |
| CN113434387A (en) | Script-driven-based automatic testing tool and system | |
| CN113918165A (en) | Method and system for compiling text description type flow description into application automatic operation script | |
| CN112363912A (en) | Method for testing comprehensive automatic interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| DD01 | Delivery of document by public notice | ||
| DD01 | Delivery of document by public notice |
Addressee: Peng Yong Document name: payment instructions |
|
| DD01 | Delivery of document by public notice |
Addressee: Peng Yong Document name: payment instructions |
|
| DD01 | Delivery of document by public notice | ||
| DD01 | Delivery of document by public notice |
Addressee: Peng Yong Document name: Notice of Termination of Patent Rights |
|
| DD01 | Delivery of document by public notice | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20161130 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |