CN107480040A - Workflow stability test method and apparatus - Google Patents
Workflow stability test method and apparatus Download PDFInfo
- Publication number
- CN107480040A CN107480040A CN201610403853.9A CN201610403853A CN107480040A CN 107480040 A CN107480040 A CN 107480040A CN 201610403853 A CN201610403853 A CN 201610403853A CN 107480040 A CN107480040 A CN 107480040A
- Authority
- CN
- China
- Prior art keywords
- workflow
- note
- abnormal
- stability test
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The purpose of the application is to provide a kind of workflow stability test method and apparatus,The application is by will cause each outside factor for relying on environmental abnormality to be abstracted as off-note,The off-note is called to carry out stability test to workflow,And output test result,After obtaining the off-note,The off-note can repeatedly be called in different workflow stability tests,After the outside factor for relying on environmental abnormality will be caused to become off-note,The development amount that stability test use-case is write can greatly be simplified,The substantial amounts of logic that repeats is not required to repeat to write,When realizing each feature,Whole workflow performance testing index and method of testing need not be known,Only need to realize how exception can occur for off-note,During so as to solve each stability test,Need to simulate again and cause outside the problem of relying on abnormal various factors,Simplify and add the outside development cost for relying on environment.
Description
Technical field
The application is related to computer realm, more particularly to a kind of workflow stability test method and apparatus.
Background technology
Working flow products are a kind of service for user, and the interface that it is externally provided can be Er Fangbao, and HTTP is (super
Text transfer protocol, HyperText Transfer Protocol) interface, or SDK (SDK,
Software Development Kit).In itself functionally, without service logic, his function is use to workflow
The activity that family defines, perform and complete according to order desired by user and scheduling mode.From work in terms of stability test angle
Stream, there is no multi-service dependence in fact, and called path not grow yet, simulated so to do the environmental abnormality for being exactly the product is relied on
Out.
The stability of current working flow products is in addition to the examination of self performance, it is necessary to consider the outside environment that relies on to work
Make the influence of stream performance itself, the stability test relied on outside, current implementation method relative discrete, that is, it is each different
Under normal scene, respective data are tested.For the stability test of workflow in itself, it is of interest that the performance number of workflow in itself
According to.When the dependence environment of its specialization occurs abnormal, the influence to performance data itself is all to occur in a standalone fashion, such as net
These dependence environment influences to performance respectively of network, workflow nodes, database.But each other no level, do not take out
As, also without the superposition of abnormal environment, thus a large amount of logics that repeat produce.Current logic be for each dependence simulator its
The abnormal scene of itself, each abnormal use-case and performance indications are then defined, doing wastes time and energy, and has substantial amounts of repetition work
Make the simulated implementation in various different characteristics, access and reality are performed in scene.Currently existing scheme, it appears that it is very complicated, often
Cause the outside various factors for relying on exception, it is necessary to simulate again during secondary stability test, this just needs a large amount of repeated work moulds
Intend exception, integrate exception and arrives workflow logic, exception will be simulated and be coupling in the logic of performance test in itself, and generate indifference
Other performance indications data.
From the point of view of existing matured product, otherwise be to pay close attention to workflow property indices in itself, or be it is outside according to
Rely the performance of the own resource such as environment such as zookeeper, db (database), no product can pay close attention to it is outside rely on environment and
The angle that workflow is integrated in itself goes to attempt to simplify problem.Wherein, Zookeeper is one distributed, point of open source code
Cloth application program coordination service.
The content of the invention
The purpose of the application is to provide a kind of workflow stability test method and apparatus, solves each stability and surveys
, it is necessary to simulate the various factors for causing outside dependence exception again, it is necessary to which a large amount of repeated works simulate abnormal, integration exception during examination
The problem of to workflow logic.
According to the one side of the application, there is provided a kind of workflow stability test method, this method include：
Each outside factor for relying on environmental abnormality will be caused to be abstracted as off-note；
Call the off-note to carry out stability test to workflow, and output test result
Further, in the above method, the off-note is called to carry out stability test to workflow, including：
The off-note is converted into interface；
The interface is called to carry out stability test to workflow.
Further, in the above method, the outside environmental abnormality that relies on includes Network Abnormal, database exception, work
Flow a kind of in abnormal node, Zookeeper exceptions and abnormal data or any combination
Further, in the above method, the off-note is called to carry out stability test to workflow, and export test
As a result, including：
Performance indications and abnormal index according to corresponding to determining the off-note of calling；
Call the off-note to carry out stability test to workflow, and export comprising the performance indications and refer to extremely
Target test result.
Further, in the above method, the test result includes the off-note called.
Further, in the above method, the test results of the performance indications include scheduling under workflow instance scene,
Execution is time-consuming, concurrency, number of request, success rate and maximum, minimum perform average one kind or any combination in taking.
Further, in the above method, the test result of the abnormal index includes not being inconsistent under workflow instance scene
Close expected result, undesirably perform number, movable exception and one kind or any combination in rollback exception.
Further, in the above method, the species of the workflow instance scene includes serial work-flow, parallel work flow
Or the workflow comprising sub-process.
According to the another aspect of the application, a kind of workflow stability test equipment is additionally provided, the equipment includes：
Abstract device, for each outside factor for relying on environmental abnormality will to be caused to be abstracted as off-note；
Test device, for calling the off-note to carry out stability test to workflow, and output test result.
Further, in the said equipment, the test device, for the off-note to be converted into interface；Call institute
State interface and stability test is carried out to workflow.
Further, in the said equipment, the outside environmental abnormality that relies on includes Network Abnormal, database exception, work
Flow a kind of in abnormal node, Zookeeper exceptions and abnormal data or any combination.
Further, in the said equipment, the test device, for the performance according to corresponding to the determination of the off-note of calling
Index and abnormal index；Call the off-note to carry out stability test to workflow, and export and include the performance indications
With the test result of abnormal index.
Further, in the said equipment, the test result includes the off-note called.
Further, in the said equipment, the test results of the performance indications include scheduling under workflow instance scene,
Execution is time-consuming, concurrency, number of request, success rate and maximum, minimum perform average one kind or any combination in taking.
Further, in the said equipment, the test result of the abnormal index includes not being inconsistent under workflow instance scene
Close expected result, undesirably perform number, movable exception and one kind or any combination in rollback exception.
Further, in the said equipment, the species of the workflow instance scene includes serial work-flow, parallel work flow
Or the workflow comprising sub-process.
Compared with prior art, the application is abnormal special by the way that each outside factor for relying on environmental abnormality will be caused to be abstracted as
Sign, call the off-note to carry out stability test to workflow, and output test result, after obtaining the off-note,
The off-note can repeatedly be called in different workflow stability tests, will cause outside dependence environmental abnormality
Factor become off-note after, can greatly simplify the development amount write of stability test use-case, it is substantial amounts of to repeat to patrol
Collect and be not required to repeat to write, when realizing each feature, without knowing whole workflow performance testing index and method of testing, only
Need to realize how exception can occur for off-note, it is necessary to simulate again during so as to solve each stability test
The problem of causing the various factors of outside dependence exception, avoid a large amount of repeated works simulations abnormal, integrate exception and patrolled to workflow
Situation about collecting, so as to simplify the development cost for adding outside dependence environment.
In addition, the application calls institute by performance indications and abnormal index according to corresponding to the determination of the off-note of calling
State off-note and stability test carried out to workflow, and export the test result comprising the performance indications and abnormal index,
The outside factor for relying on environmental abnormality will be caused to become outside off-note and the testing performance index logical sum of workflow in itself
The processing logic for relying on the abnormal index of environment is split, and layering solves respective problem, is reduced coupling, is optimized workflow
The processing strategy that steady testing relies on for the outside logic for relying on environment, reduce add the outside exploitation for relying on environment into
This, it is off-note that newly-increased outside dependence environment, which is only concerned the outside abnormal realizing method of dependence i.e. by its logical abstraction, is increased newly
Performance indications abnormal index be only concerned oneself index realize the logic i.e. computational methods of index, performance indications and abnormal index
Result correspond to one or more off-note, each off-note corresponds to that above-mentioned one kind is outside to be relied on, can be intuitively
Find out influence of the off-note (namely outside to rely on exception) to workflow performance indications and abnormal index.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, the application's is other
Feature, objects and advantages will become more apparent upon：
Fig. 1 shows a kind of flow chart of workflow stability test method according to the application one side；
Fig. 2 shows the outside schematic diagram for relying on environment of the preferred embodiment of the application one；
Fig. 3 shows the performance indications schematic diagram of the workflow of the preferred embodiment of the application one；
Fig. 4 shows the abnormal index schematic diagram of the workflow of the preferred embodiment of the application one；
Fig. 5 shows the performance indications signal of workflow in the case of the database exception of the preferred embodiment of the application one
Figure；
Fig. 6 shows the abnormal index signal of workflow in the case of the database exception of the preferred embodiment of the application one
Figure；
Fig. 7 shows the schematic diagram of the preferred embodiment of the application one.
Same or analogous reference represents same or analogous part in accompanying drawing.
Embodiment
The application is described in further detail below in conjunction with the accompanying drawings.
In one typical configuration of the application, terminal, the equipment of service network and trusted party include one or more
Processor (CPU), input/output interface, network interface and internal memory.
Internal memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moved
State random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electric erasable
Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM),
Digital versatile disc (DVD) or other optical storages, magnetic cassette tape, magnetic disk storage or other magnetic storage apparatus or
Any other non-transmission medium, the information that can be accessed by a computing device available for storage.Defined according to herein, computer
Computer-readable recording medium does not include non-temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
As shown in figure 1, provide a kind of workflow stability test method, this method bag according to the one side of the application
Include：
Step S1, each outside factor for relying on environmental abnormality will be caused to be abstracted as off-note；
Step S2, call the off-note to carry out stability test to workflow, and output test result.Specifically,
It is basic environment that workflow engine relies on by force in itself that outside, which relies on environment, under stability test scene, can simulate these scenes
When abnormal, the performance of workflow.This implementation is abnormal special by the way that each outside factor for relying on environmental abnormality will be caused to be abstracted as
Sign, logical abstraction is made to outside rely on of work flow operation, after obtaining the off-note, the off-note can be in difference
Workflow stability test in repeatedly called, after the outside factor for relying on environmental abnormality will be caused to become off-note,
The development amount that stability test use-case is write can greatly be simplified, the substantial amounts of logic that repeats is not required to repeat to write, realized
During each feature, without knowing whole workflow performance testing index and method of testing, it is only necessary to how realize off-note
Exception can occur, during so as to solve each stability test, it is necessary to again simulation cause it is outside rely on it is abnormal each
The problem of kind factor, avoid a large amount of repeated works simulations abnormal, integrate the abnormal situation to workflow logic, added so as to simplify
Outside relies on the development cost of environment.
In a kind of preferred embodiment of workflow stability test method one of the application, step S2, call the exception special
Sign carries out stability test to workflow, including：
The off-note is converted into interface；
The interface is called to carry out stability test to workflow.Specifically, as shown in fig. 7, outside is relied on into environment
Various exceptions are abstracted into each off-note, surface interface, can be optionally combined superimposed anomaly feature, rather than suitable
The overlapping development of sequence, only need to be by the off-note if wanting to test influence of a certain off-note to performance indications and abnormal index
Called and performed by workflow, greatly simplify the repetition logic of index calculating.
As shown in Fig. 2 in a kind of preferred embodiment of workflow stability test method one of the application, the outside dependence
Environmental abnormality includes a kind of in Network Abnormal, database exception, workflow nodes exception, Zookeeper exceptions and abnormal data
Or any combination.Specifically, the outside environmental abnormality that relies on having a direct impact to working flow products defined at present has：Database
Abnormal, Zookeeper is abnormal, Network Abnormal, workflow own node exception and abnormal data etc., wherein, special instruction is
Abnormal data, refer to before test job stream performance, automatic the problem of building specified configuration data are final to weigh problem number
According to the influence caused by normal work flow operation.By the way that the outside factor for relying on environmental abnormality for causing these the most frequently used is taken out
As for corresponding off-note, can subsequently repeat to call these off-notes in stability test, so as to improve stability
The efficiency of test.Here, caused each outside factor for relying on environmental abnormality is abstracted as off-note, to stability test
For entirety, any feature goes wrong, and corresponding test scene is all almost identical, i.e. the test content of workflow is constant.
For example under different concurrent scenes and current operating data pressure, how is the performance of workflow, and special in the exception
How levy the performance after being superimposed one by one, no matter whether off-note is superimposed, and the performance indications and data shown are all identical,
The data for the same workflow run are identical with the calculation of the performance indications of workflow.
In a kind of preferred embodiment of workflow stability test method one of the application, step S2, call the exception special
Sign carries out stability test to workflow, and outputs test result, including：
Performance indications and abnormal index according to corresponding to determining the off-note of calling；
Call the off-note to carry out stability test to workflow, and export comprising the performance indications and refer to extremely
Target test result.Specifically, the operation logic of workflow in itself is cast aside, it is necessary to pay close attention to two points：One is work flow operation
The preceding outside influence for relying on environment and being performed to workflow task；Another is properties and abnormal index after work flow operation,
To weigh the implementation status of workflow in itself.Wherein, the performance indications of workflow are the performances under the normal scene of work flow operation
Performance；The result statistics of abnormal data occurs when the abnormal index of workflow is work flow operation, abnormal the reason for occurring may
It is outside to rely on that environment is unavailable or even if the problem of workflow execution occurs under normal operation.Here, according to different different
Chang Tezheng superposition, the performance indications of corresponding selection and the quantity of abnormal index can change, i.e., according to different off-notes
Superposition, judge whether each performance indications and abnormal index need to include parameter, for example, in database exception scene
Under, as shown in fig. 6, abnormal index is only concerned the workflow of undesirably result, for rollback, activity itself, and reentry
Judge that abnormal (undesirably performing number) has all no longer calculated, also no longer closed as shown in figure 5, the calculating of performance indications collects
Heart success rate.Except the outside dependence environment that database is abnormal, there is performance and exception after exception in other outside environment that rely on
Data Representation, the requirement calculated index is similar, but logic is seen with current realizing, all outside dependences are to all kinds of fingers
Target is abnormal, is all to compute repeatedly from the beginning.The present embodiment will cause the outside factor for relying on environmental abnormality to become abnormal special
The processing logic for levying the abnormal index that the testing performance index logical sum outside with workflow in itself relies on environment is split, point
Layer solves respective problem, reduces coupling, optimizes the place that the steady testing of workflow relies on for the outside logic for relying on environment
Reason strategy, reduces the development cost for adding outside dependence environment, and the newly-increased outside environment that relies on is only concerned outside dependence exception
Its logical abstraction is off-note by realizing method, and the realization that newly-increased performance indications abnormal index is only concerned oneself index is patrolled
Volume i.e. the computational methods of index, the result of performance indications and abnormal index correspond to one or more off-note, and each is different
Chang Tezheng corresponds to the outside dependence of above-mentioned one kind, can intuitively find out off-note (namely outside dependence is abnormal) to workflow
The influence of performance indications and abnormal index.
In a kind of preferred embodiment of workflow stability test method one of the application, the test result includes what is called
Off-note.Specifically, as shown in fig. 7, in performance and the calculating output result of abnormal index, it is special to increase exception newly for the present embodiment
Logic is levied, the result for finally collecting out includes this every off-note for being used for work current test, so both can intuitively seen
Go out influence of the off-note to index.
As shown in figure 3, in a kind of preferred embodiment of workflow stability test method one of the application, the performance indications
Test result include scheduling under workflow instance scene, perform time-consuming, concurrency, number of request, success rate and maximum, minimum
Perform one kind or any combination in average take.Specifically, workflow instance scene refers to pre-define during performance test
Typical work flow operation scene.Here, as shown in fig. 7, the present embodiment unified metric handles logic, no matter to any abnormal
Simulation, the performance indications of the workflow of care can be preset, and each occurs extremely, and the performance indications being finally concerned about all are
The a subset of limited performance indications intersection, so unified performance indicator logic is just taken out, and it is different according to each
Chang Tezheng attribute determines whether each performance indications need to include index calculating.
As shown in figure 4, in a kind of preferred embodiment of workflow stability test method one of the application, the abnormal index
Test result include undesirably result under workflow instance scene, undesirably perform number, activity it is abnormal and
One kind or any combination in rollback exception.Here, as shown in fig. 7, the present embodiment unified metric handles logic, no matter to any
Abnormal simulation, the abnormal index of the workflow of care can be preset, and each occurs extremely, and the exception being finally concerned about refers to
Mark is all a subset of limited abnormal index intersection, so unified abnormal index processing logic is just taken out, and according to every
The attribute of one off-note determines whether each abnormal index needs to include index calculating.
In a kind of preferred embodiment of workflow stability test method one of the application, the class of the workflow instance scene
Type includes serial work-flow, parallel work flow or the workflow comprising sub-process.Specifically, serial work-flow, parallel work flow,
Workflow comprising sub-process etc., correspond to success rate as shown above respectively under different workflow scenes, the allusion quotation such as take
Type performance data.
According to the another side of the application, a kind of workflow stability test equipment is also provided, the equipment includes：
Abstract device, for each outside factor for relying on environmental abnormality will to be caused to be abstracted as off-note；
Test device, for calling the off-note to carry out stability test to workflow, and output test result.Tool
Body, it is basic environment that workflow engine relies on by force in itself that outside, which relies on environment, under stability test scene, can simulate these
Scene is when abnormal, the performance of workflow.This implementation is different by the way that each outside factor for relying on environmental abnormality will be caused to be abstracted as
Chang Tezheng, logical abstraction is made to outside rely on of work flow operation, after obtaining the off-note, the off-note can be
Repeatedly called in different workflow stability tests, the outside factor for relying on environmental abnormality will be caused to become off-note
Afterwards, the development amount that stability test use-case is write can greatly be simplified, the substantial amounts of logic that repeats is not required to repeat to write, in reality
During each existing feature, without knowing whole workflow performance testing index and method of testing, it is only necessary to realize off-note such as
Exception can occurs in what, during so as to solve each stability test, it is necessary to again simulation cause it is outside rely on it is abnormal
The problem of various factors, avoid a large amount of repeated work simulations abnormal, the abnormal situation for arriving workflow logic of integration, add so as to simplify
Enter the outside development cost for relying on environment.
In a kind of preferred embodiment of workflow stability test equipment one of the application, the test device, for by institute
State off-note and be converted into interface；The interface is called to carry out stability test to workflow.Specifically, as shown in fig. 7, will be outer
The various exceptions that portion relies on environment are abstracted into each off-note, surface interface, can be optionally combined superimposed anomaly
Feature, rather than the overlapping development of order, if wanting to test influence of a certain off-note to performance indications and abnormal index, only need
The off-note is called by workflow and performed, greatly simplify the repetition logic of index calculating.
In a kind of preferred embodiment of workflow stability test equipment one of the application, the outside dependence environmental abnormality bag
Include a kind of in Network Abnormal, database exception, workflow nodes exception, Zookeeper exceptions and abnormal data or be combined.
Specifically, the outside environmental abnormality that relies on having a direct impact to working flow products defined at present has：Database is abnormal,
Zookeeper is abnormal, Network Abnormal, workflow own node exception and abnormal data etc., wherein, special instruction is abnormal number
According to referring to before test job stream performance, automatic the problem of building specified configuration data, final problem data of weighing aligns
Influence caused by normal work flow operation.It is abstracted as pair by the way that these the most frequently used outside factors for relying on environmental abnormalities will be caused
The off-note answered, it can subsequently repeat to call these off-notes in stability test, so as to improve stability test
Efficiency.Here, caused each outside factor for relying on environmental abnormality is abstracted as into off-note, stability test is integrally come
Say, any feature goes wrong, and corresponding test scene is all almost identical, i.e. the test content of workflow is constant.Such as
Under different concurrent scenes and current operating data pressure, the performance of workflow is how, and in the off-note one by one
How is performance after superposition, and no matter whether off-note is superimposed, and the performance indications and data shown are all identical, that is, run
Same workflow data it is identical with the calculation of the performance indications of workflow.
In a kind of preferred embodiment of workflow stability test equipment one of the application, the test device, for basis
Performance indications and abnormal index corresponding to the off-note determination of calling；The off-note is called to carry out stability to workflow
Test, and export the test result comprising the performance indications and abnormal index.Patrolled specifically, casting aside the operation of workflow in itself
Collect, it is necessary to pay close attention to two points：One is the outside influence for relying on environment and being performed to workflow task before work flow operation；Another
It is properties and abnormal index after work flow operation, to weigh the implementation status of workflow in itself.Wherein, the performance of workflow
Index is the performance under the normal scene of work flow operation；Abnormal number occurs when the abnormal index of workflow is work flow operation
According to result count, abnormal the reason for occurring is probably outside to rely on that environment is unavailable or even if workflow under normal operation
Perform the problem of occurring.Here, according to the superposition of different off-notes, the performance indications of corresponding selection and the quantity of abnormal index
It can change, i.e., according to the superposition of different off-notes, judge whether each performance indications and abnormal index need to include meter
Index is calculated, for example, under database exception scene, as shown in fig. 6, abnormal index is only concerned the work of undesirably result
Stream, for rollback, activity itself, and reentry and judge that abnormal (undesirably performing number) has all no longer calculated, such as Fig. 5 institutes
Show, the calculating of performance indications, which collects, is also no longer concerned about success rate.Except abnormal outside of database relies on environment, other outsides according to
There is the performance after exception and abnormal data performance in bad environment, and the requirement calculated index is similar, but with current reality
Existing logic sees that all outside exceptions relied on to all kinds of indexs, are all to compute repeatedly from the beginning.The present embodiment will cause outside
The factor for relying on environmental abnormality becomes the testing performance index logical sum outside dependence environment of off-note with workflow in itself
The processing logic of abnormal index is split, and layering solves respective problem, reduces coupling, optimizes the steady testing pin of workflow
The processing strategy relied on the outside logic for relying on environment, reduces and adds the outside development cost for relying on environment, and newly-increased is outer
It is off-note that portion, which relies on environment and is only concerned the outside abnormal realizing method of dependence i.e. by its logical abstraction, and newly-increased performance indications are different
What Chang Zhibiao was only concerned oneself index realizes the logic i.e. computational methods of index, and the result of performance indications and abnormal index corresponds to
One or more off-note, each off-note correspond to the outside dependence of above-mentioned one kind, can intuitively find out off-note
The influence of (namely outside to rely on exception) to workflow performance indications and abnormal index.
In a kind of preferred embodiment of workflow stability test equipment one of the application, the test result includes what is called
Off-note.Specifically, as shown in fig. 7, in performance and the calculating output result of abnormal index, it is special to increase exception newly for the present embodiment
Logic is levied, the result for finally collecting out includes this every off-note for being used for work current test, so both can intuitively seen
Go out influence of the off-note to index.
As shown in figure 3, in a kind of preferred embodiment of workflow stability test equipment one of the application, the performance indications
Test result include scheduling under workflow instance scene, perform time-consuming, concurrency, number of request, success rate and maximum, minimum
Perform one kind or any combination in average take.Specifically, workflow instance scene refers to pre-define during performance test
Typical work flow operation scene.Here, as shown in fig. 7, the present embodiment unified metric handles logic, no matter to any abnormal
Simulation, the performance indications of the workflow of care can be preset, and each occurs extremely, and the performance indications being finally concerned about all are
The a subset of limited performance indications intersection, so unified performance indicator logic is just taken out, and it is different according to each
Chang Tezheng attribute determines whether each performance indications need to include index calculating.
As shown in figure 4, in a kind of preferred embodiment of workflow stability test equipment one of the application, the abnormal index
Test result include undesirably result under workflow instance scene, undesirably perform number, activity it is abnormal and
One kind or any combination in rollback exception.Here, as shown in fig. 7, the present embodiment unified metric handles logic, no matter to any
Abnormal simulation, the abnormal index of the workflow of care can be preset, and each occurs extremely, and the exception being finally concerned about refers to
Mark is all a subset of limited abnormal index intersection, so unified abnormal index processing logic is just taken out, and according to every
The attribute of one off-note determines whether each abnormal index needs to include index calculating.
In a kind of preferred embodiment of workflow stability test equipment one of the application, the kind of the workflow instance scene
Class includes serial work-flow, parallel work flow or the workflow comprising sub-process.Specifically, serial work-flow, parallel work flow,
Workflow comprising sub-process etc., correspond to success rate as shown above respectively under different workflow scenes, the allusion quotation such as take
Type performance data.
In summary, the application is adjusted by the way that each outside factor for relying on environmental abnormality will be caused to be abstracted as off-note
Stability test is carried out to workflow with the off-note, and outputed test result, it is described different after obtaining the off-note
Chang Tezheng can repeatedly be called in different workflow stability tests, will cause the outside factor for relying on environmental abnormality
After becoming off-note, it can greatly simplify the development amount that stability test use-case is write, the substantial amounts of logic that repeats is not required to
Repetition is write, when realizing each feature, without knowing whole workflow performance testing index and method of testing, it is only necessary to real
How exception can occur for existing off-note, during so as to solve each stability test, it is necessary to again simulation cause it is outer
Portion relies on the problem of abnormal various factors, avoids a large amount of repeated work simulations abnormal, integrates the abnormal feelings for arriving workflow logic
Condition, the outside development cost for relying on environment is added so as to simplify.
In addition, the application calls institute by performance indications and abnormal index according to corresponding to the determination of the off-note of calling
State off-note and stability test carried out to workflow, and export the test result comprising the performance indications and abnormal index,
The outside factor for relying on environmental abnormality will be caused to become outside off-note and the testing performance index logical sum of workflow in itself
The processing logic for relying on the abnormal index of environment is split, and layering solves respective problem, is reduced coupling, is optimized workflow
The processing strategy that steady testing relies on for the outside logic for relying on environment, reduce add the outside exploitation for relying on environment into
This, it is off-note that newly-increased outside dependence environment, which is only concerned the outside abnormal realizing method of dependence i.e. by its logical abstraction, is increased newly
Performance indications abnormal index be only concerned oneself index realize the logic i.e. computational methods of index, performance indications and abnormal index
Result correspond to one or more off-note, each off-note corresponds to that above-mentioned one kind is outside to be relied on, can be intuitively
Find out influence of the off-note (namely outside to rely on exception) to workflow performance indications and abnormal index.
Obviously, those skilled in the art can carry out the essence of various changes and modification without departing from the application to the application
God and scope.So, if these modifications and variations of the application belong to the scope of the application claim and its equivalent technologies
Within, then the application is also intended to comprising including these changes and modification.
It should be noted that the application can be carried out in the assembly of software and/or software and hardware, for example, can adopt
With application specific integrated circuit (ASIC), general purpose computer or any other realized similar to hardware device.In one embodiment
In, the software program of the application can realize steps described above or function by computing device.Similarly, the application
Software program (including related data structure) can be stored in computer readable recording medium storing program for performing, for example, RAM memory,
Magnetically or optically driver or floppy disc and similar devices.In addition, some steps or function of the application can employ hardware to realize, example
Such as, coordinate as with processor so as to perform the circuit of each step or function.
In addition, the part of the application can be applied to computer program product, such as computer program instructions, when its quilt
When computer performs, by the operation of the computer, it can call or provide according to the present processes and/or technical scheme.
And the programmed instruction of the present processes is called, it is possibly stored in fixed or moveable recording medium, and/or pass through
Broadcast or the data flow in other signal bearing medias and be transmitted, and/or be stored according to described program instruction operation
In the working storage of computer equipment.Here, including a device according to one embodiment of the application, the device includes using
Memory in storage computer program instructions and processor for execute program instructions, wherein, when the computer program refers to
When order is by the computing device, method and/or skill of the plant running based on foregoing multiple embodiments according to the application are triggered
Art scheme.
It is obvious to a person skilled in the art that the application is not limited to the details of above-mentioned one exemplary embodiment, Er Qie
In the case of without departing substantially from spirit herein or essential characteristic, the application can be realized in other specific forms.Therefore, no matter
From the point of view of which point, embodiment all should be regarded as exemplary, and be nonrestrictive, scope of the present application is by appended power
Profit requires rather than described above limits, it is intended that all in the implication and scope of the equivalency of claim by falling
Change is included in the application.Any reference in claim should not be considered as to the involved claim of limitation.This
Outside, it is clear that the word of " comprising " one is not excluded for other units or step, and odd number is not excluded for plural number.That is stated in device claim is multiple
Unit or device can also be realized by a unit or device by software or hardware.The first, the second grade word is used for table
Show title, and be not offered as any specific order.
Claims (16)
1. a kind of workflow stability test method, wherein, this method includes：
The outside factor for relying on environmental abnormality will be caused to be abstracted as off-note；
Call the off-note to carry out stability test to workflow, and output test result.
2. according to the method for claim 1, wherein, the off-note is called to carry out stability test, bag to workflow
Include：
The off-note is converted into interface；
The interface is called to carry out stability test to workflow.
3. according to the method for claim 1, wherein, it is different that the outside dependence environmental abnormality includes Network Abnormal, database
Often, a kind of or any combination in workflow nodes exception, Zookeeper exceptions and abnormal data.
4. according to the method for claim 1, wherein, call the off-note to carry out stability test to workflow, and
Output test result, including：
Performance indications and abnormal index according to corresponding to determining the off-note of calling；
Call the off-note to carry out stability test to workflow, and export comprising the performance indications and abnormal index
Test result.
5. according to the method described in any one of Claims 1-4, wherein, the test result includes the off-note called.
6. according to the method for claim 4, wherein, the test result of the performance indications is included under workflow instance scene
Scheduling, perform time-consuming, concurrency, number of request, success rate and maximum, it is minimum perform it is average it is time-consuming in one kind or any group
Close.
7. according to the method for claim 4, wherein, the test result of the abnormal index is included under workflow instance scene
Undesirably result, undesirably perform number, movable exception and one kind or any combination in rollback exception.
8. the method according to claim 6 or 7, wherein, the species of the workflow instance scene include serial work-flow,
Parallel work flow or the workflow comprising sub-process.
9. a kind of workflow stability test equipment, wherein, the equipment includes：
Abstract device, for each outside factor for relying on environmental abnormality will to be caused to be abstracted as off-note；
Test device, for calling the off-note to carry out stability test to workflow, and output test result.
10. equipment according to claim 9, wherein, the test device, connect for the off-note to be converted into
Mouthful；The interface is called to carry out stability test to workflow.
11. equipment according to claim 9, wherein, it is different that the outside dependence environmental abnormality includes Network Abnormal, database
Often, a kind of or any combination in workflow nodes exception, Zookeeper exceptions and abnormal data.
12. equipment according to claim 9, wherein, the test device, for according to the determination pair of the off-note of calling
The performance indications and abnormal index answered；Call the off-note to carry out stability test to workflow, and export comprising described
The test result of performance indications and abnormal index.
13. according to the equipment described in any one of claim 9 to 12, wherein, the test result includes the off-note called.
14. equipment according to claim 12, wherein, the test result of the performance indications includes workflow instance scene
Under scheduling, perform time-consuming, concurrency, number of request, success rate and maximum, it is minimum perform it is average it is time-consuming in one kind or any group
Close.
15. equipment according to claim 12, wherein, the test result of the abnormal index includes workflow instance scene
Under undesirably result, undesirably perform number, movable exception and one kind or any combination in rollback exception.
16. the equipment according to claims 14 or 15, wherein, the species of the workflow instance scene includes work in series
Stream, parallel work flow or the workflow comprising sub-process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610403853.9A CN107480040A (en) | 2016-06-08 | 2016-06-08 | Workflow stability test method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610403853.9A CN107480040A (en) | 2016-06-08 | 2016-06-08 | Workflow stability test method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107480040A true CN107480040A (en) | 2017-12-15 |
Family
ID=60594460
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610403853.9A Pending CN107480040A (en) | 2016-06-08 | 2016-06-08 | Workflow stability test method and apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107480040A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108563575A (en) * | 2018-04-16 | 2018-09-21 | 百度在线网络技术（北京）有限公司 | Applied program testing method, device, terminal and computer readable storage medium |
| CN108614417A (en) * | 2018-04-28 | 2018-10-02 | 合肥工业大学 | A kind of non-Poisson workpiece stream CSPS system optimizations control and emulation test method |
| CN110457207A (en) * | 2019-07-12 | 2019-11-15 | 平安普惠企业管理有限公司 | Test method and relevant device based on machine learning model |
| CN111984523A (en) * | 2019-05-24 | 2020-11-24 | 腾讯科技（深圳）有限公司 | Message processing task testing method, device, system, equipment and medium |
| CN112882948A (en) * | 2021-03-15 | 2021-06-01 | 数字广东网络建设有限公司 | Stability testing method, device and system for application and storage medium |
| US11086696B2 (en) | 2019-08-01 | 2021-08-10 | Microsoft Technology Licensing, Llc | Parallel cloned workflow execution |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1548972A (en) * | 2003-05-10 | 2004-11-24 | 华为技术有限公司 | Apparatus for testing electric power system |
| US20050125188A1 (en) * | 2003-07-07 | 2005-06-09 | Dell Products L.P. | Method and system for information handling system automated and distributed test |
| CN101334754A (en) * | 2008-08-05 | 2008-12-31 | 浙江大学 | Fault infusion based embedded system evaluation method |
| CN103634137A (en) * | 2012-08-27 | 2014-03-12 | 浙江大华技术股份有限公司 | Simulated system of network transmission environment |
| CN103945445A (en) * | 2014-03-13 | 2014-07-23 | 京信通信技术(广州)有限公司 | Method and device for testing performance of access controller |
| CN104182333A (en) * | 2013-05-23 | 2014-12-03 | 阿里巴巴集团控股有限公司 | Performance testing method and equipment |
| CN105320572A (en) * | 2014-06-27 | 2016-02-10 | 腾讯科技（深圳）有限公司 | Browser abnormity processing method, device and system |
| CN105446887A (en) * | 2016-01-11 | 2016-03-30 | 中国科学院光电研究院 | Satellite-borne embedded data communication fault dynamic injection system and method based on digital virtual technology |
-
2016
- 2016-06-08 CN CN201610403853.9A patent/CN107480040A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1548972A (en) * | 2003-05-10 | 2004-11-24 | 华为技术有限公司 | Apparatus for testing electric power system |
| US20050125188A1 (en) * | 2003-07-07 | 2005-06-09 | Dell Products L.P. | Method and system for information handling system automated and distributed test |
| CN101334754A (en) * | 2008-08-05 | 2008-12-31 | 浙江大学 | Fault infusion based embedded system evaluation method |
| CN103634137A (en) * | 2012-08-27 | 2014-03-12 | 浙江大华技术股份有限公司 | Simulated system of network transmission environment |
| CN104182333A (en) * | 2013-05-23 | 2014-12-03 | 阿里巴巴集团控股有限公司 | Performance testing method and equipment |
| CN103945445A (en) * | 2014-03-13 | 2014-07-23 | 京信通信技术(广州)有限公司 | Method and device for testing performance of access controller |
| CN105320572A (en) * | 2014-06-27 | 2016-02-10 | 腾讯科技（深圳）有限公司 | Browser abnormity processing method, device and system |
| CN105446887A (en) * | 2016-01-11 | 2016-03-30 | 中国科学院光电研究院 | Satellite-borne embedded data communication fault dynamic injection system and method based on digital virtual technology |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108563575A (en) * | 2018-04-16 | 2018-09-21 | 百度在线网络技术（北京）有限公司 | Applied program testing method, device, terminal and computer readable storage medium |
| CN108563575B (en) * | 2018-04-16 | 2019-12-10 | 百度在线网络技术（北京）有限公司 | application program testing method and device, terminal and computer readable storage medium |
| CN108614417A (en) * | 2018-04-28 | 2018-10-02 | 合肥工业大学 | A kind of non-Poisson workpiece stream CSPS system optimizations control and emulation test method |
| CN108614417B (en) * | 2018-04-28 | 2021-03-26 | 合肥工业大学 | Optimized control and simulation test method for non-Poisson workpiece flow CSPS system |
| CN111984523A (en) * | 2019-05-24 | 2020-11-24 | 腾讯科技（深圳）有限公司 | Message processing task testing method, device, system, equipment and medium |
| CN111984523B (en) * | 2019-05-24 | 2023-12-12 | 腾讯科技（深圳）有限公司 | Message processing task testing method, device, system, equipment and medium |
| CN110457207A (en) * | 2019-07-12 | 2019-11-15 | 平安普惠企业管理有限公司 | Test method and relevant device based on machine learning model |
| US11086696B2 (en) | 2019-08-01 | 2021-08-10 | Microsoft Technology Licensing, Llc | Parallel cloned workflow execution |
| CN112882948A (en) * | 2021-03-15 | 2021-06-01 | 数字广东网络建设有限公司 | Stability testing method, device and system for application and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107480040A (en) | Workflow stability test method and apparatus | |
| CN107239458B (en) | Method and device for calculating development object relationship based on big data | |
| JP5754709B2 (en) | How to optimize a business process management model | |
| US8140319B2 (en) | Method and system for predicting system performance and capacity using software module performance statistics | |
| CN105247493A (en) | Identifying impacted tests from statically collected data | |
| CN107251021B (en) | Filtering data lineage graph | |
| CN107665171A (en) | Automatic regression test method and device | |
| CN110413634A (en) | Data query method, system, device and computer readable storage medium | |
| CN109598407A (en) | A kind of execution method and device of operation flow | |
| CN110968495A (en) | Container cloud platform performance evaluation method and device | |
| CN112115276A (en) | Intelligent customer service method, device, equipment and storage medium based on knowledge graph | |
| CN114185770A (en) | Method and device for generating test data, computer equipment and storage medium | |
| CN110334012B (en) | Risk assessment method and device | |
| CN110517142B (en) | Method and device for outputting policy evaluation information | |
| CN109344173B (en) | Data management method and device and data structure | |
| CN111338959B (en) | Data processing method and related equipment | |
| CN112600936B (en) | Quantification and evaluation method for cloud computing system service | |
| CN109271453A (en) | A kind of determination method and apparatus of database volume | |
| CN104391968A (en) | Application characteristic parameter estimating method and device | |
| Krähmann et al. | Ratio and weight quantiles | |
| CN111079284A (en) | Power grid global logic data model verification method, device, server and medium | |
| CN114861871B (en) | Reasoning performance evaluation system of convolutional neural network on accelerator | |
| CN104798035A (en) | Regulating application task development | |
| Acharya et al. | Model based test case prioritization for testing component dependency in cbsd using uml sequence diagram | |
| CN114860851A (en) | Data processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171215 |