CN109471795A - It is grouped test method, device, computer equipment and storage medium - Google Patents
It is grouped test method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109471795A CN109471795A CN201811201631.4A CN201811201631A CN109471795A CN 109471795 A CN109471795 A CN 109471795A CN 201811201631 A CN201811201631 A CN 201811201631A CN 109471795 A CN109471795 A CN 109471795A
- Authority
- CN
- China
- Prior art keywords
- mark
- process flow
- client
- grouping
- specified
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010998 test method Methods 0.000 title claims abstract description 30
- 238000003860 storage Methods 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 220
- 230000008569 process Effects 0.000 claims abstract description 213
- 238000012360 testing method Methods 0.000 claims abstract description 41
- 238000012545 processing Methods 0.000 claims description 49
- 238000004590 computer program Methods 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000003780 insertion Methods 0.000 claims description 4
- 230000037431 insertion Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 10
- 238000013461 design Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 230000014759 maintenance of location Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 102100035115 Testin Human genes 0.000 description 1
- 101710070533 Testin Proteins 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of grouping test method, device, computer equipment and storage mediums, this method comprises: receiving the access request that client is sent, in the case where grouping test switch is opened, obtain number mark associated with the access request；The number mark is handled according to the shunting configuration rule of acquisition, determines process flow corresponding with number mark；The page info comprising the process flow is sent to the client.Grouping test method provided by the invention can not depend on database resource directly in server memory operation, and the consumption of server resource is greatly saved when shunting, can fast and effeciently realize the shunting of multiple process flows.
Description
Technical field
The present invention relates to data test field more particularly to a kind of grouping test method, device, computer equipment and storages
Medium.
Background technique
Different users is different to the hobby of product.By taking mobile phone application design as an example, in the design of mobile phone application
In the process, in order to be received by the market the mobile phone application of design more, mobile phone is using itself in addition to the core that may provide the user with
Service is outer, also relies on the form of displaying.However the actual demand of the design scheme of application designer and user and non-fully one
It causes.It is then desired to be grouped test to verify the effect of different designs scheme, that is, design multiple processes and be supplied to user, receives
Collect corresponding experience data.
However existing grouping test product, such as Testin, ABTester, although being capable of providing grouping testing service,
When testing process is related to multiple branches, such product is often unable to satisfy actual demand.Meanwhile being based on third-party grouping
Test, be easy to cause user data to reveal.
And in some grouping tests for supporting multiple-limb process, it tests, has higher using the grouping of white list mode
Information Security.But white list needs to configure in the database, relies on server resource very high.If necessary to configure
Data volume it is very big, also will increase corresponding operation deployment cost.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of grouping test method, device, computer equipment and
Storage medium improves user and shunts efficiency to simplify the shunting process of user.
A kind of grouping test method, comprising:
Receive the access request that client is sent；
When grouping is tested switch and opened, number mark associated with the access request is obtained；
The number mark is handled according to preset shunting configuration rule, determination is corresponding with number mark
Process flow；
The page info comprising the process flow is sent to the client；
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies in set with the first process flow
Digital element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the user
The corresponding process flow of number mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the hand
Whether the tail number of the presetting digit capacity of machine number is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is corresponding to the phone number
Process flow.
A kind of grouping test device, comprising:
Request unit is received, for receiving the access request of client transmission；
Mark unit is obtained, for obtaining user associated with the access request when grouping is tested switch and opened
Number mark；
It determines process module, is identified for handling the number according to preset shunting configuration rule, determining and institute
It states number and identifies corresponding process flow；
Information sending module, for sending the page info comprising the process flow to the client；
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies in set with the first process flow
Digital element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the user
The corresponding process flow of number mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the hand
Whether the tail number of the presetting digit capacity of machine number is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is corresponding to the phone number
Process flow.
A kind of computer equipment, including memory, processor and storage are in the memory and can be in the processing
The computer program run on device, the processor realize the step such as above-mentioned grouping test method when executing the computer program
Suddenly.
A kind of computer readable storage medium, the computer-readable recording medium storage have computer program, the meter
It realizes when calculation machine program is executed by processor such as the step of above-mentioned grouping test method.
Above-mentioned grouping test method, device, computer equipment and storage medium are asked by receiving the access that client is sent
It asks, in the case where switch unlatching is tested in grouping, obtains number mark associated with the access request；According to the shunting of acquisition
The configuration rule processing number mark, determines process flow corresponding with number mark；To the client
End sends the page info comprising the process flow.Grouping test method provided by the invention can be directly in server memory
Operation does not depend on database resource, and the consumption of server resource is greatly saved when shunting, can fast and effeciently realize multiple
The shunting of process flow.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention
Example, for those of ordinary skill in the art, without any creative labor, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is the application environment schematic diagram that test method is grouped in one embodiment of the invention；
Fig. 2 is the flow diagram that test method is grouped in one embodiment of the invention；
Fig. 3 is the flow diagram that test method is grouped in one embodiment of the invention；
Fig. 4 is the flow diagram that test method is grouped in one embodiment of the invention；
Fig. 5 is the flow diagram that test method is grouped in one embodiment of the invention；
Fig. 6 is the flow diagram that test method is grouped in one embodiment of the invention；
Fig. 7 is the flow diagram that test method is grouped in one embodiment of the invention；
Fig. 8 is the flow diagram that test method is grouped in one embodiment of the invention；
Fig. 9 is the structural schematic diagram that test device is grouped in one embodiment of the invention；
Figure 10 is a schematic diagram of computer equipment in one embodiment of the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
Grouping test method provided by the present application, can be applicable in the application environment such as Fig. 1.Wherein, client passes through net
Network is communicated with server-side.Wherein, client include but is not limited to various personal computers, laptop, smart phone,
Tablet computer and portable wearable device.Server-side can use the service of the either multiple server compositions of independent server
Device cluster is realized.
In one embodiment, as shown in Fig. 2, providing a kind of grouping test method, the service in Fig. 1 is applied in this way
It is illustrated, includes the following steps: for end
S10, the access request that client is sent is received.
In the present embodiment, client includes but is not limited to smart phone, tablet computer, desktop computer.Access request can
(to refer to that an application under the kernel language of WWW, standard generalized markup language is super literary based on the HTML5 in client
5th material alteration of this markup language), the mobile page, small routine, fast application, primary App (refer to based on local operation
The application software of system operation), any one triggered generation in the application of Internet of Things two dimensional code.The visit that server-side receives
Ask that request may include one or more facility informations of client.These facility informations may include the type of client, behaviour
Make system, language, version number etc..If access request further includes the unique identification of client, above equipment information is stored in
Storage location associated with above-mentioned unique identification.Under normal conditions, unique identification is that there are user account logins in client
In the case of, which registers user identifier obtained, the corresponding unique identification of a user account in server-side.If
Access request does not include the unique identification of client, then above equipment information is stored in " anonym " is associated deposits with mark
Storage space is set.
S20, when grouping is tested switch and is opened, obtain associated with access request number and identify.
Grouping test is for Web (Chinese meaning is webpage) or (Chinese meaning the is mobile phone application) interface App or process system
Make two (such as A/B) or multiple (such as A/B/n) versions, in same time dimension, allows the same or similar visitor of constituent respectively
These versions of the random access of Hu Duan group, collect the feedback information of each client group, are finally gone out according to feedback information evaluation
Best version is for formally using.Grouping test is usually referred to as AB test.
In the present embodiment, server end is additionally provided with grouping test switch, if grouping test switch is closed, according to default
Process provides access for client；If grouping test switch is opened, enters corresponding grouping test and shunt process.It can be according to reality
Border needs to be enabled by system manager or closed grouping test switch.It is switched for example, script can be used and generate grouping test, and
System control interface generation is released the button accordingly and close button, needs process flow to be tested when system manager matches
Afterwards, click is released the button, then is grouped test switch and opens.
Number mark can be generated based on above-mentioned unique identification.In some cases, number mark can be with
It is identical as unique identification.If unique identification is the phone number bound with user account, then number mark can be all this
Phone number.
When grouping is tested switch and closed, server-side requests returned data according to user, without being determined further.
S30, the number mark is handled according to preset shunting configuration rule, it is determining to be identified with the number
Corresponding process flow；
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies in set with the first process flow
Digital element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the user
The corresponding process flow of number mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the hand
Whether the tail number of the presetting digit capacity of machine number is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is corresponding to the phone number
Process flow.In the present embodiment, server is equipped with one or more process flows for being different from above-mentioned default process, and such as the
One process flow, second processing process etc..Specifically, process flow here refers to the design side for being grouped test
Case can be the website layout scheme by appropriate adjustment, be also possible to through substantially modified application interface design scheme.
It shunting configuration rule and is set as including one or more sub-rules, each sub-rule is corresponding with a process flow,
Such as the first process flow sub-rule, second processing process sub-rule etc..These sub-rules are mutual exclusions, if number identifies
Meet the first process flow sub-rule, does not then meet second processing process sub-rule.
Shunting configuration rule can be set by system manager.Can sub-rule determines according to actual conditions number, such as
Practical includes two process flows, then two sub-rules are arranged.By taking the scheme comprising two process flows as an example, then according to shunting
Configuration rule handles number mark, determines that the detailed process of the corresponding process flow of number mark may include:
Judge that number identifies whether to meet the first process flow sub-rule；If meeting the first process flow sub-rule, it is determined that use
The corresponding process flow of amount word mark is the first process flow；If not meeting the first process flow sub-rule, judge to use
Amount word identifies whether to meet second processing process sub-rule；If meeting second processing process sub-rule, it is determined that number
The corresponding process flow of mark is second processing process；If not meeting second processing process sub-rule, it is determined that number
The corresponding process flow of mark is default process.
S40, Xiang Suoshu client send the page info comprising the process flow.
In the present embodiment, after determining process flow corresponding with number mark, server is sent to client
Page info comprising the process flow.That is, however, it is determined that process flow be A process, then to client provide include A
The page info of process, however, it is determined that process flow be B process, then to client provide include B process page info.Herein
Place, page info include but is not limited to HTML5 page info, mobile page info, small routine page info, fast application page letter
The page info that breath, primary App page info, Internet of Things two dimensional code jump.It sends to client comprising determining post-processing stream
After the page info of journey, user can be in the corresponding page info of the Client browse, and generates feedback information.
In step S10-S40, the access request that client is sent is received, to obtain the access request for needing to shunt.Dividing
When group test switch is opened, number mark associated with the access request is obtained, to obtain easy-to-handle user
Number mark.The number mark, determining and number mark pair are handled according to preset shunting configuration rule
The process flow answered, to realize by shunting configuration rule as access request allocation processing process.Include to client transmission
The page info of the process flow, so that client receives the page info comprising process flow.It is provided in this embodiment
Method can not depend on database resource directly in server memory operation, and server resource is greatly saved when shunting
Consumption, can fast and effeciently realize the shunting of multiple process flows.
Optionally, as shown in figure 3, before step S20, further includes:
S201, the configuration information for obtaining the client for including in the access request；
S202, the number mark is generated according to the configuration information and preset coding rule.
In some applications, some configuration informations can be generated in user's use process, these configuration informations may include using
One of the gender at family, age, occupation, hobby, registion time, user gradation are a variety of.Server can be based on these configurations
Information generates number mark.The coding rule may include the total bit for setting number mark, as total bit can
Think 20；Specific digits corresponding to a certain user configuration information, such as by 15 numbers and the age in user configuration information
Numerical value corresponding to the characteristic value of associated, each user configuration information, such as number 0 can be associated with 0-9 years old user, number
Word 1 is associated with 10-19 years old user, and so on；Check digit can determine the position of check digit according to number of users
Number.For example, in one 18 number marks, it can be associated with the gender of user by the 10th number, odd number
Indicate male, even numbers indicate women, specifically may be expressed as: male user number identify: XXXXXXXXX1XXXXXXXX or
XXXXXXXXX3XXXXXXXX etc.；Female user number mark: XXXXXXXXX2XXXXXXXX or XXXXXXXXX4XXXXXXXX
Deng.When it is sample that some, which is grouped test to need specific user group, regular expression can be used to identify number
Specific fields are sieved.
In step S201-S202, the configuration information for the client for including in the access request is obtained, to obtain use
In the configuration information for generating number mark, so that number mark has the function of preferably distinguishing user group.Root
The number mark is generated according to the configuration information and preset coding rule, to realize one of number mark
Or the number in multiple numerical digits is associated with configuration information.
Optionally, the configuration information includes the age；As shown in figure 4, step S202 includes:
S2021, coding corresponding with the age is searched in preset coding rule；
In S2022, the specific field for identifying the coding insertion initialising subscriber number, and generate the number
Mark.
In the present embodiment, preset coding rule is as shown in table 1:
The preset coding rule of table 1
| Age | 0-9 | 10-19 | 20-29 | 30-39 | 40-49 | 50-59 | 60-69 | 70-79 |
| Coding | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
In table 1, the corresponding different age bracket of different codings.If the age in configuration information is 26, pass through the volume
Code rule searching is encoded to 2.One initialising subscriber number is identified as XXXXXXXXX, if specific field is the 5th number,
The number of generation is identified as XXXX2XXXX.
In step S2021-S2022, corresponding with age coding is searched in preset coding rule, to obtain and
Age corresponding coding.In the specific field that the coding insertion initialising subscriber number is identified, and generate the number of users
Word mark, so that number mark carries age-dependent information.
Optionally, as shown in figure 5, shunting configuration rule includes:
S301, judge that digital whether specify with the first process flow in the specified numerical digit of the number mark is gathered
Interior digital element is identical；
If S302, specifying the digital element in set identical with the first process flow, it is determined that the first process flow is institute
State the corresponding process flow of number mark.
In the present embodiment, specified numerical digit can self-setting according to actual needs.The length that can be identified according to number
The specified one or more numerical digits of degree, if user's numerical value is identified as one 11 numbers 11111111116, if the 11st is arranged
To specify numerical digit, then the number in the specified numerical digit is 6；If being set as specified numerical digit for the 10th, 11, specify in numerical digit
Number is 1 and 6.
First process flow refers to one in the multiple beta versions made.Such as, beta version includes version
This A and version B, the first process flow can be version A, can also be with version B.The specified set of first process flow be with first at
The corresponding digital collection of process, including one or more digital elements are managed, the specified set of such as the first process flow can be { 8 },
It is also possible to { 1,2 }.Likewise, the specified set of the first process flow can self-setting according to actual needs.
When the number in the specified numerical digit of number mark and the digital element phase in the specified set of the first process flow
Simultaneously, it is determined that the corresponding process flow of number mark is the first process flow.For example, the finger of number mark
Number on fixed number position is 8, and the specified collection of the first process flow is combined into { 2,4,6,8 }, then in the specified numerical digit of number mark
The specified set of number " 8 " and the first process flow in digital element " 8 " it is identical, determine that the first process flow is the number of users
The corresponding process flow of word mark.
After step S301, if number and the specified set of the first process flow in the specified numerical digit of number mark
Interior digital element is not identical, then enters the judgment step of next process flow.For example, the specified numerical digit of number mark
On number be 8, the specified collection of the first process flow is combined into { 2,4,6 }, the number " 8 " in the specified numerical digit of number mark with
All digital elements in the specified set of first process flow are all different, then the corresponding process flow of number mark
It is not the first process flow.
It is not the first process flow when the number identifies corresponding process flow, and in the presence of need to distribute second
When process flow, it can be determined that at second corresponding to the number and second processing process in the specified numerical digit of number mark
Any one managed in the digital element in the specified set of process is identical, if the number in specified numerical digit refers to second processing process
One in digital element in fixed set is identical, it is determined that second processing process is the corresponding processing of number mark
Process.
If the number in the specified numerical digit of number mark and the number in the specified set of all available process flows
Element is all different, then enters default process.Default process refers to non-test process flow, i.e., original process flow.
In step S301-S302, judge whether the number in the specified numerical digit of the number mark is handled with first
Digital element in the specified set of process is identical, judges that number entrained by access request identifies in a manner of directly comparing
Whether match, calculates simply, the computing resource of consumption is few with the first process flow.If in the specified set of the first process flow
Digital element is identical, it is determined that the first process flow is the corresponding process flow of number mark, to guarantee to access
When the entrained number mark of request is matched with the first process flow, determine that the first process flow is right for the access request
The process flow answered.
Specifically, as shown in fig. 6, number mark includes the phone number with client binding, shunting
Configuration rule further include:
S303, judge the digital the phase whether tail number of the presetting digit capacity of the phone number specifies with second processing process
Together；
If S304, with second processing process specify number it is identical, it is determined that second processing process be the phone number
Corresponding process flow.
In the present embodiment, the phone number that can be bound based on client shunts different process flows.Herein
Place, the tail number of presetting digit capacity, which refers to, can refer to one or the long number calculated forward since last of phone number
Word, the presetting digit capacity can be set according to demand.By taking tail number is last position of phone number as an example, tail number can be 0-
Any one number in 9.It is essentially identical for the number of users of ending with each number in specific user group, also
It is to say, the number of users that tail number is 6 is basic identical with the number of users that tail number is 1.It thus can be based on the tail number of phone number
Different process flows is shunted.For example, in one embodiment, the flow of second processing requirements of process distribution 20%, then
The specified number of second processing process can be 1 and 2, then the client that the tail number of phone number is 1 and 2 is accessed comprising second
The page of process flow.If the flow of second processing requirements of process distribution 15%, tail number includes double figures, second processing process
Specified number can be 01-15, then the client that the tail number of phone number is 01-15 is accessed comprising second processing process
The page.
In step S303-S304, judge whether the tail number of the presetting digit capacity of the phone number refers to second processing process
Fixed number is identical, based on the matched regular operation of canonical, it is only necessary to and operation is completed in current server memory, independent of
Database, Redis (Redis be being write using ANSI C language an of open source, support network, it is memory-based also can be lasting
Log type, the Key-Value database of change, and the API of multilingual is provided) etc. resources.If being specified with second processing process
Number is identical, it is determined that and second processing process is process flow corresponding to the phone number, after completing judgment step,
It can determine process flow corresponding to phone number.
Optionally, Fig. 7 is please referred to, after step S40 further include:
S50, the feedback information for receiving the response page info that the client is sent.
In grouping test, collecting feedback information seems extremely important.It can be determined and be fed back based on specific process flow
Information needs the data type collected.Feedback information may include page clicking rate, page residence time, business handling rate etc..
After being collected into enough feedback informations, according to these feedback information counting statistics information, statistical information can include but
It is not limited to the core business index such as conversion ratio, retention ratio, click volume, transaction value.
Optionally, after step S50, further includes:
S60, after the quantity of the feedback information of a received page info reaches preset threshold, according to what is received
The feedback information of the page info calculates the statistical value for the feature that the feedback information in different periods is included；
The statistical value adjustment shunting configuration rule of S70, the feature for being included according to the feedback information.
In the present embodiment, preset threshold can be set according to actual needs, for example, preset threshold can be set to
10000,50000,100000 etc..Here, preset threshold can be defined for a process flow, can also be to multiple
Process flow is defined.Different preset threshold also can be set in different disposal process.By the multiple of process flow
Feedback information is grouped by different periods, such as can be divided into daytime (6:00-18:00), night (18:00- next day 6:00), can also
It, can also be by be divided into the first period (0:00-8:00), the second period (8:00-16:00), third period (16:00-0:00)
Quantity is divided into the not equal grouping, such as idle period (0:00-16:00), busy period (16:00-0:00) of multiple time spans.
The feature that feedback information is included includes but is not limited to conversion ratio, retention ratio, click volume, transaction value.Different periods can be compared
The otherness of the same feature finds out inapparent feature of feature, difference of significant difference etc., then further according to the important of feature
Property determine next time grouping test shunting configuration rule.For example, in a certain amount of time, there are an inapparent feature of difference,
But this feature is extremely important, then can redistribute shunting configuration rule for this feature.
In step S50-S70, the feedback information for the response page info that the client is sent is received, is divided with obtaining
Feedback information required for group is tested.Reach default threshold in the quantity of the feedback information of a received process flow page info
After value, according to the feedback information of the process flow page info received, calculate corresponding described anti-in different periods
The statistical value for the feature that feedforward information is included, in time to calculate the statistical result of feedback information, so that subsequent test process
More targetedly.The statistical value for the feature for being included according to the feedback information adjusts the shunting configuration rule, to adjust automatically
Whole shunting configuration rule, realization shunt specific user.
Optionally, as shown in figure 8, number mark includes check field, a received page info
The quantity of feedback information reach preset threshold, comprising:
S601, judge whether the check field in digital subscriber mark that the feedback information included generates with server-side
Check field matching when number identifies；
If S602, the check field generated when number identifies with server-side match, which is labeled as
Normal information.
Proving program can also be arranged in accuracy in order to ensure the test results, verify the true of the feedback information being collected into
Reality.For example, the number mark that server-side generates can be a001b002c0035237, wherein last 4-digit number
" 5237 " are check field.If the digital subscriber that the feedback information received is included is identified as a001b002c0035237,
Check field is " 5237 ", identical as the check field of number mark that server-side generates, then it is assumed that two check fields
Matching.At this point, the feedback information is labeled as normal information.If the digital subscriber that the feedback information received is included is identified as
A001b002c0031358, check field are " 1358 ", the verification of the number mark generated with server-side
Field is different, then it is assumed that two check fields mismatch.At this point, the feedback information is labeled as exception information.
In step S601-S602, judge whether is check field in digital subscriber mark that the feedback information included
Check field when generating number mark with server-side matches, to verify the authenticity of feedback information.If raw with server-side
Check field matching when identifying at number, then be labeled as normal information for the feedback information, with realization and exception information
It distinguishes, guarantees the authenticity of data.It should be understood that the size of the serial number of each step is not meant to execute in above-described embodiment
Sequence it is successive, the execution of each process sequence should be determined by its function and internal logic, the reality without coping with the embodiment of the present invention
It applies process and constitutes any restriction.
In one embodiment, a kind of grouping test device is provided, is grouped and surveys in the grouping test device and above-described embodiment
Method for testing corresponds.As shown in figure 9, the grouping test device includes receiving request module, obtaining mark module, determine process
Module and information sending module.Detailed description are as follows for each functional module:
Request module 10 is received, for receiving the access request of client transmission；
Mark module 20 is obtained, for obtaining use associated with the access request when grouping is tested switch and opened
Amount word mark；
Determine process module 30, identified for handling the number according to preset shuntings configuration rule, determine and
The number identifies corresponding process flow；
Information sending module 40, for sending the page info comprising the process flow to the client；
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies in set with the first process flow
Digital element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the user
The corresponding process flow of number mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the hand
Whether the tail number of the presetting digit capacity of machine number is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is corresponding to the phone number
Process flow.
Optionally, it is grouped test device further include:
Configuration information module is obtained, for obtaining the configuration information for the client for including in the access request；
Digital mark module is generated, for generating the number of users according to the configuration information and preset coding rule
Word mark.
Optionally, the configuration information includes the age；Generating digital mark module includes:
Coding unit is searched, for searching coding corresponding with the age in preset coding rule；
Mark unit is generated, in the specific field for identifying the coding insertion initialising subscriber number, and is generated
The number mark.
Optionally, it is grouped test device further include:
Feedback information module is received, for receiving the feedback information for the response page info that the client is sent.
Optionally, it is grouped test device further include:
Feedback information module is counted, the quantity for the feedback information in a received page info reaches preset threshold
Later, according to the feedback information of the page info received, the spy that the feedback information in different periods is included is calculated
The statistical value of sign；
Adjustment shunts configuration rule module, for adjusting the shunting configuration rule according to the statistical value of the feature.
Optionally, the number mark includes check field, and statistics feedback information module includes:
Verification unit, for judge the check field in digital subscriber mark that the feedback information included whether with clothes
The check field that end generates when number identifies of being engaged in matches；
Marking unit, if check field when for generating number mark with server-side matches, by the feedback letter
Breath is labeled as normal information.
Specific about grouping test device limits the restriction that may refer to above for grouping test method, herein not
It repeats again.Modules in above-mentioned grouping test device can be realized fully or partially through software, hardware and combinations thereof.On
Stating each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also store in a software form
In memory in computer equipment, the corresponding operation of the above modules is executed in order to which processor calls.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction
Composition can be as shown in Figure 10.The computer equipment include by system bus connect processor, memory, network interface and
Database.Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory packet of the computer equipment
Include non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program and data
Library.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating
The database of machine equipment is used to store the configuration information of client and the feedback information being collected into.The network of the computer equipment connects
Mouth with external terminal by network connection for being communicated.To realize that a kind of grouping is surveyed when the computer program is executed by processor
Method for testing.
In one embodiment, a kind of computer equipment is provided, including memory, processor and storage are on a memory
And the computer program that can be run on a processor, processor perform the steps of when executing computer program
Receive the access request that client is sent；
When grouping is tested switch and opened, number mark associated with the access request is obtained；
The number mark is handled according to preset shunting configuration rule, determination is corresponding with number mark
Process flow；
The page info comprising the process flow is sent to the client；
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies in set with the first process flow
Digital element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the user
The corresponding process flow of number mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the hand
Whether the tail number of the presetting digit capacity of machine number is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is corresponding to the phone number
Process flow.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor
Receive the access request that client is sent；
When grouping is tested switch and opened, number mark associated with the access request is obtained；
The number mark is handled according to preset shunting configuration rule, determination is corresponding with number mark
Process flow；
The page info comprising the process flow is sent to the client；
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies in set with the first process flow
Digital element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the user
The corresponding process flow of number mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the hand
Whether the tail number of the presetting digit capacity of machine number is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is corresponding to the phone number
Process flow.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function
Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing
The all or part of function of description.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although referring to aforementioned reality
Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified
Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
1. a kind of grouping test method characterized by comprising
Receive the access request that client is sent；
When grouping is tested switch and opened, number mark associated with the access request is obtained；
The number mark is handled according to preset shunting configuration rule, determines place corresponding with number mark
Manage process；
The page info comprising the process flow is sent to the client；
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies the number in set with the first process flow
Element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the number
The corresponding process flow of mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the cell-phone number
Whether the tail number of the presetting digit capacity of code is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is place corresponding to the phone number
Manage process.
2. grouping test method as described in claim 1, which is characterized in that it is described when grouping is tested switch and opened, it obtains
Before number mark associated with the access request, further includes:
Obtain the configuration information for the client for including in the access request；
The number mark is generated according to the configuration information and preset coding rule.
3. grouping test method as claimed in claim 2, which is characterized in that the configuration information includes the age；The basis
The configuration information and preset coding rule generate the number mark, comprising:
Coding corresponding with the age is searched in preset coding rule；
In the specific field that the coding insertion initialising subscriber number is identified, and generate the number mark.
4. grouping test method as described in claim 1, which is characterized in that described send to the client includes the place
After the page info for managing process, further includes:
Receive the feedback information for the response page info that the client is sent.
5. grouping test method as claimed in claim 4, which is characterized in that the response institute for receiving the client and sending
After the feedback information for stating page info, further include
After the quantity of the feedback information of a received page info reaches preset threshold, believed according to the page received
The feedback information of breath calculates the statistical value for the feature that the feedback information in different periods is included；
The statistical value for the feature for being included according to the feedback information adjusts the shunting configuration rule.
6. grouping test method as claimed in claim 5, which is characterized in that the number mark includes check field,
The quantity of the feedback information of a received page info reaches preset threshold, comprising:
Judge whether the check field in digital subscriber mark that the feedback information included with server-side generates number
Check field matching when mark；
If check field when generating number mark with server-side matches, which is labeled as normal information.
7. a kind of grouping test device characterized by comprising
Request module is received, for receiving the access request of client transmission；
Mark module is obtained, for obtaining number associated with the access request when grouping is tested switch and opened
Mark；
It determines process module, is identified for handling the number according to preset shunting configuration rule, the determining and use
Amount word identifies corresponding process flow；
Information sending module, for sending the page info comprising the process flow to the client,
Wherein, the shunting configuration rule includes:
Judge whether the number in the specified numerical digit of the number mark specifies the number in set with the first process flow
Element is identical；
If identical as the digital element in the specified set of the first process flow, it is determined that the first process flow is the number
The corresponding process flow of mark；Or,
The number mark includes phone number, and the phone number and the client are bound, and judges the cell-phone number
Whether the tail number of the presetting digit capacity of code is identical as the number that second processing process is specified；
If identical as the number that second processing process is specified, it is determined that second processing process is place corresponding to the phone number
Manage process.
8. grouping test device as claimed in claim 7, which is characterized in that further include:
Configuration information module is obtained, for obtaining the configuration information for the client for including in the access request；
Digital mark module is generated, for generating the number mark according to the configuration information and preset coding rule
Know.
9. a kind of computer equipment, including memory, processor and storage are in the memory and can be in the processor
The computer program of upper operation, which is characterized in that the processor realized when executing the computer program as claim 1 to
The step of any one of 6 grouping test method.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In realization is grouped the step of test method as described in any one of claim 1 to 6 when the computer program is executed by processor
Suddenly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811201631.4A CN109471795A (en) | 2018-10-16 | 2018-10-16 | It is grouped test method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811201631.4A CN109471795A (en) | 2018-10-16 | 2018-10-16 | It is grouped test method, device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109471795A true CN109471795A (en) | 2019-03-15 |
Family
ID=65664878
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811201631.4A Pending CN109471795A (en) | 2018-10-16 | 2018-10-16 | It is grouped test method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109471795A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110164502A (en) * | 2019-04-12 | 2019-08-23 | 深圳市金泰克半导体有限公司 | Internal storage testing method, device, computer equipment and storage medium |
| CN110532024A (en) * | 2019-08-28 | 2019-12-03 | 维沃移动通信有限公司 | A kind of version optimization method, device, server and the storage medium of application program |
| CN110727590A (en) * | 2019-10-10 | 2020-01-24 | 北京字节跳动网络技术有限公司 | Method and device for determining abnormal test scheme and computer readable storage medium |
| CN111708711A (en) * | 2020-06-23 | 2020-09-25 | 湖南快乐阳光互动娱乐传媒有限公司 | AB test method and device, storage medium and electronic equipment |
| CN111752821A (en) * | 2019-03-29 | 2020-10-09 | 上海哔哩哔哩科技有限公司 | Method and device for packet pressure measurement, computer equipment and readable storage medium |
| CN112052015A (en) * | 2020-08-13 | 2020-12-08 | 苏州朗动网络科技有限公司 | Version release method and device, computer equipment and storage medium |
| CN112199296A (en) * | 2020-10-29 | 2021-01-08 | 腾讯科技（深圳）有限公司 | Page testing method and device, computer equipment and storage medium |
| CN112532483A (en) * | 2020-11-25 | 2021-03-19 | 北京百度网讯科技有限公司 | Test method, test device, electronic equipment and storage medium |
| CN112541644A (en) * | 2019-09-20 | 2021-03-23 | 深圳市中兴微电子技术有限公司 | Chip identification code distribution method, server and computer readable storage medium |
| CN112951397A (en) * | 2021-03-29 | 2021-06-11 | 深圳市科曼医疗设备有限公司 | Perioperative period process management system and method |
| CN113099274A (en) * | 2019-12-23 | 2021-07-09 | 深圳市华胜软件技术有限公司 | Digital sign grouping method and related equipment thereof |
| CN113448872A (en) * | 2021-07-22 | 2021-09-28 | 网易（杭州）网络有限公司 | Test execution method, device, equipment and storage medium |
| CN113656303A (en) * | 2021-08-16 | 2021-11-16 | 网易（杭州）网络有限公司 | Method, apparatus, storage medium, and program product for testing new functions of game |
| CN113791953A (en) * | 2021-09-16 | 2021-12-14 | 平安普惠企业管理有限公司 | Test scheduling and log management method and device, computer equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110161825A1 (en) * | 2009-12-31 | 2011-06-30 | Tierney Chris | Systems and methods for testing multiple page versions across multiple applications |
| CN104102576A (en) * | 2013-04-12 | 2014-10-15 | 阿里巴巴集团控股有限公司 | Multi-version test method and device |
| CN107273290A (en) * | 2017-06-13 | 2017-10-20 | 北京奇艺世纪科技有限公司 | The A/B method of testings and device of a kind of Page Service |
| CN108536608A (en) * | 2018-04-25 | 2018-09-14 | 万惠投资管理有限公司 | Page versions test method and device |
-
2018
- 2018-10-16 CN CN201811201631.4A patent/CN109471795A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110161825A1 (en) * | 2009-12-31 | 2011-06-30 | Tierney Chris | Systems and methods for testing multiple page versions across multiple applications |
| CN104102576A (en) * | 2013-04-12 | 2014-10-15 | 阿里巴巴集团控股有限公司 | Multi-version test method and device |
| CN107273290A (en) * | 2017-06-13 | 2017-10-20 | 北京奇艺世纪科技有限公司 | The A/B method of testings and device of a kind of Page Service |
| CN108536608A (en) * | 2018-04-25 | 2018-09-14 | 万惠投资管理有限公司 | Page versions test method and device |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111752821A (en) * | 2019-03-29 | 2020-10-09 | 上海哔哩哔哩科技有限公司 | Method and device for packet pressure measurement, computer equipment and readable storage medium |
| CN111752821B (en) * | 2019-03-29 | 2024-06-04 | 上海哔哩哔哩科技有限公司 | Method, device, computer equipment and readable storage medium for packet pressure measurement |
| CN110164502A (en) * | 2019-04-12 | 2019-08-23 | 深圳市金泰克半导体有限公司 | Internal storage testing method, device, computer equipment and storage medium |
| CN110532024A (en) * | 2019-08-28 | 2019-12-03 | 维沃移动通信有限公司 | A kind of version optimization method, device, server and the storage medium of application program |
| CN112541644A (en) * | 2019-09-20 | 2021-03-23 | 深圳市中兴微电子技术有限公司 | Chip identification code distribution method, server and computer readable storage medium |
| CN110727590A (en) * | 2019-10-10 | 2020-01-24 | 北京字节跳动网络技术有限公司 | Method and device for determining abnormal test scheme and computer readable storage medium |
| CN110727590B (en) * | 2019-10-10 | 2023-04-18 | 北京字节跳动网络技术有限公司 | Method and device for determining abnormal test scheme and computer readable storage medium |
| CN113099274A (en) * | 2019-12-23 | 2021-07-09 | 深圳市华胜软件技术有限公司 | Digital sign grouping method and related equipment thereof |
| CN111708711B (en) * | 2020-06-23 | 2023-04-07 | 湖南快乐阳光互动娱乐传媒有限公司 | AB test method and device, storage medium and electronic equipment |
| CN111708711A (en) * | 2020-06-23 | 2020-09-25 | 湖南快乐阳光互动娱乐传媒有限公司 | AB test method and device, storage medium and electronic equipment |
| CN112052015A (en) * | 2020-08-13 | 2020-12-08 | 苏州朗动网络科技有限公司 | Version release method and device, computer equipment and storage medium |
| CN112199296A (en) * | 2020-10-29 | 2021-01-08 | 腾讯科技（深圳）有限公司 | Page testing method and device, computer equipment and storage medium |
| CN112532483A (en) * | 2020-11-25 | 2021-03-19 | 北京百度网讯科技有限公司 | Test method, test device, electronic equipment and storage medium |
| CN112951397A (en) * | 2021-03-29 | 2021-06-11 | 深圳市科曼医疗设备有限公司 | Perioperative period process management system and method |
| CN113448872A (en) * | 2021-07-22 | 2021-09-28 | 网易（杭州）网络有限公司 | Test execution method, device, equipment and storage medium |
| CN113448872B (en) * | 2021-07-22 | 2022-04-29 | 网易（杭州）网络有限公司 | Test execution method, device, equipment and storage medium |
| CN113656303A (en) * | 2021-08-16 | 2021-11-16 | 网易（杭州）网络有限公司 | Method, apparatus, storage medium, and program product for testing new functions of game |
| CN113791953A (en) * | 2021-09-16 | 2021-12-14 | 平安普惠企业管理有限公司 | Test scheduling and log management method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109471795A (en) | It is grouped test method, device, computer equipment and storage medium | |
| Kagdi et al. | Assigning change requests to software developers | |
| Sobel et al. | Cloudstone: Multi-platform, multi-language benchmark and measurement tools for web 2.0 | |
| US9367601B2 (en) | Cost-based optimization of configuration parameters and cluster sizing for hadoop | |
| US20140310691A1 (en) | Method and device for testing multiple versions | |
| CN107133174A (en) | Test case code automatically generating device and method | |
| CN110688598B (en) | Service parameter acquisition method and device, computer equipment and storage medium | |
| CN109165975A (en) | Label recommendation method, device, computer equipment and storage medium | |
| US11809455B2 (en) | Automatically generating user segments | |
| CN110753920A (en) | System and method for optimizing and simulating web page ranking and traffic | |
| US9298780B1 (en) | Method and system for managing user contributed data extraction templates using weighted ranking score analysis | |
| US20230325377A1 (en) | Generation of inconsistent testing data | |
| CN110147495A (en) | Page response method, apparatus, equipment and medium based on Configuration Online | |
| US10826802B2 (en) | Managing network communication protocols | |
| Nethery et al. | Evaluation of the health impacts of the 1990 clean air act amendments using causal inference and machine learning | |
| CN109062799A (en) | Regression testing method, the apparatus and system of advertising scenarios | |
| WO2019062013A1 (en) | Electronic apparatus, user grouping method and system, and computer-readable storage medium | |
| CN109597948A (en) | Access method, system and the storage medium of URL link | |
| CN109992614B (en) | Data acquisition method, device and server | |
| CN111813816A (en) | Data processing method, data processing device, computer readable storage medium and computer equipment | |
| CN108388614A (en) | News data crawls processing method, device, computer equipment and storage medium | |
| CN112882758A (en) | iOS device identifier generation method and system | |
| Comerio et al. | A service re-design methodology for multi-channel adaptation | |
| Kesavulu et al. | A usage-based data extraction framework for cloud-based application-an human-computer interaction approach | |
| US10754915B2 (en) | Tag plan generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190315 |
|
| WD01 | Invention patent application deemed withdrawn after publication |