CN105740137A

CN105740137A - Bucket test method, device and system, and method and device for providing configuration information

Info

Publication number: CN105740137A
Application number: CN201410746167.2A
Authority: CN
Inventors: 刘晓明; 沈贲寅
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2014-12-08
Filing date: 2014-12-08
Publication date: 2016-07-06
Anticipated expiration: 2034-12-08
Also published as: CN105740137B

Abstract

The invention discloses a bucket test method and device used for a client side application program, a method and a device used for providing bucket test configuration information and a bucket test system. The bucket test method used for the client side application program comprises the following steps: obtaining bucket test configuration information which is provided by a service side and corresponds to a client side application program version; according to the functional category of a bucket test to which a client side application program code relates, obtaining a corresponding function version identifier in the bucket test configuration information; and according to the function version identifier, executing a corresponding code snippet. When the technical scheme provided by the invention is adopted, a version isolation requirement of the bucket test on the basis of a C/S (Client/Server) structure can be met, in addition, the service side can flexibly manage and control the bucket tests of different version client side application programs, especially, the configuration information can be regulated to control the client side application program to be automatically switched to a formal version after the bucket test is finished, and the use experience of a user is improved.

Description

Divide bucket method of testing and the method for configuration information, Apparatus and system are provided

Technical field

The application relates to a point bucket field tests, is specifically related to a kind of point bucket test for client application Method.The application provides a kind of point bucket test device for client application, one to be used for carrying simultaneously Method and apparatus and a kind of point of bucket test system for point bucket test configurations information.

Background technology

A/B tests (A/B Test), it is common that refer to the part on some specific page or the page, Make two or more versions, then the flowing of access of website is distributed on different versions, then The conversion ratio that observation this page of website or this part are brought, or the change of some important indicators, thus Go out one of them version conclusion more more preferable than another version, and determine, with this, the version finally reached the standard grade.

Point bucket test (Bucket Test, also referred to as Split Test) is then the extension of A/B Test concept, it is common that Pointer certain functional category to be tested (also referred to as function point or function key) to certain application version, example As: the Button Color of web displaying, perform multiple A/B Test, it may be assumed that be not only one of which test run to be measured simultaneously This B, but many version to be tested (also commonly referred to as corresponding with functional category function versions of B1, B2...... This), once divide bucket test just can select an optimum version in multiple feature releases by doing.

Above-mentioned A/B test or point bucket measuring technology, the most all design for website, owing to website leads to Frequently with B/S framework (browser/server framework), there is the characteristic that real-time release version is insensitive, as long as Service end is upgraded, and the function of all client-access is all up-to-date.But for based on C/S framework For the wireless client application program (being called for short APP) of (user terminal/server framework), due to client User can decide whether upgrading according to the wish of oneself or download the client application of latest edition, Result in multiple APP application version the situation deposited, this just requires that a point bucket test of wireless client APP needs The characteristic of version isolation to be possessed, it is ensured that point bucket test between each application version will not interfere, because of This traditional point bucket test mode is not appropriate for for wireless client APP.

Prior art divides bucket test generally to use Beta published method for above-mentioned wireless client APP, it may be assumed that For a point specific function point for bucket test, it is provided that the installation kit of difference in functionality version be (unofficial released version Installation kit), and screen active and be ready that the user having a taste of what is just in season installs above-mentioned installation kit on its client device, right Each feature release carries out little range test, and assesses the quality of multiple feature release according to test result, Determine the feature release issued of finally reaching the standard grade.

Use above-mentioned in limited customer group install fixed installation bag Beta published method, service end without Method carries out control and the management of necessity to point bucket test process, and after a point bucket test terminates, participates in a point bucket The user of test by the way of re-downloading, can only could use the client application journey of formal released version Sequence, affects the experience of user.

Summary of the invention

The dividing bucket method of testing and dividing bucket test to join for providing for client application that the application provides The method of confidence breath cooperates, for point bucket test of client application, it is proposed that a kind of new skill Art scheme, while meeting version isolation requirement, it is simple to client application is divided bucket to survey by service end Examination process is controlled and manages.The application additionally provides accordingly for point bucket survey of client application Electricity testing device and the device for offer point bucket test configurations information, and a kind of point of bucket test system.

The application provides a kind of point bucket method of testing for client application, including:

Obtain point bucket test configurations information corresponding to described client application version that service end provides；

According to the functional category of point bucket test that described client application code relates to, survey from described point of bucket Examination configuration information obtains the feature release mark of correspondence；

Corresponding code snippet is performed according to described feature release mark.

Optionally, point bucket test configurations information corresponding to described client application version includes: corresponding In the functional category dividing bucket test of described client application version and corresponding to described functional category Feature release mark.

Optionally, point bucket corresponding to described client application version that described acquisition service end provides is surveyed Examination configuration information, including:

Obtain the version information of described client application；

Judge whether this locality does not stores point bucket test configurations letter corresponding to described client application version Breath, or, store described point of bucket test configurations information but not there is " final version has determined that " mark；

If so, described point of bucket test configurations information is obtained from described service end.

Optionally, described obtain described point of bucket test configurations information from described service end and include:

Send the request of point bucket test configurations information that obtains to described service end, described request is carried described visitor The version information of family end application program and for unique mark identifying its host equipment, or, described client The end version information of application program, system type and the mark for unique its host equipment of identification；

Receive point bucket test configurations letter corresponding to described client application version that described service end returns Breath；

Described point of bucket test configurations information is stored in this locality.

Optionally, the described code snippet corresponding according to the mark execution of described feature release refers to, passes through branch Statement performs the code line corresponding with described feature release.

Optionally, after obtaining described point of bucket test configurations information, execution operations described below:

Send a notification message to described client application；

Accordingly, described client application processes in function at the readjustment of corresponding described notification message, holds The functional category of the described point bucket test related to according to described client application code of row, from described point of bucket Test configurations information obtains the feature release mark of correspondence, and right according to the mark execution of described feature release The step of the code snippet answered.

Optionally, when using the development language possessing reflection characteristic to implement this method, described according to described visitor The functional category of point bucket test that family end application code relates to, obtains from described point of bucket test configurations information Take the feature release mark of correspondence, including:

Travel through the registered each class of described client application, for each case method of each apoplexy due to endogenous wind And member method, execution operations described below:

Judge whether the title of described method meets set in advance point of bucket method of testing naming rule, described point Bucket method of testing naming rule is defined as follows Naming conventions: at least should to point method name that bucket test is relevant Comprise point functional category of bucket test to identify with the feature release corresponding to logic that realize of described method；

If so, operations described below is performed:

According to described point of bucket method of testing naming rule, from described method name, extract a point function for bucket test Classification；

According to described functional category, from described point of bucket test configurations information, obtain the feature release mark of correspondence；

Judge the feature release mark that described client application is set in advance, call described method is used The feature release known and obtain from described point of bucket test configurations information identifies whether consistent；

If it is not, utilize the reflection characteristic of described development language to carry out the dynamic replacement of method realization, make described visitor Family end application program performed to identify corresponding with the feature release in described point of bucket test configurations information in the stage of execution Method realize.

Optionally, when using the development language possessing reflection characteristic to implement this method, described according to described merit Energy version identifier performs corresponding code snippet and refers to, by reflection characteristic dynamic call and the institute of described language State the member method that feature release is corresponding.

Accordingly, the application also provides for a kind of point bucket test device for client application, including:

Configuration information acquiring unit, for obtain service end provide corresponding to described client application version This point bucket test configurations information；

Feature release acquiring unit, point bucket for relating to according to described client application code is tested Functional category, obtains the feature release mark of correspondence from described point of bucket test configurations information；

Code snippet performance element, for performing corresponding code snippet according to described feature release mark.

Optionally, the configuration information that described configuration information acquiring unit obtains includes: corresponding to described client The functional category of point bucket test of application version and the feature release mark corresponding to described functional category Know.

Optionally, described configuration information acquiring unit includes:

Version information obtains subelement, for obtaining the version information of described client application；

Locally stored judgment sub-unit, is used for judging whether this locality does not stores corresponding to described client application journey Point bucket test configurations information of sequence version, or, store described point of bucket test configurations information but do not have " final version has determined that " identifies；

Service end acquisition of information subelement, for being output as "Yes" when described locally stored judgment sub-unit Time, obtain described point of bucket test configurations information from described service end.

Optionally, described service end acquisition of information subelement includes:

Request sends subelement, for sending the request of point bucket test configurations information that obtains to described service end, Described request is carried the version information of described client application and for unique its host equipment of identification Mark, or, the version information of described client application, system type and identify it for unique The mark of host equipment；

Information receive subelement, for receive described service end return corresponding to described client application Point bucket test configurations information of version；

Information storing sub-units, for being stored in this locality by described point of bucket test configurations information.

Optionally, described code snippet performance element specifically for, by branch statement perform with described function The code line that version is corresponding.

Optionally, described device includes:

Notification message transmitting element, for after obtaining described point of bucket test configurations information, to described client Application program sends a notification message；

Notification message processing unit, is used for when described client application is after receiving described notification message, Trigger described feature release acquiring unit and the work of code snippet performance element.

Optionally, described feature release acquiring unit includes:

Traversal controls subelement, is used for traveling through the registered each class of described client application, and for Each case method of each apoplexy due to endogenous wind and member method, trigger the work of following subelement；

Name judgment sub-unit, for judging whether the title of described method meets set in advance point of bucket test Method naming rule；

Functional category extracts subelement, for when described name judgment sub-unit is output as "Yes", presses According to described point of bucket method of testing naming rule, from described method name, extract a point functional category for bucket test；

Feature release extracts subelement, for according to described functional category, from described point of bucket test configurations information The middle feature release mark obtaining correspondence；

Feature release judges to replace subelement, is used for judging that described client application is set in advance, adjusting The feature release mark used by described method and the function obtained from described point of bucket test configurations information Version identifier is the most consistent；If it is not, utilize the reflection characteristic of described development language to carry out the dynamic of method realization Replace, make described client application perform and the merit in described point of bucket test configurations information in the execution stage The method that energy version identifier is corresponding realizes.

Optionally, described code snippet performance element specifically for, the reflection characteristic by described language is dynamic Call the member method corresponding with described feature release.

Additionally, the application also provides for a kind of method for providing point bucket test configurations information, described method exists It is responsible for a point service end for bucket test to implement, including:

Receive the request obtaining point bucket test configurations information that client application sends, in described request extremely Comprise the version information of described client application less and for unique mark identifying its host equipment；

According to the above-mentioned information comprised in described request, obtain corresponding to described client application version The functional category of bucket test and the feature release corresponding to described functional category is divided to identify；

Described functional category and described feature release are identified and returns to described client application.

Optionally, the request obtaining point bucket test configurations information that certain client application sends it is initially received Time, described according to the above-mentioned information comprised in described request, obtain corresponding to described client application version This functional category of point bucket test and the feature release corresponding to described functional category identify, including:

According to set in advance point of bucket test order, select dividing corresponding to described client application version The functional category of bucket test and the feature release corresponding to described functional category identify so that participate in each merit Can version divide the quantity of client application that bucket test meet described point of bucket test order sets divide bucket Test ratio；

Store the version information of the client application comprised in described request, identify its host for unique Corresponding relation between the mark of equipment and described functional category, feature release mark.

Optionally, described according to the above-mentioned information comprised in described request, obtaining should corresponding to described client Functional category with point bucket test of program version and the feature release mark corresponding to described functional category Refer to, in the above-mentioned corresponding relation stored, according to described request comprises for unique recognition of host The mark of equipment, search point bucket test corresponding to described client application version functional category, with And the feature release mark corresponding to described functional category.

Optionally, described functional category and feature release mark are being returned to described client application Before, operations described below is performed:

Judge to test whether to terminate corresponding to a point bucket for described client application version；

If so, the feature release mark replacement used with final released version will return to described client The corresponding function version identifier of application program, and add " final version has determined that " mark；

Accordingly, described described functional category and feature release marks returns to described client application journey Sequence refers to, " final version has determined that " of the information after above-mentioned execution replacement operation and interpolation is identified one And it is sent to described client application.

Accordingly, the application also provides for a kind of device for providing point bucket test configurations information, described device It is being responsible for deployment in point server device of bucket test, including:

Request reception unit, the acquisition sent for receiving client application divides bucket test configurations information Request, including at least the version information of described client application and identifies it for unique in described request The mark of host equipment；

Information acquisition unit, for according to the above-mentioned information comprised in described request, obtains corresponding to described visitor The functional category of point bucket test of family end application version and the function version corresponding to described functional category This mark；

Information returning unit, returns to described visitor for described functional category and described feature release being identified Family end application program.

Optionally, receive when described request reception unit is obtaining of sending for the first time of certain client application When taking the request of point bucket test configurations information, described information acquisition unit includes:

Configuration information selects subelement, for according to set in advance point of bucket test order, selects corresponding to institute State the functional category of point bucket test of client application version and correspond to the merit of described functional category Energy version identifier so that the quantity participating in the client application that each feature release divides bucket to test meets described Divide point bucket test ratio set in bucket test order；

Configuration information storing sub-units, for storing the version of the client application comprised in described request Information, the mark being used for unique its host equipment of identification and described functional category, feature release identify it Between corresponding relation.

Optionally, described information acquisition unit specifically for, described configuration information storing sub-units storage In corresponding relation, according to the mark for unique recognition of host equipment comprised in described request, search correspondence In the functional category dividing bucket test of described client application version and corresponding to described functional category Feature release mark.

Optionally, described device includes:

Test terminates judging unit, for before triggering described information returning unit, it is judged that corresponding to described A point bucket for client application version tests whether to terminate；

Information replacement unit, for when described test end judging unit is output as "Yes", with final The feature release mark that released version is used replaces the corresponding merit that will return to described client application Energy version identifier, and add " final version has determined that " mark；

Accordingly, described information returning unit specifically for, by the information after above-mentioned execution replacement operation and " final version has determined that " mark added is sent to described client application in the lump.

Additionally, the application also provides for a kind of point of bucket test system, including: according to above-mentioned any one For providing the device of point bucket test configurations information；With according to described in above-mentioned any one for client should With point bucket test device of program.

Compared with prior art, the application has the advantage that

The technical scheme that the application provides, proposes a kind of new for point bucket test of client application Thinking: be responsible for the request according to the client application of participation point bucket test of point service end of bucket test, Thering is provided point bucket test configurations information corresponding with its application version, described client application is then according to code The functional category of point bucket test related to, obtains the feature release of correspondence from described point of bucket test configurations information Mark also performs corresponding code snippet according to described feature release mark.Use technique scheme, no Only can meet the version isolation requirement of based on C/S framework point of bucket test, and be easy to service end to difference A point bucket test for version client application manages neatly and controls, particularly at a point bucket test knot Shu Hou, can be controlled client application automatically switched to by the adjustment to point bucket test configurations information The formal application version (that is: performing the code snippet that the feature release that finally determines is corresponding) issued, thus use Family, without again downloading formal released version, is effectively improved the experience of user.

Accompanying drawing explanation

Fig. 1 is the flow process of the embodiment of a kind of point bucket method of testing for client application of the application Figure；

Fig. 2 is the process stream of point bucket test configurations information that the acquisition service end that the embodiment of the present application provides provides Cheng Tu；

Fig. 3 is the process chart obtaining point bucket test configurations information to service end that the embodiment of the present application provides；

Fig. 4 is the data structure schematic diagram of point bucket test configurations information that the embodiment of the present application provides；

Fig. 5 is the signal of the embodiment of a kind of point bucket test device for client application of the application Figure；

Fig. 6 is the another kind of embodiment of a kind of point bucket method of testing for client application of the application Flow chart；

Fig. 7 be the embodiment of the present application provide carry out dynamic replacement for each case method or member method Process chart；

Fig. 8 is the another kind of embodiment of a kind of point bucket test device for client application of the application Schematic diagram；

Fig. 9 is a kind of for providing the flow chart of the embodiment of the method for point bucket test configurations information of the application；

Figure 10 is a kind of for providing the schematic diagram of the device embodiment of point bucket test configurations information of the application；

Figure 11 is the schematic diagram of a kind of point of bucket test system of the application.

Detailed description of the invention

Elaborate a lot of detail in the following description so that fully understanding the application.But the application Can implement to be much different from alternate manner described here, those skilled in the art can without prejudice to Doing similar popularization in the case of the application intension, therefore the application is not limited by following public being embodied as.

In this application, each provide a kind of point bucket method of testing for client application and device, A kind of for providing the method and apparatus of point bucket test configurations information and a kind of point of bucket to test system, rear Continuous embodiment is described in detail one by one.

The application proposes a kind of new solution for a point bucket test for wireless aps P, and its core is: Service end provides corresponding with its application version to client application and divides bucket test configurations information, client Application program then obtains the function version corresponding with point bucket test function classification from described point of bucket test configurations information This mark, and perform the code snippet corresponding with described feature release mark.Use this technical scheme, not only Wireless aps P can be met and divide the bucket test requirement to version isolation, and be easy to service end and a point bucket was tested Journey is controlled and manages.

Propose although the application is point bucket test for wireless aps P, but technical scheme should Point bucket test of wireless aps P it is not limited to by scene, as long as based on user terminal/server framework (C/S Framework) point bucket test of client application, just can use the technical scheme that the application provides.

The code snippet that client application performs according to point bucket test configurations information, can be code line also Can be packaged method (method), both feelings will be respectively described by different embodiments herein The detailed description of the invention of condition.Below the technical scheme of the application is described in detail.

Refer to Fig. 1, it is a kind of enforcement dividing bucket method of testing for client application of the application The flow chart of example, in the present embodiment, uses mode based on code line to realize dividing of client application Bucket test.Described method comprises the steps:

Step 101: point bucket test corresponding to described client application version that obtaining service end provides is joined Confidence ceases.

For system based on C/S framework, it is usually present multiple client application version (also referred to as Application version) and situation about depositing, and in point bucket test process, different application versions may comprise difference Functional category to be tested (that is: function point or function key), each functional category is the most corresponding different Feature release, by the comparison of the test result to these difference in functionality versions, may finally select for The optimum feature release of each functional category, so that it is determined that the application version issued of finally reaching the standard grade.

Whether participation divides bucket test and participates in the test of which functional category, comes for client application Saying and generally determine that, the technical scheme that the application provides, point bucket test configurations provided by service end is believed Breath, determines that client application performs the concrete function version in functional category to be tested, and performs correspondence Code snippet.

In order to realize above-mentioned functions, client application is initial phase (before running its service code) Need obtain service end provide corresponding to client application version (hereinafter referred to as current application version) Point bucket test configurations information, described point of bucket test configurations information includes: corresponding to current application version point Bucket test functional category and corresponding to described functional category feature release mark (instruction client should The feature release that should perform by program).The process obtaining this information includes step 101-1 as described below extremely Step 101-4,2 is described further below in conjunction with the accompanying drawings.

Step 101-1: obtain the version information of described client application；

Each client application has the version information of oneself, it is simply that the current application described in the present embodiment Version.Running on the client application in different system platform, the mode obtaining this information is different, logical The api function that often system can be utilized to provide realizes, such as, for ios operating system, can pass through Bundle version in info.plist file or other modes obtain the relevant information of current application version.

Step 101-2: judge whether this locality does not stores point bucket test configurations information corresponding to current application version, If so, forward step 101-4 to perform, if it is not, perform step 101-3.

This step first determines whether whether this locality stores point bucket test configurations letter corresponding to current application version Breath.In the specific implementation, if described point of bucket test configurations information is stored in local data file, then may be used In the way of by reading local data file, it is judged that the most whether store corresponding with current application version Divide bucket test configurations information, it may be assumed that whether store the function class of point bucket test corresponding with current application version Type, and the feature release mark corresponding to each function type；If this locality does not stores above-mentioned information, then Need to forward step 101-4 to and obtain up-to-date point bucket test configurations information from service end, otherwise perform step 101-3。

Step 101-3: judge whether described point of locally stored bucket test configurations information has that " final version is Determine " mark, if it is not, perform step 101-4.

This step, on the basis of locally stored described point of bucket test configurations information, continues to judge described point of bucket Whether test configurations information has " final version has determined that " mark, if it has, explanation is for current application A point bucket test for version is over, and the most locally stored point bucket test configurations information is exactly and finally reaches the standard grade The configuration information that released version is corresponding, therefore client application can directly use locally stored correspondence Point bucket test configurations information in current application version；Otherwise, illustrate that a point bucket test not yet terminates, still need Step 101-3 to be performed obtains up-to-date point bucket test configurations information from service end.

Use aforesaid way, before a point bucket test terminates, all to clothes when each client application initializes Business end obtains up-to-date point of bucket test configurations information, thus for service end a point bucket test process is controlled with Management provides condition, and after the test of point bucket terminates (point bucket test configurations information it has been determined that), client is answered Just a point bucket test configurations information directly can be obtained from this locality by program, without obtaining to service end every time, Such that it is able to saving network flow.

Step 101-4: obtain described point of bucket test configurations information from described service end.

This step include to service end send request, receive point bucket test configurations information that service end returns and Store that information in local such three sub-steps, 3 this process is described further below in conjunction with the accompanying drawings.

Step 101-4-1: send the request of point bucket test configurations information that obtains to described service end.

Described request is carried current application version and the mark for unique recognition of host equipment, described host Device identification typically refers to the device numbering of host equipment, such as: the IMEI etc. of smart mobile phone, service End can uniquely identify described host equipment according to this information, and provides and described current application version phase for it Corresponding point bucket test configurations information.

In being embodied as, if service end also needs to determine a point bucket with reference to the system type of client device Test configurations information, then the system type of described client application can also be carried in described request, Such as: ios or android.

In an object lesson of the present embodiment, assemble the URL of similar following form according to above-mentioned information: http://server/abtest.html？System type=ios& device numbering=xxx&app version=xxx, then passes through Http protocol sends this request to service end.

Step 101-4-2: receive point bucket test configurations corresponding to current application version that described service end returns Information.

After service end receives the above-mentioned request that client application sends, the host according to carrying in request sets Standby mark, selects point bucket test configurations information corresponding to described current application version for it, and returns this letter Breath.So client will receive described point of bucket test configurations information, and the form class of this information is similar to as follows Shown in: { ' key1 ': ' 1 ', ' key2 ': ' 1 ' }, it may be assumed that described client application for functional category key1, The code line corresponding with feature release 1 should be performed；For functional category key2, it should perform and function version The code line of these 2 correspondences.After a point bucket test terminates, point bucket test configurations information that described service end returns In be also possible to carry " final version has determined that " mark.

Step 101-4-3: described point of bucket test configurations information is stored in this locality.

Point bucket test configurations information received is stored in this locality, and so next time runs described client application During program, it is possible to read a point bucket test configurations information from this locality, and perform judgement described above and process Process.

It is stored in point bucket test configurations information of this locality, can only comprise point bucket corresponding with current application version Test configurations information, it may be assumed that only comprise similar above-mentioned { ' key1 ': ' 1 ', ' key2 ': ' 1 ' } such information.Consider Client application may be performed once or repeatedly updating operation to user, the most locally stored point Bucket test configurations information, may comprise, for point bucket test configurations information of multiple application version, refers to attached Fig. 4, it is the data structure schematic diagram of point bucket test configurations information.In this case, this step only needs According to the information corresponding with current application version that point bucket test configurations information updating received is locally stored it is Can.

So far, point bucket test configurations information corresponding to current application version that service end provides just is obtained. In being embodied as, according to the needs of client application, it is also possible to actively arrange flag bit, instruction is originally Point bucket test configurations data for ground storage are up-to-date, it is simple to client application performs according to this flag bit Associative operation or process.

Step 102: according to the functional category of point bucket test that described client application code relates to, from institute State the feature release mark obtaining correspondence in point bucket test configurations information.

Participate in a point client application for bucket test, generally can relate in its service code in point bucket test The specific code of certain or some functional categories realize, owing to can have multiple for certain functional category Implementation, it may be assumed that corresponding different feature release, therefore before performing concrete code, first from institute State the feature release mark that in point bucket test configurations information, acquisition is corresponding with functional category.

It is illustrated by a simple case below, in certain point of bucket test, is required for the background of button Color is tested, and corresponding functional category is " btnColorTest ", to having two function versions by functional category This, button background colour is set to redness by feature release 1, and button background is set to blueness by feature release 2. It is accomplished by from described point of bucket test configurations information acquisition the most in this step corresponding with " btnColorTest " Feature release mark, thus could perform in subsequent step 103 correspondence branch statement.

Specifically, point bucket test configurations information described in locally stored is searched it is positioned under current application version Functional category " btnColorTest ", the most further read the function version corresponding with " btnColorTest " This mark.When implementing, it is also possible to above-mentioned functions is encapsulated in a function realization, with function class Do not call this function as input, obtain function version corresponding with described functional category under current application version This mark, such as:

Int version=getVersionByKey (" btnColorTest ")；

As a kind of perfect technical scheme, in addition it is also necessary to consider the feelings that the feature release mark obtained may be invalid Condition, such as: service end return feature release mark be not Effective Numerical (such as: be letter and nonnumeric), Or what service end returned is the situations such as response of makeing mistakes, then in order to ensure the normal fortune of client application OK, default value set in advance, such as " 1 " at this moment can be used to identify as feature release.

Step 103: identify according to described feature release, performs corresponding code snippet by branch statement.

After obtaining the feature release mark corresponding with functional category, it is possible to perform correspondence by branch statement Code snippet, such as, can use branch statement as follows for above-mentioned simple case:

If (version==1)

// button background colour is set to redness

}else{

// button background colour is set to blueness

}

So, above-mentioned service code will perform corresponding code line according to the feature release mark obtained. Certainly, simple case given here is only schematically, in concrete client application code, Increasingly complex code line can be performed according to demand.

Described above is the handling process of based on code line point of bucket method of testing.In being embodied as, step The function of 101 can be realized by an independent information collocation module, and step 102 and step 103 are then The service code of client application realizes.Described information collocation module and client application Service code can be to use work in series mode, when client application starts i.e. every time, described information Configuration module can first start, and obtains point bucket test configurations information, subsequently a business generation for client application Code brings into operation again, and when needs obtain feature release mark, calling described information collocation module provides The similar such interface function of getVersionByKey () realize.

Consider before a point bucket test terminates, when client application starts every time, described information configuration mould Block will obtain a point bucket test configurations information from service end, and it is relatively time-consuming that this process relates to network operation, In order to avoid the user of client application waits as long for, the technical scheme of the application additionally provides separately The message based embodiment of outer one, it may be assumed that after described information collocation module starts, client application journey The service code of sequence can also run therewith, and intercepts the notification message of information collocation module；Described After information collocation module obtains point bucket test configurations information, send a notification message to client application；Visitor After family end application program listens to this message, in registered readjustment processes function, according to service code Need, from described point of bucket test configurations information, obtain the feature release mark corresponding with functional category, and root Corresponding code line is performed according to described feature release mark.

In concrete enforcement, above-mentioned serial embodiment based on function call can be used as required, Can also use above-mentioned message based parallel practice mode, these are the change of detailed description of the invention, all Without departing from the core of the application, all within the protection domain of the application.

In the above-described embodiment, it is provided that a kind of point bucket method of testing for client application, with Corresponding, the application also provides for a kind of point bucket test device for client application.Refer to Fig. 5, it is a kind of embodiment schematic diagram dividing bucket test device for client application of the application. Owing to device embodiment is substantially similar to embodiment of the method, so describing fairly simple, relevant part sees The part of embodiment of the method illustrates.Device embodiment described below is only schematically.

A kind of point bucket test device for client application of the present embodiment, including: configuration information obtains Take unit 501, for obtaining point bucket test corresponding to described client application version that service end provides Configuration information；First feature release acquiring unit 502, for relating to according to described client application code The functional category of point bucket test, from described point of bucket test configurations information, obtain the feature release mark of correspondence； First code fragment performance element 503, for performing the code corresponding with described feature release by branch statement OK.

Optionally, described configuration information acquiring unit includes:

Optionally, described device includes:

Notification message processing unit, is used for when described client application is after receiving described notification message, Trigger described first feature release acquiring unit and the work of first code fragment performance element.

Additionally, present invention also provides the another kind of enforcement of point bucket method of testing for client application Example.Refer to Fig. 6, its a kind of point bucket method of testing for client application provided for the application The flow chart of another kind of embodiment, in the present embodiment, the reflection characteristic of exploitation language, based on method Rank realizes point bucket test of client application.The part that the present embodiment is identical with first embodiment step Repeat no more, below emphasis difference is described.

A kind of point bucket method of testing for client application that the application provides includes:

Step 601: point bucket test corresponding to described client application version that obtaining service end provides is joined Confidence ceases.

This step is identical with the step 101 of first embodiment, refer to the related description of first embodiment.

Step 602: the reflection characteristic of exploitation language, relates to according to described client application code Divide the functional category of bucket test, from described point of bucket test configurations information, obtain the feature release mark of correspondence.

In the present embodiment, employing objective-C is as software development language, and utilizes the reflection spy of this language Property, the angle called from method level achieves point bucket test for client application that the application provides Method.

In order to realize described function, it is desirable to point method that bucket test is relevant in client application code, Set in advance point of bucket method of testing naming rule is used to be named, specifically: method name must be pressed The functional category that comprises the test of point bucket according to form set in advance and the method realize the function that logic is corresponding Version identifier.Furthermore it is required that service code is when calling the method relevant to dividing bucket test, unified call The method that the feature release that pre-defines is corresponding.

In an object lesson of the present embodiment, method naming rule set in advance, define and survey with point bucket The method that examination is relevant uses following form name: abtest_key_version (), and wherein key is functional category, Version is that the feature release corresponding to logic that realize of the method identifies.In order to make it easy to understand, still with first As a example by point bucket test of the settings button background colour described in embodiment, it is red (merit by settings button background colour Can version 1) and function code that settings button background colour is blueness (feature release 2), be individually enclosed in by In two methods according to the name of said method naming rule, example code it is presented herein below:

And preset, when service code needs to be configured the background colour of button, unified call with The method of feature release 1 correspondence, it may be assumed that call abtest_btnColorTest_1 ().

On the basis of the service code of client application follows above-mentioned naming rule, this step is the most permissible The reflection characteristic of exploitation language, travels through the registered each class of client application, for each class In each case method and member method, extract from its method name according to described naming rule and survey with point bucket The functional category that examination is relevant, and from described point of bucket test configurations information, obtain the feature release mark of correspondence, And carry out the process of necessity.

First ergodic process is briefly described.The reflection characteristic of exploitation language, can obtain client should With each class registered in program and all case methods of each apoplexy due to endogenous wind and member method.Possesses reflection The development language of characteristic has multiple, and its interface obtaining above-mentioned information provided is typically different, such as, use Objective-C, can call objc_getClassList () and obtain the list of registered class definition, for Each registered class in this list, can call class_getClassMethod () and obtain the institute of this apoplexy due to endogenous wind Methodical relevant information.

On the basis of above-mentioned traversing operation, for each case method obtained or member method, according to such as Step 602-1 shown in lower, to the process of step 602-5,7 is described further below in conjunction with the accompanying drawings.

Step 602-1: judge whether the title of described method meets method naming rule set in advance；If so, Performing step 602-2, the most described method is disposed.

The method name obtained is mated with method naming rule set in advance, if its designator Close method naming rule set in advance, illustrate that the method is and point method that bucket test is relevant, the most permissible Performing 602-2, otherwise explanation the method is unrelated with point bucket test, it is not necessary to process.

Step 602-2: according to described method naming rule, extracts a point merit for bucket test from described method name Can classification.

Such as, currently processed method name is abtest_btnColorTest_1, according to shape set in advance such as The method naming rule of abtest_key_version, it is possible to therefrom extracting a point functional category for bucket test is “btnColorTest”。

Step 602-3: according to described functional category, obtain the merit of correspondence from described point of bucket test configurations information Can version identifier.

The processing procedure of this step is similar with first embodiment, refers to the relevant portion of first embodiment.

Step 602-4: judge that described client application is set in advance, call what described method was used Feature release mark identifies whether consistent with the feature release obtained from described point of bucket test configurations information； If it is not, perform step 602-5.

The example still using above-mentioned settings button background colour illustrates, for currently processed method Abtest_btnColorTest_1 (), if believed from described point of bucket test configurations according to " btnColorTest " extracted The feature release obtained in breath is designated 2, it may be assumed that service end instruction client application is for this functional category The code that feature release is 2 should be performed；And client application presets and needs the back of the body to button When scenery is configured, the method that unified call is corresponding with feature release 1, it may be assumed that call The instruction of abtest_btnColorTest_1 (), i.e. service end and the feature release of service code unified call method Inconsistent, at this moment perform step 602-5 and be replaced process.If above-mentioned two feature release is consistent, the most not Need to perform step 602-5.

Step 602-5: utilize the reflection characteristic of described development language to carry out the dynamic replacement of method realization so that Described client application performed and the feature release mark in described point of bucket test configurations information in the stage of execution Know corresponding method to realize.

Specifically, it is simply that the functional category related to for current method, client application is preset The method of unified call realize replacing with in point bucket test configurations data the feature release mark correspondence of instruction Method realizes.

Continue to illustrate with the example in step 602-4, use method in this step The realization realizing replacement method abtest_btnColorTest_1 () of abtest_btnColorTest_2 (), thus all Calling the service code of abtest_btnColorTest_1 (), actually perform in the execution stage is method The function of abtest_btnColorTest_2 ().

Use objective-C to realize above-mentioned replacement function in the present embodiment, directly invoke what system provided Class_replaceMethod () function can realize, in other embodiments, if using other to have instead Penetrate the language of characteristic, then can call other respective function with similar functions.

Step 603: the reflection characteristic of exploitation language, performs corresponding generation according to described feature release mark Chip segment.

Owing to, in step 602-5, the reflection characteristic of exploitation language, the realization having been carried out necessity is replaced Changing operation, therefore this step need not service code be carried out extra process, in the operation of service code Cheng Zhong, is ensured all methods relevant to the test of point bucket by system, execution be all and point bucket test configurations is believed The feature release specified in breath identifies consistent method and realizes.

So far, by step 601-step 603, from the angle of method level the application is provided for client A point bucket method of testing for application program is described.In the specific implementation, above-mentioned steps 601 and step 602 The acquisition completed divides barrel test configurations information and method to travel through and realize replacement function can be encapsulated in one In individual independent module, this module starts after client application completes initialization operation, it may be assumed that visitor Family end application program starts after being complete the registration of all classes, step 603 then corresponding client application The execution stage of service code.

Described above is and use the development language (such as: objective-C) possessing reflection characteristic to implement the application A kind of embodiment of technical scheme, in other embodiments, it would however also be possible to employ other have reflex mechanism Language (such as: Java language) realize the technical scheme of the application from the angle of method level.Use Java The embodiment of language is similar with the basic handling flow process of first embodiment, simply needs base in step 103 In the reflex mechanism of Java language, according to the feature release mark obtained in a step 102, it is determined that adjust Method name, then call realization in the operation phase to the survey of point bucket by getMethod () and invoke () etc. Dynamically selecting and execution of method for testing.

Corresponding with above-mentioned a kind of embodiment for point bucket method of testing of client application, the application Also provide for a kind of point bucket test device for client application.Refer to Fig. 8, it is the one of the application Plant the another kind of embodiment schematic diagram of point bucket test device for client application.Owing to device is implemented Example is substantially similar to embodiment of the method, so describing fairly simple, relevant part sees embodiment of the method Part illustrates.Device embodiment described below is only schematically.

A kind of point bucket test device for client application of the present embodiment, including: configuration information obtains Take unit 801, for obtaining point bucket test corresponding to described client application version that service end provides Configuration information；Second feature release acquiring unit 802, for the reflection characteristic of exploitation language, according to institute State the functional category of point bucket test that client application code relates to, from described point of bucket test configurations information The middle feature release mark obtaining correspondence；Second code fragment performance element 803, for exploitation language Reflection characteristic, performs corresponding code snippet according to described feature release mark.

Optionally, described configuration information acquiring unit includes:

Optionally, described second feature release acquiring unit includes:

Additionally, corresponding with the above-mentioned point bucket method of testing embodiment for client application, this Shen Please additionally provide a kind of method for providing point bucket test configurations information.Refer to Fig. 9, it carries for the application A kind of flow chart of the embodiment of the method for offer point bucket test configurations information of confession.The present embodiment and first The part that embodiment is similar repeats no more, below emphasis difference is described.

It is a kind of for providing the method for point bucket test configurations information to include that the application provides:

Step 901: preset a point bucket testing scheme.

For client application divides bucket test, it should meet each application version mutually isolated Basic demand, therefore service end needs possess based on application version point of bucket test and management function.Specifically, Service end should use with application version as context, comprises multiple functional category under each application version divides , comprise multiple feature release such individual-layer data organizational form under each functional category.

For the new point bucket test that will issue, need first to set a point bucket testing scheme, it may be assumed that this point of bucket is surveyed Which functional category application version, this point of bucket test that examination is subordinate to include, corresponding to the merit of each functional category Energy version, and participate in user's ratio that each feature release divides bucket to test.

In an object lesson of the present embodiment, newly-built one for wireless aps P1.0.0 application version Divide bucket test, under the application version 1.0.0 of above-mentioned individual-layer data, add a new functional category branch " btnColorTest ", adds two feature release marks, wherein version 1 settings button under this functional category Background colour is red, and version 2 settings button background colour is blue, and the user setting use version 1 accounts for Ratio is 30%, and the user's accounting using version 2 is 70%.

Service end defines above-mentioned point of bucket testing scheme (that is: dividing bucket test order), and developer according to Description in preceding embodiment, to participating in point client application of bucket test according to code line or method After level two ways carries out setting or the amendment of necessity, this point of bucket testing scheme just can be issued.

Step 902: receive the request obtaining point bucket test configurations information that client application sends, described Including at least the version information of described client application with for unique its host equipment of identification in request Mark.

After dividing bucket testing scheme to issue, when participating in dividing a client application for bucket test to start, all can every time The request of point bucket test configurations information that obtains is sent to service end.Should including at least described client in this request With the version information of program with for unique mark identifying its host equipment, it is also possible to comprise client application The system type that program is run.

Step 903: according to the above-mentioned information comprised in described request, obtains corresponding to described client application journey The functional category of point bucket test and the feature release corresponding to described functional category of sequence version identify.

When service end is initially received the request obtaining point bucket test configurations information that certain client application sends Time, can select corresponding to described client application version according to set in advance point of bucket testing scheme The test of point bucket functional category and corresponding to the feature release mark of described functional category.Wherein, choosing Select feature release mark and can use different strategies, such as: randomized policy, polling schemas or in advance The algorithm set, and it is referred in request the information such as the system type that carries, as long as from macroscopically can Accomplish that the quantity participating in the client application that each feature release divides bucket to test sets satisfied dividing in bucket testing scheme Fixed point bucket test ratio.

After completing above-mentioned selection, in order to ensure that client user has more stable, good experience, can With by the version information of the client application comprised in the described request being initially received, be used for uniquely knowing Between the information such as the other mark of its host equipment, described functional category and selected feature release mark Corresponding relation, is stored in the data base of this locality.

Hereafter, if the request receiving the transmission of same client again (that is: has stored in data base The mark of its host equipment), then look in the database according to the host equipment mark carried in request Look for, thus obtain point bucket test configurations information of client to be returned to, it may be assumed that should corresponding to described client Functional category with point bucket test of program version and the feature release mark corresponding to described functional category.

Under normal circumstances, before the test of point bucket terminates, service end for the request of same host equipment, Always to point bucket test configurations information that its return is same, but at some in particular cases, such as: need Adjust the user's ratio participating in difference in functionality version, at this moment can be returned to point bucket survey of client by amendment Feature release mark in examination configuration information realizes this function, say, that service end can be by adjusting a point bucket Client is divided controlling flexibly and management of barrel test process by test configurations information realization.

Step 904: described functional category and described feature release are identified and returns to described client application journey Sequence.

Point bucket test configurations information that generally can directly step 903 be obtained returns to client.Consider After dividing bucket test to terminate, the various conversion ratio indexs obtained according to statistics, it has been determined that optimum function version This, the most just can be sent to the mark of the feature release determined client, thus client should Optimal realization can be presented to user by program, also correspond to achieve client application simultaneously Automatically update process, it is not necessary to require user to download to reach the standard grade the final version issued, such that it is able to improve user Experience.

Based on above-mentioned consideration, this step point bucket test configurations information obtained is returned to client it Before, judge to test whether to terminate corresponding to a point bucket for described client application version, if terminated, The feature release mark used with final released version is replaced and will be returned to described client application Corresponding function version identifier.

Further, after using above-mentioned process, for saving network flow, it is also possible to after above-mentioned replacement Information in add " final version has determined that " mark, thus inform that this point of bucket of client application is surveyed Examination terminates, and the follow-up point bucket test configurations information that can directly use this to return of client application is i.e. Can, the request of point bucket test configurations information that obtains need not be sent again to service end.

Therefore, for point bucket test terminated, this step by the information after above-mentioned execution replacement operation and " final version has determined that " mark added is sent to described client, in the lump otherwise, directly by step 903 Point bucket test configurations information obtained is sent to described client.

In the above-described embodiment, it is provided that a kind of method for providing point bucket test configurations information, therewith Corresponding, the application also provides for a kind of device for providing point bucket test configurations information.Refer to Figure 10, What it was the application is a kind of for providing the device embodiment schematic diagram of point bucket test configurations information.Due to device Embodiment is substantially similar to embodiment of the method, so describing fairly simple, relevant part sees method and implements The part of example illustrates.Device embodiment described below is only schematically.

A kind of device for offer point bucket test configurations information of the present embodiment, including: testing scheme sets Unit 1001, is used for presetting a point bucket testing scheme；Request reception unit 1002, is used for receiving client The request obtaining point bucket test configurations information that application program sends, including at least described client in described request Hold the version information of application program and for unique mark identifying its host equipment；Information acquisition unit 1003, For according to the above-mentioned information comprised in described request, obtain corresponding to described client application version The functional category of bucket test and the feature release corresponding to described functional category is divided to identify；Information returns single Unit 1004, returns to described client application journey for described functional category and described feature release being identified Sequence.

Optionally, described information acquisition unit specifically for, described configuration information storing sub-units storage In above-mentioned corresponding relation, according to the mark for unique recognition of host equipment comprised in described request, search Corresponding to the functional category dividing bucket test of described client application version and corresponding to described function The feature release mark of classification.

Optionally, described device includes:

The embodiment of the present application additionally provides a kind of point of bucket test system.Referring to accompanying drawing 11, described system includes For providing the device 1101 of point bucket test configurations information and being used for point bucket test of client application Device 1102.Described for providing the device of point bucket test configurations information to be typically deployed at based on C/S framework Being responsible on point server of bucket test, the described point bucket test device for client application is usual It is deployed on client device based on C/S framework, including: PC, smart mobile phone, PAD, iPad Deng equipment, it is briefly described as follows the groundwork flow process of native system.

The described point of bucket test device being deployed on client device is sent out to being responsible for a point server for bucket test Sending the request obtaining point bucket test configurations information, described server is according to the client application carried in this request The version information of program, returns a point bucket test configurations information to described point of bucket test device, and this information comprises visitor Family end application program participates in the feature release mark of point functional category of bucket test and correspondence；Described point of bucket is surveyed When electricity testing device tests relevant code to point bucket in performing client application, according to a point bucket test configurations Feature release information in information, performs corresponding code snippet.

In sum, the technical scheme that the application provides, point bucket test for client application proposes A kind of new thinking: participate in that point client of bucket test provides according to service end with current application version pair Point bucket test configurations information answered, performs the code snippet corresponding with specific function version, thus completes service Point bucket test function that end is specified.Use technique scheme, be possible not only to meet client application The version isolation requirement that proposes of point bucket test, and be easy to service end to different editions client application The test of point bucket manage neatly and control, particularly after a point bucket test terminates, can be by dividing The adjustment of bucket test configurations information, controls the application version that client application automatically switches to formally issue (that is: performing the code snippet that the feature release that finally determines is corresponding), thus user is formal without again downloading Released version, is effectively improved the experience of user.

Although the application is open as above with preferred embodiment, but it is not for limiting the application, Ren Heben Skilled person, without departing from spirit and scope, can make possible variation and amendment, Therefore the protection domain of the application should be defined in the range of standard with the application claim.

In a typical configuration, calculating equipment includes one or more processor (CPU), input/output Interface, network interface and internal memory.

Internal memory potentially includes the volatile memory in computer-readable medium, random access memory (RAM) and/or the form such as Nonvolatile memory, such as read only memory (ROM) or flash memory (flash RAM). Internal memory is the example of computer-readable medium.

1, computer-readable medium includes that permanent and non-permanent, removable and non-removable media can be by Any method or technology realize information storage.Information can be computer-readable instruction, data structure, journey The module of sequence or other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), its The random access memory (RAM) of his type, read only memory (ROM), electrically erasable is read-only deposits Reservoir (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tape, tape magnetic magnetic Disk storage or other magnetic storage apparatus or any other non-transmission medium, can be used for storage can be set by calculating The standby information accessed.According to defining herein, computer-readable medium does not include non-temporary computer-readable matchmaker Body (transitory media), such as data signal and the carrier wave of modulation.

2, it will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer Program product.Therefore, the application can use complete hardware embodiment, complete software implementation or combine software Form with the embodiment of hardware aspect.And, the application can use and wherein include meter one or more The computer-usable storage medium of calculation machine usable program code (include but not limited to disk memory, CD-ROM, optical memory etc.) form of the upper computer program implemented.

Claims

1. point bucket method of testing for client application, it is characterised in that including:

Point bucket method of testing for client application the most according to claim 1, its feature exists In, point bucket test configurations information corresponding to described client application version includes: corresponding to described visitor The functional category of point bucket test of family end application version and the function version corresponding to described functional category This mark.

Point bucket method of testing for client application the most according to claim 1, its feature exists In, point bucket test configurations letter corresponding to described client application version that described acquisition service end provides Breath, including:

Obtain the version information of described client application；

Point bucket method of testing for client application the most according to claim 3, its feature exists In, described obtain described point of bucket test configurations information from described service end and include:

5. according to the arbitrary described point bucket method of testing for client application of claim 1-4, its Being characterised by, the described code snippet corresponding according to the mark execution of described feature release refers to, by branch's language Sentence performs the code line corresponding with described feature release.

Point bucket method of testing for client application the most according to claim 5, its feature exists In, after obtaining described point of bucket test configurations information, execution operations described below:

Send a notification message to described client application；

7. according to the arbitrary described point bucket method of testing for client application of claim 1-4, its It is characterised by, when using the development language possessing reflection characteristic to implement this method, described according to described client The functional category of point bucket test that end application code relates to, obtains from described point of bucket test configurations information Corresponding feature release mark, including:

If so, operations described below is performed:

8. according to the arbitrary described point bucket method of testing for client application of claim 1-4, its It is characterised by, when using the development language possessing reflection characteristic to implement this method, described according to described function Version identifier performs corresponding code snippet and refers to, by the reflection characteristic dynamic call of described language with described The member method that feature release is corresponding.

9. point bucket test device for client application, it is characterised in that including:

Point bucket test device for client application the most according to claim 9, its feature Being, the configuration information that described configuration information acquiring unit obtains includes: corresponding to described client application journey The functional category of point bucket test and the feature release corresponding to described functional category of sequence version identify.

The 11. point bucket test devices for client application according to claim 9, its feature exists In, described configuration information acquiring unit includes:

The 12. point bucket test devices for client application according to claim 11, its feature Being, described service end acquisition of information subelement includes:

13. according to the arbitrary described point bucket test device for client application of claim 9-12, It is characterized in that, described code snippet performance element specifically for, by branch statement perform with described function The code line that version is corresponding.

The 14. point bucket test devices for client application according to claim 13, its feature It is, including:

15. according to the arbitrary described point bucket test device for client application of claim 9-12, It is characterized in that, described feature release acquiring unit includes:

16. according to the arbitrary described point bucket test device for client application of claim 9-12, It is characterized in that, described code snippet performance element specifically for, the reflection characteristic by described language is dynamic Call the member method corresponding with described feature release.

17. 1 kinds for the method providing point bucket test configurations information, it is characterised in that described method is negative The service end of duty management point bucket test is implemented, including:

18. methods for providing point bucket test configurations information according to claim 17, its feature exists In, when being initially received the request obtaining point bucket test configurations information that certain client application sends, described According to the above-mentioned information comprised in described request, obtain point bucket corresponding to described client application version The functional category of test and the feature release corresponding to described functional category identify, including:

19. methods for providing point bucket test configurations information according to claim 18, its feature exists In, described according to the above-mentioned information comprised in described request, obtain corresponding to described client application version The functional category of this point bucket test and the feature release mark corresponding to described functional category refer to, In the above-mentioned corresponding relation stored, according to the mark for unique recognition of host equipment comprised in described request Know, search the functional category of point bucket test corresponding to described client application version and correspond to The feature release mark of described functional category.

20. according to the arbitrary described method for offer point bucket test configurations information of claim 17-19, its Be characterised by, described functional category and feature release are identified return to described client application it Before, execution operations described below:

21. 1 kinds for providing the device of point bucket test configurations information, it is characterised in that described device is negative Dispose in the server device of duty management point bucket test, including:

22. is according to claim 21 for providing the device of point bucket test configurations information, and its feature exists In, receive when described request reception unit is that the acquisition that certain client application sends for the first time divides bucket to survey When trying the request of configuration information, described information acquisition unit includes:

23. is according to claim 22 for providing the device of point bucket test configurations information, and its feature exists In, described information acquisition unit specifically for, at the corresponding relation of described configuration information storing sub-units storage In, according to the mark for unique recognition of host equipment comprised in described request, search corresponding to described visitor The functional category of point bucket test of family end application version and the function version corresponding to described functional category This mark.

24. according to the arbitrary described device for providing point bucket test configurations information of claim 21-23, its It is characterised by, including:

25. 1 kinds of points of bucket test systems, it is characterised in that including: according to the claims 21 For providing the device of point bucket test configurations information, and according to described in the claims 9 for client Point bucket test device of end application program.