CN106856439B - A kind of method and server of scheme test - Google Patents
A kind of method and server of scheme test Download PDFInfo
- Publication number
- CN106856439B CN106856439B CN201611116008.XA CN201611116008A CN106856439B CN 106856439 B CN106856439 B CN 106856439B CN 201611116008 A CN201611116008 A CN 201611116008A CN 106856439 B CN106856439 B CN 106856439B
- Authority
- CN
- China
- Prior art keywords
- file
- user
- routing iinformation
- server
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 63
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000009826 distribution Methods 0.000 claims abstract description 25
- 230000006399 behavior Effects 0.000 claims description 15
- 238000005516 engineering process Methods 0.000 abstract description 3
- 230000008569 process Effects 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 239000000047 product Substances 0.000 description 7
- 238000002474 experimental method Methods 0.000 description 5
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000002224 dissection Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000007795 chemical reaction product Substances 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5009—Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention discloses the methods and server of a kind of test of scheme, are used for field of computer technology.The method comprise the steps that obtaining the user tag description file corresponding with user identifier pre-generated for AB test；According to the description file and preset virtual objects example list, the routing iinformation for obtaining user identifier and virtual objects corresponding relationship describes file, determining, the routing iinformation describes the routing iinformation to be read in and describe file after file meets preset reading condition；The routing iinformation is described into file and is assembled into internal structure body, sends access request to preset access addition policy interface；When access strategy interface is to the access request, the subscriber cluster distributing strategy in the server memory is updated using the internal structure body, is tested with carrying out the AB of virtual objects distribution according to subscriber cluster.The embodiment of the present invention is directly updated, therefore subscriber cluster distributing strategy can come into force in real time by dynamic configuration subscriber cluster distributing strategy in server memory, improves AB accurate testing degree.
Description
Technical field
The present invention relates to field of computer technology, in particular to a kind of the method and server of scheme test.
Background technique
So-called AB test is exactly to allow a part of user to make for two schemes of the same target making (such as two pages)
With A scheme, another part user uses B scheme, records the service condition of user, see which scheme more meets design object.
In net cast website, in order to be lifted at the user experience during watching video live broadcast, website can be continually
It adjusts by various methods with strategy to product and system, at this moment needs quickly to obtain user feedback, it in this way can be to new
The effect of scheme makes timely adjustment, iteration update scheme is gone according to the feedback data of user, if user is to product and system
Scheme feedback result it is undesirable, or even need to abandon current new departure in time, thus AB test in video living transmission system just
Seem extremely important, is the key foundation of data-driven product.
In AB testing process, meeting while parallel two sets of plan: Control (reference scheme) and (the experiment side Treatment
Case), the process that comes into force of experimental program is shorter, and " experimental program subscriber cluster (Treatment User Set) " is on probation to new departure
Feedback can be more accurate.In experimental program during coming into force, inflow and loss of the user in website be completely it is unpredictable,
Need to shorten in test the entry-into-force time of experimental program.Also, for net cast class website, new departure adjustment is frequent, AB
Test frequency is high, and the friendliness used in this way for AB test macro seems increasingly important, not only can allow more
Non-technical personnel participates in AB test process, and can reduce the error probability of AB Test Strategy.
Usually in AB test, obtains experimental program subscriber cluster and to allow the subscriber cluster to come into force immediately of crucial importance.?
Net cast field, to the user behavior mainly according to user on website of user's portrait, comprising: user's watching behavior,
Barrage information, concern behavior, present give the information such as behavior, user geographical location, user equipment, according to specific data mould
Type stamps various labels to user, such as: it is big to certain game viewing time accounting, then certain game severe is stamped to user
Watch label；Habit sends barrage in watching video live broadcast, then stamps more barrage labels to this kind of user, and according to barrage amount
How much, segment out more users label.In short, obtaining experimental program subscriber cluster by label, experiment can be more precisely assessed
The effect of scheme.
In net cast website, when triggering specific function request response contents, client (Client) can be to service
Device submits HTTP request, which can be introduced into web gateway server (Gateway Server), then by gateway server
Request routing function is completed according to information in URL.Then the user request function of being responsible for handling active user is distributed to connect
In mouthful.Then the dissection process request is responsible for by functional interface.How in time efficiently the routing rule of configuration user request is aobvious
It obtains increasingly important.
Existing AB test method, if necessary to modify " experimental program subscriber cluster (Treatment User Set) ",
The demand for having distributed modification subscriber cluster by operational department is generally required, then satisfaction is precipitated in statistical according to demand by data team
The user of demand collects, and gives " system function " research and development department, and user's collection that statistics obtains is imported into functional interface, or even is needed
Again the system function application is issued, the subscriber cluster newly imported can be given birth to as early as possible in user's request of subsequent entrance
Effect.Whole process, what is be related to is overstaffed, complicated for operation, and distribution policy is easy error, and the process that comes into force is long.
Summary of the invention
The embodiment of the invention provides the method and server of a kind of test of scheme, dynamic configuration subscriber cluster distributing strategies
And directly updated in server memory, subscriber cluster distributing strategy is come into force in real time, improves AB accurate testing degree.
In a first aspect, the application provided a kind of method of scheme test, this method is applied to server, this method packet
It includes:
Obtain the user tag description file corresponding with user identifier pre-generated for AB test；
According to the description file and preset virtual objects example list, user identifier and the corresponding pass of virtual objects are obtained
The routing iinformation of system describes file, and the routing iinformation describes the user concentrated in file including potential user group and destination virtual
The corresponding relationship of article；
Determining that the routing iinformation describes to read in the routing iinformation description text after file meets preset reading condition
Part；
The content that the routing iinformation describes file is assembled into internal structure body, adds policy interface to preset access
Access request is sent, includes the internal structure body in the access request；
When access strategy interface is to the access request, updated in the server using the internal structure body
Subscriber cluster distributing strategy in depositing is tested with carrying out the AB of virtual objects distribution according to subscriber cluster.
Preferably, the pre-generated user tag for AB test description text corresponding with user identifier is obtained described
Before the step of part, the method also includes:
Generate the user tag description file corresponding with user identifier for AB test.
Preferably, the step of user tag corresponding with user identifier description file generated for AB test wraps
It includes:
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
It is corresponding with user identifier that user tag is generated according to the user identifier in user tag to be tested and subscriber cluster
File is described.
Preferably, if generating the routing iinformation describes the generation time of file greater than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets preset reading condition.
Preferably, the routing iinformation describes the configuration file that file is json format；
It is described that the routing iinformation is described into the step of file is assembled into internal structure body, comprising:
Read the json format configuration file；
By different field assignment in the json format configuration file to each object attribute of preset internal structure body
In.
Preferably, after carrying out the AB test of virtual objects distribution according to subscriber cluster, the method also includes:
User behavior characteristics or user is collected to feed back the usage experience of the destination virtual article of distribution；
It is fed back according to the user behavior characteristics or the usage experience, adjusts subscriber cluster distributing strategy, generate new
Routing iinformation describes file, updates into the server memory.
Second aspect, the application provide a kind of server, which includes:
First acquisition unit, for obtaining the user tag description corresponding with user identifier pre-generated for AB test
File；
Second acquisition unit, for obtaining user's mark according to the description file and preset virtual objects example list
Know and the routing iinformation of virtual objects corresponding relationship describes file, the routing iinformation describes to include target user's cluster in file
In user and destination virtual article corresponding relationship；
Unit is read in, for determining that the routing iinformation describes after file meets preset reading condition, described in reading
Routing iinformation describes file；
Assembling unit, the content for the routing iinformation to be described file are assembled into internal structure body, to preset visit
It asks that addition policy interface sends access request, includes the internal structure body in the access request；
Updating unit, for when access strategy interface is to the access request, more using the internal structure body
Subscriber cluster distributing strategy in the new server memory is tested with carrying out the AB of virtual objects distribution according to subscriber cluster.
Preferably, the server further include:
Generation unit, for corresponding with user identifier in the pre-generated user tag for AB test of the acquisition
Before the step of describing file, the user tag description file corresponding with user identifier for AB test is generated.
Preferably, the generation unit is specifically used for
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
It is corresponding with user identifier that user tag is generated according to the user identifier in user tag to be tested and subscriber cluster
File is described.
Preferably, if generating the routing iinformation describes the generation time of file greater than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets preset reading condition.
Preferably, the routing iinformation describes the configuration file that file is json format；
The assembling unit is specifically used for:
Read the json format configuration file；
By different field assignment in the json format configuration file to each object attribute of preset internal structure body
In.
Preferably, the server further includes user feedback unit；
The user feedback unit is used for after carrying out the AB test of virtual objects distribution according to subscriber cluster, is collected and is used
Family behavioural characteristic or user feed back the usage experience of the destination virtual article of distribution；
The updating unit is also used to be fed back according to the user behavior characteristics or the usage experience, adjusts subscriber cluster
Distributing strategy generates new routing iinformation and describes file, updates into the server memory.
As can be seen from the above technical solutions, the embodiment of the present invention has the advantage that
The embodiment of the present invention is by obtaining the user tag description corresponding with user identifier pre-generated for AB test
File；According to the description file and preset virtual objects example list, user identifier and virtual objects corresponding relationship are obtained
Routing iinformation file is described, determining that the routing iinformation describes to read in the road after file meets preset reading condition
File is described by information；The routing iinformation is described into file and is assembled into internal structure body, is connect to preset access addition strategy
Mouth sends access request；When access strategy interface is to the access request, updated using the internal structure body described in
Subscriber cluster distributing strategy in server memory is tested with carrying out the AB of virtual objects distribution according to subscriber cluster.The present invention
Embodiment is directly updated in server memory by dynamic configuration subscriber cluster distributing strategy, therefore subscriber cluster shunts
Strategy can come into force in real time, improve AB accurate testing degree.
Detailed description of the invention
Fig. 1 is one embodiment schematic diagram for the method that scheme is tested in the embodiment of the present invention；
Fig. 2 is one embodiment schematic diagram for the method that scheme is tested in the embodiment of the present invention；
Fig. 3 is one embodiment schematic diagram for the method that scheme is tested in the embodiment of the present invention；
Fig. 4 is the specific schematic diagram of a step of the method that scheme is tested in the embodiment of the present invention；
Fig. 5 is one embodiment schematic diagram of server in the embodiment of the present invention；
Fig. 6 is one embodiment schematic diagram of server in the embodiment of the present invention；
Fig. 7 is one embodiment schematic diagram of server in the embodiment of the present invention.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
The model that the present invention protects all should belong in member's every other embodiment obtained without making creative work
It encloses.
Description and claims of this specification and the (if present)s such as term " first " in above-mentioned attached drawing, " second "
It is to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that the number used in this way
According to being interchangeable under appropriate circumstances, so as to the embodiments described herein can in addition to the content for illustrating or describing herein with
Outer sequence is implemented.In addition, term " includes " and " having " and their any deformation, it is intended that cover non-exclusive packet
Contain, for example, what the process, method, system, product or equipment for containing a series of steps or units were not necessarily limited to be clearly listed
Those step or units, but may include be not clearly listed or it is intrinsic for these process, methods, product or equipment
Other step or units.
As shown in Figure 1, realizing the hardware structure schematic diagram of scene for scheme test in the embodiment of the present invention, the present invention is implemented
The method of scheme test is applied to the gateway server in Fig. 1 in example, and server end may include gateway in the embodiment of the present invention
Two parts of server and application server, gateway server and application server can be a hardware body, be also possible to
Isolated hardware body.Wherein gateway server is connect with application server and user terminal network respectively.
Referring to Fig. 2, the one embodiment for the method that scheme is tested in the embodiment of the present invention includes:
S201, acquisition pre-generate the user tag description file corresponding with user identifier for AB test；
S202, according to the description file and preset virtual objects example list, obtain user identifier and virtual objects
The routing iinformation of corresponding relationship describes file；
Wherein, the routing iinformation describes pair of the user concentrated in file including potential user group and destination virtual article
It should be related to；Target user's cluster is the subscriber cluster of test to be tested, and destination virtual article is that will release wait test test
Virtual product.
S203, determining that the routing iinformation describes to read in the routing iinformation after file meets preset reading condition
File is described；
S204, the content that the routing iinformation describes file is assembled into internal structure body, adds plan to preset access
Slightly interface sends access request；
It wherein, include the internal structure body in the access request；It include the internal structure in the access request
Body；Sending access request to preset access addition policy interface specifically can be, and the gateway server in Fig. 1 is with HTTP interface
Exposure service sends POST request to preset access addition policy interface (HTTP interface), wherein wraps in the POST request body
Contain the distribution policy internal structure body generated in previous step.
S205, when access strategy interface is to the access request, utilize the internal structure body to update the clothes
The subscriber cluster distributing strategy being engaged in device memory is tested with carrying out the AB of virtual objects distribution according to subscriber cluster.
The embodiment of the present invention is by obtaining the user tag description corresponding with user identifier pre-generated for AB test
File；According to the description file and preset virtual objects example list, user identifier and virtual objects corresponding relationship are obtained
Routing iinformation file is described, determining that the routing iinformation describes to read in the road after file meets preset reading condition
File is described by information；The routing iinformation is described into file and is assembled into internal structure body, is connect to preset access addition strategy
Mouth sends access request；When access strategy interface is to the access request, updated using the internal structure body described in
Subscriber cluster distributing strategy in server memory is tested with carrying out the AB of virtual objects distribution according to subscriber cluster.The present invention
Embodiment is directly updated in server memory by dynamic configuration subscriber cluster distributing strategy, therefore subscriber cluster shunts
Strategy can come into force in real time, improve AB accurate testing degree.
Preferably, as shown in figure 3, obtaining the pre-generated user tag and user identifier pair for AB test described
Before the step of description file answered, the method also includes:
S206, the user tag description file corresponding with user identifier tested for AB is generated.
Preferably, as shown in figure 4, the user tag description file corresponding with user identifier generated for AB test
The step of include:
S2061, the user tag to be tested for obtaining testing setup；
S2062, the corresponding subscriber cluster of the user tag to be tested is obtained；
Specifically for example, product team can be according to the user characteristics of website, for the user test experiments side of special characteristic
The validity of case.For example: it needs to increase a value present newly in website direct broadcasting room now, needs to verify the conjunction of amount of money setting
Rationality can obtain the corresponding subscriber cluster of specific label, label includes: to possess specific high-end product according to history payment m odel
Labels, the users for possessing this kind of label in this way such as participants in a bridge game's machine, ability of payment be strong can see new value present in the direct broadcasting room page.
This crowd of user is observed to the paid cases of this new column direct broadcasting room, is analyzed according to service condition of the user to new value present,
Take the circumstances into consideration to judge whether to need to advanced optimize adjustment.
S2063, user tag and user identifier are generated according to the user identifier in user tag to be tested and subscriber cluster
Corresponding description file.
User tag and the corresponding description file, that is, user tag of user identifier description text corresponding with User ID (UID)
Part, a specific data format are as follows:
" tag ": " column A ",
"uid_list":"uid1,uid2,uid3"
}
At this point, obtaining user identifier and virtual objects according to the description file and preset virtual objects example list
The routing iinformation of corresponding relationship, which describes file, can be, can according to the description file and preset virtual objects example list
To obtain the corresponding relationship of each user identifier with corresponding virtual objects, and then obtain user identifier and the corresponding pass of virtual objects
The routing iinformation of system describes file, such as according to user tag description file corresponding with User ID (UID), and online present column
User ID (UID)-present server ID can be calculated in list server example list " routing iinformation file is described,
One embodiment format that the routing iinformation describes file is as follows:
{"RoomGiftMainListServer":"Server_A",
"uid_list":"uid1,uid2,uid3"
}
In the embodiment of the present invention, by the experiment for then passing through Web UI (graphical operation) operation setting specific user's label
Scheme subscriber cluster the subscriber cluster distributing strategy newly configured is written in the data structure of gateway server working region,
The subscriber cluster distributing strategy is allowed to come into force in time, which can be adjusted non-technical by proposition subscriber cluster distributing strategy completely
Colleague's operation, substantially reduces probability of going on business.
Preferably, if generating the routing iinformation describes the generation time of file greater than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets preset reading condition.
Preferably, the routing iinformation describes the configuration file that file is json format；
It is described that the routing iinformation is described into the step of file is assembled into internal structure body, comprising:
Read the json format configuration file；
By different field assignment in the json format configuration file to each object attribute of preset internal structure body
In.
It describes to update the user group in the server memory using the internal structure body with a specific embodiment below
Collect distributing strategy, the detailed process of the AB test of virtual objects distribution is carried out according to subscriber cluster, is utilizing the internal structure
After body updates the subscriber cluster distributing strategy in the server memory, when user passes through user terminal (such as mobile phone or computer
Deng) enter website (such as webpage direct broadcasting room, be described by taking direct broadcasting room as an example below) when, need to request the present class in the room
Type list, the client (Client) in user terminal can submit the HTTP request of URL format to server, which can be advanced
Enter website gateway server (Gateway Server), request routing function is then completed according to information in URL by gateway server
Energy.
Firstly, can learn that the request is to ask according to the relative path (such as/gift/web_list_main) of HTTP request
Seek direct broadcasting room present master list；Secondly, obtaining " User ID (UID)-present server (i.e. application service in Fig. 1 according to UID
Device) ID " routing iinformation, the present server ID for handling the request is then got, user request is distributed to responsible processing
In active user's present server (RoomGiftMainListServer).Then the dissection process request is responsible for by the interface.
If the User ID belongs to experimental program subscriber cluster, need to return the new value present type newly configured, it is no
Then, will continue to return to common present list.Complete the request distribution of this AB test.
In the embodiment of the present invention, the user (user that i.e. above-mentioned target complex is concentrated) for hitting experimental program will use experiment
Website new function that scheme comes into force (such as push destination virtual article), in use can by user behavior characteristics or
Person's feedback function collects user to the usage experience of experiential function, and business team can adjust in time according to the user feedback of collection
Whole experimental program strategy, iteration optimization, constantly improve user experience.
It is i.e. preferred, after carrying out the AB test of virtual objects distribution according to subscriber cluster, the method also includes:
User behavior characteristics or user is collected to feed back the usage experience of the destination virtual article of distribution；
It is fed back according to the user behavior characteristics or the usage experience, adjusts subscriber cluster distributing strategy, generate new
Routing iinformation describes file, updates into the server memory.
The embodiment of server in the embodiment of the present invention is described below, in the embodiment of the present invention described in server, that is, Fig. 1
Gateway server.
Referring to Fig. 5, including: in the server for one embodiment of server in the embodiment of the present invention
First acquisition unit 501, it is corresponding with user identifier for obtaining the user tag for pre-generating and testing for AB
File is described；
Second acquisition unit 502, for obtaining user according to the description file and preset virtual objects example list
The routing iinformation of mark and virtual objects corresponding relationship describes file, and the routing iinformation describes to include potential user group in file
The user of concentration and the corresponding relationship of destination virtual article；
Unit 503 is read in, for determining that the routing iinformation describes to read in institute after file meets preset reading condition
It states routing iinformation and describes file；
Assembling unit 504, the content for the routing iinformation to be described file are assembled into internal structure body, to preset
Access addition policy interface sends access request, includes the internal structure body in the access request；
Updating unit 505, for utilizing the internal structure body when access strategy interface is to the access request
The subscriber cluster distributing strategy in the server memory is updated, is surveyed with carrying out the AB of virtual objects distribution according to subscriber cluster
Examination.
Preferably, the server further include:
Generation unit 506, for obtaining the pre-generated user tag and user identifier pair for AB test described
Before the step of description file answered, the user tag description file corresponding with user identifier for AB test is generated.
Preferably, the generation unit 506 is specifically used for
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
It is corresponding with user identifier that user tag is generated according to the user identifier in user tag to be tested and subscriber cluster
File is described.
Preferably, if generating the routing iinformation describes the generation time of file greater than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets preset reading condition.
Preferably, the routing iinformation describes the configuration file that file is json format；
The assembling unit 504 is specifically used for:
Read the json format configuration file；
By different field assignment in the json format configuration file to each object attribute of preset internal structure body
In.
Preferably, the server further includes user feedback unit 507；
The user feedback unit 507 is used for after carrying out the AB test of virtual objects distribution according to subscriber cluster, is received
Collect user behavior characteristics or user to feed back the usage experience of the destination virtual article of distribution；
The updating unit 505 is also used to be fed back according to the user behavior characteristics or the usage experience, adjusts user
Cluster distributing strategy generates new routing iinformation and describes file, updates into the server memory.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.
Another point, shown or discussed mutual coupling, direct-coupling or communication connection can be by some
The indirect coupling or communication connection of interface, device or unit can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the present invention
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
The above, the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although referring to before
Stating embodiment, invention is explained in detail, those skilled in the art should understand that: it still can be to preceding
Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features；And these
It modifies or replaces, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution.
Claims (10)
1. a kind of method of scheme test, which is characterized in that be applied to server, which comprises
Obtain the user tag description file corresponding with user identifier pre-generated for AB test；
According to the description file and preset virtual objects example list, user identifier and virtual objects corresponding relationship are obtained
Routing iinformation describes file, and the routing iinformation describes the user concentrated in file including potential user group and destination virtual article
Corresponding relationship；
It is greater than last time if generating the routing iinformation and describing generation time of file and reads in routing iinformation when describing the reading of file
Between, then it reads in the routing iinformation and describes file；
The content that the routing iinformation describes file is assembled into internal structure body, is sent to preset access addition policy interface
Access request includes the internal structure body in the access request；
When access strategy interface is to the access request, updated in the server memory using the internal structure body
Subscriber cluster distributing strategy, with according to subscriber cluster carry out virtual objects distribution AB test.
2. the method according to claim 1, wherein obtaining the pre-generated user for AB test described
Before the step of label corresponding with user identifier description file, the method also includes:
Generate the user tag description file corresponding with user identifier for AB test.
3. according to the method described in claim 2, it is characterized in that, described generate is marked for the user tag of AB test and user
The step of knowing corresponding description file include:
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
User tag description corresponding with user identifier is generated according to the user identifier in user tag to be tested and subscriber cluster
File.
4. the method according to claim 1, wherein if generating the generation time that the routing iinformation describes file
The reading time that routing iinformation describes file was read in greater than last time, it is determined that the routing iinformation describes file and meets preset reading
Enter condition.
5. the method according to claim 1, wherein being surveyed in the AB for carrying out virtual objects distribution according to subscriber cluster
After examination, the method also includes:
User behavior characteristics or user is collected to feed back the usage experience of the destination virtual article of distribution；
It is fed back according to the user behavior characteristics or the usage experience, adjusts subscriber cluster distributing strategy, generate new routing
Information describes file, updates into the server memory.
6. a kind of server, which is characterized in that the server includes:
First acquisition unit, for obtaining the user tag description text corresponding with user identifier pre-generated for AB test
Part；
Second acquisition unit, for according to the description file and preset virtual objects example list, obtain user identifier with
The routing iinformation of virtual objects corresponding relationship describes file, and the routing iinformation describes to include what potential user group was concentrated in file
The corresponding relationship of user and destination virtual article；
Unit is read in, if the generation time for describing file for generating the routing iinformation is greater than last time and reads in routing iinformation description
The reading time of file then reads in the routing iinformation and describes file；
Assembling unit, the content for the routing iinformation to be described file are assembled into internal structure body, add to preset access
Add policy interface to send access request, includes the internal structure body in the access request；
Updating unit, for access strategy interface arrive the access request when, utilize the internal structure body update institute
The subscriber cluster distributing strategy in server memory is stated, is tested with carrying out the AB of virtual objects distribution according to subscriber cluster.
7. server according to claim 6, which is characterized in that the server further include:
Generation unit, for obtaining the pre-generated user tag description corresponding with user identifier for AB test described
Before the step of file, the user tag description file corresponding with user identifier for AB test is generated.
8. server according to claim 7, which is characterized in that the generation unit is specifically used for
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
User tag description corresponding with user identifier is generated according to the user identifier in user tag to be tested and subscriber cluster
File.
9. server according to claim 6, which is characterized in that if generate the routing iinformation and describe the generation of file
Between be greater than last time and read in routing iinformation and describe reading time of file, it is determined that the routing iinformation describe file meet it is preset
Reading condition.
10. server according to claim 6, which is characterized in that the server further includes user feedback unit；
The user feedback unit is used for after carrying out the AB test of virtual objects distribution according to subscriber cluster, collects user's row
It is characterized or user feeds back the usage experience of the destination virtual article of distribution；
The updating unit is also used to be fed back according to the user behavior characteristics or the usage experience, and adjustment subscriber cluster shunts
Strategy generates new routing iinformation and describes file, updates into the server memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611116008.XA CN106856439B (en) | 2016-12-07 | 2016-12-07 | A kind of method and server of scheme test |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611116008.XA CN106856439B (en) | 2016-12-07 | 2016-12-07 | A kind of method and server of scheme test |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106856439A CN106856439A (en) | 2017-06-16 |
| CN106856439B true CN106856439B (en) | 2019-08-02 |
Family
ID=59125789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611116008.XA Active CN106856439B (en) | 2016-12-07 | 2016-12-07 | A kind of method and server of scheme test |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106856439B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110008131B (en) * | 2019-04-12 | 2020-08-04 | 重庆天蓬网络有限公司 | Method and device for managing area AB experiment based on algorithm |
| CN110418379A (en) * | 2019-07-23 | 2019-11-05 | 上海易点时空网络有限公司 | Diversion processing method and device for mobile device |
| CN111291100A (en) * | 2020-01-22 | 2020-06-16 | 北京三快在线科技有限公司 | Method and device for generating experimental result data and method and device for requesting experiment |
| CN111651667B (en) * | 2020-04-30 | 2024-06-25 | 中国平安财产保险股份有限公司 | Data push and distribution control method and device and computer readable storage medium |
| CN111831566A (en) * | 2020-07-17 | 2020-10-27 | 北京字节跳动网络技术有限公司 | Test method, test device, electronic equipment and computer readable storage medium |
| CN112162928B (en) * | 2020-10-15 | 2024-03-15 | 网易（杭州）网络有限公司 | Game testing method, game testing device, electronic equipment and computer readable medium |
| CN112269743B (en) * | 2020-10-30 | 2022-04-12 | 湖南快乐阳光互动娱乐传媒有限公司 | A/B test method and device |
| CN113742577A (en) * | 2021-08-10 | 2021-12-03 | 深圳市东信时代信息技术有限公司 | AB test scheme processing method, device, equipment and storage medium based on SaaS |
| CN114490348A (en) * | 2021-12-31 | 2022-05-13 | 医渡云（北京）技术有限公司 | Data debugging method and device, electronic equipment and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101247293A (en) * | 2008-03-11 | 2008-08-20 | 福建星网锐捷网络有限公司 | Automatic test approach and system |
| CN101431447A (en) * | 2008-11-26 | 2009-05-13 | 福建星网锐捷网络有限公司 | Method and apparatus for testing capacity and performance of virtual special network server |
| CN102148716A (en) * | 2010-02-05 | 2011-08-10 | 中国联合网络通信集团有限公司 | Point-to-point system network performance testing method and system thereof |
| CN103577321A (en) * | 2012-08-07 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Multi-version parallel test method for web pages and server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8713440B2 (en) * | 2008-02-13 | 2014-04-29 | Microsoft Corporation | Techniques to manage communications resources for a multimedia conference event |
-
2016
- 2016-12-07 CN CN201611116008.XA patent/CN106856439B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101247293A (en) * | 2008-03-11 | 2008-08-20 | 福建星网锐捷网络有限公司 | Automatic test approach and system |
| CN101431447A (en) * | 2008-11-26 | 2009-05-13 | 福建星网锐捷网络有限公司 | Method and apparatus for testing capacity and performance of virtual special network server |
| CN102148716A (en) * | 2010-02-05 | 2011-08-10 | 中国联合网络通信集团有限公司 | Point-to-point system network performance testing method and system thereof |
| CN103577321A (en) * | 2012-08-07 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Multi-version parallel test method for web pages and server |
Non-Patent Citations (1)
| Title |
|---|
| 《服务器节能认证测试方案》;洪琦;《信息技术与标准化》;20120510;第20-22页 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106856439A (en) | 2017-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106856439B (en) | A kind of method and server of scheme test | |
| CN110599263B (en) | User interaction data processing method and device, storage medium and computer equipment | |
| CN108604222A (en) | System and method for deployment customized machine learning service | |
| CN104301436B (en) | Content to be displayed push, subscription, update method and its corresponding device | |
| CN109863527A (en) | The method and system of the server side rendering of local content for showing | |
| CN105450461B (en) | A kind of shunt method and the network equipment | |
| CN108574706B (en) | Media file pushing method and device | |
| CN102710755A (en) | Data mining method of terminal user social network, correlation method, device and system | |
| US10567265B2 (en) | Solution test method and server | |
| DE112016002221T5 (en) | Systems and methods for dynamic selection of a communication identifier | |
| CN106709033A (en) | Business multimedia data processing method and device | |
| CN108028768A (en) | The method and system of application version is installed by short-range communication | |
| CN102256203A (en) | Terminal research service system, service realization method thereof and mobile terminal | |
| CN101472242A (en) | Business polymerization system and method | |
| CN103581111A (en) | Communication method and system | |
| CN105741141A (en) | Internet-based advertisement promotion method and device | |
| CN106126519A (en) | The methods of exhibiting of media information and server | |
| CN113010255A (en) | Interaction method and device based on binding session group and computer equipment | |
| CN109344173A (en) | Data managing method and device, data structure | |
| CN106383857A (en) | Information processing method and electronic equipment | |
| CN105825333A (en) | Crowdsourcing service system based on anonymous places of cloud platform and task distribution method | |
| CN109754135A (en) | Behavior of credit data processing method, device, storage medium and computer equipment | |
| CN101673279B (en) | For information issuing method and the system thereof of internet search engine | |
| CN113435937B (en) | Advertisement creating method and device | |
| CN108229993A (en) | A kind of method and device of data processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231108 Address after: Room 606-609, Compound Office Complex Building, No. 757, Dongfeng East Road, Yuexiu District, Guangzhou, Guangdong Province, 510699 Patentee after: China Southern Power Grid Internet Service Co.,Ltd. Address before: 430000 East Lake Development Zone, Wuhan City, Hubei Province, No. 1 Software Park East Road 4.1 Phase B1 Building 11 Building Patentee before: WUHAN DOUYU NETWORK TECHNOLOGY Co.,Ltd. |