CN106856439A - The method and server of a kind of scheme test - Google Patents
The method and server of a kind of scheme test Download PDFInfo
- Publication number
- CN106856439A CN106856439A CN201611116008.XA CN201611116008A CN106856439A CN 106856439 A CN106856439 A CN 106856439A CN 201611116008 A CN201611116008 A CN 201611116008A CN 106856439 A CN106856439 A CN 106856439A
- Authority
- CN
- China
- Prior art keywords
- file
- user
- routing iinformation
- server
- describes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 58
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000009826 distribution Methods 0.000 claims abstract description 20
- 230000006399 behavior Effects 0.000 claims description 15
- 238000005516 engineering process Methods 0.000 abstract description 3
- 230000008569 process Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 8
- 238000002474 experimental method Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 239000000047 product Substances 0.000 description 6
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000002224 dissection Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000007795 chemical reaction product Substances 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5009—Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses the method and server of a kind of test of scheme, for field of computer technology.Present invention method includes：Acquisition previously generates the user tag description file corresponding with ID for AB tests；According to description file and the default virtual objects example list, the routing iinformation for obtaining ID and virtual objects corresponding relation describes file, it is determined that the routing iinformation describes after file meets default reading condition, to read in the routing iinformation and describe file；The routing iinformation is described into file and is assembled into internal structure body, access request is sent to preset access addition policy interface；When access strategy interface is to the access request, the subscriber cluster distributing strategy in the server memory is updated using the internal structure body, tested with the AB that virtual objects distribution is carried out according to subscriber cluster.The embodiment of the present invention is directly updated by dynamic configuration subscriber cluster distributing strategy in server memory, therefore subscriber cluster distributing strategy can come into force in real time, improve AB accurate testing degree.
Description
Technical field
The present invention relates to field of computer technology, the method and server of more particularly to a kind of scheme test.
Background technology
So-called AB tests, it is two schemes of same target making (such as two pages) to be exactly, and allows a part of user to make
A schemes are used, another part user uses B schemes, records the service condition of user, sees which scheme more meets design object.
In net cast website, in order to be lifted at the Consumer's Experience during watching video live broadcast, website can be continually
Product and system are adjusted by various methods and strategy, at this moment needs quickly to obtain user feedback, so can be to new
The effect of scheme makes adjustment in time, and the feedback data according to user goes iteration update scheme, if user is to product and system
Scheme feedback result it is undesirable, or even need to abandon current new departure in time, thus AB tests in video living transmission system just
Seem extremely important, be the key foundation of data-driven product.
In AB testing process, can be while parallel two sets of plan：Control (reference scheme) and Treatment (experiment sides
Case), the process that comes into force of experimental program is shorter, and " experimental program subscriber cluster (Treatment User Set) " is on probation to new departure
Feedback can be more accurate.During the coming into force of experimental program, inflow and loss of the user in website be it is completely unpredictable,
Need the entry-into-force time of the shortening experimental program in test.Also, for net cast class website, new departure adjustment is frequent, AB
Test frequency is high, so seems increasingly important for the friendliness that AB test systems are used, and so can not only allow more
Non-technical personnel is participated in AB test process, and can reduce the error probability of AB Test Strategies.
Generally in AB tests, obtain experimental program subscriber cluster and to allow the subscriber cluster to come into force immediately of crucial importance.
Net cast field, to the user behavior mainly according to user on website of user's portrait, including：User's viewing behavior,
Barrage information, concern behavior, present give the information such as behavior, user geographical position, user equipment, according to specific data mould
Type, various labels is stamped to user, for example：It is big to certain money game viewing time accounting, then stamp certain money game severe to user
Viewing label；It is accustomed to sending barrage in watching video live broadcast, then stamps many barrage labels to this kind of user, and according to barrage amount
How much, segment out more users label.In short, obtaining experimental program subscriber cluster by label, experiment can be more precisely assessed
The effect of scheme.
In net cast website, when specific function request response contents are triggered, client (Client) can be to service
Device submits HTTP request to, and the request can be introduced into web gateway server (Gateway Server), then by gateway server
Request routing function is completed according to information in URL.Then the user's request is distributed to the function of being responsible for processing active user to connect
In mouthful.Then the dissection process request is responsible for by functional interface.How efficiently the routing rule of configuration user's request shows in time
Obtain increasingly important.
Existing AB method of testings, if necessary to modification " experimental program subscriber cluster (Treatment User Set) ",
The demand for having distributed modification subscriber cluster by operational department is generally required, then statistical separates out satisfaction according to demand by data team
User's collection of demand, gives " systemic-function " research and development department, will count the user's collection for obtaining and imported into functional interface, or even needs
Again the systemic-function application is issued so that the new subscriber cluster for importing can as early as possible give birth in the follow-up user's request for entering
Effect.Whole process, what is be related to is overstaffed, and complex operation, distribution policy easily malfunctions, and the process that comes into force is long.
The content of the invention
The embodiment of the invention provides the method and server of a kind of scheme test, dynamic configuration subscriber cluster distributing strategy
And directly updated in server memory so that subscriber cluster distributing strategy can come into force in real time, improve AB accurate testing degree.
In a first aspect, the application provided a kind of method of scheme test, the method is applied to server, the method bag
Include：
Acquisition previously generates the user tag description file corresponding with ID for AB tests；
According to description file and the default virtual objects example list, ID pass corresponding with virtual objects is obtained
The routing iinformation of system describes file, and the routing iinformation describes file includes user and the destination virtual of potential user group concentration
The corresponding relation of article；
It is determined that the routing iinformation describes after file meets default reading condition, to read in the routing iinformation description text
Part；
The content that the routing iinformation describes file is assembled into internal structure body, policy interface is added to preset access
Access request is sent, the access request includes the internal structure body；
When access strategy interface is to the access request, updated in the server using the internal structure body
Subscriber cluster distributing strategy in depositing, is tested with the AB that virtual objects distribution is carried out according to subscriber cluster.
Preferably, in the description text corresponding with ID of the user tag for AB tests for obtaining and previously generating
Before the step of part, methods described also includes：
Generate the user tag description file corresponding with ID for AB tests.
Preferably, it is described generate for AB test user tag it is corresponding with ID description file the step of bag
Include：
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
ID generation user tag in user tag to be tested and subscriber cluster is corresponding with ID
Description file.
Preferably, if generating the routing iinformation describes the generation time of file more than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets default reading condition.
Preferably, the routing iinformation describes the configuration file that file is json forms；
It is described the step of the routing iinformation is described into file be assembled into internal structure body, including：
Read the json format configuration files；
By each object attribute of the different field assignment to default internal structure body in the json format configuration files
In.
Preferably, after the AB that virtual objects distribution is carried out according to subscriber cluster is tested, methods described also includes：
Collect the experience feedback of the destination virtual article of user behavior feature or user to distributing；
Fed back according to the user behavior feature or the experience, adjust subscriber cluster distributing strategy, generated new
Routing iinformation describes file, updates in the server memory.
Second aspect, the application provides a kind of server, and the server includes：
First acquisition unit, for obtaining the user tag description corresponding with ID previously generated for AB tests
File；
Second acquisition unit, for according to description file and the default virtual objects example list, obtaining user's mark
Know and the routing iinformation of virtual objects corresponding relation describes file, the routing iinformation describes file includes targeted customer's cluster
In user and destination virtual article corresponding relation；
Unit is read in, for it is determined that the routing iinformation describes after file meets default reading condition, to read in described
Routing iinformation describes file；
Module units, the content for the routing iinformation to be described file is assembled into internal structure body, to preset visit
Ask that addition policy interface sends access request, the access request includes the internal structure body；
Updating block, for when access strategy interface is to the access request, using the internal structure body more
Subscriber cluster distributing strategy in the new server memory, is tested with the AB that virtual objects distribution is carried out according to subscriber cluster.
Preferably, the server also includes：
Generation unit, the user tag for AB tests for being previously generated in the acquisition is corresponding with ID
Before the step of description file, the user tag description file corresponding with ID for AB tests is generated.
Preferably, the generation unit specifically for
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
ID generation user tag in user tag to be tested and subscriber cluster is corresponding with ID
Description file.
Preferably, if generating the routing iinformation describes the generation time of file more than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets default reading condition.
Preferably, the routing iinformation describes the configuration file that file is json forms；
The module units specifically for：
Read the json format configuration files；
By each object attribute of the different field assignment to default internal structure body in the json format configuration files
In.
Preferably, the server also includes user feedback unit；
The user feedback unit is used for after the AB that virtual objects distribution is carried out according to subscriber cluster is tested, and collects and uses
The experience feedback of the destination virtual article of family behavioural characteristic or user to distributing；
The updating block is additionally operable to be fed back according to the user behavior feature or the experience, adjusts subscriber cluster
Distributing strategy, generates new routing iinformation and describes file, updates in the server memory.
As can be seen from the above technical solutions, the embodiment of the present invention has advantages below：
The embodiment of the present invention previously generates the user tag description corresponding with ID tested for AB by obtaining
File；According to description file and the default virtual objects example list, ID and virtual objects corresponding relation are obtained
Routing iinformation file is described, it is determined that the routing iinformation describes after file meets default reading condition, to read in the road
File is described by information；The routing iinformation is described into file and is assembled into internal structure body, connect to preset access addition strategy
Mouth sends access request；When access strategy interface is to the access request, update described using the internal structure body
Subscriber cluster distributing strategy in server memory, is tested with the AB that virtual objects distribution is carried out according to subscriber cluster.The present invention
Embodiment is directly updated by dynamic configuration subscriber cluster distributing strategy in server memory, therefore subscriber cluster is shunted
Strategy can come into force in real time, improve AB accurate testing degree.
Brief description of the drawings
Fig. 1 is one embodiment schematic diagram of the method for scheme test in the embodiment of the present invention；
Fig. 2 is one embodiment schematic diagram of the method for scheme test in the embodiment of the present invention；
Fig. 3 is one embodiment schematic diagram of the method for scheme test in the embodiment of the present invention；
Fig. 4 is the specific schematic diagram of a step of the method for scheme test in the embodiment of the present invention；
Fig. 5 is one embodiment schematic diagram of server in the embodiment of the present invention；
Fig. 6 is one embodiment schematic diagram of server in the embodiment of the present invention；
Fig. 7 is one embodiment schematic diagram of server in the embodiment of the present invention.
Specific embodiment
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention
Accompanying drawing, is clearly and completely described to the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only
The embodiment of a part of the invention, rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people
The every other embodiment that member is obtained under the premise of creative work is not made, should all belong to the model of present invention protection
Enclose.
The (if present)s such as term " first ", " second " in description and claims of this specification and above-mentioned accompanying drawing
It is for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that the number for so using
According to can exchange in the appropriate case, so as to the embodiments described herein can with except the content for illustrating herein or describing with
Outer order is implemented.Additionally, term " comprising " and " having " and their any deformation, it is intended that the non-exclusive bag of covering
Contain, for example, the process, method, system, product or the equipment that contain series of steps or unit are not necessarily limited to what is clearly listed
Those steps or unit, but may include not listing clearly or intrinsic for these processes, method, product or equipment
Other steps or unit.
As shown in figure 1, in the embodiment of the present invention scheme test realize the hardware structure schematic diagram of scene, the present invention is implemented
The method of scheme test is applied to the gateway server in Fig. 1 in example, and server end can include gateway in the embodiment of the present invention
Two parts of server and application server, gateway server and application server can be a hardware body, or
The hardware body of separation.Wherein gateway server is connected with application server and user terminal network respectively.
Fig. 2 is referred to, one embodiment of the method for scheme test includes in the embodiment of the present invention：
S201, acquisition previously generate the user tag description file corresponding with ID for AB tests；
S202, according to it is described description file and default virtual objects example list, obtain ID and virtual objects
The routing iinformation of corresponding relation describes file；
Wherein, the routing iinformation describes file includes that the user of potential user group concentration is right with destination virtual article
Should be related to；Targeted customer's cluster is to treat the subscriber cluster of experiment test, destination virtual article be will release treat experiment test
Virtual product.
S203, it is determined that the routing iinformation describes after file meets default reading condition, to read in the routing iinformation
Description file；
S204, the content that the routing iinformation describes file is assembled into internal structure body, plan is added to preset access
Slightly interface sends access request；
Wherein, the access request includes the internal structure body；The access request includes the internal structure
Body；It can be specifically that the gateway server in Fig. 1 is with HTTP interface to send access request to preset access addition policy interface
Exposure service, adds policy interface (HTTP interface) and sends POST request to preset access, is wrapped wherein in the POST request body
Contain the distribution policy internal structure body generated in previous step.
S205, when access strategy interface is to the access request, update the clothes using the internal structure body
Subscriber cluster distributing strategy in business device internal memory, is tested with the AB that virtual objects distribution is carried out according to subscriber cluster.
The embodiment of the present invention previously generates the user tag description corresponding with ID tested for AB by obtaining
File；According to description file and the default virtual objects example list, ID and virtual objects corresponding relation are obtained
Routing iinformation file is described, it is determined that the routing iinformation describes after file meets default reading condition, to read in the road
File is described by information；The routing iinformation is described into file and is assembled into internal structure body, connect to preset access addition strategy
Mouth sends access request；When access strategy interface is to the access request, update described using the internal structure body
Subscriber cluster distributing strategy in server memory, is tested with the AB that virtual objects distribution is carried out according to subscriber cluster.The present invention
Embodiment is directly updated by dynamic configuration subscriber cluster distributing strategy in server memory, therefore subscriber cluster is shunted
Strategy can come into force in real time, improve AB accurate testing degree.
Preferably, as shown in figure 3, in the user tag and ID pair for AB tests for obtaining and previously generating
Before the step of description file answered, methods described also includes：
S206, generate for AB test user tag description file corresponding with ID.
Preferably, as shown in figure 4, the user tag description file corresponding with ID generated for AB tests
The step of include：
S2061, the user tag to be tested for obtaining testing setup；
S2062, obtain the corresponding subscriber cluster of the user tag to be tested；
Specifically for example, product team can be according to the user characteristics of website, for the user test experiment side of special characteristic
The validity of case.Illustrate：Need now in the newly-increased value present of website direct broadcasting room, it is necessary to verify the conjunction that the amount of money is set
Rationality, can obtain the corresponding subscriber cluster of specific label according to history payment m odel, and label includes：Possess specific high-end product
The label such as participants in a bridge game's machine, ability of payment be strong, the user for so possessing this kind of label can see new value present in the direct broadcasting room page.
Paid cases of this crowd of user to this new column direct broadcasting room are observed, the service condition analysis according to user to new value present,
Take the circumstances into consideration to judge whether that needs do further to optimize and revise.
S2063, ID generation user tag and ID in user tag to be tested and subscriber cluster
Corresponding description file.
User tag description file corresponding with ID is user tag description text corresponding with ID (UID)
Part, a specific data form is as follows：
{"tag":" column A ",
"uid_list":"uid1,uid2,uid3"
}
Now, according to description file and the default virtual objects example list, ID and virtual objects are obtained
The routing iinformation of corresponding relation describes file, according to description file and the default virtual objects example list, can
To obtain the corresponding relation of each ID and corresponding virtual objects, and then obtain ID pass corresponding with virtual objects
The routing iinformation of system describes file, such as according to user tag description file corresponding with ID (UID), and online present row
List server example list, can calculate ID (UID)-present server ID " routing iinformation file is described,
One embodiment form that the routing iinformation describes file is as follows：
{"RoomGiftMainListServer":"Server_A",
"uid_list":"uid1,uid2,uid3"
}
In the embodiment of the present invention, by the experiment for then passing through Web UI (graphical operation) operation setting specific user's label
Scheme subscriber cluster, in the data structure of the subscriber cluster distributing strategy write-in gateway server working region that will newly configure,
The subscriber cluster distributing strategy is allowed to come into force in time, the non-technical that the process can be adjusted by proposition subscriber cluster distributing strategy completely
Colleague's operation, substantially reduces probability of going on business.
Preferably, if generating the routing iinformation describes the generation time of file more than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets default reading condition.
Preferably, the routing iinformation describes the configuration file that file is json forms；
It is described the step of the routing iinformation is described into file be assembled into internal structure body, including：
Read the json format configuration files；
By each object attribute of the different field assignment to default internal structure body in the json format configuration files
In.
Update the customer group in the server memory using the internal structure body with specific embodiment description below
Collection distributing strategy, the detailed process that the AB for carrying out virtual objects distribution according to subscriber cluster is tested is utilizing the internal structure
Body is updated after the subscriber cluster distributing strategy in the server memory, when user is by user terminal (such as mobile phone or computer
Deng) enter website (such as webpage direct broadcasting room is described by taking direct broadcasting room as an example below) when, it is necessary to ask the present class in the room
Type list, the client (Client) in user terminal can submit the HTTP request of URL format to server, and the request can be advanced
Enter website gateway server (Gateway Server), request route work(is then completed according to information in URL by gateway server
Energy.
First, according to HTTP request relative path (such as/gift/web_list_main), can learn that the request is to ask
Seek direct broadcasting room present master list；Secondly, " ID (UID)-present server (i.e. application service in Fig. 1 is obtained according to UID
Device) ID " routing iinformation, the present server ID for processing the request is then got, the user's request is distributed to responsible treatment
In active user's present server (RoomGiftMainListServer).Then the dissection process request is responsible for by the interface.
If the ID belongs to experimental program subscriber cluster, need to return to the new value present type of new configuration, it is no
Then, will continue to return to common present list.Complete the request distribution of this AB tests.
In the embodiment of the present invention, the user (user that i.e. above-mentioned target complex is concentrated) for hitting experimental program can use experiment
Website New function that scheme comes into force (for example pushes destination virtual article), in use can by user behavior feature or
Person's feedback function, collects experience of the user to experiential function, and business team can adjust in time according to the user feedback collected
Whole experimental program strategy, iteration optimization, constantly improve Consumer's Experience.
I.e. preferred, after the AB that virtual objects distribution is carried out according to subscriber cluster is tested, methods described also includes：
Collect the experience feedback of the destination virtual article of user behavior feature or user to distributing；
Fed back according to the user behavior feature or the experience, adjust subscriber cluster distributing strategy, generated new
Routing iinformation describes file, updates in the server memory.
The embodiment of server in the embodiment of the present invention is described below, server is described in Fig. 1 in the embodiment of the present invention
Gateway server.
Fig. 5 is referred to, is one embodiment of server in the embodiment of the present invention, the server includes：
First acquisition unit 501, previously generates corresponding with ID for the user tag of AB tests for acquisition
Description file；
Second acquisition unit 502, for according to description file and the default virtual objects example list, obtaining user
The routing iinformation of mark and virtual objects corresponding relation describes file, and the routing iinformation describes file includes potential user group
The user of concentration and the corresponding relation of destination virtual article；
Unit 503 is read in, for it is determined that the routing iinformation describes after file meets default reading condition, to read in institute
State routing iinformation and describe file；
Module units 504, the content for the routing iinformation to be described file is assembled into internal structure body, to preset
Access addition policy interface and send access request, the access request includes the internal structure body；
Updating block 505, for when access strategy interface is to the access request, using the internal structure body
The subscriber cluster distributing strategy in the server memory is updated, is surveyed with the AB that virtual objects distribution is carried out according to subscriber cluster
Examination.
Preferably, the server also includes：
Generation unit 506, for obtaining the user tag and ID pair for the AB tests that previously generate described
Before the step of description file answered, the user tag description file corresponding with ID for AB tests is generated.
Preferably, the generation unit 506 specifically for
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
ID generation user tag in user tag to be tested and subscriber cluster is corresponding with ID
Description file.
Preferably, if generating the routing iinformation describes the generation time of file more than last time reading routing iinformation description text
The reading time of part, it is determined that the routing iinformation describes file and meets default reading condition.
Preferably, the routing iinformation describes the configuration file that file is json forms；
The module units 504 specifically for：
Read the json format configuration files；
By each object attribute of the different field assignment to default internal structure body in the json format configuration files
In.
Preferably, the server also includes user feedback unit 507；
The user feedback unit 507 is used for after the AB that virtual objects distribution is carried out according to subscriber cluster is tested, and receives
The experience feedback of the destination virtual article of collection user behavior feature or user to distributing；
The updating block 505 is additionally operable to be fed back according to the user behavior feature or the experience, adjusts user
Cluster distributing strategy, generates new routing iinformation and describes file, updates in the server memory.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method can be with
Realize by another way.For example, device embodiment described above is only schematical, for example, the unit
Divide, only a kind of division of logic function there can be other dividing mode when actually realizing, for example multiple units or component
Can combine or be desirably integrated into another system, or some features can be ignored, or do not perform.
Another, shown or discussed coupling or direct-coupling or communication connection each other can be by some
The INDIRECT COUPLING of interface, device or unit or communication connection, can be electrical, mechanical or other forms.
The unit that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be according to the actual needs selected to realize the mesh of this embodiment scheme
's.
In addition, during each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.Above-mentioned integrated list
Unit can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If the integrated unit is to realize in the form of SFU software functional unit and as independent production marketing or use
When, can store in a computer read/write memory medium.Based on such understanding, technical scheme is substantially
The part for being contributed to prior art in other words or all or part of the technical scheme can be in the form of software products
Embody, the computer software product is stored in a storage medium, including some instructions are used to so that a computer
Equipment (can be personal computer, server, or network equipment etc.) performs the complete of each embodiment methods described of the invention
Portion or part steps.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can store journey
The medium of sequence code.
The above, the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although with reference to preceding
Embodiment is stated to be described in detail the present invention, it will be understood by those within the art that：It still can be to preceding
State the technical scheme described in each embodiment to modify, or equivalent is carried out to which part technical characteristic；And these
Modification is replaced, and does not make the spirit and scope of the essence disengaging various embodiments of the present invention technical scheme of appropriate technical solution.
Claims (10)
1. a kind of method that scheme is tested, it is characterised in that be applied to server, methods described includes：
Acquisition previously generates the user tag description file corresponding with ID for AB tests；
According to description file and the default virtual objects example list, ID and virtual objects corresponding relation are obtained
Routing iinformation describes file, and the routing iinformation describes file includes user and the destination virtual article of potential user group concentration
Corresponding relation；
It is determined that the routing iinformation describes after file meets default reading condition, to read in the routing iinformation and describe file；
The content that the routing iinformation describes file is assembled into internal structure body, is sent to preset access addition policy interface
Access request, the access request includes the internal structure body；
When access strategy interface is to the access request, using in the internal structure body renewal server memory
Subscriber cluster distributing strategy, tested with the AB for carrying out according to subscriber cluster virtual objects distribution.
2. method according to claim 1, it is characterised in that in the user for AB tests for obtaining and previously generating
Label it is corresponding with ID description file the step of before, methods described also includes：
Generate the user tag description file corresponding with ID for AB tests.
3. method according to claim 2, it is characterised in that the generation is used for the user tag of AB tests and user marks
The step of knowing corresponding description file includes：
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
ID generation user tag description corresponding with ID in user tag to be tested and subscriber cluster
File.
4. method according to claim 1, it is characterised in that if generating the generation time that the routing iinformation describes file
The reading time that routing iinformation describes file was read in more than last time, it is determined that the routing iinformation describes file and meets default reading
Enter condition.
5. method according to claim 1, it is characterised in that surveyed in the AB that virtual objects distribution is being carried out according to subscriber cluster
After examination, methods described also includes：
Collect the experience feedback of the destination virtual article of user behavior feature or user to distributing；
Fed back according to the user behavior feature or the experience, adjust subscriber cluster distributing strategy, generate new route
Information describes file, updates in the server memory.
6. a kind of server, it is characterised in that the server includes：
First acquisition unit, for obtaining the user tag description text corresponding with ID previously generated for AB tests
Part；
Second acquisition unit, for according to it is described description file and default virtual objects example list, obtain ID and
The routing iinformation of virtual objects corresponding relation describes file, and the routing iinformation describes file includes what potential user group was concentrated
User and the corresponding relation of destination virtual article；
Unit is read in, for it is determined that the routing iinformation describes after file meets default reading condition, to read in the route
Information describes file；
Module units, the content for the routing iinformation to be described file is assembled into internal structure body, adds to preset access
Plus policy interface sends access request, the access request includes the internal structure body；
Updating block, for when access strategy interface is to the access request, institute being updated using the internal structure body
The subscriber cluster distributing strategy in server memory is stated, is tested with the AB that virtual objects distribution is carried out according to subscriber cluster.
7. server according to claim 6, it is characterised in that the server also includes：
Generation unit, for obtaining the user tag description corresponding with ID for AB tests for previously generating described
Before the step of file, the user tag description file corresponding with ID for AB tests is generated.
8. server according to claim 7, it is characterised in that the generation unit specifically for
Obtain the user tag to be tested of testing setup；
Obtain the corresponding subscriber cluster of the user tag to be tested；
ID generation user tag description corresponding with ID in user tag to be tested and subscriber cluster
File.
9. server according to claim 6, it is characterised in that if generate the routing iinformation and describe the generation of file
Between read in routing iinformation more than last time and describe reading time of file, it is determined that the routing iinformation describes file and meets default
Reading condition.
10. server according to claim 6, it is characterised in that the server also includes user feedback unit；
The user feedback unit is used for after the AB that virtual objects distribution is carried out according to subscriber cluster is tested, and collects user's row
It is characterized or user feeds back to the experience of the destination virtual article of distribution；
The updating block is additionally operable to be fed back according to the user behavior feature or the experience, adjustment subscriber cluster shunting
Strategy, generates new routing iinformation and describes file, updates in the server memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611116008.XA CN106856439B (en) | 2016-12-07 | 2016-12-07 | A kind of method and server of scheme test |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611116008.XA CN106856439B (en) | 2016-12-07 | 2016-12-07 | A kind of method and server of scheme test |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106856439A true CN106856439A (en) | 2017-06-16 |
| CN106856439B CN106856439B (en) | 2019-08-02 |
Family
ID=59125789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611116008.XA Active CN106856439B (en) | 2016-12-07 | 2016-12-07 | A kind of method and server of scheme test |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106856439B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110008131A (en) * | 2019-04-12 | 2019-07-12 | 重庆天蓬网络有限公司 | A kind of method and device for the region AB experiment management realized based on algorithm |
| CN110418379A (en) * | 2019-07-23 | 2019-11-05 | 上海易点时空网络有限公司 | Diversion processing method and device for mobile device |
| CN111291100A (en) * | 2020-01-22 | 2020-06-16 | 北京三快在线科技有限公司 | Method and device for generating experimental result data and method and device for requesting experiment |
| CN111651667A (en) * | 2020-04-30 | 2020-09-11 | 中国平安财产保险股份有限公司 | Data pushing and shunting control method and device and computer readable storage medium |
| CN111831566A (en) * | 2020-07-17 | 2020-10-27 | 北京字节跳动网络技术有限公司 | Test method, test device, electronic equipment and computer readable storage medium |
| CN112162928A (en) * | 2020-10-15 | 2021-01-01 | 网易（杭州）网络有限公司 | Game testing method and device, electronic equipment and computer readable medium |
| CN112269743A (en) * | 2020-10-30 | 2021-01-26 | 湖南快乐阳光互动娱乐传媒有限公司 | A/B test method and device |
| CN113742577A (en) * | 2021-08-10 | 2021-12-03 | 深圳市东信时代信息技术有限公司 | AB test scheme processing method, device, equipment and storage medium based on SaaS |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101247293A (en) * | 2008-03-11 | 2008-08-20 | 福建星网锐捷网络有限公司 | Automatic test approach and system |
| CN101431447A (en) * | 2008-11-26 | 2009-05-13 | 福建星网锐捷网络有限公司 | Method and apparatus for testing capacity and performance of virtual special network server |
| US20090204922A1 (en) * | 2008-02-13 | 2009-08-13 | Microsoft Corporation | Techniques to manage communications resources for a multimedia conference event |
| CN102148716A (en) * | 2010-02-05 | 2011-08-10 | 中国联合网络通信集团有限公司 | Point-to-point system network performance testing method and system thereof |
| CN103577321A (en) * | 2012-08-07 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Multi-version parallel test method for web pages and server |
-
2016
- 2016-12-07 CN CN201611116008.XA patent/CN106856439B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090204922A1 (en) * | 2008-02-13 | 2009-08-13 | Microsoft Corporation | Techniques to manage communications resources for a multimedia conference event |
| CN101247293A (en) * | 2008-03-11 | 2008-08-20 | 福建星网锐捷网络有限公司 | Automatic test approach and system |
| CN101431447A (en) * | 2008-11-26 | 2009-05-13 | 福建星网锐捷网络有限公司 | Method and apparatus for testing capacity and performance of virtual special network server |
| CN102148716A (en) * | 2010-02-05 | 2011-08-10 | 中国联合网络通信集团有限公司 | Point-to-point system network performance testing method and system thereof |
| CN103577321A (en) * | 2012-08-07 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Multi-version parallel test method for web pages and server |
Non-Patent Citations (1)
| Title |
|---|
| 洪琦: "《服务器节能认证测试方案》", 《信息技术与标准化》 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110008131A (en) * | 2019-04-12 | 2019-07-12 | 重庆天蓬网络有限公司 | A kind of method and device for the region AB experiment management realized based on algorithm |
| CN110008131B (en) * | 2019-04-12 | 2020-08-04 | 重庆天蓬网络有限公司 | Method and device for managing area AB experiment based on algorithm |
| CN110418379A (en) * | 2019-07-23 | 2019-11-05 | 上海易点时空网络有限公司 | Diversion processing method and device for mobile device |
| CN111291100A (en) * | 2020-01-22 | 2020-06-16 | 北京三快在线科技有限公司 | Method and device for generating experimental result data and method and device for requesting experiment |
| CN111651667A (en) * | 2020-04-30 | 2020-09-11 | 中国平安财产保险股份有限公司 | Data pushing and shunting control method and device and computer readable storage medium |
| CN111651667B (en) * | 2020-04-30 | 2024-06-25 | 中国平安财产保险股份有限公司 | Data push and distribution control method and device and computer readable storage medium |
| CN111831566A (en) * | 2020-07-17 | 2020-10-27 | 北京字节跳动网络技术有限公司 | Test method, test device, electronic equipment and computer readable storage medium |
| CN112162928A (en) * | 2020-10-15 | 2021-01-01 | 网易（杭州）网络有限公司 | Game testing method and device, electronic equipment and computer readable medium |
| CN112162928B (en) * | 2020-10-15 | 2024-03-15 | 网易（杭州）网络有限公司 | Game testing method, game testing device, electronic equipment and computer readable medium |
| CN112269743A (en) * | 2020-10-30 | 2021-01-26 | 湖南快乐阳光互动娱乐传媒有限公司 | A/B test method and device |
| CN112269743B (en) * | 2020-10-30 | 2022-04-12 | 湖南快乐阳光互动娱乐传媒有限公司 | A/B test method and device |
| CN113742577A (en) * | 2021-08-10 | 2021-12-03 | 深圳市东信时代信息技术有限公司 | AB test scheme processing method, device, equipment and storage medium based on SaaS |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106856439B (en) | 2019-08-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106856439B (en) | A kind of method and server of scheme test | |
| CN104487963B (en) | Methods and apparatus to collect distributed user information for media impressions and search terms | |
| CN104933049B (en) | Generate the method and system of Digital Human | |
| CN108574706B (en) | Media file pushing method and device | |
| CN110462604A (en) | The data processing system and method for association internet device are used based on equipment | |
| CN108255847A (en) | Page generation method and device | |
| CN102710755A (en) | Data mining method of terminal user social network, correlation method, device and system | |
| CN108475249A (en) | Distributed, decentralized data polymerization | |
| CN107220837A (en) | A kind of destination object source tracing method and device | |
| US20100131335A1 (en) | User interest mining method based on user behavior sensed in mobile device | |
| CN101636725A (en) | Collecting information about a user's media collections from multiple login points | |
| DE112016002221T5 (en) | Systems and methods for dynamic selection of a communication identifier | |
| CN103069413A (en) | Customizing content displayed for a user based on user preferences of another user | |
| CN111641629B (en) | Abnormal behavior detection method, device, equipment and storage medium | |
| CN102256203A (en) | Terminal research service system, service realization method thereof and mobile terminal | |
| CN110210858A (en) | A kind of air control guard system design method based on intelligent terminal identification | |
| CN109447685A (en) | Product data method for pushing, device and computer equipment based on machine learning | |
| CN101364928A (en) | Method and system enhancing network information resource distribution | |
| CN104700197A (en) | Electronic donation processing method and system | |
| CN110472154A (en) | A kind of resource supplying method, apparatus, electronic equipment and readable storage medium storing program for executing | |
| CN107784522A (en) | Mobile advertising user management system | |
| CN110247974A (en) | Information-pushing method, device, computer and storage medium based on block chain | |
| WO2022134424A1 (en) | Service flow processing method and apparatus, and computer device and storage medium | |
| CN113010255A (en) | Interaction method and device based on binding session group and computer equipment | |
| CN106202371A (en) | The processing method of media file, device and advertisement analysis method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231108 Address after: Room 606-609, Compound Office Complex Building, No. 757, Dongfeng East Road, Yuexiu District, Guangzhou, Guangdong Province, 510699 Patentee after: China Southern Power Grid Internet Service Co.,Ltd. Address before: 430000 East Lake Development Zone, Wuhan City, Hubei Province, No. 1 Software Park East Road 4.1 Phase B1 Building 11 Building Patentee before: WUHAN DOUYU NETWORK TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |