CN109101425A - A kind of index of the page AB test of mobilism buries point methods and device - Google Patents

A kind of index of the page AB test of mobilism buries point methods and device Download PDF

Info

Publication number
CN109101425A
CN109101425A CN201810923957.1A CN201810923957A CN109101425A CN 109101425 A CN109101425 A CN 109101425A CN 201810923957 A CN201810923957 A CN 201810923957A CN 109101425 A CN109101425 A CN 109101425A
Authority
CN
China
Prior art keywords
page
block
information
mobilism
mark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810923957.1A
Other languages
Chinese (zh)
Other versions
CN109101425B (en
Inventor
沈开心
汪凡
张繁
陈世爵
肖庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced Nova Technology Singapore Holdings Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201810923957.1A priority Critical patent/CN109101425B/en
Publication of CN109101425A publication Critical patent/CN109101425A/en
Application granted granted Critical
Publication of CN109101425B publication Critical patent/CN109101425B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/362Software debugging
    • G06F11/3636Software debugging by tracing the execution of the program

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A kind of page AB test method and device of mobilism.In one embodiment, method includes: that client sends page request, and page request includes customer parameter;Receive page instance, the page instance includes multiple blocks, at least one block in multiple blocks respectively carries statistics mark, and statistics mark is for showing that the statistics mark buries an arrangement to the user's operation behavior occurred on corresponding block for showing;Based on page instance, the page is rendered;When the page operation behavior for the block for having statistics to identify occurs on the page, User operation log, the corresponding statistics mark of the User operation log block are generated.This specification embodiment need not change client and server-side code, so that it may easily add AB experiment, the index for completing AB test is buried a little and calculated, and the efficiency of page AB test is greatly improved.

Description

A kind of index of the page AB test of mobilism buries point methods and device
Technical field
This specification embodiment be related to data collecting field more particularly to a kind of page AB test index bury point methods and Device.
Background technique
Page AB test is a kind of testing scheme for promoting page product index (such as clicking rate).It specifically, is net Page (Web) or the application interface (App) or process production two (A/B) or multiple (A/B/n) versions;In same time dimension, divide Do not allow the same or similar these versions of visitor group random access of constituent;Collect the user experience data and industry of each group Business data, ultimate analysis evaluate best version and formally use.Bury be a little captured for user behavior or event, handle and The relevant technologies of transmission facilitate the acquisition of user experience data and business datum.
In traditional page AB test based on immobilized substance, index buries the complexity of process a little, and each AB test is required to Again it buries a little, develops again, change requires to send out version again every time.
In order to test out the page versions for more meeting user experience, while the efficiency of research and development is promoted, it is therefore desirable to have more Efficient test method and efficiency.
Summary of the invention
According in a first aspect, providing a kind of page AB test method of mobilism, the method is by client implementation.It is described Method includes: to send page request to server, and page request includes customer parameter;The page of first page is received from server Example, the first page by the server based on the customer parameter from participate in page AB test at least two pages in It selects, the page instance includes multiple blocks, at least one block in the multiple block respectively carries corresponding statistics Mark, the statistics mark bury an arrangement to the user's operation behavior occurred on corresponding block for showing;Based on described Page instance renders the first page;According to user for the first block at least one block of the first page Page operation behavior, generation bury information, it is described to bury the information and described first that information includes the page operation behavior The mark of statistics corresponding to block;An information reporting is buried by described, to carry out page AB test.
In the possible embodiment of first aspect, according to user at least one block of the first page The page operation behavior of first block, it includes: to determine page operation behavior institute needle according to call back function that information is buried in generation Pair element element index;The statistics mark of the block where the block elements is determined according to the element index, and will It is buried in information described in statistics mark write-in.
In the possible embodiment of first aspect, before information is buried in generation, the method also includes: based in institute It states in first page to the first page operation behavior of the second block in the multiple block, determines whether the second block carries There is statistics to identify;Determine that the second block belongs at least one described block in the case where the second block carries statistics mark The first block and first page operation behavior be for the first page at least one described block in the firstth area The page operation behavior of block.
In the possible embodiment of first aspect, in the page instance, at least one in the multiple block Blockette includes the type of pattern, and the type is used to indicate corresponding pattern;The method also includes being obtained according to the type Take the pattern of at least part block.
According to second aspect, a kind of page AB test method of mobilism is provided, the method is by server implementation;It is described Method includes: to receive the page request from client, and page request includes customer parameter;According to customer parameter, the page is participated in First page is selected at least two pages of AB test;The page instance of first page is generated, the page instance includes more A block;At least one block in the multiple block respectively carries corresponding statistics mark, and the statistics mark is used for table It is bright that an arrangement is buried to the user's operation behavior occurred on corresponding block;Page instance is sent to client.
In the possible embodiment of second aspect, at least two page respectively has page iden-tity, the multiple Block respectively has block-identified, at least one described block includes third block, and the method includes according to first page The mark of statistics entrained by the block-identified generation of the page iden-tity and third block third block.
In the possible embodiment of second aspect, at least one described block includes the 4th block, the method includes, After shunting page request a to page iden-tity according to customer parameter, determine that the 4th block is to be provided with the block buried a little, And statistics mark corresponding with the 4th block is written in the 4th block.
In the possible embodiment of second aspect, the page instance for generating first page includes loading first page The configuration data of multiple blocks in face;Based on the configuration data of multiple blocks, the respective block data of the multiple block is pulled And/or pattern.
In the possible embodiment of second aspect, the page instance for generating first page includes being based on the multiple area The pattern of block renders the block data of multiple blocks, generates the page instance of first page.
In the possible embodiment of second aspect, in the page instance, at least one in the multiple block Blockette includes the type of pattern, and the type is used to indicate corresponding pattern.
In the third aspect, a kind of page AB test device of mobilism is provided, described device includes: transmission unit, is used for Page request is sent to server, the page request includes customer parameter;Receiving unit, for receiving first page from server The page instance in face, the first page by the server based on the customer parameter from participate in page AB test at least two It is selected in a page, the page instance includes multiple blocks, at least one block in the multiple block respectively carries pair The statistics mark answered, the statistics mark bury an arrangement to the user's operation behavior occurred on corresponding block for showing; Rendering unit renders the first page for being based on the page instance;An information creating unit is buried, when sending out on the page When the page operation behavior of the first block in raw at least one block for described in, information is buried in generation, described to bury a little Information includes the information and the corresponding statistics mark of the first block of the page operation behavior;Reporting unit buries information for described It reports, to carry out page AB test.
In the possible embodiment of the third aspect, the first block includes an element, described to bury an information creating unit Subelement is determined including first, and when the page operation behavior is directed to the element, the member is determined according to call back function The element index of element, and the mark of the statistics according to corresponding to the block where the element index determines element, and by the system It is buried in information described in meter mark write-in.
In the possible embodiment of the third aspect, described device includes the second determining subelement, buries information in generation Before, based on, to the first page operation behavior of the second block in the multiple block, determining in the first page Whether two blocks carry statistics mark, and it is described to determine that the second block belongs in the case where the second block carries statistics mark The first block and first page operation behavior at least one block are in the enterprising hand-manipulating of needle of the page at least one described area The page operation behavior of the first block in block.
In the possible embodiment of the third aspect, in the page instance, at least one in the multiple block Blockette includes the type of pattern, and the type is used to indicate corresponding pattern;Described device further includes obtaining subelement, is used for The pattern of at least part block is obtained according to the type.
In the possible embodiment of first aspect or the third aspect, the statistics mark includes the page mark of first page Know and block-identified with the corresponding block of the statistics mark.
In the possible embodiment of first aspect or the third aspect, the information of burying includes the customer parameter.
In the possible embodiment of first aspect or the third aspect, the page operation behavior includes browsing, the page The information of face operation behavior includes browsing information.
In the possible embodiment of first aspect or the third aspect, the page operation behavior includes clicking, the page The information of face operation behavior includes click information.
In fourth aspect, a kind of server is provided, is tested for mobilism page AB, the server includes: to receive list Member, for receiving the page request from client, page request includes customer parameter;Routing unit, for being joined according to user Number selects first page from least two pages for participating in page AB test;Generation unit, for generating the page of first page Face example, the page instance include the multiple block;At least one block in multiple blocks respectively carries corresponding Statistics mark, the statistics mark bury an arrangement to the user's operation behavior occurred on corresponding block for showing;It sends Unit sends page instance to client.
In the possible embodiment of fourth aspect, at least two page respectively has page iden-tity, the multiple Block respectively has block-identified, at least one described block includes third block;The server includes that statistics mark generates Unit, for the system according to entrained by the block-identified generation of the page iden-tity of the first page and third block third block Meter mark.
In the possible embodiment of fourth aspect, at least one described block includes the 4th block;The server packet Writing unit is included, after shunting page request a to page iden-tity according to customer parameter, determines that the 4th block is to be provided with Block a little is buried, and statistics mark corresponding with the 4th block is written in the 4th block.
In the possible embodiment of fourth aspect, the generation unit includes load units, for loading first page Multiple blocks configuration data and pattern;It is each to pull the multiple block based on the configuration data of multiple blocks for data engine From block data and/or pattern.
In the possible embodiment of fourth aspect, the generation unit includes rendering engine, is based on the multiple block Pattern the block data of multiple blocks is rendered, generate the page instance of first page.
In the possible embodiment of fourth aspect, in the page instance, at least one in the multiple block Blockette includes the type of pattern, and the type, which is used to indicate, obtains the pattern.
According to the 5th aspect, a kind of computer readable storage medium is provided, computer program is stored thereon with, when the meter When calculation machine program executes in a computer, computer is enabled to execute method described in first or second aspect.
According to the 6th aspect, a kind of calculating equipment, including memory and processor are provided, which is characterized in that the storage It is stored with executable code in device, when the processor executes the executable code, realizes any in first or second aspect Method described in.
The method and apparatus provided by this specification embodiment, the case where not changing client and server-side code Under, AB test experiments can be easily added, AB test index is completed and buries a little and calculate, greatly promote the effect of page AB test Rate.
Detailed description of the invention
In order to which technical solution in the embodiment of the present application and advantage is more clearly understood, below in conjunction with attached drawing to the application Exemplary embodiment be described in more detail, it is clear that described embodiment be only the application a part implement Example, rather than the exhaustion of all embodiments.
Fig. 1 is the network architecture schematic diagram of page AB test;
Fig. 2 is the schematic illustration buried according to the implementation mobilism page AB test index of this specification embodiment a little;
Fig. 3 is the method flow diagram buried according to the server-side of this specification embodiment implementation mobilism AB test index a little;
Fig. 4 is the method flow diagram buried according to the client implementation mobilism AB test index of this specification embodiment a little;
Fig. 5 is the schematic diagram of a page;
Fig. 6 is the schematic diagram of another page;
Fig. 7 is the schematic diagram of the page and block lists;
Fig. 8 illustrates the detailed construction of each equipment that can be used for realizing above-mentioned various technologies according to this specification embodiment Figure;
Fig. 9 illustrates the structure chart of the page AB test device according to this specification embodiment;
Figure 10 illustrates the structure chart of the page AB testing service device according to this specification embodiment.
Specific embodiment
With reference to the accompanying drawing, the scheme provided this specification is described.
Fig. 1 is the network architecture schematic diagram of page AB test.As shown in Figure 1, multiple terminals, for example including mobile phone 112, 114,116 and personal computer 122,126, it is communicatively coupled respectively by network with server 102.Wherein, terminal may be used also To be the equipment such as tablet computer, personal digital assistant and wearable device and laptop.
The client-side program of server 102 is stored in each terminal.Client-side program operation when, each terminal simultaneously or Different time sends page request to server 102.The request can be the request of webpage, be also possible to application interface or process Request.After server 102 has received the request from client-side program, believed according to the customer parameter carried in request Request is diverted to different page instances based on the purpose of page AB test by breath;It can be directed in page instance to be tested The corresponding statistics mark of setup measures, statistics mark bury the user's operation behavior occurred on corresponding block for showing Point arrangement.Terminal carries out page rendering after receiving page instance, based on page instance, and a complete page is presented to User.Then, information is buried to the operation behavior generation in the different pages based on different user, and to burying information minute Analysis, obtains the test result of corresponding index.
Fig. 2 is the schematic illustration buried according to the implementation mobilism page AB test index of this specification embodiment a little.
In advance, platform is stored with M page file in operation, the purpose for same page AB test.These pages can To be referred to as the A page, the B page or the n page.M≥2.As M=2, these pages are divided into the A page and the B page.In an example In, the page is the hmtl page.Each page may include multiple blocks;Each block in multiple blocks respectively may include block The pattern of data and block also may include the configuration information of block data and/or pattern in block, for indicating block data And/or source and the access mode of pattern, block data and/or sample can be pulled from local or network according to the configuration information Formula;Each block in multiple blocks respectively may include the type of block pattern, and client can obtain phase according to the type The block pattern answered;Each block may include at least one element item, each element can be icon icon or text or A combination thereof can also take other forms;Each block or element can use different patterns, and pattern can determine block Or font, color, size and position of element etc.;The layout of the page can take static topology, self-adaptive layout, streaming cloth Office, response type layout, elasticity layout etc..In one example, at least part block in multiple blocks carries corresponding Statistics mark, the statistics mark bury an arrangement to the user's operation behavior occurred on corresponding block for showing.
The operator of platform can abstract the relationship of the page and block in the above-mentioned page in operation, form page knot Structure.This page structure is uniquely determined by the pattern of relative position, block between the quantity of block, block.By changing area Relative position, block itself between the quantity of block, block, operator can construct new page structure, to generate new page Face.In one example, the sequence of different blocks in the page is adjusted, for example block A is navigation bar, by block A from the current the 2nd A block locations mention the 1st block locations, and the effect of navigation can be relatively good, and the page adjusted in this way becomes new for one The page;In one example, change the quantity of block in the page, for example be reduced to 6 blocks from 8 blocks, one can be obtained A new page;In one example, the element in block changes, such as some block has such as 10 ICON, this Part ICON in a block is abandoned, then block changes, and can also generate the new page;In another example, by block Banner banner column is replaced with from navigation bar.
Block itself changes, and also leads to new page structure generation or even the new page.In one example, Block is determined because of its pattern and content sources.If only change block content and content sources are constant, then block is not Become;If the content sources of block change, block belongs to new block;If the pattern of block is changed, Block after then changing belongs to a new block.In one example, the element in block is changed, then the block category In new block.
Fig. 5 is the schematic diagram of a page, and Fig. 6 is the schematic diagram of another page.Fig. 6 is compared with Fig. 5, eliminates block 3, meanwhile, the position of block 6 moves up and pattern also has adjustment.
It is to be appreciated that platform can be in the same server with server-side in operation, can also be separately provided.
By changing one or more of number, relative position and the block itself of block, can construct one by one not With the new page so that showing the AB page effect of mobilism in client where different access person.
In one example, in order to effectively distinguish the different pages, it is provided with page iden-tity pageid, in the same page The difference page involved in AB test has different page iden-tities;In the same page, each block is assigned one respectively A block-identified blockID, different blocks have it is different block-identified, to be distinguished from each other.Pageid and blockID can To be number, letter or combinations thereof respectively.Of course, it is possible to take other effective differentiating methods, such as can be using same The overall situation under a page AB test is block-identified, i.e., under same page AB test, the different blocks of the different pages have uniquely And the mark that is distinguished from each other.Alternatively, using the overall situation to the block of interest of the different pages under same page AB test It is block-identified.For simplicity, it is hereafter still described in conjunction with page iden-tity and block-identified mode, but this field Technical staff recognize that described embodiment can be easily changed, and extend be suitable for other page iden-tities and Block-identified occasion.
As shown in Fig. 2, to bury a principle as follows for mobilism page AB test index.Firstly, client send page request to Server-side.In one example, request is http request.Request may include various customer parameters.Customer parameter can be use Family information, such as user identifier UID, the pet name, gender, country, area, city also may include facility information, such as classes of pages Type (for example, homepage), browser parameters.In one example, customer parameter is cookieID.
When receiving the page request of client, server-side obtains the customer parameter in page request.Then, according to page The customer parameter in asking is requested in person, request is shunted by routing tree, request is divided to a page iden-tity.The page iden-tity For determining one of at least two pages of page AB test.
In conjunction with Fig. 1 for example, the request from mobile phone 112 is routed to page iden-tity page1, that is, identify the page 1 pageid;Request from mobile phone 114 is routed to page2, that is, identifies the pageid of the page 2;Request quilt from mobile phone 116 It is routed to page3, that is, identifies the pageid of the page 3.The page 1,2,3 belongs to the different editions of same page AB test, and suitable For smart phone.
In another example, the request from personal computer 122 is routed to page4, that is, identifies the page 4 pageid;Request from personal computer 126 is routed to page5, that is, identifies the pageid of the page 5.The page 4 and 5 belongs to In the different editions of page AB test, it is suitable for personal computer.
In these pages for page AB test, each page respectively includes multiple blocks, the block counts of the different pages Or the pattern of block is different.These pages are distinguishable from one another because of the page structure that the pattern of multiple blocks is constituted.
Then, the page instance of the shunted page is generated, the page instance includes the multiple block;The multiple area At least one block in block respectively carries corresponding statistics mark.In one example, statistics mark includes the page of the page Face mark and at least one block are corresponding block-identified.The effect of statistics mark is to show to generation in corresponding block On user's operation behavior bury arrangement.Statistics mark can also be such that the block separation as carrier tests in page AB Being provided in A the and B page buries other blocks a little.
The block data of each block and pattern are pre-configured in page instance.In one example, these blocks Data and styles store can be accessed and be loaded by configuration data in different places.In another example, one The pattern of blockette is stored in client in the form of xml, server it is only necessary in page instance it is pre-configured these The type of the pattern of block.
In one embodiment, the process for generating page instance is divided into configuration loading link and data engine link.
The configuration data of multiple blocks of respective page is loaded according to page iden-tity in configuration loading link.Block is matched Set the page structure that data can be stored in advance in json (JavaScript Object Notation, JS object numbered musical notation) form In file.
Configuration data is used to configure the block data and/or pattern of multiple blocks.In one example, configuration data is URL link information indicates block data, the position of pattern data and access mode.The block data may include figure The non-legible element such as piece, video or even music, program.
Here is an example of page structure file.
Wherein, the page includes two blocks.By taking first block as an example, block is block-identified where block1 shows, The type of the pattern of block where BANNER_VIEW shows is banner, and block where BannerDataProcessor shows is adopted Data processor title.
Then, it goes to pull the block according to the configuration data of each block using data engine parsing page structure file Block data or pattern data.Block data may include: one in text, picture, video/audio, font file etc. or It is multiple.
Block data and pattern can be from local acquisitions;It, can be by long-range when block data or pattern strange land store Access, block data is pulled.For example, text outside some references may be included in head the or body label of hmtl code The code of part will download these external files being cited at this time;There is a < img > mark in the code of the part < body > Label refer to picture, then server obtains picture.
Here is that the result signal of two blocks progress data pull of block1 and block2 is identified as in precedent.
Map<String, Map<String, Object>>feedResponse, key is dataProcessor, are worth and are Any object, such as
Wherein, two keys that the block of block1 is v1 and v2 by the data that BannerDataProcessor is pulled Digital data;The both keyword that the block of block2 is v3 and v4 by the data that NavigationDataProcessor is pulled Data.
In one example, using rendering engine, the block data after pulling is filled into corresponding block, then root Block data is rendered according to pattern, generates page instance.
Here is the result of data filling.
Page instance after illustrating rendering below.
Wherein, the block of block1 uses " BannerView " and font as 12 pattern, and the block of block2 is adopted With the pattern of " NavigationView " and font 14.
Operator can be rendered by preview after the page, decide whether readjust page structure, to promote page AB The efficiency of test, reduces cost.
In one example, statistics mark is added in page instance according to the requirement of test index.In general, being not institute Block be all to need to be tested, can determine that a part of block needs are set from multiple blocks according to the requirement of test index It sets and buries a little, corresponding statistics mark is then filled in being disposed with the respective field for burying these blocks a little.In one example, Statistics mark statisticId, is generated by pageId and blockId;Composition form can be with are as follows: pageId#blockId.Its In, No. # is connector.Certainly, statistics mark can also take other forms, as long as block where statistics mark is enabled to have Other be provided with that effect is different from the same page is buried other blocks a little and is participated in other pages that the same page AB is tested Be provided with the block buried a little.
It traverses each needs and adds the block buried a little, add corresponding statistics for it and identify.According to the structure of the page, statistics Mark fills in the respective field of each block.
It may be noted that the operation of the addition statistics mark in page instance can also add in link earlier, such as configuration It carries link or data engine link is completed.
It is hereafter an example of the page instance with statistics mark.
Wherein, the block of block1 is provided with statistics mark page1#block1;And the block of block2 is provided with statistics Identify page1#block2.
Server-side is returned to carry and be buried a little and the page instance that identifies of statistics is to client.
Client calls render engine renders page-out according to page instance.Specific render process does not repeat again.One In a example, in page instance, having at least part block includes the type of pattern, at this time can be according to the type from originally Ground obtains the correspondence pattern of these blocks.In one example, the block data of each block of the page, including statistics mark, It is maintained in list.Fig. 7 is the schematic diagram of the page and block lists.In figure, block 2,4,5, which is provided with, to be buried a little, statistics mark Be documented in block lists, using chain-dotted line show block 2 and 5 and its count mark between corresponding relationship.
When user operates on the page, if page operation behavior, which is directed to, is provided with the block buried a little, client Automatic calling buries point processor generation and buries information.Page operation behavior can be browsing or click.
In one example, when user's browsing pages, it is assumed that be known as slide to some member, bury point processor calling Call back function (such as onselected) obtains element index (index) involved in browse action.In general, the control of element Call back function can be voluntarily provided, as long as user operation case occurs, call the function.For example, in user behavior to be monitored Page control on add particular community, bind the mouse down event of body, which behavior monitoring users operate, and pass through category Property obtain content of the act.According to element index, corresponding block and the statistics mark of the block are found from point list is buried.If Corresponding block is found from point list is buried, then the block, which belongs to, the block buried a little, and corresponding slide belongs to pair of test As;Then, browsing information is buried information the statistics of the block is added and identify as burying the write-in log of information, and at this StatisticId field.If failing to find corresponding block in point list from burying, which is not buried a little, corresponding sliding Dynamic operation is not belonging to the object of test, then the slide is not considered.
The example of the relevant log of browse operation is illustrated below.
PV,user1,page1#block1
PV,user1,page1#block2
PV,user2,page1#block1
Wherein, PV, that is, page browsing amount;Usually measure the main indicator of a Webpage amount of access.User1 and User2 is the mark for executing the different user of operation.
When the user clicks when the page, it is assumed that some element is by point, due to example registered in advance on the button of respective block Such as onclick call back function, onclick call back function is triggered at this time.From the index of the available element of call back function, then According to element index, burying a little for corresponding block and the block is found from point list is buried.It is buried a little finally, will click on information and be used as Log is written in information, and in the statistics mark statisticId field for burying an information addition block.
The example of the relevant log of clicking operation is illustrated below.
CLICK,user1,page1#block1
CLICK,user2,page1#block1
Wherein, CLICK represents clicking operation, statistics mark and UID.CTR is the click volume/amount of showing.
Burying information can also include the customer parameter for needing to be returned, such as: domain name, IP address, url network address, search One or more of content, button name.
The log for burying information of client is with real-time or offline mode through sdk (software development Kit, Software Development Kit), upload to index computing platform.Then, index computing platform carries out the calculating of index.
Common page AB test index has: the uv of the page, the pv of the page, the ctr of the page, the uv of block, the pv of block, The ctr of block.Wherein, uv (unique visitor) refers to some website of access or clicks the different IP addresses of certain news Number.According to statisticId, These parameters can be easily calculated.For example, using pageId as the keyword of statistics, The uv, pv, ctr of each page can be calculated;Using pageId#blockId as keyword, each block can be calculated Uv, pv, ctr.
It, can be based on to user's operation after the user's operation behavioral data for collecting different beta versions according to the above method The analysis of behavioral data evaluates preferred versions from different editions and is used.
In traditional page AB test based on immobilized substance, index buries the complexity of process a little, does AB test every time all It needs to bury again a little, develop again, change requires hair version every time.On the basis of using this specification embodiment, due to page Face is blocking, can set up the new page according to different block at any time, it is not necessary to change client and server-side code, simultaneously The arrangement buried a little is also completed using statistics mark.Programming personnel's (research and development so update of full page no longer needs to rely on Personnel), so that it may AB experiment is easily added, the index for completing AB test is buried a little and calculated, and page AB survey is greatly improved The efficiency of examination.
Fig. 3 is the method flow diagram buried according to the server-side of this specification embodiment implementation mobilism AB test index a little. As shown in figure 3, in step S302, server-side receives client request.
The request of different clients is diverted to by the AB page or ABn based on the purpose of page AB test in step S304 The page, or page iden-tity relevant to these pages.For the sake of description simplicity, description is hereafter only unfolded by taking the AB page as an example, This specification can extend to the situation of the ABn page naturally.
In step S306, request is divided to the A page, then obtains the page iden-tity of the A page.
In step S307, request is divided to the B page, then obtains the page iden-tity of the B page.
It obtains based on the page iden-tity read before in step S306 or S307 in step S310 and loads corresponding page The configuration data and pattern of each block in face.
The block of different blocks in the page is pulled according to the configuration data of each block of respective page in step S312 The pattern of data or block.
Page rendering is carried out according to the block data of different blocks or the pattern of block in step S314.
In step S316, page instance is constructed using the block data of different blocks and the pattern of block, and in block Middle write-in statistics mark, to show to bury the user's operation behavior occurred on block an arrangement.
In step S318, traverse it is all bury a little so that corresponding statistics mark is written in page instance.
In step S320, page instance is sent to client.
Fig. 4 is the method flow diagram buried according to the client implementation mobilism AB test index of this specification embodiment a little. As shown in figure 4, client sends page request to server-side in step S402.
In step S404, receives and save page instance.
Page rendering is carried out using the block data and pattern of different blocks in page instance in step S406.At one In example, in the case where block includes the type of pattern, the sample of at least part block is obtained according to the type Formula.
Does client detect whether user to the operation behavior of the page during webpage representation in step S407? If it is not, continuing waiting for.If so, then entering step S410.
Do you in step S410, judge that block pointed by operation behavior carries statistics mark? if being returned without if Step S407;If so, then entering step S412.
In step S412, log is written using the information of user's operation behavior as information is buried.Burying information includes statistics Mark.
In step S414, judge that user's operation behavior is browsing or clicks.If it is browsing, then S416 is entered step, PV information is added in burying information;If it is click, then S418 is entered step, CLICK information is added in burying information.When So, user's operation behavior is also possible to other operations other than browsing and clicking.
In step S420, the log for burying information is reported into index computing platform.Reporting can be with real-time or offline Mode carry out.
Fig. 3 and Fig. 4 has sketched the process of the page AB test of server-side and client implementation this specification embodiment respectively Figure.Its correlative detail can be understood in conjunction with Fig. 2 and its description.
Fig. 8 illustrates the detailed construction of each equipment that can be used for realizing above-mentioned various technologies according to this specification embodiment Figure.The block diagram shows the hardware foundations of method flow shown in achievable Fig. 2-Fig. 4.As shown in figure 8, equipment may include processing Device 802, the processor indicate the microprocessor or controller 811 of overall operation for controlling devices.Data/address bus 815 can benefit Carry out data transmission between storage equipment 840, processor 802 and controller 817.Controller 811 can be used for passing through equipment Control bus 817 is interacted and is controlled it with distinct device.Equipment may also include the net for being coupled to data link 812 Network/bus interface 814.In the case of a wireless connection, network/bus interface 814 may include wireless transceiver.
Equipment further includes storage equipment 840.In one example, which can store client software, client Software loads in RAM820 from RAM840, and thus control processor 802 executes corresponding operating, these operations include: Page request is sent to server, page request includes customer parameter;Page instance, the page instance packet are received from server Multiple blocks are included, at least one block in the multiple block respectively carries corresponding statistics mark, and the statistics mark is used In showing to bury the user's operation behavior occurred on corresponding block an arrangement;Based on the page instance, described the is rendered One page;According to user for the page operation behavior of the first block at least one block described in the first page, Information is buried in generation, described to bury the information and the corresponding statistics mark of the first block that information includes the page operation behavior.
In another example, which is stored with server software;At runtime, server software is from RAM840 In load in RAM820, and thus control processor 802 execute corresponding operating, comprising: receive the page from client Request, page request includes customer parameter;According to customer parameter, from participating in selecting at least two pages that page AB is tested One page;The page instance of first page is generated, the page instance includes multiple blocks;In at least one of multiple blocks Block respectively carries corresponding statistics mark, and the statistics mark is for showing to the user's operation row occurred on corresponding block To bury an arrangement;Page instance is sent to client.
It should be appreciated that equipment described herein can use previously described embodiment of the method at many aspects or tie therewith It closes.
Those skilled in the art are it will be appreciated that in said one or multiple examples, each embodiment of this specification Described function can be realized with hardware, software, firmware or their any combination.It when implemented in software, can be with By the storage of these functions in computer-readable medium or as on computer-readable medium one or more instructions or generation Code is transmitted.According to the embodiment of another aspect, a kind of computer readable storage medium is also provided, computer is stored thereon with Program enables computer execute and combines method described in Fig. 2-Fig. 4 when the computer program executes in a computer.
Fig. 9-Figure 10 illustrate each embodiment described function of this specification using hardware, firmware or a combination thereof or With some possible schemes when combination of software.
Fig. 9 illustrates the structure chart of the page AB test device according to this specification embodiment.As shown in figure 9, page AB Test device includes transmission unit 902, is configured to send page request to server, page request includes customer parameter;It connects Unit 904 is received, the page instance of first page is received from server, the first page is based on the user by the server For parameter from participating in selecting at least two pages that page AB is tested, the page instance includes multiple blocks, the multiple area At least one block in block respectively carries corresponding statistics mark, and the statistics mark is for showing to generation in corresponding block On user's operation behavior bury arrangement;Rendering unit 906 is based on page instance, renders first page;Information is buried to generate Unit 908 is directed to the page operation behavior of the first block at least one described block according to user, and information is buried in generation, It is described to bury the information and the corresponding statistics mark of the first block that information includes the page operation behavior.
Figure 10 illustrates the structure chart of the page AB testing service device according to this specification embodiment.As shown in Figure 10, it takes Business device includes: receiving unit 1002, receives the page request from client, page request includes customer parameter;Routing unit 1004, for selecting first page from least two pages for participating in page AB test according to customer parameter;Generation unit 1006, for generating the page instance of first page, the page instance includes multiple blocks;At least one in multiple blocks A block respectively carries corresponding statistics mark, and the statistics mark is for showing to the user's operation occurred on corresponding block An arrangement is buried in behavior;Transmission unit 1008 sends page instance to client.
It should be appreciated that page AB test device described herein and server can use at many aspects it is previously described Embodiment of the method is in combination.
Those skilled in the art are it will be appreciated that in said one or multiple examples, function described in the invention It can be realized with hardware, software, firmware or their any combination.It when implemented in software, can be by these functions Storage in computer-readable medium or as on computer-readable medium one or more instructions or code transmitted.
Above-described specific embodiment has carried out further the purpose of the present invention, technical scheme and beneficial effects It is described in detail, it should be understood that being not intended to limit the present invention the foregoing is merely a specific embodiment of the invention Protection scope, all any modification, equivalent substitution, improvement and etc. on the basis of technical solution of the present invention, done should all Including within protection scope of the present invention.

Claims (28)

1. a kind of page AB test method of mobilism, the method is by client implementation;The described method includes:
Page request is sent to server, page request includes customer parameter;
From server receive first page page instance, the first page by the server be based on the customer parameter from It participates in selecting at least two pages of page AB test, the page instance includes multiple blocks, in the multiple block At least one block respectively carries corresponding statistics mark, and the statistics mark is for showing to the use occurred on corresponding block Family operation behavior buries an arrangement;
Based on the page instance, the first page is rendered;
According to user for the page operation behavior of the first block at least one block of the first page, generation is buried a little Information, it is described to bury the mark of statistics corresponding to the information and first block that information includes the page operation behavior;
An information reporting is buried by described, to carry out page AB test.
2. the page AB test method of mobilism as described in claim 1, wherein the statistics mark includes first page Page iden-tity and block-identified with the corresponding block of the statistics mark.
3. the page AB test method of mobilism as described in claim 1, wherein the information of burying includes user's ginseng Number.
4. the page AB test method of mobilism as described in claim 1, wherein the page operation behavior include browsing and/ Or click, the corresponding information of the page operation behavior includes browsing information and/or click information.
5. the page AB test method of mobilism as described in claim 1, wherein according to user for the first page The page operation behavior of the first block at least one block, generation bury information and include:
The element index of the targeted element of page operation behavior is determined according to call back function;
According to the mark of statistics corresponding to the block where the element index determines the element;
Statistics mark is included in described bury in information.
6. the page AB test method of mobilism as described in claim 1, wherein before information is buried in generation, the method Further include: based on to the first page operation behavior of the second block in the multiple block, being determined in the first page Whether the second block carries statistics mark;Determine that the second block belongs to institute in the case where the second block carries statistics mark The first block at least one block is stated, and first page operation behavior is described at least one for the first page The page operation behavior of the first block in a block.
7. the page AB test method of mobilism as described in claim 1, wherein the multiple in the page instance At least part block in block includes the type of pattern, and the type is used to indicate corresponding pattern;It is described based on described Page instance, rendering the first page further includes, and the pattern of at least part block is obtained according to the type.
8. a kind of page AB test method of mobilism, the method is by server implementation;The described method includes:
The page request from client is received, page request includes customer parameter;
According to customer parameter, first page is selected from least two pages for participating in page AB test;
The page instance of first page is generated, the page instance includes multiple blocks;At least one of the multiple block Block respectively carries corresponding statistics mark, and the statistics mark is for showing to the user's operation row occurred on corresponding block To bury an arrangement;
Page instance is sent to client.
9. the page AB test method of mobilism as claimed in claim 8, wherein at least two page respectively has page Face mark, the multiple block respectively has block-identified, at least one described block includes third block, the method includes It is identified according to statistics entrained by the block-identified generation of the page iden-tity of the first page and third block third block.
10. the page AB test method of mobilism as claimed in claim 8, wherein at least one described block includes the 4th area Block, the method includes determining that the 4th block is to set after shunting page request a to page iden-tity according to customer parameter It is equipped with the block buried a little, and statistics mark corresponding with the 4th block is written in the 4th block.
11. the page AB test method of mobilism as claimed in claim 8, wherein the page instance for generating first page Including loading the configuration data of multiple blocks of first page;Based on the configuration data of multiple blocks, the multiple block is pulled Respective block data and/or pattern.
12. the page AB test method of mobilism as claimed in claim 8, wherein generating the page instance packet of first page It includes, the pattern based on the multiple block renders the block data of multiple blocks, generates the page instance of first page.
13. the page AB test method of mobilism as claimed in claim 8, wherein the multiple in the page instance At least part block in block includes the type of pattern, and the type is used to indicate corresponding pattern.
14. a kind of page AB test device of mobilism, described device include:
Transmission unit, for sending page request to server, the page request includes customer parameter;
Receiving unit, for receiving the page instance of first page from server, the first page is based on by the server For the customer parameter from participating in selecting at least two pages that page AB is tested, the page instance includes multiple blocks, institute It states at least one block in multiple blocks and respectively carries corresponding statistics mark, the statistics mark exists to generation for showing An arrangement is buried in user's operation behavior on corresponding block;
Rendering unit renders the first page for being based on the page instance;
An information creating unit is buried, the page operation behavior of the first block at least one described block is directed to according to user, Information is buried in generation, described to bury the information and the corresponding statistics mark of the first block that information includes the page operation behavior;
Reporting unit buries an information reporting for described, to carry out page AB test.
15. the page AB test device of mobilism as claimed in claim 14, wherein statistics mark includes the page of first page Face mark and block-identified with the corresponding block of the statistics mark.
16. the page AB test device of mobilism as claimed in claim 14, wherein described, to bury information include customer parameter.
17. the page AB test device of mobilism as claimed in claim 14, wherein the user's operation behavior includes browsing And/or click, the corresponding information of the page operation behavior includes browsing information and/or click information.
18. the page AB test device of mobilism as claimed in claim 14, wherein the first block includes an element, it is described Bury an information creating unit include first determine subelement, when the page operation behavior be directed to the element when, according to return Letter of transfer number determines the element index of the element, and the system according to corresponding to the block where the element index determines element Meter mark, and statistics mark is written in described bury in information.
19. the page AB test device of mobilism as claimed in claim 14, wherein described device further includes the second determining son Unit, before information is buried in generation, based in the first page to first of the second block in the multiple block Page operation behavior, determines whether the second block carries statistics mark, in the case where the second block carries statistics mark It determines the first block that the second block belongs at least one described block and first page operation behavior is enterprising in the page Page operation behavior of the hand-manipulating of needle to the first block at least one described block.
20. the page AB test device of mobilism as claimed in claim 14, wherein described more in the page instance At least part block in a block includes the type of pattern, and the type is used to indicate corresponding pattern;Described device is also Including obtaining subelement, for obtaining the pattern of at least part block according to the type.
21. a kind of server, is tested for mobilism page AB, the server includes:
Receiving unit, for receiving the page request from client, page request includes customer parameter;
Routing unit, for selecting first page from least two pages for participating in page AB test according to customer parameter;
Generation unit, for generating the page instance of first page, the page instance includes multiple blocks;In multiple blocks At least one block respectively carry corresponding statistics mark, the statistics mark is for showing to occurring on correspondence block An arrangement is buried in user's operation behavior;
Transmission unit, for sending page instance to client.
22. server as claimed in claim 21, wherein at least two page respectively has page iden-tity, it is the multiple Block respectively has block-identified, at least one described block includes third block;The server includes that statistics mark generates Unit, for the system according to entrained by the block-identified generation of the page iden-tity of the first page and third block third block Meter mark.
23. server as claimed in claim 21, wherein at least one described block includes the 4th block;The server packet Writing unit is included, after shunting page request a to page iden-tity according to customer parameter, determines that the 4th block is to be provided with Block a little is buried, and statistics mark corresponding with the 4th block is written in the 4th block.
24. server as claimed in claim 21, wherein the generation unit includes load units, for loading first page Multiple blocks configuration data;Data engine pulls the respective area of the multiple block based on the configuration data of multiple blocks Block number evidence and/or pattern.
25. server as claimed in claim 21 is based on the multiple block wherein the generation unit includes rendering engine Pattern the block data of multiple blocks is rendered, generate the page instance of first page.
26. server as claimed in claim 21, wherein in the page instance, at least one in the multiple block Blockette includes the type of pattern, and the type is used to indicate corresponding pattern.
27. a kind of computer readable storage medium, is stored thereon with computer program, when the computer program in a computer When execution, computer perform claim is enabled to require the method for any one of 1-13.
28. a kind of calculating equipment, including memory and processor, which is characterized in that be stored with executable generation in the memory Code realizes method of any of claims 1-13 when the processor executes the executable code.
CN201810923957.1A 2018-08-14 2018-08-14 Index point burying method and device for dynamic page AB test Active CN109101425B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810923957.1A CN109101425B (en) 2018-08-14 2018-08-14 Index point burying method and device for dynamic page AB test

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810923957.1A CN109101425B (en) 2018-08-14 2018-08-14 Index point burying method and device for dynamic page AB test

Publications (2)

Publication Number Publication Date
CN109101425A true CN109101425A (en) 2018-12-28
CN109101425B CN109101425B (en) 2021-12-07

Family

ID=64849643

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810923957.1A Active CN109101425B (en) 2018-08-14 2018-08-14 Index point burying method and device for dynamic page AB test

Country Status (1)

Country Link
CN (1) CN109101425B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109829757A (en) * 2019-01-18 2019-05-31 泰康保险集团股份有限公司 A kind of selection method and device of optimal marketing program
CN109947643A (en) * 2019-03-01 2019-06-28 广州华多网络科技有限公司 A kind of configuration method, device and the equipment of the experimental program based on A/B test
CN110334015A (en) * 2019-06-13 2019-10-15 腾讯科技(成都)有限公司 A kind of white-box testing method, apparatus, equipment and medium
CN110609856A (en) * 2019-08-22 2019-12-24 贵州省广播电视信息网络股份有限公司 Method for recommending AB report statistics based on artificial intelligence
CN110633205A (en) * 2019-06-20 2019-12-31 北京无限光场科技有限公司 Method and device for detecting embedded point event, terminal equipment and medium
CN111124932A (en) * 2019-12-30 2020-05-08 广州华多网络科技有限公司 Scheme verification method, system, device, computer equipment and storage medium
CN111708711A (en) * 2020-06-23 2020-09-25 湖南快乐阳光互动娱乐传媒有限公司 AB test method and device, storage medium and electronic equipment
CN112181782A (en) * 2020-10-16 2021-01-05 中国工商银行股份有限公司 Adaptive gray function issuing method and device based on AB test
CN112799946A (en) * 2021-01-29 2021-05-14 长沙市到家悠享网络科技有限公司 Method, equipment and storage medium for embedding points and collecting data
CN112817669A (en) * 2020-03-09 2021-05-18 腾讯科技(深圳)有限公司 Page selection method and device and readable storage medium
CN112817856A (en) * 2021-02-04 2021-05-18 上海哔哩哔哩科技有限公司 AB experiment integration method and system

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090281989A1 (en) * 2008-05-06 2009-11-12 Yahoo!, Inc. Micro-Bucket Testing For Page Optimization
US20100312975A1 (en) * 2009-06-09 2010-12-09 Rostedt Steven D Mechanism for a Reader Page for a Ring Buffer
CN102999535A (en) * 2011-09-19 2013-03-27 阿里巴巴集团控股有限公司 Information display method, information acquisition method, client terminal and server
CN104572043A (en) * 2013-10-16 2015-04-29 阿里巴巴集团控股有限公司 Method and device for embedding points for controls of client application in real time
CN105574049A (en) * 2014-10-30 2016-05-11 阿里巴巴集团控股有限公司 Page processing method, device and system of mobile applications
CN105743730A (en) * 2014-12-12 2016-07-06 阿里巴巴集团控股有限公司 Method and system used for providing real-time monitoring for webpage service of mobile terminal
CN106066826A (en) * 2016-05-24 2016-11-02 北京金山安全软件有限公司 Automatic testing method and device for buried point and terminal
CN106469183A (en) * 2015-08-21 2017-03-01 阿里巴巴集团控股有限公司 Page rendering method and device, page data processing method and client
CN106777086A (en) * 2016-12-13 2017-05-31 东软集团股份有限公司 A kind of webpage buries dynamic management approach and device a little
CN107066273A (en) * 2017-03-31 2017-08-18 北京奇艺世纪科技有限公司 A kind of style sheet update method and device
CN107092652A (en) * 2017-03-14 2017-08-25 口碑控股有限公司 The air navigation aid and device of target pages
CN107145491A (en) * 2016-03-01 2017-09-08 阿里巴巴集团控股有限公司 Page rendering method and device
CN107295050A (en) * 2016-04-01 2017-10-24 阿里巴巴集团控股有限公司 Front end user behavioral statisticses method and device
CN107832218A (en) * 2017-11-10 2018-03-23 平安科技(深圳)有限公司 A processing method, device and computer equipment are buried in dynamic page
CN108334525A (en) * 2017-01-20 2018-07-27 阿里巴巴集团控股有限公司 A kind of method for exhibiting data and device

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090281989A1 (en) * 2008-05-06 2009-11-12 Yahoo!, Inc. Micro-Bucket Testing For Page Optimization
US20100312975A1 (en) * 2009-06-09 2010-12-09 Rostedt Steven D Mechanism for a Reader Page for a Ring Buffer
CN102999535A (en) * 2011-09-19 2013-03-27 阿里巴巴集团控股有限公司 Information display method, information acquisition method, client terminal and server
CN104572043A (en) * 2013-10-16 2015-04-29 阿里巴巴集团控股有限公司 Method and device for embedding points for controls of client application in real time
CN105574049A (en) * 2014-10-30 2016-05-11 阿里巴巴集团控股有限公司 Page processing method, device and system of mobile applications
CN105743730A (en) * 2014-12-12 2016-07-06 阿里巴巴集团控股有限公司 Method and system used for providing real-time monitoring for webpage service of mobile terminal
CN106469183A (en) * 2015-08-21 2017-03-01 阿里巴巴集团控股有限公司 Page rendering method and device, page data processing method and client
CN107145491A (en) * 2016-03-01 2017-09-08 阿里巴巴集团控股有限公司 Page rendering method and device
CN107295050A (en) * 2016-04-01 2017-10-24 阿里巴巴集团控股有限公司 Front end user behavioral statisticses method and device
CN106066826A (en) * 2016-05-24 2016-11-02 北京金山安全软件有限公司 Automatic testing method and device for buried point and terminal
CN106777086A (en) * 2016-12-13 2017-05-31 东软集团股份有限公司 A kind of webpage buries dynamic management approach and device a little
CN108334525A (en) * 2017-01-20 2018-07-27 阿里巴巴集团控股有限公司 A kind of method for exhibiting data and device
CN107092652A (en) * 2017-03-14 2017-08-25 口碑控股有限公司 The air navigation aid and device of target pages
CN107066273A (en) * 2017-03-31 2017-08-18 北京奇艺世纪科技有限公司 A kind of style sheet update method and device
CN107832218A (en) * 2017-11-10 2018-03-23 平安科技(深圳)有限公司 A processing method, device and computer equipment are buried in dynamic page

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109829757B (en) * 2019-01-18 2021-02-26 泰康保险集团股份有限公司 Optimal marketing scheme selection method and device
CN109829757A (en) * 2019-01-18 2019-05-31 泰康保险集团股份有限公司 A kind of selection method and device of optimal marketing program
CN109947643A (en) * 2019-03-01 2019-06-28 广州华多网络科技有限公司 A kind of configuration method, device and the equipment of the experimental program based on A/B test
CN110334015A (en) * 2019-06-13 2019-10-15 腾讯科技(成都)有限公司 A kind of white-box testing method, apparatus, equipment and medium
CN110334015B (en) * 2019-06-13 2024-02-13 腾讯科技(成都)有限公司 White box testing method, device, equipment and medium
CN110633205A (en) * 2019-06-20 2019-12-31 北京无限光场科技有限公司 Method and device for detecting embedded point event, terminal equipment and medium
CN110609856A (en) * 2019-08-22 2019-12-24 贵州省广播电视信息网络股份有限公司 Method for recommending AB report statistics based on artificial intelligence
CN111124932A (en) * 2019-12-30 2020-05-08 广州华多网络科技有限公司 Scheme verification method, system, device, computer equipment and storage medium
CN111124932B (en) * 2019-12-30 2023-06-09 广州华多网络科技有限公司 Scheme verification method, system, device, computer equipment and storage medium
CN112817669A (en) * 2020-03-09 2021-05-18 腾讯科技(深圳)有限公司 Page selection method and device and readable storage medium
CN112817669B (en) * 2020-03-09 2023-09-19 腾讯科技(深圳)有限公司 Page selection method, device and readable storage medium
CN111708711A (en) * 2020-06-23 2020-09-25 湖南快乐阳光互动娱乐传媒有限公司 AB test method and device, storage medium and electronic equipment
CN111708711B (en) * 2020-06-23 2023-04-07 湖南快乐阳光互动娱乐传媒有限公司 AB test method and device, storage medium and electronic equipment
CN112181782A (en) * 2020-10-16 2021-01-05 中国工商银行股份有限公司 Adaptive gray function issuing method and device based on AB test
CN112799946A (en) * 2021-01-29 2021-05-14 长沙市到家悠享网络科技有限公司 Method, equipment and storage medium for embedding points and collecting data
CN112817856A (en) * 2021-02-04 2021-05-18 上海哔哩哔哩科技有限公司 AB experiment integration method and system

Also Published As

Publication number Publication date
CN109101425B (en) 2021-12-07

Similar Documents

Publication Publication Date Title
CN109101425A (en) A kind of index of the page AB test of mobilism buries point methods and device
US10911554B2 (en) Method and system for tracking web link usage
CN106528432B (en) The construction method and device of test scene data bury a test method
US10152464B2 (en) Determining and displaying a count of unread items in content feeds
CN103729285B (en) A kind of webpage test method, equipment and system
CN101542427B (en) Content feed user interface
TWI416344B (en) Computer-implemented method and computer-readable medium for providing access to content
CN100589106C (en) Page jump method and system
CN105260420B (en) A kind of method and apparatus for the offer target pages in mobile application
CN101488151B (en) System and method for gathering website contents
CN109478302A (en) Flow timeline social networks
CN103034690A (en) Self-customizing method of mobile terminal client application program based on web service
KR20110023749A (en) Traffic visualization across web maps
CN105302461B (en) A kind of method and apparatus for the offer target pages in mobile application
CN110263070A (en) Event report method and device
CN105095374A (en) Method and device for browsing mobile terminal news
CN109684571A (en) Data acquisition method and device and storage medium
CN103678343A (en) Method and device for prompting webpage loading progress
CN101894109A (en) Database building method and device
CN108984070A (en) Method, apparatus, electronic equipment and readable medium for thermodynamic chart imaging
US20130297600A1 (en) Method and system for chronological tag correlation and animation
US20120311040A1 (en) Real-time browsing monitoring
JP5832056B1 (en) Program for displaying Web page, terminal device, and server device
CN103761024A (en) Interface display method, device, terminal, server and system
CN109582469A (en) Information sharing method, calculates equipment and storage medium at device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20201009

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Innovative advanced technology Co.,Ltd.

Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant before: Advanced innovation technology Co.,Ltd.

Effective date of registration: 20201009

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Advanced innovation technology Co.,Ltd.

Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240226

Address after: Guohao Times City # 20-01, 128 Meizhi Road, Singapore

Patentee after: Advanced Nova Technology (Singapore) Holdings Ltd.

Country or region after: Singapore

Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Patentee before: Innovative advanced technology Co.,Ltd.

Country or region before: United Kingdom