CN109634649B - Page flow experimental method, system, equipment and readable storage medium - Google Patents
Page flow experimental method, system, equipment and readable storage medium Download PDFInfo
- Publication number
- CN109634649B CN109634649B CN201811202924.4A CN201811202924A CN109634649B CN 109634649 B CN109634649 B CN 109634649B CN 201811202924 A CN201811202924 A CN 201811202924A CN 109634649 B CN109634649 B CN 109634649B
- Authority
- CN
- China
- Prior art keywords
- page flow
- user behavior
- behavior data
- page
- version
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000002474 experimental method Methods 0.000 title claims abstract description 144
- 230000001960 triggered effect Effects 0.000 claims abstract description 12
- 230000006399 behavior Effects 0.000 claims description 121
- 238000013507 mapping Methods 0.000 claims description 5
- 238000000034 method Methods 0.000 description 25
- 238000004891 communication Methods 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a page flow experimental method, which comprises the following steps: when receiving a version identifier downloading request sent by a client, issuing a corresponding version identifier to the client according to a preset flow diversion rule and the version identifier downloading request; receiving user behavior data reported by the client, and storing the user behavior data, wherein the client executes a page flow of a corresponding version based on the version identification, and when executing the page flow, collects the user behavior data, and reports the user behavior data to a server; when a triggered experiment report generation instruction is monitored, generating a page flow experiment report according to stored user behavior data. The invention also provides a page flow experiment system, equipment and a readable storage medium. The invention can effectively improve the experimental accuracy and accurately determine the better page flow.
Description
Technical Field
The present invention relates to the field of page flow experiment technologies, and in particular, to a page flow experiment method, system, device, and readable storage medium.
Background
Different page flows have different attractions to users, namely, some page operation flows are more in line with the demands of the users, more users can be attracted, and when two new and old page flows exist, an A/B experiment is generally adopted to determine which flow of the two new and old page flows can be more attractive to the users.
However, when determining which of the two new and old page operation flows can attract the user, the conventional a/B experiment is generally fixed in statistical index, the sampled sample is not representative and cannot provide comparison between the two new and old page flows, and finally the experimental data obtained through the a/B experiment is inaccurate and the better page flow cannot be accurately determined.
Therefore, how to improve the experimental accuracy and accurately determine the better page flow is a problem to be solved at present.
Disclosure of Invention
The invention mainly aims to provide a page flow experimental method, a system, equipment and a readable storage medium, which aim to improve experimental accuracy and accurately determine a better page flow.
In order to achieve the above object, the present invention provides a page flow experimental method, which includes the following steps:
when receiving a version identifier downloading request sent by a client, issuing a corresponding version identifier to the client according to a preset flow diversion rule and the version identifier downloading request;
Receiving user behavior data reported by the client, and storing the user behavior data, wherein the client executes a page flow of a corresponding version based on the version identification, and when executing the page flow, collects the user behavior data, and reports the user behavior data to a server;
When a triggered experiment report generation instruction is monitored, generating a page flow experiment report according to stored user behavior data.
Optionally, the step of issuing the corresponding version identifier to the client according to a preset traffic distribution rule and the version identifier downloading request includes:
Carrying out random hash on the user name in the version identifier downloading request to obtain a hash value, and determining a hash value group of a page flow of a version to which the hash value belongs according to a preset flow diversion rule;
Inquiring a mapping relation table of a pre-stored hash value group and version identification information, acquiring a version identification corresponding to the hash value group, and transmitting the version identification to the client.
Optionally, the step of generating the page flow experiment report according to the stored user behavior data includes:
acquiring stored user behavior data corresponding to each version identifier respectively, and analyzing the user behavior data corresponding to each version identifier respectively to acquire experimental index values of page flows corresponding to each version identifier respectively;
and generating a page flow experiment report according to the experiment index values of the page flows respectively corresponding to the version identifiers.
Optionally, the step of generating the page flow experiment report according to the experiment index values of the page flows respectively corresponding to the version identifiers includes:
Judging whether the current page flow experiment is credible or not according to the experiment index value of the page flow corresponding to the first version identification and the experiment index value of the page flow corresponding to the second version identification;
if the current page flow experiment is credible, accumulating the experiment index value of the page flow corresponding to the first version identification with the experiment index value of the page flow corresponding to the second version identification to obtain an accumulated experiment index value;
comparing the experimental index value of the page flow corresponding to the third version identification with the accumulated experimental index value to obtain an experimental index difference value of the page flow corresponding to the third version identification and the page flow corresponding to the first version identification or the second version identification;
and generating a page flow experiment report according to the experiment index difference value.
Optionally, when executing the page flow, the client collects user behavior data, and the step of reporting the user behavior data to the server includes:
When the client executes the page flow, collecting user behavior data, and storing the collected user behavior data into a preset storage area;
Counting the total bytes of user behavior data stored in a preset storage area at fixed time, and judging whether the total bytes are larger than or equal to a preset threshold value;
And if the total byte number is greater than or equal to a preset threshold value, reporting the user behavior data in a preset storage area to a server.
Optionally, after the step of collecting the user behavior data and storing the collected user behavior data in the preset storage area when the client executes the page flow, the method further includes:
the client acquires the URL address of the current display page and judges whether the URL address is in a preset URL address group or not;
if the URL address is in the preset URL address group, executing the steps of: and reporting the user behavior data in the preset storage area to a server.
Optionally, the step of reporting, by the client, the user behavior data in the preset storage area to the server includes:
The client compresses the user behavior data in the preset storage area and reports the compressed user behavior data to the server.
In addition, in order to achieve the above objective, the present invention further provides a page flow experimental system, which comprises a server and a client, wherein the server comprises a transceiver module, a storage module and a report generation module, wherein the transceiver module is configured to, when receiving a version identifier downloading request sent by the client, send a corresponding version identifier to the client according to a preset flow splitting rule and the version identifier downloading request;
the client is used for executing the page flow of the corresponding version based on the version identification, collecting user behavior data when executing the page flow, and reporting the user behavior data to the server
The storage module is used for receiving the user behavior data reported by the client and storing the user behavior data;
And the report generating module is used for generating a page flow experiment report according to the stored user behavior data when the triggered experiment report generating instruction is monitored.
In addition, in order to achieve the above object, the present invention also provides a page flow experimental device, which includes a processor, a memory, and a page flow experimental program stored on the memory and executable by the processor, wherein the page flow experimental program, when executed by the processor, implements the steps of the page flow experimental method as described above.
In addition, in order to achieve the above object, the present invention further provides a readable storage medium, on which a page flow experiment program is stored, wherein the page flow experiment program, when executed by a processor, implements the steps of the page flow experiment method as described above.
The invention provides a page flow experiment method, a system, equipment and a readable storage medium. By the method, an accurate experimental report of the version of the new page flow and the old page flow can be obtained, the experimental accuracy can be improved, and a better page flow can be accurately determined.
Drawings
FIG. 1 is a schematic diagram of a hardware structure of a page flow experimental device according to various embodiments of the present invention;
FIG. 2 is a schematic flow chart of a first embodiment of the page flow experimental method of the invention;
fig. 3 is a schematic diagram of functional modules of a first embodiment of the page flow experimental system of the invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The page flow experimental method related to the embodiment of the invention is mainly applied to page flow experimental equipment, and the page flow experimental equipment can be equipment with display and processing functions such as a PC (personal computer personal computer), a portable computer, a mobile terminal and the like.
Referring to fig. 1, fig. 1 is a schematic hardware structure of a page flow experimental device according to an embodiment of the present invention. In an embodiment of the present invention, the page flow experimental device may include a processor 1001 (e.g., a central processing unit Central Processing Unit, a CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein the communication bus 1002 is used to enable connected communications between these components; the user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard); the network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface); the memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory, and the memory 1005 may alternatively be a storage system independent of the processor 1001. Those skilled in the art will appreciate that the hardware configuration shown in fig. 1 is not limiting of the invention and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
With continued reference to FIG. 1, the memory 1005 of FIG. 1, which is a readable storage medium, may include an operating system, a network communication module, and a page flow experimental program. In fig. 1, the network communication module is mainly used for connecting with a server and performing data communication with the server; the processor 1001 may call the page flow experimental program stored in the memory 1005 and execute the page flow experimental method provided by the embodiment of the present invention.
The embodiment of the invention provides a page flow experimental method.
Referring to fig. 2, fig. 2 is a flow chart of a first embodiment of the page flow experimental method of the invention.
In this embodiment, the page flow experimental method includes the following steps:
Step S101, when receiving a version identifier downloading request sent by a client, transmitting a corresponding version identifier to the client according to a preset flow distribution rule and the version identifier downloading request;
In this embodiment, a developer performs data embedding on a Page according to the specific process of the Page of the new and old versions, and an experimenter configures experimental indexes, flow diversion rules, a client white list and other experimental basic information through a server, wherein the experimental indexes include, but are not limited to, PV (Page View), UV (Unique Visitor, independent visitor number), visit (Page preview number), page residence time, page jump rate, page click rate, click volume, investment conversion rate, exposure volume, return visit rate, return visit volume, order volume and scene conversion rate; the flow diversion rule is to set four page flows, namely three identical old page flows and one new version page flow, three identical old page flows are defined as a comparison plate A, a comparison plate C and a comparison plate D respectively, the new version page flow is defined as an experiment plate B, and the diversion proportion of the four page flows is required to meet the following conditions, namely the comparison plate C=the comparison plate D, the experiment plate B=the comparison plate C+the comparison plate D, and the comparison plate A+the experiment plate B+the comparison plate C+the comparison plate D=100%. For example, the split ratio of experiment plate B was 20%, the split ratio of control plate C and control plate D were 10% and the split ratio of control plate a was 60%. It should be noted that the above-mentioned split ratio may be set by those skilled in the art based on actual situations, and this embodiment is not particularly limited.
After the experimenter completes the experimental basic information through the server configuration, the experimenter starts to execute the page flow experiment, namely, when the client is started for the first time, a version identifier downloading request carrying a device number, a user name or a user person group is generated, the version identifier downloading request is sent to the server, and when the server receives the version identifier downloading request sent by the client, the server sends the corresponding version identifier to the client according to a preset flow distribution rule and the version identifier downloading request. Specifically, a random hash is performed on a user name in a version identifier downloading request to obtain a hash value, a hash value group of a page flow of a version to which the hash value belongs is determined according to a preset flow distribution rule, then a mapping relation table of a pre-stored hash value group and version identifier information is queried, a version identifier corresponding to the hash value group is obtained, and the version identifier is issued to a client. For example, the preset flow splitting rule is that the splitting ratio of the comparison plate a, the experimental plate B, the comparison plate C and the comparison plate D is 20%, 40%, 20% and 20%, respectively, the hash value groups of the comparison plate a, the experimental plate B, the comparison plate C and the comparison plate D are [1,20], [21,60], [61,80] and [81,100], when the hash value group of the page flow of the version to which the hash value belongs is [1,20], the version identifier of the comparison plate a is issued to the client, when the hash value group of the page flow of the version to which the hash value belongs is [21,60], the version identifier of the experimental plate B is issued to the client, when the hash value group of the page flow of the version to which the hash value belongs is [61,80], the version identifier of the comparison plate C is issued to the client, and when the hash value group of the page flow of the version to which the hash value belongs is [81,100 ]. It should be noted that, the value range of the hash value may be set by those skilled in the art based on practical situations, and this embodiment is not limited to this, and may be selected as [1,100].
The specific version identifier issuing mode may also be that a server runs a preset random integer generating program to generate a random integer of 1-100, determines a random integer range where the random integer is located according to a preset flow distribution rule, queries a mapping relation table of a pre-stored random integer range and version identifiers, obtains a version identifier corresponding to the random integer range where the random integer is located, and issues the version identifier to a client. For example, the preset flow splitting rule is that the splitting ratio of the control plate A, the experimental plate B, the control plate C and the control plate D is 60%, 20%, 10% and 10%, respectively, then the random integer ranges include [1,60], [61,80], [81,90] and [91,100], when the random integer range where the random integer is located is [1,60], the version identification of the control plate A is issued to the client, when the random integer range where the random integer is located is [61,80], the version identification of the experimental plate B is issued to the client, when the random integer range where the random integer is located is [81,90], the version identification of the control plate C is issued to the client, and when the random integer range where the random integer is located is [91,100 ].
The triggering mode for starting the page flow experiment comprises timing starting, button starting and remote instruction starting, wherein the timing starting is to set a timer, the timer starts to count when the configuration of the basic information of the experiment is completed, and the page flow experiment starts to be executed when the counting time of the timer reaches a preset threshold value; the button opening is that a server is provided with an experiment starting button, and when the experiment starting button is monitored to be touched or clicked, page flow experiment is started to be executed; the remote instruction is started to transmit an experiment instruction carrying key information to the server through other trusted devices, when the server receives the experiment instruction carrying the key information, the server compares the local key information with the key information carried in the experiment instruction, and if the local key information and the key information are the same, the page flow experiment is started to be executed.
Further, after the server configures the experimental basic information, a white list is set for checking whether the client can execute the page flow of the corresponding version, a version identifier of the page flow of the corresponding version is issued to each client in the white list, and then the server receives the page flow execution result returned by each client to check whether the client can execute the page flow of the corresponding version.
Step S102, receiving user behavior data reported by a client and storing the user behavior data, wherein the client executes a page flow of a corresponding version based on a version identifier, collects the user behavior data when executing the page flow, and reports the user behavior data to a server;
In this embodiment, the server receives user behavior data including version identifiers reported by each client, and stores the user behavior data, where each client executes a corresponding page flow based on the version identifiers after receiving the version identifiers issued by the server, and collects the user behavior data in the process of executing the page flow, and reports the user behavior data including the version identifiers to the server, i.e., the client selects a page flow of a corresponding version according to the version identifiers, executes logic of the selected page flow, and then collects the user behavior data at a pre-buried point of the page in the process of executing the logic of the page flow. The user behavior data includes, but is not limited to, client identification, client type, version identification, URL address of the page where the click event occurs, page element content or target of the click event, event occurrence time, page jump time and page stay time. It should be noted that, the client has two page flows, through the version identifier, the client can enter the corresponding page flow, that is, when the version identifiers are the version identifiers corresponding to the comparison version a, the comparison version C and the comparison version D, the client enters the page flow of the old version, and when the version identifier is the version identifier corresponding to the experiment version B, the client enters the page flow of the new version.
In a specific implementation, in order to reduce the traffic loss and the power loss caused by continuously reporting the user behavior data, a data reporting policy may be set, including but not limited to a timing reporting policy, a batch reporting policy, a screen-off reporting policy, and a wireless network reporting policy, where it is to be noted that the foregoing data reporting policy may be set by a person skilled in the art based on actual situations, and this embodiment is not limited specifically.
Step S103, when a triggered experiment report generation instruction is monitored, generating a page flow experiment report according to stored user behavior data.
In this embodiment, when a triggered experiment report generation instruction is monitored, a page flow experiment report is generated according to stored user behavior data. The method comprises the steps that a triggering mode of an experiment report generating instruction comprises manual real-time triggering and conditional real-time triggering of a user, wherein the manual real-time triggering is that an experiment report generating button is arranged on a server, when the experiment report generating button is detected to be touched by the user, the experiment report generating instruction is triggered, the conditional real-time triggering is that the total access times of participating in page flow experiments are counted, and when the total access times are larger than or equal to a set value, the experiment report generating instruction is triggered.
The server obtains the stored user behavior data corresponding to each version identifier, analyzes the user behavior data corresponding to each version identifier to obtain experimental index values corresponding to the page flows, namely page access amount, independent visitor number, page preview number, page residence time, page jump rate, page click rate, click amount, investment conversion rate, exposure amount, return visit rate, return visit amount, order amount and/or scene conversion rate, and generates a page flow experimental report according to the experimental index values corresponding to the page flows, namely an experimental report template is obtained, and the experimental index values corresponding to the page flows of each version identifier are filled in the corresponding positions of the experimental report template.
The server judges whether the current page flow experiment is credible or not according to the experiment index value of the page flow corresponding to the first version identifier and the experiment index value of the page flow corresponding to the second version identifier, namely, calculates the difference value of the experiment index value of the page flow corresponding to the first version identifier and the experiment index value of the page flow corresponding to the second version identifier, judges whether the difference value is smaller than or equal to a preset difference value, if the difference value is smaller than or equal to the preset difference value, the current page flow experiment is determined to be credible, otherwise, if the difference value is larger than the preset difference value, the current page flow experiment is determined to be not credible; and if the current page flow experiment is credible, accumulating the experiment index value of the page flow corresponding to the first version identification with the experiment index value of the page flow corresponding to the second version identification to obtain an accumulated experiment index value, comparing the experiment index value of the page flow corresponding to the third version identification with the accumulated experiment index value to obtain an experiment index difference value of the page flow corresponding to the third version identification and the page flow corresponding to the first version identification or the second version identification, and finally generating a page flow experiment report according to the experiment index difference value. The page flows corresponding to the first version identifier and the second version identifier are old page flows, and the page flows corresponding to the third version identifier are new page flows.
In this embodiment, when receiving a version identifier downloading request sent by a client, the invention issues a corresponding version identifier to the client according to a preset flow distribution rule and the downloading request, then receives user behavior data reported by the client, stores the user behavior data, and finally generates a page flow experiment report according to the stored user behavior data when detecting a triggered experiment report generating instruction. By the method, an accurate experimental report of the version of the new page flow and the old page flow can be obtained, the experimental accuracy can be improved, and a better page flow can be accurately determined.
Further, based on the first embodiment, a second embodiment of the page flow experimental method of the present invention is provided, which is different from the foregoing embodiment in that, when the client executes the page flow, the step of collecting user behavior data and reporting the user behavior data to the server includes:
Step a, when a client executes a page flow, collecting user behavior data, and storing the collected user behavior data into a preset storage area;
in this embodiment, the client selects a page flow of a corresponding version according to the version identifier, executes logic of the selected page flow, and then collects user behavior data at a pre-buried point of the page and stores the collected user behavior data in a preset storage area in the process of executing logic of the page flow.
Step b, counting the total bytes of the user behavior data stored in the preset storage area at regular time, and judging whether the total bytes are larger than or equal to a preset threshold value;
In this embodiment, the client counts the total bytes of the user behavior data in the preset storage area at regular time, that is, counts the bytes of the user behavior data corresponding to the relevant version identifiers, accumulates the bytes of the user behavior data corresponding to the relevant version identifiers, obtains the total bytes of the user behavior data, and determines whether the total bytes are greater than or equal to a preset threshold. It should be noted that the above-mentioned preset threshold may be set by those skilled in the art based on practical situations, which is not particularly limited in this embodiment.
And c, if the total byte number is greater than or equal to a preset threshold value, reporting the version identification and the user behavior data in the preset storage area to a server.
In this embodiment, if the total number of bytes is greater than or equal to the preset threshold, the version identifier and the user behavior data in the preset storage area are reported to the server, and after the reporting is successful, the user behavior data in the preset storage area is deleted, and if the total number of bytes is less than the preset threshold, no processing is performed. In specific implementation, the client acquires the URL address of the current display page, judges whether the URL address is in a preset URL address group, reports the version identifier and the user behavior data in the preset storage area to the server if the URL address is in the preset URL address group, deletes the user behavior data in the preset storage area after the report is successful, and does not process if the URL address is not in the preset URL address group. The method for reporting the user behavior data can also be used for detecting whether the client is changed from a bright screen state to a dead screen state, reporting the user behavior data in a preset storage area to a server when the client is detected to be changed from the bright screen state to the dead screen state, deleting the user behavior data in the preset storage area after the client is successfully reported, further recording the duration time of the client in the dead screen state, reporting the user behavior data in the preset storage area to the server if the duration time of the device in the dead screen state exceeds a set value, and deleting the user behavior data in the preset storage area after the client is successfully reported; the method for reporting the user behavior data can also be that the client detects whether the current network environment is a wireless network environment, if the current network environment is the wireless network environment, the user behavior data in the preset storage area is reported to the server, and after the reporting is successful, the user behavior data in the preset storage area is deleted.
Further, before the client side reports the user behavior data, the user behavior data in the preset storage area is compressed, and the compressed user behavior data is reported to the server, so that the time and the flow consumed by reporting the data can be reduced.
In this embodiment, the present invention stores the user behavior data in the preset storage area, and when the stored user behavior data reaches a certain value, reports the user behavior data to the server, so that the traffic loss and the power loss caused by continuously reporting the user behavior data can be reduced.
In addition, the embodiment of the invention also provides a page flow experiment system.
Referring to fig. 3, fig. 3 is a schematic diagram of functional modules of a first embodiment of the page flow experimental system of the invention.
The page flow experimental system is a virtual system and is stored in the memory 1005 of the page flow experimental device shown in fig. 1, so as to realize all functions of the page flow experimental program; when receiving a version identifier downloading request sent by a client, issuing a corresponding version identifier to the client according to a preset flow diversion rule and the version identifier downloading request; receiving user behavior data reported by the client, and storing the user behavior data, wherein the client executes a page flow of a corresponding version based on the version identification, and when executing the page flow, collects the user behavior data, and reports the user behavior data to a server; when a triggered experiment report generation instruction is monitored, generating a page flow experiment report according to stored user behavior data.
Specifically, in this embodiment, the page flow experiment system includes:
The page flow experimental system comprises: a server 100 and a client 200, the server 100 comprising a transceiver module 101, a storage module 102 and a report generation module 103, wherein,
The transceiver module 101 is configured to, when receiving a version identifier downloading request sent by a client, send a corresponding version identifier to the client according to a preset traffic distribution rule and the version identifier downloading request;
the client 200 is configured to execute a page flow of a corresponding version based on the version identifier, collect user behavior data when executing the page flow, and report the user behavior data to a server
The storage module 102 is configured to receive user behavior data reported by the client, and store the user behavior data;
the report generating module 103 is configured to generate a page flow experiment report according to stored user behavior data when a triggered experiment report generating instruction is monitored.
Further, the transceiver module 101 is further configured to:
Carrying out random hash on the user name in the version identifier downloading request to obtain a hash value, and determining a hash value group of a page flow of a version to which the hash value belongs according to a preset flow diversion rule;
Inquiring a mapping relation table of a pre-stored hash value group and version identification information, acquiring a version identification corresponding to the hash value group, and transmitting the version identification to the client.
Further, the report generating module 103 is further configured to:
acquiring stored user behavior data corresponding to each version identifier respectively, and analyzing the user behavior data corresponding to each version identifier respectively to acquire experimental index values of page flows corresponding to each version identifier respectively;
and generating a page flow experiment report according to the experiment index values of the page flows respectively corresponding to the version identifiers.
Further, the report generating module 103 is further configured to:
Judging whether the current page flow experiment is credible or not according to the experiment index value of the page flow corresponding to the first version identification and the experiment index value of the page flow corresponding to the second version identification;
if the current page flow experiment is credible, accumulating the experiment index value of the page flow corresponding to the first version identification with the experiment index value of the page flow corresponding to the second version identification to obtain an accumulated experiment index value;
comparing the experimental index value of the page flow corresponding to the third version identification with the accumulated experimental index value to obtain an experimental index difference value of the page flow corresponding to the third version identification and the page flow corresponding to the first version identification or the second version identification;
and generating a page flow experiment report according to the experiment index difference value.
Further, the client 200 is further configured to:
When the page flow is executed, collecting user behavior data, and storing the collected user behavior data into a preset storage area;
Counting the total bytes of user behavior data stored in a preset storage area at fixed time, and judging whether the total bytes are larger than or equal to a preset threshold value;
and if the total byte number is greater than or equal to a preset threshold value, reporting the version identification and the user behavior data in the preset storage area to a server.
Further, the client 200 is further configured to:
acquiring a URL address of a current display page, and judging whether the URL address is in a preset URL address group or not;
if the URL address is in the preset URL address group, executing the steps of: and reporting the version identification and the user behavior data in the preset storage area to a server.
Further, the client 200 is further configured to:
compressing the user behavior data in the preset storage area, and reporting the compressed user behavior data to a server.
The function implementation of each module in the page flow experimental system corresponds to each step in the page flow experimental method embodiment, and the function and implementation process of each module are not described here again.
In addition, the embodiment of the invention also provides a readable storage medium.
The invention stores the page flow experimental program on the readable storage medium, wherein the page flow experimental program realizes the steps of the page flow experimental method when being executed by the processor.
The method implemented when the page flow experimental program is executed may refer to various embodiments of the page flow experimental method of the present invention, which are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (8)
1. The page flow experimental method is characterized by comprising the following steps of:
when receiving a version identifier downloading request sent by a client, issuing a corresponding version identifier to the client according to a preset flow diversion rule and the version identifier downloading request;
Receiving user behavior data reported by the client, and storing the user behavior data, wherein the client executes a page flow of a corresponding version based on the version identification, and when executing the page flow, collects the user behavior data, and reports the user behavior data to a server;
when a triggered experiment report generation instruction is monitored, generating a page flow experiment report according to stored user behavior data; wherein,
The step of generating the page flow experiment report according to the stored user behavior data comprises the following steps:
acquiring stored user behavior data corresponding to each version identifier respectively, and analyzing the user behavior data corresponding to each version identifier respectively to acquire experimental index values of page flows corresponding to each version identifier respectively;
Generating a page flow experiment report according to the experiment index values of the page flows respectively corresponding to the version identifiers; wherein,
The step of generating the page flow experiment report according to the experiment index values of the page flows respectively corresponding to the version identifiers comprises the following steps:
Judging whether the current page flow experiment is credible or not according to the experiment index value of the page flow corresponding to the first version identification and the experiment index value of the page flow corresponding to the second version identification;
if the current page flow experiment is credible, accumulating the experiment index value of the page flow corresponding to the first version identification with the experiment index value of the page flow corresponding to the second version identification to obtain an accumulated experiment index value;
comparing the experimental index value of the page flow corresponding to the third version identification with the accumulated experimental index value to obtain an experimental index difference value of the page flow corresponding to the third version identification and the page flow corresponding to the first version identification or the second version identification;
and generating a page flow experiment report according to the experiment index difference value.
2. The page flow experimental method of claim 1, wherein the step of issuing the corresponding version identifier to the client according to a preset traffic splitting rule and the version identifier downloading request comprises:
Carrying out random hash on the user name in the version identifier downloading request to obtain a hash value, and determining a hash value group of a page flow of a version to which the hash value belongs according to a preset flow diversion rule;
Inquiring a mapping relation table of a pre-stored hash value group and version identification information, acquiring a version identification corresponding to the hash value group, and transmitting the version identification to the client.
3. The page flow experimental method of any of claims 1-2, wherein the step of the client collecting user behavior data and reporting the user behavior data to a server when executing the page flow comprises:
When the client executes the page flow, collecting user behavior data, and storing the collected user behavior data into a preset storage area;
Counting the total bytes of user behavior data stored in a preset storage area at fixed time, and judging whether the total bytes are larger than or equal to a preset threshold value;
And if the total byte number is greater than or equal to a preset threshold value, reporting the user behavior data in a preset storage area to a server.
4. The page flow experimental method of claim 3, wherein the step of the client collecting user behavior data and storing the collected user behavior data in a preset storage area when executing the page flow, further comprises:
the client acquires the URL address of the current display page and judges whether the URL address is in a preset URL address group or not;
if the URL address is in the preset URL address group, executing the steps of: and reporting the version identification and the user behavior data in the preset storage area to a server.
5. The page flow experimental method of claim 3, wherein the step of reporting the user behavior data in the preset storage area to the server by the client comprises:
The client compresses the user behavior data in the preset storage area and reports the compressed user behavior data to the server.
6. The page flow experimental system is characterized by comprising a server and a client, wherein the server comprises a receiving and transmitting module, a storage module and a report generating module, and the receiving and transmitting module is used for transmitting a corresponding version identifier to the client according to a preset flow distribution rule and the version identifier downloading request when receiving the version identifier downloading request sent by the client;
The client is used for executing the page flow of the corresponding version based on the version identification, collecting user behavior data when executing the page flow, reporting the user behavior data to the storage module of the server, and receiving the user behavior data reported by the client and storing the user behavior data;
The report generation module is used for generating a page flow experiment report according to stored user behavior data when a triggered experiment report generation instruction is monitored; wherein,
The step of generating the page flow experiment report according to the stored user behavior data comprises the following steps:
acquiring stored user behavior data corresponding to each version identifier respectively, and analyzing the user behavior data corresponding to each version identifier respectively to acquire experimental index values of page flows corresponding to each version identifier respectively;
Generating a page flow experiment report according to the experiment index values of the page flows respectively corresponding to the version identifiers; wherein,
The step of generating the page flow experiment report according to the experiment index values of the page flows respectively corresponding to the version identifiers comprises the following steps:
Judging whether the current page flow experiment is credible or not according to the experiment index value of the page flow corresponding to the first version identification and the experiment index value of the page flow corresponding to the second version identification;
if the current page flow experiment is credible, accumulating the experiment index value of the page flow corresponding to the first version identification with the experiment index value of the page flow corresponding to the second version identification to obtain an accumulated experiment index value;
comparing the experimental index value of the page flow corresponding to the third version identification with the accumulated experimental index value to obtain an experimental index difference value of the page flow corresponding to the third version identification and the page flow corresponding to the first version identification or the second version identification;
and generating a page flow experiment report according to the experiment index difference value.
7. A page flow experimental device, characterized in that it comprises a processor, a memory, and a page flow experimental program stored on the memory and executable by the processor, wherein the page flow experimental program, when executed by the processor, implements the steps of the page flow experimental method according to any one of claims 1 to 5.
8. A readable storage medium, wherein a page flow experimental program is stored on the readable storage medium, wherein the page flow experimental program, when executed by a processor, implements the steps of the page flow experimental method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811202924.4A CN109634649B (en) | 2018-10-16 | 2018-10-16 | Page flow experimental method, system, equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811202924.4A CN109634649B (en) | 2018-10-16 | 2018-10-16 | Page flow experimental method, system, equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109634649A CN109634649A (en) | 2019-04-16 |
| CN109634649B true CN109634649B (en) | 2024-04-30 |
Family
ID=66066449
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811202924.4A Active CN109634649B (en) | 2018-10-16 | 2018-10-16 | Page flow experimental method, system, equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109634649B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111813648A (en) * | 2019-06-03 | 2020-10-23 | 北京嘀嘀无限科技发展有限公司 | Automatic testing method and device applied to App, storage medium and electronic equipment |
| CN112487325A (en) * | 2020-11-25 | 2021-03-12 | 北京字节跳动网络技术有限公司 | Data processing method and device, readable medium and electronic equipment |
| CN113095047A (en) * | 2021-04-12 | 2021-07-09 | 苏州创腾软件有限公司 | Experiment report generation method and device, computer equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6606657B1 (en) * | 1999-06-22 | 2003-08-12 | Comverse, Ltd. | System and method for processing and presenting internet usage information |
| CN107395614A (en) * | 2017-08-09 | 2017-11-24 | 深圳国泰安教育技术股份有限公司 | Single-point logging method and system |
-
2018
- 2018-10-16 CN CN201811202924.4A patent/CN109634649B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6606657B1 (en) * | 1999-06-22 | 2003-08-12 | Comverse, Ltd. | System and method for processing and presenting internet usage information |
| CN107395614A (en) * | 2017-08-09 | 2017-11-24 | 深圳国泰安教育技术股份有限公司 | Single-point logging method and system |
Non-Patent Citations (1)
| Title |
|---|
| 虚拟实验环境下通用实验报告***的设计与实现;许丹;汪诗林;;计算机工程与设计(18);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109634649A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109634649B (en) | Page flow experimental method, system, equipment and readable storage medium | |
| CN108737333B (en) | Data detection method and device | |
| CN107818133B (en) | Residential area network capacity analysis method and system based on big data | |
| RU2527754C2 (en) | System for generating statistical information and method of generating statistical information | |
| US20170109431A1 (en) | Method and apparatus for grouping network service users | |
| EP2287799A1 (en) | System and method for reporting advertisement measurement | |
| CN107026750B (en) | User Internet QoE evaluation method and device | |
| CN108334530B (en) | User behavior information analysis method, device and storage medium | |
| CN103678372B (en) | A kind of method and apparatus for obtaining the application performance of the page | |
| CN111148018B (en) | Method and device for identifying and positioning regional value based on communication data | |
| CN110322143B (en) | Model materialization management method, device, equipment and computer storage medium | |
| CN109885656B (en) | Microblog forwarding prediction method and device based on quantification heat degree | |
| CN113938430B (en) | Flow control method, device, equipment and storage medium | |
| CN111581258A (en) | Safety data analysis method, device, system, equipment and storage medium | |
| CN111158926A (en) | Service request analysis method, device and equipment | |
| CN107943678B (en) | Method for evaluating application access process and evaluation server | |
| EP3109789B1 (en) | Method and gateway device for obtaining file reputation and file reputation server | |
| CN112019546B (en) | Protection strategy adjusting method, system, equipment and computer storage medium | |
| CN110543509B (en) | Monitoring system, method and device for user access data and electronic equipment | |
| CN116094969B (en) | Bandwidth adjustment method, device, equipment and storage medium | |
| US11308212B1 (en) | Adjudicating files by classifying directories based on collected telemetry data | |
| WO2023045434A1 (en) | Access detection method, system, and apparatus | |
| CN110807052A (en) | User group classification method, device, equipment and storage medium | |
| CN106817710A (en) | The localization method and device of a kind of network problem | |
| CN110933068B (en) | Black and white list real-time optimization method and device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Floor 15, 1333 Lujiazui Ring Road, Pudong New Area (Shanghai) pilot Free Trade Zone, Shanghai 200000 Applicant after: Weikun (Shanghai) Technology Service Co.,Ltd. Address before: 2000 15/F, 1333 Lujiazui Ring Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai Applicant before: LUJINSUO (SHANGHAI) SCIENCE AND TECHNOLOGY SERVICES CO.,LTD. |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240401 Address after: K3, No. 155 Jijiamiao, Huaxiang, Fengtai District, Beijing, 100071 Applicant after: Beijing Zhixing Tongde Information Technology Co.,Ltd. Country or region after: China Address before: 15th Floor, No. 1333 Lujiazui Ring Road, Pudong New Area (Shanghai) Pilot Free Trade Zone, Shanghai, 200000 Applicant before: Weikun (Shanghai) Technology Service Co.,Ltd. Country or region before: China |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |