CN113204405A - Page data acquisition method, device, equipment and computer readable storage medium - Google Patents
Page data acquisition method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN113204405A CN113204405A CN202110555645.1A CN202110555645A CN113204405A CN 113204405 A CN113204405 A CN 113204405A CN 202110555645 A CN202110555645 A CN 202110555645A CN 113204405 A CN113204405 A CN 113204405A
- Authority
- CN
- China
- Prior art keywords
- data
- page data
- sub
- requests
- task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000004044 response Effects 0.000 claims description 30
- 238000007906 compression Methods 0.000 claims description 13
- 230000006835 compression Effects 0.000 claims description 13
- 238000012360 testing method Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 230000009467 reduction Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 238000013144 data compression Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the disclosure provides a page data acquisition method, a page data acquisition device, page data acquisition equipment and a computer-readable storage medium. The method comprises the steps of receiving a page data request from a client; generating a plurality of sub-data requests according to the page data request; asynchronously sending the sub data requests to a plurality of task services, so as to obtain data requested by the corresponding sub data requests through different task services in the plurality of task services, and obtain target page data requested by the page data requests; and sending the target page data to the client. In this way, the page data can be efficiently acquired according to the batch request of the back end on the basis of avoiding the batch request of the front end of the client, so that the efficiency is considered, the number of times of the front end request, namely the number of the external network requests, is reduced, and the problem of serious reduction of service throughput caused by the adoption of a one-time data pulling mode for fragmented data is solved.
Description
Technical Field
Embodiments of the present disclosure relate generally to the field of internet technology, and more particularly, to a page data acquisition method, apparatus, device, and computer-readable storage medium.
Background
At present, a plurality of front ends need to acquire data of a complex data structure to render a UI view of an APP or a server page, and the complex data may come from different data sources at the same time, that is, the front ends need to acquire a plurality of fragmented data and then integrate the fragmented data, thereby implementing rendering of the page. The existing data acquisition mode is that a front end directly sends batch requests to a background, so that fragmented data are respectively acquired through the batch requests and then page rendering is completed, and the method causes large pressure of the front end and many times of requests of an external network; or the front end only sends a data request to the background to perform one-time data pulling, which can cause the service throughput to be seriously reduced.
Disclosure of Invention
According to an embodiment of the present disclosure, a page data acquisition scheme is provided.
In a first aspect of the disclosure, a page data obtaining method is provided. The method comprises the following steps:
receiving a page data request from a client;
generating a plurality of sub-data requests according to the page data request;
asynchronously sending the sub data requests to a plurality of task services, so as to obtain data requested by the corresponding sub data requests through different task services in the plurality of task services, and obtain target page data requested by the page data requests;
And sending the target page data to the client.
The above-described aspect and any possible implementation manner further provide an implementation manner, where generating a plurality of sub-data requests according to the page data request includes:
and generating a corresponding sub data request for each page view according to one or more page views occupied by the target page data requested by the page data request.
The above-described aspect and any possible implementation manner further provide an implementation manner, where generating a plurality of sub-data requests according to the page data request includes:
splitting the page data request into the plurality of sub-data requests according to the association degree of each part of data in the target page data requested by the page data request, wherein the association degree of the data requested by different sub-data requests in the plurality of sub-data requests is lower than a preset association degree.
The above aspect and any possible implementation further provide an implementation in which the asynchronously sending the plurality of child data requests to a plurality of task services includes:
and distributing the plurality of sub-data requests to different task services according to the historical test response time of each task service in the plurality of task services, wherein the task service with longer historical test response time receives fewer sub-data requests.
The above-described aspects and any possible implementations further provide an implementation, and the method further includes:
when data requested by a corresponding sub data request is acquired through different task services in the plurality of task services, determining data acquisition response time lengths of the different task services;
when the data acquisition response time of any task service in the plurality of task services is longer than the preset response time, re-splitting the sub data request received by the any task service, and distributing the split data request for the any task service.
As to the above-mentioned aspects and any possible implementation manner, further providing an implementation manner, where the asynchronously sending the sub data requests to multiple task services to obtain, through different task services in the multiple task services, data requested by the corresponding sub data requests and obtain target page data requested by the page data request, includes:
asynchronously sending the plurality of sub-data requests to a plurality of task services through a gateway service;
receiving data responses of the different task services through a gateway service, wherein the data responses are data requested by corresponding sub data requests acquired by the different task services;
And encapsulating the data requested by the corresponding sub data request through a gateway service to obtain the target page data.
The above-described aspects and any possible implementations further provide an implementation, and the method further includes:
receiving the target page data sent by the gateway service through a load balancing service;
compressing the target page data through a load balancing service;
the sending the target page data to the client includes:
and sending the compressed target page data to the client through a load balancing service.
The above-described aspects and any possible implementations further provide an implementation, and the method further includes:
the load balancing service adjusts the compression ratio according to the load condition of the load balancing service;
compressing the target page data by the load balancing service includes:
and the load balancing service compresses the target page data according to the adjusted compression ratio.
In a second aspect of the present disclosure, a page data acquisition apparatus is provided. The device includes:
the receiving module is used for receiving a page data request from a client;
The generating module is used for generating a plurality of sub-data requests according to the page data requests;
the processing module is used for asynchronously sending the plurality of sub-data requests to a plurality of task services, so as to obtain data requested by the corresponding sub-data requests through different task services in the plurality of task services and obtain target page data requested by the page data requests;
and the sending module is used for sending the target page data to the client.
In a third aspect of the disclosure, an electronic device is provided. The electronic device includes: a memory having a computer program stored thereon and a processor implementing the method as described above when executing the program.
In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the method as according to the first and/or second aspect of the present disclosure.
It should be understood that the statements herein reciting aspects are not intended to limit the critical or essential features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like or similar reference characters designate like or similar elements, and wherein:
FIG. 1 shows a flow diagram of a method of page data acquisition according to an embodiment of the present disclosure;
FIG. 2 shows a flow diagram of another page data acquisition method according to an embodiment of the present disclosure;
FIG. 3 shows a block diagram of a page data acquisition device according to an embodiment of the present disclosure;
FIG. 4 illustrates a block diagram of an exemplary electronic device capable of implementing embodiments of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are some, but not all embodiments of the present disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
In addition, the term "and/or" herein is only one kind of association relationship describing an associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
According to the method and the device, a plurality of sub-data requests can be generated based on the page data request sent by the client, then the sub-data requests are distributed to different task services, different fragmented data are respectively obtained through the different task services, and the complete target page data requested by the page data request is finally obtained.
FIG. 1 shows a flow diagram for a page data acquisition method 100 according to an embodiment of the disclosure. The method 100 includes:
and acquiring the data requested by the corresponding sub data request through different task services, namely acquiring the data requested by the sub data request distributed for the task services through different task services.
Each task service may be assigned one or more sub data requests.
Different child data requests are used to request different portions of data in the target page data.
After receiving a page data request from a client, a plurality of sub-data requests can be generated according to the page data request, and then the sub-data requests are distributed to different task services, so that the data requested by the corresponding sub-data requests acquired by the different task services are integrated and other various processing is carried out, complete target page data requested by the page data request can be obtained, and the target page data is sent to the client.
In one embodiment, the generating a plurality of sub-data requests according to the page data request includes:
and generating a corresponding sub data request for each page view according to one or more page views occupied by the target page data requested by the page data request. One page view, i.e., one view control.
According to one or more page views occupied by target page data, a corresponding sub-data request can be generated for each page view, so that different sub-data requests can request data in different page views, and the request pressure of a front end can be reduced by reducing the request times of the front end in a mode that the background splits an original page data request into a plurality of sub-data requests; meanwhile, the serious reduction of service throughput caused by one-time data pulling of complex data can be avoided.
In one embodiment, the generating a plurality of sub-data requests according to the page data request includes:
splitting the page data request into the plurality of sub-data requests according to the association degree of each part of data in the target page data requested by the page data request, wherein the association degree of the data requested by different sub-data requests in the plurality of sub-data requests is lower than a preset association degree.
When the sub data request is generated, the page data request can be split into the plurality of sub data requests according to the relevance of each part of data in the target page data requested by the front-end page data request, so that the relevance of the data requested by different sub data requests is low, the independence is high, the same data is prevented from being requested repeatedly, and the data acquisition efficiency can be improved.
In addition, the way of generating the sub-request depending on the association degree in this embodiment may be combined with the way of generating the sub-request depending on the view in the previous embodiment, and preferably, this embodiment may be assisted, that is, on the basis of generating the sub-request depending on the view, the association degree is combined to adjust the particles of the view or directly perform optimization such as splitting or integrating on the generated sub-request.
In one embodiment, said asynchronously sending the number of child data requests to a plurality of task services comprises:
and distributing the plurality of sub-data requests to different task services according to the historical test response time of each task service in the plurality of task services, wherein the task service with longer historical test response time receives fewer sub-data requests.
Because the performances of different task services are different, the response time of each different task service can be tested in advance, then the plurality of sub-data requests are generated, and then the plurality of sub-data requests are distributed to the different task services according to the historical test response time of each task service, so that the sub-data requests can be reasonably distributed by specifically combining the performances of the different task services, for example, the number of sub-data requests received by the task service with longer historical test response time can be reduced, the performances of all the task services can be maximized as much as possible, and the data acquisition efficiency can be further improved.
The task services are essentially a process, and different task services can be distributed on different servers, that is, the number of the task services can be equal to or greater than the number of the servers, and the servers are close to each other and are basically located in the same machine room, so that a method of obtaining page data nearby, such as a Content Delivery Network (CDN), can be avoided, and the CDN obtaining method is generally applicable to storing public data rather than personalized data on the servers, and thus, the obtaining method disclosed by the present disclosure is beneficial to improving personalized data obtaining efficiency.
In one embodiment, the method further comprises:
when data requested by a corresponding sub data request is acquired through different task services in the plurality of task services, determining data acquisition response time lengths of the different task services;
when the data acquisition response time of any task service in the plurality of task services is longer than the preset response time, re-splitting the sub data request received by the any task service, and distributing the split data request for the any task service. The preset response time period may be freely set, such as 50 milliseconds.
When the data requested by the corresponding sub data request is acquired through different task services in the plurality of task services, if the data acquisition response time length of a certain task service in the plurality of task services is longer than the preset response time length, the data acquisition efficiency of the task service which is poor in performance at present is low, therefore, the sub data request received by the task service can be split again, the split data request is distributed to the task service, and the sub data request can be dynamically adjusted in real time according to the performance of the task service, so that the acquisition efficiency of fragmented data is fully improved.
In addition, by splitting the sub data request again, the performance of any task service with response time length longer than the preset response time length can be optimized, and certainly, the further optimization scheme can be capacity expansion, namely determining the service type of any task service, and then increasing the number of task services with the same type, which is equivalent to adopting the barrel principle, and can directionally and continuously perform performance optimization, so that the performance can be optimized to the utmost. For example: the types of the task services may be member services (for example, task services for requesting data related to an account and a balance), and user services (for example, task services for requesting personalized data such as personalized collection and personalized playing resources), and if the service type of any one task service is a user service, the amount of the user services may be increased to achieve capacity expansion.
In one embodiment, the asynchronously sending the sub data requests to a plurality of task services to obtain data requested by the corresponding sub data requests through different task services in the plurality of task services and obtain target page data requested by the page data request includes:
asynchronously sending the plurality of sub-data requests to a plurality of task services through a gateway service;
Receiving data responses of the different task services through a gateway service, wherein the data responses are data requested by corresponding sub data requests acquired by the different task services; the gateway service is also a process, which may be a process on the gateway.
And encapsulating the data requested by the corresponding sub data request through a gateway service to obtain the target page data.
The plurality of sub-data requests are sent to the plurality of task services through the gateway service, data responses of different task services can be received based on the gateway service, and then the data requested by the corresponding sub-data requests acquired by the different task services are packaged, so that complete target page data requested by a front-end client can be obtained, the requests are split and packaged through a background gateway, and efficient acquisition of fragmented data is achieved.
In one embodiment, the method further comprises:
receiving the target page data sent by the gateway service through a load balancing service;
compressing the target page data through a load balancing service;
the load balancing service may be a process on a load balancing server.
The sending the target page data to the client includes:
and sending the compressed target page data to the client through a load balancing service.
The target page data is automatically compressed through the load balancing service, so that the space occupied by the target page data can be reduced, and the data transmission efficiency can be improved when the compressed target page data is sent to the client side through the load balancing service.
In one embodiment, the method further comprises:
the load balancing service adjusts the compression ratio according to the load condition of the load balancing service;
compressing the target page data by the load balancing service includes:
and the load balancing service compresses the target page data according to the adjusted compression ratio.
The load balancing service can also dynamically adjust the compression ratio according to the load condition of the load balancing service, and then automatically compress the target page data by using the adjusted compression ratio, so that great pressure on the load balancing service due to data compression is avoided, and the compression ratio can be dynamically rationalized.
The technical solution of the present invention will be further explained with reference to fig. 2:
The method for efficiently providing the personalized complex data structure comprises the steps of firstly carrying out data blocking according to views (namely each block in a page and each view);
each block (i.e. data on view) corresponds to a data root node in a returned result; the data root node is the identifier of each block;
accessing the gateway service based on a request, realizing the access to the corresponding micro service according to the block allocation task, and returning the access to the gateway service according to an appointed data structure;
based on the scheme, the gateway service is responsible for asynchronously distributing tasks to each microservice;
the gateway service is finally responsible for assembling the data nodes;
performing data compression through web containers such as Nginx and the like, and transmitting the data to an App end through a network;
the App end renders each sub UI according to the data nodes;
a client (APP) initiates a request to load balancing (for example, a Nginx server, the compression ratio can be dynamically adjusted, and for example, the compression ratio is selected according to the load conditions of CPU and the like consumed after compression); load balancing transfers the request to a back-end gateway service; the gateway service sends a request to a back-end task service (micro service, which is a process on a server) asynchronously and concurrently according to the service scene; the task service continuously returns results to the gateway service; the gateway service encapsulates the result and then outputs the result to the responsible balance; and after the load balancing is responsible for compression, the compressed data is sent to the client, and the whole process of the request is completed.
It is noted that while for simplicity of explanation, the foregoing method embodiments have been described as a series of acts or combination of acts, it will be appreciated by those skilled in the art that the present disclosure is not limited by the order of acts, as some steps may, in accordance with the present disclosure, occur in other orders and concurrently. Further, those skilled in the art should also appreciate that the embodiments described in the specification are exemplary embodiments and that acts and modules referred to are not necessarily required by the disclosure.
The above is a description of embodiments of the method, and the embodiments of the apparatus are further described below.
Fig. 3 shows a block diagram of a page data acquisition apparatus 300 according to an embodiment of the present disclosure.
As shown in fig. 3, the apparatus 300 includes:
a receiving module 310, configured to receive a page data request from a client;
a generating module 320, configured to generate a plurality of sub-data requests according to the page data request;
the processing module 330 is configured to asynchronously send the multiple sub-data requests to multiple task services, so as to obtain, through different task services in the multiple task services, data requested by the corresponding sub-data requests, and obtain target page data requested by the page data request;
A sending module 340, configured to send the target page data to the client.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the described module may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
FIG. 4 shows a schematic block diagram of an electronic device 400 that may be used to implement embodiments of the present disclosure. The apparatus 400 may be used to implement the page data acquisition device of fig. 2. As shown in fig. 4, the device 400 includes a CPU401, which can perform various appropriate actions and processes according to computer program instructions stored in a ROM402 or loaded from a storage unit 408 into a RAM 403. In the RAM403, various programs and data required for the operation of the device 400 can also be stored. The CPU401, ROM402, and RAM403 are connected to each other via a bus 404. An I/O interface 405 is also connected to bus 404.
A number of components in device 400 are connected to I/O interface 405, including: an input unit 406 such as a keyboard, a mouse, or the like; an output unit 407 such as various types of displays, speakers, and the like; a storage unit 408 such as a magnetic disk, optical disk, or the like; and a communication unit 409 such as a network card, modem, wireless communication transceiver, etc. The communication unit 409 allows the device 400 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processing unit 401 performs the various methods and processes described above, such as the methods 100, 200. For example, in some embodiments, the methods 100, 200 may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 408. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 400 via the ROM 402 and/or the communication unit 409. When loaded into RAM 403 and executed by CPU 401, may perform one or more of the steps of methods 100, 200 described above. Alternatively, in other embodiments, the CPU 401 may be configured to perform the methods 100, 200 by any other suitable means (e.g., by way of firmware).
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a RAM, a ROM, an EPROM, an optical fiber, a CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
Further, while operations are depicted in a particular order, this should be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (10)
1. A page data acquisition method is characterized by comprising the following steps:
receiving a page data request from a client;
generating a plurality of sub-data requests according to the page data request;
asynchronously sending the sub data requests to a plurality of task services, so as to obtain data requested by the corresponding sub data requests through different task services in the plurality of task services, and obtain target page data requested by the page data requests;
and sending the target page data to the client.
2. The method of claim 1, wherein generating a number of child data requests from the page data request comprises:
generating a corresponding subdata request for each page view according to one or more page views occupied by target page data requested by the page data request; and/or
The generating a plurality of sub-data requests according to the page data request comprises:
splitting the page data request into the plurality of sub-data requests according to the association degree of each part of data in the target page data requested by the page data request, wherein the association degree of the data requested by different sub-data requests in the plurality of sub-data requests is lower than a preset association degree.
3. The method of claim 1,
the asynchronously sending the plurality of sub-data requests to a plurality of task services includes:
and distributing the plurality of sub-data requests to different task services according to the historical test response time of each task service in the plurality of task services, wherein the task service with longer historical test response time receives fewer sub-data requests.
4. The method of claim 1, further comprising:
when data requested by a corresponding sub data request is acquired through different task services in the plurality of task services, determining data acquisition response time lengths of the different task services;
when the data acquisition response time of any task service in the plurality of task services is longer than the preset response time, re-splitting the sub data request received by the any task service, and distributing the split data request for the any task service.
5. The method according to any one of claims 1 to 4, wherein the asynchronously sending the sub-data requests to a plurality of task services to obtain data requested by corresponding sub-data requests through different task services of the plurality of task services and obtain target page data requested by the page data request comprises:
asynchronously sending the plurality of sub-data requests to a plurality of task services through a gateway service;
receiving data responses of the different task services through a gateway service, wherein the data responses are data requested by corresponding sub data requests acquired by the different task services;
and encapsulating the data requested by the corresponding sub data request through a gateway service to obtain the target page data.
6. The method of claim 5, further comprising:
receiving the target page data sent by the gateway service through a load balancing service;
compressing the target page data through a load balancing service;
the sending the target page data to the client includes:
and sending the compressed target page data to the client through a load balancing service.
7. The method of claim 6, further comprising:
the load balancing service adjusts the compression ratio according to the load condition of the load balancing service;
compressing the target page data by the load balancing service includes:
and the load balancing service compresses the target page data according to the adjusted compression ratio.
8. A page data acquisition apparatus, comprising:
the receiving module is used for receiving a page data request from a client;
the generating module is used for generating a plurality of sub-data requests according to the page data requests;
the processing module is used for asynchronously sending the plurality of sub-data requests to a plurality of task services, so as to obtain data requested by the corresponding sub-data requests through different task services in the plurality of task services and obtain target page data requested by the page data requests;
and the sending module is used for sending the target page data to the client.
9. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program, wherein the processor, when executing the program, implements the method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110555645.1A CN113204405A (en) | 2021-05-21 | 2021-05-21 | Page data acquisition method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110555645.1A CN113204405A (en) | 2021-05-21 | 2021-05-21 | Page data acquisition method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113204405A true CN113204405A (en) | 2021-08-03 |
Family
ID=77030331
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110555645.1A Pending CN113204405A (en) | 2021-05-21 | 2021-05-21 | Page data acquisition method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113204405A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114301984A (en) * | 2022-01-18 | 2022-04-08 | 阿里巴巴新加坡控股有限公司 | Data request processing method and device and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106936925A (en) * | 2017-04-17 | 2017-07-07 | 广州孩教圈信息科技股份有限公司 | Load-balancing method and system |
| CN111324843A (en) * | 2020-02-17 | 2020-06-23 | 政采云有限公司 | Front-end request processing method, device, equipment and readable storage medium |
| CN111901383A (en) * | 2020-06-30 | 2020-11-06 | 深圳市金蝶天燕云计算股份有限公司 | Data request processing method and device, computer equipment and storage medium |
-
2021
- 2021-05-21 CN CN202110555645.1A patent/CN113204405A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106936925A (en) * | 2017-04-17 | 2017-07-07 | 广州孩教圈信息科技股份有限公司 | Load-balancing method and system |
| CN111324843A (en) * | 2020-02-17 | 2020-06-23 | 政采云有限公司 | Front-end request processing method, device, equipment and readable storage medium |
| CN111901383A (en) * | 2020-06-30 | 2020-11-06 | 深圳市金蝶天燕云计算股份有限公司 | Data request processing method and device, computer equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 张霞等: "《食品药品监管信息化工程概论》", 31 January 2018 * |
| 徐丽俊: "《构建大型银行开放平台***智能运维体系研究》", 31 October 2018 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114301984A (en) * | 2022-01-18 | 2022-04-08 | 阿里巴巴新加坡控股有限公司 | Data request processing method and device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7112919B2 (en) | Smart device task processing method and device | |
| CN105718540B (en) | Data loading method and device | |
| CN109887098B (en) | Web AR data presentation mode based on distributed computing | |
| CN111786939B (en) | Method, device and system for testing management platform of Internet of things | |
| CN113467910B (en) | Overload protection scheduling method based on service level | |
| CN109254854A (en) | Asynchronous invoking method, computer installation and storage medium | |
| CN111600920B (en) | JS-based data request proxy method, device, equipment and readable storage medium | |
| CN113204405A (en) | Page data acquisition method, device, equipment and computer readable storage medium | |
| CN112422450A (en) | Computer equipment, and flow control method and device for service request | |
| CN111427899A (en) | Method, device, equipment and computer readable medium for storing file | |
| CN112084042A (en) | Message processing method and device | |
| CN111800223A (en) | Method, device and system for generating sending message and processing receiving message | |
| CN110764769A (en) | Method and device for processing user request | |
| CN115858905A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN110120959B (en) | Big data pushing method, device, system, equipment and readable storage medium | |
| CN113630327B (en) | Flow control method and device, electronic equipment and computer readable medium | |
| CN112149392A (en) | Rich text editing method and device | |
| CN109471574B (en) | Method and device for configuring resources | |
| CN113485902B (en) | Method, device, equipment and computer readable medium for testing service platform | |
| CN115454666A (en) | Data synchronization method and device among message queue clusters | |
| CN114265692A (en) | Service scheduling method, device, equipment and storage medium | |
| CN112131095B (en) | Pressure testing method and device | |
| CN113568706A (en) | Container adjusting method and device for service, electronic equipment and storage medium | |
| CN112398915A (en) | APP application auditing method and system of cloud rendering platform | |
| CN113132480B (en) | Data transmission method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210803 |
|
| RJ01 | Rejection of invention patent application after publication |