CN106095597A - Client data processing method and processing device - Google Patents
Client data processing method and processing device Download PDFInfo
- Publication number
- CN106095597A CN106095597A CN201610370451.3A CN201610370451A CN106095597A CN 106095597 A CN106095597 A CN 106095597A CN 201610370451 A CN201610370451 A CN 201610370451A CN 106095597 A CN106095597 A CN 106095597A
- Authority
- CN
- China
- Prior art keywords
- data
- client
- pipeline
- layer
- extracted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 26
- 238000000034 method Methods 0.000 claims abstract description 82
- 230000008569 process Effects 0.000 claims abstract description 77
- 239000000284 extract Substances 0.000 claims abstract description 23
- 238000010586 diagram Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 4
- 238000000605 extraction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000007493 shaping process Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/544—Buffers; Shared memory; Pipes
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a kind of client data processing method, described client data processing method comprises the following steps: the data received, when receiving the data that each client sends, are stored in default relief area by described I O layer；Described distributing layer extracts the data of storage from described default relief area, and the described data extracted is pressed in corresponding pipeline according to the classification of the data extracted；Data in each pipeline are processed by described process layer accordingly.The invention also discloses a kind of client data processing means.The present invention solves server when processing the request of client, owing to read requests and the request that processes are carried out in same thread, may result in the problem that the confusion in code logic and data-handling efficiency reduce.
Description
Technical field
The present invention relates to technical field of data processing, particularly relate to a kind of client data processing method and processing device.
Background technology
Major part server is to process client request based on sequential iteration, namely waits client request, then reads
Request, processes request, replys response.But when processing request, need the substantial amounts of cpu time, can cause other client
Not in time, this is accomplished by a kind of settling mode, and common settling mode is exactly concurrent in response.Specifically, it is simply that for each
Client one thread of distribution processes, and when there being new client request to come in, creates a thread for it and it needs to for this
Individual thread one socket (commonly referred to as " socket ") of distribution and port (port) carry out I/O operation.But, use this
When the mode of kind carries out I/O operation, owing to read requests and the request that processes are carried out in same thread, when multiple clients are same
Time when making requests on, the confusion in code logic may be caused, and then cause data-handling efficiency to reduce.
Foregoing is only used for auxiliary and understands technical scheme, does not represent and recognizes that foregoing is existing skill
Art.
Summary of the invention
Present invention is primarily targeted at a kind of client data processing method and processing device of offer, it is intended to settlement server exists
When processing the request of client, owing to read requests and the request that processes are carried out in same thread, may result in code and patrol
Confusion on Ji and the problem of data-handling efficiency reduction.
For achieving the above object, a kind of client data processing method that the present invention provides, it is applied in server, described
Server includes I O layer, distributing layer and processes layer, and described client data processing method comprises the following steps:
The data received, when receiving the data that each client sends, are stored in default buffering by described I O layer
Qu Zhong；
Described distributing layer extracts the data of storage from described default relief area, and according to the classification of the data extracted
By in pipeline corresponding for the described data press-in extracted；
Data in each pipeline are processed by described process layer accordingly.
Alternatively, the data received, when receiving the data that each client sends, are stored in pre-by described I O layer
If relief area in step include:
Described I O layer, when receiving the data that each client sends, obtains the address of the client sending described data
Information；
Described address information is added the head to the described data received by described I O layer；
The described data including header information are stored in default relief area by described I O layer.
Alternatively, described distributing layer extracts the data of storage from described default relief area, and according to the number extracted
According to classification the step in pipeline corresponding for the described data extracted press-in is included:
Described distributing layer extracts the data of storage from described default relief area, and according to the head of the data extracted
The described data extracted are classified by information；
Described distributing layer sets up corresponding pipeline according to the classification of the described data extracted；
Described distributing layer is by the pipeline of the described data press-in correspondence extracted.
Alternatively, described distributing layer, by before the step in the pipeline of the described data press-in correspondence extracted, also includes:
The header information of the described data extracted is removed by described distributing layer.
Alternatively, the step that the data in each pipeline are processed by described process layer accordingly includes:
Described process layer be each pipeline distribute a worker thread, with by described worker thread to the data in pipeline
Process accordingly.
Additionally, for achieving the above object, the present invention also provides for a kind of client data processing means, described client data
Processing means includes；
Memory module, for when receiving the data that each client sends, being stored in default by the data received
Relief area in；
Press-in module, for extracting the data of storage, and according to the data extracted from described default relief area
Classification is by the pipeline of the described data press-in correspondence extracted；
Processing module, for processing accordingly the data in each pipeline.
Alternatively, described memory module includes:
Acquiring unit, for when receiving the data that each client sends, obtains the client sending described data
Address information；
Adding device, for adding the head to the described data received by described address information；
Memory element, for being stored in default relief area by the described data including header information.
Alternatively, described press-in module includes:
Taxon, for extracting the data of storage, and according to the data extracted from described default relief area
The described data extracted are classified by header information；
Set up unit, set up corresponding pipeline for the classification according to the described data extracted；
Press-in unit, in the pipeline of the described data press-in correspondence that will extract.
Alternatively, described press-in module also includes:
Remove unit, for being removed by the header information of the described data extracted.
Alternatively, described processing module, it is additionally operable to distribute a worker thread, with by described active line into each pipeline
Data in pipeline are processed by journey accordingly.
The client data processing method and processing device that the present invention proposes, is sent out receiving each client by described I O layer
During the data sent, the data received are stored in default relief area；Described distributing layer is from described default relief area
Extract the data of storage, and according to the classification of the data extracted, the described data extracted are pressed in corresponding pipeline；Institute
State process layer the data in each pipeline are processed accordingly.The request of client is carried out by the mode using Multilevel method
Process so that read requests and process in asking client ask the no longer same layer to process, it is to avoid when receive
The code of the read requests of multiple clients with process the code of request due in the code logic that may cause within the same layer
Confusion, by multiple layers, the data of client are processed simultaneously, improve to client data process efficiency.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the first embodiment of client data processing method of the present invention；
Fig. 2 be I O layer in Fig. 1 of the present invention when receiving the data that each client sends, the data received are deposited
The step refinement schematic flow sheet being stored in default relief area；
Fig. 3 is the data that the distributing layer in Fig. 1 extracts storage from described default relief area, and according to the number extracted
According to classification by the step refinement schematic flow sheet in pipeline corresponding for the described data press-in extracted；
Fig. 4 is the data that the distributing layer in Fig. 1 of the present invention extracts storage from described default relief area, and according to extraction
To the classification of data by another step refinement schematic flow sheet in pipeline corresponding for the described data press-in extracted；
Fig. 5 is the high-level schematic functional block diagram of the first embodiment of client data processing means of the present invention；
Fig. 6 is the refinement high-level schematic functional block diagram of the memory module in Fig. 5 of the present invention；
Fig. 7 is the refinement high-level schematic functional block diagram of the press-in module in Fig. 5 of the present invention；
Fig. 8 is another refinement high-level schematic functional block diagram of the press-in module in Fig. 5 of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further referring to the drawings.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
Based on the problems referred to above, the present invention provides a kind of client data processing method, is applied in server, described service
Device includes I O layer, distributing layer and processes layer.
Schematic flow sheet with reference to the first embodiment that Fig. 1, Fig. 1 are client data processing method of the present invention.
In the present embodiment, described client data processing method includes:
Step S10, the data received, when receiving the data that each client sends, are stored in pre-by described I O layer
If relief area in；
The client data processing method that the present invention provides, the difference with existing technical scheme is to use layered shaping
Mode the data of client are processed, the treatment effeciency of the data to client can be improved.Concrete, in the present invention
Server logic on can be divided into three layers, respectively I O layer, distributing layer and process layer.Described I O layer is based on completing port
, IO completing port is a kind of mechanism, and by this mechanism, first application program can create a thread pool, so on startup
After this application program use thread pool process asynchronous I/O request.The sole purpose that these threads are created is exactly for processing I/O
Request.For processing the application program of a large amount of concurrent asynchronous I/O request, create thread compared to when I/O request occurs
For, use that completing port just can do faster and more efficiently.Owing to described I O layer is based on completing port, therefore,
Described I O layer is when receiving the data that each client sends, when i.e. receiving the I/O request of each client, and can be at once
Using the multiple threads in this I O layer to read the data that client sends, each thread reads the I/O request of a client,
After receiving the data that client sends, these data received are stored in default relief area.Described default relief area is
The storage at the end of the pipeline buffer that the worker thread of described I O layer pre-builds is interval.The most each I O layer will receive
When data are stored in pipeline, it it is all the storage interval storing data in the interval most end of the residue storage in pipeline buffer
In.In the present embodiment, described I O layer only receives the data that each client sends, and data not sent each client
Process, i.e. the I/O of each client is asked to be read out by the worker thread in I O layer, and not to each client
Request processes.
Step S20, described distributing layer extracts the data of storage from described default relief area, and according to the number extracted
According to classification by pipeline corresponding for the described data press-in extracted；
Described distributing layer checks in the default memory block in pipeline whether there are data in real time or at that time, if in described pipeline
Pre-set buffer district in there are data, the most described distributing layer reads the data of storage from the default memory block of this pipeline.Specifically
, described distributing layer can extract the data in this pipeline pre-set buffer district by the worker thread in this floor, is extracting number
According to rear, determining the classification of the data extracted, i.e. these data extracted are the data which client is sent, and carry determining
After the classification of the data got, by pipeline corresponding for the press-in of these data.Described distributing layer can be according to the data extracted
Classification sets up pipeline, in the pipeline that the press-in of same class other data is identical, and different classes of data press-in different pieces of information classification
In corresponding pipeline.When described distributing layer often determines a new classification according to the data extracted, with regard to a newly created pipeline,
Data for the category can be pressed in the pipeline of correspondence.
Step S30, the data in each pipeline are processed by described process layer accordingly.
Owing to each pipeline correspond to a long-range client, therefore, described process layer can be to each client
The data sent process.
Specifically, described step S30 includes: described process layer is that each pipeline distributes a worker thread, to pass through
State worker thread the data in pipeline are processed accordingly.
Described process layer is one worker thread of distribution in each pipeline, is entered the data in pipeline by this worker thread
Row reads, and deposits, and processes, and the operation such as response.Simultaneously as each pipeline is all assigned with a worker thread, therefore right
Temporarily interruption when data in each pipeline carry out processing operation does not interferes with process and the response of the data of other clients.
The present embodiment is by described I O layer when receiving the data that each client sends, and the data that will receive store
In default relief area；Described distributing layer extracts the data of storage from described default relief area, and according to extracting
The classification of data is by the pipeline of the described data press-in correspondence extracted；Data in each pipeline are carried out by described process layer
Corresponding process.The request of client is processed by the mode using Multilevel method so that the reading in asking client
Request and process and ask the no longer same layer to process, it is to avoid when the code of read requests and the place that receive multiple client
The code of reason request is due to the confusion in the code logic that may cause within the same layer, simultaneously by multiple layers to client
Data process, and improve the efficiency processing client data.
Further, with reference to the flow process signal of the second embodiment that Fig. 2, Fig. 2 are client data processing method of the present invention
Figure.First embodiment based on above-mentioned client data processing method, described step S10 includes:
Step S11, described I O layer, when receiving the data that each client sends, obtains the client sending described data
The address information of end；
Step S12, described address information is added the head to the described data received by described I O layer；
Step S13, the described data including header information are stored in default relief area by described I O layer.
Address information is not comprised, the data i.e. received owing to described I O layer receives in the data that each client sends
In do not comprise the address information of client sending these data, described address information includes local address and the port of client
Number, such as, local address: 192.168.1.99, port numbers: 2400.Therefore, the data in order to send each client are carried out
Classification difference, needs, when receiving the data that each client sends, to obtain the address information of the client sending these data,
I.e. obtaining local address and the port numbers of the client sending these data, described I O layer can be carried out with server by client
The socket that communication creates obtains the address information of the client sending described data.Described I O layer is getting described in transmission
After the address information of the client of data, described address information is added the head to the described data received so that receive
To data all include the address information of data source, thus for distributing layer, this is received data and carries out forward process and improve
Necessary identification information.Address information is being added to the head of the data received by I O layer, and this is included the institute of head
State data and be stored in default relief area.
The present embodiment when receiving the data that each client sends by described I O layer, is obtained and sends described data
The address information of client, and described address information is added the head to the described data received, thus be described distribution
Layer receives data to this to carry out forward process and improves the identification information of necessity so that described distributing layer can accurately will respectively
The data that individual client sends are distributed in each request processing thread.
Further, with reference to the flow process signal of the 3rd embodiment that Fig. 3, Fig. 3 are client data processing method of the present invention
Figure.The second embodiment based on above-mentioned client data processing method, described step S20 includes:
Step S21, described distributing layer extracts the data of storage from described default relief area, and according to the number extracted
According to header information the described data extracted are classified；
Step S22, described distributing layer sets up corresponding pipeline according to the classification of the described data extracted；
Step S23, described distributing layer is by the pipeline of the described data press-in correspondence extracted.
Described distributing layer is after the data extracting storage from described default relief area, to the described data extracted
Classify.Concrete, described distributing layer is classified according to the header information of the data extracted, due to the data extracted
The address information that header information is client, therefore when the data extracting each are classified, header information is consistent
Data be divided into a class, the inconsistent data of header information are divided into different classifications.After the data extracted are classified,
Described distributing layer sets up corresponding pipeline according to the classification of data, and the data of each class are set up a pipeline, be there are how many classes
Other data just set up how many pipelines, and the data such as extracted always co-exist in 8 classes, then need to set up 8 pipelines.Described point
Send out layer when setting up pipeline, can not find that the data of a new classification just set up a new pipeline, however, it is determined that this extraction
Data be the data of existing classification, then need not resettle pipeline.Distributing layer, can be by each classification after setting up pipeline
Data are respectively pressed in the pipeline corresponding with its classification.
The present embodiment is by all setting up a corresponding pipeline for every class data so that the process to each client data
Much sooner, accurately, will not confusion reigned.
Further, with reference to the flow process signal of the 4th embodiment that Fig. 4, Fig. 4 are client data processing method of the present invention
Figure.The 3rd embodiment based on above-mentioned client data processing method, before described step S23, also includes:
Step S24, the header information of the described data extracted is removed by described distributing layer.
Described distributing layer is after the classification according to the data extracted sets up corresponding pipeline, due to the data extracted
The address information that header information is client, this information effect be only distributing layer determine the number that will extract according to this information
Which according to being pressed in pipeline, therefore after determining the pipeline that the data extracted need press-in, in order to save memory space, then exist
Before these data extracted press-in pipeline, the header information of these data extracted can be removed, in order to process layer right
These data process.Further, the step that the header information of the described data extracted removes also may be used by described distributing layer
To be performed by described process layer, i.e. before the data in pipeline are processed by described process layer, first by the head of pending data
Portion removes, and processes these data the most accordingly.
Before the present embodiment is by the pipeline corresponding in the data press-in that will extract, the header information of these data is moved
Remove, thus save memory space.
The present invention further provides a kind of client data processing means.
High-level schematic functional block diagram with reference to the first embodiment that Fig. 5, Fig. 5 are client data processing means of the present invention.
In the present embodiment, described client data processing means includes: memory module 10, press-in module 20 and process mould
Block 30.
Described memory module 10, for when receiving the data that each client sends, the data that will receive store
In default relief area；
With the difference of existing technical scheme, technical scheme is that the mode using layered shaping is to client
Data process, the treatment effeciency of the data to client can be improved.Concrete, in the server logic in the present invention
Three layers can be divided into, respectively I O layer, distributing layer and process layer.Described I O layer based on completing port, IO completing port is
A kind of mechanism, by this mechanism, first application program can create a thread pool on startup, and then this application program uses
Thread pool processes asynchronous I/O request.The sole purpose that these threads are created is exactly for processing I/O request.Big for processing
For the application program of amount concurrent asynchronous I/O request, for creating thread when I/O request occurs, use end
Mouth just can do faster and more efficiently.Owing to described I O layer is based on completing port, therefore, described I O layer is receiving
During the data that each client sends, when i.e. receiving the I/O request of each client, can use in this I O layer many at once
Individual thread reads the data that client sends, and each thread reads the I/O request of a client, sends receiving client
Data after these data received are stored in default relief area.Described default relief area is the active line of described I O layer
The storage at the end of the pipeline buffer that journey pre-builds is interval.The data received are being stored in pipeline by the most each I O layer
Time, it is all in the storage interval storing data in the interval most end of the residue storage in pipeline buffer.At the present embodiment
In, described I O layer only receives the data that each client sends, and the data not sent each client process, i.e. IO
Worker thread in Ceng only I/O to each client asks to be read out, and request to each client does not processes.
Described press-in module 20, for extracting the data of storage, and according to extracting from described default relief area
The classification of data is by the pipeline of the described data press-in correspondence extracted；
Described distributing layer checks in the default memory block in pipeline whether there are data in real time or at that time, if in described pipeline
Pre-set buffer district in there are data, the most described distributing layer reads the data of storage from the default memory block of this pipeline.Specifically
, described distributing layer can extract the data in this pipeline pre-set buffer district by the worker thread in this floor, is extracting number
According to rear, determining the classification of the data extracted, i.e. these data extracted are the data which client is sent, and carry determining
After the classification of the data got, by pipeline corresponding for the press-in of these data.Described distributing layer can be according to the data extracted
Classification sets up pipeline, in the pipeline that the press-in of same class other data is identical, and different classes of data press-in different pieces of information classification
In corresponding pipeline.When described distributing layer often determines a new classification according to the data extracted, with regard to a newly created pipeline,
Data for the category can be pressed in the pipeline of correspondence.
Described processing module 30, for processing accordingly the data in each pipeline.
Owing to each pipeline correspond to a long-range client, therefore, described process layer can be to each client
The data sent process.
Specifically, described processing module 30, it is additionally operable to distribute a worker thread, with by described work into each pipeline
Data in pipeline are processed by thread accordingly.
Described process layer is one worker thread of distribution in each pipeline, is entered the data in pipeline by this worker thread
Row reads, and deposits, and processes, and the operation such as response.Simultaneously as each pipeline is all assigned with a worker thread, therefore right
Temporarily interruption when data in each pipeline carry out processing operation does not interferes with process and the response of the data of other clients.
The present embodiment is by described I O layer when receiving the data that each client sends, and the data that will receive store
In default relief area；Described distributing layer extracts the data of storage from described default relief area, and according to extracting
The classification of data is by the pipeline of the described data press-in correspondence extracted；Data in each pipeline are carried out by described process layer
Corresponding process.The request of client is processed by the mode using Multilevel method so that the reading in asking client
Request and process and ask the no longer same layer to process, it is to avoid when the code of read requests and the place that receive multiple client
The code of reason request is due to the confusion in the code logic that may cause within the same layer, simultaneously by multiple layers to client
Data process, and improve the efficiency processing client data.
Further, with reference to the functional module of the second embodiment that Fig. 6, Fig. 6 are client data processing means of the present invention
Schematic diagram.First embodiment based on above-mentioned client data processing means, described memory module 10 includes: acquiring unit 11,
Adding device 12 and memory element 13.
Described acquiring unit 11, for when receiving the data that each client sends, obtains and sends described data
The address information of client；
Described adding device 12, for adding the head to the described data received by described address information；
Described memory element 13, for being stored in default relief area by the described data including header information.
Address information is not comprised, the data i.e. received owing to described I O layer receives in the data that each client sends
In do not comprise the address information of client sending these data, described address information includes local address and the port of client
Number, such as, local address: 192.168.1.99, port numbers: 2400.Therefore, the data in order to send each client are carried out
Classification difference, needs, when receiving the data that each client sends, to obtain the address information of the client sending these data,
I.e. obtaining local address and the port numbers of the client sending these data, described I O layer can be carried out with server by client
The socket that communication creates obtains the address information of the client sending described data.Described I O layer is getting described in transmission
After the address information of the client of data, described address information is added the head to the described data received so that receive
To data all include the address information of data source, thus for distributing layer, this is received data and carries out forward process and improve
Necessary identification information.Address information is being added to the head of the data received by I O layer, and this is included the institute of head
State data and be stored in default relief area.
The present embodiment when receiving the data that each client sends by described I O layer, is obtained and sends described data
The address information of client, and described address information is added the head to the described data received, thus be described distribution
Layer receives data to this to carry out forward process and improves the identification information of necessity so that described distributing layer can accurately will respectively
The data that individual client sends are distributed in each request processing thread.
Further, with reference to the functional module of the 3rd embodiment that Fig. 7, Fig. 7 are client data processing means of the present invention
Schematic diagram.The second embodiment based on above-mentioned client data processing means, described press-in module 20 includes: taxon 21,
Set up unit 22 and press-in unit 23.
Described taxon 21, for extracting the data of storage, and according to extracting from described default relief area
The described data extracted are classified by the header information of data；
Described set up unit 22, set up corresponding pipeline for the classification according to the described data extracted；
Described press-in unit 23, in the pipeline of the described data press-in correspondence that will extract.
Described distributing layer is after the data extracting storage from described default relief area, to the described data extracted
Classify.Concrete, described distributing layer is classified according to the header information of the data extracted, due to the data extracted
The address information that header information is client, therefore when the data extracting each are classified, header information is consistent
Data be divided into a class, the inconsistent data of header information are divided into different classifications.After the data extracted are classified,
Described distributing layer sets up corresponding pipeline according to the classification of data, and the data of each class are set up a pipeline, be there are how many classes
Other data just set up how many pipelines, and the data such as extracted always co-exist in 8 classes, then need to set up 8 pipelines.Described point
Send out layer when setting up pipeline, can not find that the data of a new classification just set up a new pipeline, however, it is determined that this extraction
Data be the data of existing classification, then need not resettle pipeline.Distributing layer, can be by each classification after setting up pipeline
Data are respectively pressed in the pipeline corresponding with its classification.
The present embodiment is by all setting up a corresponding pipeline for every class data so that the process to each client data
Much sooner, accurately, will not confusion reigned.
Further, with reference to the functional module of the 4th embodiment that Fig. 8, Fig. 8 are client data processing means of the present invention
Schematic diagram.The 3rd embodiment based on above-mentioned client data processing means, described press-in module 20 also includes: remove unit
24。
Described remove unit 24, for being removed by the header information of the described data extracted.
Described distributing layer is after the classification according to the data extracted sets up corresponding pipeline, due to the data extracted
The address information that header information is client, this information effect be only distributing layer determine the number that will extract according to this information
Which according to being pressed in pipeline, therefore after determining the pipeline that the data extracted need press-in, in order to save memory space, then exist
Before these data extracted press-in pipeline, the header information of these data extracted can be removed, in order to process layer right
These data process.Further, the step that the header information of the described data extracted removes also may be used by described distributing layer
To be performed by described process layer, i.e. before the data in pipeline are processed by described process layer, first by the head of pending data
Portion removes, and processes these data the most accordingly.
Before the present embodiment is by the pipeline corresponding in the data press-in that will extract, the header information of these data is moved
Remove, thus save memory space.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.By above embodiment party
The description of formula, those skilled in the art it can be understood that can add required general to above-described embodiment method by software
The mode of hardware platform realizes, naturally it is also possible to by hardware, but a lot of in the case of the former is more preferably embodiment.Based on
Such understanding, the part that prior art is contributed by technical scheme the most in other words can be with software product
Form embody, this computer software product is stored in a storage medium (such as ROM/RAM, magnetic disc, CD), including
Some instructions are with so that a station terminal equipment (can be mobile phone, computer, server, air-conditioner, or the network equipment etc.)
Perform the method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every utilize this
Equivalent structure or equivalence flow process that bright description and accompanying drawing content are made convert, or are directly or indirectly used in other relevant skills
Art field, is the most in like manner included in the scope of patent protection of the present invention.
Claims (10)
1. a client data processing method, is applied in server, it is characterised in that described server includes I O layer, divides
Sending out layer and process layer, described client data processing method comprises the following steps:
The data received, when receiving the data that each client sends, are stored in default relief area by described I O layer
In；
Described distributing layer extracts the data of storage from described default relief area, and will carry according to the classification of the data extracted
In the pipeline of the described data press-in correspondence got；
Data in each pipeline are processed by described process layer accordingly.
2. client data processing method as claimed in claim 1, it is characterised in that described I O layer is receiving each client
During the data that end sends, the step that the data received are stored in default relief area is included:
Described I O layer, when receiving the data that each client sends, obtains the address letter of the client sending described data
Breath；
Described address information is added the head to the described data received by described I O layer；
The described data including header information are stored in default relief area by described I O layer.
3. client data processing method as claimed in claim 2, it is characterised in that described distributing layer is from described default delaying
Rush the data extracting storage in district, and according to the classification of the data extracted, the described data extracted are pressed into corresponding pipeline
In step include:
Described distributing layer extracts the data of storage from described default relief area, and according to the header information of the data extracted
The described data extracted are classified；
Described distributing layer sets up corresponding pipeline according to the classification of the described data extracted；
Described distributing layer is by the pipeline of the described data press-in correspondence extracted.
4. client data processing method as claimed in claim 3, it is characterised in that described in described distributing layer will extract
Before step in the pipeline that data press-in is corresponding, also include:
The header information of the described data extracted is removed by described distributing layer.
5. the client data processing method as described in any one of Claims 1-4, it is characterised in that described process layer is to respectively
The step that data in individual pipeline process accordingly includes:
Described process layer is that each pipeline distributes a worker thread, to be carried out the data in pipeline by described worker thread
Corresponding process.
6. a client data processing means, it is characterised in that described client data processing means includes；
The data received, for when receiving the data that each client sends, are stored in default delaying by memory module
Rush in district；
Press-in module, for extracting the data of storage, and according to the classification of the data extracted from described default relief area
By in pipeline corresponding for the described data press-in extracted；
Processing module, for processing accordingly the data in each pipeline.
7. client data processing means as claimed in claim 6, it is characterised in that described memory module includes:
Acquiring unit, for when receiving the data that each client sends, obtains the ground of the client sending described data
Location information；
Adding device, for adding the head to the described data received by described address information；
Memory element, for being stored in default relief area by the described data including header information.
8. client data processing means as claimed in claim 7, it is characterised in that described press-in module includes:
Taxon, for extracting the data of storage, and according to the head of the data extracted from described default relief area
The described data extracted are classified by information；
Set up unit, set up corresponding pipeline for the classification according to the described data extracted；
Press-in unit, in the pipeline of the described data press-in correspondence that will extract.
9. client data processing means as claimed in claim 7, it is characterised in that described press-in module also includes:
Remove unit, for being removed by the header information of the described data extracted.
10. the client data processing means as described in any one of claim 69, it is characterised in that described processing module,
It is additionally operable to distribute a worker thread, the data in pipeline to be located accordingly by described worker thread for each pipeline
Reason.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610370451.3A CN106095597B (en) | 2016-05-30 | 2016-05-30 | Client data processing method and processing device |
| PCT/CN2017/080837 WO2017206601A1 (en) | 2016-05-30 | 2017-04-18 | Client data processing method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610370451.3A CN106095597B (en) | 2016-05-30 | 2016-05-30 | Client data processing method and processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106095597A true CN106095597A (en) | 2016-11-09 |
| CN106095597B CN106095597B (en) | 2017-09-26 |
Family
ID=57229619
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610370451.3A Active CN106095597B (en) | 2016-05-30 | 2016-05-30 | Client data processing method and processing device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106095597B (en) |
| WO (1) | WO2017206601A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106790632A (en) * | 2017-01-03 | 2017-05-31 | 北京奇虎科技有限公司 | The concurrent transmission method and device of a kind of flow data |
| WO2017206601A1 (en) * | 2016-05-30 | 2017-12-07 | 深圳市鼎盛智能科技有限公司 | Client data processing method and apparatus |
| CN108667505A (en) * | 2018-04-20 | 2018-10-16 | 广州亿航智能技术有限公司 | The data processing method and computer readable storage medium of UAV Communication link |
| CN110046040A (en) * | 2019-04-09 | 2019-07-23 | 厦门网宿有限公司 | Distributed task scheduling processing method and system and storage medium |
| CN111061474A (en) * | 2018-10-16 | 2020-04-24 | 深圳市茁壮网络股份有限公司 | Lamda programming model and data processing method thereof |
| CN111901689A (en) * | 2020-06-17 | 2020-11-06 | 视联动力信息技术股份有限公司 | Streaming media data transmission method and device, terminal equipment and storage medium |
| CN113965844A (en) * | 2021-12-22 | 2022-01-21 | 深圳市维海德技术股份有限公司 | Low-delay audio transmission method and device, driving equipment and readable storage medium |
| CN117041304A (en) * | 2023-10-10 | 2023-11-10 | 南京翼辉信息技术有限公司 | Vehicle-mounted atomic service system and control method thereof |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571617A (en) * | 2012-03-22 | 2012-07-11 | 上海中科高等研究院 | Streaming data server, streaming media transmission method and data transmission system |
| CN103338156A (en) * | 2013-06-17 | 2013-10-02 | 南京国电南自美卓控制***有限公司 | Thread pool based named pipe server concurrent communication method |
| CN104219286A (en) * | 2014-08-13 | 2014-12-17 | 腾讯科技（深圳）有限公司 | Method and device for processing stream media, client, CDN (content delivery network) node server and terminal |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1684413A (en) * | 2004-04-12 | 2005-10-19 | 英业达股份有限公司 | Dynamic realizing method of network communication |
| US7752123B2 (en) * | 2006-04-28 | 2010-07-06 | Townsend Analytics Ltd. | Order management system and method for electronic securities trading |
| CN103036961A (en) * | 2012-12-07 | 2013-04-10 | 蓝盾信息安全技术股份有限公司 | Distributed collection and storage method of journal |
| CN106095597B (en) * | 2016-05-30 | 2017-09-26 | 深圳市鼎盛智能科技有限公司 | Client data processing method and processing device |
-
2016
- 2016-05-30 CN CN201610370451.3A patent/CN106095597B/en active Active
-
2017
- 2017-04-18 WO PCT/CN2017/080837 patent/WO2017206601A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571617A (en) * | 2012-03-22 | 2012-07-11 | 上海中科高等研究院 | Streaming data server, streaming media transmission method and data transmission system |
| CN103338156A (en) * | 2013-06-17 | 2013-10-02 | 南京国电南自美卓控制***有限公司 | Thread pool based named pipe server concurrent communication method |
| CN104219286A (en) * | 2014-08-13 | 2014-12-17 | 腾讯科技（深圳）有限公司 | Method and device for processing stream media, client, CDN (content delivery network) node server and terminal |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017206601A1 (en) * | 2016-05-30 | 2017-12-07 | 深圳市鼎盛智能科技有限公司 | Client data processing method and apparatus |
| CN106790632A (en) * | 2017-01-03 | 2017-05-31 | 北京奇虎科技有限公司 | The concurrent transmission method and device of a kind of flow data |
| CN106790632B (en) * | 2017-01-03 | 2020-07-14 | 北京奇虎科技有限公司 | Streaming data concurrent transmission method and device |
| CN108667505A (en) * | 2018-04-20 | 2018-10-16 | 广州亿航智能技术有限公司 | The data processing method and computer readable storage medium of UAV Communication link |
| CN111061474A (en) * | 2018-10-16 | 2020-04-24 | 深圳市茁壮网络股份有限公司 | Lamda programming model and data processing method thereof |
| CN111061474B (en) * | 2018-10-16 | 2024-04-26 | 深圳市茁壮网络股份有限公司 | Lamda programming device and data processing method thereof |
| CN110046040A (en) * | 2019-04-09 | 2019-07-23 | 厦门网宿有限公司 | Distributed task scheduling processing method and system and storage medium |
| CN110046040B (en) * | 2019-04-09 | 2021-11-16 | 厦门网宿有限公司 | Distributed task processing method and system and storage medium |
| CN111901689A (en) * | 2020-06-17 | 2020-11-06 | 视联动力信息技术股份有限公司 | Streaming media data transmission method and device, terminal equipment and storage medium |
| CN113965844A (en) * | 2021-12-22 | 2022-01-21 | 深圳市维海德技术股份有限公司 | Low-delay audio transmission method and device, driving equipment and readable storage medium |
| CN117041304A (en) * | 2023-10-10 | 2023-11-10 | 南京翼辉信息技术有限公司 | Vehicle-mounted atomic service system and control method thereof |
| CN117041304B (en) * | 2023-10-10 | 2023-12-19 | 南京翼辉信息技术有限公司 | Vehicle-mounted atomic service system and control method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106095597B (en) | 2017-09-26 |
| WO2017206601A1 (en) | 2017-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106095597A (en) | Client data processing method and processing device | |
| CN102170479B (en) | Updating method of Web buffer and updating device of Web buffer | |
| CN109951547B (en) | Transaction request parallel processing method, device, equipment and medium | |
| CN107729137B (en) | Server, block chain signature verification decryption method and storage medium | |
| CN110995513A (en) | Data sending and receiving method in Internet of things system, Internet of things equipment and platform | |
| CN104601696A (en) | Service processing method and service invoking frame, device and architecture | |
| CN110163739B (en) | Payment complaint method, device, server and readable storage medium | |
| CN105303437A (en) | Processing method and device for account checking | |
| CN101788961A (en) | Data access method for carrying out asynchronous request on block equipment | |
| CN110457128B (en) | Task allocation method, device and system | |
| CN105260639A (en) | Face recognition system data update method and device | |
| CN107656796B (en) | Virtual machine cold migration method, system and equipment | |
| CN107256479B (en) | Transaction mode classification execution method and device | |
| CN109347982A (en) | A kind of dispatching method and device of data center | |
| CN106992999B (en) | Cross-server data communication processing method | |
| CN107168788A (en) | The dispatching method and device of resource in distributed system | |
| CN101146111A (en) | A file download method and device | |
| CN111125168A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN105187391A (en) | APP, method and system for allowing APP to log into network access point and server | |
| CN114564210A (en) | Copy deployment method, device, system, electronic equipment and storage medium | |
| CN109412898B (en) | Feature database generation method and device and corresponding flow sorting method and device | |
| CN114841267A (en) | Real-time prediction method and device, electronic equipment and computer program product | |
| CN113094415B (en) | Data extraction method, data extraction device, computer readable medium and electronic equipment | |
| CN104407846B (en) | Information processing method and device | |
| CN106209973A (en) | service request processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CB03 | Change of inventor or designer information |
Inventor after: Sheng Ge Inventor after: Sheng Zhangmei Inventor before: Xu Yongchang Inventor before: Sheng Ge |
|
| CB03 | Change of inventor or designer information | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20210316 Granted publication date: 20170926 |
|
| PP01 | Preservation of patent right | ||
| PD01 | Discharge of preservation of patent |
Date of cancellation: 20240316 Granted publication date: 20170926 |
|
| PD01 | Discharge of preservation of patent |