CN103595800B - A kind of real-time distribution processor device and method of data - Google Patents
A kind of real-time distribution processor device and method of data Download PDFInfo
- Publication number
- CN103595800B CN103595800B CN201310581497.6A CN201310581497A CN103595800B CN 103595800 B CN103595800 B CN 103595800B CN 201310581497 A CN201310581497 A CN 201310581497A CN 103595800 B CN103595800 B CN 103595800B
- Authority
- CN
- China
- Prior art keywords
- data
- real
- time
- distribution
- warehouse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009826 distribution Methods 0.000 title claims abstract description 257
- 238000000034 method Methods 0.000 title abstract description 14
- 238000003672 processing method Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 5
- 238000012790 confirmation Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 description 13
- 230000008569 process Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 238000010224 classification analysis Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A kind of real-time distribution processor device and method of data, is related to mass data distribution processor field, improves the real-time of the real-time distribution processor of mass data in multiple concurrent data sources, reduces data and overstocks.Distribute in real time the data flow that one or more data source sends is received into library module, and inquire about the current binning state of this module, if the current binning state meets the warehouse-in demand of the data flow, then the data flow is stored in data set in memory module, if the current binning state is unsatisfactory for the warehouse-in demand of the data flow, then according to the plurality of real-time current binning state distributed into library module, it is determined that meet one or more of the warehouse-in demand of data flow distributing into library module in real time, distribute library module in real time the data flow is stored in data set in memory module determined by instruction;After each distributes the data flow warehouse-in success of library module in real time, current binning state is updated.
Description
Technical field
The present invention relates to mass data distribution processor field, the real-time distribution processor device of more particularly to a kind of data and side
Method.
Background technology
By in July, 2013, by taking CHINAUNICOM as an example, the average mobile subscriber of national 31 province(Including 3G subscription, 2G user and
Wireless networking card user)Average daily total flow 0.9PB, by gathering in national all core network element deployed with devices light splitting, and
Data on flows to collecting carries out packet parsing, national 31 province mobile subscriber averagely generate flow CDR file 9.5 ten thousand/
Day, 60,000,000,000/day of discharge record, average 69.4 ten thousand/second, it is 4TB/ days that discharge record takes memory space.Every flow note
Record is with fixed field form.
In CDR file, the data form of discharge record is:
Subscriber Number | Discharge pattern | Reference address | Time started | End time | Access duration | Terminal IP | Access IP |
Positional information | Terminal type | Uplink traffic | Downlink traffic | Total flow | Content type | Other |
By collecting and parsing the discharge record that 31 province's partial nodes are generated, and storage system in data set is distributed in real time
Put in storage in real time, centralized stores and unified Analysis, based on to mobile user data traffic analysis as a result, it is possible to achieve
Various applications, including the detailed list real-time query of flow, flow real-time management, precision marketing etc..
But in system actual deployment and market demand, as mass data derives from multiple concurrent data sources, and each
The data volume of data source changes at any time, and causing cannot be according to each data source using the data distribution process system of prior art
Data volume change carries out real-time self adaptation distribution processor to data, causes data to overstock.As data cannot be put in storage in real time
The real-time demand of application cannot just be met.
Therefore, can the real-time distribution processor for the mass data in multiple concurrent data sources be to ensure that data are put in storage in real time
And meet important prerequisite using real time data demand.
Available data distribution processor technical scheme has:
The Chinese patent application of Publication No. CN103152392A is related to a kind of charging method and charge system of cloud computing,
And specifically disclose:There is in system multiple data acquisition units and data aggregator, with load equalizer, its Monitoring Data is converged
The present load ability of poly- device, indicates that data acquisition unit sends the data of collection to the convergence device of corresponding light load,
Convergence device gives unique identifier to the data block that receives from data acquisition unit, the identifier indicate the data block from
In which data acquisition unit;Data block in caching is sent to distributed data base and is stored by convergence device.
But, the method, load equalizer are responsible for periodically by the data balancing for receiving to each convergence device.
Lead to not data be carried out real-time self adaptation distribution processor according to the change of the data volume of each data source, cause data to overstock
Postpone with warehouse-in, so as to the real-time demand of application cannot be met.
The content of the invention
The technical problem to be solved in the present invention is to provide a kind of real-time distribution processor device and method of data, and raising is multiple simultaneously
The real-time of the real-time distribution processor of mass data of data source is sent out, data is reduced and is overstock.
In order to solve the above problems, the invention provides a kind of real-time distribution processor device of data, including deposit in data set
Storage module and it is multiple it is real-time distribute into library module,
Distribute into library module in real time, for receiving the data flow that one or more data source sends, and inquire about this module
Current binning state, if the current binning state meets the warehouse-in demand of the data flow, the data flow is deposited
Enter in data set in memory module, if the current binning state is unsatisfactory for the warehouse-in demand of the data flow, according to institute
State multiple real-time current binning states distributed into library module, it is determined that meet the warehouse-in demand of data flow one or more are real-time
Distribute into library module, distribute library module in real time determined by instruction and the data flow is stored in data set in memory module;
After warehouse-in success, the current binning state of this module is updated;It is additionally operable to distribute the instruction general into library module according to other in real time
Corresponding data flow is stored in data set in memory module;
Memory module in the data set, distributes the data flow sent into library module in real time for receiving and storing each.
Further, current binning state includes free memory and storage, when free memory is higher than number
During according to the demand space and storage of stream higher than the lowest threshold for arranging, the warehouse-in demand of the data flow is met.
Further, when the current binning state in this module is all unsatisfactory for the warehouse-in demand of the data flow, the reality
When distribution warehouse-in module determine that another of warehouse-in demand for meeting data flow is distributed in real time into library module, by determine another
Distribute library module in real time the data flow is stored in data set in memory module;
Or,
When all real-time current binning states distributed into library module are all unsatisfactory for the warehouse-in demand of the data flow, institute
State to distribute in real time a storage is determined higher than the lowest threshold and free memory for arranging closest to number into library module
According to distributing into library module in real time for the warehouse-in demand for flowing, then determine one or more storage higher than the lowest threshold for arranging
And free memory meets the distributing into library module in real time of the warehouse-in demand of remaining traffic, by two for determining or many
When individual, distribution warehouse-in module is stored in data set the data flow in memory module;
Or,
When all real-time current binning states distributed into library module are all unsatisfactory for the warehouse-in demand of the data flow, institute
State distribute in real time into library module determine two or more distribute in real time into library module storage higher than arrange lowest threshold,
After combination, free memory meets the warehouse-in demand of the warehouse-in demand and immediate data flow of data flow, by described two
Or multiple real-time library modules of distributing are stored in data set the data flow in memory module.
Further, it is described it is real-time distribute include distributing submodule and data loading submodule in real time into library module,
The real-time distribution submodule, after the data flow that one or more data source sends is received, inquiry warehouse-in shape
State information table, obtains the real-time current binning state distributed into library module, real-time distributes into the current of library module when described
When binning state meets the warehouse-in demand of the data flow, distribution submodule sends data loading message and gives data loading in real time
Module;The real-time distribution submodule is additionally operable to update warehouse-in according to the warehouse-in success message that the data loading submodule sends
Status information table;The real-time distribution submodule is additionally operable to be believed according to other instruction inquiry binning states for distributing submodule in real time
Table is ceased, storage and distribution storage space information is obtained, and the distribution storage space information is returned to into other real-time point
Send out submodule;The distribution memory space is less than or equal to free memory;
The data loading submodule, the data flow is stored in data set in memory module, and after being stored in successfully,
Storehouse success message is transmitted into distribution submodule in real time.
Further, when the warehouse-in that the real-time current binning state distributed into library module is unsatisfactory for the data flow is needed
When asking, data distribution request is sent to all or part of real-time real-time distribution submodule distributed into library module of others and disappeared
Breath, receives one or more real-time distribution submodule inquiry binning state information table of data distribution request message, and to
The real-time distribution submodule returned data distribution for sending data distribution request message confirms message;The data distribution confirms message
Middle carrying storage and distribution storage space information;
The real-time distribution submodule that data distribution confirms message is received, determines storage higher than the lowest threshold for arranging
And another for meeting the warehouse-in demand of data flow is distributed into library module or storage in real time higher than the minimum threshold for arranging
Value and the multiple real-time of warehouse-in demand of data flow is met after combining distribute into library module, and to another distribution warehouse-in in real time
The real-time distribution submodule of module or multiple real-time real-time distribution submodule transmission data distribution message distributed into library module,
And confirm that according to the data distribution received data flow is distributed by distribution memory space in message in real time, by another
One data loading submodule or multiple real-time data loading submodules distributed into library module distributed into library module 1 in real time
The data flow is stored in data set in memory module, and after being stored in successfully, storehouse success message is transmitted into corresponding reality
When distribute submodule.
It is described another distribute in real time into library module real-time distribution submodule or it is multiple it is real-time distribute into library module,
It is additionally operable to update binning state information table according to the warehouse-in success message that corresponding data loading submodule sends.
Further, current binning state also includes other real-time distribution submodule number of tasks N for servicing, and is receiving
During to once other data distribution request messages that distribution submodule sends in real time, N+1 is receiving a data loading submodule
When the IP address that block sends is that other distribute the warehouse-in success message of the address into library module in real time, N-1.
Further, distribution submodule is additionally operable to be used for for the data flow token of one or more of data sources in real time
Indicate the data source label of the source data stream;It is additionally operable to after combination meet multiple real-time point of the warehouse-in demand of data flow
The real-time distribution submodule for sending out library module is sent for indicating the list of file names of distribution of document;
The plurality of real-time data loading submodule distributed into library module, is additionally operable to according to the data source label and text
Part list of file names, the data flow are stored in data set in memory module.
In order to solve the above problems, the invention provides a kind of real-time distribution processing method of data, including:
Distribute in real time and the data flow that one or more data source sends is received into library module, and inquire about the current of this module
The data flow, if the current binning state meets the warehouse-in demand of the data flow, is stored in data by binning state
In centralized stores module, if the current binning state is unsatisfactory for the warehouse-in demand of the data flow, according to the plurality of
Distribute the current binning state into library module in real time, it is determined that meet the warehouse-in demand of data flow one or more distribute in real time into
Library module, distributes library module in real time determined by instruction and the data flow is stored in data set in memory module;
In data set, memory module is received and stores each and distributes the data flow sent into library module in real time;
After each distributes the data flow warehouse-in success of library module in real time, current binning state is updated.
Further, current binning state includes free memory and storage, when free memory is higher than number
During according to the demand space and storage of stream higher than the lowest threshold for arranging, the warehouse-in demand of the data flow is met.
Further, it is determined that meeting one or more of the warehouse-in demand of data flow distributes the strategy into library module in real time
For:
It is determined that meet another of the warehouse-in demand of data flow distributing into library module in real time;
Or,
Determine that a storage is higher than the warehouse-in of the lowest threshold and free memory of setting closest to data flow
Demand is distributed in real time into library module, then determines one or more storage higher than the lowest threshold for arranging and available deposit
Storage space meets the warehouse-in demand of remaining traffic and distributes into library module in real time;
Or,
Determine that two or more distribute library module storage in real time available higher than after the lowest threshold, combination for arranging
Memory space meets the warehouse-in demand of the warehouse-in demand and immediate data flow of data flow.
Further, it is determined that the multiple real-time of the warehouse-in demand of data flow is met after combination distributing into bag the step of library module
Include:
It is described it is real-time distribute into library module to others it is all or part of it is real-time distribute into library module send data distribution
Request message, one or more the real-time distribution module for receiving data distribution request message inquire about binning state information table,
And message is confirmed to the real-time distribution submodule returned data distribution for sending data distribution request message;The data distribution confirms
Storage and distribution storage space information are carried in message;The distribution memory space is empty less than or equal to available storage
Between;
The real-time distribution submodule that data distribution confirms message is received, determines storage higher than the lowest threshold for arranging
And another for meeting the warehouse-in demand of data flow is distributed into library module or storage in real time higher than the minimum threshold for arranging
Value and the multiple real-time of warehouse-in demand of data flow is met after combining distribute into library module, and to described another real-time distribution
Enter library module or it is multiple it is real-time distribute into library module send data distribution message, and according to the data distribution confirm message in
Distribution memory space received data flow is distributed in real time.
Further, after distribution submodule receives the data flow that one or more data source sends in real time, it is described
The data flow token of one or more data source is used for the data source label for indicating the source data stream;
Distribution submodule is it is determined that the multiple real-time of warehouse-in demand that data flow is met after combination is distributed into library module in real time
Afterwards, meet to after combination data flow warehouse-in demand it is multiple real-time distribute send for indicating the text of distribution of document into library module
Part list of file names;
It is the plurality of it is real-time distribute into library module according to the data source label and list of file names, the data flow is stored in
In data set in memory module.
Changed according to the data volume of different data sources using this apparatus and method and the real-time distribution processor ability of data, in real time
Distribution processor data, fully improve the treatment effeciency that data distribution processes system, reduce data and overstock.And pass through data source IP
Address mark data flow, realizes that distributed data is put in storage, and the data loading for solving centralized stores system cannot be to different pieces of information
Source information carries out the problem stored with classification analysises of classifying, and improves warehouse-in efficiency.
Description of the drawings
Fig. 1 is the structural representation of the real-time distribution processor device of data of the embodiment of the present invention;
Fig. 2 is the structural representation distributed into library module in real time of the embodiment of the present invention;
Data real-time distribution processing method flow charts of the Fig. 3 for the embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention become more apparent, below in conjunction with accompanying drawing to the present invention
Embodiment be described in detail.It should be noted that in the case where not conflicting, in the embodiment and embodiment in the application
Feature can mutual combination in any.
As shown in figure 1, the embodiment of the present invention provides a kind of data real-time distribution processor device, including data centralized stores mould
Block 2 and it is multiple it is real-time distribute into library module 1,
Distribute into library module 1 in real time, for receiving the data flow that one or more data source sends, and inquire about this module
Current binning state, if the current binning state meets the warehouse-in demand of the data flow, the data flow is deposited
Enter in data set in memory module 2, if the current binning state is unsatisfactory for the warehouse-in demand of the data flow, according to institute
Multiple real-time current binning states distributed into library module 1 are stated, it is determined that meeting one or more of the warehouse-in demand of data flow
Distribute into library module 1 in real time, distribute determined by instruction in real time and the data flow is stored in into data centralized stores mould into library module 1
In block 2;After warehouse-in success, the current binning state of this module is updated;It is additionally operable to be distributed into library module 1 in real time according to other
Instruction is stored in data set corresponding data flow in memory module 2;
Memory module 2 in the data set, distributes the data sent into library module 1 in real time for receiving and storing each
Stream.
In the preferred embodiments of the present invention, current binning state is stored in binning state information table, wherein currently putting shape in storage
State includes free memory and storage, when free memory is higher than the demand space and storage height of data flow
When the lowest threshold for arranging, the warehouse-in demand of the data flow is met.
Binning state information table is used to distribute into the management binning state information of library module 1 in real time.
It is current distribute in real time the inquiry of library module 1 other distribute the current binning state of library module 1 in real time after, if
Others distribute the warehouse-in demand that the data flow is met into library module 1 in real time, then put in storage using single one distribution in real time
Module 1 is stored in data set the data flow in memory module 2.
It is when this is distributed the current binning state into library module 1 in real time and is unsatisfactory for the warehouse-in demand of the data flow, described
Distribute in real time and determine that another of warehouse-in demand for meeting data flow is distributed in real time into library module 1 into library module 1, it is another by what is determined
Distribute library module 1 in real time for one the data flow is stored in data set in memory module 2;
When all real-time current binning states distributed into library module 1 are all unsatisfactory for the warehouse-in demand of the data flow,
It is described it is real-time distribute meet the multiple real-time of warehouse-in demand of data flow after library module 1 determines combination and distribute into library module 1
Mode can be:
Determine that a storage is higher than the warehouse-in of the lowest threshold and free memory of setting closest to data flow
Demand is distributed in real time into library module 1, then determines one or more storage higher than the lowest threshold for arranging and can use
Memory space meets the distributing into library module 1 in real time of the warehouse-in demand of remaining traffic, by two or more time-divisions for determining
Send out library module 1 data flow is stored in data set in memory module 2.
Or
When all real-time current binning states distributed into library module 1 are all unsatisfactory for the warehouse-in demand of the data flow,
It is described it is real-time distribute into library module 1 determine two or more distribute in real time into 1 storage of library module higher than arrange it is minimum
After threshold value, combination, free memory meets the warehouse-in demand of the warehouse-in demand and immediate data flow of data flow, by institute
State two or more and distribute library module 1 in real time and the data flow is stored in data set in memory module 2.
It is determined that when warehouse-in demand multiple real-time that data flow is met after combination is distributed into library module 1, it may include this module.
Here " instruction " is likely to include the instruction to this module 1.
Other reasonable manners can also be utilized to determine the multiple real-time distribution warehouse-in mould of the warehouse-in demand for meeting data flow
Block 1, it is necessary to which the requirement of satisfaction is warehouse-in demand of the free memory after combination more than or equal to data flow, in order to more preferable
Real-time distribution processor data, fully improve the treatment effeciency that data distribution processes system, on the basis of space requirement is met,
Consider storage, prioritizing selection storage is high to be distributed in real time into library module 1.
As shown in Fig. 2 it is described it is real-time distribute include distributing submodule 11 and data loading submodule in real time into library module 1
12,
The real-time distribution submodule 11, after the data flow that one or more data source sends is received, inquiry warehouse-in
Status information table, obtains the real-time current binning state distributed into library module 1, real-time distributes into library module 1 when described
When current binning state meets the warehouse-in demand of the data flow, distribution submodule 11 sends data loading message to data in real time
Warehouse-in submodule 12;The real-time distribution submodule 11 is additionally operable to the warehouse-in success sent according to the data loading submodule 12
Information updating binning state information table;The real-time distribution submodule 11 is additionally operable to distribute the finger of submodule 11 according to other in real time
Show inquiry binning state information table, obtain storage and distribution storage space information, and by the distribution storage space information
Return to other distribution submodules 11 in real time;The distribution memory space is less than or equal to free memory;
The data loading submodule 12, the data flow is stored in data set in memory module 2, and is being stored in successfully
Afterwards, storehouse success message is transmitted into distribution submodule 11 in real time.
As shown in Fig. 2 when the real-time current binning state distributed into library module 1 is unsatisfactory for the warehouse-in of the data flow
During demand, sending data distribution to all or part of real-time real-time distribution submodule 11 distributed into library module 1 of others please
Message is sought, one or more real-time distribution submodule 11 inquiry binning state information of data distribution request message is received
Table, and message is confirmed to real-time 11 returned data of the distribution submodule distribution for sending data distribution request message;The data point
Send out;The distribution memory space is deposited less than or equal to available
Storage space;
The real-time distribution submodule 1 that data distribution confirms message is received, determines storage higher than the minimum threshold for arranging
Value and meet data flow warehouse-in demand another distribute in real time it is minimum higher than what is arranged into library module 1 or storage
The multiple real-time of warehouse-in demand that data flow is met after threshold value and combination is distributed into library module 1, and to another real-time distribution
Enter the real-time distribution submodule 11 or the multiple real-time real-time transmission of distribution submodule 11 numbers distributed into library module 1 of library module 1
According to dispatch messages, and confirm that according to the data distribution received data flow is carried out reality by the distribution memory space in message
When distribute, by another distribute in real time into library module 1 data loading submodule 12 or multiple real-time distribute into library module 1
Data loading submodule 12 is stored in the data flow in data set in memory module 2, and after being stored in successfully, transmits into Kucheng
Work(message is to corresponding real-time distribution submodule 11.
Preferably, current binning state also includes other real-time distribution submodule number of tasks N for servicing, and is receiving
Once during other data distribution request messages that distribution submodule 11 sends in real time, N+1 is receiving a data loading submodule
When the IP address that block 12 sends is that other distribute the warehouse-in success message into the address of library module 11 in real time, N-1.
It is described another distribute in real time into library module 1 real-time distribution submodule 11 or multiple real-time distribute into library module
1, it is additionally operable to update binning state information table according to the warehouse-in success message that corresponding data loading submodule 12 sends.
In real time distribution submodule 11 is after the data flow for receiving data source transmission, real-time query or according to looking into for arranging
In the inquiry cycle, inquire about binning state information table and obtain the binning state originally distributed in real time into library module 1.
Wherein, polling cycle can be according to the data volume scale of all data sources and the real-time distributing and processing system of mass data
Data loading ability(Free memory, storage)It is configured.
Distribution submodule 11 is additionally operable to be used to indicate institute for the data flow token of one or more of data sources in real time
State the data source label of source data stream;The multiple real-time of warehouse-in demand for being additionally operable to after combination meet data flow distributes warehouse-in
The real-time distribution submodule 11 of module 1 is sent for indicating the list of file names of distribution of document;
The plurality of real-time data loading submodule 12 distributed into library module 1, is additionally operable to according to the data source label
And list of file names, the data flow is stored in data set in memory module 2.
The data flow token that distribution submodule 11 pairs is received in real time indicates the data source label in source, by the data
Source label, it is possible to achieve different pieces of information source data is inquired by classification and analyzed, such as data source label information can be province
The data of different provinces and cities, by data source label information, can be inquired by classification and be analyzed by city's title.According to application demand,
Multiple label informations can be marked to same data source.
For example:Data source data form:
Filename | File content |
After distribution submodule 11 is received in real time, the data that marked data source label with form can be:
Data source label | Filename | File content |
For the data flow token data source label to receiving, each is distributed submodule 11 in real time and can safeguard a number
According to source list of labels, its corresponding label information is inquired about according to the IP address of data source, in increase and decrease data source or the IP of data source
List of labels information when address and label information are changed, in all real-time distribution submodules 11 of synchronous vacations.Label column form
Formula can be:
The IP address of data source | The label information of data source |
As shown in figure 3, the embodiment of the present invention also provides a kind of data real-time distribution processing method, including:
Distribute in real time and the data flow that one or more data source sends is received into library module 1, and inquire about working as this module
The data flow, if the current binning state meets the warehouse-in demand of the data flow, is stored in number by front binning state
According to centralized stores module 2, if the current binning state is unsatisfactory for the warehouse-in demand of the data flow, according to described many
The individual real-time current binning state distributed into library module 1, it is determined that meet the warehouse-in demand of data flow one or more are real-time
Distribute into library module 1, distribute library module 1 in real time determined by instruction and the data flow is stored in into memory module 2 in data set
In;
In data set, memory module 2 is received and stores each and distributes the data flow sent into library module 1 in real time;
After each distributes the data flow warehouse-in success of library module 1 in real time, current binning state is updated.
Wherein, current binning state includes free memory and storage, when free memory is higher than data flow
Demand space and storage higher than arrange lowest threshold when, meet the warehouse-in demand of the data flow.
It is determined that the multiple real-time strategy distributed into library module 1 that the warehouse-in demand of data flow is met after combination can be:
It is determined that meet another of the warehouse-in demand of data flow distributing into library module 1 in real time;
Or,
Determine that a storage is higher than the warehouse-in of the lowest threshold and free memory of setting closest to data flow
Demand is distributed in real time into library module 1, then determines one or more storage higher than the lowest threshold for arranging and can use
Memory space meets the distributing into library module 1 in real time of the warehouse-in demand of remaining traffic;
Or
Determine two or more distribute in real time 1 storage of library module higher than arrange lowest threshold, combination after can
The warehouse-in demand of the warehouse-in demand and immediate data flow of data flow is met with memory space.
It is determined that warehouse-in demand multiple real-time that data flow is met after combination includes the step of distribution into library module 1:
It is described it is real-time distribute into library module 1 to others it is all or part of it is real-time distribute send data point into library module 1
Request message is sent out, one or more the real-time distribution module 1 for receiving data distribution request message inquires about binning state information
Table, and message is confirmed to real-time 1 returned data of the distribution submodule distribution for sending data distribution request message;The data distribution
Storage and distribution storage space information are carried in confirming message;The distribution memory space is less than or equal to available storage
Space;
The real-time distribution submodule 1 that data distribution confirms message is received, determines storage higher than the minimum threshold for arranging
Value and meet data flow warehouse-in demand another distribute in real time it is minimum higher than what is arranged into library module 1 or storage
Threshold value and the multiple real-time of warehouse-in demand of data flow is met after combining and distribute into library module 1, and another is real-time to described
Distribute into library module 1 or it is multiple it is real-time distribute into library module 1 send data distribution message, and according to the data distribution confirm
Received data flow is distributed by distribution memory space in message in real time.
After in real time distribution submodule 1 receives the data flow that one or more data source sends, be it is one or
The data flow token of multiple data sources is used for the data source label for indicating the source data stream;
Distribution submodule 1 is it is determined that the multiple real-time of warehouse-in demand that data flow is met after combination is distributed into library module in real time
After 1, meet to after combination data flow warehouse-in demand it is multiple real-time distribute send for indicating distribution of document into library module 1
List of file names;
It is the plurality of it is real-time distribute into library module 1 according to the data source label and list of file names, the data flow is deposited
Enter in data set in memory module 2.
Embodiment
Embodiment 1, distribute the flow process that can the data of institute's service data source be carried out with real-time warehouse-in into library module 1 in real time:
So that first distributes library module 1 in real time as an example:
1), first distributes the data flow into one or more data source transmission of 1 real-time reception of library module in real time;
2), first distributes in real time into the inquiry data source list of labels of library module 1, is the data flow addition number of each data source
According to source label;
3), first distributes the inquiry binning state information table of submodule 11 in real time, and first distributes in real time into the current of library module 1
Remaining free memory and storage meet warehouse-in demand;
4), first distributes the transmission data loading message of submodule 11 in real time to the first data loading submodule 12;
5), the first data loading submodule 12 completes data loading according to data source label, list of file names information;
6), after data loading, the first data loading submodule 12 transmits into storehouse success message and distributes submodule in real time to first
Block 11;
7), first distributes the renewal binning state information table of submodule 11 in real time.
Embodiment 2, distribute in real time to meet into library module 1 and institute's service data source data is put in storage in real time, need to enter
The flow process of row data distribution processor is:
Distributing with first in real time and requirement cannot being met into library module 1, second distributes in real time and can meet requirement into library module 1
As a example by:
1), first distributes the data flow into one or more data source transmission of 1 real-time reception of library module in real time;
2), first distributes in real time into the inquiry data source list of labels of library module 1, is the data flow addition number of each data source
According to source label;
3), first distributes the inquiry binning state information table of submodule 11 in real time, and first distributes in real time into the current of library module 1
Remaining free memory or storage cannot meet warehouse-in demand;
4), the first real-time distribution submodule 11 inquires about other binning states for entering library module;
5), first distribute in real time into library module 1 first in real time distribution submodule 11 distribute into library module 1 in real time to second
Second in real time distribution submodule 11 send data distribution request message;
6), second distributes the second real-time distribution submodule 11 inquiry binning state information table into library module 1 in real time;
7), second distributes the second real-time distribution submodule 11 returned data distribution confirmation message into library module 1, bag in real time
Include storage and the memory space that can distribute;
8), first distribute in real time into library module 1 first in real time distribution submodule 11 select to meet data flow warehouse-in demand
Second in real time distribution warehouse-in submodule 1 carry out data distribution;First distributes the first real-time distribution submodule into library module 1 in real time
Block 11 is distributed to second in real time and distributes the transmission data distribution message of submodule 11 in real time into the second of library module 1;
9) after, the second the second real-time distribution submodule 11 for distributing library module 1 in real time receives data distribution message, more
New binning state information table, while send data loading message distributes the second data loading into library module 1 in real time to second
Module 12;
10), the second data loading submodule 12 carries out data loading;
11), the second data loading submodule 12 returns warehouse-in success message;
12), second distributes the second real-time distribution submodule 11 renewal binning state information table into library module 1 in real time.
Embodiment 3, distribute in real time to meet into library module 1 and institute's service data source data is put in storage in real time, need to enter
The flow process of row data distribution processor is:
Distribute with first in real time and requirement cannot be met into library module 1, after first and second distribute the combination of library module 1 in real time
As a example by requirement being met:
1), first distributes the data flow into one or more data source transmission of 1 real-time reception of library module in real time;
2), first distributes in real time into the inquiry data source list of labels of library module 1, is the data flow addition number of each data source
According to source label;
3), first distributes the inquiry binning state information table of submodule 11 in real time, and first distributes in real time into the current of library module 1
Remaining free memory or storage cannot meet warehouse-in demand;
4), the first real-time distribution submodule 11 inquires about other binning states for entering library module;
5), first distribute in real time into library module 1 first in real time distribution submodule 11 distribute into library module 1 in real time to second
Second in real time distribution submodule 11 send data distribution request message;
6), second distributes the second real-time distribution submodule 11 inquiry binning state information table into library module 1 in real time;
7), second distributes the second real-time distribution submodule 11 returned data distribution confirmation message into library module 1, bag in real time
Include storage and the memory space that can distribute;
8), first distributes first the first real-time distribution warehouse-in mould of distribution submodule 11 determination in real time into library module 1 in real time
Block 1 and second is distributed in real time data flow warehouse-in demand is met after library module 1 is combined;First distributes into library module 1 in real time
One distributes submodule 11 in real time distributes free memory and the second real-time distribution warehouse-in mould into library module 1 in real time according to first
The distribution memory space of block 1 to second distribute in real time into library module 1 second in real time distribution submodule 11 send data distribution and disappear
Breath;
9) after, the second the second real-time distribution submodule 11 for distributing library module 1 in real time receives data distribution message, more
New binning state information table, while send data loading message distributes the second data loading into library module 1 in real time to second
Module 12;First distributes the first real-time distribution submodule 11 renewal binning state information table into library module 1 in real time, while sending
Data loading message distributes the first data loading submodule 12 into library module 1 in real time to first;
10), the first and second data loading submodules 12 carry out data loading;
11), the first and second data loading submodule 12 returns warehouse-in success message;
12), first distribute in real time into library module 1 first in real time distribution submodule 11 second distribute into library module 1 in real time
Second in real time distribution submodule 11 update binning state information table.
If first distributes the warehouse-in demand that data flow cannot be met into library module 1 in real time, and free memory is low
In the minimum threshold of setting, selecting other in addition to first distributes library module 1 in real time to distribute in real time carries out data into library module 1
Warehouse-in, such as second and the 3rd distributes after library module 1 is combined in real time and can meet requirement, then select second and the 3rd in real time point
Sending out library module 1 carries out data loading jointly, and idiographic flow is similar with above-mentioned situation.
Distributing the real-time transmission of the distribution submodule 11 data distribution request message into library module 1 to other parts in real time
When, determine certain it is several it is real-time distribute into library module 1 mode can according to select grade be ranked up, for example
Binning state information table can also include all real-time binning state information distributed into library module, and concrete form can
Think:
Other for servicing distribute submodule number of tasks N in real time, are receiving once other distribution submodules 11 in real time
During the data distribution message of transmission, N+1;Distribute into library module in real time receive that notebook data warehouse-in submodule 12 sends
When IP address is the warehouse-in success message of other warehouse-in module's address, N-1;
Select grade be when binning state information table is updated every time, in table it is all it is real-time distribute into library module 1 enter
Storehouse ability is entered according to other real-time distribution submodule number of tasks N, storage, current residual free memory for servicing
The integrated ordered acquisition of row.N is less and remaining free memory is bigger distributes into library module in real time, and which selects higher grade.
Timestamp, in real time distribution warehouse-in module I P address, storage, current residual free memory derive from data
Enter the warehouse-in success message and other binning state new informations that distribution submodule sends in real time of library module transmission.
The maintenance management of binning state information table:
Receive data loading submodule 12 warehouse-in success message, other distribute in real time submodule 12 transmission warehouse-in
When state new information, data distribution message, update the timestamp of safeguarded binning state information table, current residual and can use and deposit
Storage space, other real-time distribution submodule number of tasks N, the selection class informations for servicing.
Binning state new information is sent between distribution submodule 11 in real time according to the update cycle for arranging, i.e., is distributed in real time
Submodule is sent to other all real-time distribution submodules, binning state new information form after the update cycle is reached in real time
For:
The real-time distribution processor of data
Binning state information as originally distributed in real time into library module 1 disclosure satisfy that warehouse-in demand(Current residual can be with storage
Space is higher than the warehouse-in demand of data flow, storage higher than the lowest threshold for arranging), then number is sent to data loading submodule
According to warehouse-in message.
Data loading message format is:
Module I P address is put in distribution in real time in storage | Data source label | List of file names |
Warehouse-in demand cannot be met into library module 1 as this is distributed in real time(Current residual free memory is less than data flow
Warehouse-in demand or storage less than arrange lowest threshold), then based on the binning state information table safeguarded, according to available
Memory space is first-selected to select high one or more of grade to distribute into library module in real time, divides to one or more selected in real time
Send out library module 1 and send data distribution request message.
Data distribution request message format is:
Meanwhile, other data distribution request messages that distribution submodule 11 sends in real time are received, and inquires about binning state letter
Breath table, returned data distribution confirm message.
Data distribution confirms that message format is:
The real-time distribution submodule 11 that data distribution confirms message is received, to the real-time distribution submodule 11 asked by which
Data distribution message is sent, and confirms that according to data distribution received data are carried out reality by the distribution memory space in message
When distribute, complete data loading by other data loading submodules 12.
Data distribution message format is:
Data loading submodule 12 receives this data for distributing the real-time transmission of distribution submodule 11 into library module 1 in real time and enters
Storehouse message, and according to the real-time distribution warehouse-in module I P address in message, data source label and list of file names, data are carried out
Warehouse-in, after warehouse-in, transmits into storehouse success message to distribution submodule 11 in real time.
Putting success message form in storage is:
Module I P address is put in distribution in real time in storage | Timestamp | Storage | Current residual free memory |
Embodiment 4,
Distributing into library module 1 in real time for such as embodiment of the present invention is 7, wherein first distributes in real time into library module 1
Free memory is 1.2GB, and second to distribute the free memory into library module 1 in real time be 700MB, the 3rd distribute in real time into
The free memory of library module 1 be 400MB, the 4th distribute in real time into library module 1 free memory be 500MB, the 5th
The free memory distributed into library module 1 in real time is 600MB, and the 6th distributes the free memory into library module 1 in real time is
300MB, the 7th distribute in real time into library module 1 free memory be 800MB, above-mentioned 7 distribute into library module 1 in real time enter
Storehouse speed is all higher than the lowest threshold for setting, and as 350MB, the data flow for needing storage is the memory space minimum threshold for setting
1GB。
After the data flow for needing to store is sent to first distributes into library module 1 in real time, because the first distribution in real time is put in storage
The current binning state of module 1 meets the warehouse-in requirement of data flow, is distributed by first in real time and is deposited the data flow into library module 1
Enter in data set in memory module 2.
After the data flow for needing to store is sent to second distributes into library module 1 in real time, because the second distribution in real time is put in storage
The current binning state of module 1 is unsatisfactory for the warehouse-in requirement of data flow, and inquiry obtains second, third and distributes into library module 1 in real time
After combination, meet the warehouse-in demand of the warehouse-in demand and immediate data flow of data flow, distributed by second and the 3rd in real time
Enter library module 1 data flow is stored in data set in memory module 2.
It is after the data flow for needing to store is sent to the three, the four, the 5th distributes into library module 1 in real time, real-time with second
Distribute it is similar into 1 situation of library module, in order to not waste free memory as far as possible, have respectively the 3rd and second distribute in real time into
Library module the 1, the 4th and the 5th is distributed in real time to distribute into library module the 1, the 5th and the 4th in real time and is deposited the data flow into library module 1
Enter in data set in memory module 2.
After the data flow for needing to store is sent to the 6th distributes into library module 1 in real time, because the 6th distribution in real time is put in storage
Memory space minimum threshold of the currently available memory space of module 1 less than setting, is distributed institute into library module 1 in real time by other
State data flow to be stored in data set in memory module 2, this is first to distribute in real time and distribute into library module the 1, second and the 3rd in real time
Enter that library module 1 is combined, the 4th and the 5th distributes in real time the warehouse-in demand for all meeting data flow is combined into library module 1, select second
Distribute library module 1 in real time with the 3rd and combine and the data flow is stored in data set in memory module 2, or the 4th and the 5th
Distribute library module 1 in real time and combine and the data flow is stored in data set in memory module 2, or by first distribute in real time into
Library module 1 combines and the data flow is stored in data set in memory module 2.
Now can be selected according to certain strategy, for example, keep the integrity of data as far as possible, first can be selected
Distribute into library module 1 in real time, do not waste as far as possible free memory second and the 3rd distribute in real time combine into library module 1, the 4th
Distribute with the 5th identical into the combination free memory of library module 1 in real time, can select to return most fast one group of message, Huo Zheqi
In one distribute in real time into library module 1 at utmost meet require.
After needing the data flow of storage to send to the 7th to distribute into library module 1 in real time, this be closest to for the six the
Six distribute in real time into library module 1, but the 6th distributes storage of the currently available memory space into library module 1 less than setting in real time
Space minimum threshold, therefore ignore, selects to distribute library module 1 in real time with the 3rd to combine the data flow is stored in data set
In memory module 2, or distribute library module 1 in real time by first and combine the data flow is stored in into memory module 2 in data set
In.
Although disclosed herein embodiment as above, described content only to facilitate understand the present invention and adopt
Embodiment, is not limited to the present invention.Technical staff in any the technical field of the invention, without departing from this
On the premise of the disclosed spirit and scope of invention, any modification and change can be made in the formal and details implemented,
But the scope of patent protection of the present invention, still must be defined by the scope of which is defined in the appended claims.
Claims (8)
1. the real-time distribution processor device of a kind of data, it is characterised in that including memory module in data set and multiple real-time distributions
Enter library module,
Distribute into library module in real time, for receiving the data flow that one or more data source sends, and inquire about working as this module
The data flow, if the current binning state meets the warehouse-in demand of the data flow, is stored in number by front binning state
According to centralized stores module, if the current binning state is unsatisfactory for the warehouse-in demand of the data flow, according to described many
The individual real-time current binning state distributed into library module, it is determined that meeting one or more real-time distributions of the warehouse-in demand of data flow
Enter library module, distribute library module in real time determined by instruction and the data flow is stored in data set in memory module;Entering
After Kucheng's work(, the current binning state of this module is updated;Being additionally operable to will be corresponding according to other instructions distributed into library module in real time
Data flow be stored in data set in memory module;
Memory module in the data set, distributes the data flow sent into library module in real time for receiving and storing each;
Current binning state includes free memory and storage, when free memory is higher than the demand space of data flow
And when storage is higher than the lowest threshold for arranging, meet the warehouse-in demand of the data flow;
When all real-time current binning states distributed into library module are all unsatisfactory for the warehouse-in demand of the data flow, the reality
When distribution warehouse-in module determine a storage higher than arrange lowest threshold and free memory closest to data flow
Warehouse-in demand distribute into library module in real time, then determine one or more storage higher than the lowest threshold for arranging and
Free memory meets the distributing into library module in real time of the warehouse-in demand of remaining traffic, during by two or more for determining
Distribute library module the data flow is stored in data set in memory module;
Or,
When all real-time current binning states distributed into library module are all unsatisfactory for the warehouse-in demand of the data flow, the reality
When distribution warehouse-in module determine two or more distribute in real time into library module storage higher than arrange lowest threshold, combination
Free memory meets the warehouse-in demand of the warehouse-in demand and immediate data flow of data flow afterwards, by described two or
Multiple real-time library modules of distributing are stored in data set the data flow in memory module.
2. processing meanss as claimed in claim 1, it is characterised in that:It is described it is real-time distribute include in real time distribution into library module
Module and data loading submodule,
The real-time distribution submodule, after the data flow that one or more data source sends is received, inquiry binning state letter
Breath table, obtains the real-time current binning state distributed into library module, when the real-time current warehouse-in distributed into library module
When state meets the warehouse-in demand of the data flow, distribution submodule sends data loading message and gives data loading submodule in real time
Block;The real-time distribution submodule is additionally operable to update warehouse-in shape according to the warehouse-in success message that the data loading submodule sends
State information table;The real-time distribution submodule is additionally operable to inquire about binning state information according to other instructions for distributing submodule in real time
Table, obtains storage and distribution storage space information, and the distribution storage space information is returned to other real-time distributions
Submodule;The distribution memory space is less than or equal to free memory;
The data loading submodule, the data flow is stored in data set in memory module, and after being stored in successfully, is sent
Warehouse-in success message is to distribution submodule in real time.
3. processing meanss as claimed in claim 2, it is characterised in that:When the real-time current warehouse-in shape distributed into library module
When state is unsatisfactory for the warehouse-in demand of the data flow, to all or part of real-time real-time distribution distributed into library module of others
Submodule sends data distribution request message, receives one or more real-time distribution submodule of data distribution request message
Inquiry binning state information table, and disappear to the real-time distribution submodule returned data distribution confirmation for sending data distribution request message
Breath;The data distribution carries storage and distribution storage space information in confirming message;
Receive data distribution confirm message real-time distribution submodule, determine storage higher than arrange lowest threshold and
The multiple real-time of warehouse-in demand that data flow is met after combination is distributed into library module, and to multiple real-time realities distributed into library module
When distribution submodule send data distribution message, and according to the data distribution confirm message in distribution memory space will be connect
The data flow for receiving is distributed in real time, deposits the data flow by multiple real-time data loading submodules distributed into library module
Enter in data set in memory module, and after being stored in successfully, storehouse success message is transmitted into corresponding real-time distribution submodule;
It is the plurality of it is real-time distribute into library module, be additionally operable to according to corresponding data loading submodule send warehouse-in success message
Update binning state information table.
4. processing meanss as claimed in claim 3, it is characterised in that:Current binning state also includes other realities for servicing
When distribute submodule number of tasks N, when other data distribution request messages that in real time distribution submodules send are received once, N+
1, receive the IP address that data loading submodule sends be other distribute the address into library module in real time enter Kucheng
During work(message, N-1.
5. processing meanss as claimed in claim 3, it is characterised in that:In real time distribution submodule be additionally operable to as one or
The data flow token of multiple data sources is used for the data source label for indicating the source data stream;It is additionally operable to number is met to after combination
Send for indicating the text of distribution of document according to the multiple real-time real-time distribution submodule distributed into library module of the warehouse-in demand of stream
Part list of file names;
The plurality of real-time data loading submodule distributed into library module, is additionally operable to according to the data source label and filename
List, the data flow are stored in data set in memory module.
6. the real-time distribution processing method of a kind of data, it is characterised in that for the real-time distribution processor of data described in claim 1
Device, including:
Distribute in real time and the data flow that one or more data source sends is received into library module, and inquire about the current warehouse-in of this module
State, if the current binning state meets the warehouse-in demand of the data flow, the data flow is stored in data set
In memory module, if the current binning state is unsatisfactory for the warehouse-in demand of the data flow, according to the plurality of real-time
Distribute the current binning state into library module, it is determined that mould is put in one or more distributions in real time for meeting the warehouse-in demand of data flow in storage
Block, distributes library module in real time determined by instruction and the data flow is stored in data set in memory module;
In data set, memory module is received and stores each and distributes the data flow sent into library module in real time;
After each distributes the data flow warehouse-in success of library module in real time, current binning state is updated;
Current binning state includes free memory and storage, when free memory is higher than the demand space of data flow
And when storage is higher than the lowest threshold for arranging, meet the warehouse-in demand of the data flow;
It is determined that one or more strategies distributed into library module in real time for meeting the warehouse-in demand of data flow include:
Determine that a storage is higher than the warehouse-in demand of the lowest threshold and free memory of setting closest to data flow
Distribute into library module in real time, then determine one or more storage higher than the lowest threshold for arranging and can be empty with storage
Between meet the warehouse-in demand of remaining traffic and distribute into library module in real time;
Or,
Determine that two or more are distributed library module storage in real time and store higher than can use after the lowest threshold, combination for arranging
Space meets the warehouse-in demand of the warehouse-in demand and immediate data flow of data flow.
7. processing method as claimed in claim 6, it is characterised in that:
It is determined that warehouse-in demand multiple real-time that data flow is met after combination includes the step of distribution into library module:
It is described it is real-time distribute into library module to others it is all or part of it is real-time distribute into library module send data distribution request
Message, one or more the real-time distribution module for receiving data distribution request message inquire about binning state information table, and to
The real-time distribution submodule returned data distribution for sending data distribution request message confirms message;The data distribution confirms message
Middle carrying storage and distribution storage space information;The distribution memory space is less than or equal to free memory;
Receive data distribution confirm message real-time distribution submodule, determine storage higher than arrange lowest threshold and
The multiple real-time of warehouse-in demand that data flow is met after combination is distributed into library module, and real-time distributes into library module to the plurality of
Send data distribution message, and confirm distribution memory space in message by received data flow according to the data distribution
Distributed in real time.
8. processing method as claimed in claim 7, it is characterised in that:One or more number is received in distribution submodule in real time
It is used to indicate the source data stream according to the data flow token for after the data flow that source sends, being one or more of data sources
Data source label;
In real time distribution submodule it is determined that meet after combination the warehouse-in demand of data flow it is multiple real-time distribute library module after, to
Meet after combination data flow warehouse-in demand it is multiple real-time distribute send for indicating the filename of distribution of document into library module
List;
It is the plurality of it is real-time distribute into library module according to the data source label and list of file names, the data flow is stored in data
In centralized stores module.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310581497.6A CN103595800B (en) | 2013-11-18 | 2013-11-18 | A kind of real-time distribution processor device and method of data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310581497.6A CN103595800B (en) | 2013-11-18 | 2013-11-18 | A kind of real-time distribution processor device and method of data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103595800A CN103595800A (en) | 2014-02-19 |
CN103595800B true CN103595800B (en) | 2017-04-05 |
Family
ID=50085780
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310581497.6A Active CN103595800B (en) | 2013-11-18 | 2013-11-18 | A kind of real-time distribution processor device and method of data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103595800B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105306173A (en) * | 2015-11-17 | 2016-02-03 | 天泽信息产业股份有限公司 | Adaptive Internet of vehicles terminal access method |
EP3403198A4 (en) * | 2016-01-11 | 2019-09-04 | Oracle America, Inc. | Query-as-a-service system that provides query-result data to remote clients |
CN106487902A (en) * | 2016-10-19 | 2017-03-08 | 华迪计算机集团有限公司 | A kind of method of data capture based on message-oriented middleware and system |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102073683A (en) * | 2010-12-22 | 2011-05-25 | 四川大学 | Distributed real-time news information acquisition system |
CN103152393A (en) * | 2013-02-05 | 2013-06-12 | 北京邮电大学 | Charging method and charging system for cloud computing |
CN103312752A (en) * | 2012-03-13 | 2013-09-18 | 中国联合网络通信集团有限公司 | P2P (Peer to Peer) network information distribution method, downloading node, index server and P2P network information distribution system |
US8943497B2 (en) * | 2008-05-29 | 2015-01-27 | Red Hat, Inc. | Managing subscriptions for cloud-based virtual machines |
-
2013
- 2013-11-18 CN CN201310581497.6A patent/CN103595800B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8943497B2 (en) * | 2008-05-29 | 2015-01-27 | Red Hat, Inc. | Managing subscriptions for cloud-based virtual machines |
CN102073683A (en) * | 2010-12-22 | 2011-05-25 | 四川大学 | Distributed real-time news information acquisition system |
CN103312752A (en) * | 2012-03-13 | 2013-09-18 | 中国联合网络通信集团有限公司 | P2P (Peer to Peer) network information distribution method, downloading node, index server and P2P network information distribution system |
CN103152393A (en) * | 2013-02-05 | 2013-06-12 | 北京邮电大学 | Charging method and charging system for cloud computing |
Also Published As
Publication number | Publication date |
---|---|
CN103595800A (en) | 2014-02-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104969213B (en) | Data flow for low latency data access is split | |
CN104462121B (en) | Data processing method, apparatus and system | |
CN103763343A (en) | Method and device for processing service access | |
CN103491024B (en) | Job scheduling method and device for streaming data | |
CN103281367A (en) | Load balance method and device | |
CN109685429A (en) | Distribution capacity determines method, apparatus, electronic equipment and storage medium | |
CN101741705A (en) | Method and device for parallel processing of routing update messages | |
CN103595800B (en) | A kind of real-time distribution processor device and method of data | |
CN102970242A (en) | Method for achieving load balancing | |
CN104504006A (en) | Method and system for acquiring and analyzing data on news client | |
CN104486116A (en) | Multidimensional query method and multidimensional query system of flow data | |
CN106326339A (en) | Task allocating method and device | |
CN108055701A (en) | A kind of resource regulating method and base station | |
CN103326925A (en) | Message push method and device | |
CN102333280B (en) | A kind of method, system and the Service Process Server of business cipher key renewal | |
CN103974219B (en) | The distribution of a kind of group of charging identifier and delivery method, group charging identifier processing entities | |
CN105243078B (en) | A kind of distribution method of file resource, system and device | |
CN105159925A (en) | Database cluster data distribution method and system | |
CN103248636A (en) | Offline download system and method | |
CN109889349A (en) | A kind of APP broadcast message method for pushing, device and readable storage medium storing program for executing | |
CN109474902A (en) | Message message accounting, method, terminal and system | |
CN106453092B (en) | A kind of route renewing method and device | |
CN102448120A (en) | Multipath load sharing method and device | |
CN108093047A (en) | Data transmission method for uplink, device, electronic equipment and middleware system | |
CN104994181A (en) | Method for displaying dynamic MAC address table in distributed OLT system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |