CN106354795B - A kind of Distributed data exchange system - Google Patents
A kind of Distributed data exchange system Download PDFInfo
- Publication number
- CN106354795B CN106354795B CN201610729474.9A CN201610729474A CN106354795B CN 106354795 B CN106354795 B CN 106354795B CN 201610729474 A CN201610729474 A CN 201610729474A CN 106354795 B CN106354795 B CN 106354795B
- Authority
- CN
- China
- Prior art keywords
- data
- data exchange
- exchange client
- node
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention discloses a kind of Distributed data exchange system, for carrying out data exchange to concurrent data, provides the efficiency of data exchange.In above system, interface editor creates data acquisition flow, and data acquisition flow is sent to the data exchange client node in data exchange client cluster；Data distribution controller realizes class according to shunt controller and the data service acquired is needed to determine draining conditions；Simultaneous streaming to be processed is got from data acquisition sources end, simultaneous streaming to be processed is divided into multiple data fields according to draining conditions, and multiple data fields are respectively allocated to each data exchange client node in data exchange client cluster；Data exchange client cluster carries out data exchange processing to corresponding data field by each data exchange client node that data distribution controller is selected, and each data field after the completion of data exchange processing is respectively stored into database by each data exchange client node.
Description
Technical field
The present invention relates to field of computer technology, and in particular to a kind of Distributed data exchange system.
Background technique
With information-based development, trend will be become by establishing unified data center.For large-scale consumer system, packet
E-commerce, game class system are included, due to being completely newly to construct, data will innately have the gene of unification storage, unified Modeling.And
The big data system of enterprise, government, industry class will be unified by force due to having numerous system on-line operations in history
Data storage and modeling, do not have feasibility.In this case, newly-built big data system will pass through Enterprise Service Bus
The mode of (Enterprise Service Bus, ESB) generates system docking with original online data, passes through existing system
System carries out data acquisition, by converting and carrying out unified storage after modeling, to achieve the purpose that data sharing, intercommunication.
Either large-scale consumer or enterprise, government, industry class system, development and history number with business
According to accumulation, will all form the situation that data volume is big, business is complicated, will also cause to need between not homologous ray a large amount of, continually
Carry out data exchange.Under the application scenarios of ESB, current ESB does not support the data exchange of concurrent processing, concurrent multiple numbers
It will cause data collision when according to storage to database, it can not be to the mass data of lasting generation progress data exchange, data exchange
Efficiency it is lower.
Summary of the invention
The purpose of the present invention is to provide a kind of Distributed data exchange systems, for carrying out data friendship to concurrent data
It changes, the efficiency of data exchange is provided.
In order to achieve the above object, the present invention uses such following technical solution:
The present invention provides a kind of Distributed data exchange system, comprising:
Interface editor is sent to data exchange visitor for creating data acquisition flow, and by the data acquisition flow
Data exchange client node in the cluster of family end, the data acquisition flow include: data source address, data pick-up slip
Part, acquisition field information, scheduling rule and shunt controller realize class；
Data distribution controller divides for realizing that class and the data service for needing to acquire determine according to the shunt controller
Stream condition；Simultaneous streaming to be processed is got from data acquisition sources end, it will be described to be processed according to the draining conditions
Simultaneous streaming is divided into multiple data fields, and the multiple data field is respectively allocated to data exchange client cluster
In each data exchange client node；
Data exchange client cluster, each data exchange client for being selected by the data distribution controller
End node carries out data exchange processing to corresponding data field, is handed over data by each data exchange client node
The each data field changed after the completion of handling is respectively stored into database.
After adopting the above technical scheme, technical solution provided by the invention will have the following advantages:
It include interface editor, data distribution control in Distributed data exchange system provided in an embodiment of the present invention
Device processed and data exchange client cluster include multiple data exchange client nodes in the data exchange client cluster,
Simultaneous streaming to be processed can be divided into multiple data fields according to draining conditions by data classification controller, and will be multiple
Data field is respectively allocated to each data exchange client node in data exchange client cluster, each data exchange visitor
Family end node can carry out data exchange processing to corresponding data field respectively, and each data exchange client node is by data
Each data field after the completion of exchange processing is respectively stored into database.Therefore distributed number provided in an embodiment of the present invention
According to exchange system by concomitantly carrying out data acquisition and transmission, data exchange can be carried out to concurrent data, data friendship is provided
The efficiency changed.
Detailed description of the invention
Fig. 1 is the composed structure schematic diagram of Distributed data exchange system provided in an embodiment of the present invention；
Fig. 2 is data exchange client clustered deploy(ment) structural schematic diagram provided in an embodiment of the present invention；
Fig. 3 is that shunt controller provided in an embodiment of the present invention locks schematic diagram；
Fig. 4 is that table provided in an embodiment of the present invention inputs distributed lock schematic diagram；
Fig. 5 is data exchange process schematic diagram of the present invention.
Specific embodiment
The embodiment of the invention provides a kind of Distributed data exchange systems, for carrying out data exchange to concurrent data,
The efficiency of data exchange is provided.
In order to make the invention's purpose, features and advantages of the invention more obvious and easy to understand, below in conjunction with the present invention
Attached drawing in embodiment, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that disclosed below
Embodiment be only a part of the embodiment of the present invention, and not all embodiments.Based on the embodiments of the present invention, this field
Technical staff's every other embodiment obtained, shall fall within the protection scope of the present invention.
Term " includes " in description and claims of this specification and above-mentioned attached drawing and " having " and they
Any deformation, it is intended that covering non-exclusive includes so as to a series of process, method comprising units, system, product or to set
It is standby to be not necessarily limited to those units, but be not clearly listed or these process, methods, product or equipment are consolidated
The other units having.
In order to improve the efficiency of transmission of ESB, the mode that ESB must be able to support cluster concurrent in the embodiment of the present invention is counted
According to acquisition and transmission.Distributed data exchange system provided in an embodiment of the present invention can be connected by data acquisition sources end and ESB
It connects, to realize the exchange of concurrent data.Request is as shown in fig.1, Distributed data exchange system provided in an embodiment of the present invention
System, comprising:
Interface editor is sent to data exchange client for creating data acquisition flow, and by data acquisition flow
Data exchange client node in cluster, data acquisition flow include: data source address, data acquisition conditions, acquisition word
Segment information, scheduling rule and shunt controller realize class；
Data distribution controller, for realizing class according to shunt controller and the data service acquired being needed to determine shunt bar
Part；Simultaneous streaming to be processed is got from data acquisition sources end, according to draining conditions by concurrent data flow point to be processed
Multiple data fields are segmented into, and multiple data fields are respectively allocated to each data exchange in data exchange client cluster
Client node；
Data exchange client cluster, each data exchange client end segment for being selected by data distribution controller
Point carries out data exchange processing to corresponding data field, by each data exchange client node that data exchange processing is complete
Each data field after is respectively stored into database.
In embodiments of the present invention, data acquisition sources end is connected with ESB, can pass through number from Distributed data exchange system
Simultaneous streaming is collected according to acquisition source, is provided with data exchange visitor in the embodiment of the present invention in Distributed data exchange system
Family end cluster, includes multiple data exchange client nodes in the data exchange client cluster, in the embodiment of the present invention point
Data distribution controller is additionally provided in cloth data exchange system, which can control to simultaneous streaming
Shunting solve the problems, such as that current ESB can not transmit simultaneous streaming to realize simultaneously operating to simultaneous streaming,
The embodiment of the present invention is based on distributed type colony concurrent processing data exchange, to ensure the high efficiency and stability of data exchange.
In some embodiments of the invention, data exchange client cluster is also used to select by data distribution controller
Corresponding data field is encrypted in each data exchange client node selected out, and carries out in each data field
Each data field is decrypted again after the completion of data exchange processing, will be solved by each data exchange client node
Each data field after the completion of close processing is respectively stored into database.
As shown in Fig. 2, being data exchange client clustered deploy(ment) structural schematic diagram of the invention, by the number for disposing cluster
According to exchange client node, data exchange client cluster is by each data exchange client node to data shunt controller
The data field for distributing to the data exchange client node is encrypted, when data exchange client node completes logarithm
After the data exchange processing of field, data exchange client cluster is again by each data exchange client node to data
Field is decrypted, then each data field after the completion of decryption processing is respectively stored into database.Data acquisition
Encryption enters transmission channel afterwards, and the output end of data exchange client node is decrypted when getting data, it is ensured that data
The integrality of transmission.
In some embodiments of the invention, data classification controller, specifically for being opened when data exchange client cluster
When beginning management and running, using shunt controller lock since simultaneous streaming to be processed calculate one data word section data
Position and end Data Position, will match in simultaneous streaming from beginning Data Position to the data field terminated between Data Position
It sets to a data exchange client node in data exchange client cluster, continues to calculate distribution using shunt controller lock
To the data field of another data exchange client node in data exchange client cluster.
As shown in figure 3, locking schematic diagram for shunt controller provided in an embodiment of the present invention.Two places Data Concurrent carries out data
When exchange, in order to avoid each data exchange client node repeated acquisition data, shunt controller lock control, meter can be passed through
The data field that each data exchange client node needs to acquire is calculated, when data exchange client node starts management and running
When, first since shunt controller lock obtain need to acquire data Data Position and terminate Data Position, it is responsible after having obtained
The shunt controller lock for calculating beginning Data Position and end Data Position is released to other data exchange client node sections again
Point uses.It is respectively right that shunt controller lock is obtained by multiple node tasks schedulers for each data exchange client node
The data field answered.For example, the node tasks scheduler of a data exchange client node is grouped timer-triggered scheduler task,
The data field for determining that the data exchange client node needs to acquire is locked using separation controller.
Further, in some embodiments of the invention, data exchange client cluster is specifically used for using shunting control
Device lock processed gets the beginning Data Position for distributing to each data exchange client node and terminates Data Position, triggers each
Data exchange client node is according to the beginning Data Position for being allocated to corresponding data exchange client node and terminates data bit
Set the data field that corresponding each data exchange client node is got from simultaneous streaming.
Specifically, data exchange client node is got using shunt controller lock distributes to the data exchange client
The beginning Data Position and end Data Position of node, the data exchange client node are objective according to corresponding data exchange is allocated to
The beginning Data Position and end Data Position of family end node get corresponding each data exchange client from simultaneous streaming
The data field of end node.For example, as shown in figure 3, altogether including N number of data exchange visitor in data exchange client cluster
Family end node, each data exchange client node use node tasks scheduler, are shunted and are controlled by node tasks scheduler schedules
Device lock processed gets the beginning Data Position for distributing to the data exchange client node and terminates Data Position.
In some embodiments of the invention, data exchange client cluster is specifically used for through each data exchange visitor
Family end node call list inputs distributed lock, inputs distributed lock by table and corresponding data field is written in database
In datum target list.
As shown in figure 4, inputting distributed lock schematic diagram for table provided in an embodiment of the present invention.In the receiving end of data, lead to
Alternative when table input distributed lock realizes control concurrent data insertion database is crossed, table input distributed lock is for concurrently holding
It to be inserted into the service of data when row, in Fig. 4, shares N number of table input, call list inputs distributed lock when being executed for each table input,
Corresponding data field is written in the datum target list in database to which distributed lock will be inputted by table, prevents that
This interference, it is ensured that the consistency of data.
In some embodiments of the invention, data exchange client cluster is also used to from all data exchange clients
A data exchange client host node is selected in node, remainder data exchanges client node as data exchange client
From node, the data acquisition flow that interface editor is sent parse obtaining by data exchange client host node
The flow instance parsed, and stored the flow instance parsed to data exchange client by data exchange client host node
It holds in the rear end caching of cluster, is obtained from the caching of the rear end of data exchange client cluster by data exchange client from node
Get the flow instance parsed.
It is illustrated below, it, can be from all data exchange client nodes in the deployment of data exchange client cluster
A data exchange client host node is selected, the parsing being responsible for when process publication by data exchange client host node simultaneously will solution
Flow instance after analysis is put into the rear end caching of data exchange client cluster, and process just no longer needs to solve when dispatching next time
Analyse the configuration information of process, if from rear end caching can quick obtaining, while when modification process is issued again, data
Exchange client host node is responsible for buffer update, and the physical file of process configuration information all can be by data exchange client host node
Copy is a to each data exchange client from node, when data exchange client host node or abnormal caching appearance,
His data exchange client can be competed rapidly from node as host node, and guarantee that the process of data exchange is unaffected.
In some embodiments of the invention, data distribution controller is also used to deposit in data exchange client cluster
When data exchange client node is abnormal, the data exchange client node into data exchange client cluster again
Distribute data field.For example, simultaneous streaming can be redistributed when there is data exchange client node to be abnormal
In each data field, shunting logic is recalculated by data distribution controller, may insure data by way of cluster
The stability of exchange.By concomitantly carrying out data acquisition and transmission, the high efficiency of data exchange has been effectively ensured.
In order to facilitate a better understanding and implementation of the above scheme of the embodiment of the present invention, corresponding application scenarios of illustrating below come
It is specifically described.The present embodiments relate to distributed type colony concurrent processing data exchange is based on, to ensure data exchange
High efficiency and stability.It is an object of the invention to ensure the stability in data exchange process and effectively improve data exchange
Performance, it is ensured that data exchange being capable of 7*24 hours stable continuous services.
As shown in figure 5, illustrate " the data exchange client node " of Fig. 2, " the shunt controller lock " of Fig. 3, involved by Fig. 4
And " table input distributed lock " between relationship, i.e., " data exchange client node " to acquire to pass through before data and " shunt
Controller lock ", which obtains, will acquire starting position and the end position of data, after the completion of acquisition " data exchange client node " into
The cleaning of row data is converted, and after data mart modeling, each " table input " service passes through " table input point before being inserted into object table
The alternative of cloth lock " control data insertion.A point indicates data acquisition sources end, and B point indicates data receiver destination.
In the embodiment of the present invention, using clustered deploy(ment) data exchange client node, carried out by way of data distribution
Data Concurrent acquisition and transmission input the alternative that distributed lock realizes insertion by table in the input terminal of data.When there is node
When occurring abnormal, shunting logic is recalculated by data distribution controller, may insure data exchange by way of cluster
Stability；By concomitantly carrying out data acquisition and transmission, the high efficiency of data exchange has been effectively ensured.
As shown in Fig. 1 to 5, the cluster concurrent method based on Distributed data exchange is may be implemented in the embodiment of the present invention, tool
Body including the following steps:
Step 1, the process that the acquisition of a data is created by visual interface editor, this process recording data source
Address, the condition for acquiring data, acquisition field information, scheduling rule, shunt controller realize the information such as class.Wherein, control is shunted
Device processed realizes that class is the class name for calling shunt controller to realize class, because shunt controller is that different business is supported secondary can to expand
Expansion hair.Procedure information (include: from which table acquisition data, acquire to carry out after which field, acquisition how process data
The service configuration information of equal acquisitions transmission) finally save as the XML format data file of standard.
One step 2, creation data shunt controller, the realization of data distribution controller divide the data to be acquired
Stream, data distribution controller determines draining conditions according to practical business, if any 3 clustered nodes: node 1 acquires 1-4 month
Data field, node 2 acquire the data field in 5-8 month, and node 3 acquires the data field in 9-12 month.Data distribution control
Device will be compiled packing after realizing, file is put into XML same file clip directory described in step 1 after compiling, data
When exchanging client node process of analysis configuration file, the logic of shunt controller is called to realize streamed data by reflection mode
Exchange, wherein reflection mode, which refers in java operational process, realizes that class is gone load to realize and corresponded to according to specified shunt controller
Shunting logic.
Step 3, the data exchange client node for disposing cluster copy the process for acquiring data publication under cluster to
Each data exchange client node, data exchange client node carry out parsing to process and by data exchange client nodes
The core engine driving of itself starts data acquisition.
Step 4, node task dispatcher be responsible for timer-triggered scheduler task, this node needs are confirmed by data distribution controller
The data information of acquisition, and collected data result collection is put into transmission channel and is output to target location, it is propped up in transmission process
Hold the encryption of sensitive data.
Step 5, the receiving end in data are realized the alternative of control concurrent data insertion by distributed lock, prevent that
This interference, it is ensured that the consistency of data.
The present invention provides effective Security Assurance Mechanism, integrality of the data transmission using MD5 verification data, WEB service
Provide the safety protecting mechanism based on WS-Security specification.Data exchange client provides complete across a network communication
Security mechanism, including the Authentication mechanism that HTTPS, Web Service, Restful are accessed, message encryption/decrypted transport machine
System, the signature and sign test mechanism of message provide safety prevention measure in transport layer, message layer, application layer.When supporting data transmission
Encrypting and decrypting, in business procession, user needs that certain sensitive datas are encrypted, and is receiving encryption number
According to when operation is decrypted.
In the embodiment of the present invention, the logic of data distribution is calculated by shunt controller, shunt controller can be according to reality
The needs extension of business is realized to improve flexibility.Data exchange client host node under cluster is responsible for parsing data exchange
Procedure information, and procedure information is put into caching, when process starts scheduling, procedure information rapidly can be obtained from caching,
Process of analysis information is gone again without each node；Each data exchange client node will be inserted into data to transmission destination
When, the consistency of data is controlled by distributed lock.The class requirement of safety depends on practical business in the embodiment of the present invention
Needs, security level just introduces the Encryption Algorithm supported of ESB itself, such as DES, RSA, Base64 etc. if necessary to relatively high
It is transmitted after encryption, if you do not need to then not encrypted transmission.
In addition it should be noted that, the apparatus embodiments described above are merely exemplary, wherein described as separation
The unit of part description may or may not be physically separated, component shown as a unit can be or
It can not be physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to reality
Border needs to select some or all of the modules therein to achieve the purpose of the solution of this embodiment.In addition, provided by the invention
In Installation practice attached drawing, the connection relationship between module indicates there is communication connection between them, specifically can be implemented as one
Item or a plurality of communication bus or signal wire.Those of ordinary skill in the art are without creative efforts, it can
It understands and implements.
Through the above description of the embodiments, it is apparent to those skilled in the art that the present invention can borrow
Help software that the mode of required common hardware is added to realize, naturally it is also possible to by specialized hardware include specific integrated circuit, specially
It is realized with CPU, private memory, special components and parts etc..Under normal circumstances, all functions of being completed by computer program are ok
It is easily realized with corresponding hardware, moreover, being used to realize that the specific hardware structure of same function is also possible to a variety of more
Sample, such as analog circuit, digital circuit or special circuit etc..But software program is real in situations more for the purpose of the present invention
It is now more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words makes the prior art
The part of contribution can be embodied in the form of software products, which is stored in the storage medium that can be read
In, such as the floppy disk of computer, USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory
Device (RAM, Random Access Memory), magnetic or disk etc., including some instructions are with so that a computer is set
Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the present invention.
In conclusion the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although referring to upper
Stating embodiment, invention is explained in detail, those skilled in the art should understand that: it still can be to upper
Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features；And these
It modifies or replaces, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution.
Claims (7)
1. a kind of Distributed data exchange system characterized by comprising
Interface editor is sent to data exchange client for creating data acquisition flow, and by the data acquisition flow
Data exchange client node in cluster, the data acquisition flow include: data source address, data acquisition conditions, adopt
Collect field information, scheduling rule and shunt controller and realizes class；
Data distribution controller, for realizing class according to the shunt controller and the data service acquired being needed to determine shunt bar
Part；Simultaneous streaming to be processed is got from data acquisition sources end, it will be described to be processed concurrent according to the draining conditions
Data flow is divided into multiple data fields, and the multiple data field is respectively allocated in data exchange client cluster
Each data exchange client node；
Data exchange client cluster, each data exchange client end segment for being selected by the data distribution controller
Point carries out data exchange processing to corresponding data field, will be at data exchange by each data exchange client node
Each data field after the completion of reason is respectively stored into database.
2. a kind of Distributed data exchange system according to claim 1, which is characterized in that the data exchange client
Cluster, each data exchange client node for being also used to select by the data distribution controller is to corresponding data word
Section is encrypted, and each data field is decrypted again after the completion of each data field carries out data exchange processing
Processing, is respectively stored into number for each data field after the completion of decryption processing by each data exchange client node
According in library.
3. a kind of Distributed data exchange system according to claim 1, which is characterized in that the data distribution control
Device, specifically for being locked from described to be processed using shunt controller when data exchange client cluster starts management and running
Simultaneous streaming calculate one data word section beginning Data Position and terminate Data Position, by the simultaneous streaming from
It is described to start Data Position to the data field configuration between the end Data Position to the data exchange client cluster
In a data exchange client node, using the shunt controller lock continue calculate distribute to the data exchange client
Hold the data field of another data exchange client node in cluster.
4. a kind of Distributed data exchange system according to claim 3, which is characterized in that the data exchange client
Cluster distributes to the beginning data of each data exchange client node specifically for getting using shunt controller lock
Position and end Data Position, trigger each data exchange client node according to corresponding data is allocated to and exchange client node
Beginning Data Position and terminate Data Position and get corresponding each data exchange client end segment from the simultaneous streaming
The data field of point.
5. a kind of Distributed data exchange system according to claim 1, which is characterized in that the data exchange client
Cluster is specifically used for inputting distributed lock by each data exchange client node call list, be inputted by the table
Corresponding data field is written in the datum target list in database by distributed lock.
6. a kind of Distributed data exchange system according to any one of claim 1 to 5, which is characterized in that the number
According to exchange client cluster, it is also used to select the main section of data exchange client from all data exchange client nodes
Point, remainder data exchange client node as data exchange client from node, pass through the main section of data exchange client
Point carries out flow instance of the parsing to be parsed to the data acquisition flow that the interface editor is sent, and by described
The flow instance parsed is stored to the rear end of the data exchange client cluster and is cached by data exchange client host node
In, it is got from the caching of the rear end of the data exchange client cluster by the data exchange client from node described
The flow instance parsed.
7. a kind of Distributed data exchange system according to any one of claim 1 to 5, which is characterized in that the number
According to shunt controller, it is also used to when there are data exchange client nodes to be abnormal in the data exchange client cluster
When, the data exchange client node into data exchange client cluster distributes data field again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610729474.9A CN106354795B (en) | 2016-08-26 | 2016-08-26 | A kind of Distributed data exchange system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610729474.9A CN106354795B (en) | 2016-08-26 | 2016-08-26 | A kind of Distributed data exchange system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106354795A CN106354795A (en) | 2017-01-25 |
| CN106354795B true CN106354795B (en) | 2019-09-17 |
Family
ID=57854263
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610729474.9A Active CN106354795B (en) | 2016-08-26 | 2016-08-26 | A kind of Distributed data exchange system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106354795B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107222539B (en) * | 2017-06-05 | 2020-03-13 | 西安交通大学 | Cache deployment method based on node competition delay cost model |
| CN109412970B (en) * | 2018-09-30 | 2022-07-05 | 江苏满运软件科技有限公司 | Data transfer system, data transfer method, electronic device, and storage medium |
| CN109766325B (en) * | 2019-01-09 | 2019-09-17 | 吴思齐 | A kind of distributed file system and flow data wiring method towards flow data |
| CN110471977B (en) * | 2019-08-22 | 2022-04-22 | 杭州数梦工场科技有限公司 | Data exchange method, device, equipment and medium |
| CN110888858B (en) * | 2019-10-29 | 2023-06-30 | 北京奇艺世纪科技有限公司 | Database operation method and device, storage medium and electronic device |
| CN112235193B (en) * | 2020-10-12 | 2022-08-30 | 南威软件股份有限公司 | Data transmission method, device, equipment and medium based on cross-network multi-level routing |
| CN113486629A (en) * | 2020-12-31 | 2021-10-08 | 易百信息技术（上海）股份有限公司 | Application method and system for enterprise service bus of docking third-party system |
| CN116305220B (en) * | 2023-05-18 | 2023-08-08 | 天云融创数据科技（北京）有限公司 | Big data-based resource data processing method and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102724063A (en) * | 2012-05-11 | 2012-10-10 | 北京邮电大学 | Log collection server, data packet delivering and log clustering methods and network |
| CN104866528A (en) * | 2015-04-24 | 2015-08-26 | 广东小天才科技有限公司 | Multi-platform data acquisition method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8949257B2 (en) * | 2008-02-01 | 2015-02-03 | Mandiant, Llc | Method and system for collecting and organizing data corresponding to an event |
-
2016
- 2016-08-26 CN CN201610729474.9A patent/CN106354795B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102724063A (en) * | 2012-05-11 | 2012-10-10 | 北京邮电大学 | Log collection server, data packet delivering and log clustering methods and network |
| CN104866528A (en) * | 2015-04-24 | 2015-08-26 | 广东小天才科技有限公司 | Multi-platform data acquisition method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106354795A (en) | 2017-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106354795B (en) | A kind of Distributed data exchange system | |
| CN102170440B (en) | Method suitable for safely migrating data between storage clouds | |
| CN103259762B (en) | A kind of file encryption based on cloud storage, decryption method and system | |
| CN104503745B (en) | A kind of method and apparatus generated using channel packet | |
| CN106209739A (en) | Cloud storage method and system | |
| US10091123B2 (en) | System and user interface for coordinating distributed workflow between multiple computing systems | |
| US10771243B1 (en) | Multicast encryption scheme for data-ownership platform | |
| CN112235193B (en) | Data transmission method, device, equipment and medium based on cross-network multi-level routing | |
| CN107819891A (en) | Data processing method, device, computer equipment and storage medium | |
| CN103403731A (en) | Data encryption processing device and method of cloud storage system | |
| US20200259810A1 (en) | Systems and methods for blockchain-based secure storage | |
| CN103631636A (en) | Enabling multi-tenancy for a commerce server | |
| CN108777685A (en) | Method and apparatus for handling information | |
| AU2014342832B2 (en) | Method and system for automatically managing secret application and maintenance | |
| US11716354B2 (en) | Determination of compliance with security technical implementation guide standards | |
| CN112804360A (en) | Method and apparatus for providing cross-chain private data | |
| CN108268284A (en) | Application program conversion equipment and method | |
| CN114780982A (en) | Flow business circulation method, device and system | |
| CN110245014A (en) | Data processing method and device | |
| WO2017188417A1 (en) | Data transmission system, data transmission device, data transmission method, and computer-readable recording medium | |
| Jeong et al. | An efficient cloud storage model for cloud computing environment | |
| CN112528239A (en) | Method and device for automatically authorizing software | |
| CN105302645B (en) | A kind of task distribution method and device | |
| CA3011477A1 (en) | Method, system, and device for selecting a winner of a raffle based on content from raffle tickets | |
| CN106598721A (en) | Media asset data circulating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |