CN104519130A - Trans-IDC (internet data center) data sharing caching method - Google Patents
Trans-IDC (internet data center) data sharing caching method Download PDFInfo
- Publication number
- CN104519130A CN104519130A CN201410784343.1A CN201410784343A CN104519130A CN 104519130 A CN104519130 A CN 104519130A CN 201410784343 A CN201410784343 A CN 201410784343A CN 104519130 A CN104519130 A CN 104519130A
- Authority
- CN
- China
- Prior art keywords
- data
- internet
- data center
- local
- idc
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a trans-IDC (internet data center) data sharing caching method. The method includes: (1), establishing a local sharing cache, and initializing data; (2), registering, and establishing sharing cache network connection among internet data centers; (3), performing data writing and synchronization; (4), providing data services for other internet data centers. The trans-IDC data sharing caching method has the advantages that sharing caches of multiple internet data centers are integrally connected to perform data writing and synchronization, and the data services are provided to the other internet data centers, so that data of the internet data centers can be synchronized in a short time, data consistency can be guaranteed, the internet data centers of various regions can acquire countrywide data and provide the data services on this account, and service quality and service response speed can be increased remarkably.
Description
Technical field
The present invention relates to the technical field of internet data process, relate to a kind of data sharing caching method across IDC particularly, between different Internet data centers (IDC, Internet Data Center), namely carry out the shared buffer memory of data.
Background technology
The shared buffer memory service of the Internet provides Data support for real time service, usually based on memory database, as exploitations such as redis, mongodb, can respond inquiry fast, extensively for Internet enterprises adopts.Across the data sharing caching method of IDC for requiring to provide the field serving, need comprehensive data on a large scale, especially as field of traffic, very important.
The mentality of designing of the existing data sharing caching method across IDC is as follows:
1., based on local data, synchronous strange land data termly, as 24 hours Integral synchronous strange land data.
2. service is only for local service, can not the data of other Internet data centers of real-time synchronization.
Therefore, there is obvious technical deficiency in the above data sharing caching method across IDC:
1. shared buffer memory only supports local service;
2. can not real-time synchronization strange land data center data;
3. can not provide associated service before there is no synchronous strange land data;
4. between different pieces of information center, data consistency is poor;
5. limit by wide area network transmission, efficiency of transmission is not high;
6. lack real-time, or only synchronous static data, as user basic information, can not the multidate information of simultaneous user's real time position.
But, along with the development and progress of human society, people adopt automobile as the vehicles more and more, and the automobile on road increases swift and violent, data between the Internet data center of zones of different usually need to be transmitted in real time, and the user for zones of different checks analysis.
Summary of the invention
Technology of the present invention is dealt with problems and is: overcome the deficiencies in the prior art, a kind of data sharing caching method across IDC is provided, it can make the data of multiple Internet data center complete data syn-chronization at short notice, ensure the consistency of data, ensure that various places Internet data center can obtain the data in the whole nation and provide data, services with this, significantly improve service quality and the service speed of response.
Technical solution of the present invention is: this data sharing caching method across IDC, and the method comprises the following steps:
(1) local shared buffer memory is set up, initialization data;
(2) register, the shared buffer memory network setting up each Internet data center connects;
(3) data write and synchronous is carried out;
(4) data, services is provided to other Internet data center.
The shared buffer memory of multiple Internet data center is connected the as a whole data write and synchronous carried out by the present invention, and provide data, services to other Internet data center, so the data of multiple Internet data center can be made to complete data syn-chronization at short notice, ensure the consistency of data, ensure that various places Internet data center can obtain the data in the whole nation and provide data, services with this, significantly improve service quality and the service speed of response.
Additionally provide a kind of data sharing caching method across IDC, the method comprises the following steps:
(I) start;
(II) configuration information is obtained;
(III) initialization system, sets up routing table;
(IV) initialization network connects;
(V) local data base is connected;
(VI) service is started;
(VII) judge whether response request stops, and is, perform step (XIV), otherwise perform step (VIII);
(VIII) interception request, if read requests then performs step (IX), if write request then performs step (XI);
(IX) local data base is inquired about;
(X) response request, jump procedure (VII);
(XI) determining whether local request, is perform step (XII), otherwise performs step (XIII);
(XII) route shunting, local data writes other Internet data center;
(XIII) local data base is write, jump procedure (X);
(XIV) terminate.
Accompanying drawing explanation
Fig. 1 is the flow chart of a preferred embodiment according to the data sharing caching method across IDC of the present invention.
Embodiment
This data sharing caching method across IDC, the method comprises the following steps:
(1) local shared buffer memory is set up, initialization data;
(2) register, the shared buffer memory network setting up each Internet data center connects;
(3) data write and synchronous is carried out;
(4) data, services is provided to other Internet data center.
The shared buffer memory of multiple Internet data center is connected the as a whole data write and synchronous carried out by the present invention, and provide data, services to other Internet data center, so the data of multiple Internet data center can be made within the short time (being 50ms during normal network conditions) to complete data syn-chronization, ensure the consistency of data, ensure that various places Internet data center can obtain the data in the whole nation and provide data, services with this, significantly improve service quality and the service speed of response.
In addition, in described step (1), initialization data is from other Internet data center's synchrodata.Certainly, alternate manner also can be taked to carry out initialization data.
In addition, described step (3) comprises step by step following:
(3.1) determine the logical relation between each Internet data center, determine whether that local data needs to be synchronized to those data centers according to logical relation, set up routing table;
(3.2) data access, through routing table, judges the data center needing write;
(3.3) table of query and routing, selects routing channel;
(3.4) local shared buffer memory is write;
(3.5) by route technology reading cache data, distributing data;
(3.6) through data platform development kit DPDK server (i.e. Distribution Center), amendment original header, is sent to the DPDK server of other Internet data center;
(3.7) the DPDK server of other Internet data center receives message, reverts to original header, writes local shared buffer memory.
In addition, described step (3) also comprises step by step following:
(3.8) inquiry service is provided;
(3.9) real-time synchronization, when local data center has write operation, by the operation name of this operation and data, sequence turns to byte stream, transmits; After strange land data center receives this message, unserializing obtains operating data, performs this operation and completes synchronously.
As shown in Figure 1, additionally provide a kind of data sharing caching method across IDC, the method comprises the following steps:
(I) start; (in Fig. 1 this step not shown)
(II) configuration information is obtained;
(III) initialization system, sets up routing table;
(IV) initialization network connects;
(V) local data base is connected;
(VI) service is started;
(VII) judge whether response request stops, and is, perform step (XIV), otherwise perform step (VIII);
(VIII) interception request, if read requests then performs step (IX), if write request then performs step (XI); (now the data write of other Internet data center is local)
(IX) local data base is inquired about;
(X) response request, jump procedure (VII);
(XI) determining whether local request, is perform step (XII), otherwise performs step (XIII);
(XII) route shunting, local data writes other Internet data center;
(XIII) local data base is write, jump procedure (X);
(XIV) terminate.
In addition, in described step (XII): Data dissemination center is distributed to other data center according to routing rule; Other data center listens to new order, resolves this order, and performs this order in place data center, completes data syn-chronization.
Relative to prior art, this method has following innovative point:
1. based on memory database;
2. be based upon the routing mechanism that shared buffer memory sets up Data dissemination;
3., based on the two-forty of DPDK technique guarantee shared buffer memory data syn-chronization, the distribution of packet is focused on the webserver of specialty, coordinate compression algorithm, the utilance of server and bandwidth can be significantly improved;
4. plug-in unitization design, can be selected by user by Data replication and distribution strategy, only affect efficiency, do not affect functional realiey.
The above; it is only preferred embodiment of the present invention; not any pro forma restriction is done to the present invention, every above embodiment is done according to technical spirit of the present invention any simple modification, equivalent variations and modification, all still belong to the protection range of technical solution of the present invention.
Claims (6)
1., across a data sharing caching method of IDC, it is characterized in that: the method comprises the following steps:
(1) local shared buffer memory is set up, initialization data;
(2) register, the shared buffer memory network setting up each Internet data center connects;
(3) data write and synchronous is carried out;
(4) data, services is provided to other Internet data center.
2. the data sharing caching method across IDC according to claim 1, is characterized in that: in described step (1), initialization data is from other Internet data center's synchrodata.
3. the data sharing caching method across IDC according to claim 1 and 2, is characterized in that: described step (3) comprises step by step following:
(3.1) determine the logical relation between each Internet data center, determine whether that local data needs to be synchronized to those data centers according to logical relation, set up routing table;
(3.2) data access, through routing table, judges the data center needing write;
(3.3) table of query and routing, selects routing channel;
(3.4) local shared buffer memory is write;
(3.5) by route technology reading cache data, distributing data;
(3.6) through data platform development kit DPDK server, amendment original header, is sent to the DPDK server of other Internet data center;
(3.7) the DPDK server of other Internet data center receives message, reverts to original header, writes local shared buffer memory.
4. the data sharing caching method across IDC according to claim 3, is characterized in that: described step (3) also comprises step by step following:
(3.8) inquiry service is provided;
(3.9) real-time synchronization, when local data center has write operation, by the operation name of this operation and data, sequence turns to byte stream, transmits; After strange land data center receives this message, unserializing obtains operating data, performs this operation and completes synchronously.
5., across a data sharing caching method of IDC, it is characterized in that: the method comprises the following steps:
(I) start;
(II) configuration information is obtained;
(III) initialization system, sets up routing table;
(IV) initialization network connects;
(V) local data base is connected;
(VI) service is started;
(VII) judge whether response request stops, and is, perform step (XIV), otherwise perform step (VIII);
(VIII) interception request, if read requests then performs step (IX), if write request then performs step (XI);
(IX) local data base is inquired about;
(X) response request, jump procedure (VII);
(XI) determining whether local request, is perform step (XII), otherwise performs step (XIII);
(XII) route shunting, local data writes other Internet data center;
(XIII) local data base is write, jump procedure (X);
(XIV) terminate.
6. the data sharing caching method across IDC according to claim 5, is characterized in that: in described step (XII): Data dissemination center is distributed to other data center according to routing rule; Other data center listens to new order, resolves this order, and performs this order in place data center, completes data syn-chronization.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410784343.1A CN104519130B (en) | 2014-12-16 | 2014-12-16 | A kind of data sharing caching method across IDC |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410784343.1A CN104519130B (en) | 2014-12-16 | 2014-12-16 | A kind of data sharing caching method across IDC |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104519130A true CN104519130A (en) | 2015-04-15 |
| CN104519130B CN104519130B (en) | 2018-02-27 |
Family
ID=52793833
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410784343.1A Active CN104519130B (en) | 2014-12-16 | 2014-12-16 | A kind of data sharing caching method across IDC |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104519130B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106101280A (en) * | 2016-08-18 | 2016-11-09 | 无锡华云数据技术服务有限公司 | A kind of network information synchronization update method between data center |
| CN109213766A (en) * | 2018-09-12 | 2019-01-15 | 福建天泉教育科技有限公司 | A kind of processing method and terminal of data zero-lag |
| CN109522353A (en) * | 2018-11-09 | 2019-03-26 | 福建南威软件有限公司 | The trans-regional shared implementation method of electronics license based on routing table |
| CN109788060A (en) * | 2019-01-22 | 2019-05-21 | 曲阜师范大学 | Cloud data sharing and update method based on block chain |
| US10333788B2 (en) | 2015-12-29 | 2019-06-25 | Alibaba Group Holding Limited | System and method for acquiring, processing and updating global information |
| US10425502B2 (en) | 2015-12-29 | 2019-09-24 | Alibaba Group Holding Limited | System and method for acquiring, processing and updating global information |
| US10440069B2 (en) | 2015-12-29 | 2019-10-08 | Alibaba Group Holding Limited | System and method for acquiring, processing, and updating global information |
| WO2021093079A1 (en) * | 2019-11-11 | 2021-05-20 | 广州华多网络科技有限公司 | Service data processing method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078957A (en) * | 2013-02-01 | 2013-05-01 | 北京航空航天大学 | Data center mirror image distribution system supporting IDC (Internet Data Center) domain functions |
| CN103685486A (en) * | 2013-12-02 | 2014-03-26 | 中国科学院计算技术研究所 | Distributed system monitoring method stepping over data center clusters and system |
| CN103763368A (en) * | 2014-01-20 | 2014-04-30 | 浪潮电子信息产业股份有限公司 | Cross-data-center data synchronism method |
| CN103945004A (en) * | 2014-05-06 | 2014-07-23 | 中国联合网络通信集团有限公司 | Dispatching method and system for data between data centers |
-
2014
- 2014-12-16 CN CN201410784343.1A patent/CN104519130B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078957A (en) * | 2013-02-01 | 2013-05-01 | 北京航空航天大学 | Data center mirror image distribution system supporting IDC (Internet Data Center) domain functions |
| CN103685486A (en) * | 2013-12-02 | 2014-03-26 | 中国科学院计算技术研究所 | Distributed system monitoring method stepping over data center clusters and system |
| CN103763368A (en) * | 2014-01-20 | 2014-04-30 | 浪潮电子信息产业股份有限公司 | Cross-data-center data synchronism method |
| CN103945004A (en) * | 2014-05-06 | 2014-07-23 | 中国联合网络通信集团有限公司 | Dispatching method and system for data between data centers |
Non-Patent Citations (1)
| Title |
|---|
| 码迷: ""跨IDC ycache原理和配置说明"", 《码迷》 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10333788B2 (en) | 2015-12-29 | 2019-06-25 | Alibaba Group Holding Limited | System and method for acquiring, processing and updating global information |
| US10425502B2 (en) | 2015-12-29 | 2019-09-24 | Alibaba Group Holding Limited | System and method for acquiring, processing and updating global information |
| US10440069B2 (en) | 2015-12-29 | 2019-10-08 | Alibaba Group Holding Limited | System and method for acquiring, processing, and updating global information |
| CN106101280A (en) * | 2016-08-18 | 2016-11-09 | 无锡华云数据技术服务有限公司 | A kind of network information synchronization update method between data center |
| CN106101280B (en) * | 2016-08-18 | 2019-01-22 | 无锡华云数据技术服务有限公司 | A kind of network information synchronization update method between data center |
| CN109213766A (en) * | 2018-09-12 | 2019-01-15 | 福建天泉教育科技有限公司 | A kind of processing method and terminal of data zero-lag |
| CN109213766B (en) * | 2018-09-12 | 2021-03-26 | 福建天泉教育科技有限公司 | Data zero-delay processing method and terminal |
| CN109522353A (en) * | 2018-11-09 | 2019-03-26 | 福建南威软件有限公司 | The trans-regional shared implementation method of electronics license based on routing table |
| CN109788060A (en) * | 2019-01-22 | 2019-05-21 | 曲阜师范大学 | Cloud data sharing and update method based on block chain |
| CN109788060B (en) * | 2019-01-22 | 2021-05-07 | 曲阜师范大学 | Cloud data sharing and updating method based on block chain |
| WO2021093079A1 (en) * | 2019-11-11 | 2021-05-20 | 广州华多网络科技有限公司 | Service data processing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104519130B (en) | 2018-02-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104519130A (en) | Trans-IDC (internet data center) data sharing caching method | |
| CN104009920B (en) | The processing method of data source movement, the method for E-Packeting and its device | |
| CN103493455B (en) | Use the global traffic management of modified host name | |
| CN104469261B (en) | A kind of video conferencing system and method based on CDN | |
| Dodge | The geographies of Cyberspace. A research note | |
| CN105657006B (en) | A kind of access acceleration method and system for the first time accelerating network based on online | |
| CN109391640A (en) | Dynamic content accesses accelerated method, system, medium and computing device | |
| CN109408234A (en) | A kind of augmented reality data-optimized systems and method based on edge calculations | |
| CN106357539A (en) | Data acquisition method and equipment | |
| CN103198135A (en) | Microblog registration data online acquiring method for grid division of geographic regions | |
| CN113556413A (en) | Message processing method and device | |
| CN109873767A (en) | Incorporate network virtualization method based on the forwarding of agreement unaware | |
| CN103426325A (en) | Two-dimensional bar code electronic station board | |
| CN106131242B (en) | Classification method of IP application scenes | |
| CN114710523A (en) | Multi-region Internet of vehicles cloud platform architecture and vehicle fixed region access method | |
| CN102075584B (en) | Distributed file system and access method thereof | |
| CN104125310B (en) | Message method based on semi-permanent address | |
| CN105027532B (en) | Content distribution method and device | |
| CN110740459B (en) | uRLLC network slice generation device and generation method based on GPS | |
| CN102594866A (en) | Map service providing system and method | |
| CN1988551A (en) | Online user inquiry method and system | |
| CN102487406B (en) | A kind of terminal address book enhancing system of cloud mode | |
| CN103052052B (en) | The method and system that fixed number is migrated to IMS network by tradition fixed telephone network | |
| CN103414777A (en) | Distributed geographic information matching system and method based on content distribution network | |
| CN105306571A (en) | Method and system for supporting stateful anycast in NDN based on routing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |