CN103078946A - Mass real-time data distributing method and mass real-time data access method - Google Patents
Mass real-time data distributing method and mass real-time data access method Download PDFInfo
- Publication number
- CN103078946A CN103078946A CN2013100094521A CN201310009452A CN103078946A CN 103078946 A CN103078946 A CN 103078946A CN 2013100094521 A CN2013100094521 A CN 2013100094521A CN 201310009452 A CN201310009452 A CN 201310009452A CN 103078946 A CN103078946 A CN 103078946A
- Authority
- CN
- China
- Prior art keywords
- circle
- cryptographic hash
- time data
- database node
- hash value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a mass real-time data distributing method and a mass real-time data access method. The mass real-time data distributing method comprises the following steps of calculating a first hash value of each real-time database node by utilizing a hash function, and configuring the obtained first hash value onto a circle; calculating a second hash value of the test-point information by utilizing the hash function; mapping the second hash value onto the circle to be matched with the first hash value, storing the data of the second hash value onto a first database node which is matched on the circle; and storing the data of the second hash value onto a first database node on the circle at the beginning of the searching if the second hash value cannot find a matched database node after searching one turn on the circle. According to the mass real-time data distributing method and the access method, the re-distribution of measured points on each database node can be maximally inhibited, the nonuniformity for distributing the measured points on each database node can be effectively prevented, the re-distribution of the database nodes when the database nodes are increased or reduced can be maximally reduced, the access time also can be greatly shortened through the rapid and convenient access steps, and the access efficiency is greatly increased.
Description
?
Technical field
The present invention relates to a kind of magnanimity real time data location mode and access method thereof.
Background technology
The handled data of real-time data base are the measuring point in the workflow industry and the real time data that collects thereof, do not have very strong logic association between each measuring point and the real time data thereof, this specific character is so that real-time data base is particularly suitable for carrying out distributed deployment and application just.
The real-time data base product that comparative maturity has been arranged at present both at home and abroad, these products also can carry out distributed deployment and use, shown in the following accompanying drawing 1 of common deployment mode, real-time data base distribute at net environment and be deployed on each station server (DB-1, DB-2 ..., DB-M), in the network environment each use (APP-1, APP-2 ..., APP-N) access each database server according to oneself needs and obtain or Update Table.This deployment way requires each application need to know each its data storage position that will access, under the real-time applied environment of magnanimity, also need especially performance and the capacity situation of the server at understanding data place can satisfy its application requirements, this just requires the physics of each application system and Database Systems to dispose close-coupled, and planning, the design and development of using system are realized having proposed very high requirement.Along with the scale of real time data is increasing, the source of real time data is more and more diversified, requirement to the application system of real time data is more and more higher, become increasingly complex, can greatly increase and use difficulty and the complexity of carrying out and safeguarding, and this way does not meet the layering construction principle of application system, the final result that finally can cause application system at all can't launch yet.
?
Summary of the invention
For addressing the above problem, a kind of magnanimity real time data location mode and the access method thereof that the object of the present invention is to provide, it has suppressed the redistribution of measuring point at each database node to greatest extent, and the establishment measuring point each database node distribute inhomogeneous, the redistribution of the measuring point in the time of can reducing to greatest extent the database node increase and decrease, and accessing step has also shortened the access time greatly quickly and easily, has greatly improved access efficiency.
The present invention is the purpose that reaches above-mentioned, and the present invention adopts following technical scheme:
A kind of magnanimity real time data location mode at first utilizes hash function to calculate the first cryptographic Hash of each real-time data base node, and the first cryptographic Hash of gained is configured on the circle; Then utilize hash function to calculate the second cryptographic Hash of test point information; Then the second cryptographic Hash is mapped to circle and upward mates with the first cryptographic Hash, and its data are saved on first database node that is complementary on the circle; If the second cryptographic Hash is sought a circle successor at circle and do not found the database node that is complementary, then it is saved on first database node when beginning to seek on the circle.
Described circle is divided into 2
32Equal portions.
A kind of access method of magnanimity real time data location mode, may further comprise the steps: at first the visit information with application system calculates the 3rd cryptographic Hash by hash function, then the 3rd cryptographic Hash and the second cryptographic Hash are mated, the match is successful then conducts interviews to the database node at the second cryptographic Hash place that the match is successful, and visit information is fed back to application system; If the 3rd cryptographic Hash does not find the second cryptographic Hash that is complementary after circle is sought a circle, then its automatically with circle on the second cryptographic Hash on first database node when beginning to seek be complementary, and first database node is conducted interviews, visit information is fed back to application system.
Beneficial effect of the present invention is: a kind of magnanimity real time data location mode provided by the invention and access method thereof, it has suppressed the redistribution of measuring point at each database node to greatest extent, and the establishment measuring point each database node distribute inhomogeneous, the redistribution of the measuring point in the time of can reducing to greatest extent the database node increase and decrease, and accessing step has also shortened the access time greatly quickly and easily, has greatly improved access efficiency.
Description of drawings
Fig. 1 is existing its distributed deployment structural representation of real-time data base;
Fig. 2 is real-time data base distributed deployment structural representation of the present invention.
Embodiment
As shown in Figure 1, the present embodiment provides a kind of magnanimity real time data location mode, at first utilize hash function to calculate each real-time data base node (Node1, Node2 ... Node n) the first cryptographic Hash, and the first cryptographic Hash of gained is configured to 0-2
32On the circle of equal portions; Then utilize hash function to calculate the second cryptographic Hash of test point information; Then the second cryptographic Hash is mapped to circle and upward mates with the first cryptographic Hash, and its data are saved on first database node that is complementary; If the second cryptographic Hash can not find the database node that is complementary at circle, then it is saved in Position Number and is on first database node of 0.
The access method of described a kind of magnanimity real time data location mode, may further comprise the steps: at first the visit information with application system obtains the 3rd cryptographic Hash by uncommon function calculation, then the 3rd cryptographic Hash and the second cryptographic Hash are mated, the match is successful then conducts interviews to the database node at the second cryptographic Hash place, and visit information is fed back to application system; If the 3rd cryptographic Hash does not find the second cryptographic Hash that is complementary after circle is sought a circle, then its automatically with circle on when beginning to seek Position Number be that the second cryptographic Hash on first database node of 0 is complementary, and conduct interviews to being numbered first database node of 0, visit information is fed back to application system.
When the database node number changed, for example when needs increased by 1 database node, only measuring point and the data storage location thereof on place anticlockwise first each database node of circle increase database node can be affected.
A kind of magnanimity real time data location mode and access method thereof that the present embodiment provides, it has suppressed the redistribution of measuring point at each database node to greatest extent, and the establishment measuring point each database node distribute inhomogeneous, the redistribution of the measuring point in the time of can reducing to greatest extent the database node increase and decrease, and accessing step has also shortened the access time greatly quickly and easily, has greatly improved access efficiency.
Claims (3)
1. magnanimity real time data location mode is characterized in that: at first utilize hash function to calculate the first cryptographic Hash of each real-time data base node, and the first cryptographic Hash of gained is configured on the circle; Then utilize hash function to calculate the second cryptographic Hash of test point information; Then the second cryptographic Hash is mapped to circle and upward mates with the first cryptographic Hash, and its data are saved on first database node that is complementary on the circle; If the second cryptographic Hash is sought a circle successor at circle and do not found the database node that is complementary, then it is saved on first database node when beginning to seek on the circle.
2. a kind of magnanimity real time data location mode according to claim 1, it is characterized in that: described circle is divided into 2
32Equal portions.
3. the access method of a kind of magnanimity real time data location mode according to claim 1, it is characterized in that may further comprise the steps: at first the visit information with application system calculates the 3rd cryptographic Hash by hash function, then the 3rd cryptographic Hash and the second cryptographic Hash are mated, the match is successful then conducts interviews to the database node at the second cryptographic Hash place that the match is successful, and visit information is fed back to application system; If the 3rd cryptographic Hash does not find the second cryptographic Hash that is complementary after circle is sought a circle, then its automatically with circle on the second cryptographic Hash on first database node when beginning to seek be complementary, and first database node is conducted interviews, visit information is fed back to application system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100094521A CN103078946A (en) | 2013-01-10 | 2013-01-10 | Mass real-time data distributing method and mass real-time data access method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100094521A CN103078946A (en) | 2013-01-10 | 2013-01-10 | Mass real-time data distributing method and mass real-time data access method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103078946A true CN103078946A (en) | 2013-05-01 |
Family
ID=48155348
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013100094521A Pending CN103078946A (en) | 2013-01-10 | 2013-01-10 | Mass real-time data distributing method and mass real-time data access method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103078946A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473334A (en) * | 2013-09-18 | 2013-12-25 | 浙江中控技术股份有限公司 | Data storage method, inquiry method and system |
| CN104270458A (en) * | 2014-10-17 | 2015-01-07 | 浪潮(北京)电子信息产业有限公司 | Method and device for achieving data distribution management of cloud storage system |
| CN105320771A (en) * | 2015-10-31 | 2016-02-10 | 南京南瑞继保电气有限公司 | Hash ring based time sequence database service cluster implementation method and system |
| WO2018064936A1 (en) * | 2016-10-08 | 2018-04-12 | 腾讯科技（深圳）有限公司 | Data processing method and device, and storage medium |
| CN112234608A (en) * | 2020-09-25 | 2021-01-15 | 国能日新科技股份有限公司 | Real-time library active power control system based on combination of centralized type and distributed type |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101692239A (en) * | 2009-10-19 | 2010-04-07 | 浙江大学 | Method for distributing metadata of distributed type file system |
| US20110153953A1 (en) * | 2009-12-23 | 2011-06-23 | Prakash Khemani | Systems and methods for managing large cache services in a multi-core system |
| CN102387169A (en) * | 2010-08-26 | 2012-03-21 | 阿里巴巴集团控股有限公司 | Delete method, system and delete server for distributed cache objects |
-
2013
- 2013-01-10 CN CN2013100094521A patent/CN103078946A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101692239A (en) * | 2009-10-19 | 2010-04-07 | 浙江大学 | Method for distributing metadata of distributed type file system |
| US20110153953A1 (en) * | 2009-12-23 | 2011-06-23 | Prakash Khemani | Systems and methods for managing large cache services in a multi-core system |
| CN102387169A (en) * | 2010-08-26 | 2012-03-21 | 阿里巴巴集团控股有限公司 | Delete method, system and delete server for distributed cache objects |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473334A (en) * | 2013-09-18 | 2013-12-25 | 浙江中控技术股份有限公司 | Data storage method, inquiry method and system |
| CN103473334B (en) * | 2013-09-18 | 2017-01-11 | 中控技术（西安）有限公司 | Data storage method, inquiry method and system |
| CN104270458A (en) * | 2014-10-17 | 2015-01-07 | 浪潮(北京)电子信息产业有限公司 | Method and device for achieving data distribution management of cloud storage system |
| CN105320771A (en) * | 2015-10-31 | 2016-02-10 | 南京南瑞继保电气有限公司 | Hash ring based time sequence database service cluster implementation method and system |
| WO2018064936A1 (en) * | 2016-10-08 | 2018-04-12 | 腾讯科技（深圳）有限公司 | Data processing method and device, and storage medium |
| US10698623B2 (en) | 2016-10-08 | 2020-06-30 | Tencent Technology (Shenzhen) Company Limited | Data processing method and apparatus and storage medium |
| CN112234608A (en) * | 2020-09-25 | 2021-01-15 | 国能日新科技股份有限公司 | Real-time library active power control system based on combination of centralized type and distributed type |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104348679B (en) | A kind of methods, devices and systems of point of bucket test | |
| CN105786808B (en) | A kind of method and apparatus for distributed execution relationship type computations | |
| CN102214228B (en) | Large-grid distributed real-time database system and data management method thereof | |
| CN103078946A (en) | Mass real-time data distributing method and mass real-time data access method | |
| CN108427684A (en) | Data query method, apparatus and computing device | |
| CN104298541A (en) | Data distribution algorithm and data distribution device for cloud storage system | |
| CN105243169B (en) | A kind of data query method and system | |
| CN105516284B (en) | A kind of method and apparatus of Cluster Database distributed storage | |
| CN106294421A (en) | A kind of data write, read method and device | |
| TW201800967A (en) | Method and device for processing distributed streaming data | |
| CN110334094B (en) | Data query method, system, device and equipment based on inverted index | |
| CN103714004A (en) | JVM online memory leak analysis method and system | |
| CN110399387A (en) | Method and device based on table incidence relation dynamic generation query SQL | |
| CN106453122A (en) | Method and device for selecting streaming data transmission node | |
| CN103823846A (en) | Method for storing and querying big data on basis of graph theories | |
| CN107888666A (en) | A kind of cross-region data-storage system and method for data synchronization and device | |
| US10140347B2 (en) | Exposing data to query generating applications using usage profiles | |
| CN111258978A (en) | Data storage method | |
| CN104572809A (en) | Distributive relational database free expansion method | |
| CN107959695A (en) | A kind of data transmission method and device | |
| CN106933897A (en) | Data query method and apparatus | |
| CN109636262A (en) | A kind of order processing method, apparatus, system, computer equipment and storage medium | |
| CN105373621A (en) | Rapid database-system-across data increment migration method | |
| CN105159925A (en) | Database cluster data distribution method and system | |
| CN114416868A (en) | Data synchronization method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130501 |