CN112272228A - Distributed registry architecture - Google Patents
Distributed registry architecture Download PDFInfo
- Publication number
- CN112272228A CN112272228A CN202011141885.9A CN202011141885A CN112272228A CN 112272228 A CN112272228 A CN 112272228A CN 202011141885 A CN202011141885 A CN 202011141885A CN 112272228 A CN112272228 A CN 112272228A
- Authority
- CN
- China
- Prior art keywords
- distributed
- registry
- architecture
- registration
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002688 persistence Effects 0.000 claims abstract description 7
- 238000012423 maintenance Methods 0.000 claims description 3
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2255—Hash tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/74—Address processing for routing
- H04L45/745—Address table lookup; Address filtering
- H04L45/7453—Address table lookup; Address filtering using hashing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a distributed registration center architecture. The architecture includes: the client SDK is used for accessing the client system to the distributed registration center; the Proxy agent layer is used for virtually enabling the data nodes to be N virtual slices, calculating a hash value according to the service identifier after receiving a request of the client SDK, and routing to the specific data nodes according to the hash value; the data persistence layer comprises a plurality of data nodes and is used for performing distributed storage on the microservices and providing registration services according to the received requests; and the management console is used for managing each component of the distributed registration center. The distributed registration center framework provided by the invention can solve the problem of bottleneck existing in the registration of the service instance in the registration center.
Description
Technical Field
The invention relates to the technical field of micro-service architecture, in particular to a distributed registration center architecture.
Background
With the development of industrial technology, more and more enterprises and organizations are transforming the technical architecture and constructing the micro-service of the system.
For large enterprises and organizations, a certain bottleneck exists in the registration examples and service continuity of popular registration centers (such as Eureka, Zookeeper and Nacos) in the market at present, and when the number of service examples reaches a certain amount, the service examples can cause very large performance influence on the whole business system, even normal operation of the system.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a distributed registration center architecture, which can solve the problem of bottleneck existing in registering a service instance in a registration center.
To solve the above technical problem, the present invention provides a distributed registry architecture, where the architecture includes: the client SDK is used for accessing the client system to the distributed registration center; the Proxy agent layer is used for virtually enabling the data nodes to be N virtual slices, calculating a hash value according to the service identifier after receiving a request of the client SDK, and routing to the specific data nodes according to the hash value; the data persistence layer comprises a plurality of data nodes and is used for performing distributed storage on the microservices and providing registration services according to the received requests; and the management console is used for managing each component of the distributed registration center.
In some embodiments, the client SDK supports registration and discovery of services, self-discovery and loading at the Proxy layer.
In some embodiments, the client SDK is compatible with access to multiple registry frameworks simultaneously, wherein the registry frameworks include: and the major registration centers of industries such as zookeeper, eureka and nacos.
In some embodiments, the data persistence layer is comprised of a plurality of small clusters, each of which has data nodes disposed within it.
In some embodiments, the virtual slices are arranged in correspondence with the small clusters.
In some embodiments, the data node is configured to store a service registration instance.
In some embodiments, the management console primarily manages the administration of rights by the registry.
In some embodiments, the management and control functions include black and white lists accessed to a registration center, Proxy online management, data node management, virtual shard maintenance, service routing, weight and the like.
In some embodiments, further comprising: the data synchronizer is used for being compatible with stock application, and can synchronize the service registration instance information of the original stock application into the distributed registry or synchronize the service registration instance of the distributed registry into the original stock registry.
After adopting such design, the invention has at least the following advantages:
through the distributed registry, the access of the service is routed through the Proxy, the Proxy can be expanded infinitely as required, the service is routed to different data nodes through the hash calculation of the service identifier consistency, the distributed storage of the information of the service is realized, and the requirements of large-scale enterprises and mechanisms in millions of instances are met.
Drawings
The foregoing is only an overview of the technical solutions of the present invention, and in order to make the technical solutions of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and the detailed description.
Fig. 1 is an architecture diagram of a distributed registry architecture provided by an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Because the service registration examples supported by the registration center in the current market are limited, the method has certain limitation on the micro-service construction of large enterprises and institutions, and the registration and discovery of millions of examples are realized by researching and developing a distributed registration center.
Referring to fig. 1, the distributed registry design is generally divided into five modules: client side SDK, Proxy layer, data persistence layer, management console, and data synchronizer.
The client SDK is mainly responsible for accessing a client system to a distributed registry, supporting registration and discovery of services, self-discovery and load of a Proxy layer, and simultaneously being compatible with the access of a mainstream registry framework in the current market, such as registries of zookeeper, eureka and the like, so that the inventory system can be easily accessed to the distributed registry.
The Proxy layer is mainly responsible for the access of a client, the Proxy layer is designed in a stateless manner and can be expanded infinitely to support the access of tens of millions of services, the Proxy bottom layer logically virtualizes data nodes into N virtual fragments, the virtual fragments are distributed on a Hash ring through a consistent Hash algorithm, the Proxy receives a client request, calculates Hash according to service identification to route to specific data nodes, the registration and discovery of the services are realized, and the service registration information quantity of each data node is reduced.
The data persistence layer is composed of a plurality of small clusters and is routed to different data clusters by Proxy to realize distributed storage.
The management console mainly manages authority control of the registration center, and includes management and control functions of black and white lists accessed to the registration center, Proxy online management, data node management, virtual fragment maintenance, service routing, weight and the like.
The data synchronization application is mainly used for compatible stock application, and can synchronize the service registration instance information of the original stock application into the distributed registry or synchronize the service registration instance of the distributed registry into the original stock registry.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the present invention in any way, and it will be apparent to those skilled in the art that the above description of the present invention can be applied to various modifications, equivalent variations or modifications without departing from the spirit and scope of the present invention.
Claims (9)
1. A distributed registry architecture, comprising:
the client SDK is used for accessing the client system to the distributed registration center;
the Proxy agent layer is used for virtually enabling the data nodes to be N virtual slices, calculating a hash value according to the service identifier after receiving a request of the client SDK, and routing to the specific data nodes according to the hash value;
the data persistence layer comprises a plurality of data nodes and is used for performing distributed storage on the microservices and providing registration services according to the received requests;
and the management console is used for managing each component of the distributed registration center.
2. The distributed registry architecture of claim 1 wherein client SDKs support registration and discovery of services, self-discovery and loading at the Proxy agent level.
3. The distributed registry architecture of claim 2 wherein the client SDK is simultaneously compatible with access to multiple registry frameworks, wherein the registry frameworks comprise: and the major registration centers of industries such as zookeeper er, eureka, nacos and the like.
4. The distributed registry architecture of claim 1 wherein the data persistence layer is comprised of a plurality of small clusters, each of which has data nodes disposed therein.
5. The distributed registry architecture of claim 4 wherein the virtual slices are arranged in correspondence with small clusters.
6. The distributed registry architecture of claim 4 wherein the data nodes are configured to store service registry instances.
7. The distributed registry architecture of claim 1 wherein the management console primarily manages registry entitlement management.
8. The distributed registry architecture of claim 7 wherein the management and control functions include black and white lists for access to the registry, Proxy online management, data node management, virtual shard maintenance, service routing, weighting, etc.
9. The distributed registry architecture of claim 1 further comprising:
the data synchronizer is used for being compatible with stock application, and can synchronize the service registration instance information of the original stock application into the distributed registry or synchronize the service registration instance of the distributed registry into the original stock registry.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011141885.9A CN112272228A (en) | 2020-10-22 | 2020-10-22 | Distributed registry architecture |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011141885.9A CN112272228A (en) | 2020-10-22 | 2020-10-22 | Distributed registry architecture |
Publications (1)
Publication Number | Publication Date |
---|---|
CN112272228A true CN112272228A (en) | 2021-01-26 |
Family
ID=74342223
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011141885.9A Pending CN112272228A (en) | 2020-10-22 | 2020-10-22 | Distributed registry architecture |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112272228A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112887415A (en) * | 2021-02-03 | 2021-06-01 | 北京云上曲率科技有限公司 | Globalized distributed program coordination service system |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106096038A (en) * | 2016-06-28 | 2016-11-09 | 浪潮软件股份有限公司 | A kind of distributed database architecture under cloud computing framework |
CN106301947A (en) * | 2016-08-31 | 2017-01-04 | 广州唯品会信息科技有限公司 | Business information processing system and method |
CN106385435A (en) * | 2016-08-30 | 2017-02-08 | 乐视控股(北京)有限公司 | Service treatment method and system of service system |
CN110033095A (en) * | 2019-03-04 | 2019-07-19 | 北京大学 | A kind of fault-tolerance approach and system of high-available distributed machine learning Computational frame |
-
2020
- 2020-10-22 CN CN202011141885.9A patent/CN112272228A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106096038A (en) * | 2016-06-28 | 2016-11-09 | 浪潮软件股份有限公司 | A kind of distributed database architecture under cloud computing framework |
CN106385435A (en) * | 2016-08-30 | 2017-02-08 | 乐视控股(北京)有限公司 | Service treatment method and system of service system |
CN106301947A (en) * | 2016-08-31 | 2017-01-04 | 广州唯品会信息科技有限公司 | Business information processing system and method |
CN110033095A (en) * | 2019-03-04 | 2019-07-19 | 北京大学 | A kind of fault-tolerance approach and system of high-available distributed machine learning Computational frame |
Non-Patent Citations (2)
Title |
---|
任钢: "微服务设计 企业架构转型之道", 31 December 2019 * |
陈林,廖恩红,曹杰: ""互联网+"智慧校园技术与工程实施", 30 September 2017 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112887415A (en) * | 2021-02-03 | 2021-06-01 | 北京云上曲率科技有限公司 | Globalized distributed program coordination service system |
CN112887415B (en) * | 2021-02-03 | 2023-04-25 | 北京云上曲率科技有限公司 | Globalization distributed program coordination service system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10506033B2 (en) | Distributed global load-balancing system for software-defined data centers | |
US11570255B2 (en) | SMB2 scaleout | |
CN110213352B (en) | Method for aggregating dispersed autonomous storage resources with uniform name space | |
WO2020147331A1 (en) | Micro-service monitoring method and system | |
US9069835B2 (en) | Organizing data in a distributed storage system | |
EP3138003B1 (en) | System and method for supporting a bypass-domain model and a proxy model and updating service information for across-domain messaging in a transactional middleware machine environment | |
CN102333029B (en) | Routing method in server cluster system | |
CN102880557B (en) | look-up method of multistage distribution type high-speed cache of heterogeneous data source | |
US8108461B2 (en) | Method and system for processing a request sent over a network | |
US20100312871A1 (en) | Executing Programs Based on User-Specified Constraints | |
US8891403B2 (en) | Inter-cluster communications technique for event and health status communications | |
CN106255956A (en) | Public affair identifier is supported to optimize and the system and method for affairs cohesion based on the resource manager instance perception in transaction environment | |
CN110225138B (en) | Distributed architecture | |
US20100332532A1 (en) | Distributed directory environment using clustered ldap servers | |
EP3935515A1 (en) | Metadata routing in a distributed system | |
US20230208711A1 (en) | Subscriber configuration ingestion in a content delivery network | |
US8832215B2 (en) | Load-balancing in replication engine of directory server | |
CN116962498A (en) | Service splitting method based on distributed architecture | |
US11886309B2 (en) | Cell-based storage system with failure isolation | |
CN104410531A (en) | Redundant system architecture approach | |
US9569224B2 (en) | System and method for adaptively integrating a database state notification service with a distributed transactional middleware machine | |
CN112272228A (en) | Distributed registry architecture | |
CN113326100A (en) | Cluster management method, device and equipment and computer storage medium | |
CN115225645B (en) | Service updating method, device, system and storage medium | |
CN110913018A (en) | Distributed regulation and control service system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |