CN112272228A - Distributed registry architecture - Google Patents

Distributed registry architecture Download PDF

Info

Publication number
CN112272228A
CN112272228A CN202011141885.9A CN202011141885A CN112272228A CN 112272228 A CN112272228 A CN 112272228A CN 202011141885 A CN202011141885 A CN 202011141885A CN 112272228 A CN112272228 A CN 112272228A
Authority
CN
China
Prior art keywords
distributed
registry
architecture
registration
service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011141885.9A
Other languages
Chinese (zh)
Inventor
陈宏鸿
范兴泽
彭彰苗
朱海东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Shenzhou Digital Technology Co ltd
Original Assignee
Beijing Shenzhou Digital Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Shenzhou Digital Technology Co ltd filed Critical Beijing Shenzhou Digital Technology Co ltd
Priority to CN202011141885.9A priority Critical patent/CN112272228A/en
Publication of CN112272228A publication Critical patent/CN112272228A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • G06F16/2255Hash tables
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278Data partitioning, e.g. horizontal or vertical partitioning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/74Address processing for routing
    • H04L45/745Address table lookup; Address filtering
    • H04L45/7453Address table lookup; Address filtering using hashing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a distributed registration center architecture. The architecture includes: the client SDK is used for accessing the client system to the distributed registration center; the Proxy agent layer is used for virtually enabling the data nodes to be N virtual slices, calculating a hash value according to the service identifier after receiving a request of the client SDK, and routing to the specific data nodes according to the hash value; the data persistence layer comprises a plurality of data nodes and is used for performing distributed storage on the microservices and providing registration services according to the received requests; and the management console is used for managing each component of the distributed registration center. The distributed registration center framework provided by the invention can solve the problem of bottleneck existing in the registration of the service instance in the registration center.

Description

Distributed registry architecture
Technical Field
The invention relates to the technical field of micro-service architecture, in particular to a distributed registration center architecture.
Background
With the development of industrial technology, more and more enterprises and organizations are transforming the technical architecture and constructing the micro-service of the system.
For large enterprises and organizations, a certain bottleneck exists in the registration examples and service continuity of popular registration centers (such as Eureka, Zookeeper and Nacos) in the market at present, and when the number of service examples reaches a certain amount, the service examples can cause very large performance influence on the whole business system, even normal operation of the system.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a distributed registration center architecture, which can solve the problem of bottleneck existing in registering a service instance in a registration center.
To solve the above technical problem, the present invention provides a distributed registry architecture, where the architecture includes: the client SDK is used for accessing the client system to the distributed registration center; the Proxy agent layer is used for virtually enabling the data nodes to be N virtual slices, calculating a hash value according to the service identifier after receiving a request of the client SDK, and routing to the specific data nodes according to the hash value; the data persistence layer comprises a plurality of data nodes and is used for performing distributed storage on the microservices and providing registration services according to the received requests; and the management console is used for managing each component of the distributed registration center.
In some embodiments, the client SDK supports registration and discovery of services, self-discovery and loading at the Proxy layer.
In some embodiments, the client SDK is compatible with access to multiple registry frameworks simultaneously, wherein the registry frameworks include: and the major registration centers of industries such as zookeeper, eureka and nacos.
In some embodiments, the data persistence layer is comprised of a plurality of small clusters, each of which has data nodes disposed within it.
In some embodiments, the virtual slices are arranged in correspondence with the small clusters.
In some embodiments, the data node is configured to store a service registration instance.
In some embodiments, the management console primarily manages the administration of rights by the registry.
In some embodiments, the management and control functions include black and white lists accessed to a registration center, Proxy online management, data node management, virtual shard maintenance, service routing, weight and the like.
In some embodiments, further comprising: the data synchronizer is used for being compatible with stock application, and can synchronize the service registration instance information of the original stock application into the distributed registry or synchronize the service registration instance of the distributed registry into the original stock registry.
After adopting such design, the invention has at least the following advantages:
through the distributed registry, the access of the service is routed through the Proxy, the Proxy can be expanded infinitely as required, the service is routed to different data nodes through the hash calculation of the service identifier consistency, the distributed storage of the information of the service is realized, and the requirements of large-scale enterprises and mechanisms in millions of instances are met.
Drawings
The foregoing is only an overview of the technical solutions of the present invention, and in order to make the technical solutions of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and the detailed description.
Fig. 1 is an architecture diagram of a distributed registry architecture provided by an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Because the service registration examples supported by the registration center in the current market are limited, the method has certain limitation on the micro-service construction of large enterprises and institutions, and the registration and discovery of millions of examples are realized by researching and developing a distributed registration center.
Referring to fig. 1, the distributed registry design is generally divided into five modules: client side SDK, Proxy layer, data persistence layer, management console, and data synchronizer.
The client SDK is mainly responsible for accessing a client system to a distributed registry, supporting registration and discovery of services, self-discovery and load of a Proxy layer, and simultaneously being compatible with the access of a mainstream registry framework in the current market, such as registries of zookeeper, eureka and the like, so that the inventory system can be easily accessed to the distributed registry.
The Proxy layer is mainly responsible for the access of a client, the Proxy layer is designed in a stateless manner and can be expanded infinitely to support the access of tens of millions of services, the Proxy bottom layer logically virtualizes data nodes into N virtual fragments, the virtual fragments are distributed on a Hash ring through a consistent Hash algorithm, the Proxy receives a client request, calculates Hash according to service identification to route to specific data nodes, the registration and discovery of the services are realized, and the service registration information quantity of each data node is reduced.
The data persistence layer is composed of a plurality of small clusters and is routed to different data clusters by Proxy to realize distributed storage.
The management console mainly manages authority control of the registration center, and includes management and control functions of black and white lists accessed to the registration center, Proxy online management, data node management, virtual fragment maintenance, service routing, weight and the like.
The data synchronization application is mainly used for compatible stock application, and can synchronize the service registration instance information of the original stock application into the distributed registry or synchronize the service registration instance of the distributed registry into the original stock registry.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the present invention in any way, and it will be apparent to those skilled in the art that the above description of the present invention can be applied to various modifications, equivalent variations or modifications without departing from the spirit and scope of the present invention.

Claims (9)

1. A distributed registry architecture, comprising:
the client SDK is used for accessing the client system to the distributed registration center;
the Proxy agent layer is used for virtually enabling the data nodes to be N virtual slices, calculating a hash value according to the service identifier after receiving a request of the client SDK, and routing to the specific data nodes according to the hash value;
the data persistence layer comprises a plurality of data nodes and is used for performing distributed storage on the microservices and providing registration services according to the received requests;
and the management console is used for managing each component of the distributed registration center.
2. The distributed registry architecture of claim 1 wherein client SDKs support registration and discovery of services, self-discovery and loading at the Proxy agent level.
3. The distributed registry architecture of claim 2 wherein the client SDK is simultaneously compatible with access to multiple registry frameworks, wherein the registry frameworks comprise: and the major registration centers of industries such as zookeeper er, eureka, nacos and the like.
4. The distributed registry architecture of claim 1 wherein the data persistence layer is comprised of a plurality of small clusters, each of which has data nodes disposed therein.
5. The distributed registry architecture of claim 4 wherein the virtual slices are arranged in correspondence with small clusters.
6. The distributed registry architecture of claim 4 wherein the data nodes are configured to store service registry instances.
7. The distributed registry architecture of claim 1 wherein the management console primarily manages registry entitlement management.
8. The distributed registry architecture of claim 7 wherein the management and control functions include black and white lists for access to the registry, Proxy online management, data node management, virtual shard maintenance, service routing, weighting, etc.
9. The distributed registry architecture of claim 1 further comprising:
the data synchronizer is used for being compatible with stock application, and can synchronize the service registration instance information of the original stock application into the distributed registry or synchronize the service registration instance of the distributed registry into the original stock registry.
CN202011141885.9A 2020-10-22 2020-10-22 Distributed registry architecture Pending CN112272228A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011141885.9A CN112272228A (en) 2020-10-22 2020-10-22 Distributed registry architecture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011141885.9A CN112272228A (en) 2020-10-22 2020-10-22 Distributed registry architecture

Publications (1)

Publication Number Publication Date
CN112272228A true CN112272228A (en) 2021-01-26

Family

ID=74342223

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011141885.9A Pending CN112272228A (en) 2020-10-22 2020-10-22 Distributed registry architecture

Country Status (1)

Country Link
CN (1) CN112272228A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112887415A (en) * 2021-02-03 2021-06-01 北京云上曲率科技有限公司 Globalized distributed program coordination service system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106096038A (en) * 2016-06-28 2016-11-09 浪潮软件股份有限公司 A kind of distributed database architecture under cloud computing framework
CN106301947A (en) * 2016-08-31 2017-01-04 广州唯品会信息科技有限公司 Business information processing system and method
CN106385435A (en) * 2016-08-30 2017-02-08 乐视控股(北京)有限公司 Service treatment method and system of service system
CN110033095A (en) * 2019-03-04 2019-07-19 北京大学 A kind of fault-tolerance approach and system of high-available distributed machine learning Computational frame

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106096038A (en) * 2016-06-28 2016-11-09 浪潮软件股份有限公司 A kind of distributed database architecture under cloud computing framework
CN106385435A (en) * 2016-08-30 2017-02-08 乐视控股(北京)有限公司 Service treatment method and system of service system
CN106301947A (en) * 2016-08-31 2017-01-04 广州唯品会信息科技有限公司 Business information processing system and method
CN110033095A (en) * 2019-03-04 2019-07-19 北京大学 A kind of fault-tolerance approach and system of high-available distributed machine learning Computational frame

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
任钢: "微服务设计 企业架构转型之道", 31 December 2019 *
陈林,廖恩红,曹杰: ""互联网+"智慧校园技术与工程实施", 30 September 2017 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112887415A (en) * 2021-02-03 2021-06-01 北京云上曲率科技有限公司 Globalized distributed program coordination service system
CN112887415B (en) * 2021-02-03 2023-04-25 北京云上曲率科技有限公司 Globalization distributed program coordination service system

Similar Documents

Publication Publication Date Title
US10506033B2 (en) Distributed global load-balancing system for software-defined data centers
US11570255B2 (en) SMB2 scaleout
CN110213352B (en) Method for aggregating dispersed autonomous storage resources with uniform name space
WO2020147331A1 (en) Micro-service monitoring method and system
US9069835B2 (en) Organizing data in a distributed storage system
EP3138003B1 (en) System and method for supporting a bypass-domain model and a proxy model and updating service information for across-domain messaging in a transactional middleware machine environment
CN102333029B (en) Routing method in server cluster system
CN102880557B (en) look-up method of multistage distribution type high-speed cache of heterogeneous data source
US8108461B2 (en) Method and system for processing a request sent over a network
US20100312871A1 (en) Executing Programs Based on User-Specified Constraints
US8891403B2 (en) Inter-cluster communications technique for event and health status communications
CN106255956A (en) Public affair identifier is supported to optimize and the system and method for affairs cohesion based on the resource manager instance perception in transaction environment
CN110225138B (en) Distributed architecture
US20100332532A1 (en) Distributed directory environment using clustered ldap servers
EP3935515A1 (en) Metadata routing in a distributed system
US20230208711A1 (en) Subscriber configuration ingestion in a content delivery network
US8832215B2 (en) Load-balancing in replication engine of directory server
CN116962498A (en) Service splitting method based on distributed architecture
US11886309B2 (en) Cell-based storage system with failure isolation
CN104410531A (en) Redundant system architecture approach
US9569224B2 (en) System and method for adaptively integrating a database state notification service with a distributed transactional middleware machine
CN112272228A (en) Distributed registry architecture
CN113326100A (en) Cluster management method, device and equipment and computer storage medium
CN115225645B (en) Service updating method, device, system and storage medium
CN110913018A (en) Distributed regulation and control service system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination