CN109918359A - Database service persistence method and system based on swarm - Google Patents
Database service persistence method and system based on swarm Download PDFInfo
- Publication number
- CN109918359A CN109918359A CN201910049793.9A CN201910049793A CN109918359A CN 109918359 A CN109918359 A CN 109918359A CN 201910049793 A CN201910049793 A CN 201910049793A CN 109918359 A CN109918359 A CN 109918359A
- Authority
- CN
- China
- Prior art keywords
- database
- container
- service
- name
- block device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002688 persistence Effects 0.000 title claims abstract description 33
- 238000000034 method Methods 0.000 title claims abstract description 32
- 230000002085 persistent effect Effects 0.000 claims abstract description 6
- 238000007726 management method Methods 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000013500 data storage Methods 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 4
- 238000012217 deletion Methods 0.000 claims description 4
- 230000037430 deletion Effects 0.000 claims description 4
- 238000011084 recovery Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of database service persistence method based on swarm, the persistence method including single database and data-base cluster.For single database the following steps are included: the database mirroring of 1, building request；2, parsing database service creates parameter；3, ceph block device is created；4, database container etc. is created；5, creation entrance accesses container.For data-base cluster the following steps are included: 1, parsing database service creates parameter；2, ceph block device is created；3, registration entrance access service；4, creation entrance accesses container；5, registration database service；6, database container is created.Database service persistent object system based on swarm of the invention, system includes: parsing module；Control module；Network module；Registration module etc..The present invention provides the persistence methods that database service is general, improve the safety of the availability and data of database service.
Description
Technical field
The present invention relates to container technical fields, and in particular to a kind of database service persistence method based on swarm and
System.
Background technique
Docker is most popular one of the open source projects of current container technical field, and docker container can be mentioned to developer
For being packaged application and relevant dependence packet in transplantable container, relative to the virtual machine with similar resource isolation
For, container virtualizing operating systems rather than hardware, thus it is more portable and efficient, almost start immediately.And Swarm is
One of most popular container cluster management instrument of docker, and be the primary included programming facility of docker.Mainly several
Docker host is abstracted as an entirety, and is managed collectively the various docker on these docker hosts by an entrance
Resource.
Ceph is one of the open source stored items of current most mainstream, be one reliably, automatically rebalancing method, restore automatically
Distributed memory system, addressing data uses CRUSH algorithm, more efficient compared to the addressing system of other storage systems, storage
Property comparison is abundant, can provide object storage, block device storage and file and store three kinds of memory interfaces, have prepare more part, nothing
Division center, without Single Point of Faliure, good expansion the features such as, be increasingly becoming substitution cloud computing environment in conventional store solution
Scheme.
If all data in container service operational process do not use persistence method, stops or delete in container instance
It removes or exception exits, then these data will all lose, and can not give for change.And not for swarm container cluster management platform
General database service includes the method and system of single database and data-base cluster persistence.
Summary of the invention
In view of the deficiencies of the prior art, it is an object of the present invention to provide a kind of cluster pipe primary based on swarm(container
Science and engineering tool) database service persistence method, the method aims to solve the problem that current swarm container cluster does not have general number
The defect of the method including single database and data-base cluster persistence is serviced according to library, while improving database service delay machine
Restore processing capacity, the service delay machine recovery time of shortening, increases availability of the database service on swarm cluster.Together
When the invention also discloses a kind of database service persistent object system based on swarm.
A kind of database service persistence method based on swarm, including holding for single database and data-base cluster
Longization method, wherein for the persistence method of single database, comprising the following steps:
Database mirroring is constructed on the basis of S1, the High Availabitity software (keepalived) based on Virtual Router Redundacy Protocol；
S2, creation single database parameter, and parsed, the parameter of creation includes: stateful services set mark, network name
Word, network-driven, database name, database service name, database service port, Database Replica number, database starting
It orders, database is ceased and desisted order, block device size, block access limit, block device name, the address vip, entrance access Service name
Word, entrance access serve port；
S3, distributed memory system (ceph) block device is created according to the parameter of parsing；
S4, database container and carry distributed memory system block device are created according to analytic parameter;
S5, database container is accessed according to analytic parameter creation proxy server (nginx) entrance.
To the persistence method of data-base cluster, comprising the following steps:
L1, creation data base set swarm parameter, and parsed, the parameter of creation includes: stateful services set mark, network drive
Dynamic, network name, database service name, database service port, Database Replica number, database start command, database
It ceases and desist order, block device size, block access limit, block device name, the address vip, entrance access service name, entrance access clothes
Business port parameter；
L2, distributed memory system block device is created according to analytic parameter；
L3, the access service of registration database cluster entrance；
L4, data-base cluster container is accessed according to analytic parameter creation proxy server entrance；
L5, registration database service；
L6, database container and carry distributed memory system block device are created according to analytic parameter.
Preferably, in the keepalived mirror image of step S1 constructed in advance in S4 step creation database container meeting step
The required parameter of S2 creation automatically generates keepalived.conf configuration file and log-on data library script and stops database
Script, the required parameter include database service name, database service port, database start command, database stopping
Order, network name, network-driven, the address vip；
Preferably, step S3 is parsed according to S2 parameter calls the api(application programming interface of ceph) creation distribution deposits
Storage system block device, the parameter of creation include block size, block name, the corresponding pond of block (pool) and block access limit, and only
A block device is created, for the database container carry of step S4.
Preferably, step S4 creates database container and can be automatically generated according to the parameter that step S2 is created
Keepalived.conf configuration file and log-on data library script and stopping database script, the parameter packet that step S4 is used
Include that database service name, database service port, database start command, database are ceased and desisted order, network name, network drive
The container of the dynamic, address vip, step S4 uses rexray(book plug-in unit) carry distributed memory system block device.
Preferably, database container and carry ceph block device are created according to analytic parameter in step S4, including following
Step:
S4-1, creation primary database container carry ceph block device；
S4-2, standby database container carry is created with a ceph block device.
Primary database container and the standby respective keepalived service of database container can check the weight of itself, weighted value
High container log-on data library service, the low container of weighted value stop database service, and the same time only has primary database container
Or standby database container one of container operation data library services.
Preferably, step S5 accesses container according to analytic parameter creation proxy server entrance, can automatically generate
Nginx.conf configuration file, while agency's forwarding is provided to primary database and standby database, unless primary database delay machine, agency
Request can be all forwarded to standby database by server entrance access container, otherwise all be to be forwarded to primary database.
Preferably, step L2 according to analytic parameter call ceph api(application programming interface) creation distribution deposit
Storage system block device, the parameter of creation include block size, block name, the corresponding pond of block (pool), the number of block and block read-write power
Limit, wherein the number of the database container of distributed memory system block device number and L6 the step creation created is equal, ceph
Block device is mounted to the identical database container of name, and the name format of database container and ceph block device is equal are as follows: database
Name-{ 1,2,3... }.
Preferably, step L3 register entrance access service steps the following steps are included:
L3-1, name is serviced to key-value pair data storage system (etcd) registration entrance access；
L3-2, serve port is accessed to etcd registration entrance.
Preferably, step L4 accesses container according to analytic parameter creation proxy server entrance, configures including unified
Management tool (confd) service and proxy server.
Confd service periodically obtains information, which includes portal service name in etcd, portal service port, data
Library name, database port, and check whether the key-value pair of etcd storage changes, if there is a change, then according to agency
The configuration template of server starting regenerates the configuration of new nginx.conf(proxy server starting), then notification agent
Server reloads new nginx.conf configuration file.
Proxy server provides load balancing to data-base cluster and provides entrance access, loses if agency's forwarding is primary
It loses, is reattempted after 10s primary.
Preferably, the service of step L5 registration database the following steps are included:
L5-1, to etcd registration database container name；
L5-2, to etcd registration database container port.
As long as registration database container and entrance access service name be it is identical, the database container of registration will add
It is added in proxy server load balance list, so if carrying out dilatation to data-base cluster, it is only necessary to be registered to identical
Entrance access service name.
Step L6 creates database container and carry distributed memory system block device according to analytic parameter, wherein being distributed
Formula storage system block device is mounted to the identical database container of name, and the name format of database container and ceph block device is equal
Are as follows: database name-{ 1,2,3... }, data-base cluster have several distributed memory system block devices.
In a kind of system of above-mentioned database service persistence based on swarm, the system includes:
Control module: for handling user's request and being responsible for communicating with other modules, docker is called according to user demand
Api creates corresponding database container.
Registration module: it for the registration and deletion in data-base cluster, registers parameter and includes entrance access service name, enters
Mouth access serve port, database service name and database serve port.
Network module: for creating the network (network) of container (docker), and acquisition network id.
Parsing module: the creation database service file for submitting to user carries out Parameter analysis of electrochemical.
Resource management module: distributed memory system block device pond is used to provide block device for container carry, which uses
It is managed in the pond pool, the corresponding pond pool of block includes allocated block device and unappropriated memory space, manager
Formula includes creation, deletes, inquiry operation.
Compared with the prior art, the invention has the following advantages and beneficial effects:
The present invention realizes database service persistence method and system based on swarm, can ensure that the data of database service
It is persisted in the block device of ceph, improves the Information Security of database；Single database and data are each provided simultaneously
Library cluster two types, meet the different demands of user；The delay machine recovery time of single database service is shortened simultaneously, is improved
The availability and recovery capability of database, and the system can facilitate user to create database service, reduce the fortune of operation maintenance personnel
Tie up difficulty.
Detailed description of the invention
Fig. 1 is the database service persistent object system block architecture diagram of the invention based on swarm.
Fig. 2 is the general flow chart of the database service persistent object system of the invention based on swarm.
Fig. 3 is the flow chart of single database in the database service persistence based on swarm in the embodiment of the present invention.
Fig. 4 is the flow chart of data-base cluster in the database service persistence based on swarm in the embodiment of the present invention.
Specific embodiment
Present invention will now be described in further detail with reference to the embodiments and the accompanying drawings, but does not constitute to of the invention any
Limitation, described the specific embodiments are only for explaining the present invention, and embodiments of the present invention are not limited thereto.
Embodiment:
As shown in Figure 1, it is shown that the database service persistent object system based on swarm specifically includes that control module, parsing mould
Block, registration module, network module, resource management module.
Control module is responsible for receiving the request for the creation database that user sends in the present embodiment, which, which receives, asks
It after asking, is forwarded to parsing module and carries out Parameter analysis of electrochemical, then parameter is included the forwarding such as network-driven, network name by control module
It include block device size, block access limit, block device name, block device pond name to network module creation network, then by parameter
Block device is requested etc. resource management module is forwarded to, finally docker api is called to create container, returns to user.
Parsing module is responsible for the request from control module user in the present embodiment, which can be according to stateful service
The value of collection mark determines creation single database or data-base cluster, if there is status service integrates the value of mark as true
(true), then create data-base cluster；If there is status service integrates the value of mark as false(vacation), then single database is created, so
Return parameters are to control module afterwards, and if it is single database, then return parameters include network-driven, network name, database clothes
Business name, database service port, database start command, database cease and desist order, block device size, block access limit, block
Device name, the address vip, entrance access service name, entrance access serve port；If it is data-base cluster then return parameters
Including network-driven, network name, database service name, database service port, Database Replica number, block device size,
Block access limit, block device name, entrance access service name, entrance access serve port.
Registration module is responsible for the request from control module creation data-base cluster in the present embodiment, wherein individual data
Library service-creation does not need registration information, and it includes entrance access service name which, which provides registration and delete related registration information,
With port, database service name and port.
Network module is responsible for the request from control module creation network service in the present embodiment, which can call
The application programming interface of docker api(container) check that network whether there is, if there is directly return overlay net
Network id is to control module, if it does not exist, then calls docker api to create overlay network (overlay network), then returns
Overlay network id is to control module.
Resource management module is responsible for the request from control module creation block device in the present embodiment, which calls
The api(application programming interface of ceph) the specified block device of creation do not need to create if the block device is existing,
Directly return to the block device.The database service persistence method to provided in an embodiment of the present invention based on swarm carries out below
Detailed step explanation.
To single database, the processing step of the database service persistence based on swarm is as follows:
Step 1: user is when constructing customized database mirroring, it is only necessary to be used to combine the life of image in dockerfile(
The text document of order) on add-on system provide High Availabitity software of the keepalived(based on Virtual Router Redundacy Protocol) basis
Customized database is installed on mirror image, then covers the order executed when the entrance entrypoint(container starting of mirror image) i.e.
It can.
Step 2: user sends the request of creation single database to control module, and required parameter includes status service collection
Mark, network name, network-driven, database name, database service name, database service port, Database Replica
Number, database start command, database are ceased and desisted order, block device size, block access limit, block device name, the address vip, are entered
Mouth access service name, entrance access serve port；Control module forwards the request to parsing module, and parsing module makes requests ginseng
Several parsings；
Step 3: the api for the request call ceph that resource management module is forwarded according to control module creates block device, required parameter
It to include the corresponding pond pool of creation block, block access limit, block size and block name, the block device if necessary to creation exists,
Then directly return to existing block device；
Step 4: control module creates primary database container and standby database container according to required parameter, and required parameter includes data
Library service name, database service port, database start command, database cease and desist order, network name, network-driven, vip
Address；Two containers call plug-in unit rexray(containers to roll up plug-in units) service is mounted to the same block device；
Step 5: control module calls docker api creation nginx entrance to access container, required parameter packet according to required parameter
Name and the port, network-driven and network name of entrance access container are included, the mirror image which accesses container is system
It constructs in advance, effect is to carry out load forwarding to primary database container and standby database container；
In step 2, parsing module analytic parameter judges whether it is creation single database request, and required parameter must include
Database service name, database service port, database start command, database cease and desist order, the address vip etc..
In step 4, control module first creates the nerve of a covering of specified network-driven and network name to network module request
Network returns and calls docker api creation primary database container and standby database container after being covered with network id, generates simultaneously
Keepalived.conf configuration file allows primary database container and standby database container by heartbeat communication, two containers according to
Weight determines the database service starting of which database container, when container starting, the initialization weight of primary database container
It is higher than the initialization weight of standby database container, so will start the database of primary database container, stops standby database
The database of container, when primary database container occur the database service halted state of delay machine or primary database container when
It waits, the weight of primary database container can reduce and stop the database of primary database container, the weight meeting of standby database container
Increase and start the database of standby database container.
In steps of 5, the mirror image of nginx entrance access container is that system is built in advance, which mainly includes
Nginx service, the nginx service are mainly used for acting on behalf of tcp(transmission control protocol) forwarding.Control module creates nginx entrance
Access container can generate corresponding nginx.conf configuration file, carry out agency's forwarding, one of container meeting to two containers
As primary server, that is, primary database container of agency's forwarding, after primary server delay machine, nginx forwarding can just be forwarded to standby
The i.e. standby database container of server.
For data-base cluster, the processing step of the database service persistence based on swarm is as follows:
Step 1: user sends the request of creation data-base cluster to control module, and request includes stateful services set mark, net
Network driving, network name, database service name, database service port, Database Replica number, database start command, number
It ceases and desist order according to library, block device size, block access limit, block device name, the address vip, entrance access service name, entrance visit
It asks that serve port parameter, control module forward the request to parsing module, carries out Parameter analysis of electrochemical；
Step 2: resource management module creates block device, the parameter of request according to the request call ceph api that control module forwards
It to include the corresponding pond pool of creation block, block size, block name, the number of block and block access limit, wherein what the block created was set
Number and the number of database container are identical, if the presence of corresponding block device, directly returns to corresponding block device, block
Equipment names format to name according to database-{ 1,2,3... }；
Step 3: control module accesses service request to the entrance of etcd registration database cluster；Including registration entrance access service
Name and port；
Step 4: control module first creates specified network to network module request, returns to network id, is called according to required parameter
Docker api creation, wherein the entrance comprising nginx and confd accesses service container, the mirror image of entrance access container is
What system constructed in advance, which accesses the service name of container and the registration entrance access Service name of open port and step 3
Word and port are corresponding identical；Whether wherein confd service changes every the 1s key-value pair that can inspect periodically etcd, such as
There is modification, addition, deletes situation in fruit key-value pair, then confd service can regenerate nginx.conf configuration file；If key
Value is not to changing, then confd service will not regenerate new configuration file；
Step 5: control module creates the name and port, registered paths and step of database container into etcd registration S6 step
3 registration entrance access service name is identical.
Step 6: control module requests network id to network module, then docker api is called to create database container,
Using plug-in unit rexray, the corresponding block device of each database container difference carry, wherein block device carry corresponding relationship according to
Container name: database name-{ 1,2,3... } and ceph block device name: database name-{ 1,2,3... } corresponds.
In step 1, parsing module analytic parameter judge whether be create data-base cluster request, and request parameter
It must include: entrance access service, entrance access serve port, database service name, database service port etc..
In step 4, the mirror image of creation nginx entrance access container is that system is built in advance, which mainly wraps
Nginx service and confd service are included, nginx therein is serviced for acting on behalf of tcp forwarding, confd for monitoring etcd key assignments.
If the key-value pair in etcd changes, then the nginx.conf that confd can be new according to the newly-generated portion of template leads to
Know that nginx examines the configuration file whether correct, i.e., whether meets the grammer of nginx configuration file, if correctly, nginx weight
Newly-generated configuration file is newly loaded, if incorrect, nginx still uses original configuration file.Nginx can be to database
Container is polled forwarding, i.e., each request is assigned to database container one by one in chronological order, if there is database occurs one
If secondary retransmission failure, then in the following 10s time, nginx will not be reattempted second of forwarding, after 10s, be turned again
It is dealt into the database container.
In step 6, if necessary to carry out dilatation to the data-base cluster, it can be transmit a request to control module,
Control module registers the key-value pair of new database container, and new database container name and the access service of its entrance to etcd
Name be it is identical, confd can detecte the addition of key-value pair, again update nginx.conf configuration file, notice
Nginx reloads configuration file.Then control module recalls docker api and creates new database container, calls
The new block device of rexray carry.
If necessary to database capacity reducing, transmit a request to control module, control module calls docker
Api delete database container, be then forwarded to registration module, transmit a request to etcd delete the database container name and
Port.When etcd key assignments changes, confd can detecte the deletion of key assignments, update nginx.conf configuration text again
Part reloads configuration file in notice nginx.
By this example can database service include that single database and data-base cluster realize persistence, it is full
The different demand of sufficient user, improves the safety of database data, while improving database service in the availability of operation, phase
Container restarting is compared, this example can be shortened the delay machine recovery time of single database service 76%.Pass through this instance user simultaneously
It only needs to send database request to control module, database service can be created, reduce the O&M difficulty of operation maintenance personnel.
The above is only the preferred embodiment of the present invention, it should be pointed out that for those skilled in the art, is not taking off
Under the premise of from structure of the invention, various modifications and improvements can be made, these all will not influence the effect that the present invention is implemented
And patent practicability, the technical solution of patent and its patent of invention design are subject to equivalent substitution or change according to the present invention, all
Belong to the scope of protection of the patent of the present invention.
Claims (10)
1. a kind of database service persistence method based on swarm, including the persistence to single database and data-base cluster
Method, which is characterized in that the persistence method of single database, comprising the following steps:
Database mirroring is constructed on the basis of S1, the High Availabitity software (keepalived) based on Virtual Router Redundacy Protocol；
S2, creation single database parameter, and parsed, the parameter of creation includes: stateful services set mark, network name
Word, network-driven, database name, database service name, database service port, Database Replica number, database starting
It orders, database is ceased and desisted order, block device size, block access limit, block device name, the address vip, entrance access Service name
Word, entrance access serve port；
S3, distributed memory system (ceph) block device is created according to the parameter of parsing；
S4, database container and carry distributed memory system block device are created according to analytic parameter;
S5, database container is accessed according to analytic parameter creation proxy server (nginx) entrance；
To the persistence method of data-base cluster, comprising the following steps:
L1, creation data base set swarm parameter, and parsed, the parameter of creation includes: stateful services set mark, network drive
Dynamic, network name, database service name, database service port, Database Replica number, database start command, database
It ceases and desist order, block device size, block access limit, block device name, the address vip, entrance access service name, entrance access clothes
Business port parameter；
L2, distributed memory system block device is created according to analytic parameter；
L3, the access service of registration database cluster entrance；
L4, data-base cluster container is accessed according to analytic parameter creation proxy server entrance；
L5, registration database service；
L6, database container and carry distributed memory system block device are created according to analytic parameter.
2. the database service persistence method of swarm according to claim 1, which is characterized in that step S3 is according to S2
The parameter of parsing calls the api(application programming interface of ceph) creation distributed memory system block device, the parameter of creation
Including block size, block name, the corresponding pond of block (pool) and block access limit, and a block device is only created, for step S4
Database container carry.
3. the database service persistence method of swarm according to claim 1, which is characterized in that step S4 creates number
According to storage capacity device keepalived.conf configuration file and log-on data library script can be automatically generated according to the parameter that step S2 is created
And stopping database script, the parameter that step S4 is used includes that database service name, database service port, database open
Dynamic order, database cease and desist order, network name, network-driven, the address vip, and the container of step S4 uses book plug-in unit
Rexray carry distributed memory system block device.
4. the database service persistence method of swarm according to claim 1, which is characterized in that step S4
Database container and carry distributed memory system block device are created according to analytic parameter, comprising the following steps:
S4-1, creation primary database container carry distributed memory system block device；
S4-2, the same distributed memory system block device for creating standby database container carry and master data container carry；
Primary database container and the standby respective keepalived service of database container can check the weight of itself, and weighted value is high
The service of container log-on data library, the low container of weighted value stop database service, the same time only have primary database container or
Standby database container one of container operation data library services.
5. the database service persistence method of swarm according to claim 1, which is characterized in that step S5 is according to solution
It analyses parameter creation proxy server entrance and accesses container, nginx.conf configuration file can be automatically generated, while to primary database
Agency's forwarding is provided with standby database, unless primary database delay machine, proxy server entrance, which accesses container, all to turn request
It is dealt into standby database, is otherwise all to be forwarded to primary database.
6. the database service persistence method of swarm according to claim 1, which is characterized in that step L2 is according to solution
Analyse the api(application programming interface that parameter calls ceph) distributed memory system block device is created, the parameter of creation includes
The corresponding pond of block size, block name, block (pool), block number and block access limit, wherein the distributed memory system created
Block device number and the number of the database container of L6 step creation are equal, and ceph block device is mounted to the identical database of name
The name format of container, database container and ceph block device is equal are as follows: database name word-{ 1,2,3... }.
7. the database service persistence method of swarm according to claim 1, which is characterized in that step L3 register into
Mouthful access service steps the following steps are included:
L3-1, name is serviced to key-value pair data storage system (etcd) registration entrance access；
L3-2, serve port is accessed to key-value pair data storage system registration entrance.
8. the database service persistence method of swarm according to claim 1, which is characterized in that step L4 is according to solution
It analyses parameter creation proxy server entrance and accesses container, taken including unified configuration management tool (confd) service and agency
Business device；
Confd service periodically obtains information, which includes portal service name in etcd, portal service port, database clothes
Business name, database port, and check whether the key-value pair of etcd storage changes, if there is a change, taken according to agency
The configuration template of business device starting regenerates the configuration (nginx.conf) of new proxy server starting, and then notification agent takes
Business device reloads new nginx.conf configuration file；
Proxy server provides load balancing to data-base cluster and provides entrance access, if the primary failure of agency's forwarding, every
It is reattempted after 10s primary.
9. the database service persistence method of swarm according to claim 1, which is characterized in that step L5 registers number
According to library service the following steps are included:
L5-1, to key-value pair data storage system registration database container name；
L5-2, to key-value pair data storage system registration database container port；
As long as registration database container and entrance access service name be it is identical, the database container of registration will be added to
In proxy server load balance list, so if carrying out dilatation to data-base cluster, it is only necessary to be registered to identical entrance
Access service name；
Step L6 creates database container and carry distributed memory system block device according to analytic parameter, and wherein distribution is deposited
Storage system block device is mounted to the identical database container of name, and the name format of database container and ceph block device is equal are as follows:
Database name-{ 1,2,3... }, data-base cluster have several distributed memory system block devices, and the container of step L6 uses
Rexray(book plug-in unit) carry distributed memory system block device.
10. a kind of database service persistent object system based on swarm, which is characterized in that comprise the following modules:
Control module: for handling user's request and being responsible for communicating with other modules, docker is called according to user demand
Api creates corresponding database container；
Registration module: for the registration and deletion in data-base cluster, registering parameter includes entrance access service name, entrance visit
Ask serve port, database service name and database serve port；
Network module: for creating the network (network) of container (docker), and acquisition network id；
Parsing module: the creation database service file for submitting to user carries out Parameter analysis of electrochemical；
Resource management module: distributed memory system block device pond is used to provide block device for container carry, the module for pair
The pond pool is managed, and the corresponding pond pool of block includes allocated block device and unappropriated memory space, way to manage packet
Include creation, deletion, inquiry operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910049793.9A CN109918359B (en) | 2019-01-18 | 2019-01-18 | Database service persistence method and system based on sweep |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910049793.9A CN109918359B (en) | 2019-01-18 | 2019-01-18 | Database service persistence method and system based on sweep |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109918359A true CN109918359A (en) | 2019-06-21 |
| CN109918359B CN109918359B (en) | 2022-03-29 |
Family
ID=66960469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910049793.9A Active CN109918359B (en) | 2019-01-18 | 2019-01-18 | Database service persistence method and system based on sweep |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109918359B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110806907A (en) * | 2019-10-31 | 2020-02-18 | 浪潮云信息技术有限公司 | Containerized configurable database execution script management system and method |
| CN110990458A (en) * | 2019-12-03 | 2020-04-10 | 电子科技大学 | Distributed database system, interface communication middleware |
| CN111966717A (en) * | 2020-09-04 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Data access method and system for reducing database crash probability |
| CN112256399A (en) * | 2020-10-28 | 2021-01-22 | 四川长虹电器股份有限公司 | Docker-based Jupyter Lab multi-user remote development method and system |
| CN112486564A (en) * | 2020-12-09 | 2021-03-12 | 浪潮云信息技术股份公司 | Confd dynamic update configuration-based method and system |
| CN112667747A (en) * | 2020-12-31 | 2021-04-16 | 北京赛思信安技术股份有限公司 | Dynamic configuration multi-database distributed persistence method supporting user-defined plug-in |
| CN113190627A (en) * | 2021-06-02 | 2021-07-30 | 南京恩瑞特实业有限公司 | Nginx and Mycat based information system architecture and configuration method thereof |
| CN114500573A (en) * | 2021-12-24 | 2022-05-13 | 天翼云科技有限公司 | Storage volume mounting method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118073A (en) * | 2013-01-08 | 2013-05-22 | 华中科技大学 | Virtual machine data persistence storage system and method in cloud environment |
| WO2015176636A1 (en) * | 2014-05-23 | 2015-11-26 | ***股份有限公司 | Distributed database service management system |
| CN107967124A (en) * | 2017-12-14 | 2018-04-27 | 南京云创大数据科技股份有限公司 | A kind of distribution persistence memory storage system and method |
-
2019
- 2019-01-18 CN CN201910049793.9A patent/CN109918359B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118073A (en) * | 2013-01-08 | 2013-05-22 | 华中科技大学 | Virtual machine data persistence storage system and method in cloud environment |
| WO2015176636A1 (en) * | 2014-05-23 | 2015-11-26 | ***股份有限公司 | Distributed database service management system |
| CN107967124A (en) * | 2017-12-14 | 2018-04-27 | 南京云创大数据科技股份有限公司 | A kind of distribution persistence memory storage system and method |
Non-Patent Citations (2)
| Title |
|---|
| KANG D K: "Workload-aware resource management for energy", 《2016 IEEE REGION 10 CONFERENCE (TENCON)》 * |
| 卢胜林等: "基于Docker Swarm 集群的调度策略优化", 《信息技术》 * |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110806907A (en) * | 2019-10-31 | 2020-02-18 | 浪潮云信息技术有限公司 | Containerized configurable database execution script management system and method |
| CN110806907B (en) * | 2019-10-31 | 2023-04-21 | 浪潮云信息技术股份公司 | Containerized configurable database script execution management system and method |
| CN110990458A (en) * | 2019-12-03 | 2020-04-10 | 电子科技大学 | Distributed database system, interface communication middleware |
| CN110990458B (en) * | 2019-12-03 | 2023-04-18 | 电子科技大学 | Distributed database system, interface communication middleware |
| CN111966717B (en) * | 2020-09-04 | 2022-06-14 | 苏州浪潮智能科技有限公司 | Data access method and system for reducing database crash probability |
| CN111966717A (en) * | 2020-09-04 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Data access method and system for reducing database crash probability |
| CN112256399A (en) * | 2020-10-28 | 2021-01-22 | 四川长虹电器股份有限公司 | Docker-based Jupyter Lab multi-user remote development method and system |
| CN112256399B (en) * | 2020-10-28 | 2022-08-19 | 四川长虹电器股份有限公司 | Docker-based Jupitter Lab multi-user remote development method and system |
| CN112486564A (en) * | 2020-12-09 | 2021-03-12 | 浪潮云信息技术股份公司 | Confd dynamic update configuration-based method and system |
| CN112667747B (en) * | 2020-12-31 | 2021-09-21 | 北京赛思信安技术股份有限公司 | Dynamic configuration multi-database distributed persistence method supporting user-defined plug-in |
| CN112667747A (en) * | 2020-12-31 | 2021-04-16 | 北京赛思信安技术股份有限公司 | Dynamic configuration multi-database distributed persistence method supporting user-defined plug-in |
| CN113190627A (en) * | 2021-06-02 | 2021-07-30 | 南京恩瑞特实业有限公司 | Nginx and Mycat based information system architecture and configuration method thereof |
| CN114500573A (en) * | 2021-12-24 | 2022-05-13 | 天翼云科技有限公司 | Storage volume mounting method, device, equipment and storage medium |
| CN114500573B (en) * | 2021-12-24 | 2024-04-26 | 天翼云科技有限公司 | Storage volume mounting method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109918359B (en) | 2022-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109918359A (en) | Database service persistence method and system based on swarm | |
| US6105067A (en) | Connection pool management for backend servers using common interface | |
| CN110971614A (en) | Internet of things adaptation method and system, computer equipment and storage medium | |
| CN110324177A (en) | Service request processing method, system and medium under micro-service architecture | |
| CN109542611A (en) | Database, that is, service system, database dispatching method, equipment and storage medium | |
| CN110377395A (en) | A kind of Pod moving method in Kubernetes cluster | |
| CN103795793B (en) | Road vehicle monitoring platform system based on double server clusters | |
| EP1682978A2 (en) | Method and system for accessing and managing virtual machines | |
| CN112925646A (en) | Electric power data edge calculation system and calculation method | |
| CN103226518A (en) | Method and device for performing volume expansion in storage management system | |
| JPH08137795A (en) | Data access right managing system in data independent type computer system | |
| CN110830574B (en) | Method for realizing intranet load balance based on docker container | |
| CN112698838B (en) | Multi-cloud container deployment system and container deployment method thereof | |
| CN112256439B (en) | Service directory dynamic updating system and method based on cloud computing resource pool | |
| CN106933548A (en) | Global information is obtained, processes and updated, methods, devices and systems | |
| CN106713391A (en) | Session information sharing method and sharing system | |
| CN104780221A (en) | Intellectual property comprehensive service platform system for middle and small-sized enterprises | |
| CN113301590B (en) | Virtual resource management and control system facing 5G access network | |
| CN111541599B (en) | Cluster software system and method based on data bus | |
| CN106547790B (en) | Relational database service system | |
| CN112121413A (en) | Response method, system, device, terminal and medium of function service | |
| CN115695139A (en) | Method for enhancing micro-service system architecture based on distributed robust | |
| CN110011984A (en) | A kind of distributed cluster system and method based on REST and RPC | |
| US20240036910A1 (en) | Meta-level management system that aggregates information and functionalities of computational-resource management systems and that provides new management functionalities | |
| CN112351106A (en) | Service grid platform containing event grid and communication method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |