CN105550309A - MPP framework database cluster sequence system and sequence management method - Google Patents

MPP framework database cluster sequence system and sequence management method Download PDF

Info

Publication number
CN105550309A
CN105550309A CN201510927405.4A CN201510927405A CN105550309A CN 105550309 A CN105550309 A CN 105550309A CN 201510927405 A CN201510927405 A CN 201510927405A CN 105550309 A CN105550309 A CN 105550309A
Authority
CN
China
Prior art keywords
sequence
memory database
clustered node
supervisory
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510927405.4A
Other languages
Chinese (zh)
Inventor
赵伟
武新
王洪越
杨伟伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd
Original Assignee
TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd filed Critical TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd
Priority to CN201510927405.4A priority Critical patent/CN105550309A/en
Publication of CN105550309A publication Critical patent/CN105550309A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides an MPP framework database cluster sequence system and a sequence management method. The MPP framework database cluster sequence system comprises a memory database used for providing a sequence object management service for each cluster node. With the adoption of the technical scheme provided by the invention, an MPP framework database cluster can be endowed with a sequence function comprising sequence object management, so that the same experience as a stand-alone database can be obtained by using the sequence function of the MPP framework database cluster; in addition, the sequence function is provided by the memory database, so that a high-performance sequence function can be provided; and the sequence management is carried out in the memory database, and a high-speed concurrent processing mechanism can be provided, so that the performance of the memory database is far superior to that of the stand-alone database.

Description

MPP framework data-base cluster sequential system and sequence management method
Technical field
The invention belongs to Cluster Database field, especially relate to a kind of MPP framework data-base cluster sequential system and sequence management method.
Background technology
Along with the fast development of informationization technology, number of users, the data volume of an enterprise all present explosive growth, while portfolio improves, the visit capacity of database and data volume increase fast to database processing power and calculating strength also corresponding increase, and single node database cannot be born at all.Under such background, large-scale distributed data-base cluster creates, so-called data-base cluster, refer to and utilize two or multiple stage database service, form a virtual centralized database logical image, as single database, provide transparent data, services to client.
At present, there is the data-base cluster framework of two kinds of main flows, the band aggregated structure of Centroid and the MPP framework not with Centroid.With the aggregated structure of Centroid, cluster metadata only has portion, is in charge of by Centroid is unified; MPP framework not with Centroid, cluster metadata has many parts, and each clustered node is a, and identical, by each clustered node self maintained.
In Database Systems, comprise the database objects such as the table (Table) of database, index (Index), view (View).Sequence (Sequence) is also the one of database object, in unit database, this object is for generating unique sequence code, for business, for uniquely identifying certain table record, be characterized in that the sequential value that this sequence generates is monotone increasing (or successively decreasing), the sequential value generated by the example of same sequence object is in a database unique.And in data-base cluster, particularly in the cluster of MPP framework, owing to there is no Centroid, so do not have Global center to be responsible for the management work of sequence, the sequence object as unit cannot be realized.
Summary of the invention
Embodiments provide a kind of MPP framework data-base cluster sequential system and sequence management method, in order to realize the object realizing sequence management in MPP framework data-base cluster.
First aspect, embodiments provide a kind of MPP framework data-base cluster sequential system, described system comprises:
Memory database, for providing the service of sequence sequence Object Management group for each clustered node.
Further, described memory database distribution is arranged in each clustered node.
Further, described distribution is arranged on the memory database in each clustered node is virtual overall memory database.
Further, described memory database specifically for:
Increase newly, revise, delete and inquiry sequence sequence object.
Second aspect, embodiments provide a kind of MPP framework data-base cluster sequence sequence management method, described method comprises:
Node receives the supervisory sequence sequence object requests of client, and described supervisory sequence sequence object is sent to memory database;
Memory database performs sequence sequence Object Management group, and supervisory sequence sequence object response message is returned to clustered node;
Described supervisory sequence sequence object response message is sent to described client by clustered node.
Further, described memory database performs sequence sequence Object Management group, and supervisory sequence sequence object response message is returned to clustered node, comprising:
Described memory database formation sequence numerical value, returns this sequential digit values to clustered node;
Described supervisory sequence sequence object response message is sent to described client by described clustered node, comprising:
The sequential digit values that clustered node will generate, is sent to described client.
Further, stsndard SQL Interface realization supervisory sequence sequence object is passed through between described memory database and clustered node.
Adopt technique scheme, the data-base cluster of MPP framework can be allowed to have sequence functional nucleotide sequence, comprise sequence sequence Object Management group, make to use the sequence function of MPP framework data-base cluster can obtain the experience identical with unit database; In addition provide sequence function by memory database, high performance sequence function can be provided; The management of sequence, all in memory database, can provide high speed, concurrent processing mechanism, make its performance be far longer than unit database.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the structural representation of the MPP framework data-base cluster sequential system that first embodiment of the invention provides;
Fig. 2 is the schematic flow sheet of the MPP framework data-base cluster sequence sequence management method that second embodiment of the invention provides;
Fig. 3 is the schematic flow sheet of the MPP framework data-base cluster sequence sequence management method that third embodiment of the invention provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Fig. 1 is the structural representation of the MPP framework data-base cluster sequential system that first embodiment of the invention provides.See Fig. 1, described MPP framework data-base cluster sequential system, comprising:
Memory database, for providing the service of sequence sequence Object Management group for each clustered node.
In the present embodiment, described MPP framework data-base cluster sequential system comprises three nodes, also comprise memory database in the system, the mode that described memory database is combined by software and hardware realizes, for providing the service of sequence sequence Object Management group for each clustered node.The hardware composition distribution of described memory database is arranged in each clustered node.And be a whole memory database by software virtual, to realize carrying out holistic management to sequence sequence object.Concrete, can be used for increasing, revise, delete and inquire about sequence sequence object newly.
The technical scheme that the embodiment of the present invention provides, the data-base cluster of MPP framework can be allowed to have sequence functional nucleotide sequence, comprise sequence sequence Object Management group, make to use the sequence function of MPP framework data-base cluster can obtain the experience identical with unit database; In addition pass through the cooperation of node sequence module and center sequence module, high performance sequence function can be provided; If user uses sequence, function ratio is more frequent, when user defines sequence object, can define cache parameter is a larger value, make each clustered node can provide sequence function as unit database like this, multiple clustered node is concurrent provides sequence function, makes its performance be far longer than unit sequence database.
Fig. 2 illustrates second embodiment of the invention.
Fig. 2 is the schematic flow sheet of the MPP framework data-base cluster sequence sequence management method that second embodiment of the invention provides.
See Fig. 2, described MPP framework data-base cluster sequence sequence management method comprises:
Step 210, node receives the supervisory sequence sequence object requests of client, and described supervisory sequence sequence object is sent to memory database.
User sends supervisory sequence sequence object requests by client software to any one node in MPP framework data-base cluster, node is after receiving supervisory sequence sequence object requests, described supervisory sequence sequence object requests is sent to memory database, is processed by memory database.
Step 220, memory database performs sequence sequence Object Management group, and supervisory sequence sequence object response message is returned to clustered node.
Memory database is analyzed described supervisory sequence sequence object requests, obtains supervisory sequence sequence object.Memory database performs according to request and completes the management of sequence object.And sequence is managed result be sent to clustered node.
Step 230, described supervisory sequence sequence object response message is sent to described client by clustered node.
The technical scheme that the present embodiment provides, the data-base cluster of MPP framework can be allowed to have sequence functional nucleotide sequence, comprise sequence sequence Object Management group, make to use the sequence function of MPP framework data-base cluster can obtain the experience identical with unit database; In addition pass through the cooperation of node sequence module and center sequence module, high performance sequence function can be provided.
Fig. 3 is the schematic flow sheet of the MPP framework data-base cluster sequence sequence management method that third embodiment of the invention provides.Described supervisory sequence sequence object, based on above-described embodiment, further, is defined as: new series sequence numerical value by the present embodiment; And described memory database is performed sequence sequence Object Management group, and supervisory sequence sequence object response message is returned to clustered node, be specifically optimized for: described memory database formation sequence numerical value, returns this sequential digit values to clustered node; Accordingly, described supervisory sequence sequence object response message is sent to described client by described clustered node, is specifically optimized for: the sequential digit values that clustered node will generate, be sent to described client.
See Fig. 3, described MPP framework data-base cluster sequence sequence management method, comprising:
Step 310, node receives the supervisory sequence sequence object requests of client, and described supervisory sequence sequence object is sent to memory database.
Step 320, memory database formation sequence numerical value, returns this sequential digit values to clustered node.
Step 330, the sequential digit values that clustered node will generate, is sent to described client.
Further, stsndard SQL Interface realization supervisory sequence sequence object is passed through between memory database and clustered node.
One of ordinary skill in the art will appreciate that: all or part of step realizing above-mentioned each embodiment of the method can have been come by the hardware that programmed instruction is relevant.Aforesaid program can be stored in a computer read/write memory medium.This program, when performing, performs the step comprising above-mentioned each embodiment of the method; And aforesaid storage medium comprises: ROM, RAM, magnetic disc or CD etc. various can be program code stored medium.
Last it is noted that above each embodiment is only in order to illustrate technical scheme of the present invention, be not intended to limit; Although with reference to foregoing embodiments to invention has been detailed description, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein some or all of technical characteristic; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.

Claims (7)

1. a MPP framework data-base cluster sequential system, is characterized in that: described system comprises:
Memory database, for providing the service of sequence sequence Object Management group for each clustered node.
2. system according to claim 1, is characterized in that: described memory database distribution is arranged in each clustered node.
3. system according to claim 2, is characterized in that, the described distribution memory database be arranged in each clustered node is virtual overall memory database.
4. system according to claim 1, is characterized in that, described memory database specifically for:
Increase newly, revise, delete and inquiry sequence sequence object.
5. a MPP framework data-base cluster sequence sequence management method, is characterized in that, comprising:
Node receives the supervisory sequence sequence object requests of client, and described supervisory sequence sequence object is sent to memory database;
Memory database performs sequence sequence Object Management group, and supervisory sequence sequence object response message is returned to clustered node;
Described supervisory sequence sequence object response message is sent to described client by clustered node.
6. method according to claim 5, is characterized in that, described supervisory sequence sequence object comprises: new series sequence numerical value;
Described memory database performs sequence sequence Object Management group, and supervisory sequence sequence object response message is returned to clustered node, comprising:
Described memory database formation sequence numerical value, returns this sequential digit values to clustered node;
Described supervisory sequence sequence object response message is sent to described client by described clustered node, comprising:
The sequential digit values that clustered node will generate, is sent to described client.
7. the method according to claim 5 or 6, is characterized in that, by stsndard SQL Interface realization supervisory sequence sequence object between described memory database and clustered node.
CN201510927405.4A 2015-12-12 2015-12-12 MPP framework database cluster sequence system and sequence management method Pending CN105550309A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510927405.4A CN105550309A (en) 2015-12-12 2015-12-12 MPP framework database cluster sequence system and sequence management method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510927405.4A CN105550309A (en) 2015-12-12 2015-12-12 MPP framework database cluster sequence system and sequence management method

Publications (1)

Publication Number Publication Date
CN105550309A true CN105550309A (en) 2016-05-04

Family

ID=55829498

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510927405.4A Pending CN105550309A (en) 2015-12-12 2015-12-12 MPP framework database cluster sequence system and sequence management method

Country Status (1)

Country Link
CN (1) CN105550309A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107908652A (en) * 2017-10-12 2018-04-13 北京人大金仓信息技术股份有限公司 A kind of Sequence implementation methods for distributed data base system
CN108123984A (en) * 2016-11-30 2018-06-05 天津易遨在线科技有限公司 A kind of memory database optimizes server cluster framework

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000034895A1 (en) * 1998-12-10 2000-06-15 Mci Worldcom, Inc. Cluster-wide database system
CN101751394A (en) * 2008-12-16 2010-06-23 青岛海信传媒网络技术有限公司 Method and system for synchronizing data
CN102025550A (en) * 2010-12-20 2011-04-20 中兴通讯股份有限公司 System and method for managing data in distributed cluster
CN102142008A (en) * 2010-12-02 2011-08-03 华为技术有限公司 Method and system for implementing distributed memory database, token controller and memory database
US20120150805A1 (en) * 2010-12-08 2012-06-14 Ibm Corporation Efficient Backup and Restore of a Cluster Aware Virtual Input/Output Server (VIOS) Within a VIOS Cluster
US20120246190A1 (en) * 2011-03-23 2012-09-27 Manik Surtani System and method for performing object relational mapping for a data grid
WO2014052942A1 (en) * 2012-09-29 2014-04-03 Gopivotal, Inc. Random number generator in a parallel processing database
CN104239555A (en) * 2014-09-25 2014-12-24 天津神舟通用数据技术有限公司 MPP (massively parallel processing)-based parallel data mining framework and MPP-based parallel data mining method
CN104871153A (en) * 2012-10-29 2015-08-26 华为技术有限公司 System and method for flexible distributed massively parallel processing (mpp) database
CN105009110A (en) * 2012-11-30 2015-10-28 华为技术有限公司 Method for automated scaling of massive parallel processing (mpp) database
CN105045929A (en) * 2015-08-31 2015-11-11 国家电网公司 MPP architecture based distributed relational database

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000034895A1 (en) * 1998-12-10 2000-06-15 Mci Worldcom, Inc. Cluster-wide database system
CN101751394A (en) * 2008-12-16 2010-06-23 青岛海信传媒网络技术有限公司 Method and system for synchronizing data
CN102142008A (en) * 2010-12-02 2011-08-03 华为技术有限公司 Method and system for implementing distributed memory database, token controller and memory database
US20120150805A1 (en) * 2010-12-08 2012-06-14 Ibm Corporation Efficient Backup and Restore of a Cluster Aware Virtual Input/Output Server (VIOS) Within a VIOS Cluster
CN102025550A (en) * 2010-12-20 2011-04-20 中兴通讯股份有限公司 System and method for managing data in distributed cluster
US20120246190A1 (en) * 2011-03-23 2012-09-27 Manik Surtani System and method for performing object relational mapping for a data grid
WO2014052942A1 (en) * 2012-09-29 2014-04-03 Gopivotal, Inc. Random number generator in a parallel processing database
CN104871153A (en) * 2012-10-29 2015-08-26 华为技术有限公司 System and method for flexible distributed massively parallel processing (mpp) database
CN105009110A (en) * 2012-11-30 2015-10-28 华为技术有限公司 Method for automated scaling of massive parallel processing (mpp) database
CN104239555A (en) * 2014-09-25 2014-12-24 天津神舟通用数据技术有限公司 MPP (massively parallel processing)-based parallel data mining framework and MPP-based parallel data mining method
CN105045929A (en) * 2015-08-31 2015-11-11 国家电网公司 MPP architecture based distributed relational database

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108123984A (en) * 2016-11-30 2018-06-05 天津易遨在线科技有限公司 A kind of memory database optimizes server cluster framework
CN107908652A (en) * 2017-10-12 2018-04-13 北京人大金仓信息技术股份有限公司 A kind of Sequence implementation methods for distributed data base system

Similar Documents

Publication Publication Date Title
US11734234B1 (en) Data architecture for supporting multiple search models
US8775464B2 (en) Method and system of mapreduce implementations on indexed datasets in a distributed database environment
Zhao et al. Modeling MongoDB with relational model
US9507875B2 (en) Symbolic hyper-graph database
CN107515878B (en) Data index management method and device
JP6928677B2 (en) Data processing methods and equipment for performing online analysis processing
CN111966677B (en) Data report processing method and device, electronic equipment and storage medium
JP6779231B2 (en) Data processing method and system
Ngu et al. B+-tree construction on massive data with Hadoop
CN113051446A (en) Topological relation query method, device, electronic equipment and medium
CN106156070A (en) A kind of querying method, Piece file mergence method and relevant apparatus
CN111723161A (en) Data processing method, device and equipment
JP6269140B2 (en) Access control program, access control method, and access control apparatus
CN104239470A (en) Distributed environment-oriented space data compound processing system and method
CN115481110A (en) Resource sharing exchange design method based on metadata
CN105550309A (en) MPP framework database cluster sequence system and sequence management method
US20210311917A1 (en) Multi-value primary keys for plurality of unique identifiers of entities
CN105447183A (en) MPP framework database cluster sequence system and sequence management method
Gupta et al. Efficient query analysis and performance evaluation of the NoSQL data store for bigdata
CN108319604A (en) The associated optimization method of size table in a kind of hive
CN114415971B (en) Data processing method and device
WO2014180411A1 (en) Distributed index generation method and device
CN108121807B (en) Method for realizing multi-dimensional Index structure OBF-Index in Hadoop environment
US20230153300A1 (en) Building cross table index in relational database
US9081578B1 (en) System and method for graph conditioning with non-overlapping orderable values for efficient graph evaluation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160504

RJ01 Rejection of invention patent application after publication