CN114780251A - Method and system for improving computing performance by using distributed database architecture - Google Patents

Method and system for improving computing performance by using distributed database architecture Download PDF

Info

Publication number
CN114780251A
CN114780251A CN202210650043.9A CN202210650043A CN114780251A CN 114780251 A CN114780251 A CN 114780251A CN 202210650043 A CN202210650043 A CN 202210650043A CN 114780251 A CN114780251 A CN 114780251A
Authority
CN
China
Prior art keywords
data source
data
database
information
cache
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210650043.9A
Other languages
Chinese (zh)
Other versions
CN114780251B (en
Inventor
王志群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Lan You Technology Co Ltd
Original Assignee
Shenzhen Lan You Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Lan You Technology Co Ltd filed Critical Shenzhen Lan You Technology Co Ltd
Priority to CN202210650043.9A priority Critical patent/CN114780251B/en
Publication of CN114780251A publication Critical patent/CN114780251A/en
Application granted granted Critical
Publication of CN114780251B publication Critical patent/CN114780251B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/466Transaction processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/508Monitor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/548Queue

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method and a system for improving computing performance by using a distributed database architecture, and relates to the technical field of data processing. The present invention confirms data validity in real time by propagating transaction messages to the cache and from the database in real time, in combination with transaction information delivered through the primary copy function provided by the higher level copy software or the database. And a monitoring agent is deployed at the data service layer, and data of the OS and DB layers are acquired in real time and written into a cache, so that the data source component can know the performance and load of the data service component in time and can be scheduled as required. The method supports the definition of a distributed application data source contained in an application layer, can open the distributed application in the application layer, and can set and support a routing mode supported by the data source; an efficient and controllable distributed application system is constructed, the expandability of a distributed database architecture is fully utilized on the data service level, and the running efficiency of the system and the resource utilization of a balanced running environment are improved.

Description

Method and system for improving computing performance by using distributed database architecture
Technical Field
The invention belongs to the technical field of data processing, and particularly relates to a method and a system for improving computing performance by using a distributed database architecture.
Background
An enterprise-level data management system not only needs to quickly process a large number of concurrent transactions (OLTP), but also needs to support analysis (OLAP) of recent data, such as complex query, comprehensive report forms and the like, but the optimization means and the architecture design of OLAP and OLTP are completely different, and on the premise of not using a special hardware platform (such as ExaData), the traditional centralized data storage cannot meet the requirements.
The construction of a distributed application system, particularly the adoption of a distributed database at the data service level is an effective means for ensuring the operation efficiency of an enterprise-level data management system. As also disclosed in chinese patent CN106685835B, a method for implementing high-speed distributed routing among computing nodes in a data center is provided, in which an OVS virtual switch for providing network services to the outside is installed on a computing node and a network node, and only a Fast-DVR controller for monitoring the flow of the OVS virtual switch is installed on the computing node, and a channel bridge is updated by the Fast-DVR controller, and the Fast-DVR controllers deployed on the computing nodes are centrally controlled by a control node; and the user issues user-defined configuration to the Fast-DVR controller through the API, and the Fast-DVR controller dynamically plans the network topology among the computing nodes when different network flows among the computing nodes exceed the network flow threshold value. The network flow on the computing node is monitored, the network routing function is realized through the network node and the computing node, the topological structure of the whole data center is simplified, the network throughput pressure of the network node can be obviously reduced, and the overall network performance of the data center is improved.
Furthermore, distributed databases are used using open source or business components that support distributed data management, typically such components as: TDDL, SHARDING, CAT all provide support for distributed features such as database, table, read/write separation, etc.
However, when the timeliness of the system is very high, and the client does not receive or allow the use of expired and delayed dirty data to provide data services, but there are a large number of service scenarios of online complex service operations requested in real time, a custom distributed data source management component is required to complete data management under the distributed architecture.
Disclosure of Invention
The invention aims to provide a data processing system constructed based on a data resource directory, which fully utilizes the expandability of a distributed database architecture on the data service level by constructing an efficient and controllable distributed application system, improves the operation efficiency of the system and the resource utilization of a balanced operation environment, and solves the following technical problems:
1. data validity judgment is not supported, and the validity of data obtained by service operation cannot be guaranteed;
2. do not support on-demand customized distribution data sources;
3. the method does not support the automatic distribution of data sources according to the load capacity, and has the phenomenon of unbalanced resource use.
In order to solve the technical problems, the invention is realized by the following technical scheme:
as a first aspect provided by the present invention, the present invention is a method for improving computing performance by using a distributed database architecture, comprising the steps of:
step SS 01: before data operation, the dynamic data source management module scans data source registration information registered in a cache in real time;
step SS 02: according to the data source registration information, removing invalid data sources;
step SS 03: instantiating an effective data source according to a data source template in the configuration item, and refreshing the dynamic data source in real time after testing the effectiveness of the data source to ensure that the current data source contains all available and effective data sources;
step SS 04: selecting a proper data source as a current data source of the dynamic data source according to the routing rule;
step SS 05: and completing the data operation by using the data source specified in the dynamic data source.
Further, the configuration method of the data source comprises the following steps:
a Spring frame is adopted as an IOC container;
configuring a main database definition used under a distributed data architecture in a configuration file of Spring, connecting to a main database (cluster) in a system environment, and using the main database definition as a default data source of data operation;
and configuring a slave database definition used under a distributed data architecture in a configuration file of Spring, wherein the definition serves as a data source template dynamically registered from a database and adapts to different types of data sources.
Further, the dynamic data source comprises a master data source and a data source corresponding to the dynamically registered slave database.
Further, in step SS02, the method for removing the invalid data source is as follows:
s21: deploying a custom acquisition agent client on a server needing to monitor the state;
s22: the agent client side collects server state information at regular time T1, wherein the server state information comprises CPU use conditions, database busy DEGREE (DB DERGRE), memory utilization rate, IO utilization rate and the like;
s23: sending the server state information to a cache, setting a life cycle to be T1, and finishing automatic registration;
s24: taking T1=500ms as a heartbeat detection period, finishing heartbeat detection by a TTL mechanism of a cache, wherein the heartbeat detection is not refreshed after time out and is regarded as node loss (invalid data source);
s25: and the dynamic data source monitors the server state information stored in the cache during working and judges the state of each server in real time.
Further, for step SS04, all sessions are injected into the dynamic data source through JDBC templates, with one application having and only a single data source.
Further, in step SS04, according to the routing rule, the method for selecting an appropriate data source includes:
s41: acquiring the current server state including information such as a CPU, an internal memory, a magnetic disk and the like from a database according to a timing T1, writing the current server state into a cache, and completing self registration;
s42: after the business function processing of the master database is finished, writing the current internal transaction processing number into a transaction registration table to finish the transaction processing of the master database;
s43: the application layer or the data layer issues internal transaction processing information through messages;
s44: receiving internal transaction number information in a transaction registry from a database through high-level replication software;
s45: receiving internal transaction processing information from the database through the message, comparing the internal transaction processing information with the internal transaction number in the local transaction registration table, and confirming the transaction synchronization state;
s46: writing from the database data synchronization state to the cache;
s47: and the application end dynamic data source acquires the registered related server information and database information in the cache according to the routing rule, and selects the server with the lowest load as a service processing node to complete the service processing process.
Further, when the application layer or the data layer issues the internal transaction information through the message, the following steps are executed:
creating a context for storing the session associated information, and defining related attributes contained in the context;
loading an interception policy on a data table to be copied based on ORACLE fine granularity control (FGAC);
and the subsequent processing work of copy monitoring is included in the business function processing process of the application layer.
Further, in step S45:
if the local transaction number is 0, no content needing to be copied exists;
if the local transaction number is greater than 0, the transaction number needs to be synchronized; that is, data change needing to be copied is shown, a local change table of a main database needs to be recorded, and an application needs to send a transaction number to a slave database agent through MQ; the data insertion operation transaction is contained within the application transaction; in order to be as transparent as possible to the application; interacting with the external interface only through the (internal) transaction number; the session context and DML auditing are all hidden inside the system.
Further, T1 is 500 ms.
As another aspect provided by the present invention, the present invention provides a system for improving computing performance by using a distributed database architecture, the system comprising a master server, a slave server and a cache, which are communicatively connected to each other, the system being configured to implement the method as provided in the first aspect.
The invention has the following beneficial effects:
according to the invention, by acquiring and judging the states of all data service nodes under a distributed data architecture in real time and managing the dynamic data source, the data operation process is distributed to the designated data service nodes in a balanced manner on the premise of ensuring the reality and the effectiveness of the service data, so that the performance of the whole system is improved.
Of course, it is not necessary for any product to practice the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of server state acquisition and registration in accordance with the present invention;
FIG. 2 is a schematic diagram of database change monitoring according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment is as follows:
referring to fig. 1-2, the present invention is a method for improving computing performance by using a distributed database architecture, comprising the following steps:
step SS 01: before data operation, the dynamic data source management module scans data source registration information registered in a cache in real time;
step SS 02: according to the data source registration information, removing invalid data sources;
step SS 03: instantiating an effective data source according to a data source template in the configuration item, and refreshing a dynamic data source in real time after testing the validity of the data source to ensure that the current data source contains all available and effective data sources;
step SS 04: selecting a proper data source as a current data source of the dynamic data source according to the routing rule;
step SS 05: and completing the data operation by using the data source specified in the dynamic data source.
The invention propagates transaction messages to a cache and from a (query) database in real time, and confirms the data validity in real time (< 20ms) by combining the transaction information transmitted by a primary copy function provided by high-level copy software (such as OGG and SPX) or the database; deploying a monitoring agent at a data service layer, acquiring OS (operating system) and DB (data base) layer data in real time (< 500ms) and writing the data into a cache, ensuring that a data source component can know the performance and load of the data service component in time and scheduling the data service component as required; the support comprises the metadata definition of the distributed application at the application level, the distributed application can be started at the application level, and the routing mode supported by the data source can be set and supported.
As an embodiment provided by the present application, preferably, the configuration method of the data source is:
a Spring frame is adopted as an IOC container;
configuring a main database definition used under a distributed data architecture in a configuration file of Spring, connecting to a main database (cluster) in a system environment, and using the main database definition as a default data source of data operation;
and configuring a slave database definition used in a distributed data architecture in a configuration file of Spring, wherein the definition is used as a data source template dynamically registered from a database and is adapted to different types of data sources.
As an embodiment provided by the present application, preferably, the dynamic data source includes a master data source and a data source corresponding to the dynamically registered slave database.
As an embodiment provided by the present application, preferably, in step SS02, the method for removing the invalid data source is:
s21: deploying a custom acquisition agent client on a server needing to monitor the state;
s22: the proxy client side collects server state information at a fixed time T1 (T1 =500 ms), wherein the server state information comprises CPU (Central processing Unit) use condition, database busy DEGREE (DB DERGRE), memory utilization rate, IO (input/output) utilization rate and the like;
s23: sending the server state information to a cache, setting a life cycle of T1=500ms, and finishing automatic registration;
s24: taking T1=500ms as a heartbeat detection period, finishing heartbeat detection by a TTL mechanism of a cache, wherein the heartbeat detection is not refreshed after time out and is regarded as node loss (invalid data source);
s25: and the dynamic data source monitors the server state information stored in the cache during working and judges the state of each server in real time.
As an embodiment provided by the present application, preferably, for step SS04, all sessions are injected into the dynamic data source through JDBC template, and an application has one and only a single data source, and which actual data source is specifically used is determined by the routing rule.
As an embodiment provided by the present application, preferably, in step SS04, according to the routing rule, the method for selecting the appropriate data source includes:
s41: acquiring the current server state from a database according to a timing T1 (T1 =500 ms), wherein the current server state comprises information such as a CPU (Central processing Unit), a memory, a disk and the like, writing the information into a cache, and finishing self registration at the same time;
s42: after the main database service function processing is completed, writing the current internal transaction processing number into a transaction registration table to complete the main database transaction processing;
s43: the application layer or the data layer issues internal transaction processing information through messages;
s44: receiving internal transaction number information in a transaction registry from a database through high-level replication software;
s45: receiving internal transaction processing information from the database through messages, comparing the internal transaction processing information with internal transaction numbers in a local transaction registration table, and confirming a transaction synchronization state;
s46: writing from the database data synchronization state to the cache;
s47: and the application-side dynamic data source acquires the registered related server information and database information in the cache according to the routing rule, and selects the server with the lowest load as a service processing node to complete the service processing process.
On the premise of being completely transparent to the application, transaction changes in the database are monitored in real time by deploying a hook component in a main (write) database or by an AOP mechanism at an application level, and as an embodiment provided by the application, preferably, an ORALCE database is adopted to complete data change monitoring at a data layer: when the application layer or the data layer issues the internal transaction information through the message, the following steps are executed:
creating a context for storing the session association information, and defining related attributes contained in the context, specifically:
-user context name
dml_audit_ctx VARCHAR2(30) DEFAULT 'DML_AUDIT_CONTEXT';
-default scenario user
DEFAULT _ user _ name VARCHAR2(30) DEFAULT 'scheme name';
- -DML operation definition
DML_OPERATED_KEY VARCHAR2(30) default 'DML_OPERATED';
……
create or replace context
DML _ AUDIT _ CONTEXT using scheme name duplicate _ audio _ pkg;
loading an interception strategy on a data table needing to be copied based on ORACLE fine granularity control (FGAC), and ensuring that all services realize transparent interception through a template mode;
and the subsequent processing work of copy monitoring is included in the business function processing process of the application layer.
As an embodiment provided by the present application, preferably, when obtaining the user name, the service name, and the operation name from the context, note that: when the database is just started, the content in DML _ audio _ ctx is 'NULL' -DML operation occurs on the table to be copied; the next (transaction) operation by default does not include a DML operation that copies the table.
As an embodiment provided by the present application, preferably, in step S45:
if the local transaction number is 0, no content needing to be copied exists;
if the local transaction number is greater than 0, the transaction number needs to be synchronized; that is, the data change needing to be copied is shown, a local change table of a master database needs to be recorded, and an application needs to send a transaction number to a slave database agent through MQ; the data insertion operation transaction is contained within the application transaction; in order to be as transparent as possible to the application; only through the (internal) transaction number and the external interface; the session context and DML auditing are all hidden inside the system.
Specifically, the method comprises the following steps:
author: creation date of Wangzhi group: 20160613 *
Date modified: 20160613 *
Function: judging whether a consistency check table needs to be recorded in a main database
Inputting: < leave blank > x
Outputting: local transaction number 0 has no content that needs to be copied >0 needs a synchronous transaction number
Description of the drawings: if the local transaction number >0, indicating that a data change requiring replication has occurred
The local change table of the main database needs to be recorded
Application needs to issue transaction number to slave database proxy through MQ
Data insertion operation transaction is contained within application transaction
Remarks are as follows: in order to be as transparent as possible to the application
Interaction with external interface only through (internal) transaction number
Session context and DML auditing are all hidden inside the system.
Example two:
the invention provides a system for improving computing performance by utilizing a distributed database architecture, which comprises a main server, a slave server and a cache which are mutually connected in a communication way, and is used for realizing the method provided by the first embodiment.
A system for improving computing performance by using a distributed database architecture is characterized in that states of data service nodes under the distributed data architecture are collected and judged in real time, and a data operation process is distributed to designated data service nodes in a balanced mode on the premise that service data are real and effective through dynamic data source management, so that the performance of the whole system is improved.
In the description herein, references to the description of "one embodiment," "an example," "a specific example," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.

Claims (10)

1. A method for improving computing performance using a distributed database architecture, comprising the steps of:
step SS 01: before data operation, the dynamic data source management module scans data source registration information registered in a cache in real time;
step SS 02: according to the data source registration information, removing invalid data sources;
step SS 03: instantiating an effective data source according to a data source template in the configuration item, and refreshing a dynamic data source in real time after testing the effectiveness of the data source;
step SS 04: selecting a proper data source as a current data source of the dynamic data source according to the routing rule;
step SS 05: and completing the data operation by using the data source specified in the dynamic data source.
2. The method of claim 1, wherein the data source is configured by:
a Spring frame is adopted as an IOC container;
configuring a main database definition used under a distributed data architecture in a configuration file of Spring, connecting the main database definition to a main database in a system environment, and using the main database definition as a default data source of data operation;
and configuring a slave database definition used under a distributed data architecture in a configuration file of Spring, wherein the definition serves as a data source template dynamically registered from a database and adapts to different types of data sources.
3. The method for improving computing performance by utilizing a distributed database architecture according to claim 2, wherein the dynamic data sources comprise a master data source and a data source corresponding to the dynamically registered slave database.
4. The method for improving computing performance by using distributed database architecture as claimed in claim 1, wherein in step SS02, the method for removing invalid data source is:
s21: deploying a custom acquisition agent client on a server needing to monitor the state;
s22: the proxy client acquires the server state information at a fixed time T1;
s23: sending the server state information to a cache, setting a life cycle to be T1, and finishing automatic registration;
s24: t1 is used as a heartbeat detection period, the heartbeat detection is finished by a TTL mechanism of a cache, and the node is regarded as node disconnection without refreshing when overtime occurs;
s25: and the dynamic data source monitors the server state information stored in the cache during working and judges the state of each server in real time.
5. The method of claim 4, wherein for step SS04, all sessions are injected into dynamic data sources through JDBC templates, and one application has only one single data source.
6. The method for improving computing performance by using distributed database architecture according to claim 5, wherein in said step SS04, the method for selecting the proper data source according to the routing rule is:
s41: acquiring the current server state from a database according to a timing T1, writing the current server state into a cache, and completing self registration;
s42: after the main database service function processing is completed, writing the current internal transaction processing number into a transaction registration table to complete the main database transaction processing;
s43: the application layer or the data layer issues internal transaction processing information through messages;
s44: receiving internal transaction number information in a transaction registry from a database through the high-level replication software;
s45: receiving internal transaction processing information from the database through messages, comparing the internal transaction processing information with internal transaction numbers in a local transaction registration table, and confirming a transaction synchronization state;
s46: writing from the database data synchronization state to the cache;
s47: and the application-side dynamic data source acquires the registered related server information and database information in the cache according to the routing rule, and selects the server with the lowest load as a service processing node to complete the service processing process.
7. The method of claim 6, wherein when the application layer or the data layer issues the internal transaction information through a message, the following steps are performed:
creating a context for storing the session association information, and defining related attributes contained in the context;
loading an interception strategy on a data table needing to be copied based on ORACLE fine granularity control;
and the subsequent processing work of copy monitoring is included in the business function processing process of the application layer.
8. The method of claim 7, wherein in step S45:
if the local transaction number is 0, no content needing to be copied exists;
if the local transaction number >0, then the transaction number needs to be synchronized.
9. The method for improving computing performance using a distributed database architecture of claim 6, T1 is 500 ms.
10. A system for improving computing performance using a distributed database architecture, the system comprising a master server, a slave server, and a cache communicatively connected to each other, the system being configured to implement the method of any of claims 1-9.
CN202210650043.9A 2022-06-10 2022-06-10 Method and system for improving computing performance by using distributed database architecture Active CN114780251B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210650043.9A CN114780251B (en) 2022-06-10 2022-06-10 Method and system for improving computing performance by using distributed database architecture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210650043.9A CN114780251B (en) 2022-06-10 2022-06-10 Method and system for improving computing performance by using distributed database architecture

Publications (2)

Publication Number Publication Date
CN114780251A true CN114780251A (en) 2022-07-22
CN114780251B CN114780251B (en) 2022-09-16

Family

ID=82422205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210650043.9A Active CN114780251B (en) 2022-06-10 2022-06-10 Method and system for improving computing performance by using distributed database architecture

Country Status (1)

Country Link
CN (1) CN114780251B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020194015A1 (en) * 2001-05-29 2002-12-19 Incepto Ltd. Distributed database clustering using asynchronous transactional replication
US20030208505A1 (en) * 2002-05-03 2003-11-06 Ward Mullins Dynamic class inheritance and distributed caching with object relational mapping and cartesian model support in a database manipulation and mapping system
US20060047713A1 (en) * 2004-08-03 2006-03-02 Wisdomforce Technologies, Inc. System and method for database replication by interception of in memory transactional change records
CN102622427A (en) * 2012-02-27 2012-08-01 杭州闪亮科技有限公司 Method and system for read-write splitting database
CN106095977A (en) * 2016-06-20 2016-11-09 环球大数据科技有限公司 The distributed approach of a kind of data base and system
CN107480251A (en) * 2017-08-14 2017-12-15 福建新大陆软件工程有限公司 A kind of system for managing data access
US20190065258A1 (en) * 2017-08-30 2019-02-28 ScalArc Inc. Automatic Provisioning of Load Balancing as Part of Database as a Service
CN112000444A (en) * 2020-10-27 2020-11-27 财付通支付科技有限公司 Database transaction processing method and device, storage medium and electronic equipment
CN114564340A (en) * 2022-01-19 2022-05-31 中国电子科技集团公司第十研究所 Distributed software high-availability method for aerospace ground system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020194015A1 (en) * 2001-05-29 2002-12-19 Incepto Ltd. Distributed database clustering using asynchronous transactional replication
US20030208505A1 (en) * 2002-05-03 2003-11-06 Ward Mullins Dynamic class inheritance and distributed caching with object relational mapping and cartesian model support in a database manipulation and mapping system
US20060047713A1 (en) * 2004-08-03 2006-03-02 Wisdomforce Technologies, Inc. System and method for database replication by interception of in memory transactional change records
CN102622427A (en) * 2012-02-27 2012-08-01 杭州闪亮科技有限公司 Method and system for read-write splitting database
CN106095977A (en) * 2016-06-20 2016-11-09 环球大数据科技有限公司 The distributed approach of a kind of data base and system
CN107480251A (en) * 2017-08-14 2017-12-15 福建新大陆软件工程有限公司 A kind of system for managing data access
US20190065258A1 (en) * 2017-08-30 2019-02-28 ScalArc Inc. Automatic Provisioning of Load Balancing as Part of Database as a Service
CN112000444A (en) * 2020-10-27 2020-11-27 财付通支付科技有限公司 Database transaction processing method and device, storage medium and electronic equipment
CN114564340A (en) * 2022-01-19 2022-05-31 中国电子科技集团公司第十研究所 Distributed software high-availability method for aerospace ground system

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
SRI WULANDARI 等: "Distributed Database Implementation in Point of Sale System with Method Synchronous Replication", 《INTERNATIONAL JOURNAL OF ENGINEERING TECHNOLOGY AND NATURAL SCIENCES》 *
YALING XUN 等: "FiDoop: Parallel Mining of Frequent Itemsets Using MapReduce", 《IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS: SYSTEMS》 *
卫孝贤 等: "多主云数据库的全局事务日志", 《华东师范大学学报(自然科学版)》 *
祝雄锋: "数据库集群中间件MySQL Proxy研究与分析", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
许彪 等: "基于Mariadb Galera的高可用数据库集群技术", 《信息技术与信息化》 *
韩剑辉 等: "基于CORBA技术的高可用舰船信息处理***", 《计算机工程与科学 》 *
魏寒: "基于RDMA的共享缓冲区分布式数据库事务处理设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Also Published As

Publication number Publication date
CN114780251B (en) 2022-09-16

Similar Documents

Publication Publication Date Title
CN111338766B (en) Transaction processing method and device, computer equipment and storage medium
CN104793988B (en) The implementation method and device of integration across database distributed transaction
US9558207B1 (en) Versioning of database partition maps
CN109840166A (en) Across the cluster object storage async backup methods, devices and systems of one kind
CN107787490A (en) Function is directly connected in distributed data base grid
CN103581332B (en) HDFS framework and pressure decomposition method for NameNodes in HDFS framework
CN109542611A (en) Database, that is, service system, database dispatching method, equipment and storage medium
CN109739935A (en) Method for reading data, device, electronic equipment and storage medium
US20100023564A1 (en) Synchronous replication for fault tolerance
WO2021103499A1 (en) Multi-active data center-based traffic switching method and device
KR20080068687A (en) System and method to maintain coherence of cache contents in a multi-tier software system aimed at interfacing large databases
CN103345502B (en) Transaction processing method and system of distributed type database
CN112162846B (en) Transaction processing method, device and computer readable storage medium
CN104657497A (en) Mass electricity information concurrent computation system and method based on distributed computation
CN110019469A (en) Distributed data base data processing method, device, storage medium and electronic device
CN107885881A (en) Business datum real-time report, acquisition methods, device, equipment and its storage medium
CN110196859A (en) Data base read-write based on JDBC distributor separates cluster real-time consistency method
WO2006061262A1 (en) An on demand message based financial network integration middleware
CN101753359B (en) Method and system for dynamically distributing components
CN108228755A (en) The data of MySQL database based on daily record analytic technique to Hadoop platform synchronize clone method
WO2023082992A1 (en) Data processing method and system
CN110083306A (en) A kind of distributed objects storage system and storage method
WO2015088813A1 (en) Elastic data metadata compression in a distributed data grid
CN109783578A (en) Method for reading data, device, electronic equipment and storage medium
CN110413687A (en) The distributed transaction fault handling method and relevant device of verification are mutually demonstrate,proved based on node

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant