US20200265009A1 - Blockchain-based data migration method and apparatus - Google Patents
Blockchain-based data migration method and apparatus Download PDFInfo
- Publication number
- US20200265009A1 US20200265009A1 US16/869,298 US202016869298A US2020265009A1 US 20200265009 A1 US20200265009 A1 US 20200265009A1 US 202016869298 A US202016869298 A US 202016869298A US 2020265009 A1 US2020265009 A1 US 2020265009A1
- Authority
- US
- United States
- Prior art keywords
- storage system
- data
- blockchain
- migration
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/119—Details of migration of file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
- G06F16/1767—Concurrency control, e.g. optimistic or pessimistic approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/184—Distributed file systems implemented as replicated file system
- G06F16/1844—Management specifically adapted to replicated file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/12—Applying verification of the received information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
- H04L67/1076—Resource dissemination mechanisms or network resource keeping policies for optimal resource availability in the overlay network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/06—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols the encryption apparatus using shift registers or memories for block-wise or stream coding, e.g. DES systems or RC4; Hash functions; Pseudorandom sequence generators
- H04L9/0643—Hash functions, e.g. MD5, SHA, HMAC or f9 MAC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
- H04L9/0816—Key establishment, i.e. cryptographic processes or cryptographic protocols whereby a shared secret becomes available to two or more parties, for subsequent use
-
- H04L2209/38—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/50—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols using hash chains, e.g. blockchains or hash trees
Definitions
- the present specification relates to the field of network communications technologies, and in particular, to a blockchain-based data migration method and apparatus.
- the blockchain technology is also referred to as the distributed account book technology, and is an emerging technology in which computing devices jointly participate in “accounting” and jointly maintain a complete distributed database.
- the blockchain technology is characterized by decentralization, openness, and transparency.
- Each computing device can participate in database recording as a blockchain node device, and data synchronization can be quickly performed between computing devices.
- Each blockchain node device usually needs to process a high-concurrency consensus, verification, and read/write operation in a blockchain system. With an increase in the number of “accounting” blocks, incremental block data storage gradually affects a memory response speed, and further affects response efficiency of the node device to the high-concurrency consensus, verification, and read/write operation.
- the present specification provides a blockchain-based data migration method.
- the method is used by a blockchain node device to store data
- a storage architecture of the blockchain node device includes a first storage system and a second storage system interconnected with the first storage system, and the method includes: receiving the latest block of a blockchain, and storing the latest block in the first storage system; determining whether a migration trigger event for block data stored in the first storage system is detected; and migrating block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event.
- the first storage system is a centralized storage system
- the second storage system is a distributed storage system that includes cluster nodes.
- the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether specified data stored in the first storage system satisfies a predetermined data migration trigger rule; and if yes, determining that the migration trigger event for the block data stored in the first storage system is detected.
- the data migration trigger rule includes: a data capacity of the specified data stored in the first storage system exceeds a predetermined threshold; or a capacity ratio of a data capacity of the specified data stored in the first storage system to a total data capacity of the first storage system exceeds a predetermined threshold.
- the specified data includes one or more of total data, transaction digest value data, block digest value data, and historical status data in the block.
- the migrating block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event includes: invoking a data migration utility in the blockchain to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system, in response to the detected migration trigger event for the block data stored in the first storage system.
- the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether a migration instruction for the block data stored in the first storage system is received; and if yes, determining that the migration trigger event for the block data stored in the first storage system is detected.
- the migration instruction includes the specified data migration reference time.
- the second storage system includes a coordinator node and storage cluster nodes, and the coordinator node is configured to coordinate allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- the coordinating allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system includes: successively allocating the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- the coordinating allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system includes: migrating the block data that is of the blockchain and that is migrated to the second storage system to a first storage cluster node of the second storage system in ascending order of block heights; migrating remaining block data to a second storage cluster node of the second storage system in ascending order of block heights when a storage capacity of the first storage cluster node exceeds a predetermined capacity threshold; migrating remaining block data to a third storage cluster node of the second storage system in ascending order of block heights when a storage capacity of the second storage cluster node exceeds the predetermined capacity threshold; and so on.
- the blockchain is a consortium chain.
- the determining whether a migration trigger event for block data stored in the first storage system is detected; and migrating block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event includes: invoking a smart contract corresponding to data migration of the blockchain, and executing data migration logic claimed in the smart contract, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- the present specification further provides a blockchain-based data migration apparatus.
- the apparatus is used by a blockchain node device to store data
- a storage architecture of the blockchain node device includes a first storage system and a second storage system interconnected with the first storage system, and the apparatus includes: an acquisition unit, configured to receive the latest block of a blockchain, and store the latest block in the first storage system; a determining unit, configured to determine whether a migration trigger event for block data stored in the first storage system is detected; and a migration execution unit, configured to migrate block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event.
- the first storage system is a centralized storage system
- the second storage system is a distributed storage system that includes cluster nodes.
- the determining unit is specifically configured to: determine whether specified data stored in the first storage system satisfies a predetermined data migration trigger rule; and if yes, determine that the migration trigger event for the block data stored in the first storage system is detected.
- the determining unit is specifically configured to: determine whether a migration instruction for the block data stored in the first storage system is received; and if yes, determine that the migration trigger event for the block data stored in the first storage system is detected.
- the second storage system includes a coordinator node and storage cluster nodes, and the coordinator node is configured to coordinate allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- the blockchain is a consortium chain.
- the determining unit and the migration execution unit are specifically configured to: invoke a smart contract corresponding to data migration of the blockchain, and execute data migration logic claimed in the smart contract, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- the present specification further provides a computer device, including a memory and a processor.
- the memory stores a computer program that can be run by the processor, and the processor performs the steps of the previous blockchain-based data migration method when running the computer program.
- the present specification further provides a computer-readable storage medium.
- the computer-readable storage medium stores a computer program, and the steps of the previous blockchain-based data migration method are performed when the computer program is run by a processor.
- the blockchain-based data migration method and apparatus, the computer device, and the computer-readable storage medium that are provided above in the present specification are used by a blockchain node device to store data.
- a blockchain node device Under triggering of a related migration trigger event, existing block data that is in a first storage system for processing a blockchain service and that exists before migration reference time is migrated to a second storage system, to release more storage space for the first storage system, so that the first storage system can more optimally perform various data operations generated on a blockchain, such as a high-concurrency consensus, verification, and read/write operation.
- FIG. 1 is a flowchart illustrating a blockchain-based data migration method, according to an example implementation of the present specification
- FIG. 2 is a schematic diagram illustrating data allocation in a second storage system, according to an example implementation of the present specification
- FIG. 3 is a schematic diagram illustrating a blockchain-based data migration apparatus, according to an example implementation of the present specification.
- FIG. 4 is a structural hardware diagram illustrating an implementation of a blockchain-based data migration method or apparatus, according to the present specification.
- the “blockchain” described in the implementations provided in the present specification can be specifically a P2P network system that is achieved by node devices by using a consensus mechanism and that has a distributed data storage structure.
- Data in the blockchain is distributed in “blocks” that are connected to each other in terms of time.
- a current block includes a data digest of a previous block, and data of all or some nodes is completely backed up based on a specific consensus mechanism (for example, POW, POS, DPOS, or PBFT).
- Each node device (especially, a full node device) of the blockchain usually needs to process a high-concurrency consensus, verification, and read/write operation in the blockchain system.
- incremental block data storage gradually affects a memory response speed, and further affects response efficiency of the node device to the high-concurrency consensus, verification, and read/write operation.
- the present specification aims to provide a blockchain-based data migration method or apparatus, to migrate a historical block from a first storage system of a node device to a second storage system, so that the first storage system can be used for the previous high-concurrency consensus, verification, and read/write operation.
- FIG. 1 is a flowchart illustrating a blockchain-based data migration method, according to an example implementation of the present specification.
- a storage architecture of a blockchain node device includes a first storage system and a second storage system interconnected with the first storage system. The method includes the following steps:
- Step 102 Receive the latest block of a blockchain, and store the latest block in the first storage system of the node device.
- Step 104 Determine whether a migration trigger event for block data stored in the first storage system is detected.
- Step 106 Migrate block data that is stored in the first storage system, and that exists before migration reference time to the second storage system in response to the detected migration trigger event, where the second storage system is a distributed storage system that includes cluster nodes.
- the first storage system described in the present specification is a storage system that is connected to a blockchain network, and that is configured to perform any data operation (including a consensus, verification, and read/write operation) on the blockchain.
- a centralized storage architecture with a relatively high-performance configuration (such as high bandwidth, a high processing rate, and a large capacity) is usually selected as the first storage system.
- the centralized storage architecture can be a single high-performance host, a distributed architecture in which a single high-performance host is used as a central node for centralized processing, and a shared disk-based SMP architecture of multiple high-performance hosts.
- the first storage system described in the present specification is not limited to the centralized storage architecture. Any storage system that is capable of storing and processing data and various services on the blockchain, such as a distributed storage system, can be referred to as the first storage system.
- the second storage system described in the present specification is a storage system that is connected to the first storage system, and that receives data migrated from the first storage system to share storage pressure of the first storage system.
- a person skilled in the art knows that because the blockchain system runs in a corresponding consensus mechanism, data that has been recorded in a blockchain database is difficult to be tampered with by a random node. For example, to tamper existing data on a blockchain that uses a POW consensus mechanism, an attack of at least 51% of a total hash rate is needed. Therefore, the blockchain system is characterized by incomparable data security insurance, anti-attack, and tamper-resistance.
- a distributed storage system is usually selected as the second storage system that receives an existing block migrated from the first storage system.
- the distributed storage system can include multiple cluster nodes with relatively low-performance configurations, and is configured to store only an existing block of the blockchain.
- the second storage system can be a storage system of a Shared Nothing-based MPP architecture.
- the block data that exists before the migration reference time is migrated to the second storage system based on the detected migration trigger event for the block data stored in the first storage system.
- the block data described in the implementations of the present specification includes the entire data in blocks of the blockchain.
- the block data should further include the index data corresponding to each block.
- the index data usually includes content such as a block digest value (hash value) index, a transaction digest value (hash value) index, and a historical transaction status data index for each block.
- Historical transaction status data is a historical value of a transaction status on the blockchain, for example, a total balance value of an on-chain account corresponding to a specific block.
- the block data migration described in the present specification can include overall migration of all data in a block and further include migration of index data corresponding to the block with the block.
- the migration reference time can be physical time, for example, a specific moment or timestamp, or can be logical time, namely, a logical value that has a positive correlation with the physical time.
- a timestamp of the moment is also recorded. Therefore, a block height value of the blockchain is logical data that has a positive correlation with the physical time, and the block height value is the logical time.
- the blockchain-based data migration method when triggered by a related migration trigger event, existing block data that is in a first storage system for processing a blockchain service and that exists before migration reference time is migrated to a second storage system, to release more storage space for the first storage system, so that the first storage system can more optimally perform various data operations generated on a blockchain, such as a high-concurrency consensus, verification, and read/write operation.
- a tamper-resistance mechanism of the blockchain data that has been recorded in a historical block cannot be deleted or modified, and data cannot be added to the historical block, and therefore only a read operation can be performed on the block data migrated to the second storage system. Therefore, a hardware device resource with a relatively low-performance configuration can be selected to deploy the second storage system, to reduce system costs.
- the second storage system described in the present specification is a distributed storage system that includes several cluster nodes.
- a specific architecture type of the first storage system or the second storage system is not limited. Any technical solution of migrating block data of a blockchain from a first storage system to a second storage system in consideration of processing rate improvement or cost reduction shall fall within the protection scope of the present specification.
- the blockchain can be specifically a consortium chain formed by organizations used as consortium members.
- a consensus mechanism selected for the consortium chain is relatively flexible, and the time for confirming transaction data on the chain is relatively short. Therefore, a block generation rate of the consortium chain is faster than that of a public chain (for example, a bitcoin blockchain).
- the consortium node needs to process a high-concurrency consensus, verification, and transaction data write operation. Therefore, compared with a common node (a light node) on the consortium chain, a service processing operation of the consortium member node imposes a higher requirement on a storage system of the consortium member node.
- the blockchain-based data migration method described in the previous implementation is more applicable to the consortium member node of the consortium chain.
- a target transaction (transfer) described in the present specification means that a user creates a piece of data by using a client of a blockchain, and finally publishes the data to a distributed database of the blockchain.
- Transactions on the blockchain include both the narrow-sense transaction and the broad-sense transaction.
- the narrow-sense transaction is a value transfer published by the user to the blockchain.
- a transaction can be a transfer initiated by the user on the blockchain.
- the broad-sense transaction means that the user publishes service data to the blockchain with a service intention.
- an operator can establish a consortium chain based on an actual service requirement, and deploy some other types of value transfer-unrelated online services (such as a rental service, a vehicle scheduling service, an insurance claims service, a credit service, and a medical service) based on the consortium chain.
- a transaction can be that the user publishes a service message or a service request to the consortium chain for a service intention.
- the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether specified data in the block data stored in the first storage system satisfies a predetermined data migration trigger rule.
- the data migration trigger rule can include that a data capacity of the specified data in the block data stored in the first storage system is greater than a predetermined threshold; or that a capacity ratio of a data capacity of the specified data in the block data stored in the first storage system to a total data capacity of the first storage system is greater than a predetermined threshold.
- the specified data used for trigger rule determining can include one or more of total data, transaction digest value data, block digest value data, and historical status data in the block.
- a migration operation is initiated, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- the block data here includes total data of each block or total data of each block and index data related to the total data of each block.
- the migration reference time is a specific block height value
- migration of block data that exists before the block height value can be directly initiated.
- the migration reference time is a specific physical time (for example, time point or timestamp)
- the physical time can be converted into a specific block height value, and then migration of bock data that exists before the block height value is initiated.
- a capacity of the transaction digest value data of the blockchain in the first storage system exceeds the threshold or whether a capacity ratio of the transaction digest value data to the total data capacity of the first storage system exceeds the predetermined threshold is queried. If yes, a migration operation is initiated, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- other specified data in the blockchain database can also be used as a monitoring object specified in the migration trigger rule. For example, a capacity or capacity ratio of the previous historical status data is monitored, to trigger a migration operation.
- the data migration trigger rule and the migration trigger operation are usually specified and executed by a computer program. It can be understood that an execution program that the data migration trigger rule is specified for can be deployed inside the blockchain node device to monitor a storage status of the first storage system, so that the execution program can be executed based on the migration trigger rule; or can be deployed in a distributed account book of the blockchain, so that the execution program can be invoked and executed in a form of a smart contract.
- a data migration rule (or data migration logic) that is applicable to some or all node devices of the blockchain can be claimed in the smart contract.
- a data migration rule (or data migration logic) that is applicable to multiple consortium members can be deployed on the blockchain in the form of the smart contract.
- the computer program when the computer program performs the corresponding migration operation in response to the detected migration trigger event for the block data stored in the first storage system, the computer program can invoke a data migration utility in the blockchain to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- a migration instruction of the invoked data migration utility can include content such as an identifier of a source storage system (for example, an identifier of the first storage system), an identifier of a target storage system (for example, an identifier of the second storage system), a migrated-data type (for example, a block, a transaction digest value, a block digest value, or historical status data), and a migration boundary threshold (for example, a migrated-block height threshold determined based on the migration reference time).
- a source storage system for example, an identifier of the first storage system
- an identifier of a target storage system for example, an identifier of the second storage system
- a migrated-data type for example, a block, a transaction digest value, a block digest value, or historical status data
- a migration boundary threshold for example, a migrated-block height threshold determined based on the migration reference time
- Migrate epoch1 block 1000000 to epoch0 (epoch 1 is the first storage system, epoch 0 is the second storage system, the migrated-data type is a block, and the migration boundary threshold is 1000000).
- the blockchain system can more easily learn a location and a query path of migrated data, thereby facilitating a subsequent read operation.
- the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether a migration instruction for the block data stored in the first storage system is received; and if yes, determining that the migration trigger event for the block data stored in the first storage system is detected.
- “Migration instruction” can be implemented in multiple ways.
- the instruction can be a migration instruction that is actively entered based on an existing status of the first storage system by a user of the blockchain node device that the first storage system is located in, or can be a migration instruction that is triggered after the blockchain node device invokes some other system programs or a related smart contract program. This is not limited in the present specification.
- the migration instruction can be a migration instruction that is triggered when the data migration utility in the blockchain is invoked. Details are omitted here. It is worthwhile to note that the migration instruction can include the data migration reference time, to explicitly migrate block data that satisfies a data migration reference time requirement to the second storage system.
- the second storage system should predetermine some storage rules, to read the stored block data in a relatively optimized way.
- FIG. 2 is a schematic diagram illustrating the allocation of the migrated block data in the second storage system, according to an example implementation of the present specification.
- the blockchain is a consortium chain architecture, and the consortium chain has M consortium members.
- the M consortium members are responsible for verifying on-chain data based on a consensus mechanism of the consortium chain, and recording data that conforms to a consensus result in blocks of the consortium chain.
- the first storage system and the second storage system are corresponding to a node device that consortium member A of the consortium chain is located.
- the first storage system is configured to store and process related data of consortium member A of the blockchain, including but not limited to performing concurrent read/write, consensus verification, recording, and accounting on the block data.
- blocks in the first storage system that exist before the migration reference time are migrated to the second storage system. If existing blocks in the first storage system start from height value 5001, blocks that exist before block height 10000 (migration reference time) are migrated to the second storage system.
- the second storage system shown in FIG. 2 uses a Shared Nothing-based MPP architecture, and includes a coordinator node node 0 and storage cluster nodes node 1 to node N.
- a storage device with relatively low costs, or even a common PC can be selected as a cluster node device of the second storage system.
- a way of allocating the migrated blocks to the cluster nodes of the second storage system can be specified by the coordinator node node 0 based on a specific service requirement. For example, the blocks (whose block heights are 5001 to 10000) of the blockchain that are migrated to the second storage system can be successively allocated to the cluster nodes of the second storage system.
- a block whose block height is 5001 is allocated to node 1
- a block whose block height is 5002 is allocated to node 2
- a block whose block height is 5003 is allocated to node 3, and so on.
- a block whose height value is H is allocated to the [(H ⁇ 5000) mod (N)]th cluster node.
- adjacent blocks in the consortium chain generally include interrelated service data
- adjacent blocks can be stored in a same storage cluster node as many as possible, that is, the migrated block data is allocated to the cluster nodes of the second storage system in the following way: migrating the block data that is of the blockchain and that is migrated to the second storage system to node 1 of the second storage system in ascending order of block heights; migrating remaining blocks in the current migration operation to node 2 in ascending order of block heights when a storage capacity of node 1 exceeds a predetermined capacity threshold; migrating remaining blocks in the current migration operation to node 3 of the second storage system in ascending order of block heights when a storage capacity of node 2 exceeds the predetermined capacity threshold; and so on.
- the storage way further facilitates the reading of related historical service data by a user and further improves processing efficiency.
- the coordinator node node 0 is configured to coordinate and record allocation of the blocks of the blockchain that are migrated to the second storage system to the storage cluster nodes of the second storage system.
- the previous recording method can be specifically establishing an index table that includes index content such as a block data storage location (namely, an identifier or a location of a cluster node device of the second storage system), block data content (or a block data type), a block height value, a transaction digest value (TX hash), or a block digest value (Block hash).
- the coordinator node node 0 After receiving a read instruction, the coordinator node node 0 parses the read instruction to obtain a corresponding index object, and obtains a block data storage location (namely, a cluster node device that the block data belong to) from the index table based on a value of the index object, to read content corresponding to the instruction from the cluster node device.
- a block data storage location namely, a cluster node device that the block data belong to
- each of the M consortium members processes a related service on the blockchain, and stores data that is obtained by the consortium members by consensus in the consortium chain.
- Each consortium member stores all data obtained after consensus verification in a node device corresponding to the consortium member.
- a consensus mechanism of the consortium chain is usually set to be relatively flexible, and a service or transaction corresponding to the consortium chain is usually a high-frequency event. Therefore, a storage resource with a large capacity and a high configuration needs to be provided.
- consortium member A when the quantity N of storage cluster nodes of the second storage system is far greater than the quantity M of members in the consortium chain, all data that is collected by the M member nodes on the chain can be distributed in the N cluster node devices for storage. It greatly relieves data storage and processing pressure of the first storage system of consortium member A.
- Data migration logic that should be initiated when a migration trigger rule is satisfied can be claimed in the smart contract, so that each consortium party node device invokes the smart contract when a predetermined migration trigger rule is satisfied, to initiate the data migration logic claimed in the smart contract.
- the data migration logic can be the previous specific data migration method for migrating block data from a first storage system of a node device to a second storage system or can be a centralized data migration instruction.
- each consortium member node After receiving the data migration instruction, each consortium member node performs data migration based on a migration rule (including an allocation rule of migrated data in a second storage system) that is claimed in a migration program determined for each consortium member node, to ensure that each consortium member in the consortium chain system can effectively, continuously, and independently migrate historical block data, thereby improving service processing efficiency of the entire consortium chain.
- a migration rule including an allocation rule of migrated data in a second storage system
- an implementation of the present specification further provides a blockchain-based data migration apparatus.
- the apparatus can be implemented by software, can be implemented by hardware, or can be implemented by a combination of hardware and software.
- the software implementation is used as an example.
- the apparatus is formed after a CPU (Central Processing Unit) in a device that the apparatus is located in reads a corresponding computer program instruction to memory for running.
- the device that the blockchain-based data migration apparatus is located in usually further includes at least one of other hardware such as a chip for sending/receiving a radio signal, and a card for implementing a network communication function.
- FIG. 3 shows a blockchain-based data migration apparatus 30 provided in the present specification.
- the apparatus 30 is used by a blockchain node device to store data
- a storage architecture of the blockchain node device includes a first storage system and a second storage system interconnected with the first storage system, and the apparatus includes:
- an acquisition unit 302 configured to receive the latest block of a blockchain, and store the latest block in the first storage system
- a determining unit 304 configured to determine whether a migration trigger event for block data stored in the first storage system is detected
- a migration execution unit 306 configured to migrate block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event.
- the first storage system is a centralized storage system
- the second storage system is a distributed storage system that includes cluster nodes.
- the determining unit 304 is specifically configured to:
- the determining unit 304 is specifically configured to:
- the second storage system includes a coordinator node and storage cluster nodes, and the coordinator node is configured to coordinate the allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- the blockchain is a consortium chain.
- the determining unit 302 and the migration execution unit 304 are specifically configured to invoke a smart contract corresponding to data migration of the blockchain and execute data migration logic claimed in the smart contract, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- references can be made to an implementation process of the corresponding steps in the previous method.
- references can be made to some descriptions in the method implementation. Details are omitted here.
- the previous apparatus implementation is merely an example.
- the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical modules, in other words, can be located in one position, or can be distributed on multiple network modules. Some or all of the units or modules can be selected based on actual requirements to achieve the objectives of the solutions of the present specification. A person of ordinary skill in the art can understand and implement the implementations of the present application without creative efforts.
- the apparatus and unit illustrated in the previous implementation can be specifically implemented by a computer chip or an entity, or can be implemented by a product with a certain function.
- a typical implementation device is a computer, and the computer can be specifically a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email sending/receiving device, a game console, a tablet computer, a wearable device, or any combination of these devices.
- an implementation of the present specification further provides a computer device.
- the computer device includes a memory and a processor.
- the memory stores a computer program that can be run by the processor, and the processor performs the steps of the blockchain-based data migration method in the implementations of the present specification when running the stored computer program.
- the steps of the blockchain-based data migration method references can be made to the previous content. Details are not repeated.
- an implementation of the present specification further provides a computer-readable storage medium.
- the storage medium stores a computer program, and the steps of the blockchain-based data migration method in the implementations of the present specification are performed when the computer program is run by a processor.
- steps of the blockchain-based data migration method references can be made to the previous content. Details are not repeated.
- a computing device includes one or more processors (CPUs), an input/output interface, a network interface, and a memory.
- the memory can include a non-persistent memory, a random access memory (RAM), a nonvolatile memory, and/or another form of memory in computer-readable media, for example, a read-only memory (ROM) or a flash random access memory (flash RAM).
- RAM random access memory
- flash RAM flash random access memory
- the memory is an example of a computer-readable medium.
- the computer-readable medium includes persistent, non-persistent, movable, and unmovable media that can store information by using any method or technology.
- the information can be a computer-readable instruction, a data structure, a program module, or other data.
- Examples of the computer storage medium include but are not limited to a phase-change random access memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), another type of random access memory (RAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory or another memory technology, a compact disc read-only memory (CD-ROM), a digital versatile disc (DVD) or another optical storage, a magnetic cassette, a magnetic tape, a magnetic disk memory or another magnetic storage device, or any other non-transmission medium that can be used to store information accessible to the computing device.
- the computer-readable medium does not include computer-readable transitory media (transitory media), such as a modulated data signal and carrier.
- the terms “include”, “comprise”, or their any other variants are intended to cover a non-exclusive inclusion, so that a process, a method, a product, or a device that includes a list of elements not only includes those elements but also includes other elements that are not expressly listed, or further includes elements inherent to such process, method, product, or device. Without more constraints, an element preceded by “includes a . . . ” does not preclude the existence of additional identical elements in the process, method, product, or device that includes the element.
- implementations of the present application can be provided as a method, a system, or a computer program product. Therefore, the implementations of the present specification can use a form of hardware only implementations, software only implementations, or implementations with a combination of software and hardware. Moreover, the implementations of the present specification can use a form of a computer program product that is implemented on one or more computer-usable storage media (including but not limited to a magnetic disk memory, a CD-ROM, an optical memory, etc.) that include computer-usable program code.
- computer-usable storage media including but not limited to a magnetic disk memory, a CD-ROM, an optical memory, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Business, Economics & Management (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Power Engineering (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
- This application is a continuation of U.S. patent application Ser. No. 16/427,032, filed on May 30, 2019, which claims priority to Chinese Patent Application No. 201810553077.X, filed on May 31, 2018, and each application is hereby incorporated by reference in its entirety.
- The present specification relates to the field of network communications technologies, and in particular, to a blockchain-based data migration method and apparatus.
- The blockchain technology is also referred to as the distributed account book technology, and is an emerging technology in which computing devices jointly participate in “accounting” and jointly maintain a complete distributed database. The blockchain technology is characterized by decentralization, openness, and transparency. Each computing device can participate in database recording as a blockchain node device, and data synchronization can be quickly performed between computing devices. Each blockchain node device usually needs to process a high-concurrency consensus, verification, and read/write operation in a blockchain system. With an increase in the number of “accounting” blocks, incremental block data storage gradually affects a memory response speed, and further affects response efficiency of the node device to the high-concurrency consensus, verification, and read/write operation.
- To resolve the previous problem, the present specification provides a blockchain-based data migration method. The method is used by a blockchain node device to store data, a storage architecture of the blockchain node device includes a first storage system and a second storage system interconnected with the first storage system, and the method includes: receiving the latest block of a blockchain, and storing the latest block in the first storage system; determining whether a migration trigger event for block data stored in the first storage system is detected; and migrating block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event.
- Preferably, the first storage system is a centralized storage system, and the second storage system is a distributed storage system that includes cluster nodes.
- Preferably, the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether specified data stored in the first storage system satisfies a predetermined data migration trigger rule; and if yes, determining that the migration trigger event for the block data stored in the first storage system is detected.
- Preferably, the data migration trigger rule includes: a data capacity of the specified data stored in the first storage system exceeds a predetermined threshold; or a capacity ratio of a data capacity of the specified data stored in the first storage system to a total data capacity of the first storage system exceeds a predetermined threshold.
- Preferably, the specified data includes one or more of total data, transaction digest value data, block digest value data, and historical status data in the block.
- Preferably, the migrating block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event includes: invoking a data migration utility in the blockchain to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system, in response to the detected migration trigger event for the block data stored in the first storage system.
- Preferably, the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether a migration instruction for the block data stored in the first storage system is received; and if yes, determining that the migration trigger event for the block data stored in the first storage system is detected.
- Preferably, the migration instruction includes the specified data migration reference time.
- Preferably, the second storage system includes a coordinator node and storage cluster nodes, and the coordinator node is configured to coordinate allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- Preferably, the coordinating allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system includes: successively allocating the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- Preferably, the coordinating allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system includes: migrating the block data that is of the blockchain and that is migrated to the second storage system to a first storage cluster node of the second storage system in ascending order of block heights; migrating remaining block data to a second storage cluster node of the second storage system in ascending order of block heights when a storage capacity of the first storage cluster node exceeds a predetermined capacity threshold; migrating remaining block data to a third storage cluster node of the second storage system in ascending order of block heights when a storage capacity of the second storage cluster node exceeds the predetermined capacity threshold; and so on.
- Preferably, the blockchain is a consortium chain.
- Preferably, the determining whether a migration trigger event for block data stored in the first storage system is detected; and migrating block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event includes: invoking a smart contract corresponding to data migration of the blockchain, and executing data migration logic claimed in the smart contract, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- Correspondingly, the present specification further provides a blockchain-based data migration apparatus. The apparatus is used by a blockchain node device to store data, a storage architecture of the blockchain node device includes a first storage system and a second storage system interconnected with the first storage system, and the apparatus includes: an acquisition unit, configured to receive the latest block of a blockchain, and store the latest block in the first storage system; a determining unit, configured to determine whether a migration trigger event for block data stored in the first storage system is detected; and a migration execution unit, configured to migrate block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event.
- Preferably, the first storage system is a centralized storage system, and the second storage system is a distributed storage system that includes cluster nodes.
- Preferably, the determining unit is specifically configured to: determine whether specified data stored in the first storage system satisfies a predetermined data migration trigger rule; and if yes, determine that the migration trigger event for the block data stored in the first storage system is detected.
- Preferably, the determining unit is specifically configured to: determine whether a migration instruction for the block data stored in the first storage system is received; and if yes, determine that the migration trigger event for the block data stored in the first storage system is detected.
- Preferably, the second storage system includes a coordinator node and storage cluster nodes, and the coordinator node is configured to coordinate allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- Preferably, the blockchain is a consortium chain.
- Preferably, the determining unit and the migration execution unit are specifically configured to: invoke a smart contract corresponding to data migration of the blockchain, and execute data migration logic claimed in the smart contract, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system.
- The present specification further provides a computer device, including a memory and a processor. The memory stores a computer program that can be run by the processor, and the processor performs the steps of the previous blockchain-based data migration method when running the computer program.
- The present specification further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and the steps of the previous blockchain-based data migration method are performed when the computer program is run by a processor.
- The blockchain-based data migration method and apparatus, the computer device, and the computer-readable storage medium that are provided above in the present specification are used by a blockchain node device to store data. Under triggering of a related migration trigger event, existing block data that is in a first storage system for processing a blockchain service and that exists before migration reference time is migrated to a second storage system, to release more storage space for the first storage system, so that the first storage system can more optimally perform various data operations generated on a blockchain, such as a high-concurrency consensus, verification, and read/write operation. Due to a tamper-resistance mechanism of the blockchain, data that has been recorded in a historical block cannot be deleted or modified, and data cannot be added to the historical block, and therefore only a read operation can be performed on the block data migrated to the second storage system. Therefore, a hardware device resource with a relatively low performance configuration can be selected to deploy the second storage system, to reduce system costs.
-
FIG. 1 is a flowchart illustrating a blockchain-based data migration method, according to an example implementation of the present specification; -
FIG. 2 is a schematic diagram illustrating data allocation in a second storage system, according to an example implementation of the present specification; -
FIG. 3 is a schematic diagram illustrating a blockchain-based data migration apparatus, according to an example implementation of the present specification; and -
FIG. 4 is a structural hardware diagram illustrating an implementation of a blockchain-based data migration method or apparatus, according to the present specification. - The “blockchain” described in the implementations provided in the present specification can be specifically a P2P network system that is achieved by node devices by using a consensus mechanism and that has a distributed data storage structure. Data in the blockchain is distributed in “blocks” that are connected to each other in terms of time. A current block includes a data digest of a previous block, and data of all or some nodes is completely backed up based on a specific consensus mechanism (for example, POW, POS, DPOS, or PBFT).
- Each node device (especially, a full node device) of the blockchain usually needs to process a high-concurrency consensus, verification, and read/write operation in the blockchain system. With an increase in the number of “accounting” blocks, incremental block data storage gradually affects a memory response speed, and further affects response efficiency of the node device to the high-concurrency consensus, verification, and read/write operation. The present specification aims to provide a blockchain-based data migration method or apparatus, to migrate a historical block from a first storage system of a node device to a second storage system, so that the first storage system can be used for the previous high-concurrency consensus, verification, and read/write operation.
-
FIG. 1 is a flowchart illustrating a blockchain-based data migration method, according to an example implementation of the present specification. A storage architecture of a blockchain node device includes a first storage system and a second storage system interconnected with the first storage system. The method includes the following steps: - Step 102: Receive the latest block of a blockchain, and store the latest block in the first storage system of the node device.
- Step 104: Determine whether a migration trigger event for block data stored in the first storage system is detected.
- Step 106: Migrate block data that is stored in the first storage system, and that exists before migration reference time to the second storage system in response to the detected migration trigger event, where the second storage system is a distributed storage system that includes cluster nodes.
- The first storage system described in the present specification is a storage system that is connected to a blockchain network, and that is configured to perform any data operation (including a consensus, verification, and read/write operation) on the blockchain. To satisfy a multi-node and high-concurrency service requirement of the blockchain, a centralized storage architecture with a relatively high-performance configuration (such as high bandwidth, a high processing rate, and a large capacity) is usually selected as the first storage system. The centralized storage architecture can be a single high-performance host, a distributed architecture in which a single high-performance host is used as a central node for centralized processing, and a shared disk-based SMP architecture of multiple high-performance hosts. With an increase in the number of blocks packaged on the blockchain, remaining storage space of the first storage system decreases gradually. Accordingly, data processing capability such as a block data consensus, verification, and read/write processing capability of the first storage system gradually decreases. It is worthwhile to understand that the first storage system described in the present specification is not limited to the centralized storage architecture. Any storage system that is capable of storing and processing data and various services on the blockchain, such as a distributed storage system, can be referred to as the first storage system.
- The second storage system described in the present specification is a storage system that is connected to the first storage system, and that receives data migrated from the first storage system to share storage pressure of the first storage system. A person skilled in the art knows that because the blockchain system runs in a corresponding consensus mechanism, data that has been recorded in a blockchain database is difficult to be tampered with by a random node. For example, to tamper existing data on a blockchain that uses a POW consensus mechanism, an attack of at least 51% of a total hash rate is needed. Therefore, the blockchain system is characterized by incomparable data security insurance, anti-attack, and tamper-resistance. An existing block that is recorded in each blockchain node device by consensus cannot be tampered with, and therefore only a read operation can be performed on the existing block. Therefore, a distributed storage system is usually selected as the second storage system that receives an existing block migrated from the first storage system. The distributed storage system can include multiple cluster nodes with relatively low-performance configurations, and is configured to store only an existing block of the blockchain. For example, the second storage system can be a storage system of a Shared Nothing-based MPP architecture.
- The block data that exists before the migration reference time is migrated to the second storage system based on the detected migration trigger event for the block data stored in the first storage system. The block data described in the implementations of the present specification includes the entire data in blocks of the blockchain. When index data created for all data in each block is further specified in the blockchain database, the block data should further include the index data corresponding to each block. The index data usually includes content such as a block digest value (hash value) index, a transaction digest value (hash value) index, and a historical transaction status data index for each block. Historical transaction status data is a historical value of a transaction status on the blockchain, for example, a total balance value of an on-chain account corresponding to a specific block. Therefore, the block data migration described in the present specification can include overall migration of all data in a block and further include migration of index data corresponding to the block with the block. The migration reference time can be physical time, for example, a specific moment or timestamp, or can be logical time, namely, a logical value that has a positive correlation with the physical time. When data of each block is packaged and recorded on the blockchain, a timestamp of the moment is also recorded. Therefore, a block height value of the blockchain is logical data that has a positive correlation with the physical time, and the block height value is the logical time.
- According to the blockchain-based data migration method provided in the previous implementation, when triggered by a related migration trigger event, existing block data that is in a first storage system for processing a blockchain service and that exists before migration reference time is migrated to a second storage system, to release more storage space for the first storage system, so that the first storage system can more optimally perform various data operations generated on a blockchain, such as a high-concurrency consensus, verification, and read/write operation. Due to a tamper-resistance mechanism of the blockchain, data that has been recorded in a historical block cannot be deleted or modified, and data cannot be added to the historical block, and therefore only a read operation can be performed on the block data migrated to the second storage system. Therefore, a hardware device resource with a relatively low-performance configuration can be selected to deploy the second storage system, to reduce system costs.
- The second storage system described in the present specification is a distributed storage system that includes several cluster nodes. In the present specification, a specific architecture type of the first storage system or the second storage system is not limited. Any technical solution of migrating block data of a blockchain from a first storage system to a second storage system in consideration of processing rate improvement or cost reduction shall fall within the protection scope of the present specification.
- In an implementation shown in the present specification, the blockchain can be specifically a consortium chain formed by organizations used as consortium members. A consensus mechanism selected for the consortium chain is relatively flexible, and the time for confirming transaction data on the chain is relatively short. Therefore, a block generation rate of the consortium chain is faster than that of a public chain (for example, a bitcoin blockchain). In addition, because a consortium node of the consortium chain participates in the accounting of blocks, the consortium node needs to process a high-concurrency consensus, verification, and transaction data write operation. Therefore, compared with a common node (a light node) on the consortium chain, a service processing operation of the consortium member node imposes a higher requirement on a storage system of the consortium member node. The blockchain-based data migration method described in the previous implementation is more applicable to the consortium member node of the consortium chain.
- It is worthwhile to note that a target transaction (transfer) described in the present specification means that a user creates a piece of data by using a client of a blockchain, and finally publishes the data to a distributed database of the blockchain. Transactions on the blockchain include both the narrow-sense transaction and the broad-sense transaction. The narrow-sense transaction is a value transfer published by the user to the blockchain. For example, in a conventional bitcoin blockchain network, a transaction can be a transfer initiated by the user on the blockchain. The broad-sense transaction means that the user publishes service data to the blockchain with a service intention. For example, an operator can establish a consortium chain based on an actual service requirement, and deploy some other types of value transfer-unrelated online services (such as a rental service, a vehicle scheduling service, an insurance claims service, a credit service, and a medical service) based on the consortium chain. In such a consortium chain, a transaction can be that the user publishes a service message or a service request to the consortium chain for a service intention.
- In an implementation shown in the present specification, the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether specified data in the block data stored in the first storage system satisfies a predetermined data migration trigger rule. Specifically, the data migration trigger rule can include that a data capacity of the specified data in the block data stored in the first storage system is greater than a predetermined threshold; or that a capacity ratio of a data capacity of the specified data in the block data stored in the first storage system to a total data capacity of the first storage system is greater than a predetermined threshold. Based on a type of data included in the block data, the specified data used for trigger rule determining can include one or more of total data, transaction digest value data, block digest value data, and historical status data in the block.
- For example, whether a total data capacity of existing blocks of the blockchain in the first storage system exceeds the predetermined threshold is queried. If yes, a migration operation is initiated, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system. The block data here includes total data of each block or total data of each block and index data related to the total data of each block. When the migration reference time is a specific block height value, migration of block data that exists before the block height value can be directly initiated. When the migration reference time is a specific physical time (for example, time point or timestamp), the physical time can be converted into a specific block height value, and then migration of bock data that exists before the block height value is initiated.
- For another example, when related index data is further specified in the blockchain database, for a blockchain that uses a transaction as a main service form, whether a capacity of the transaction digest value data of the blockchain in the first storage system exceeds the threshold or whether a capacity ratio of the transaction digest value data to the total data capacity of the first storage system exceeds the predetermined threshold is queried. If yes, a migration operation is initiated, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system. Similarly, other specified data in the blockchain database can also be used as a monitoring object specified in the migration trigger rule. For example, a capacity or capacity ratio of the previous historical status data is monitored, to trigger a migration operation.
- The data migration trigger rule and the migration trigger operation are usually specified and executed by a computer program. It can be understood that an execution program that the data migration trigger rule is specified for can be deployed inside the blockchain node device to monitor a storage status of the first storage system, so that the execution program can be executed based on the migration trigger rule; or can be deployed in a distributed account book of the blockchain, so that the execution program can be invoked and executed in a form of a smart contract. A data migration rule (or data migration logic) that is applicable to some or all node devices of the blockchain can be claimed in the smart contract. In particular, for consortium nodes of a consortium chain, a data migration rule (or data migration logic) that is applicable to multiple consortium members can be deployed on the blockchain in the form of the smart contract. When the data in the first storage system satisfies the migration trigger logic claimed in the previous smart contract, the smart contract automatically triggers data migration.
- It is worthwhile to note that, when the computer program performs the corresponding migration operation in response to the detected migration trigger event for the block data stored in the first storage system, the computer program can invoke a data migration utility in the blockchain to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system. A migration instruction of the invoked data migration utility can include content such as an identifier of a source storage system (for example, an identifier of the first storage system), an identifier of a target storage system (for example, an identifier of the second storage system), a migrated-data type (for example, a block, a transaction digest value, a block digest value, or historical status data), and a migration boundary threshold (for example, a migrated-block height threshold determined based on the migration reference time). For example:
- Migrate epoch1 block 1000000 to epoch0 (
epoch 1 is the first storage system,epoch 0 is the second storage system, the migrated-data type is a block, and the migration boundary threshold is 1000000). - Compared with a case in which an external program of the blockchain is invoked to perform the block data migration operation, when the data migration utility program in the blockchain database is used to perform the data migration operation, the blockchain system can more easily learn a location and a query path of migrated data, thereby facilitating a subsequent read operation.
- In another shown implementation, the determining whether a migration trigger event for block data stored in the first storage system is detected includes: determining whether a migration instruction for the block data stored in the first storage system is received; and if yes, determining that the migration trigger event for the block data stored in the first storage system is detected. “Migration instruction” can be implemented in multiple ways. For example, the instruction can be a migration instruction that is actively entered based on an existing status of the first storage system by a user of the blockchain node device that the first storage system is located in, or can be a migration instruction that is triggered after the blockchain node device invokes some other system programs or a related smart contract program. This is not limited in the present specification. Alternatively, the migration instruction can be a migration instruction that is triggered when the data migration utility in the blockchain is invoked. Details are omitted here. It is worthwhile to note that the migration instruction can include the data migration reference time, to explicitly migrate block data that satisfies a data migration reference time requirement to the second storage system.
- Because the block data is migrated from the first storage system to the second storage system in an incremental migration mode, in other words, an amount of stored data migrated from the first storage system to the second storage system gradually increases with time, the second storage system should predetermine some storage rules, to read the stored block data in a relatively optimized way.
-
FIG. 2 is a schematic diagram illustrating the allocation of the migrated block data in the second storage system, according to an example implementation of the present specification. In this implementation, the blockchain is a consortium chain architecture, and the consortium chain has M consortium members. In the consortium chain, the M consortium members are responsible for verifying on-chain data based on a consensus mechanism of the consortium chain, and recording data that conforms to a consensus result in blocks of the consortium chain. The first storage system and the second storage system are corresponding to a node device that consortium member A of the consortium chain is located. The first storage system is configured to store and process related data of consortium member A of the blockchain, including but not limited to performing concurrent read/write, consensus verification, recording, and accounting on the block data. After an execution program detects or a user manually detects a migration trigger event for the block data stored in the first storage system, blocks in the first storage system that exist before the migration reference time are migrated to the second storage system. If existing blocks in the first storage system start fromheight value 5001, blocks that exist before block height 10000 (migration reference time) are migrated to the second storage system. - The second storage system shown in
FIG. 2 uses a Shared Nothing-based MPP architecture, and includes acoordinator node node 0 and storagecluster nodes node 1 to node N. To reduce system costs, a storage device with relatively low costs, or even a common PC, can be selected as a cluster node device of the second storage system. A way of allocating the migrated blocks to the cluster nodes of the second storage system can be specified by thecoordinator node node 0 based on a specific service requirement. For example, the blocks (whose block heights are 5001 to 10000) of the blockchain that are migrated to the second storage system can be successively allocated to the cluster nodes of the second storage system. That is, a block whose block height is 5001 is allocated tonode 1, a block whose block height is 5002 is allocated tonode 2, a block whose block height is 5003 is allocated tonode 3, and so on. In other words, a block whose height value is H is allocated to the [(H−5000) mod (N)]th cluster node. - In another shown implementation, because adjacent blocks in the consortium chain generally include interrelated service data, to facilitate reading of the interrelated service data, adjacent blocks can be stored in a same storage cluster node as many as possible, that is, the migrated block data is allocated to the cluster nodes of the second storage system in the following way: migrating the block data that is of the blockchain and that is migrated to the second storage system to
node 1 of the second storage system in ascending order of block heights; migrating remaining blocks in the current migration operation tonode 2 in ascending order of block heights when a storage capacity ofnode 1 exceeds a predetermined capacity threshold; migrating remaining blocks in the current migration operation tonode 3 of the second storage system in ascending order of block heights when a storage capacity ofnode 2 exceeds the predetermined capacity threshold; and so on. The storage way further facilitates the reading of related historical service data by a user and further improves processing efficiency. - In the previous implementation, the
coordinator node node 0 is configured to coordinate and record allocation of the blocks of the blockchain that are migrated to the second storage system to the storage cluster nodes of the second storage system. The previous recording method can be specifically establishing an index table that includes index content such as a block data storage location (namely, an identifier or a location of a cluster node device of the second storage system), block data content (or a block data type), a block height value, a transaction digest value (TX hash), or a block digest value (Block hash). After receiving a read instruction, thecoordinator node node 0 parses the read instruction to obtain a corresponding index object, and obtains a block data storage location (namely, a cluster node device that the block data belong to) from the index table based on a value of the index object, to read content corresponding to the instruction from the cluster node device. - In the previous implementation provided in the present specification, each of the M consortium members processes a related service on the blockchain, and stores data that is obtained by the consortium members by consensus in the consortium chain. Each consortium member stores all data obtained after consensus verification in a node device corresponding to the consortium member. A consensus mechanism of the consortium chain is usually set to be relatively flexible, and a service or transaction corresponding to the consortium chain is usually a high-frequency event. Therefore, a storage resource with a large capacity and a high configuration needs to be provided. For consortium member A, when the quantity N of storage cluster nodes of the second storage system is far greater than the quantity M of members in the consortium chain, all data that is collected by the M member nodes on the chain can be distributed in the N cluster node devices for storage. It greatly relieves data storage and processing pressure of the first storage system of consortium member A.
- It can be learned that, when each of node devices that are corresponding to most consortium members in the consortium chain or corresponding to members responsible for verifying and recording data uses the data migration method provided in the present specification to continuously migrate historical blocks to a corresponding second storage system with a relatively low configuration in response to a migration trigger event, to relieve pressure of a first storage system that is responsible for all operations such as data consensus, verification, and recording on the blockchain, processing efficiency such as a throughput of the entire consortium chain can be further improved on the premise of cost reduction. Therefore, to centrally manage block data migration of all the consortium node devices, a smart contract can be deployed on the consortium chain. Data migration logic that should be initiated when a migration trigger rule is satisfied can be claimed in the smart contract, so that each consortium party node device invokes the smart contract when a predetermined migration trigger rule is satisfied, to initiate the data migration logic claimed in the smart contract. The data migration logic can be the previous specific data migration method for migrating block data from a first storage system of a node device to a second storage system or can be a centralized data migration instruction. After receiving the data migration instruction, each consortium member node performs data migration based on a migration rule (including an allocation rule of migrated data in a second storage system) that is claimed in a migration program determined for each consortium member node, to ensure that each consortium member in the consortium chain system can effectively, continuously, and independently migrate historical block data, thereby improving service processing efficiency of the entire consortium chain.
- It is worthwhile to note that a consensus algorithm and a specific consensus process that are used when the member node devices in the consortium chain perform consensus processing on transaction or service data released to the blockchain are not described in detail in the present specification. When implementing the technical solutions recorded in the present specification, a person skilled in the art can make references to recordings in related technologies.
- Corresponding to the previous implementation procedure, an implementation of the present specification further provides a blockchain-based data migration apparatus. The apparatus can be implemented by software, can be implemented by hardware, or can be implemented by a combination of hardware and software. The software implementation is used as an example. As a logical apparatus, the apparatus is formed after a CPU (Central Processing Unit) in a device that the apparatus is located in reads a corresponding computer program instruction to memory for running. In terms of hardware implementation, in addition to a CPU, a memory, and storage that are shown in
FIG. 4 , the device that the blockchain-based data migration apparatus is located in usually further includes at least one of other hardware such as a chip for sending/receiving a radio signal, and a card for implementing a network communication function. -
FIG. 3 shows a blockchain-baseddata migration apparatus 30 provided in the present specification. Theapparatus 30 is used by a blockchain node device to store data, a storage architecture of the blockchain node device includes a first storage system and a second storage system interconnected with the first storage system, and the apparatus includes: - an
acquisition unit 302, configured to receive the latest block of a blockchain, and store the latest block in the first storage system; - a determining
unit 304, configured to determine whether a migration trigger event for block data stored in the first storage system is detected; and - a
migration execution unit 306, configured to migrate block data that is stored in the first storage system and that exists before migration reference time to the second storage system in response to the detected migration trigger event. - Preferably, the first storage system is a centralized storage system, and the second storage system is a distributed storage system that includes cluster nodes.
- Preferably, the determining
unit 304 is specifically configured to: - determine whether specified data stored in the first storage system satisfies a predetermined data migration trigger rule; and if yes, determine that the migration trigger event for the block data stored in the first storage system is detected.
- Preferably, the determining
unit 304 is specifically configured to: - determine whether a migration instruction for the block data stored in the first storage system is received; and if yes, determine that the migration trigger event for the block data stored in the first storage system is detected.
- Preferably, the second storage system includes a coordinator node and storage cluster nodes, and the coordinator node is configured to coordinate the allocation of the block data that is of the blockchain and that is migrated to the second storage system to the storage cluster nodes of the second storage system.
- Preferably, the blockchain is a consortium chain.
- Preferably, the determining
unit 302 and themigration execution unit 304 are specifically configured to invoke a smart contract corresponding to data migration of the blockchain and execute data migration logic claimed in the smart contract, to migrate the block data that is stored in the first storage system and that exists before the migration reference time to the second storage system. - For an implementation process of functions of the units in the apparatus, references can be made to an implementation process of the corresponding steps in the previous method. For related parts, references can be made to some descriptions in the method implementation. Details are omitted here.
- The previous apparatus implementation is merely an example. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical modules, in other words, can be located in one position, or can be distributed on multiple network modules. Some or all of the units or modules can be selected based on actual requirements to achieve the objectives of the solutions of the present specification. A person of ordinary skill in the art can understand and implement the implementations of the present application without creative efforts.
- The apparatus and unit illustrated in the previous implementation can be specifically implemented by a computer chip or an entity, or can be implemented by a product with a certain function. A typical implementation device is a computer, and the computer can be specifically a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email sending/receiving device, a game console, a tablet computer, a wearable device, or any combination of these devices.
- Corresponding to the previous method implementation, an implementation of the present specification further provides a computer device. The computer device includes a memory and a processor. The memory stores a computer program that can be run by the processor, and the processor performs the steps of the blockchain-based data migration method in the implementations of the present specification when running the stored computer program. For detailed descriptions of the steps of the blockchain-based data migration method, references can be made to the previous content. Details are not repeated.
- Corresponding to the previous method implementation, an implementation of the present specification further provides a computer-readable storage medium. The storage medium stores a computer program, and the steps of the blockchain-based data migration method in the implementations of the present specification are performed when the computer program is run by a processor. For detailed descriptions of the steps of the blockchain-based data migration method, references can be made to the previous content. Details are not repeated.
- The previous descriptions are merely example implementations of the present specification, but are not intended to limit the present specification. Any modification, equivalent replacement, improvement, etc. made without departing from the spirit and principle of the present specification shall fall within the protection scope of the present specification.
- In a typical configuration, a computing device includes one or more processors (CPUs), an input/output interface, a network interface, and a memory.
- The memory can include a non-persistent memory, a random access memory (RAM), a nonvolatile memory, and/or another form of memory in computer-readable media, for example, a read-only memory (ROM) or a flash random access memory (flash RAM). The memory is an example of a computer-readable medium.
- The computer-readable medium includes persistent, non-persistent, movable, and unmovable media that can store information by using any method or technology. The information can be a computer-readable instruction, a data structure, a program module, or other data.
- Examples of the computer storage medium include but are not limited to a phase-change random access memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), another type of random access memory (RAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory or another memory technology, a compact disc read-only memory (CD-ROM), a digital versatile disc (DVD) or another optical storage, a magnetic cassette, a magnetic tape, a magnetic disk memory or another magnetic storage device, or any other non-transmission medium that can be used to store information accessible to the computing device. Based on the definition in the present specification, the computer-readable medium does not include computer-readable transitory media (transitory media), such as a modulated data signal and carrier.
- It is worthwhile to further note that, the terms “include”, “comprise”, or their any other variants are intended to cover a non-exclusive inclusion, so that a process, a method, a product, or a device that includes a list of elements not only includes those elements but also includes other elements that are not expressly listed, or further includes elements inherent to such process, method, product, or device. Without more constraints, an element preceded by “includes a . . . ” does not preclude the existence of additional identical elements in the process, method, product, or device that includes the element.
- A person skilled in the art should understand that the implementations of the present application can be provided as a method, a system, or a computer program product. Therefore, the implementations of the present specification can use a form of hardware only implementations, software only implementations, or implementations with a combination of software and hardware. Moreover, the implementations of the present specification can use a form of a computer program product that is implemented on one or more computer-usable storage media (including but not limited to a magnetic disk memory, a CD-ROM, an optical memory, etc.) that include computer-usable program code.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/869,298 US20200265009A1 (en) | 2018-05-31 | 2020-05-07 | Blockchain-based data migration method and apparatus |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810553077.X | 2018-05-31 | ||
CN201810553077.XA CN108829350B (en) | 2018-05-31 | 2018-05-31 | Data migration method and device based on block chain |
US16/427,032 US10649953B2 (en) | 2018-05-31 | 2019-05-30 | Blockchain-based data migration method and apparatus |
US16/869,298 US20200265009A1 (en) | 2018-05-31 | 2020-05-07 | Blockchain-based data migration method and apparatus |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/427,032 Continuation US10649953B2 (en) | 2018-05-31 | 2019-05-30 | Blockchain-based data migration method and apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
US20200265009A1 true US20200265009A1 (en) | 2020-08-20 |
Family
ID=64146998
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/427,032 Active US10649953B2 (en) | 2018-05-31 | 2019-05-30 | Blockchain-based data migration method and apparatus |
US16/869,298 Abandoned US20200265009A1 (en) | 2018-05-31 | 2020-05-07 | Blockchain-based data migration method and apparatus |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/427,032 Active US10649953B2 (en) | 2018-05-31 | 2019-05-30 | Blockchain-based data migration method and apparatus |
Country Status (6)
Country | Link |
---|---|
US (2) | US10649953B2 (en) |
EP (1) | EP3701706B1 (en) |
CN (1) | CN108829350B (en) |
SG (1) | SG11202004641PA (en) |
TW (1) | TWI710978B (en) |
WO (1) | WO2019231954A1 (en) |
Families Citing this family (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109754251B (en) * | 2018-12-27 | 2022-02-01 | 石更箭数据科技(上海)有限公司 | Data processing method and device, medium and terminal thereof |
CN109710617B (en) * | 2018-12-29 | 2021-07-30 | 杭州趣链科技有限公司 | Secure data transaction method based on Mercker certification |
CN111447055B (en) * | 2019-01-17 | 2022-02-25 | 华为技术有限公司 | Block chain account book storage method and device |
CN110058968A (en) * | 2019-04-17 | 2019-07-26 | 深圳市先河***技术有限公司 | Control method, system and the relevant device of decentralization storage |
US10990705B2 (en) * | 2019-04-18 | 2021-04-27 | Advanced New Technologies Co., Ltd. | Index creation for data records |
CN110209736A (en) * | 2019-05-06 | 2019-09-06 | 深圳壹账通智能科技有限公司 | Device, method and the storage medium of block chain data processing |
CN110278246B (en) * | 2019-05-23 | 2021-09-14 | 创新先进技术有限公司 | Certificate storage service transfer method, device and equipment for alliance chain |
CN110347660B (en) * | 2019-06-28 | 2020-08-11 | 阿里巴巴集团控股有限公司 | Block chain based hierarchical storage method and device and electronic equipment |
US10789222B2 (en) | 2019-06-28 | 2020-09-29 | Alibaba Group Holding Limited | Blockchain-based hierarchical data storage |
US11036720B2 (en) | 2019-06-28 | 2021-06-15 | Advanced New Technologies Co., Ltd. | Blockchain-based hierarchical data storage |
US11934386B2 (en) * | 2019-09-02 | 2024-03-19 | Worldline | Migration of a data blockchain |
SG11202002027TA (en) * | 2019-09-12 | 2020-04-29 | Alibaba Group Holding Ltd | Log-structured storage systems |
CN112559484A (en) * | 2019-09-25 | 2021-03-26 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for managing data objects |
US11388010B2 (en) * | 2019-10-18 | 2022-07-12 | Arcblock, Inc. | Blockchain account migration |
CN111159195A (en) * | 2019-12-31 | 2020-05-15 | 余俊龙 | Data storage control method and equipment in block chain system |
CN111291022B (en) * | 2020-02-10 | 2024-01-05 | 刘翱天 | Data storage system based on block chain |
CN111309711A (en) * | 2020-03-13 | 2020-06-19 | 财付通支付科技有限公司 | Cross-block-chain data migration method, device, equipment and storage medium |
CN111680019B (en) * | 2020-04-29 | 2023-11-24 | 杭州趣链科技有限公司 | Block chain data expansion method and device |
EP4143689A4 (en) * | 2020-05-01 | 2023-11-08 | Coin Metrics Inc. | Blockchain network risk management universal blockchain data model |
CN111708835B (en) * | 2020-05-28 | 2023-04-25 | 西安纸贵互联网科技有限公司 | Block chain data storage method and device |
CN111737265B (en) * | 2020-07-24 | 2020-12-04 | 支付宝(杭州)信息技术有限公司 | Block data access method, block data storage method and device |
CN111949634A (en) * | 2020-08-07 | 2020-11-17 | 广州科创空间信息科技有限公司 | Method for synchronously migrating block chain data |
JP7421443B2 (en) * | 2020-08-11 | 2024-01-24 | 株式会社日立製作所 | Data migration methods, data migration systems, and nodes |
US11449478B2 (en) | 2020-10-08 | 2022-09-20 | Kyndryl, Inc. | Blockchain implemented data migration audit trail |
CN112488833A (en) * | 2020-11-24 | 2021-03-12 | 成都质数斯达克科技有限公司 | Transaction processing method and device, electronic equipment and readable storage medium |
CN112540969B (en) * | 2020-11-26 | 2023-07-14 | 南京纯白矩阵科技有限公司 | Data migration method of intelligent contracts among heterogeneous block chains |
CN112395469A (en) * | 2020-11-27 | 2021-02-23 | ***股份有限公司 | Biological characteristic storage method, device, equipment and storage medium |
CN112507028B (en) * | 2020-12-18 | 2023-02-21 | 杭州趣链科技有限公司 | Data storage method, device, equipment and storage medium |
CN113467722B (en) * | 2021-07-26 | 2024-04-30 | 浙江大华技术股份有限公司 | Data migration method and device of distributed storage system |
CN113590265A (en) * | 2021-08-02 | 2021-11-02 | 杭州云象网络技术有限公司 | Method, medium, device and system for migrating alliance chain cluster environment |
CN113806335A (en) * | 2021-09-28 | 2021-12-17 | 杭州溪塔科技有限公司 | Data migration method and device applied to block chain |
CN114153827B (en) * | 2021-10-11 | 2023-01-10 | 北京天德科技有限公司 | Transaction data removing method based on block chain system |
CN114154606B (en) * | 2021-12-02 | 2024-03-15 | 杭州复杂美科技有限公司 | Identification code generation method, computer device, and storage medium |
CN113918513B (en) * | 2021-12-10 | 2022-03-08 | 北京百度网讯科技有限公司 | Data migration method, device, equipment and storage medium based on block chain |
CN114466067B (en) * | 2021-12-21 | 2023-08-04 | 天翼云科技有限公司 | Data migration method and device and electronic equipment |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006350599A (en) * | 2005-06-15 | 2006-12-28 | Hitachi Ltd | Storage system and data migration method thereof |
US8407190B2 (en) * | 2009-06-30 | 2013-03-26 | Commvault Systems, Inc. | Performing data storage operations with a cloud environment, including containerized deduplication, data pruning, and data transfer |
CN103019614B (en) * | 2011-09-23 | 2015-11-25 | 阿里巴巴集团控股有限公司 | Distributed memory system management devices and method |
TWI461929B (en) * | 2011-12-09 | 2014-11-21 | Promise Tecnnology Inc | Cloud data storage system |
TWI610166B (en) * | 2012-06-04 | 2018-01-01 | 飛康國際網路科技股份有限公司 | Automated disaster recovery and data migration system and method |
US10535063B2 (en) * | 2015-03-13 | 2020-01-14 | First Data Corporation | Systems and methods for securing digital gift cards with a public ledger |
US11488147B2 (en) * | 2015-07-14 | 2022-11-01 | Fmr Llc | Computationally efficient transfer processing and auditing apparatuses, methods and systems |
US20170031676A1 (en) * | 2015-07-27 | 2017-02-02 | Deja Vu Security, Llc | Blockchain computer data distribution |
CN107786339A (en) * | 2016-08-31 | 2018-03-09 | 陈新 | It is layered controllable alliance's block catenary system |
WO2018086015A1 (en) * | 2016-11-09 | 2018-05-17 | 弗洛格(武汉)信息科技有限公司 | Block chain system and architecture method for block chain system |
CN106598490A (en) * | 2016-11-25 | 2017-04-26 | 深圳前海微众银行股份有限公司 | Access method for block chain data and block chain management system |
CN106598500A (en) * | 2016-12-16 | 2017-04-26 | 郑州云海信息技术有限公司 | Hierarchical storage dynamic migration method |
CN107145521B (en) * | 2017-04-10 | 2019-05-21 | 杭州趣链科技有限公司 | A kind of data migration method towards block chain multistage intelligent contract |
CN107193500A (en) * | 2017-05-26 | 2017-09-22 | 郑州云海信息技术有限公司 | A kind of distributed file system Bedding storage method and system |
US10601665B2 (en) * | 2017-07-26 | 2020-03-24 | International Business Machines Corporation | Using blockchain smart contracts to manage dynamic data usage requirements |
CN107577427B (en) * | 2017-08-31 | 2019-12-13 | 上海保险交易所股份有限公司 | data migration method, device and storage medium for blockchain system |
CN108519862B (en) * | 2018-03-30 | 2020-03-17 | 百度在线网络技术(北京)有限公司 | Storage method, device and system of block chain system and storage medium |
-
2018
- 2018-05-31 CN CN201810553077.XA patent/CN108829350B/en active Active
- 2018-11-23 TW TW107141854A patent/TWI710978B/en active
-
2019
- 2019-05-29 SG SG11202004641PA patent/SG11202004641PA/en unknown
- 2019-05-29 EP EP19731441.2A patent/EP3701706B1/en active Active
- 2019-05-29 WO PCT/US2019/034256 patent/WO2019231954A1/en unknown
- 2019-05-30 US US16/427,032 patent/US10649953B2/en active Active
-
2020
- 2020-05-07 US US16/869,298 patent/US20200265009A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
EP3701706A1 (en) | 2020-09-02 |
US20190370223A1 (en) | 2019-12-05 |
SG11202004641PA (en) | 2020-06-29 |
CN108829350B (en) | 2020-02-21 |
TW202004584A (en) | 2020-01-16 |
EP3701706B1 (en) | 2021-11-17 |
WO2019231954A1 (en) | 2019-12-05 |
CN108829350A (en) | 2018-11-16 |
TWI710978B (en) | 2020-11-21 |
US10649953B2 (en) | 2020-05-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10649953B2 (en) | Blockchain-based data migration method and apparatus | |
CN109144414B (en) | Multi-level storage method and device for block chain data | |
US10929198B2 (en) | Blockchain-based resource allocation method and apparatus | |
AU2019295818A1 (en) | Block chain-based data processing method and device | |
US10356150B1 (en) | Automated repartitioning of streaming data | |
CN111767143A (en) | Transaction data processing method, device, equipment and system | |
KR20170097132A (en) | System for efficient processing of transaction requests related to an account in a database | |
US20210157821A1 (en) | Blockchain-based data processing methods and apparatuses and computer devices | |
US11102284B2 (en) | Service processing methods and systems based on a consortium blockchain network | |
JP2019527883A (en) | Database data change request processing method and apparatus | |
CN115129621B (en) | Memory management method, device, medium and memory management module | |
CN110750221B (en) | Volume cloning method, apparatus, electronic device and machine-readable storage medium | |
US10812408B1 (en) | Preventing concentrated selection of resource hosts for placing resources | |
CN114741449A (en) | Object storage method and device based on distributed database | |
CN111435323B (en) | Information transmission method, device, terminal, server and storage medium | |
WO2024001025A1 (en) | Pre-execution cache data cleaning method and blockchain node | |
US11354055B2 (en) | Method and device for dividing storage devices into device groups | |
US11188393B1 (en) | Systems and methods for performing load balancing and distributed high-availability | |
US11121981B1 (en) | Optimistically granting permission to host computing resources | |
US20200192596A1 (en) | Blockchain data storage method and apparatus | |
CN111090389B (en) | Method and device for releasing cache space and storage medium | |
EP4120060A1 (en) | Method and apparatus of storing data,and method and apparatus of reading data | |
US20240241770A1 (en) | Workload summarization for congestion avoidance in computer servers | |
CN116204335A (en) | Block generation method and device | |
CN118277344A (en) | Storage node interlayer merging method and device of distributed key value storage system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ALIBABA GROUP HOLDING LIMITED, CAYMAN ISLANDS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YANG, XINYING;WANG, SHIFENG;REEL/FRAME:053010/0682 Effective date: 20200117 |
|
AS | Assignment |
Owner name: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD., CAYMAN ISLANDS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ALIBABA GROUP HOLDING LIMITED;REEL/FRAME:053743/0464 Effective date: 20200826 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
AS | Assignment |
Owner name: ADVANCED NEW TECHNOLOGIES CO., LTD., CAYMAN ISLANDS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.;REEL/FRAME:053754/0625 Effective date: 20200910 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |