CN115408715A - Heterogeneous data processing system, method and equipment based on block chain and IPFS - Google Patents
Heterogeneous data processing system, method and equipment based on block chain and IPFS Download PDFInfo
- Publication number
- CN115408715A CN115408715A CN202211056900.9A CN202211056900A CN115408715A CN 115408715 A CN115408715 A CN 115408715A CN 202211056900 A CN202211056900 A CN 202211056900A CN 115408715 A CN115408715 A CN 115408715A
- Authority
- CN
- China
- Prior art keywords
- data
- subsystem
- ipfs
- block
- block chain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 33
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000007781 pre-processing Methods 0.000 claims abstract description 7
- 238000004590 computer program Methods 0.000 claims description 11
- 238000012795 verification Methods 0.000 claims description 11
- 238000003672 processing method Methods 0.000 claims description 9
- 238000012800 visualization Methods 0.000 claims description 5
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000013500 data storage Methods 0.000 description 5
- 238000007726 management method Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013506 data mapping Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a heterogeneous data processing system, method and device based on a block chain and an IPFS (Internet protocol multimedia File System), and belongs to the technical field of computers. According to the heterogeneous data processing system based on the block chain and the IPFS, a service subsystem acquires heterogeneous data acquired by terminal equipment, and packages the heterogeneous data after preprocessing to generate at least one data block; the service subsystem further generates a data fingerprint based on the plurality of data chunks; the service subsystem sends a plurality of data blocks to the interplanetary file subsystem for storage, the interplanetary file subsystem generates an IPFS file hash address based on one data block, and returns at least one IPFS file hash address to the service subsystem; after the service subsystem calls a data chaining contract on the block chain subsystem, at least one IPFS file hash address and the data fingerprint are stored in a newly-built block of the block chain system; and the block chain subsystem calculates and returns the hash value of the newly-built block to the service subsystem for storage.
Description
Technical Field
The invention belongs to the technical field of computers, and particularly relates to a heterogeneous data processing system, method and equipment based on a block chain and IPFS.
Background
With the development of the internet, it is more and more important for users to upload files to the internet for storage and management. Data storage and security have always been a major issue in the contemporary internet, and how to reliably store data and protect the security and privacy of data is also a difficult task.
The information disclosed in this background section is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.
Disclosure of Invention
The invention aims to improve the security of heterogeneous data storage, and provides a heterogeneous data processing system, method and device based on a block chain and IPFS.
In a first aspect, an embodiment of the present invention provides a heterogeneous data processing system based on a blockchain and an IPFS, including a service subsystem, an interplanetary file subsystem, and a blockchain subsystem: wherein,
after the service subsystem responds to a data submission request sent by terminal equipment, the service subsystem acquires heterogeneous data acquired by the terminal equipment, and packages the heterogeneous data after preprocessing to generate at least one data block;
the service subsystem further generates a data fingerprint based on the plurality of data chunks;
the service subsystem sends a plurality of data blocks to the interplanetary file subsystem for storage, the interplanetary file subsystem generates an IPFS file hash address based on one data block and returns at least one IPFS file hash address to the service subsystem;
after the service subsystem calls a data chaining contract on the block chain subsystem, at least one IPFS file hash address and the data fingerprint are stored in a newly-built block of the block chain subsystem;
and the block chain subsystem calculates and returns the hash value of the newly-built block to the service subsystem for storage.
Optionally, the heterogeneous data includes at least one or more of voice data, video data, picture data, and text data.
Optionally, the data block includes one or more of a data type identifier, a data date, and a terminal device ID.
Optionally, the service subsystem generates a query range parameter based on a data query request sent by the terminal device, where the range reference includes a data date and a terminal device ID;
the service subsystem sends the query range parameter to the block chain subsystem;
the block chain subsystem inquires a target block based on the received inquiry range parameter and the data inquiry contract on the chain, and sends the IPFS file hash address and the data fingerprint in the target block to the service subsystem;
the service subsystem sends the IPFS file hash address to the interplanetary file subsystem;
the interplanetary file subsystem inquires data blocks corresponding to the IPFS file hash addresses one by one according to the IPFS file hash addresses;
the interplanetary file subsystem transmits the data blocks to the service subsystem;
and the service subsystem carries out data fingerprint verification on the received data block based on the data fingerprint.
Optionally, if the verification is passed, the service subsystem performs visualization processing on the data block, and returns the data after visualization processing to the terminal device for display.
In a second aspect, an embodiment of the present invention provides a method for processing heterogeneous data based on a block chain and an IPFS, including:
after responding to a data submission request sent by terminal equipment, acquiring heterogeneous data acquired by the terminal equipment, preprocessing the heterogeneous data, and packaging to generate a plurality of data blocks;
generating a data fingerprint based on the heterogeneous data acquired by the terminal equipment;
sending a plurality of data blocks to an interplanetary file subsystem for storage, and receiving an IPFS file hash address sent by the interplanetary file subsystem, wherein the IPFS file hash address is generated by the interplanetary file subsystem based on the data blocks;
and after a data chaining contract on the block chain subsystem is called, the IPFS file hash address and the data fingerprint are stored in a newly-built block of the block chain subsystem.
Optionally, the heterogeneous data processing method based on a blockchain and an IPFS further includes:
generating a query range parameter based on a data query request sent by a terminal device, wherein the range reference comprises a data date and a terminal device ID;
sending the query scope parameter to the block chain subsystem;
receiving IPFS file hash addresses and data fingerprints in the target blocks sent by the block chain subsystem;
sending the IPFS file hash address to the interplanetary file subsystem;
receiving a data block which is sent by the interplanetary file subsystem and obtained based on the IPFS file hash address;
and performing data fingerprint verification on the received data block based on the data fingerprint.
In a third aspect, an embodiment of the present invention provides an electronic device, including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the above-described method.
In a fourth aspect, embodiments of the present invention provide a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the above method.
In a fifth aspect, an embodiment of the present invention provides a computer program product, which includes a computer program that, when executed by a processor, implements the above method.
Drawings
Fig. 1 illustrates a structure and a data processing schematic diagram of a heterogeneous data processing system based on a block chain and an IPFS according to an embodiment of the present invention;
FIG. 2 illustrates another data processing schematic of the heterogeneous data processing system based on blockchain and IPFS shown in FIG. 1;
FIG. 3 shows a schematic block diagram of an example electronic device 300 that may be used to implement an embodiment of the invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs. The use of "first," "second," and the like, herein does not denote any order, quantity, or importance, but rather the terms "first," "second," and the like are used to distinguish one element from another. Also, the use of the terms "a," "an," or "the" and similar referents do not denote a limitation of quantity, but rather denote the presence of at least one. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.
It should be noted that the blockchain is a chain data structure that combines data blocks in a sequential manner according to a time sequence, and the blockchain is also equal to a blockadding chain, and a block can be roughly divided into two parts, namely a head (header) and a body (body). The block header generally includes the hash value (parent hash) of the previous block, a timestamp, and other information, and the block body includes information corresponding to the block itself, and the whole blockchain system may include the following technical features:
(1) Point-to-point transmission: all nodes in a blockchain are connected together through a point-to-point network, and unlike a centralized network mode, all nodes in the point-to-point network are in equal positions, share part of computing resources and transmit information through a specific software protocol.
(2) Distributed data storage: as a distributed ledger, all participating nodes in the blockchain system will contain a complete ledger information copy of the blockchain, and whether the information of one ledger is tampered can be compared with the ledger copy information of other nodes.
(3) A consensus mechanism: all blockchain nodes maintain own blockbook and can collect transaction information newly generated in the blockchain in a period of time and store the transaction information in the blockchain in the own blockbook, if the blockchain nodes keep the added blockchain information of all nodes in the whole network consistent in the period of time and are verified and approved by all nodes together, the process of verifying and approving the blocks of the stored blockchain information by all nodes is called a consensus mechanism, and the consensus mechanism is achieved through a distributed consistency consensus algorithm.
Fig. 1 is a schematic diagram of a structure and data processing of a heterogeneous data processing system based on a block chain and an IPFS according to an embodiment of the present invention, and as shown in fig. 1, the heterogeneous data processing system based on the block chain and the IPFS includes a service subsystem 100, an interplanetary file subsystem 200, and a block chain subsystem 300.
Specifically, after the service subsystem 100 responds to a data submission request sent by the terminal device, the service subsystem 100 obtains heterogeneous data acquired by the terminal device, and performs preprocessing on the heterogeneous data and then packages the preprocessed heterogeneous data to generate at least one data block. Service subsystem 100 also generates a data fingerprint based on the plurality of data chunks.
With continued reference to fig. 1, the service subsystem 100 sends a plurality of data blocks to the interplanetary file subsystem 200 for storage, the interplanetary file subsystem 200 generates an IPFS file hash address based on one data block, and returns at least one IPFS file hash address to the service subsystem 100. Then, after the service subsystem 100 calls the data chaining contract on the blockchain subsystem 300, the at least one IPFS file hash address and the data fingerprint are saved in the newly created block of the blockchain subsystem 300. Finally, the blockchain subsystem 300 calculates and returns the hash value of the newly created block to the service subsystem 100 for storage.
The terminal device may be, for example, a mobile phone, a tablet computer, a personal digital assistant, a wearable device, a vehicle-mounted device, a sensor, or other hardware devices.
The block structure in the block chain subsystem 300 is as shown in fig. 1, where the block header mainly includes a timestamp, a preamble block hash, and a data type identifier (specific types of video, voice, text, etc.), the block body stores data mapping information in the IPFS, specific data exists in the IPFS, and the block body mainly includes a terminal device ID, a data date, an IPFS file hash address, and a data fingerprint. Since the data fingerprint is stored on the blockchain, the data fingerprint cannot be tampered with. When the subsequent query data is used, the data fingerprint on the chain can be compared with the fingerprint of the actually queried data, and whether the data is tampered or not can be judged.
Optionally, the heterogeneous data includes at least one or more of voice data, video data, picture data, and text data.
Optionally, the data block includes one or more of a data type identifier, a data date, and a terminal device ID.
In this embodiment, because the IPFS file hash address corresponding to the data block is stored in the block chain subsystem 300, decentralized file storage, management, and sharing of an intelligent contract based on the block chain are realized, and thus the security of heterogeneous data storage is improved. In addition, considering the problems of transaction delay and throughput bottleneck of the blockchain, information which is stored in the blockchain as little as possible is required to be stored, the method adopts a distributed File System such as an inter-plane File System (IPFS) to realize off-chain storage, and data stored in the IPFS is stable and safe and is difficult to be maliciously tampered.
Fig. 2 is another data processing diagram of the heterogeneous data processing system based on the block chain and IPFS shown in fig. 1, and as shown in fig. 2, first, the service subsystem 100 generates a query scope parameter based on a data query request sent by a terminal device, and the scope parameter includes a data date and a terminal device ID. Then, the service subsystem 100 sends the query scope parameter to the blockchain subsystem 300, and the blockchain subsystem 300 queries the target block based on the received query scope parameter and the on-chain data query contract, and sends the IPFS file hash address and the data fingerprint in the target block to the service subsystem 100. Further, the service subsystem 100 sends the IPFS file hash address to the interplanetary file subsystem 200, and the interplanetary file subsystem 200 queries the data blocks corresponding to the IPFS file hash address one by one according to the IPFS file hash address. The interplanetary file subsystem 200 sends the data block sum to the service subsystem 100. Finally, the service subsystem 100 performs data fingerprint verification on the received data block based on the data fingerprint.
In this embodiment, the blockchain subsystem 300 queries a target block based on the received query scope parameter and the on-chain data query contract, and sends the IPFS file hash address and the data fingerprint in the target block to the service subsystem 100, the interplanetary file subsystem 200 sends the data block to the service subsystem 100, and the service subsystem 100 performs data fingerprint verification on the received data block based on the data fingerprint, so as to check whether the stored heterogeneous data is tampered.
In some embodiments, as shown in fig. 2, if the verification is passed, the service subsystem 100 performs visualization processing on the data block, and returns the data after the visualization processing to the terminal device for display.
The invention also provides a heterogeneous data processing method based on the block chain and the IPFS, which comprises the following steps:
1. after responding to a data submission request sent by the terminal equipment, acquiring heterogeneous data acquired by the terminal equipment, preprocessing the heterogeneous data, and packaging to generate a plurality of data blocks;
2. generating a data fingerprint based on heterogeneous data acquired by terminal equipment;
3. sending a plurality of data blocks to an interplanetary file subsystem for storage, and receiving an IPFS file hash address sent by the interplanetary file subsystem, wherein the IPFS file hash address is generated by the interplanetary file subsystem based on the data blocks;
4. after the data chaining contract on the blockchain subsystem 300 is invoked, the IPFS file hash address and the data fingerprint are saved to a newly created block of the blockchain system.
In this embodiment, because the IPFS file hash address corresponding to the data block is stored in the block chain subsystem 300, decentralized file storage, management, and sharing of an intelligent contract based on a block chain are realized, and thus security of heterogeneous data storage is improved. In addition, in consideration of the problems of transaction delay and throughput bottleneck of the blockchain, information which is as small as possible needs to be stored in the blockchain, the invention adopts a distributed File System such as an inter-satellite File System (IPFS) to realize off-chain storage, and data stored in the IPFS is stable and safe and is difficult to be maliciously tampered.
In some embodiments, the heterogeneous data processing method based on a blockchain and an IPFS further includes:
1. generating a query range parameter based on a data query request sent by the terminal equipment, wherein the range reference comprises a data date and a terminal equipment ID;
2. send the query scope parameter to the block chain subsystem 300;
3. receiving IPFS file hash addresses and data fingerprints in the target tiles sent by the tile chain subsystem 300;
4. sending the IPFS file hash address to the interplanetary file subsystem;
5. receiving a data block which is sent by an interplanetary file subsystem and obtained based on an IPFS file hash address;
6. and carrying out data fingerprint verification on the received data block based on the data fingerprint.
In this embodiment, the executed subject is a service subsystem, in this embodiment, the blockchain subsystem 300 queries a target block based on a received query range parameter and a data query contract on a chain, and sends an IPFS file hash address and a data fingerprint in the target block to the service subsystem 100, the interplanetary file subsystem 200 sends the data block to the service subsystem 100, and the service subsystem 100 performs data fingerprint verification on the received data block based on the data fingerprint, so that whether stored heterogeneous data is tampered or not can be verified.
The present application also provides an electronic device, a non-transitory computer-readable storage medium, and a computer program product according to embodiments of the present invention.
FIG. 3 shows a schematic block diagram of an example electronic device 300 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 3, the apparatus 300 includes a computing unit 301 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 302 or a computer program loaded from a storage unit 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data necessary for the operation of the device 300 can also be stored. The calculation unit 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
Various components in device 300 are connected to I/O interface 305, including: an input unit 306 such as a keyboard, a mouse, or the like; an output unit 307 such as various types of displays, speakers, and the like; a storage unit 308 such as a magnetic disk, optical disk, or the like; and a communication unit 309 such as a network card, modem, wireless communication transceiver, etc. The communication unit 309 allows the device 300 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 301 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 301 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit 301 performs the various methods and processes described above, such as for heterogeneous data processing methods based on blockchains and IPFS. For example, in some embodiments, the heterogeneous data processing method for blockchain and IPFS based may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 308. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 300 via ROM 302 and/or communication unit 309. When the computer program is loaded into RAM 303 and executed by the computing unit 301, one or more steps of the above described heterogeneous data processing method for blockchain and IPFS may be performed. Alternatively, in other embodiments, the computing unit 301 may be configured by any other suitable means (e.g., by means of firmware) to perform the heterogeneous data processing method for blockchain and IPFS-based.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present invention may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the Internet.
Cloud computing (cloud computer) refers to a technology system that accesses a flexibly extensible shared physical or virtual resource pool through a network, where resources may include servers, operating systems, networks, software, applications, or storage devices, and the like, and may be deployed and managed in an on-demand, self-service manner. Through the cloud computing technology, high-efficiency and strong data processing capacity can be provided for technical application such as artificial intelligence and block chains and model training.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired result of the technical solution of the present invention can be achieved.
It will be understood that the above embodiments are merely exemplary embodiments taken to illustrate the principles of the present invention, which is not limited thereto. It will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the spirit and scope of the invention, and such modifications and improvements are also considered to be within the scope of the invention.
Claims (10)
1. A heterogeneous data processing system based on a block chain and IPFS is characterized by comprising a service subsystem, an interplanetary file subsystem and a block chain subsystem: wherein,
after the service subsystem responds to a data submission request sent by terminal equipment, the service subsystem acquires heterogeneous data acquired by the terminal equipment, and packages the heterogeneous data after preprocessing to generate at least one data block;
the service subsystem further generates a data fingerprint based on the plurality of data chunks;
the service subsystem sends a plurality of data blocks to the interplanetary file subsystem for storage, the interplanetary file subsystem generates an IPFS file hash address based on one data block and returns at least one IPFS file hash address to the service subsystem;
after the service subsystem calls a data uplink contract on the block chain subsystem, at least one IPFS file hash address and the data fingerprint are stored in a newly-built block of the block chain system;
and the block chain subsystem calculates and returns the hash value of the newly-built block to the service subsystem for storage.
2. The blockchain and IPFS based heterogeneous data processing system according to claim 1, wherein the heterogeneous data comprises at least one or several of voice data, video data, picture data, text data.
3. The heterogeneous data processing system based on a blockchain and IPFS of claim 1, wherein the data block includes one or more of a data type identifier, a data date, and a terminal device ID.
4. The heterogeneous data processing system based on blockchain and IPFS according to claim 1, wherein said service subsystem generates a query scope parameter based on a data query request sent by a terminal device, said scope reference comprising a data date and a terminal device ID;
the service subsystem sends the query range parameter to the block chain subsystem;
the block chain subsystem inquires a target block based on the received inquiry range parameter and the data inquiry contract on the chain, and sends the IPFS file hash address and the data fingerprint in the target block to the service subsystem;
the service subsystem sends the IPFS file hash address to the interplanetary file subsystem;
the interplanetary file subsystem inquires data blocks corresponding to the IPFS file hash addresses one by one according to the IPFS file hash addresses;
the interplanetary file subsystem transmits the data blocks to the service subsystem;
and the service subsystem carries out data fingerprint verification on the received data block based on the data fingerprint.
5. The heterogeneous data processing system according to claim 4, wherein if the verification is successful, the service subsystem performs visualization processing on the data chunk and returns the visualized data to the terminal device for display.
6. A heterogeneous data processing method based on a block chain and IPFS is characterized by further comprising the following steps:
after responding to a data submission request sent by terminal equipment, acquiring heterogeneous data acquired by the terminal equipment, preprocessing the heterogeneous data, and packaging to generate a plurality of data blocks;
generating a data fingerprint based on the heterogeneous data acquired by the terminal equipment;
sending a plurality of data blocks to an interplanetary file subsystem for storage, and receiving an IPFS file hash address sent by the interplanetary file subsystem, wherein the IPFS file hash address is generated by the interplanetary file subsystem based on the data blocks;
and after calling a data chaining contract on the block chain subsystem, storing the IPFS file hash address and the data fingerprint into a newly-built block of the block chain subsystem.
7. The heterogeneous data processing method based on blockchain and IPFS according to claim 6, comprising:
generating a query range parameter based on a data query request sent by a terminal device, wherein the range reference comprises a data date and a terminal device ID;
sending the query scope parameter to the block chain subsystem;
receiving IPFS file hash addresses and data fingerprints in target blocks sent by the block chain subsystem;
sending the IPFS file hash address to the interplanetary file subsystem;
receiving a data block which is sent by the interplanetary file subsystem and obtained based on the IPFS file hash address;
and performing data fingerprint verification on the received data block based on the data fingerprint.
8. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 6-7.
9. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 6-7.
10. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 6-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211056900.9A CN115408715A (en) | 2022-08-31 | 2022-08-31 | Heterogeneous data processing system, method and equipment based on block chain and IPFS |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211056900.9A CN115408715A (en) | 2022-08-31 | 2022-08-31 | Heterogeneous data processing system, method and equipment based on block chain and IPFS |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115408715A true CN115408715A (en) | 2022-11-29 |
Family
ID=84163482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211056900.9A Pending CN115408715A (en) | 2022-08-31 | 2022-08-31 | Heterogeneous data processing system, method and equipment based on block chain and IPFS |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115408715A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115657974A (en) * | 2022-12-29 | 2023-01-31 | 中国电子信息产业集团有限公司第六研究所 | Block chain-based data access method, system, device and storage medium |
| CN115827785A (en) * | 2022-12-30 | 2023-03-21 | 中国联合网络通信集团有限公司 | Data storage method, device, equipment and readable storage medium |
| CN116319815A (en) * | 2023-05-17 | 2023-06-23 | 驿羚江苏大数据有限公司 | Cloud data placement policy management system introducing SaaS features |
| CN116662291A (en) * | 2023-05-15 | 2023-08-29 | 上海交通大学 | Building material supply chain data management system and method based on block chain and IPFS |
-
2022
- 2022-08-31 CN CN202211056900.9A patent/CN115408715A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115657974A (en) * | 2022-12-29 | 2023-01-31 | 中国电子信息产业集团有限公司第六研究所 | Block chain-based data access method, system, device and storage medium |
| CN115827785A (en) * | 2022-12-30 | 2023-03-21 | 中国联合网络通信集团有限公司 | Data storage method, device, equipment and readable storage medium |
| CN116662291A (en) * | 2023-05-15 | 2023-08-29 | 上海交通大学 | Building material supply chain data management system and method based on block chain and IPFS |
| CN116319815A (en) * | 2023-05-17 | 2023-06-23 | 驿羚江苏大数据有限公司 | Cloud data placement policy management system introducing SaaS features |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115408715A (en) | Heterogeneous data processing system, method and equipment based on block chain and IPFS | |
| CN108924250B (en) | Service request processing method and device based on block chain and computer equipment | |
| CN110825479A (en) | Page processing method and device, terminal equipment, server and storage medium | |
| CN112667414A (en) | Message queue-based message consumption method and device, computer equipment and medium | |
| WO2021223662A1 (en) | Page access based on code scanning | |
| US10116746B2 (en) | Data storage method and network interface card | |
| US10693816B2 (en) | Communication methods and systems, electronic devices, and computer clusters | |
| CN109951546B (en) | Transaction request processing method, device, equipment and medium based on intelligent contract | |
| US20200120039A1 (en) | Systems and methods for controlling access to broker resources | |
| CN113259479B (en) | Data processing method and equipment | |
| CN108965450B (en) | Service request response method, device, computer equipment and storage medium | |
| CN113360116A (en) | Method, device and equipment for controlling terminal and storage medium | |
| CN112764887A (en) | Construction method, processing method, device, equipment and storage medium of transaction request | |
| EP4095686A2 (en) | Method for switching skin of mini-program page, and electronic device | |
| CN113946816A (en) | Cloud service-based authentication method and device, electronic equipment and storage medium | |
| CN113132400A (en) | Business processing method, device, computer system and storage medium | |
| CN115459990A (en) | Block chain-based terminal equipment network access authentication method, system and equipment | |
| CN115599571A (en) | Data processing method and device, electronic equipment and storage medium | |
| US20240193249A1 (en) | Method of processing cross-domain authorization and method of processing cross-domain call | |
| CN115330396A (en) | Payment state acquisition method and device, computer equipment and storage medium | |
| US11163537B1 (en) | Tiered application pattern | |
| CN107273047A (en) | A kind of buffer memory management method, cache manager and storage management software | |
| CN114328731A (en) | Information processing method, device, electronic equipment and storage medium | |
| CN113935069A (en) | Data verification method, device and equipment based on block chain and storage medium | |
| CN114996557B (en) | Service stability determination method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |