CN108596627B - Big data calculation method and system based on block chain and fog calculation - Google Patents
Big data calculation method and system based on block chain and fog calculation Download PDFInfo
- Publication number
- CN108596627B CN108596627B CN201810324751.7A CN201810324751A CN108596627B CN 108596627 B CN108596627 B CN 108596627B CN 201810324751 A CN201810324751 A CN 201810324751A CN 108596627 B CN108596627 B CN 108596627B
- Authority
- CN
- China
- Prior art keywords
- node
- data
- resource
- intelligent contract
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004364 calculation method Methods 0.000 title claims abstract description 149
- 238000012795 verification Methods 0.000 claims abstract description 56
- 238000000034 method Methods 0.000 claims abstract description 42
- 230000008569 process Effects 0.000 claims description 27
- 230000001960 triggered effect Effects 0.000 claims description 11
- 239000002184 metal Substances 0.000 description 8
- 238000000354 decomposition reaction Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 239000003595 mist Substances 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/405—Establishing or using transaction specific rules
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/02—Payment architectures, schemes or protocols involving a neutral party, e.g. certification authority, notary or trusted third party [TTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/50—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols using hash chains, e.g. blockchains or hash trees
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q2220/00—Business processing using cryptography
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Development Economics (AREA)
- Computer Security & Cryptography (AREA)
- Marketing (AREA)
- Technology Law (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Storage Device Security (AREA)
Abstract
The invention provides a big data calculation method and a big data calculation system based on block chain and fog calculation, wherein the method comprises the following steps: the information issuing node issues an intelligent contract carrying a data resource directory to the block chain network; the data node issues the data information to a block chain network; the big data calculation demand node generates a big data calculation intelligent contract carrying demand information and a storage position according to the data information and the intelligent contract; the fog computing resource node selects a resource node from the fog computing network and issues a corresponding task intelligent contract to the block chain network; the verification node triggers a target data node according to the task intelligent contract, the demand information and the data information; the target data node sends target resource data to the selected resource node; and the selected resource node calculates the target resource data according to the demand information to generate a calculation result and stores the calculation result in a storage position. By the technical scheme, the resource data of the data node can be prevented from leaking through the big data calculation demand node.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a big data calculation method and system based on block chain and fog calculation.
Background
In recent years, big data computing brings revolutionary breakthrough in various fields such as science, business and society, and relevant technologies and services of big data are greatly developed.
At present, in a big data computing process, a data node with resource data is generally required to directly provide resource data capable of meeting computing requirements of a big data computing requirement node with big data computing requirements, that is, the data node is required to directly share the resource data with the big data computing requirement node, which may cause the resource data of the data node to leak through the big data computing requirement node.
Disclosure of Invention
The embodiment of the invention provides a big data calculation method and a big data calculation system based on fog calculation and a block chain, which can prevent resource data of data nodes from leaking through big data calculation demand nodes.
In a first aspect, the present invention provides a big data calculation method based on a blockchain and fog calculation, including:
determining a data resource directory through an information issuing node, forming an intelligent contract according to the data resource directory, and issuing the intelligent contract to a block chain network;
issuing data information of resource data owned by the current data node to the block chain network through at least one data node according to the data resource catalog carried by the intelligent contract;
generating a big data calculation intelligent contract and issuing the big data calculation intelligent contract to the block chain network through a big data calculation demand node according to each data information and the data resource catalog carried by the intelligent contract, wherein the big data calculation intelligent contract carries demand information and a storage position;
selecting at least one resource node from a fog computing network through a fog computing resource node, generating a task intelligent contract according to the selected at least one resource node and the demand information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network;
triggering at least one target data node through a verification node according to the task intelligent contract and each data information;
sending target resource data corresponding to the demand information to the selected at least one resource node under the trigger of the verification node through the at least one target data node;
and calculating each target resource data according to the selected at least one resource node according to the requirement information to generate a calculation result, and storing the generated calculation result to the storage position.
Preferably, the first and second electrodes are formed of a metal,
the requirement information comprises: target data type, target data identification and calculation method.
Preferably, the first and second electrodes are formed of a metal,
the method comprises the following steps of selecting at least one resource node from a fog computing network through the fog computing resource node, generating a task intelligent contract according to the selected at least one resource node and the demand information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network, and comprises the following steps:
selecting an idle storage node and an idle computing node from the fog computing network through the fog computing resource node;
generating a storage task intelligent contract by the fog computing resource node according to a first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract and the target data identifier;
generating a computing task intelligent contract by the fog computing resource node according to a second node identifier of the idle computing node and the computing method carried by the big data computing intelligent contract;
then the process of the first step is carried out,
the triggering of at least one target data node by the verification node according to the task intelligent contract and each data information comprises the following steps: selecting at least one target data node from the at least one data node through a verification node according to the intelligent contract of the storage task, and triggering the at least one target data node;
the sending, by the at least one target data node, target resource data corresponding to the demand information to the selected at least one resource node under the trigger of the verification node includes: and storing target resource data to the idle storage node according to the target data type and the target data identification carried by the storage task intelligent contract under the trigger of the verification node through the at least one target data node.
Preferably, the first and second electrodes are formed of a metal,
the calculating each target resource data according to the selected at least one resource node according to the demand information to generate a calculation result, and storing the generated calculation result to the storage location, including:
reading each target resource data stored in the idle storage node through the idle computing node, computing each target resource data according to the computing method carried by the intelligent contract of the computing task to generate a computing result, and storing the generated computing result to the storage position.
Preferably, the first and second electrodes are formed of a metal,
the selecting, by the fog computing resource node, a free storage node and a free computing node from the fog computing network further comprises: generating a private key and a public key corresponding to the idle storage node;
then, the generating, by the fog computing resource node, a storage task intelligent contract according to the first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract, and the target data identifier includes: generating a storage task intelligent contract by the fog computing resource node according to a first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract, the public key and the target data identifier;
the storing target resource data to the idle storage node according to the target data type and the target data identifier carried by the storage task intelligent contract under the trigger of the verification node by the at least one target data node comprises: and determining target resource data according to the target data type and the target data identification carried by the intelligent contract of the storage task under the trigger of the verification node through the at least one target data node, encrypting the target resource data according to the public key carried by the intelligent contract of the storage task to form a ciphertext corresponding to the target resource data, and sending the ciphertext corresponding to the target resource data to the idle storage node.
In a second aspect, an embodiment of the present invention provides a big data computing system based on a blockchain and fog computing, including:
the system comprises an information publishing node, at least one data node, a big data computing demand node, a fog computing resource node, a verification node, a block chain network and a fog computing network comprising at least one resource node; wherein,
the information issuing node is used for determining a data resource directory, forming an intelligent contract according to the data resource directory, and issuing the intelligent contract to a block chain network;
the at least one data node is used for issuing data information of resource data owned by the current data node to the block chain network according to the data resource catalog carried by the intelligent contract; when the node serving as the target data is triggered by the verification node, sending target resource data corresponding to the demand information to the selected at least one resource node;
the big data calculation demand node is used for generating a big data calculation intelligent contract according to the data information and the data resource catalog carried by the intelligent contract and issuing the big data calculation intelligent contract to the block chain network, wherein the big data calculation intelligent contract carries demand information and a storage position;
the fog computing resource node is used for selecting at least one resource node from a fog computing network, generating a task intelligent contract according to the selected at least one resource node and the demand information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network;
the verification node is used for triggering at least one target data node according to the task intelligent contract and each piece of data information;
and the resource node is used for calculating each target resource data according to the demand information to generate a calculation result after being selected by the fog calculation resource node, and storing the generated calculation result to the storage position.
Preferably, the first and second electrodes are formed of a metal,
the requirement information comprises: target data type, target data identification and calculation method.
Preferably, the first and second electrodes are formed of a metal,
the fog computing resource node is used for selecting an idle storage node and an idle computing node from the fog computing network; generating a storage task intelligent contract according to the target data type and the target data identification carried by the intelligent contract calculated according to the first node identification of the idle storage node and the big data; generating a calculation task intelligent contract according to the second node identification of the idle calculation node and the calculation method carried by the big data calculation intelligent contract;
then the process of the first step is carried out,
the verification node is used for selecting at least one target data node from the at least one data node according to the intelligent contract of the storage task and triggering the at least one target data node;
and the data node is used for storing target resource data to the idle storage node according to the target data type and the target data identifier carried by the intelligent contract of the storage task when the target data node is triggered by the verification node.
Preferably, the first and second electrodes are formed of a metal,
and the resource node is used for reading each target resource data stored in the idle storage node when the fog computing resource node is selected as an idle computing node, computing each target resource data according to the computing method carried by the intelligent contract of the computing task to generate a computing result, and storing the generated computing result to the storage position.
Preferably, the first and second electrodes are formed of a metal,
the fog computing resource node comprising: the system comprises a secret key generation module and a contract processing module; wherein,
the secret key generating module is used for generating a private key and a public key corresponding to the idle storage node;
the contract processing module is used for calculating the target data type carried by the intelligent contract according to the first node identification of the idle storage node, the big data, the public key and the target data identification to generate an intelligent contract of a storage task;
and the data node is used for determining target resource data according to the target data type and the target data identification carried by the intelligent contract of the storage task when the target data node is triggered by the verification node, encrypting the target resource data according to the public key carried by the intelligent contract of the storage task to form a ciphertext corresponding to the target resource data, and sending the ciphertext corresponding to the target resource data to the idle storage node.
The embodiment of the invention provides a big data calculation method based on fog calculation and a block chain, in the method, an information issuing node issues an intelligent contract carrying a data resource catalog to the block chain, each data node can issue data information of the resource data which can be used for big data calculation to the block chain network according to the resource catalog carried by the intelligent contract in the block chain network, a big data calculation demand node can issue a big data calculation intelligent contract carrying demand information and a storage position to the block chain network according to the data resource catalog carried by the intelligent contract and each data information in the block chain network, and subsequently, the fog calculation resource node can select one or more resource nodes from the fog calculation network, generate a task intelligent contract according to each selected resource node and then issue the task intelligent contract to the block chain network, the verification node triggers one or more target data nodes which accord with the demand information according to the task intelligent contract and each data information, each target data node can send target resource data which accord with the demand information to the selected resource node in the fog computing network under the trigger of the verification node, then the selected resource node in the fog computing network computes each target resource data to generate a computation result, and then the computation result is sent to a storage position carried by the big data computing intelligent contract. In summary, when the big data calculation is realized through the technical scheme of the invention, the big data calculation demand node does not need to access the data node, the calculation process of the big data calculation is only carried out on one or more resource nodes in the fog calculation network, the resource data of each data node cannot be directly shared to the big data calculation demand node, and the leakage of the resource data of the data node through the big data calculation demand node can be prevented.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of a big data calculation method based on block chain and fog calculation according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a big data computing system based on block chain and fog computing according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention, and based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts belong to the scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a big data calculation method based on a block chain and fog calculation, including:
102, issuing data information of resource data owned by the current data node to the block chain network through at least one data node according to the data resource catalog carried by the intelligent contract;
103, generating a big data calculation intelligent contract according to each data information and the data resource catalog carried by the intelligent contract through a big data calculation demand node, and issuing the big data calculation intelligent contract to the block chain network, wherein the big data calculation intelligent contract carries demand information and a storage position;
104, selecting at least one resource node from a fog computing network through the fog computing resource node, generating a task intelligent contract according to the selected at least one resource node and the requirement information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network;
105, triggering at least one target data node through a verification node according to the task intelligent contract and each piece of data information;
As shown in fig. 1, in the embodiment, an information publishing node publishes an intelligent contract carrying a data resource catalog to a blockchain, each data node can publish data information of resource data which can be used for big data calculation to the blockchain network according to the resource catalog carried by the intelligent contract in the blockchain network, a big data calculation demand node can publish a big data calculation intelligent contract carrying demand information and a storage location to the blockchain network according to the data resource catalog carried by the intelligent contract and each data information in the blockchain network, subsequently, a fog calculation resource node can select one or more resource nodes from the fog calculation network, generate a task intelligent contract according to each selected resource node and publish the task intelligent contract to the blockchain network, and a verification node triggers one or more target data nodes meeting the demand information according to the task intelligent contract and each data information, each target data node can send target resource data meeting the requirement information to the selected resource nodes in the fog computing network under the trigger of the verification node, then the selected resource nodes in the fog computing network calculate each target resource data to generate a calculation result, and then the calculation result is sent to a storage position carried by the big data computing intelligent contract. In summary, when the big data calculation is realized through the technical scheme of the invention, the big data calculation demand node does not need to access the data node, the calculation process of the big data calculation is only carried out on one or more resource nodes in the fog calculation network, the resource data of each data node cannot be directly shared to the big data calculation demand node, and the leakage of the resource data of the data node through the big data calculation demand node can be prevented.
In the above embodiment, in order to identify the identity of each node, the information publishing node may further identify all participating nodes, including identifying the identities of the data node, the big data computation demand node, the verification node, the fog computation resource node, and the like, form an intelligent identification contract by using the identity of each participating node, and then publish the intelligent identification contract to the blockchain network, so that all participating nodes can learn about the identity of each participating node by looking up the intelligent identification contract.
Specifically, the requirement information includes: target data type, target data identification and calculation method. It should be understood that a requirement information may include a plurality of decomposition tasks, and each decomposition task may correspond to a corresponding target data type, a corresponding target data identifier, and a corresponding calculation method.
In an embodiment of the present invention, the selecting at least one resource node from a fog computing network through a fog computing resource node, generating a task intelligent contract according to the selected at least one resource node and the requirement information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network includes:
selecting an idle storage node and an idle computing node from the fog computing network through the fog computing resource node;
generating a storage task intelligent contract by the fog computing resource node according to a first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract and the target data identifier;
generating a computing task intelligent contract by the fog computing resource node according to a second node identifier of the idle computing node and the computing method carried by the big data computing intelligent contract;
then the process of the first step is carried out,
the triggering of at least one target data node by the verification node according to the task intelligent contract and each data information comprises the following steps: selecting at least one target data node from the at least one data node through a verification node according to the intelligent contract of the storage task, and triggering the at least one target data node;
the sending, by the at least one target data node, target resource data corresponding to the demand information to the selected at least one resource node under the trigger of the verification node includes: and storing target resource data to the idle storage node according to the target data type and the target data identification carried by the storage task intelligent contract under the trigger of the verification node through the at least one target data node.
In the above embodiment, the fog computing resource node may select a relatively idle storage node and an idle computing node from the fog computing network, generate a storage task intelligent contract according to a first node identifier of the idle storage node, a target data type and a target data identifier carried in the demand information, and generate a computing task intelligent contract according to a second node identifier of the idle computing node and a computing method carried in the demand information; in the subsequent process, the verification node may select at least one target data node from the at least one data node according to the intelligent storage task contract (each target data node should be capable of providing resource data having a target data identifier and a data format of the target data node is a target data type), and trigger each target data node, so that each target data node stores the target resource data to the idle storage node according to the first node identifier carried in the intelligent storage task contract. Therefore, the resource data needed in the big data calculation process can be stored in the relatively idle storage nodes in the fog calculation network, the relatively idle storage nodes in the fog calculation network can more efficiently finish the access of the target resource data, and the big data calculation efficiency is improved.
Correspondingly, in an embodiment of the present invention, the calculating, by the selected at least one resource node, each target resource data according to the requirement information to generate a calculation result, and storing the generated calculation result in the storage location includes: reading each target resource data stored in the idle storage node through the idle computing node, computing each target resource data according to the computing method carried by the intelligent contract of the computing task to generate a computing result, and storing the generated computing result to the storage position.
In the above embodiment, after each target data node stores corresponding target resource data to the selected idle storage node, the verification node may trigger the selected idle computing node according to the second node identifier carried in the intelligent contract for the computing task in a summary manner, so that the idle computing node reads each target resource data stored in the idle storage node, calculates each target resource data according to the calculation method carried in the intelligent contract for the computing task to generate a calculation result, and then stores the generated calculation result to the storage location. Therefore, the computing task in the big data computing process can be executed through the idle computing nodes in the fog computing network, the idle computing nodes can more efficiently complete the computing task in the big data computing process, and the big data computing efficiency is improved.
It should be understood that, when the demand information carries a plurality of decomposition tasks, the idle computing node should compute, for each decomposition task, corresponding target resource data according to a computation method corresponding to the decomposition task, the obtained intermediate result may be temporarily stored in the idle storage node, the intermediate result stored in the idle storage node may be continuously used for subsequent decomposition tasks, until each decomposition task is completed, a computation result meeting the big data computation demand may be obtained, and only the obtained computation result may be stored in a storage location carried in the big data computation intelligent contract, so that the big data computation demand node reads the computation result from the storage location.
In an embodiment of the present invention, the selecting, by the cloud computing resource node, an idle storage node and an idle computing node from the cloud computing network further includes: generating a private key and a public key corresponding to the idle storage node;
then, the generating, by the fog computing resource node, a storage task intelligent contract according to the first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract, and the target data identifier includes: generating a storage task intelligent contract by the fog computing resource node according to a first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract, the public key and the target data identifier;
the storing target resource data to the idle storage node according to the target data type and the target data identifier carried by the storage task intelligent contract under the trigger of the verification node by the at least one target data node comprises: and determining target resource data according to the target data type and the target data identification carried by the intelligent contract of the storage task under the trigger of the verification node through the at least one target data node, encrypting the target resource data according to the public key carried by the intelligent contract of the storage task to form a ciphertext corresponding to the target resource data, and sending the ciphertext corresponding to the target resource data to the idle storage node.
In the above embodiment, when the mist computing resource node selects the corresponding idle storage node from the mist computing network, a private key and a public key corresponding to the idle storage node may be generated, in the subsequent process, each target data node triggered by the verification node may encrypt the target resource data according to the public key carried in the storage task intelligent contract to form a ciphertext corresponding to the target resource data, and after the ciphertext is stored in the idle storage node, the idle storage node may decrypt the corresponding private key to obtain the corresponding target resource data, so that the target resource data may be prevented from being maliciously stolen in the process of being transmitted from the data node to the idle storage node.
In another possible implementation manner, a public key and a private key corresponding to the idle computing node may also be generated, and a method similar to the above embodiment is used to prevent target resource data from being maliciously stolen in a process of transmitting the target resource data from the idle storage node to the idle computing node.
It will be appreciated by those skilled in the art that the intelligent contracts described in the foregoing embodiments are all corresponding computer programs that can be distributed to the blockchain network, and that each participating node connected to the blockchain network can read information carried in the computer programs.
As shown in fig. 2, an embodiment of the present invention provides a big data computing system based on block chain and fog computing, including:
the system comprises an information publishing node 201, at least one data node 202, a big data computing demand node 203, a fog computing resource node 204, a verification node 205, a block chain network 206 and a fog computing network 207 comprising at least one resource node 2071; wherein,
the information issuing node 201 is configured to determine a data resource directory, form an intelligent contract according to the data resource directory, and issue the intelligent contract to the blockchain network 206;
the at least one data node 202 is configured to issue, according to the data resource directory carried by the intelligent contract, data information of resource data owned by the current data node 202 to the block chain network 206; when triggered by the verification node 205 as a target data node, sending target resource data corresponding to the requirement information to the selected at least one resource node 2071;
the big data computation demand node 203 is configured to generate a big data computation intelligent contract according to each piece of data information and the data resource directory carried by the intelligent contract, and issue the big data computation intelligent contract to the block chain network 206, where the big data computation intelligent contract carries demand information and a storage location;
the fog computing resource node 204 is configured to select at least one resource node 2071 from the fog computing network 207, generate a task intelligent contract according to the selected at least one resource node 2071 and the requirement information carried by the big data computing intelligent contract, and issue the task intelligent contract to the block chain network 206;
the verification node 205 is configured to trigger at least one target data node according to the task intelligent contract and each piece of data information;
the at least one resource node 2071 is configured to calculate each target resource data according to the demand information to generate a calculation result after being selected by the fog calculation resource node 204, and store the generated calculation result in the storage location.
In an embodiment of the present invention, the requirement information includes: target data type, target data identification and calculation method.
In an embodiment of the present invention, the fog computing resource node 204 is configured to select an idle storage node and an idle computing node from the fog computing network 206; generating a storage task intelligent contract according to the target data type and the target data identification carried by the intelligent contract calculated according to the first node identification of the idle storage node and the big data; generating a calculation task intelligent contract according to the second node identification of the idle calculation node and the calculation method carried by the big data calculation intelligent contract;
then the process of the first step is carried out,
the verification node 205 is configured to select at least one target data node from the at least one data node 202 according to the storage task intelligence contract, and trigger the at least one target data node;
the data node 202 is configured to store, when being triggered by the verification node as a target data node, target resource data to the idle storage node according to the target data type and the target data identifier carried in the storage task intelligent contract.
In an embodiment of the present invention, the resource node 2071 is configured to, when the fog computing resource node 204 selects an idle computing node, read each target resource data stored in the idle storage node, perform computation on each target resource data according to the computation method carried by the intelligent contract for computing tasks to generate a computation result, and store the generated computation result in the storage location.
In an embodiment of the present invention, the fog computing resource node 204 includes: a key generation module (not shown in the drawings) and a contract processing module (not shown in the drawings); wherein,
the secret key generating module is used for generating a private key and a public key corresponding to the idle storage node;
the contract processing module is used for calculating the target data type carried by the intelligent contract according to the first node identification of the idle storage node, the big data, the public key and the target data identification to generate an intelligent contract of a storage task;
the data node 202 is configured to, when being triggered by the verification node 205 as a target data node, determine target resource data according to the target data type and the target data identifier carried in the storage task intelligent contract, encrypt the target resource data according to the public key carried in the storage task intelligent contract to form a ciphertext corresponding to the target resource data, and send the ciphertext corresponding to the target resource data to the idle storage node.
It should be understood that each node in the embodiments of the present invention may specifically be a personal computer or a server.
Because the information interaction, execution process, and other contents between the units in the device are based on the same concept as the method embodiment of the present invention, specific contents may refer to the description in the method embodiment of the present invention, and are not described herein again.
In summary, the embodiments of the present invention have at least the following advantages:
1. in one embodiment of the invention, an intelligent contract carrying a data resource catalog is issued to a block chain through an information issuing node, each data node can issue data information of resource data which can be used for big data calculation to the block chain network according to the resource catalog carried by the intelligent contract in the block chain network, a big data calculation demand node can issue a big data calculation intelligent contract carrying demand information and a storage position to the block chain network according to the data resource catalog carried by the intelligent contract and each data information in the block chain network, subsequently, a fog calculation resource node can select one or more resource nodes from the fog calculation network, generate a task intelligent contract according to each selected resource node and then issue the task intelligent contract to the block chain network, a verification node triggers one or more target data nodes according with the demand information according to the task intelligent contract and each data information, each target data node can send target resource data meeting the requirement information to the selected resource nodes in the fog computing network under the trigger of the verification node, then the selected resource nodes in the fog computing network calculate each target resource data to generate a calculation result, and then the calculation result is sent to a storage position carried by the big data computing intelligent contract. In summary, when the big data calculation is realized through the technical scheme of the invention, the big data calculation demand node does not need to access the data node, the calculation process of the big data calculation is only carried out on one or more resource nodes in the fog calculation network, the resource data of each data node cannot be directly shared to the big data calculation demand node, and the leakage of the resource data of the data node through the big data calculation demand node can be prevented.
2. In one embodiment of the invention, the fog computing resource node can select a relatively idle storage node and an idle computing node from the fog computing network, generate an intelligent contract of a storage task according to a first node identifier of the idle storage node, a target data type and a target data identifier carried in demand information, and generate an intelligent contract of a computing task according to a second node identifier of the idle computing node and a computing method carried in the demand information; in the subsequent process, the verification node may select at least one target data node from the at least one data node according to the intelligent storage task contract (each target data node should be capable of providing resource data having a target data identifier and a data format of the target data node is a target data type), and trigger each target data node, so that each target data node stores the target resource data to the idle storage node according to the first node identifier carried in the intelligent storage task contract. Therefore, the resource data needed in the big data calculation process can be stored in the relatively idle storage nodes in the fog calculation network, the relatively idle storage nodes in the fog calculation network can more efficiently finish the access of the target resource data, and the big data calculation efficiency is improved.
3. In an embodiment of the present invention, after each target data node stores corresponding target resource data to a selected idle storage node, the verification node may trigger the selected idle computing node according to a second node identifier carried in a computation task intelligent contract, so that the idle computing node reads each target resource data stored in the idle storage node, and performs computation on each target resource data according to a computation method carried in the computation task intelligent contract to generate a computation result, and then stores the generated computation result to a storage location. Therefore, the computing task in the big data computing process can be executed through the idle computing nodes in the fog computing network, the idle computing nodes can more efficiently complete the computing task in the big data computing process, and the big data computing efficiency is improved.
4. In an embodiment of the invention, when the fog computing resource node selects a corresponding idle storage node from the fog computing network, a private key and a public key corresponding to the idle storage node can be generated, in the subsequent process, each target data node triggered by the verification node can encrypt target resource data according to the public key carried in the intelligent contract of the storage task to form a ciphertext corresponding to the target resource data, and after the ciphertext is stored in the idle storage node, the idle storage node can decrypt the corresponding target resource data according to the corresponding private key, so that the target resource data can be prevented from being maliciously stolen in the process of being transmitted from the data node to the idle storage node.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a" does not exclude the presence of other similar elements in a process, method, article, or apparatus that comprises the element.
Finally, it is to be noted that: the above description is only a preferred embodiment of the present invention, and is only used to illustrate the technical solutions of the present invention, and not to limit the protection scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (6)
1. A big data calculation method based on block chain and fog calculation is characterized by comprising the following steps:
determining a data resource directory through an information issuing node, forming an intelligent contract according to the data resource directory, and issuing the intelligent contract to a block chain network;
issuing data information of resource data owned by the current data node to the block chain network through at least one data node according to the data resource catalog carried by the intelligent contract;
generating a big data calculation intelligent contract and issuing the big data calculation intelligent contract to the block chain network through a big data calculation demand node according to each data information and the data resource catalog carried by the intelligent contract, wherein the big data calculation intelligent contract carries demand information and a storage position;
selecting at least one resource node from a fog computing network through a fog computing resource node, generating a task intelligent contract according to the selected at least one resource node and the demand information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network;
triggering at least one target data node through a verification node according to the task intelligent contract and each data information;
sending target resource data corresponding to the demand information to the selected at least one resource node under the trigger of the verification node through the at least one target data node;
calculating each target resource data according to the requirement information through the selected at least one resource node to generate a calculation result, and storing the generated calculation result to the storage position;
the requirement information comprises: target data type, target data identification and calculation method;
the method comprises the following steps of selecting at least one resource node from a fog computing network through the fog computing resource node, generating a task intelligent contract according to the selected at least one resource node and the demand information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network, and comprises the following steps:
selecting an idle storage node and an idle computing node from the fog computing network through the fog computing resource node;
generating a storage task intelligent contract by the fog computing resource node according to a first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract and the target data identifier;
generating a computing task intelligent contract by the fog computing resource node according to a second node identifier of the idle computing node and the computing method carried by the big data computing intelligent contract;
then the process of the first step is carried out,
the triggering of at least one target data node by the verification node according to the task intelligent contract and each data information comprises the following steps: selecting at least one target data node from the at least one data node through a verification node according to the intelligent contract of the storage task, and triggering the at least one target data node;
the sending, by the at least one target data node, target resource data corresponding to the demand information to the selected at least one resource node under the trigger of the verification node includes: and storing target resource data to the idle storage node according to the target data type and the target data identification carried by the storage task intelligent contract under the trigger of the verification node through the at least one target data node.
2. The method of claim 1,
the calculating each target resource data according to the selected at least one resource node according to the demand information to generate a calculation result, and storing the generated calculation result to the storage location, including:
reading each target resource data stored in the idle storage node through the idle computing node, computing each target resource data according to the computing method carried by the intelligent contract of the computing task to generate a computing result, and storing the generated computing result to the storage position.
3. The method of claim 1,
the selecting, by the fog computing resource node, a free storage node and a free computing node from the fog computing network further comprises: generating a private key and a public key corresponding to the idle storage node;
then, the generating, by the fog computing resource node, a storage task intelligent contract according to the first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract, and the target data identifier includes: generating a storage task intelligent contract by the fog computing resource node according to a first node identifier of the idle storage node, the target data type carried by the big data computing intelligent contract, the public key and the target data identifier;
the storing target resource data to the idle storage node according to the target data type and the target data identifier carried by the storage task intelligent contract under the trigger of the verification node by the at least one target data node comprises: and determining target resource data according to the target data type and the target data identification carried by the intelligent contract of the storage task under the trigger of the verification node through the at least one target data node, encrypting the target resource data according to the public key carried by the intelligent contract of the storage task to form a ciphertext corresponding to the target resource data, and sending the ciphertext corresponding to the target resource data to the idle storage node.
4. A big data computing system based on blockchain and fog computing, comprising:
the system comprises an information publishing node, at least one data node, a big data computing demand node, a fog computing resource node, a verification node, a block chain network and a fog computing network comprising at least one resource node; wherein,
the information issuing node is used for determining a data resource directory, forming an intelligent contract according to the data resource directory, and issuing the intelligent contract to a block chain network;
the at least one data node is used for issuing data information of resource data owned by the current data node to the block chain network according to the data resource catalog carried by the intelligent contract; when the node serving as the target data is triggered by the verification node, sending target resource data corresponding to the demand information to the selected at least one resource node;
the big data calculation demand node is used for generating a big data calculation intelligent contract according to the data information and the data resource catalog carried by the intelligent contract and issuing the big data calculation intelligent contract to the block chain network, wherein the big data calculation intelligent contract carries demand information and a storage position;
the fog computing resource node is used for selecting at least one resource node from a fog computing network, generating a task intelligent contract according to the selected at least one resource node and the demand information carried by the big data computing intelligent contract, and issuing the task intelligent contract to the block chain network;
the verification node is used for triggering at least one target data node according to the task intelligent contract and each piece of data information;
the resource node is used for calculating each target resource data according to the demand information to generate a calculation result after being selected by the fog calculation resource node, and storing the generated calculation result to the storage position;
the requirement information comprises: target data type, target data identification and calculation method;
the fog computing resource node is used for selecting an idle storage node and an idle computing node from the fog computing network; generating a storage task intelligent contract according to the target data type and the target data identification carried by the intelligent contract calculated according to the first node identification of the idle storage node and the big data; generating a calculation task intelligent contract according to the second node identification of the idle calculation node and the calculation method carried by the big data calculation intelligent contract;
then the process of the first step is carried out,
the verification node is used for selecting at least one target data node from the at least one data node according to the intelligent contract of the storage task and triggering the at least one target data node;
and the data node is used for storing target resource data to the idle storage node according to the target data type and the target data identifier carried by the intelligent contract of the storage task when the target data node is triggered by the verification node.
5. The system of claim 4,
and the resource node is used for reading each target resource data stored in the idle storage node when the fog computing resource node is selected as an idle computing node, computing each target resource data according to the computing method carried by the intelligent contract of the computing task to generate a computing result, and storing the generated computing result to the storage position.
6. The system of claim 4,
the fog computing resource node comprising: the system comprises a secret key generation module and a contract processing module; wherein,
the secret key generating module is used for generating a private key and a public key corresponding to the idle storage node;
the contract processing module is used for calculating the target data type carried by the intelligent contract according to the first node identification of the idle storage node, the big data, the public key and the target data identification to generate an intelligent contract of a storage task;
and the data node is used for determining target resource data according to the target data type and the target data identification carried by the intelligent contract of the storage task when the target data node is triggered by the verification node, encrypting the target resource data according to the public key carried by the intelligent contract of the storage task to form a ciphertext corresponding to the target resource data, and sending the ciphertext corresponding to the target resource data to the idle storage node.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810324751.7A CN108596627B (en) | 2018-04-11 | 2018-04-11 | Big data calculation method and system based on block chain and fog calculation |
| PCT/CN2018/113896 WO2019196397A1 (en) | 2018-04-11 | 2018-11-05 | Big data computing method and system based on blockchain and fog computing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810324751.7A CN108596627B (en) | 2018-04-11 | 2018-04-11 | Big data calculation method and system based on block chain and fog calculation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108596627A CN108596627A (en) | 2018-09-28 |
| CN108596627B true CN108596627B (en) | 2022-03-01 |
Family
ID=63622177
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810324751.7A Active CN108596627B (en) | 2018-04-11 | 2018-04-11 | Big data calculation method and system based on block chain and fog calculation |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108596627B (en) |
| WO (1) | WO2019196397A1 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108596627B (en) * | 2018-04-11 | 2022-03-01 | 山东浪潮科学研究院有限公司 | Big data calculation method and system based on block chain and fog calculation |
| CN109358969B (en) * | 2018-10-09 | 2021-11-23 | 浙江工业大学 | Mobile block chain optimization calculation power distribution method based on linear search under single edge calculation server scene |
| CN111107122B (en) * | 2018-10-29 | 2023-08-18 | 上海诺基亚贝尔股份有限公司 | Method, apparatus and computer readable medium for discovering fog resources in a network |
| CN109302405B (en) * | 2018-10-31 | 2020-11-17 | 北京邮电大学 | Industrial data detection block chain network system based on edge calculation and detection method |
| CN109583891B (en) * | 2018-11-14 | 2021-08-24 | 咪咕文化科技有限公司 | Information processing method, device and storage medium |
| CN110866067B (en) * | 2019-11-06 | 2022-06-24 | 华南理工大学 | Body area network real-time data processing method and system based on fog calculation and block chain |
| CN112364317B (en) * | 2020-11-17 | 2024-04-19 | 中国传媒大学 | Internet of things fog environment management architecture and method based on blockchain technology |
| CN114745379B (en) * | 2022-03-21 | 2023-07-11 | 北京卓视智通科技有限责任公司 | Block chain and fog calculation based Internet of things equipment system and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106101199A (en) * | 2016-06-02 | 2016-11-09 | 西安电子科技大学 | A kind of cloud based on SDN/mist hybrid network framework |
| CN106529932A (en) * | 2016-11-01 | 2017-03-22 | 西安电子科技大学 | Bitcoin-based outsourcing calculating fair payment method |
| GB201710373D0 (en) * | 2017-06-28 | 2017-08-09 | Wfs Technologies Ltd | Subsea communication system |
| CN107071033A (en) * | 2017-04-20 | 2017-08-18 | 济南浪潮高新科技投资发展有限公司 | A kind of car networking deployment system calculated based on mist |
| CN107249046A (en) * | 2017-08-15 | 2017-10-13 | 李俊庄 | A kind of distributed cloud storage system construction method based on block chain |
| CN107483446A (en) * | 2017-08-23 | 2017-12-15 | 上海点融信息科技有限责任公司 | Encryption method, equipment and system for block chain |
| CN107528856A (en) * | 2017-09-27 | 2017-12-29 | 福建实达电脑设备有限公司 | Internet of Things mist end equipment based on block chain platform access authentication method beyond the clouds |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11829998B2 (en) * | 2016-06-07 | 2023-11-28 | Cornell University | Authenticated data feed for blockchains |
| WO2018019364A1 (en) * | 2016-07-26 | 2018-02-01 | NEC Laboratories Europe GmbH | Method for controlling access to a shared resource |
| CN106682530A (en) * | 2017-01-10 | 2017-05-17 | 杭州电子科技大学 | Method and device for medical information sharing privacy protection based on blockchain technology |
| CN107465656B (en) * | 2017-06-14 | 2020-09-11 | 广州宏和网络科技有限公司 | Security monitoring big data processing method and system based on cloud computing |
| CN107786639A (en) * | 2017-09-28 | 2018-03-09 | 山东鲁能智能技术有限公司 | A kind of electric automobile networked system and its method of work based on block chain technology |
| CN107819848A (en) * | 2017-11-08 | 2018-03-20 | 济南浪潮高新科技投资发展有限公司 | A kind of internet of things equipment autonomy interconnected method based on block chain |
| CN108596627B (en) * | 2018-04-11 | 2022-03-01 | 山东浪潮科学研究院有限公司 | Big data calculation method and system based on block chain and fog calculation |
-
2018
- 2018-04-11 CN CN201810324751.7A patent/CN108596627B/en active Active
- 2018-11-05 WO PCT/CN2018/113896 patent/WO2019196397A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106101199A (en) * | 2016-06-02 | 2016-11-09 | 西安电子科技大学 | A kind of cloud based on SDN/mist hybrid network framework |
| CN106529932A (en) * | 2016-11-01 | 2017-03-22 | 西安电子科技大学 | Bitcoin-based outsourcing calculating fair payment method |
| CN107071033A (en) * | 2017-04-20 | 2017-08-18 | 济南浪潮高新科技投资发展有限公司 | A kind of car networking deployment system calculated based on mist |
| GB201710373D0 (en) * | 2017-06-28 | 2017-08-09 | Wfs Technologies Ltd | Subsea communication system |
| CN107249046A (en) * | 2017-08-15 | 2017-10-13 | 李俊庄 | A kind of distributed cloud storage system construction method based on block chain |
| CN107483446A (en) * | 2017-08-23 | 2017-12-15 | 上海点融信息科技有限责任公司 | Encryption method, equipment and system for block chain |
| CN107528856A (en) * | 2017-09-27 | 2017-12-29 | 福建实达电脑设备有限公司 | Internet of Things mist end equipment based on block chain platform access authentication method beyond the clouds |
Non-Patent Citations (2)
| Title |
|---|
| 区块链技术在物联网中的应用分析;张建强等;《电信科学》;20180120;第104-110页 * |
| 地理信息***在岩土工程勘察工程中的应用策略;付坤丹等;《世界有色金属》;20180125(第06期);第237-238页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019196397A1 (en) | 2019-10-17 |
| CN108596627A (en) | 2018-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108596627B (en) | Big data calculation method and system based on block chain and fog calculation | |
| CN109495592B (en) | Data collaboration method and electronic equipment | |
| Liu et al. | Design pattern as a service for blockchain-based self-sovereign identity | |
| WO2020106638A1 (en) | Blockchain transaction analysis and anti-money laundering compliance systems and methods | |
| CN111047321A (en) | Service processing method and device, electronic equipment and storage medium | |
| CN111556120A (en) | Data processing method and device based on block chain, storage medium and equipment | |
| CN111008335B (en) | Information processing method, device, equipment and storage medium | |
| CN111597567B (en) | Data processing method, data processing device, node equipment and storage medium | |
| CN111488372A (en) | Data processing method, device and storage medium | |
| Zhang et al. | Achieving privacy-preserving multitask allocation for mobile crowdsensing | |
| CN107342866A (en) | Electronic document verification method, equipment and system | |
| CN110910143A (en) | Identity identification generation method, device, related node and medium | |
| Tong et al. | Privacy-preserving data integrity verification for secure mobile edge storage | |
| CN112966309A (en) | Service implementation method and device based on block chain | |
| CN114266680A (en) | Block chain-based electronic contract signing method, device and system | |
| TW201738776A (en) | Real-time streaming record data analysis system and method using a computed result obtained by a computing process as the system and method for increasing the future computing efficiency | |
| CN109828832B (en) | Block chain-based data circulation method, device, equipment and medium | |
| Khan et al. | Lucy with agents in the sky: trustworthiness of cloud storage for industrial internet of things | |
| CN113536384B (en) | Block chain-based private data mapping method, block chain-based private data mapping device, block chain-based private data mapping medium and electronic equipment | |
| CN113064899B (en) | Method and device for storing asset securities type general evidence transaction certificates and electronic equipment | |
| CN114969805A (en) | Service query method and device, electronic equipment and storage medium | |
| CN110781523B (en) | Method and apparatus for processing information | |
| Liu et al. | Video data integrity verification method based on full homomorphic encryption in cloud system | |
| CN107347008A (en) | Electronic document verification method, equipment and system | |
| Shin et al. | Identification of corrupted cloud storage in batch auditing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220209 Address after: 250100 building S02, No. 1036, Langchao Road, high tech Zone, Jinan City, Shandong Province Applicant after: Shandong Inspur Scientific Research Institute Co.,Ltd. Address before: 250100 First Floor of R&D Building 2877 Kehang Road, Sun Village Town, Jinan High-tech Zone, Shandong Province Applicant before: JINAN INSPUR HIGH-TECH TECHNOLOGY DEVELOPMENT Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20180928 Assignee: INSPUR SOFTWARE Co.,Ltd. Assignor: Shandong Inspur Scientific Research Institute Co.,Ltd. Contract record no.: X2023980030294 Denomination of invention: A big data computing method and system based on blockchain and fog computing Granted publication date: 20220301 License type: Exclusive License Record date: 20230110 |