CN115766615A - Cloud edge-based equipment twin data management method and system - Google Patents
Cloud edge-based equipment twin data management method and system Download PDFInfo
- Publication number
- CN115766615A CN115766615A CN202211527281.7A CN202211527281A CN115766615A CN 115766615 A CN115766615 A CN 115766615A CN 202211527281 A CN202211527281 A CN 202211527281A CN 115766615 A CN115766615 A CN 115766615A
- Authority
- CN
- China
- Prior art keywords
- data
- cloud
- rule
- edge
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a device twin data management method and system based on cloud edges, which comprises the following steps that a cloud end receives a registration request of a receiving device terminal, wherein the registration request comprises a device data portrait; establishing a data storage or uploading policy rule of the equipment terminal based on the equipment data portrait to form an equipment rule base; the equipment terminal respectively uploads the generated data to a cloud end or stores the data to an edge node according to an equipment rule base; according to the invention, through an edge computing technology framework based on cloud originality, a transmission component and a processing component are issued from a cloud end to an edge node for deployment, data uploading pre-management is directly carried out on the edge, whether the data needs to be stored on the edge side is analyzed by combining the characteristics of various devices and the data thereof, and the data is uploaded to the cloud end for storage and use through a transmission system by combining the conditions of edge cloud networks before transmission, so that the online rate and the real-time performance of the data are improved, and the application value of twin data of the devices is improved.
Description
Technical Field
The invention relates to the technical field of data management, in particular to a method and a system for equipment twin data management based on cloud edges.
Background
With the development and the gradual maturity of cloud computing and internet of things technologies and the continuous expansion of 5G network scale, the number of terminal devices is rapidly increased, and the devices generate mass data in the whole life cycle.
The data that equipment produced are all uploaded to the cloud center and are handled under traditional internet of things technical framework, processing speed has received the influence of factors such as cloud center computing power, network bandwidth, data excessively rely on the network when uploading, transmission speed is influenced by the network, there is the hysteresis in data, the expansion of data volume has increased cloud center storage simultaneously, the high consumption of computational resource, how manage effectively uploading of magnanimity equipment data, better realize the mapping between equipment entity and the virtual world, the problem that needs to solve has become urgent.
The data volume generated by the terminal equipment is huge, the computing power and the resource size of the terminal equipment are different, the requirement of directly processing mass data locally after data generation cannot be met, meanwhile, the data cannot be uploaded in real time under a complex network environment, and even the risk of direct loss is faced, so that the twin information mapping and data fusion analysis accuracy of follow-up equipment is influenced.
Disclosure of Invention
Aiming at the defects existing in the problems, the invention provides a method and a system for managing twin data of equipment based on cloud edges.
In order to achieve the above object, the present invention provides a cloud edge-based device twin data management method, including:
the cloud receives a registration request of a receiving equipment terminal, wherein the registration request comprises an equipment data portrait;
establishing a data storage or uploading strategy rule of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the equipment terminal respectively uploads the generated data to the cloud or stores the data to an edge node according to the equipment rule base;
wherein, constructing the device rule base comprises constructing a cloud rule base, and the steps comprise:
setting a storage rule and a cloud-going rule for the data of the equipment terminal;
the storage rule comprises a storage size and a rotation rule;
the cloud uploading rule comprises configuring the data uploading priority weight;
the number of repetitions is configured.
Preferably, the constructing the device rule base further includes updating the rule base of the edge node, and the step includes:
the cloud is provided with a controller, and the controller is used for detecting the cloud rule base and sending the rules of the cloud rule base to the edge node;
the edge node is provided with an agent which is in communication connection with the controller and receives rules from the controller.
Preferably, the agent receiving the rule from the controller includes:
if the rule is received for the first time, directly storing the rule;
if not, the difference from the first configuration rule is updated.
Preferably, the edge node runs a data transmission component and a data processing component;
the data transmission component comprises a queue to be uploaded, the data are uploaded to the queue to be uploaded based on the rule base of the edge node, the data are uploaded to the cloud end through a priority weight sequence, and when the data are uploaded to the cloud end, the data are sorted according to the priority from the first to the last if the same priority weight occurs;
the data processing component maintains a data storage state based on the storage rule.
Preferably, the device data representation includes a protocol type and format description, a device attribute and data structure description, and a device access mode description.
The invention also comprises a cloud edge-based equipment twin data management system, which comprises:
the system comprises a registration module, a display module and a display module, wherein the registration module is used for receiving a registration request of a receiving equipment terminal by a cloud end, and the registration request comprises an equipment data portrait;
the establishing module is used for establishing a data storage or uploading strategy rule of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the uploading storage module is used for the equipment terminal to respectively upload the generated data to the cloud or store the data to the edge node according to the equipment rule base;
wherein, constructing the device rule base comprises constructing a cloud rule base, and the steps comprise:
setting a storage rule and a cloud-going rule for the data of the equipment terminal;
the storage rule comprises a storage size and a rotation rule;
the cloud uploading rule comprises configuring the data uploading priority weight;
the number of repetitions is configured.
Preferably, the step of constructing the device rule base further comprises updating the rule base of the edge node, and comprises:
the cloud is provided with a controller, and the controller is used for detecting the cloud rule base and sending the rules of the cloud rule base to the edge node;
the edge node is provided with an agent which is in communication connection with the controller and receives the rule from the controller.
Preferably, the agent receiving the rule from the controller includes:
if the rule is received for the first time, directly storing the rule;
if not, the difference from the first configuration rule is updated.
Preferably, the edge node runs a data transmission component and a data processing component;
the data transmission assembly comprises a queue to be uploaded, the data are uploaded to the queue to be uploaded based on the rule base of the edge node, the data are uploaded to the cloud end through a priority weight sequence, and when the data are uploaded to the cloud end, if the same priority weight appears, the data are sorted in a first-come-last-come sequence;
the data processing component maintains a data storage state based on the storage rule.
Preferably, the device data representation includes a protocol type and format description, a device attribute and data structure description, and a device access mode description.
Compared with the prior art, the invention has the beneficial effects that:
according to the invention, through an edge computing technology framework based on cloud originality, a transmission component and a processing component are issued from a cloud end to an edge node for deployment, data uploading pre-management is directly carried out on the edge, whether the data needs to be stored on the edge side is analyzed by combining the characteristics of various devices and the data thereof, and the data is uploaded to the cloud end for storage and use through a transmission system by combining the conditions of edge cloud networks before transmission, so that the online rate and the real-time performance of the data are improved, and the application value of twin data of the devices is improved.
Drawings
FIG. 1 is a flow chart of a twin data management method of a cloud edge-based device according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
Referring to fig. 1, the present invention provides a cloud edge-based device twin data management method, including:
the cloud receives a registration request of a receiving equipment terminal, wherein the registration request comprises an equipment data portrait, and the equipment data portrait comprises protocol type and format description, equipment attribute and data structure description and equipment access mode description;
establishing a data storage or uploading policy rule of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the equipment terminal respectively uploads the generated data to a cloud end or stores the data to an edge node according to an equipment rule base;
wherein, constructing the device rule base comprises constructing a cloud rule base, and the steps comprise:
setting a storage rule and a cloud rule for data of the equipment terminal;
the storage rule comprises the steps of setting storage size and rotation rule;
the cloud uploading rule comprises a configuration data uploading priority weight, and the weight value range is between 0 and 100;
the number of repetitions is configured.
Specifically, the cloud-up rule further includes a configuration threshold, which is used to determine which data to upload preferentially when the network is unstable, and the configuration fields are as follows:
further, the step of constructing the device rule base further comprises updating the rule base of the edge node, and the step comprises:
the cloud end is provided with a controller, and the controller is used for detecting the cloud end rule base and sending the rules of the cloud end rule base to the edge node; the controller is used for continuously monitoring the newly added and changed rules of the rule configuration sensing equipment in the cloud rule base, if the newly added and changed rules exist, the latest rules are issued to edge nodes where the equipment is located in real time, and only the changed rules are updated in an incremental mode in the issuing process;
the edge node is provided with an agent, the agent is communicated with the cloud end controller through a quic or websocket, and the rule from the controller is received. And analyzing whether the configuration is primarily issued or not during receiving, and storing the configuration into the edge node disk when the configuration is received for the first time. And performing incremental updating on the content in the disk by the matching difference between the subsequent updating configuration and the initial configuration. The edge device senses the updated content in real time, applies the configuration change in real time and realizes the configuration hot update.
The edge node runs a data transmission component and a data processing component, and the transmission component and the processing component are deployed into the edge node generating data through a cloud native edge computing technology;
the data transmission component obtains the rule base of all the equipment on the edge node in a mounting mode so as to obtain equipment rule configuration; the data transmission assembly comprises a queue to be uploaded, data are uploaded to the queue to be uploaded based on a rule base of an edge node, the data are uploaded to the cloud end through a priority weight sequence, when the data are uploaded to the cloud end, if the same priority weight appears, sequencing is carried out according to the priority of the data, and at the moment, the sequence of an uploading list can be changed. When the same priority occurs, the ordering is performed according to a first-come-first-come principle. The priority of long-waiting low-priority data is gradually increased along with time, so that the phenomenon of starvation is avoided, and the cloud receives uploaded data and then stores the uploaded data into a corresponding database;
the data processing component maintains a data storage state based on the storage rule.
By the method, the importance degree of the data is considered in the data uploading of the edge nodes, the high-value data transfer efficiency is improved, and the data vitality under the complex network environment is enhanced; the method can realize tagging full-life cycle management of the twin data aiming at the twin data of the devices with different characteristics, improve the real-time performance and the online rate of the data of the traditional Internet of things devices, improve the data value and reduce the cloud resource cost.
The invention also comprises a cloud edge-based equipment twin data management system, which comprises:
the system comprises a registration module, a data processing module and a data processing module, wherein the registration module is used for receiving a registration request of a receiving equipment terminal by a cloud, the registration request comprises an equipment data portrait, and the equipment data portrait comprises protocol type and format description, equipment attribute and data structure description and equipment access mode description;
the establishing module is used for establishing a data storage or uploading strategy rule of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the uploading and storing module is used for the equipment terminal to respectively upload the generated data to the cloud or store the data to the edge node according to the equipment rule base;
wherein, constructing the device rule base comprises constructing a cloud rule base, and the steps comprise:
setting a storage rule and a cloud rule for data of the equipment terminal;
the storage rule comprises setting storage size and rotation rule;
the cloud uploading rule comprises a configuration data uploading priority weight, and the weight value range is between 0 and 100;
the number of repetitions is configured.
Specifically, the cloud-up rule further includes a configuration threshold, which is used to determine which data to upload preferentially when the network is unstable, and the configuration fields are as follows:
further, the step of constructing the device rule base further comprises updating the rule base of the edge node, and the step comprises:
the cloud is provided with a controller, and the controller is used for detecting the cloud rule base and sending the rules of the cloud rule base to the edge node; the controller is used for continuously monitoring the newly added and changed rules of the rule configuration sensing equipment in the cloud rule base, if the newly added and changed rules exist, the latest rules are issued to edge nodes where the equipment is located in real time, and only the changed rules are updated in an incremental mode in the issuing process;
the edge node is provided with an agent, the agent and the cloud end controller communicate through quic or websocket and receive rules from the controller. And analyzing whether the configuration is primarily issued or not during receiving, and storing the configuration into the edge node disk when the configuration is received for the first time. And performing incremental updating on the content in the disk by the matching difference between the subsequent updating configuration and the initial configuration. And the edge equipment senses the updated content in real time, applies the configuration change in real time and realizes the hot update of the configuration.
The edge node runs a data transmission component and a data processing component, and the transmission component and the processing component are deployed into the edge node generating data through a cloud native edge computing technology;
the data transmission component obtains the rule base of all the equipment on the edge node in a mounting mode so as to obtain equipment rule configuration; the data transmission assembly comprises a queue to be uploaded, data are uploaded to the queue to be uploaded based on a rule base of the edge node, the data are uploaded to the cloud end through a priority weight sequence, when the data are uploaded to the cloud end, if the same priority weight appears, sequencing is carried out according to the order from the first to the last, and at the moment, the uploading list sequence can be changed. When the same priority occurs, the ordering is performed according to a first-come-first-come principle. The priority of long-waiting low-priority data is gradually increased along with time, so that the phenomenon of starvation is avoided, and the cloud end receives uploaded data and then stores the data into a corresponding database;
the data processing component maintains a data storage state based on the storage rule.
The present invention has been described in terms of the preferred embodiment, and it is not intended to be limited to the embodiment. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A cloud edge-based device twin data management method is characterized by comprising the following steps:
the cloud receives a registration request of a receiving equipment terminal, wherein the registration request comprises equipment data portrait;
establishing a data storage or uploading strategy rule of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the equipment terminal respectively uploads the generated data to the cloud or stores the data to an edge node according to the equipment rule base;
wherein, constructing the device rule base comprises constructing a cloud rule base, and the steps comprise:
setting a storage rule and a cloud rule for the data of the equipment terminal;
the storage rule comprises a storage size and a rotation rule;
the cloud uploading rule comprises configuring the data uploading priority weight;
the number of repetitions is configured.
2. The cloud edge-based device twin data management method according to claim 1, wherein building a device rule base further includes updating a rule base of edge nodes, and the steps include:
the cloud is provided with a controller, and the controller is used for detecting the cloud rule base and sending the rules of the cloud rule base to the edge node;
the edge node is provided with an agent which is in communication connection with the controller and receives the rule from the controller.
3. The cloud edge-based device twin data management method of claim 2, wherein the agent receiving the rule from the controller includes:
if the rule is received for the first time, directly storing the rule;
if not, the difference from the first configuration rule is updated.
4. The cloud edge-based device twin data management method of claim 3, wherein the edge node runs a data transmission component and a data processing component;
the data transmission assembly comprises a queue to be uploaded, the data are uploaded to the queue to be uploaded based on the rule base of the edge node, the data are uploaded to the cloud end through a priority weight sequence, and when the data are uploaded to the cloud end, if the same priority weight appears, the data are sorted in a first-come-last-come sequence;
the data processing component maintains a data storage state based on the storage rule.
5. The cloud edge-based device twin data management method according to claim 1, wherein the device data image includes a protocol type and format description, a device attribute and data structure description, and a device access mode description.
6. A cloud-edge-based device twin data management system, comprising:
the system comprises a registration module, a display module and a display module, wherein the registration module is used for receiving a registration request of a receiving equipment terminal by a cloud end, and the registration request comprises an equipment data portrait;
the establishing module is used for establishing a data storage or uploading strategy rule of the equipment terminal based on the equipment data portrait to form an equipment rule base;
the uploading storage module is used for the equipment terminal to respectively upload the generated data to the cloud or store the data to the edge node according to the equipment rule base;
wherein, constructing the device rule base comprises constructing a cloud rule base, and the steps comprise:
setting a storage rule and a cloud rule for the data of the equipment terminal;
the storage rule comprises a storage size and a rotation rule;
the cloud uploading rule comprises configuring the data uploading priority weight;
the number of repetitions is configured.
7. The cloud edge-based device twin data management system of claim 6, wherein building a device rule base further comprises updating a rule base of edge nodes, comprising:
the cloud is provided with a controller, and the controller is used for detecting the cloud rule base and sending the rules of the cloud rule base to the edge node;
the edge node is provided with an agent which is in communication connection with the controller and receives rules from the controller.
8. The cloud edge based device twin data management system of claim 7, wherein the agent receiving rules from the controller includes:
if the rule is received for the first time, directly storing the rule;
if not, the difference from the first configuration rule is updated.
9. The cloud edge-based device twin data management system of claim 8, wherein the edge node runs a data transmission component and a data processing component;
the data transmission component comprises a queue to be uploaded, the data are uploaded to the queue to be uploaded based on the rule base of the edge node, the data are uploaded to the cloud end through a priority weight sequence, and when the data are uploaded to the cloud end, the data are sorted according to the priority from the first to the last if the same priority weight occurs;
the data processing component maintains a data storage state based on the storage rule.
10. The cloud edge-based device twin data management system according to claim 6, wherein the device data image includes a protocol type and format description, a device attribute and data structure description, a device access mode description.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211527281.7A CN115766615B (en) | 2022-11-30 | 2022-11-30 | Cloud-edge-based equipment twin data management method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211527281.7A CN115766615B (en) | 2022-11-30 | 2022-11-30 | Cloud-edge-based equipment twin data management method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115766615A true CN115766615A (en) | 2023-03-07 |
| CN115766615B CN115766615B (en) | 2023-08-25 |
Family
ID=85341846
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211527281.7A Active CN115766615B (en) | 2022-11-30 | 2022-11-30 | Cloud-edge-based equipment twin data management method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115766615B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111770014A (en) * | 2020-06-17 | 2020-10-13 | 上海乾隆节能科技有限公司 | Data information processing method, edge gateway and system for processing data information |
| CN112559133A (en) * | 2020-12-22 | 2021-03-26 | 北京滴普科技有限公司 | Cloud-edge coordination system and cloud-edge coordination method based on native container technology |
| KR102262321B1 (en) * | 2019-11-29 | 2021-06-08 | 주식회사 두두원 | IoT GATEWAY SYSTEM FOR INDUSTRIAL |
| CN112988327A (en) * | 2021-03-04 | 2021-06-18 | 杭州谐云科技有限公司 | Container safety management method and system based on cloud edge cooperation |
| CN113708974A (en) * | 2021-09-03 | 2021-11-26 | 南方电网数字电网研究院有限公司 | Edge cloud network system based on self-adaptive networking and cooperation method |
| CN114338353A (en) * | 2021-12-31 | 2022-04-12 | 新开普电子股份有限公司 | Internet of things platform operation and maintenance method based on cloud edge cooperation |
| CN115002148A (en) * | 2022-04-21 | 2022-09-02 | 浪潮云信息技术股份公司 | Internet of things cloud side communication method and system |
-
2022
- 2022-11-30 CN CN202211527281.7A patent/CN115766615B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102262321B1 (en) * | 2019-11-29 | 2021-06-08 | 주식회사 두두원 | IoT GATEWAY SYSTEM FOR INDUSTRIAL |
| CN111770014A (en) * | 2020-06-17 | 2020-10-13 | 上海乾隆节能科技有限公司 | Data information processing method, edge gateway and system for processing data information |
| CN112559133A (en) * | 2020-12-22 | 2021-03-26 | 北京滴普科技有限公司 | Cloud-edge coordination system and cloud-edge coordination method based on native container technology |
| CN112988327A (en) * | 2021-03-04 | 2021-06-18 | 杭州谐云科技有限公司 | Container safety management method and system based on cloud edge cooperation |
| CN113708974A (en) * | 2021-09-03 | 2021-11-26 | 南方电网数字电网研究院有限公司 | Edge cloud network system based on self-adaptive networking and cooperation method |
| CN114338353A (en) * | 2021-12-31 | 2022-04-12 | 新开普电子股份有限公司 | Internet of things platform operation and maintenance method based on cloud edge cooperation |
| CN115002148A (en) * | 2022-04-21 | 2022-09-02 | 浪潮云信息技术股份公司 | Internet of things cloud side communication method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115766615B (en) | 2023-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7039685B2 (en) | Traffic measurement methods, devices, and systems | |
| CN111242282B (en) | Deep learning model training acceleration method based on end edge cloud cooperation | |
| CN107181724B (en) | Identification method and system of cooperative flow and server using method | |
| Li et al. | DeepNFV: A lightweight framework for intelligent edge network functions virtualization | |
| CN112866059B (en) | Lossless network performance testing method and device based on artificial intelligence application | |
| CN110968426B (en) | Edge cloud collaborative k-means clustering model optimization method based on online learning | |
| WO2022095356A1 (en) | Transfer learning method for image classification, related device, and storage medium | |
| WO2020042612A1 (en) | Method and device for storing and reading a message, server, and storage medium | |
| CN111404932A (en) | Method for accessing medical institution system to smart medical cloud service platform | |
| CN112291728A (en) | Private industry application platform implementation architecture based on 5G network | |
| CN112491609A (en) | System application architecture discovery method and system based on business service | |
| WO2020147601A1 (en) | Graph learning system | |
| CN113408675A (en) | Intelligent unloading optimization method and system based on federal learning | |
| CN112887356A (en) | System for sharing memory data distribution service and operation method thereof | |
| CN113301126B (en) | Edge computing method suitable for heterogeneous networking gateway | |
| CN115766615A (en) | Cloud edge-based equipment twin data management method and system | |
| CN110515716B (en) | Cloud optimization scheduling method and system supporting priority and inverse affinity | |
| CN114625805B (en) | Return test configuration method, device, equipment and medium | |
| CN116320033A (en) | Resource scheduling optimization method and device | |
| CN115879543A (en) | Model training method, device, equipment, medium and system | |
| CN114884893A (en) | Forwarding and control definable cooperative traffic scheduling method and system | |
| CN112106327B (en) | Resource management and resource allocation method in self-optimization network of heterogeneous processing nodes | |
| CN113467718A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN115484161A (en) | TSN network configuration method, device and computer readable storage medium | |
| CN112527453A (en) | Virtualization information simulation system, method and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |