CN116170445A - Industrial data processing system based on cloud computing - Google Patents
Industrial data processing system based on cloud computing Download PDFInfo
- Publication number
- CN116170445A CN116170445A CN202310112522.XA CN202310112522A CN116170445A CN 116170445 A CN116170445 A CN 116170445A CN 202310112522 A CN202310112522 A CN 202310112522A CN 116170445 A CN116170445 A CN 116170445A
- Authority
- CN
- China
- Prior art keywords
- data
- cloud computing
- processing
- industrial data
- industrial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses an industrial data processing system based on cloud computing, belongs to the field of data processing, and solves the problem of how to perform high-efficiency data transmission and data processing on industrial data through cloud computing; according to the method, the data summarizing terminal closest to the cloud computing platform is selected to transfer other data summarizing terminals or industrial data sent by the data collecting terminal, and the industrial data is sent to the cloud platform; therefore, the industrial data can be quickly transmitted to the cloud platform after being acquired, and meanwhile, the data acquisition terminal can also reduce the network connection times with the cloud platform and reduce the paralysis probability of the cloud platform server; the setting of the data transmission control server can reasonably allocate each processing server node to acquire and process industrial data, and each storage server node stores the processed industrial data, so that the cloud platform can reasonably adjust the server and network resources in real time to process and store the industrial data.
Description
Technical Field
The invention belongs to the field of data processing, and particularly relates to an industrial data processing system based on cloud computing.
Background
Along with the development of internet information technology, industrial data is in mass growth, and the traditional data processing mode is mainly realized through centralized processing, so that server paralysis and data packet loss are easy to cause.
Patent (201811553127.0) discloses a data processing system based on a cloud computing platform, comprising: the system comprises a data acquisition terminal, a data classification module, a cloud computing platform, a charging module, a background management terminal, a data encryption module, an illegal intrusion alarm module and a display terminal. The cloud computing platform based on the cloud computing platform has the advantages that a large amount of data of a plurality of different industries or companies can be processed, the operation cost of the companies is saved, the office efficiency of the companies is improved, the data security of the companies can be protected, the theft is prevented, the alarm can be given out timely after illegal invasion is found, the cloud computing platform based on the cloud computing platform is suitable for processing the data uploaded by clients and directly collecting the data through the collecting terminal, and the cloud computing platform based on the cloud computing platform is wide in application range. However, this prior art only improves office efficiency of a company and protects data security to some extent, but does not solve how to efficiently transmit data and process data.
Therefore, the invention provides an industrial data processing system based on cloud computing.
Disclosure of Invention
The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, the invention provides an industrial data processing system based on cloud computing, which solves the problem of how to perform high-efficiency data transmission and data processing on industrial data through cloud computing.
To achieve the above object, an embodiment according to a first aspect of the present invention proposes an industrial data processing system based on cloud computing, comprising: the cloud computing system comprises a plurality of data acquisition terminals, a cloud computing platform, a plurality of user terminals and a monitoring management background;
the data acquisition terminals are used for acquiring different types of industrial data in real time and transmitting the industrial data to the cloud computing platform;
the cloud computing platform is used for processing and storing the acquired industrial data; the cloud computing platform comprises a distributed processing server cluster, a distributed storage server cluster and a data transmission control server; the data transmission control server calculates a processing analysis value according to list information, CPU utilization rate, memory utilization rate and network utilization rate of data processing processes uploaded by a plurality of processing server nodes in the distributed processing server cluster, and selects a processing server node of which the processing analysis value is smaller than a preset threshold value and closest to a data summarizing terminal to acquire industrial data and process the industrial data; meanwhile, the data transmission control server also selects one or more storage server nodes which are closest to the distributed processing server cluster and have the residual storage space larger than a preset threshold value in the distributed storage server cluster to acquire industrial data after analysis and processing for storage;
the user terminal is used for searching and checking the industrial data stored in the distributed storage server cluster;
the monitoring management background is used for monitoring and managing the data transmission and data processing processes of the data acquisition terminal, the cloud computing platform and the user terminal.
Further, the types of industrial data are text type, picture type, video type, and audio type.
Further, a plurality of data acquisition terminals are connected with each other; the data acquisition terminals detect the running speed, the signal intensity and the real-time acquired data quantity of the data acquisition terminals in real time, and the data acquisition terminals with high running speed, strong signal intensity and low real-time acquired data quantity are selected as data summarizing terminals; and selecting the data summarizing terminal nearest to the cloud computing platform to transfer the industrial data sent by other data summarizing terminals or data collecting terminals.
Further, the plurality of data acquisition terminals transmit the acquired industrial data to the data summarizing terminal closest to the industrial data.
Further, the data transmission control server marks the number of data processing processes of the same processing server node as Ai, marks the CPU utilization as Ci, marks the memory utilization as Ni, and marks the network utilization as Wi; where i denotes a processing server node number, i=1, 2 … … i;
according to the calculation formula pi=α×ai+β×ci+γ×ni+δ×wi; acquiring a processing analysis value of an ith processing server node; wherein α, β, γ, and δ are correction coefficients.
Further, the user terminal is a mobile phone mobile terminal, a PC terminal or a tablet terminal.
Further, the user terminal is provided with an authorized login unit, and the authorized login unit is used for authenticating the identity of the user, and accessing the industrial data stored in the distributed storage server cluster after authentication is successful.
Further, the monitoring management background monitors whether each server is attacked in real time, and processes the server with the stuck state in real time.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the invention, a plurality of data acquisition terminals select the data acquisition terminal with high running speed, strong signal strength and low real-time acquisition data quantity as a data summarizing terminal by detecting the running speed, the signal strength and the real-time acquisition data quantity of the data acquisition terminals, select the data summarizing terminal closest to a cloud computing platform to transfer other data summarizing terminals or industrial data sent by the data acquisition terminal, and send the industrial data to the cloud platform; therefore, the industrial data can be quickly transmitted to the cloud platform after being acquired, and meanwhile, the data acquisition terminal can also reduce the network connection times with the cloud platform and reduce the paralysis probability of the cloud platform server.
2. According to the invention, a data transmission control server calculates a processing analysis value according to list information, CPU utilization rate, memory utilization rate and network utilization rate of data processing processes uploaded by a plurality of processing server nodes in a distributed processing server cluster, and selects a processing server node with a small processing analysis value and nearest to a data summarizing terminal to acquire industrial data and process the industrial data; meanwhile, the data transmission control server also selects one or more storage server nodes which have large residual storage space and are closer to the distributed processing server cluster to acquire industrial data after analysis and processing; therefore, the industrial data are acquired and processed by each processing server node and the processed industrial data are stored by each storage server node, so that the cloud platform can reasonably adjust the server and network resources in real time to process and store the industrial data.
Drawings
Fig. 1 is a schematic diagram of a system structure according to the present invention.
Detailed Description
The technical solutions of the present invention will be clearly and completely described in connection with the embodiments, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
As shown in fig. 1, an industrial data processing system based on cloud computing, comprising: the cloud computing system comprises a plurality of data acquisition terminals, a cloud computing platform, a plurality of user terminals and a monitoring management background;
in the application, the data acquisition terminal is arranged on an industrial production site and is used for acquiring industrial data in real time and sending the acquired industrial data to the cloud computing platform;
in the industrial production process, according to the type of the process for producing the product and the safety monitoring management in the production process, the type of the industrial data can be a text type, a picture type, a video type, an audio type and the like;
the data acquisition terminals are used for acquiring different types of industrial data and are connected with each other; the data acquisition terminals detect the running speed, the signal intensity and the real-time acquired data quantity of the data acquisition terminals in real time, the data acquisition terminals with the running speed higher than a preset running speed threshold, the signal intensity higher than a preset signal intensity threshold and the real-time acquired data quantity lower than a preset acquired data quantity threshold are selected as data summarizing terminals, and the data summarizing terminal closest to the cloud computing platform is selected to carry out transfer of other data summarizing terminals or industrial data sent by the data acquisition terminals; the data collecting terminals transmit the collected and acquired industrial data to the data summarizing terminal closest to the cloud computing platform, and the data summarizing terminals summarize the acquired industrial data and transmit the industrial data to the data summarizing terminal closest to the cloud computing platform for data transfer;
in the application, the cloud computing platform is used for processing and storing the acquired industrial data; the cloud computing platform comprises a distributed processing server cluster, a distributed storage server cluster and a data transmission control server;
the distributed processing server cluster is used for analyzing and processing the acquired industrial data; the industrial data after analysis and processing are transmitted to a distributed storage server cluster; the distributed processing server cluster comprises at least one processing server node; a plurality of processing server nodes are connected with each other; the plurality of processing server nodes upload list information of a plurality of data processing processes of the processing server nodes to the data transmission control server; the processing server nodes also upload the information of CPU utilization rate, memory utilization rate and network utilization rate to the data transmission control server;
the distributed storage server cluster is used for carrying out distributed storage on industrial data which is analyzed and processed by the distributed processing server cluster; the distributed storage server cluster comprises at least one storage server node; a plurality of storage server nodes are connected with each other; the storage server nodes upload the storage space utilization condition information and the residual storage space information of the storage server nodes to a data transmission control server;
the data transmission control server is used for controlling a plurality of processing server nodes of the distributed processing server cluster to acquire industrial data; specifically, the data transmission control server acquires list information of data processing processes uploaded by a plurality of processing server nodes, CPU utilization rate, memory utilization rate and network utilization rate;
the number of data processing processes of the same processing server node is marked as Ai, the CPU utilization rate is marked as Ci, the memory utilization rate is marked as Ni, and the network utilization rate is marked as Wi; where i denotes a processing server node number, i=1, 2 … … i;
according to the calculation formula pi=α×ai+β×ci+γ×ni+δ×wi; acquiring a processing analysis value of an ith processing server node; wherein alpha, beta, gamma and delta are correction coefficients;
the data transmission control server presets a processing analysis value threshold, and selects a processing server node with the processing analysis value smaller than the processing analysis threshold and a processing server node nearest to the data summarizing terminal to acquire the transmitted industrial data and process the data;
in addition, the data transmission control server is also used for distributing the storage of the industrial data which is output after the distributed processing server cluster processes;
specifically, the data transmission control server acquires the residual storage space uploaded by a plurality of storage server nodes, presets a residual storage space threshold, selects one or more storage server nodes which are closer to the distributed processing server cluster to acquire industrial data after analysis processing, wherein the residual storage space is larger than the residual storage space threshold;
in the application, the user terminal is used for searching and viewing industrial data stored in the distributed storage server cluster;
specifically, the user terminal may be a mobile phone mobile terminal, a PC terminal or a tablet terminal;
the user terminal is provided with an authorized login unit for authenticating the identity of the user, and can access industrial data stored in the distributed storage server cluster after successful authentication;
in the application, the monitoring management background is used for monitoring and managing the data transmission and data processing processes of the data acquisition terminal, the cloud computing platform and the user terminal;
the monitoring management background monitors whether each server is attacked in real time and processes the server with the stuck state in real time.
The above formulas are all formulas with dimensions removed and numerical values calculated, the formulas are formulas which are obtained by acquiring a large amount of data and performing software simulation to obtain the closest actual situation, and preset parameters and preset thresholds in the formulas are set by a person skilled in the art according to the actual situation or are obtained by simulating a large amount of data.
The working principle of the invention is as follows: according to the invention, a plurality of data acquisition terminals acquire industrial data, and the plurality of data acquisition terminals select the data acquisition terminals with high running speed, strong signal strength and low real-time acquisition data as data summarizing terminals by detecting the running speed, the signal strength and the real-time acquisition data, select the data summarizing terminals closest to a cloud computing platform to transfer other data summarizing terminals or industrial data transmitted by the data acquisition terminals, and transmit the industrial data to the cloud platform; the distributed processing server cluster in the cloud platform processes the acquired industrial data, and the distributed storage server cluster performs distributed storage on the processed industrial data; the data transmission control server calculates a processing analysis value according to list information, CPU utilization rate, memory utilization rate and network utilization rate of data processing processes uploaded by a plurality of processing server nodes in the distributed processing server cluster, and selects a processing server node with a small processing analysis value and nearest to the data summarizing terminal to acquire industrial data and process the industrial data; meanwhile, the data transmission control server also selects one or more storage server nodes which have large residual storage space and are closer to the distributed processing server cluster to acquire industrial data after analysis and processing; searching and checking industrial data stored in the distributed storage server cluster by a plurality of user terminals; and the monitoring management background monitors and manages the whole process of data transmission and data processing of the data acquisition terminal, the cloud computing platform and the user terminal.
The above embodiments are only for illustrating the technical method of the present invention and not for limiting the same, and it should be understood by those skilled in the art that the technical method of the present invention may be modified or substituted without departing from the spirit and scope of the technical method of the present invention.
Claims (8)
1. An industrial data processing system based on cloud computing, comprising: the cloud computing system comprises a plurality of data acquisition terminals, a cloud computing platform, a plurality of user terminals and a monitoring management background;
the data acquisition terminals are used for acquiring different types of industrial data in real time and transmitting the industrial data to the cloud computing platform;
the cloud computing platform is used for processing and storing the acquired industrial data; the cloud computing platform comprises a distributed processing server cluster, a distributed storage server cluster and a data transmission control server; the data transmission control server calculates a processing analysis value according to list information, CPU utilization rate, memory utilization rate and network utilization rate of data processing processes uploaded by a plurality of processing server nodes in the distributed processing server cluster, and selects a processing server node of which the processing analysis value is smaller than a preset threshold value and closest to a data summarizing terminal to acquire industrial data and process the industrial data; meanwhile, the data transmission control server also selects one or more storage server nodes which are closest to the distributed processing server cluster and have the residual storage space larger than a preset threshold value in the distributed storage server cluster to acquire industrial data after analysis and processing for storage;
the user terminal is used for searching and checking the industrial data stored in the distributed storage server cluster;
the monitoring management background is used for monitoring and managing the data transmission and data processing processes of the data acquisition terminal, the cloud computing platform and the user terminal.
2. The cloud computing based industrial data processing system of claim 1, wherein the types of industrial data are text type, picture type, video type, and audio type.
3. The cloud computing-based industrial data processing system of claim 1, wherein a plurality of data acquisition terminals are interconnected; the data acquisition terminals detect the running speed, the signal intensity and the real-time acquired data quantity of the data acquisition terminals in real time, and the data acquisition terminals with high running speed, strong signal intensity and low real-time acquired data quantity are selected as data summarizing terminals; and selecting the data summarizing terminal nearest to the cloud computing platform to transfer the industrial data sent by other data summarizing terminals or data collecting terminals.
4. A cloud computing based industrial data processing system as claimed in claim 3 wherein a plurality of data acquisition terminals transmit acquired industrial data to the nearest data aggregation terminal.
5. The cloud computing based industrial data processing system of claim 1, wherein the data transmission control server marks the number of data processing processes of the same processing server node as Ai, marks CPU utilization as Ci, marks memory utilization as Ni, and marks network utilization as Wi; where i denotes a processing server node number, i=1, 2 … … i;
according to the calculation formula pi=α×ai+β×ci+γ×ni+δ×wi; acquiring a processing analysis value of an ith processing server node; wherein α, β, γ, and δ are correction coefficients.
6. The cloud computing-based industrial data processing system of claim 1, wherein the user terminal is a mobile phone mobile terminal, a PC terminal, or a tablet terminal.
7. The cloud computing-based industrial data processing system according to claim 1, wherein the user terminal is provided with an authorized login unit for authenticating the identity of the user, and accessing the industrial data stored in the distributed storage server cluster after authentication is successful.
8. The cloud computing-based industrial data processing system according to claim 1, wherein the monitoring management background monitors whether each server is attacked in real time and processes the server with the occurrence of a card in real time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310112522.XA CN116170445A (en) | 2023-02-14 | 2023-02-14 | Industrial data processing system based on cloud computing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310112522.XA CN116170445A (en) | 2023-02-14 | 2023-02-14 | Industrial data processing system based on cloud computing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116170445A true CN116170445A (en) | 2023-05-26 |
Family
ID=86412882
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310112522.XA Pending CN116170445A (en) | 2023-02-14 | 2023-02-14 | Industrial data processing system based on cloud computing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116170445A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117891614A (en) * | 2024-03-14 | 2024-04-16 | 山西泓禾惜贤科贸有限公司 | Big data analysis platform based on cloud service |
-
2023
- 2023-02-14 CN CN202310112522.XA patent/CN116170445A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117891614A (en) * | 2024-03-14 | 2024-04-16 | 山西泓禾惜贤科贸有限公司 | Big data analysis platform based on cloud service |
| CN117891614B (en) * | 2024-03-14 | 2024-05-14 | 山西泓禾惜贤科贸有限公司 | Big data analysis platform based on cloud service |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104967875A (en) | Method and device for controlling monitoring video checking authority | |
| CN107040608A (en) | A kind of data processing method and system | |
| CN106101264A (en) | Content distributing network daily record method for pushing, device and system | |
| CN111611129B (en) | Performance monitoring method and device of PaaS cloud platform | |
| CN116170445A (en) | Industrial data processing system based on cloud computing | |
| CN112463422A (en) | Internet of things fault operation and maintenance method and device, computer equipment and storage medium | |
| CN111338247A (en) | Simulation control system and method based on Internet of things | |
| CN111444072A (en) | Client abnormality identification method and device, computer equipment and storage medium | |
| CN116628774A (en) | Data storage integrity supervision system based on cloud computing | |
| CN117201501B (en) | Intelligent engineering sharing management system and operation method | |
| CN109753009A (en) | A kind of level monitoring online data management system | |
| CN102970768A (en) | Weather monitoring system based on time division long term evolution (TD-LTE) public network | |
| CN112969172A (en) | Communication flow control method based on cloud mobile phone | |
| CN112291303A (en) | Multidirectional distance dynamic monitoring and early warning method based on edge calculation | |
| CN115222181B (en) | Robot operation state monitoring system and method | |
| CN114745616A (en) | Underground heat information remote monitoring and early warning system and method | |
| CN115333917A (en) | CDN anomaly detection method and device | |
| CN114157577B (en) | Comprehensive management analysis system of Internet of things | |
| CN114666093B (en) | System security management and control method and device, storage medium and electronic equipment | |
| CN117112039B (en) | Transmission optimization system and operation method of data center | |
| CN117834540B (en) | Communication optimization method based on ultrasonic water meter, internet of things system and equipment | |
| CN117395198B (en) | Congestion alarm method and system for power communication network | |
| CN117939516A (en) | Power distribution communication network state monitoring system, method, computer equipment and computer readable storage medium | |
| CN116436684A (en) | Network flow analysis equipment and analysis method applied to high-performance calculation | |
| CN115409213A (en) | Digital road operation and maintenance method based on predictive maintenance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |