CN116414081A - Intelligent workshop real-time monitoring method based on digital twinning - Google Patents
Intelligent workshop real-time monitoring method based on digital twinning Download PDFInfo
- Publication number
- CN116414081A CN116414081A CN202111683650.7A CN202111683650A CN116414081A CN 116414081 A CN116414081 A CN 116414081A CN 202111683650 A CN202111683650 A CN 202111683650A CN 116414081 A CN116414081 A CN 116414081A
- Authority
- CN
- China
- Prior art keywords
- workshop
- data
- dimension
- real
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 79
- 238000000034 method Methods 0.000 title claims abstract description 62
- 230000000007 visual effect Effects 0.000 claims abstract description 49
- 238000013507 mapping Methods 0.000 claims abstract description 46
- 238000010276 construction Methods 0.000 claims abstract description 22
- 238000004519 manufacturing process Methods 0.000 claims description 68
- 230000008569 process Effects 0.000 claims description 27
- 239000000463 material Substances 0.000 claims description 19
- 230000003993 interaction Effects 0.000 claims description 18
- 238000007726 management method Methods 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 9
- 230000000694 effects Effects 0.000 claims description 9
- 230000003190 augmentative effect Effects 0.000 claims description 8
- 230000006399 behavior Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 7
- 238000003754 machining Methods 0.000 claims description 7
- 238000013523 data management Methods 0.000 claims description 6
- 238000013461 design Methods 0.000 claims description 6
- 238000009877 rendering Methods 0.000 claims description 6
- 238000013500 data storage Methods 0.000 claims description 5
- 238000001514 detection method Methods 0.000 claims description 5
- 230000006870 function Effects 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 5
- 238000003860 storage Methods 0.000 claims description 5
- 238000005457 optimization Methods 0.000 claims description 4
- 238000004088 simulation Methods 0.000 claims description 4
- 238000012800 visualization Methods 0.000 claims description 4
- 230000009471 action Effects 0.000 claims description 3
- 230000008520 organization Effects 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000004140 cleaning Methods 0.000 claims description 2
- 238000007405 data analysis Methods 0.000 claims description 2
- 238000007418 data mining Methods 0.000 claims description 2
- 230000004927 fusion Effects 0.000 claims description 2
- 239000011521 glass Substances 0.000 claims description 2
- 238000005192 partition Methods 0.000 claims description 2
- 238000007619 statistical method Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 14
- 230000033772 system development Effects 0.000 abstract description 3
- 239000000047 product Substances 0.000 description 25
- 230000018109 developmental process Effects 0.000 description 16
- 238000011161 development Methods 0.000 description 13
- 230000010354 integration Effects 0.000 description 8
- 230000008901 benefit Effects 0.000 description 5
- 230000009466 transformation Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000003801 milling Methods 0.000 description 3
- 239000012141 concentrate Substances 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 108010015780 Viral Core Proteins Proteins 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000010923 batch production Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000005242 forging Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000011265 semifinished product Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 238000003466 welding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
- G05B19/406—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by monitoring or safety
- G05B19/4065—Monitoring tool breakage, life or condition
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/37—Measurements
- G05B2219/37616—Use same monitoring tools to monitor tool and workpiece
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Manufacturing & Machinery (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to a digital twinning-based intelligent workshop real-time monitoring method. The invention builds a six-dimensional model of a workshop three-dimensional visual monitoring system based on digital twinning by taking an industrial Internet of things platform as a system service platform, and comprises a physical workshop dimension, a virtual workshop dimension, an industrial Internet of things platform service dimension, a twinning data dimension, a front-end display dimension and a connection dimension, introduces a three-dimensional visual monitoring system development flow, and then expounds key technologies such as twinning data acquisition, virtual workshop construction, data real-time mapping and the like in system development on the basis. Aiming at the current situation that workshop data acquisition is difficult, the twin data acquisition method based on the industrial Internet of things platform is provided, and a solution is provided for realizing three-dimensional visual monitoring of the workshop.
Description
Technical Field
The invention belongs to the field of intelligent manufacturing, and particularly relates to a digital twinning-based intelligent workshop real-time monitoring method.
Background
With the development of information technology and the continuous promotion of industrialization, the automation and informatization level of the manufacturing industry are continuously improved, and more manufacturing enterprises adopt an automatic production line to engage in production and manufacturing activities. The automatic production line is put into use in a large quantity, so that the production of mass products can be met, and the economic benefit of enterprises is obviously improved; however, on one hand, enterprises lack quick and effective means for managing and monitoring the running state of workshops due to low informatization management level, and on the other hand, the transparency of the production process is difficult to realize due to the fact that the management systems on the market are various, and effective information interaction means are lacked between the management systems and the control systems. The traditional workshop monitoring mode mainly comprises modes of manual recording, two-dimensional report forms, configuration monitoring and the like, and has poor real-time performance and visual effect.
Digital twinning is also known as digital mirroring, digital mapping, or digital twinning. The digital twin is to fully utilize data such as a physical model, sensor update, operation history and the like, integrate simulation processes of multiple disciplines, multiple physical quantities, multiple scales and multiple probabilities, and complete mapping in a virtual space, thereby reflecting the full life cycle process of corresponding entity equipment.
Digital twin technology has shown greater and greater application potential in various fields such as electric power, automobiles, medical treatment, ships, urban construction, traffic planning and the like, and becomes a key technology for realizing an information physical system, but the application of digital twin in related fields is hindered due to the lack of a general digital twin theoretical model and a construction method. At present, the digital twin theoretical model comprises a classical digital twin conceptual model, a digital twin five-dimensional model, a CPS5C model, a C2PS model and the like, and the theoretical models can be summarized into three major core elements of data, models and services, and the requirements of a workshop three-dimensional visual monitoring system are consistent with the three-dimensional visual monitoring system.
At present, the difficulty of three-dimensional visual monitoring of a workshop is surrounded to obtain a certain research result, such as workshop data acquisition and workshop event modeling; the visual monitoring of workshops is changed from two dimensions to three dimensions, more workshop information can be provided, and the monitoring transparency is improved. However, there are some problems that the development threshold of the visual monitoring system is high, the development efficiency is low, the portability of the system is poor, the monitoring mode is single, and the manufacturing state of the workshop can not be reflected well; a theoretical model of the monitoring system is lacking.
Disclosure of Invention
Aiming at the problems existing in the prior art, the invention provides a workshop three-dimensional visual monitoring system which is based on digital twinning, takes an industrial Internet of things platform as a data bus and can dynamically display the production process in real time. The problems of low monitoring transparency, single mode, poor real-time performance and the like of a workshop monitoring system are solved, the real-time high-transparency diversified monitoring of a production line is met, and the management and control integration of workshop manufacturing resources is realized.
In order to solve the problems, the technical scheme of the invention is as follows:
a digital twinning-based intelligent workshop real-time monitoring system is used for establishing the following six dimensions and obtaining a digital twinning workshop three-dimensional visual monitoring six-dimensional model:
the physical workshop dimension is that the physical workshop is an entity set of workshop environment and production line equipment, receives a production task issued by an upper service system, executes production activities and completes the production task according to a predefined production instruction after virtual workshop simulation optimization;
the dimension of the virtual workshop, which describes the relation between the geometric parameters of the physical workshop and the model action through three-dimensional modeling, so that the virtual workshop has space-time consistent twin mapping with the physical workshop;
the service dimension defines a set of services required by the monitoring implementation process and is used for providing services for the physical workshop dimension, the virtual workshop dimension, the twin data dimension and the front-end display dimension;
the twin data dimension is used for storing physical workshop dimension data and virtual workshop dimension data and providing data storage and query calling for other dimensions;
the front end display dimension is used for displaying all monitoring contents to a user;
the connection interface dimension is an interface for each dimension to communicate with each other, and includes: the method comprises the steps of connecting a physical workshop with a virtual workshop, connecting the physical workshop with twin data, connecting the twin data with front-end display, connecting the front-end display with the virtual workshop, and connecting an industrial Internet of things platform with each dimension.
The physical workshop dimension is divided into four layers of equipment level, unit level, production line level and workshop level according to functions and structures.
The virtual workshop dimension comprises the steps of adopting model rendering, virtual reality modeling and further optimizing a geometric model: the physical workshop has real texture due to the addition of light, materials and special effects, and is used for realizing scene roaming with the front-end display dimension through man-machine interaction interface design and external input event response.
The service dimension is mainly realized by an industrial Internet of things platform, three-dimensional modeling software and virtual reality development software, and the service is divided into: functional services and business services;
the functional services include:
model services provided for the virtual workshops include model construction, model rendering, virtual scene construction, and model driving based on real-time data;
the data management service provided for the digital twin dimension comprises data storage, data cleaning, data packaging, data mining, data fusion and data analysis; the system is also used for storing real-time data into a twin data dimension through a standard database interface, and simultaneously calling historical data in the twin data dimension by a service dimension to perform data statistical analysis and calculation;
providing connection services for connection dimension, including interface services and protocol services;
a business service, a service provided for a front-end presentation dimension, comprising: the method provides various monitoring means for workshop managers: monitor large screen, augmented reality glasses, intelligent mobile device.
The front-end presentation dimension includes: the system comprises a three-dimensional virtual scene module, a state billboard module, a real-time video module and an augmented reality module;
the three-dimensional virtual scene module receives data provided by a connection interface of a physical workshop and a virtual workshop, and realizes visual control on the workshop manufacturing process from three aspects of logistics, equipment and products by taking the three-dimensional virtual scene module as a monitoring mode;
the state board module is used for displaying real-time and statistical information of each production resource;
the real-time video module is used for realizing real-time and visual monitoring of the key nodes of the workshop through a plurality of industrial cameras arranged on the scene;
the augmented reality module is used for superposing virtual information on the real world through three-dimensional modeling, real-time tracking registration, intelligent interaction and sensors, so that visual display of the internal motion state of the equipment is realized.
The connection interface dimensions include:
the connection interface of the physical workshop and the virtual workshop is used for collecting data of the physical workshop in real time and transmitting the data to a model corresponding to the virtual workshop;
the connection interface of the physical workshop and the service dimension of the industrial Internet of things platform is used for realizing the two-way communication of the physical workshop and the service dimension of the industrial Internet of things platform by utilizing a standard software interface, and realizing data acquisition, transmission and storage;
the physical workshop and twinning data connecting interface is used for acquiring physical workshop dimension data in real time by utilizing a sensor, data acquisition equipment and a communication protocol and transmitting the physical workshop dimension data to twinning data dimension;
the connection interface of the service dimension of the virtual workshop and the service dimension of the industrial Internet of things platform is used for realizing the two-way communication of the service dimension of the virtual workshop and the service dimension of the industrial Internet of things platform by utilizing a standard software interface, and realizing model driving based on real-time data;
the connection interface between the twin data and the front-end display is corresponding service provided according to service dimension through TCP/IP and UDP network communication mode, and data interaction between the front-end display and the twin data is realized.
The virtual shop floor dimension further comprises: establishing a workshop production system operation model for describing workshop dynamic behaviors, and sending the workshop dynamic behaviors to a front-end display dimension for visual monitoring display;
describing operation logic of a production system by adopting an operation logic modeling method, and converting twin data in a workshop manufacturing process into corresponding workshop events to drive the change of equipment states and the circulation of workpieces among different stations so as to realize real-time mapping of logistics;
establishing a virtual workshop by adopting a virtual model construction method; realizing real-time mapping of logistics by adopting event driving; realizing real-time mapping of equipment by adopting model driving;
and realizing real-time mapping of products according to the combination of the logistics real-time mapping and the equipment real-time mapping with the process flow.
The equipment-level data comprise protocol data and sensing data, and an industrial Internet of things platform is used as a data bus in the dimension of a physical workshop; collecting material information by using a high-frequency passive RFID, and collecting equipment data by using an OPC protocol and an equipment software development kit and combining a remote procedure call protocol;
based on a distributed file system, a NoSQL database, a relational database and a time sequence database management engine, the partition selection, storage, cataloging and indexing of workshop data in a twin data dimension are realized;
and the GET method based on the REST FUL architecture realizes data exchange between the upper-layer application and the industrial Internet of things platform.
Three-dimensional visualization of the workshop running state is realized through a twin data driving model, and real-time mapping based on twin data is realized through management of twin data and a virtual scene geometric model;
the virtual workshop dimension adopts a root-stem-leaf three-layer tissue structure to realize the management of a workshop geometric model: the workshop geometric model takes a workshop as a root level, takes workshop environments, personnel, a stereoscopic warehouse, logistics, machining and assembly detection units as stem levels, takes equipment forming each stem level as a leaf level, and is used for organizing workshop resources in a three-layer structure to accurately model personnel, equipment, a factory building and material objects possibly related to a digital manufacturing workshop in a geometric dimension; for the geometric model of the equipment hierarchy, the efficient driving of the model is realized by adopting an organization form of nesting of father and son nodes.
The invention has the following beneficial effects and advantages:
1. the invention provides a workshop three-dimensional visual monitoring system six-dimensional model based on digital twinning.
2. The invention provides the method for reducing the difficulty of workshop data acquisition and management by adopting the industrial Internet of things platform as the data bus and by means of strong equipment access, data management and system integration capability of the industrial Internet of things platform, so that the three-dimensional visual monitoring system can be developed and deployed quickly.
3. Compared with the traditional industrial workshop data acquisition, the data acquisition scheme has strong equipment access capability. Through the mature products and solutions of platform integrated industrial gateway, middleware, embedded operating system and the like, the connection between the platform and the resources can be quickly constructed, so that comprehensive collection of various production element data of personnel, equipment, software, materials, environment and the like is realized. The industrial Internet of things platform can flexibly realize data service based on scene driving for a developer based on the modes of an open source development tool, a micro-service architecture and the like. The industrial Internet of things platform screens the complex processes of equipment connection, software integration and deployment and computing resource scheduling for developers by solidifying resources such as technology, knowledge, experience and the like into a portable and reusable industrial microservice component library, and only needs to concentrate on the design of system functions, so that the development efficiency of the system is obviously improved.
4. The invention establishes a virtual workshop three-layer mapping system based on twin data driving from three aspects of logistics, equipment and products, and can describe the dynamic behavior of the workshop more accurately.
Drawings
FIG. 1 is a six-dimensional model of a three-dimensional visual monitoring system of a workshop;
FIG. 2 is a diagram of a three-dimensional visual monitoring system developing a twinning data acquisition path;
FIG. 3 is a flow chart of data collection based on an industrial Internet of things platform;
FIG. 4 is a flow chart of the intelligent workshop virtual scene construction;
FIG. 5 is a diagram of a virtual plant geometry model;
fig. 6 is an automated warehouse unit process flow diagram.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples.
In order to make the purposes, technical solutions and advantages of the present invention become more apparent, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention and the accompanying drawings.
The invention provides a six-dimensional model of a workshop three-dimensional visual monitoring system based on digital twinning, which comprises a physical workshop, a virtual workshop, service and twin data front end display, connection and the relation among the dimensions is shown in figure 1 by combining a digital twinning five-dimensional model architecture and a C2PS model 'cloud' deployment mode with the powerful data integration and system integration capability of an industrial Internet of things platform and taking the industrial Internet of things platform as a system service platform.
And (5) a physical workshop. The physical workshop is a building foundation of a six-dimensional model, has typical layering characteristics, and can be generally divided into four layers of equipment level, unit level, production line level and workshop level according to functions and structures. Taking an automatic production workshop as an example, each device in the workshop can be regarded as a device level, and is the minimum constituent unit of the workshop; according to the technological flow and process of the product, the equipment participating in the same process or working procedure is regarded as a unit level, such as an automatic warehouse unit, a logistics unit, a machining unit, an assembly unit, a detection unit, a packaging unit and the like; the production line formed by combining the unit-level devices for producing the same product or component can be regarded as a production line level; the production plant, which is formed by the production lines for processing the same type of product or component, can be regarded as a plant level, such as a stamping plant, a forging plant, a welding plant, etc.
The virtual workshop describes geometrical parameters of the physical workshop, including shape, size, position and assembly relation, through a three-dimensional modeling technology, so that the virtual workshop has good space-time consistency with the physical workshop. The geometric modeling is further perfected by adopting a model rendering technology, a virtual reality modeling language and the like, and the virtual workshop has real texture by adding necessary lights, materials and special effects; meanwhile, scene roaming is realized through man-machine interaction interface design, external input event response and the like.
The service refers to a set of services required by a six-dimensional model implementation process of the workshop three-dimensional visual monitoring system, and is mainly provided by an industrial Internet of things platform, three-dimensional modeling software, virtual reality development software and the like. Services can be divided into functional services and business services according to different application requirements, and the functional services provide support for realization and operation of the business services.
The twin data is the basis of six-dimensional model operation of the workshop three-dimensional visual monitoring system, and mainly comprises physical workshop data, virtual workshop data, service data and knowledge data. The physical workshop data are mainly used for describing physical element attribute data of equipment, plants, lamplight and the like forming the physical workshop and dynamic process data capable of reflecting the running state of the physical workshop, the physical element attribute data are mainly provided by equipment factories or measured in the field, and the dynamic process data are acquired through sensors, equipment interfaces, embedded acquisition cards, the Internet of things technology and the like; the virtual shop data mainly comprises data related to the virtual shop, such as data related to the physical shop model including a geometric model, a physical model, a behavior model, a rule model and the like; the service data mainly comprises functional service related data including models, algorithms, decision rules, database operations and the like, and business service related data including model dynamic process data, man-machine interaction data and the like; knowledge data includes expert knowledge, industry standards, common algorithms, common databases, common API interfaces, common model construction methods, and the like.
The development route of the workshop three-dimensional visual monitoring system based on digital twinning is shown in fig. 2. The mapping from the physical workshop to the virtual workshop is a core for realizing three-dimensional visual monitoring, and in order to establish a real mapping process, a workshop production system operation model needs to be established, so that the dynamic behavior of the workshop is accurately described. The operation logic modeling method is adopted to describe the operation logic of the production system, and real-time mapping of logistics is realized by converting the twin data of the workshop manufacturing process into corresponding workshop events, driving the change of equipment states and the circulation of workpieces among different stations. And establishing a virtual workshop by adopting a virtual model construction method. Realizing real-time mapping of logistics by adopting event driving and realizing real-time mapping of equipment by adopting model driving; the real-time mapping of the product is realized by combining the real-time mapping of the logistics and the real-time mapping of the equipment with the process flow, and finally the front-end display of the visual monitoring is realized through hardware. The development key technology of the three-dimensional visual monitoring system can be summarized into acquisition of twin data, construction of a workshop virtual scene and real-time mapping of the data.
The data of the industrial field is mainly contained in equipment, the equipment data can be divided into protocol data (including bus type data and API type data) and sensing data, and the mode of protocol data acquisition mainly comprises software direct acquisition, acquisition box acquisition, protocol conversion module and the like; the acquisition mode of the sensing data mainly comprises a multifunctional comprehensive data acquisition device, an integrated data acquisition device and the like. Although the above methods can collect data, due to the diversity of shop field devices, sensors, and communication specifications, if parsing rules are individually specified for various specifications, not only is the effort large but also the versatility is poor. Although some standardized protocols exist, such as OPC, MTconnect, the developer is still required to write programs by himself to collect plant data, and not all devices support data collection in the manner of standard protocols.
The data acquisition flow chart based on the industrial Internet of things platform is shown in fig. 3, the industrial Internet of things platform is used as a data bus, and the difficulty of workshop data acquisition and management is reduced by means of strong equipment access, data management and system integration capacity of the industrial Internet of things platform, so that the three-dimensional visual monitoring system can be developed and deployed rapidly. Typical industrial Internet of things platforms are COSMOPlat, oceanographic ion, thinwood, and the like. The advantage of using the industrial internet of things platform as a data bus is that: (1) The device has strong access capability, and can quickly construct the connection between the platform and the resource through the mature products and solutions such as the industrial gateway, middleware, embedded operating system and the like integrated by the platform, thereby realizing the comprehensive acquisition of various production element data such as personnel, equipment, software, materials, environment and the like. (2) The industrial Internet of things platform can flexibly realize data service based on scene driving for developers based on modes such as open source development tools, micro-service architecture and the like. The data application scene in the workshop three-dimensional visual monitoring system mainly comprises two parts: and providing data driving for the three-dimensional virtual scene based on the real-time data and providing decision support for the monitoring system based on the historical data. (3) The system development efficiency is high, the industrial Internet of things platform screens the complex processes of equipment connection, software integration and deployment and computing resource scheduling for developers by solidifying resources such as technology, knowledge, experience and the like into a transplantable and reusable industrial microservice component library, and only needs to concentrate on the design of system functions, so that the development efficiency of the system is obviously improved.
The workshop virtual scene construction flow is shown in fig. 4, and mainly comprises geometric modeling, scene construction, man-machine interaction, scene optimization and the like. Geometric modeling is the foundation of virtual scene construction; the scene construction is further perfection of geometric modeling, and the virtual scene has real texture by adding necessary lights, materials and special effects; the man-machine interaction comprises man-machine interaction interface design, external input event response and the like, and aims to realize scene roaming in a three-dimensional virtual scene; in order to balance the contradiction between the drawing complexity and the drawing instantaneity of the virtual scene, the fluency of the system in the large-scale scene is ensured, the virtual scene is required to be optimized, and finally the virtual workshop scene model is obtained.
The workshop three-dimensional visual monitoring system realizes three-dimensional visualization of the workshop running state through the twin data driving model, and not only effectively manages twin data, but also effectively manages the virtual scene geometric model for realizing real-time mapping based on the twin data. The management of the workshop geometric model is realized by adopting a three-layer tissue structure of root-stem-leaf, and the structure of the workshop geometric model is shown in figure 5.
The workshop geometric model takes a workshop as a root level, takes workshop environments, personnel, a stereoscopic warehouse, logistics, machining and assembly detection units as stem levels, takes equipment forming each stem level as a leaf level, and the structure organizes workshop resources in a three-layer structure to accurately describe objects such as personnel, equipment, workshops and materials possibly related to a digital manufacturing workshop in geometric dimension. Aiming at the geometric model of the equipment hierarchy, the efficient driving of the model is realized by adopting an organization form of nesting of father and son nodes. After the geometric model structure is determined, a workshop geometric model can be established through three-dimensional modeling software.
Scene construction
The visual monitoring system requires that the created virtual scene not only has good realism and immersion, but also has good man-machine interaction performance so as to meet the requirements of six-dimensional model service dimension of the three-dimensional visual monitoring system, so that the following points are considered when a development mode is selected: (1) The system has stronger model construction and processing capacity and supports the import and export of common formats; (2) The system has strong graphic processing capability, and can meet the optimized rendering output of graphics in complex scenes and large scenes; (3) The system should have an open source interface, be programmed using a common object-oriented computer language, and facilitate development of the system program.
Compared with a real-time video monitoring mode, the three-dimensional virtual scene has the remarkable advantage that the three-dimensional virtual scene can respond to man-machine interaction events, so that the content displayed by the virtual scene is changed. Scene roaming based on man-machine interaction mainly comprises the implementation of geometric transformation and the response of external input events, and can be realized by means of mouse click events, keyboard operation events and the like. The geometric transformation is the basis of scene roaming, and the motion of all models in the virtual scene and the scene roaming are realized based on the geometric transformation technology. Geometric transformation is the basis of various graphic processing methods, and by transforming the spatial positions of pixels, the new positions of the original coordinate points are displayed on the new spatial positions, and the geometric transformation comprises three steps of translation, rotation and scaling. In a three-dimensional visual monitoring system, a mouse and a keyboard are one of the most basic input modes. The change of the view angle direction of the camera, the distance between the vision distance, the switching of multiple scenes and the like in the scenes can be completed through the mouse operation. The change, forward, backward, left, right, up, down, etc. of the view direction of the camera in the scene can be accomplished by keyboard operations.
The real-time mapping from the physical workshop to the virtual workshop is a core for realizing three-dimensional visual monitoring of the workshop. In order to form visual real-time monitoring capable of covering the whole life cycle of workshop manufacture, a virtual workshop three-layer mapping system based on twin data driving is established from the aspects of logistics, equipment and products, so that the dynamic behaviors of the workshop are accurately described, (1) logistics layers are used for converting real-time state data of the workshop manufacture process into corresponding workshop events, and the circulation of the products among different stations is driven to realize logistics mapping; (2) The equipment hierarchy, the mapping of the equipment is the minimum mapping unit of a three-layer mapping system of a virtual workshop, the real-time perception of the action of the physical equipment is realized through the technology of the Internet of things, the technology of a sensor, the technology of an interface and the like, and the virtual and real synchronization of the physical equipment under the virtual environment is realized based on the driving of a virtual model by twin data; (3) The product level and the mapping of the product are that the process flow, the real-time position and the real-time state of the product are converted into workshop events on the basis of realizing the mapping of the equipment level and the logistics level, the dynamic change of a product model is realized on the basis of an event-driven method, and the real-time mapping of the product state is finally realized.
The logistics mapping in the virtual workshop three-layer mapping system is realized based on a workshop operation logic model dynamic mapping framework, and the twin data in the workshop manufacturing process is converted into corresponding changes of workshop event driving equipment states and the circulation of workpieces among different stations. The mixed-flow automation production line is a typical discrete event dynamic system, and the task execution process can be expressed as events and states, and is suitable for modeling by using a Petri network. The Petri net is a mathematical modeling language for describing a discrete event system, and since the proposal of the 60 th century of the 20 th century, the Petri net is widely developed and focused in the field of discrete manufacturing modeling due to visual and easy understanding, and an improved Petri net oriented to different fields is formed: (1) judging the net (EP-N); (2) a transition network (TP-N); (3) a colored web (CP-N); (4) an advanced network (HLP-N); (5) extending a random advanced decision Petri network. The ESHLP-N method defines a double token and a double mark, so that the effect is visual, and the analysis of the system performance is facilitated; in addition, by introducing the scheduling rules, the reasoning and decision capability of the ESHLP-N method is improved, so that the ESHLP-N method has good effects in modeling, scheduling and simulation optimization of a flexible manufacturing system. Production system operation logic is described herein using the ESHLP-N method to dynamically map physical shop field operation by driving production system state transitions through shop events. Taking a machining unit as an example, the process of establishing the ESHLEP-N model is described. The material delivery is the first process of an automatic production line. The stacker is controlled to take out corresponding materials from the stereoscopic warehouse according to the process requirements, and the materials are transported to a temporary storage area of the next process by a logistics system after visual detection or RFID inspection and verification of the material information. A process flow diagram of an automated warehouse unit is shown in fig. 6.
The plant events described herein are exemplified as follows:
the automatic production system for a seal mainly comprises an automatic warehouse unit, a logistics unit, a processing and manufacturing unit, an assembling unit and a control unit. The automatic warehouse unit consists of a roadway three-dimensional automatic warehouse, a stacker, a warehouse-in and warehouse-out platform and an RFID identification system and is mainly used for storing materials and finished products; the logistics unit consists of an AGV, a grabbing manipulator, an image recognition system, a transfer platform and a finished product area and is mainly used for circulation of logistics, finished products and semi-finished products among stations; the machining and manufacturing unit consists of an engraving and milling machine, a numerical control lathe and a loading and unloading robot, realizes automatic loading and unloading of the machine tool through cooperative control of a robot control system and a CNC system, and is mainly used for machining products; the assembling unit is composed of an assembling robot and a rotating platform and is mainly used for assembling the seal; the control unit is composed of a field master control PLC, a CNC system, a robot control system, an AGV control system, a man-machine interaction interface and an upper computer. The processed products have two types, namely official seal and private seal, and are typical multi-variety and small-batch production modes.
In order to realize transparent control of the production process, according to the six-dimensional model of the three-dimensional visual monitoring system provided by the foregoing, a Thingworx internet of things platform is used as a data application bus, and a Creo, 3D Max and Unity 3D multi-software collaborative modeling mode is used, based on the NET platform, the three-dimensional visual monitoring system of the seal production workshop is designed and developed, and the three-dimensional visual monitoring system consists of a physical layer, a twin layer, a platform layer, an application layer and a network layer: (1) the physical layer corresponds to a physical workshop (PS) of the six-dimensional model, is a collection of all elements of a seal production workshop, and comprises personnel, equipment, materials, process flows, plants and the like; (2) virtual workshops (VS) of the six-dimensional model corresponding to the twin layer are constructed in a multi-software cooperative mode, so that real mapping of the physical workshops (PS) is realized; (3) the platform layer corresponds to services (Ss) and twin data (DD) of the six-dimensional model, and based on strong ubiquitous connection, flexible data management and rapid application development capability of the platform of the Internet of things, equipment connection, data acquisition, data storage, data service, application development and WEB front-end system integration are realized; (4) front end display (FD) of the application layer corresponding to the six-dimensional model realizes multi-level monitoring by constructing a three-dimensional virtual scene, a state signboard, a real-time video and augmented reality; (5) the network layer corresponds to the Connection (CN) of the six-dimensional model, and the interconnection and the intercommunication of all parts of the system are realized through various standard/non-standard protocols and wired/wireless networking modes.
The field large screen monitors and displays three-dimensional virtual scenes, real-time monitoring videos and state billboard contents. The three-dimensional virtual scene can realize switching of different visual angles through man-machine interaction, and the real-time running state of the workshop is checked in an intuitive immersion mode; the real-time monitoring video is used for displaying the workshop site state of a fixed visual angle; the production report mainly shows daily output and monthly output of a seal production workshop. Besides the information displayed above, the information popup window is added on the automatic warehouse, the AGV unit, the numerical control lathe, the loading and unloading robot, the engraving and milling machine and the assembly robot model in the three-dimensional virtual scene, the real-time operation data of the equipment is intuitively displayed in a text mode, and the monitoring form is enriched. The popup window displays the position coordinates, temperature, electric quantity of the AGV and angles of all axes of the mechanical arm in an intuitive mode. The AR scene mainly uses the triaxial motion of a main shaft, a tool library and an engraving and milling machine of the numerical control lathe as a monitoring object, and the equipment runs an information popup window through real-time data driving, so that part of running data is directly displayed in a text form, and the real-time visualization of the internal motion state of the machine tool is realized. By researching and optimizing the virtual scene, the data acquisition mode, the data management strategy, the real-time data driving model method and the front-end and back-end data interaction mode, the real-time performance of the monitoring system is improved. The system after online operation is smooth, the real-time performance is good, through actual tests, virtual workshops (VS) and physical workshops data service virtual scene construction data service AR scene construction twin data state billboard scene file AR equipment is imported into an integrated physical layer, a twin layer, a platform layer, an application layer, a network layer, a physical layer and ThingWorx (PS) with a delay of about 0.5s, the monitoring requirements in the actual production process can be met, and the feasibility and the effectiveness of the three-dimensional virtual monitoring system are verified. The system is added with real-time video and augmented reality, the monitoring mode is richer, the delay of the constructed three-dimensional visual monitoring system is within 3s, and compared with the system, the real-time performance of the system is better.
Real-time mapping based on twin data is a key for realizing a workshop three-dimensional visual monitoring system. The logistics hierarchy realizes the real-time mapping of the material circulation process by converting the real-time data of the workshop manufacturing process into event driving; the equipment level and the model driving method are different according to different virtual workshop construction methods; and determining the real-time working procedure of the product according to the real-time position of the material, the technological process of the product and the state of the equipment, thereby realizing the real-time mapping of the product hierarchy.
The foregoing is merely illustrative of the present invention, and the present invention is not limited to the specific embodiments, and any person skilled in the art can easily change or replace the specific embodiments within the scope of the present invention. The protection scope of the invention is therefore subject to the claims.
Claims (9)
1. The intelligent workshop real-time monitoring system based on digital twinning is characterized in that the following six dimensions are established, and a digital twinning workshop three-dimensional visual monitoring six-dimensional model is obtained:
the physical workshop dimension is that the physical workshop is an entity set of workshop environment and production line equipment, receives a production task issued by an upper service system, executes production activities and completes the production task according to a predefined production instruction after virtual workshop simulation optimization;
the dimension of the virtual workshop, which describes the relation between the geometric parameters of the physical workshop and the model action through three-dimensional modeling, so that the virtual workshop has space-time consistent twin mapping with the physical workshop;
the service dimension defines a set of services required by the monitoring implementation process and is used for providing services for the physical workshop dimension, the virtual workshop dimension, the twin data dimension and the front-end display dimension;
the twin data dimension is used for storing physical workshop dimension data and virtual workshop dimension data and providing data storage and query calling for other dimensions;
the front end display dimension is used for displaying all monitoring contents to a user;
the connection interface dimension is an interface for each dimension to communicate with each other, and includes: the method comprises the steps of connecting a physical workshop with a virtual workshop, connecting the physical workshop with twin data, connecting the twin data with front-end display, connecting the front-end display with the virtual workshop, and connecting an industrial Internet of things platform with each dimension.
2. The digital twinning-based intelligent workshop real-time monitoring method according to claim 1, wherein the physical workshop dimension is divided into four layers of equipment level, unit level, production line level and workshop level according to functions and structures.
3. The digital twinning-based intelligent plant real-time monitoring method of claim 1, wherein the virtual plant dimensions comprise using model rendering, virtual reality modeling and further optimizing a geometric model: the physical workshop has real texture due to the addition of light, materials and special effects, and is used for realizing scene roaming with the front-end display dimension through man-machine interaction interface design and external input event response.
4. The digital twinning-based intelligent workshop real-time monitoring method according to claim 1, wherein the service dimension is mainly realized by an industrial internet of things platform, three-dimensional modeling software and virtual reality development software, and the service dimension is divided into: functional services and business services;
the functional services include:
model services provided for the virtual workshops include model construction, model rendering, virtual scene construction, and model driving based on real-time data;
the data management service provided for the digital twin dimension comprises data storage, data cleaning, data packaging, data mining, data fusion and data analysis; the system is also used for storing real-time data into a twin data dimension through a standard database interface, and simultaneously calling historical data in the twin data dimension by a service dimension to perform data statistical analysis and calculation;
providing connection services for connection dimension, including interface services and protocol services;
a business service, a service provided for a front-end presentation dimension, comprising: the method provides various monitoring means for workshop managers: monitor large screen, augmented reality glasses, intelligent mobile device.
5. The digital twinning-based intelligent workshop real-time monitoring method of claim 1, wherein the front-end presentation dimension comprises: the system comprises a three-dimensional virtual scene module, a state billboard module, a real-time video module and an augmented reality module;
the three-dimensional virtual scene module receives data provided by a connection interface of a physical workshop and a virtual workshop, and realizes visual control on the workshop manufacturing process from three aspects of logistics, equipment and products by taking the three-dimensional virtual scene module as a monitoring mode;
the state board module is used for displaying real-time and statistical information of each production resource;
the real-time video module is used for realizing real-time and visual monitoring of the key nodes of the workshop through a plurality of industrial cameras arranged on the scene;
the augmented reality module is used for superposing virtual information on the real world through three-dimensional modeling, real-time tracking registration, intelligent interaction and sensors, so that visual display of the internal motion state of the equipment is realized.
6. The digital twinning-based intelligent workshop real-time monitoring method of claim 1, wherein the connection interface dimensions comprise:
the connection interface of the physical workshop and the virtual workshop is used for collecting data of the physical workshop in real time and transmitting the data to a model corresponding to the virtual workshop;
the connection interface of the physical workshop and the service dimension of the industrial Internet of things platform is used for realizing the two-way communication of the physical workshop and the service dimension of the industrial Internet of things platform by utilizing a standard software interface, and realizing data acquisition, transmission and storage;
the physical workshop and twinning data connecting interface is used for acquiring physical workshop dimension data in real time by utilizing a sensor, data acquisition equipment and a communication protocol and transmitting the physical workshop dimension data to twinning data dimension;
the connection interface of the service dimension of the virtual workshop and the service dimension of the industrial Internet of things platform is used for realizing the two-way communication of the service dimension of the virtual workshop and the service dimension of the industrial Internet of things platform by utilizing a standard software interface, and realizing model driving based on real-time data;
the connection interface between the twin data and the front-end display is corresponding service provided according to service dimension through TCP/IP and UDP network communication mode, and data interaction between the front-end display and the twin data is realized.
7. The physical plant-to-virtual plant connection method of claim 3, wherein the virtual plant dimension further comprises: establishing a workshop production system operation model for describing workshop dynamic behaviors, and sending the workshop dynamic behaviors to a front-end display dimension for visual monitoring display;
describing operation logic of a production system by adopting an operation logic modeling method, and converting twin data in a workshop manufacturing process into corresponding workshop events to drive the change of equipment states and the circulation of workpieces among different stations so as to realize real-time mapping of logistics;
establishing a virtual workshop by adopting a virtual model construction method; realizing real-time mapping of logistics by adopting event driving; realizing real-time mapping of equipment by adopting model driving;
and realizing real-time mapping of products according to the combination of the logistics real-time mapping and the equipment real-time mapping with the process flow.
8. The digital twinning-based intelligent workshop real-time monitoring method according to claim 2, wherein,
the equipment-level data comprise protocol data and sensing data, and an industrial Internet of things platform is used as a data bus in the dimension of a physical workshop; collecting material information by using a high-frequency passive RFID, and collecting equipment data by using an OPC protocol and an equipment software development kit and combining a remote procedure call protocol;
based on a distributed file system, a NoSQL database, a relational database and a time sequence database management engine, the partition selection, storage, cataloging and indexing of workshop data in a twin data dimension are realized;
and the GET method based on the REST FUL architecture realizes data exchange between the upper-layer application and the industrial Internet of things platform.
9. The digital twinning-based intelligent workshop real-time monitoring method according to claim 1, wherein the three-dimensional visualization of the workshop running state is realized through a twinning data driving model, and the real-time mapping based on twinning data is realized through management of twinning data and a virtual scene geometric model;
the virtual workshop dimension adopts a root-stem-leaf three-layer tissue structure to realize the management of a workshop geometric model: the workshop geometric model takes a workshop as a root level, takes workshop environments, personnel, a stereoscopic warehouse, logistics, machining and assembly detection units as stem levels, takes equipment forming each stem level as a leaf level, and is used for organizing workshop resources in a three-layer structure to accurately model personnel, equipment, a factory building and material objects possibly related to a digital manufacturing workshop in a geometric dimension; for the geometric model of the equipment hierarchy, the efficient driving of the model is realized by adopting an organization form of nesting of father and son nodes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111683650.7A CN116414081A (en) | 2021-12-29 | 2021-12-29 | Intelligent workshop real-time monitoring method based on digital twinning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111683650.7A CN116414081A (en) | 2021-12-29 | 2021-12-29 | Intelligent workshop real-time monitoring method based on digital twinning |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116414081A true CN116414081A (en) | 2023-07-11 |
Family
ID=87051975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111683650.7A Pending CN116414081A (en) | 2021-12-29 | 2021-12-29 | Intelligent workshop real-time monitoring method based on digital twinning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116414081A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116821223A (en) * | 2023-08-25 | 2023-09-29 | 云南三耳科技有限公司 | Industrial visual control platform and method based on digital twinning |
| CN117332635A (en) * | 2023-09-21 | 2024-01-02 | 北京联远智维科技有限公司 | Structure online monitoring system and method based on digital twinning |
-
2021
- 2021-12-29 CN CN202111683650.7A patent/CN116414081A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116821223A (en) * | 2023-08-25 | 2023-09-29 | 云南三耳科技有限公司 | Industrial visual control platform and method based on digital twinning |
| CN116821223B (en) * | 2023-08-25 | 2023-11-24 | 云南三耳科技有限公司 | Industrial visual control platform and method based on digital twinning |
| CN117332635A (en) * | 2023-09-21 | 2024-01-02 | 北京联远智维科技有限公司 | Structure online monitoring system and method based on digital twinning |
| CN117332635B (en) * | 2023-09-21 | 2024-04-19 | 北京联远智维科技有限公司 | Structure online monitoring system and method based on digital twinning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109375595B (en) | Visual workshop monitoring method, device and equipment | |
| CN112818446B (en) | Construction method of intelligent workshop digital twin system | |
| Liu et al. | A systematic review of digital twin about physical entities, virtual models, twin data, and applications | |
| Wang et al. | BIM information integration based VR modeling in digital twins in industry 5.0 | |
| Zhang et al. | Information modeling for cyber-physical production system based on digital twin and AutomationML | |
| CN113011837A (en) | Digital twin management and control platform based on micro-service | |
| Correa | Cyber-physical systems for construction industry | |
| CN109976296A (en) | A kind of manufacture process visualization system and construction method based on virtual-sensor | |
| CN116414081A (en) | Intelligent workshop real-time monitoring method based on digital twinning | |
| Xie et al. | Framework for a closed-loop cooperative human Cyber-Physical System for the mining industry driven by VR and AR: MHCPS | |
| CN113902605A (en) | Smart park operation and maintenance management mode based on CIM framework | |
| CN114372341A (en) | Steel hot rolling pipe control system and method based on digital twinning | |
| CN115907700A (en) | Real-time mapping and visual monitoring method for digital twin model of workshop | |
| CN114035515A (en) | Digital twin system for discrete workshop production process and construction method thereof | |
| CN102708512A (en) | Intelligent bridge maintenance management system based on Internet of Things and 3D (three-dimensional) GIS (geographic information system) | |
| CN114384881A (en) | Workshop logistics monitoring and simulation system and method based on digital twins | |
| CN113752264A (en) | Mechanical arm intelligent equipment control method and system based on digital twins | |
| Correa | Integrating Industry 4.0 associated technologies into automated and traditional construction | |
| Guo et al. | Art product design and vr user experience based on iot technology and visualization system | |
| CN116415386A (en) | Digital twin production line visualization system based on real-time data driving | |
| Zhou et al. | Revisiting digital twins: Origins, fundamentals, and practices | |
| Ding et al. | AML-based web-twin visualization integration framework for DT-enabled and IIoT-driven Manufacturing system under I4. 0 workshop | |
| CN101295327B (en) | Harbor monitoring data virtual display device and method | |
| Zhang et al. | A framework for service-oriented digital twin systems for discrete workshops and its practical case study | |
| CN115546416A (en) | Web-based lightweight 3D visualization method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |