CN211604116U - Projection type augmented reality fastener assembly guiding and detecting device - Google Patents
Projection type augmented reality fastener assembly guiding and detecting device Download PDFInfo
- Publication number
- CN211604116U CN211604116U CN202020286955.9U CN202020286955U CN211604116U CN 211604116 U CN211604116 U CN 211604116U CN 202020286955 U CN202020286955 U CN 202020286955U CN 211604116 U CN211604116 U CN 211604116U
- Authority
- CN
- China
- Prior art keywords
- module
- assembly
- augmented reality
- fastener
- image acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The utility model discloses a projection formula augmented reality fastener assembly guide and detection device, it includes database module, server module, visual show module and image acquisition and processing module, database module passes through the circuit and links to each other with the server module, the server module passes through the circuit and links to each other with visual show module, the server module passes through circuit and image acquisition and processing module interconnect. The utility model discloses can improve the intellectuality of fastener assembly and detection, alleviate workman intensity of labour and promote assembly quality and efficiency, feedback information is more clear directly perceived, has more alternately should the hommization.
Description
Technical Field
The utility model belongs to the technical field of the augmented reality, concretely relates to projection formula augmented reality fastener assembly guide and detection device.
Background
With the development of smart manufacturing technologies, augmented reality technologies are gradually going deep into the manufacturing field and have already begun to be applied to the auxiliary assembly process of the manufacturing industry. Augmented Reality (AR) is a technology that integrates the real world "seamlessly" with a virtual world, enabling users to achieve a sensory experience beyond reality by overlaying computer-generated information to the real world. The application of the augmented reality technology in the manufacturing industry can effectively overcome the defects of non-intuitive expression, non-centralized information and the like of the traditional two-dimensional drawing, and particularly in the field of equipment manufacturing with complex structure and complicated assembly process, the assembly efficiency can be improved, and the cost can be reduced.
Chinese patent publication No. CN 107423650 a discloses a projection-type augmented reality assembly induction and monitoring system, which includes a computer loaded with assembly induction information, an electronic tag scanner, an electronic tag, a workbench, and a projector set, where the projector set and the electronic tag scanner are connected to the computer, the projector set is fixed above the workbench through a mounting bracket, and the electronic tag is disposed on the operated component. The assembly guiding mode related to the prior art needs to stick an electronic tag on a part to be assembled and read data through an electronic tag scanner, but is not suitable for fasteners which are small in size, large in quantity, high in surface quality requirement and not allowed to have visual pollution; the modified monitoring system focuses on monitoring people, and judges whether the actions of an operator are qualified or not through identifying and tracking the skeletal points of the people; the detection of the assembly quality of the fasteners is only suitable for fasteners in threaded connection, is not suitable for assembly occasions requiring rivet connection and welding, and lacks direct feedback of assembly detection results and wrong assembly classification.
Disclosure of Invention
The utility model aims at providing a to the not enough of above-mentioned prior art, provide one kind and can improve the fastener assembly and the intellectuality that detects, alleviate workman intensity of labour and promote projection formula augmented reality fastener assembly guide and detection device of assembly quality and efficiency.
The utility model adopts the technical scheme as follows: the utility model provides a projection formula augmented reality fastener assembly guide and detection device, it includes database module, server module, visual display module and image acquisition and processing module, database module passes through the circuit and links to each other with the server module, the server module passes through the circuit and links to each other with visual display module, the server module passes through circuit and image acquisition and processing module interconnect.
The database module is composed of a microcomputer and is used for importing and storing the digital prototype and the process knowledge base.
The server module is composed of a computer and is used for taking charge of standardized processing of process knowledge, communication with each module and perception judgment of detection information.
The visual display module consists of a projector, a supporting bracket and a case and is used for projecting the auxiliary guide information of the assembly of the fastener, the feedback information of the assembly detection and the human-computer interaction of the assembly operation process.
The image acquisition and processing module consists of an industrial camera, a fixed support and a graphic processor and is used for taking charge of image acquisition of fastener hole sites on the workpiece, preprocessing of images, extraction and analysis of geometric features and monitoring of the whole process of assembly operation.
The projector is an LED projector, and the LED projector has the advantages of small volume, convenience, environmental protection and long service life.
In the aspect of hardware, the database module, the server module, the visual display module and the image acquisition and processing module are all installed on an assembly tool frame and used for fixing and adjusting the positions of the modules.
In the aspect of communication, a client/server architecture (C/S architecture) is adopted, a server module is used as a server, a database module, a visual display module and an image acquisition and processing module are respectively used as 3 clients, and a Socket communication mode is adopted to be responsible for sending and receiving data.
The beneficial effects of the utility model are that:
(1) the utility model greatly improves the intelligence of the assembly process flow, replaces the prior paper documents and electronic technical manuals, leads information more visually, reduces the understanding burden and the operation intensity of assembly workers, and improves the quality and the efficiency of the assembly of the fasteners;
(2) the utility model realizes real-time monitoring in the detection of the assembly state of the fastener, does not need to use the current mainstream part detection method-the method based on artificial identification to realize the three-dimensional registration of the part, has no defects of visual pollution, complex operation process and the like, and can be applied to the tracking of metal parts with higher surface requirements;
(3) the utility model discloses can compare with the template and judge the testing result according to the picture that the camera gathered to carry out the perception classification to the assembled state, at work piece surface projection mistake warning, feedback information is more clear directly perceived, has more mutual suitable hommization.
Drawings
Fig. 1 is a schematic structural view of the present invention;
FIG. 2 is a schematic diagram of an embodiment of the present invention;
in the figure 1, a database module; 2. a server module; 3. a visual display module; 4. and the image acquisition and processing module.
Detailed Description
The invention will be further described with reference to the accompanying drawings:
as shown in fig. 1-2, the utility model discloses it is including database module 1, server module 2, visual display module 3 and image acquisition and processing module 4, database module 1 links to each other with server module 2 through the circuit, database module 1, server module 2, visual display module 3 and image acquisition and processing module 4 all install on the assembly tool rest for the position of fixed and regulation each module.
The database module 1 is composed of a microcomputer and is used for importing and storing a digital prototype and a process knowledge base.
The server module 2 is connected with the visual display module 3 through a line, and the server module 2 is composed of a computer and is used for taking charge of standardized processing of process knowledge, communication with each module and perception judgment of detection information. The visual display module 3 is composed of a projector, a supporting bracket and a case and is used for projecting the auxiliary guide information of the assembly of the fastener, the feedback information of the assembly detection and the human-computer interaction of the assembly operation process.
The server module 2 is connected with the image acquisition and processing module 4 through a line, and the image acquisition and processing module 4 consists of an industrial camera, a fixed support and a graphic processor and is used for being responsible for image acquisition of fastener hole sites on workpieces, image preprocessing, extraction and analysis of geometric features and monitoring of the whole process of assembly operation.
The utility model discloses a use as follows:
step 1: preparing and building a hardware system and a related software environment, installing three-dimensional modeling software CATIA on a microcomputer in a database module 1, installing Visual Studio 2013 and Untiy3D software on a computer in a server module 2, configuring an open source image processing library OpenCV3.0.0 on a Visual Studio 2013 development platform and installing a matching drive program of an industrial camera on a server;
step 2: adjusting the visual field and the focal length of the projector and the industrial camera to enable the projector and the industrial camera to fully cover the workpiece to be assembled, so that the image acquired by the industrial camera is clear and has bright color;
and step 3: calibrating the projector and the industrial camera in a combined manner, and acquiring internal parameters and external parameters of the projector and the industrial camera, so that an image coordinate system of the projector and an industrial camera coordinate system are unified in the same world coordinate system, and the conversion of the spatial relationship between a projected image and a camera image is facilitated;
and 4, step 4: importing a three-dimensional digital prototype, namely a digital model, and related assembly process requirements into a database module 1, wherein the three-dimensional digital prototype comprises the shape and size of a product to be assembled and the model, number and position process information of a fastener;
and 5: the method comprises the following steps that an industrial camera collects a part picture to be assembled, image preprocessing is carried out, the geometric characteristics of the image are extracted, and the hole site coordinates of a fastener are determined;
step 6: comparing the hole site information of the real fasteners acquired by the image with the three-dimensional digital-analog information, simultaneously extracting the hole site information of the fasteners with the same mark to be installed by the server module 2, sending a guide instruction to the visual display module 3, and projecting the same color block on the hole sites to prompt an operator to install;
and 7: an operator assembles the fasteners according to the guiding prompt information, and enters an installation detection stage after the fasteners of the same type are assembled;
and 8: the industrial camera carries out image preprocessing and image segmentation on the collected picture, compares the similarity of the local hole site picture with the picture of the installed fastener, sets a threshold value and judges an installation result;
and step 9: the server module 2 classifies the assembly state into 3 types according to the installation result: neglected installation, wrong installation and assembly of the fasteners are finished, and three prompt messages with different colors and character early warning signals are projected on corresponding hole sites respectively to prompt an operator;
step 10: and (4) monitoring the industrial camera in real time, and when an operator corrects wrong assembly, the assembly warning information disappears and becomes correct installation feedback until all fasteners of the type are correctly installed, and the assembly guide detection process is finished.
Other parts which are not described in the present invention are the same as those in the prior art.
Claims (7)
1. The utility model provides a projection formula augmented reality fastener assembly guide and detection device, characterized by it is including database module (1), server module (2), visual show module (3) and image acquisition and processing module (4), database module (1) links to each other with server module (2) through the circuit, server module (2) link to each other with visual show module (3) through the circuit, server module (2) pass through circuit and image acquisition and processing module (4) interconnect.
2. The projective augmented reality fastener assembly guidance and detection apparatus of claim 1, wherein the database module (1) is composed of a microcomputer for importing and storing a digital prototype and a process knowledge base.
3. The projected augmented reality fastener assembly guidance and detection apparatus of claim 1, wherein the server module (2) is comprised of a computer for taking care of standardized processing of process knowledge, communication with each module, and perceptual judgment of detection information.
4. The device for guiding and detecting the assembly of the projection-type augmented reality fastener according to claim 1, wherein the visual display module (3) is composed of a projector, a supporting bracket and a case, and is used for projecting the auxiliary guiding information of the assembly of the fastener, the feedback information of the assembly detection and the human-computer interaction of the assembly operation process.
5. The projection augmented reality fastener assembly guidance and detection apparatus of claim 1, wherein the image acquisition and processing module (4) is composed of an industrial camera, a fixed support and a graphic processor, and is used for image acquisition of fastener hole sites on the workpiece, preprocessing of images, extraction and analysis of geometric features and monitoring of the whole assembly process.
6. The projected augmented reality fastener assembly guidance and detection device of claim 1, wherein the database module (1), the server module (2), the visual display module (3) and the image acquisition and processing module (4) are mounted on an assembly jig for fixing and adjusting the position of each module.
7. The projected augmented reality fastener assembly guidance and detection apparatus of claim 4, wherein the projector is an LED projector.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020286955.9U CN211604116U (en) | 2020-03-10 | 2020-03-10 | Projection type augmented reality fastener assembly guiding and detecting device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020286955.9U CN211604116U (en) | 2020-03-10 | 2020-03-10 | Projection type augmented reality fastener assembly guiding and detecting device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN211604116U true CN211604116U (en) | 2020-09-29 |
Family
ID=72580541
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202020286955.9U Active CN211604116U (en) | 2020-03-10 | 2020-03-10 | Projection type augmented reality fastener assembly guiding and detecting device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN211604116U (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113393535A (en) * | 2021-06-25 | 2021-09-14 | 深圳市拓普智造科技有限公司 | Projection type operation guiding method and system |
| CN114197884A (en) * | 2021-12-27 | 2022-03-18 | 广东景龙建设集团有限公司 | Assembling guiding method and system for customized decorative wallboard |
-
2020
- 2020-03-10 CN CN202020286955.9U patent/CN211604116U/en active Active
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113393535A (en) * | 2021-06-25 | 2021-09-14 | 深圳市拓普智造科技有限公司 | Projection type operation guiding method and system |
| CN114197884A (en) * | 2021-12-27 | 2022-03-18 | 广东景龙建设集团有限公司 | Assembling guiding method and system for customized decorative wallboard |
| CN114197884B (en) * | 2021-12-27 | 2022-07-08 | 广东景龙建设集团有限公司 | Assembling guiding method and system for customized decorative wallboard |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106845502B (en) | Wearable auxiliary device for equipment maintenance and visual equipment maintenance guiding method | |
| CN211604116U (en) | Projection type augmented reality fastener assembly guiding and detecting device | |
| CN111710055A (en) | Portable power inspection equipment, power inspection method and power inspection system | |
| CN109638959B (en) | Power equipment remote signaling function debugging method and system based on AR and deep learning | |
| CN110347266B (en) | Space gesture control device based on machine vision | |
| CN111091611A (en) | Workshop digital twin oriented augmented reality system and method | |
| CN111626234A (en) | Implementation method of intelligent manufacturing system platform | |
| CN112304957A (en) | Machine vision-based intelligent detection method and system for appearance defects | |
| CN115184361A (en) | Real-time workpiece surface defect detection and evaluation system and method based on machine vision | |
| CN111770450B (en) | Workshop production monitoring server, mobile terminal and application | |
| CN105699387A (en) | Electronic product appearance defect detection system | |
| CN114155610A (en) | Panel assembly key action identification method based on upper half body posture estimation | |
| CN110619630B (en) | Mobile equipment visual test system and test method based on robot | |
| CN113269234B (en) | Connecting piece assembly detection method and system based on target detection | |
| CN113240798B (en) | Intelligent material integrity detection and configuration method based on digital twinning and AR | |
| KR102366396B1 (en) | RGB-D Data and Deep Learning Based 3D Instance Segmentation Method and System | |
| CN111860416A (en) | Unmanned aerial vehicle image monitoring control device and control method thereof | |
| CN110428496A (en) | Handheld tool operation guidance method based on virtual reality fusion | |
| CN106846302B (en) | Detection method for correctly taking tool and examination table based on method | |
| CN114663367A (en) | Automatic teaching method for visual inspection of gluing defects | |
| CN113034418B (en) | Circuit board identification and bonding pad/chip rapid positioning method for electronic industry | |
| CN103148783A (en) | Automatic detection method for installing position of valve rocker | |
| Ramshankar et al. | Development of machine vision system for automatic inspection of vehicle identification number | |
| Palomino et al. | Ai-powered augmented reality training for metal additive manufacturing | |
| CN116087671B (en) | Automatic test operation method, robot and system based on machine vision |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |