CN108961420A - Machine-building teaching auxiliary system and development approach based on AR cloud storage technology - Google Patents

Machine-building teaching auxiliary system and development approach based on AR cloud storage technology Download PDF

Info

Publication number
CN108961420A
CN108961420A CN201810654252.4A CN201810654252A CN108961420A CN 108961420 A CN108961420 A CN 108961420A CN 201810654252 A CN201810654252 A CN 201810654252A CN 108961420 A CN108961420 A CN 108961420A
Authority
CN
China
Prior art keywords
typical part
module
unity3d
cloud storage
typical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810654252.4A
Other languages
Chinese (zh)
Inventor
潘旭东
关靖添
霍红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology
Original Assignee
Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology filed Critical Harbin Institute of Technology
Priority to CN201810654252.4A priority Critical patent/CN108961420A/en
Publication of CN108961420A publication Critical patent/CN108961420A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Machine-building teaching auxiliary system and development approach based on AR cloud storage technology, the present invention relates to machine-building teaching software and its development approaches.Not intuitive the purpose of the invention is to be imparted knowledge to students in solving teaching at present using drawing, student interests are relatively low, and using physical model poor mobility, portability is poor, teaching ability limited problem single using existing AR auxiliary software content.Machine-building teaching auxiliary system based on AR cloud storage technology include: for distributing topic, course that curriculum information, typical part information are shown prepare subsystem;The AR be overlapped for the threedimensional model to typical part and typical part fixture, merge, shown shows subsystem;The AR shows that subsystem includes: rotation scaling section view module;Information display module;More figure identification modules;Animated show module;Cloud storage module.The present invention is used for machine-building tutor auxiliary platform field.

Description

Machine-building teaching auxiliary system and development approach based on AR cloud storage technology
Technical field
The present invention relates to machine-building teaching software and its development approaches.
Background technique
The Course Exercise of Machine Manufacturing Technology is the required practice of mechanical design and manufacture & automation major undergraduate Property the content of courses, the primary comprehensive practical rehearsal being routed in after having repaired relevant speciality course.
Augmented reality (Augmented Reality Technique, abbreviation AR technology) is in virtual reality technology Development generates on the basis of (Virtual Reality Technique, abbreviation VR technology), it is to the letter in true environment Breath carries out three-dimensional registration, and the virtual information superposition that computer generates is applied to real world, is set using sensing technology and display It is standby that virtual information and real world are unified in a picture or space, to realize the enhancing to real world, reach super More real sensory experience.
This software combines mobile AR technology and Course Design of Manufacture, and it is auxiliary to produce a cloud AR teaching Software is helped, is effectively imparted knowledge to students in solution teaching at present using drawing not intuitive, student interests are relatively low, use physical model mobility Difference, portability is poor, single using existing AR auxiliary software content, the limited problem of teaching ability.
Summary of the invention
Not intuitive the purpose of the invention is to be imparted knowledge to students in solving teaching at present using drawing, student interests are relatively low, make With physical model poor mobility, portability is poor, single using existing AR auxiliary software content, the limited problem of teaching ability, and It is proposed machine-building teaching auxiliary system and development approach based on AR cloud storage technology.
Machine-building teaching auxiliary system based on AR cloud storage technology includes:
For distributing topic, course that curriculum information, typical part information are shown prepare subsystem;
The AR be overlapped for the threedimensional model to typical part and typical part fixture, merge, shown shows subsystem System;
The AR shows that subsystem includes:
Rotated, scaled for the threedimensional model to typical part and typical part fixture in AR displaying subsystem, The rotation of section view scales section view module;
For showing that the threedimensional model of typical part and typical part fixture in subsystem carries out text information exhibition to AR The information display module shown;
For showing the threedimensional model progress of N number of typical part and typical part fixture in subsystem to AR while folding The more figure identification modules add, merge, showing;
N is more than or equal to 2, and value is integer;
For showing that the threedimensional model of typical part and typical part fixture in subsystem carries out animated show to AR Animated show module;
For showing that the threedimensional model and its script of typical part and typical part fixture in subsystem are beaten to AR Wrap the cloud storage module of simultaneously cloud storage.
The development approach detailed process of machine-building teaching auxiliary system based on AR cloud storage technology are as follows:
Step 1: establishing application and identification atlas in the official website HiAR management backstage and will apply and identify that atlas is associated with;
Identification atlas is the two-dimentional drawing for the model to be shown, is used for mobile phone camera scanning;
Step 2: downloading HiAR SDK and HiAR SDK being imported Unity3D, configuration exploitation bad border;
Step 3: App Key and Sercert to be pasted to the HiAR Engine of HiARCamera in Unity3D In Behaviour script;
Step 4: the threedimensional model of the typical part of production and typical part fixture is imported in Unity3D;
Step 5: in Unity3D to AR show subsystem in rotation scaling section view module and information display module into The typical part in rotation scaling section view module and the threedimensional model rotation of typical part fixture, scaling, section view are realized in row exploitation It is shown with the threedimensional model text information of typical part and typical part fixture in information display module;
Step 6: being configured in Unity3D to HiAR Engine Behaviour script, to realize more figure identifications More figures identification that module carries out N number of typical part or typical part fixture while being superimposed, merging, showing;
N is more than or equal to 2, and value is integer;
Animated show mould is realized in Unity3D Step 7: the typical part of production and typical part fixture animation are imported The threedimensional model animated show of typical part and typical part fixture in block;
Step 8: creating course in Unity3D prepares subsystem;
Step 9: all models that step 1 to step 8 obtains are uploaded to the cloud HiAR with corresponding identification picture packing Management backstage is simultaneously associated with one by one, realizes cloud storage module to the three-dimensional mould of typical part in AR display module and typical part fixture Type and its script be packaged and cloud storage;
Step 10: step 1 to step 9 result is exported with the file format of Andrid installation kit, mobile application is generated.
The invention has the benefit that
Invention applies cloud storages, realize the cloud storage of multiple parts and show;Reduce accounting for for mobile phone EMS memory With existing in mobile phone originally, exist in cloud data now;Realize the displaying of 11 parts and its corresponding fixture;Apk installation kit is only Need 40M or so;
The present invention increases course preparation module in addition to AR display module, helps classmate to complete course and learns in advance;
Invention increases more figure identification functions, an originally interface is only able to display three-dimensional or section, a present interface On can show three-dimensional and show section, can now show solid on an interface but also show animation;
Invention increases playing animation functions, originally can only zoom, originally be in picture and a figure Three parts whole one can only start, it now is possible to which three parts in a figure amplify respectively, reduce, move up and down It shows, it is more intuitive, improve students ' interest of study;
The present invention reduces button use, function is realized leans on gesture operation substantially, and interface is more succinct;
Interface display of the present invention character introduction explanation, helps to understand.
Exploitation basis of the present invention using Unity3D+HiAR SDK as software, using Android mobile terminal conduct The application platform of software realizes that the cloud of AR model packet stores using HiAR management backstage, has produced a novel form, interior Contain and enrich, scalability is strong, the machine-building teaching software of the powerful AR cloud storage technology of teaching aided function.
The present invention use the higher Android mobile terminal of popularity rate, portability is strong, due to user to operation mode Be familiar with, be not required to study the application method that can grasp software in depth, and man-machine interaction effect is powerful, be conducive to increase user Immersion sense.
The present invention realizes the cloud storage of AR content packet, has saved the volume of software installation packet, and a step improves software just The property taken, it can be achieved that more multi-model displaying, content more it is abundant deeply, the extension that cloud updates model realization software can be passed through With update, the scalability of software is greatly improved.
The present invention only needs network+mobile terminal+AR application that tutor auxiliary platform work can be completed, and is not required to additional AR and intelligently sets Standby, physical model needed for saving teaching solves physical model poor mobility, the problem of portability is poor, limited amount, solution It has determined AR smart machine problem at high cost, has solved existing AR Teaching Aid Software and be not able to achieve cloud storage and lead to model It is single, the problem of it is limited to provide content, tutor auxiliary platform less effective.
The present invention, which is identified using drawing as AR, to be schemed, and in the case where Network status is excellent, stress model is rapid, and display is steady Fixed, using the powerful rendering engine of Unity3D, model shows that quality is outstanding, using the human-computer interaction technology of touch operation, enhancing User's sense of participation and immersion sense.
Detailed description of the invention
Fig. 1 is invention software frame diagram;
Fig. 2 is invention software development process figure;
Fig. 3 is that course of the present invention prepares platform platform operational flowchart;
Fig. 4 is AR display platform operational flowchart of the present invention;
Fig. 5 a is that course of the present invention prepares platform display topic implementation flow chart;
Fig. 5 b is that course of the present invention prepares platform display information realization flow chart;
Fig. 5 c is that course of the present invention prepares platform information matching implementation flow chart;
Fig. 6 is that AR of the present invention shows that scene forms display diagram, and Directional Light is that environment light arranges module, CloudRecognition is cloud identification module, and HiARCamera is the parameter setting module in scene to camera, ImageTarget is target figure setup module;
Fig. 7 is that ARCamera of the present invention is associated with setting figure with cloud;
Fig. 8 is identification atlas in cloud storage management backstage of the present invention;
Fig. 9 is that model of the present invention is packaged figure
Figure 10 is cloud storage management of the present invention backstage AR content packet upload interface.
Figure 11 is entree free hand drawing of the present invention;
Figure 12 a is that course of the present invention prepares platform figure;
Figure 12 b is distribution topic functional block diagram;
Figure 12 c is that integrated course information shows functional block diagram;
Figure 12 d is part analysis functional block diagram;
Figure 13 is AR display platform figure of the present invention;
Figure 14 is part section view display diagram of the present invention;
Figure 15 is part rotary display figure of the present invention;
Figure 16 is parts information part of the present invention display diagram;
Figure 17 is present clip and its reference information part display diagram;
Figure 18 is the more figure identification function display diagrams of the present invention;
The layout and space distribution diagram that Figure 19 is GUI.
Specific embodiment
Specific embodiment 1: the machine-building teaching auxiliary system packet based on AR cloud storage technology of present embodiment It includes:
For (carrying out preliminary information exhibition to Course Exercise to topic distribution function, curriculum information function, parts information function Showing) course that is shown prepares subsystem;
For to typical part (slip yoke, CA6140 lathe shift fork, CA6140 lathe ring flange, CA6140 vehicle Bed lever, CA10B Jiefang brand automobile back steel plate spring lifting lug) and the threedimensional model of typical part fixture be overlapped, merge, show The AR shown shows subsystem;
Additive fusion display function, be by virtual information additive fusion to real world, including have it is three-dimensional with The additive fusion of track registering functional is shown and the additive fusion without three-dimensional Tracing Registration is shown.
Additive fusion with three-dimensional Tracing Registration, which is shown, refers to that computer real time recognition and tracking positioning shooting head is opposite In the position and attitude information of marker, then match server end virtual information, successful match render virtual information, carry out coordinate System's transformation, is calculated the two-dimensional coordinate that each characteristic point of virtual information is fastened in image coordinate, then passes through graphical display technics To come on virtual information Overlapping display to display screen, thus reach it is a kind of mix the spurious with the genuine surmount true real empty fusion effect Fruit, while this also embodies the property the immersed feature of AR technology.
Without three-dimensional Tracing Registration additive fusion show with it is preceding introduce on the contrary, it in real time calculate virtual information exist Virtual information, is only simply added on real world by the location information among real world.In general, the superposition is melted The information for closing display is motionless relative to the position of mobile device screen, virtual to believe even if changing the orientation of mobile device camera The position of breath will not change.
And two kinds of forms of content information that institute's additive fusion of the present invention is shown all include, the virtual three-dimensional model being superimposed is Additive fusion with Tracing Registration function is shown, with the change of camera position posture, position that model is shown on the screen Confidence breath can change, but the result changed can allow people's perceptual model not change relative to real-world locations.And Text, the virtual push button of superposition are that the additive fusion without Tracing Registration function shows that position displayed in the screen will not As the position and attitude of camera changes and change.
The AR shows that subsystem includes:
Rotated, scaled for the threedimensional model to typical part and typical part fixture in AR displaying subsystem, The rotation of section view scales section view module;
For showing that the threedimensional model of typical part and typical part fixture in subsystem carries out text information exhibition to AR The information display module shown;
For showing the threedimensional model progress of N number of typical part and typical part fixture in subsystem to AR while folding The more figure identification modules add, merge, showing;
N is more than or equal to 2, and value is integer;
For showing that the threedimensional model of typical part and typical part fixture in subsystem carries out animated show to AR Animated show module;
For showing that the threedimensional model and its script of typical part and typical part fixture in subsystem are beaten to AR Wrap the cloud storage module of simultaneously cloud storage.
Specific embodiment 2: the present embodiment is different from the first embodiment in that: the AR shows subsystem also Include:
For acquiring the image collection module of image in drawing by mobile terminal camera;
Identification image is prestored in image and cloud database for obtaining to image collection module carries out matched feature Match cognization module.
Specific embodiment 3: the present embodiment is different from the first and the second embodiment in that: the course prepares son System includes:
For distributing the topic distribution module shown to topic;
Curriculum information module for being shown to curriculum information;
For to typical part and technique information, (technique to be exactly the initial conditions such as to require according to part pattern and technique, is compiled Part by numerical control processing program processed, and it is input to the digital control system of numerically-controlled machine tool, to control the phase of cutter and workpiece in numerically-controlled machine tool To movement, to complete the processing of part.) the parts information module that is shown.
Specific embodiment 4: the machine-building teaching auxiliary system based on AR cloud storage technology of present embodiment is opened Forwarding method detailed process are as follows:
Step 1: establishing application in the official website HiAR management backstage (logs in personal account in the official website HiAR, into after manager Platform selects newly-built application into application management.) with identification atlas and will apply and identify that atlas is associated with;
Identification atlas is the two-dimentional drawing for the model to be shown, is used for mobile phone camera scanning;Purpose be by After appkey and sercert is pasted in Unity3D, identify that the drawing in atlas can be used as the camera identification mesh of the application Mark;
Being associated in choose on website can be completed.
Step 2: downloading HiAR SDK (being that HIAR company researches and develops, the AR application developmentpackage used for developer) and inciting somebody to action HiAR SDK imports Unity3D, configuration exploitation bad border;
Step 3: by the App Key and Sercert of application, (after application is established in website, website can be provided for the application Its proprietary App Key and sercert) paste the HiAR Engine Behaviour script of HiARCamera in Unity3D In;
Step 4: the threedimensional model of the typical part of production and typical part fixture is imported in Unity3D;
Step 5: in Unity3D to AR show subsystem in rotation scaling section view module and information display module into The typical part in rotation scaling section view module and the threedimensional model rotation of typical part fixture, scaling, section view are realized in row exploitation It is shown with the threedimensional model text information of typical part and typical part fixture in information display module;
(HiAR Engine is clicked Step 6: being configured in Unity3D to HiAR Engine Behaviour script Behaviour makes hook in wherein MultiTarget option.), to realize that more figure identification modules carry out N number of typical part or allusion quotation More figures identification that type part clamp is superimposed, merges, showing simultaneously;Process are as follows:
N is more than or equal to 2, and value is integer;
Step 7: by the typical part of production and typical part fixture animation (animation is the animation of part and its fixture, three Dimension module is generated by Solidworks software modeling, and animation is the assembly explosion animation of threedimensional model) it imports in Unity3D and realizes The threedimensional model animated show of typical part and typical part fixture in animated show module;
Step 8: creating course in Unity3D prepares subsystem;
Step 9: by all models that step 1 to step 8 obtains (be that sequence operates between each step, the 9th step institute The model of application, the final mask before being after the completion of all steps) and its correspond to identification picture and be packaged and be uploaded to the cloud HiAR Management backstage is simultaneously associated with one by one, realizes cloud storage module to the three-dimensional mould of typical part in AR display module and typical part fixture Type and its script be packaged and cloud storage;
Step 10: step 1 to step 9 result is exported with the file format of Andrid installation kit, mobile application is generated.
Specific embodiment 5: present embodiment is unlike specific embodiment four: will production in the step 4 Typical part and typical part fixture threedimensional model import Unity3D in;
Detailed process are as follows:
Step 4 one, the threedimensional model that typical part and typical part fixture are established in Solidworks;
Step 4 two will be converted in the threedimensional model of the typical part of completion and typical part fixture importing 3dsmax .fbx it format and imports in Unity3D.
Other steps and parameter are identical as specific embodiment four.
Specific embodiment 6: present embodiment is unlike specific embodiment four or five: in the step 5 Rotation scaling section view module and information display module in subsystem, which are developed, to be shown to AR in Unity3D, realizes rotation contracting It puts in threedimensional model rotation, scaling, section view and the information display module of the typical part and typical part fixture in section view module Typical part and typical part fixture threedimensional model text information show;
Detailed process are as follows:
Step 5 one, addition Quick Swipe component and Quick Pinch component (come from Unity3D Quicktouch component packet), it is realized and is rotated using Quick Swipe component, realized and scaled using Quick Pinch component;
Step 5 two, respectively by the complete model and section view model of typical part and typical part fixture threedimensional model import In Unity3D, Quick Tap component is added in Unity3D, utilizes Quick Tap (coming from Quicktouch component packet) group Part realizes that the switching of complete part and section view part (carries out the setting of parameter and its Controlling model to QuickTAP component, original is said Bright middle lower section textures it is stated that);
Step 5 three is clicked script to typical part and the addition of typical part fixture and is edited (by information to display Input in script) reference information to display, using Gui.Window component, (Gui.window is that software carries function, is The existing component that can be called) realize reference information displaying.
Other steps and parameter are identical as specific embodiment four or five.
Specific embodiment 7: unlike one of present embodiment and specific embodiment four to seven: the step 7 It is middle by the typical part of production and typical part fixture animation (animation is the animation of part and its fixture, threedimensional model by Solidworks software modeling generates, and animation is the assembly explosion animation of threedimensional model) it imports in Unity3D and realizes animated show The threedimensional model animated show of typical part and typical part fixture in module;Process are as follows:
Step 7 one makes typical part and typical part fixture animation in Solidworks;
Step 7 two imports in Unity3D after typical part and typical part fixture animation to be exported as to .mp4 format, adds Enter in Video Player and is packaged the cloud storage module for being uploaded to cloud storage.
Other steps and parameter are identical as one of specific embodiment four to seven.
Specific embodiment 8: unlike one of present embodiment and specific embodiment four to seven: the step 8 In in Unity3D create course prepare subsystem;Detailed process are as follows:
Step 8 one creates Scene (scene) in Unity3D, and Canvas (painting canvas) is added using the UGUI of Unity3D Component;
Painting canvas of the present invention switches key code:
Button (button) component is added using the UGUI of Unity3D in step 8 two, adds for Button (button) component Random script (need to assign the script write to Button control), realize topic distribution function;
Step 8 three, UGUI addition Toggle (switch) component and Image (picture) component using Unity3D, and Addition needs the information shown in Image component, adds script (extremely by the script mouse drag write for Toggle component Toggle component, so that it may add script.) realize Image component in information switching;
Input Field (input frame) component is added using the UGUI of Unity3D in step 8 four, to identify input Character, writing content file, (content file by the Part No. of input and is given using Part No. as identification feature by if sentence Part No. matching, to all Part No.s, text is explained in input in content file, is corresponded with Part No..) and typical part Part No. match, using in Image component Text (text) control carry out content (content is write in content file Content) display.
Other steps and parameter are identical as one of specific embodiment four to seven.
Specific embodiment 9: unlike one of present embodiment and specific embodiment four to eight: the step 9 It is middle step 1 to eight is obtained all models (be between each step sequence operate, model applied by the 9th step, before being Final mask after the completion of all steps) and its correspond to identification picture packing be uploaded to the cloud HiAR management backstage and close one by one Connection realizes that cloud storage module plays the threedimensional model and its script of typical part and typical part fixture in AR display module It wraps and cloud stores;Detailed process are as follows:
Step 9 one, by the model for making script (be between each step sequence operate, model applied by the 9th step Final mask before being after the completion of all steps) it is dragged under Prefebs and renames, extend entitled .unity3d;
Step 9 two selects development platform for Android, and creates AssetBundles, obtains model compression packet;
Model of the present invention is packaged crucial setting, such as Fig. 9;
Step 9 three, model compression is wrapped reach corresponding to the picture library of cloud identify image catalogue under, complete AR in The setting for holding packet (logs in the official website HiAR, into management backstage, into atlas management, into the atlas established before, click is thought The picture for adding content packet clicks setting at the Android in " setting UnityAR content packet ", selection pair in a computer The AR content packet answered.), the model compression packet that AR content packet, that is, step 9 two obtains (is known as AR content packet, such as on the website HIAR The following figure).
AR content packet setting of the present invention, such as Figure 10.
Other steps and parameter are identical as one of specific embodiment four to eight.
Working principle:
System operatio process is as shown in Figure 3 and Figure 4.
One, the APP of the machine-building teaching auxiliary system based on AR cloud storage technology is opened, APP interface of main menu is reached, APP interface of main menu includes that course prepares, AR shows and exits the program;As shown in figure 11.
Two, single machine course prepare, reach course prepare subsystem, including topic distribution, curriculum information, parts information show Show;As figure 12 a shows.
Topic distribution is clicked, shows distributed topic;Curriculum information is clicked, shows INTRODUCTION OF THE COURSE STRUCTURE and design and attention of drawing Item;Parts information is clicked, Part No. is inputted, input Part No. is clicked and carries out receipts rope, show corresponding part reference information;
Three, " returning to main menu " is clicked, is selected " AR display platform ", single machine AR is shown, is reached AR and is shown subsystem, camera shooting Head is taken pictures, and carries out identification matching to picture, if not finding corresponding identification figure, camera is taken pictures again;If finding corresponding Identification figure carries out free hand drawing or more figure identifications to picture, obtains part and fixture and playing animation, carry out hand to part and fixture Refer to that sliding obtains rotating part and fixture, finger contraction is carried out to part and fixture or unfolds to obtain scaling part and fixture, it is right Part and fixture are double-clicked to obtain section view part and fixture, are clicked to obtain display reference information to part and fixture.
Beneficial effects of the present invention are verified using following embodiment:
Embodiment one:
Machine-building teaching software and development approach of the present embodiment based on AR cloud storage technology are specifically according to following step Suddenly it prepares:
Fig. 1 is the invention software frame figure, which mainly includes MIM message input module, merges display module and man-machine friendship Mutual module mainly includes that user inputs and selects to information needed in software main menu in MIM message input module The functional module and software needed is handled before the information input in AR display platform, is known including video camera to the analysis of identification figure Not, the downloading of AR content packet is carried out after being identified by by cloud database, is prepared for the fusion display module of next step.Melt Close decompression of the display module completion to AR content packet, Tracing Registration and fusion display.In human-computer interaction module then by user Specific function is realized in selection, is prepared distribution topic, class in platform platform including course and is set information, part analysis function and AR exhibition Show the displaying function of rotation the scaling section view and reference information of the part and fixture that combine in platform with fusion display.
Fig. 2 is the development process figure of the invention software, develops the main preparation of Development Course respectively and AR shows two functions Platform is connected again.This software is using Unity3D as development platform, using HiAR SDK as software development kit.It is class first The exploitation of journey preparation platform platform.According to Software functional requirements, therefore course is individually established in Unity3D and prepares platform Scene, The layout of GUI and the distribution in space are completed in scene.
The layout of GUI and space distribution such as Figure 19;
Next writing for GUI control script is completed.Distribute topic functional module by Button (button) control and One Text (text) control composition;Class sets informational function module by a Canvas control as bottom plate, selects three Image (image) control, edits as the container of comprehensive design experiment introduction and design and drawing points for attention, and by text information It is implanted into container afterwards.Toogle Group (switching group) is established, two Toggle controls is placed and is realized in Text control in group The display of information and hide;The composition of part analysis module, it, as module bottom plate, is made by a Canvas control by Image For container.Text control is for showing text information.InputField (input frame) control is for inputting Part No..Button control Part execute function of search, with script in part match, search out corresponding parts information, and send information to Text control into Row information shows that specific course prepares platform platform implementation process such as Fig. 5 a, 5b, 5c.
AR display platform mainly includes the building of local exploitation and cloud database.General mobile augmented reality application master It to be made of processed offline and online processing two large divisions.Since the exploitation of the application under Android platform is based on Java language Speech, so needing to carry out the downloading and installation of JDK (Java Development Kit), configure Java context.Open browsing Device accesses the official website Java.Correct version downloading is selected according to the operating system of oneself computer.
Since the main operation platform of system is Android platform, the downloading and installation of Android SDK need to be carried out. Web browser is opened, Android developer official homepage is accessed.Click SDK downloading.
Set setting after being installed.It opens " control panel ", opens " system ", " advanced system is set for click Set ", then " environmental variance " is clicked, into environmental variance set interface.Two variables are created below system variable and ginseng is set Number:
Variable name: JAVA_HOME, variate-value be " C: Program Files Java jdk1.6.0 " (this be that oneself is electric The installation path of brain JDK);
Variable name: CLASSPATH, variate-value are ";%JAVA_HOME% lib;%JAVA_HOME% lib Tools.jar " (add indicate current path), edits existing variable Path, variate-value finally add parameter ";%JAVA_ HOME% bin;%JAVA_HOME% jre bin;".
The official website HiAR is logged in, the downloading of HiAR SDK is completed and is conducted into Unity3D exploitation engine.Enter simultaneously The official website HiAR management backstage, carries out the creation of personal account.After the completion of creation, atlas and application are created, and be associated with, so far Complete the preliminary foundation of cloud database.
As shown in fig. 6, showing the composition of scene for AR, CloudRecognition is cloud identification function module, includes cloud Identify associated script file.HiARCamera is the module called camera in HiAR SDK and realize three-dimensional registration.
ImageTarget is identification module.
Log in the creation that HiAR management backstage carries out atlas, the creation of application.Using AppKey/ can be obtained after creation Secret, as shown in fig. 7, AppKey/Secret is affixed in the script file of HiARCamera can be completed using with it is soft The association of part.Atlas is selected in HiAR official website management backstage, associated application can make the picture in atlas as software Identification figure applied.
This software selects the part of piecemeal engineering figure to be uploaded as picture, if Fig. 8 is identification figure upload interface, clicks " addition identification picture ", each identification figure of upload that identification figure can be completed has the TargetID of oneself to distinguish, picture It can be seen that the identification degree star of picture, the star is higher to illustrate that picture identifiability is higher after upload.Picture needs after uploading Being issued can just be identified.
Model used in this software makes in Solidworks software, but since Unity3D does not support Solidworks File format, therefore need first to import part and carry out format conversion in 3dsmax software, it can be imported after being converted into .fbx format It is edited in Unity3D.
After the completion of part progress script edit, so that it may be packaged, crucial script setting carries out specifically above It is bright.It is illustrated in figure 9 model and is packaged interface, the data packet of multiple platforms can be packaged simultaneously, but should be noted and ordered again when model is packaged The suffix of name is necessary for .Unity3D, otherwise can not generate data packet.
Compressed package can be found in project directory after the completion of packing, the corresponding identification of part is selected in management backstage Figure finds data packet as indicated, clicking setting in the case where AR content packet is arranged in catalogue, and clicking upload can be completed data packet Upload, as shown in Figure 10.
Embodiment two: embodiment is particularly applicable in teaching for invention software and illustrates
Fig. 3 and Fig. 4 is respectively that course of the present invention prepares platform platform and AR display platform operational flowchart, followed by reality Example software is shown.
Firstly, opening App, into interface of main menu, as shown in figure 11." course preparation " platform is selected, such as Figure 12 a institute Show, clicks " distribution topic button ", complete topic distribution, as shown in Figure 12b.Next selection " class sets information " module, respectively " comprehensive design experiment introduction " and " design and drawing points for attention " button is clicked, Course Exercise intension is understood, completes pre- before the class It is standby.As shown in fig. 12 c.Next it clicks " part analysis ", inputs Part No. " 831007 ", click " search ", obtain part Function and industrial analysis, as shown in figure 12d.So far, " course preparation " module completes its repertoire.
" returning to main menu " button is clicked, interface of main menu is returned to, selects " AR displaying " module, scan 831007 part drawings Paper, the AR part for obtaining actual situation combination are shown.As shown in figure 13.The rotation scaling and section view of part are realized by gesture operation, It is as shown in Figure 14 and Figure 15 part can more fully to be understood.The reference of part can be shown by clicking right side blank collision body Information, as shown in figure 16.Next to 831007 boring grabs and progress AR displaying, wherein text information includes the positioning of fixture Component analysis, analysis of Positioning Error are as shown in figure 17.Finally by more figure identifications, while showing that the boring grab of part is dynamic with it It draws, further deepens the understanding that student designs fixture.As shown in figure 18.
So far invention software completes its tutor auxiliary platform task in machine-building Course Exercise.
The present invention can also have other various embodiments, without deviating from the spirit and substance of the present invention, this field Technical staff makes various corresponding changes and modifications in accordance with the present invention, but these corresponding changes and modifications all should belong to The protection scope of the appended claims of the present invention.

Claims (9)

1. the machine-building teaching auxiliary system based on AR cloud storage technology, it is characterised in that: the system comprises:
For distributing topic, course that curriculum information, typical part information are shown prepare subsystem;
The AR be overlapped for the threedimensional model to typical part and typical part fixture, merge, shown shows subsystem;
The AR shows that subsystem includes:
It rotated, scaled, section view for the threedimensional model to typical part and typical part fixture in AR displaying subsystem Rotation scale section view module;
For showing that the threedimensional model of typical part and typical part fixture in subsystem carries out text information displaying to AR Information display module;
It carries out while being superimposed for the threedimensional model to N number of typical part and typical part fixture in AR displaying subsystem, melt It closes, more figure identification modules of display;
N is more than or equal to 2, and value is integer;
For showing that the threedimensional model of typical part and typical part fixture in subsystem carries out the animation of animated show to AR Display module;
For showing that the threedimensional model and its script of typical part and typical part fixture in subsystem are packaged simultaneously to AR The cloud storage module of cloud storage.
2. the machine-building teaching auxiliary system according to claim 1 based on AR cloud storage technology, it is characterised in that: described AR shows subsystem further include:
For acquiring the image collection module of image in drawing by mobile terminal camera;
Identification image is prestored in image and cloud database for obtaining to image collection module carries out matched characteristic matching Identification module.
3. the machine-building teaching auxiliary system according to claim 2 based on AR cloud storage technology, it is characterised in that: described Course prepares subsystem
For distributing the topic distribution module shown to topic;
Curriculum information module for being shown to curriculum information;
Parts information module for being shown to typical part and technique information.
4. a kind of development approach of claim 1,2 or 3 machine-building teaching auxiliary system based on AR cloud storage technology, It is characterized by: the method detailed process are as follows:
Step 1: establishing application and identification atlas in the official website HiAR management backstage and will apply and identify that atlas is associated with;
Identification atlas is the two-dimentional drawing for the model to be shown, is used for mobile phone camera scanning;
Step 2: downloading HiAR SDK and HiAR SDK being imported Unity3D, configuration exploitation bad border;
Step 3: App Key and Sercert to be pasted to the HiAR Engine Behaviour of HiARCamera in Unity3D In script;
Step 4: the threedimensional model of the typical part of production and typical part fixture is imported in Unity3D;
Step 5: showing that rotation scaling section view module and information display module in subsystem are opened to AR in Unity3D Hair realizes threedimensional model rotation, scaling, section view and the letter of the typical part and typical part fixture in rotation scaling section view module The threedimensional model text information for ceasing typical part and typical part fixture in display module is shown;
Step 6: being configured in Unity3D to HiAR Engine Behaviour script, to realize more figure identification modules The more figures identification for carrying out N number of typical part or typical part fixture while being superimposed, merging, showing;
N is more than or equal to 2, and value is integer;
It is realized in animated show module Step 7: the typical part of production and typical part fixture animation are imported in Unity3D Typical part and typical part fixture threedimensional model animated show;
Step 8: creating course in Unity3D prepares subsystem;
Step 9: all models that step 1 to step 8 obtains are uploaded to the management of the cloud HiAR with corresponding identification picture packing Backstage is simultaneously associated with one by one, realization cloud storage module to the threedimensional model of typical part in AR display module and typical part fixture and Its script be packaged and cloud storage;
Step 10: step 1 to step 9 result is exported with the file format of Andrid installation kit, mobile application is generated.
5. the development approach of the machine-building teaching auxiliary system according to claim 4 based on AR cloud storage technology, special Sign is: importing the threedimensional model of the typical part of production and typical part fixture in Unity3D in the step 4;Specifically Process are as follows:
Step 4 one, the threedimensional model that typical part and typical part fixture are established in Solidworks;
Step 4 two will be converted to .fbx lattice in the threedimensional model of the typical part of completion and typical part fixture importing 3dsmax Formula simultaneously imports in Unity3D.
6. the development approach of the machine-building teaching auxiliary system according to claim 5 based on AR cloud storage technology, special Sign is: showing that rotation scaling section view module and information in subsystem show mould to AR in Unity3D in the step 5 Block is developed, realize rotation scaling section view module in typical part and typical part fixture threedimensional model rotation, scaling, The threedimensional model text information of section view and typical part and typical part fixture in information display module is shown;Detailed process Are as follows:
Step 5 one adds Quick Swipe component and Quick Pinch component in Unity3D, using Quick Swipe Component realizes rotation, is realized and is scaled using Quick Pinch component;
Step 5 two, respectively by the complete model and section view model of typical part and typical part fixture threedimensional model import In Unity3D, Quick Tap component is added in Unity3D, realizes complete part and section view zero using Quick Tap component The switching of part;
Step 5 three clicks script to typical part and the addition of typical part fixture and edits reference information to display, benefit The displaying of reference information is realized with Gui.Window component.
7. the development approach of the machine-building teaching auxiliary system according to claim 6 based on AR cloud storage technology, special Sign is: importing the typical part of production and typical part fixture animation in the step 7 and realizes animation exhibition in Unity3D Show the threedimensional model animated show of the typical part and typical part fixture in module;Process are as follows:
Step 7 one makes typical part and typical part fixture animation in Solidworks;
Step 7 two imports in Unity3D after typical part and typical part fixture animation to be exported as to .mp4 format, is added In Video Player and it is packaged the cloud storage module for being uploaded to cloud storage.
8. the development approach of the machine-building teaching auxiliary system according to claim 7 based on AR cloud storage technology, special Sign is: creating course in the step 8 in Unity3D and prepares subsystem;Detailed process are as follows:
Step 8 one creates Scene in Unity3D, and Canvas component is added using the UGUI of Unity3D;
Button component is added using the UGUI of Unity3D in step 8 two, adds random script, realization topic for Button component Mesh distribution function;
Toggle component and Image component is added using the UGUI of Unity3D in step 8 three, and adding in Image component need to The information to be shown adds the switching that script realizes information in Image component for Toggle component;
Step 8 four writes content to identify the character of input using the UGUI addition Input Field component of Unity3D The Part No. of file and typical part matches, and carries out content using the Text control in Image component and shows.
9. the development approach of the machine-building teaching auxiliary system according to claim 8 based on AR cloud storage technology, special Sign is: all models that step 1 to step 8 obtains being uploaded to HiAR with corresponding identification picture packing in the step 9 Cloud management backstage is simultaneously associated with one by one, realizes cloud storage module to the three of typical part in AR display module and typical part fixture Dimension module and its script be packaged and cloud storage;Detailed process are as follows:
The model for making script is dragged under Prefebs and is renamed by step 9 one, extends entitled .unity3d;
Step 9 two selects development platform for Android, and creates AssetBundles, obtains model compression packet;
Step 9 three, model compression is wrapped reach corresponding to the picture library of cloud identify image catalogue under, complete AR content packet Setting, the model compression packet that AR content packet, that is, step 9 two obtains.
CN201810654252.4A 2018-06-22 2018-06-22 Machine-building teaching auxiliary system and development approach based on AR cloud storage technology Pending CN108961420A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810654252.4A CN108961420A (en) 2018-06-22 2018-06-22 Machine-building teaching auxiliary system and development approach based on AR cloud storage technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810654252.4A CN108961420A (en) 2018-06-22 2018-06-22 Machine-building teaching auxiliary system and development approach based on AR cloud storage technology

Publications (1)

Publication Number Publication Date
CN108961420A true CN108961420A (en) 2018-12-07

Family

ID=64486281

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810654252.4A Pending CN108961420A (en) 2018-06-22 2018-06-22 Machine-building teaching auxiliary system and development approach based on AR cloud storage technology

Country Status (1)

Country Link
CN (1) CN108961420A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110349467A (en) * 2019-07-12 2019-10-18 中国民用航空飞行学院 A kind of navigation training on maintenance system and method based on augmented reality
CN111243373A (en) * 2020-03-27 2020-06-05 上海乂学教育科技有限公司 Panoramic simulation teaching system
CN113870440A (en) * 2021-10-13 2021-12-31 福州大学 MAR-based mechanical drawing mobile terminal learning aid system
CN116301390A (en) * 2023-05-24 2023-06-23 中科航迈数控软件(深圳)有限公司 Machine tool assembly guiding method and device, AR glasses and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105810025A (en) * 2016-05-10 2016-07-27 马骏 Interactive multimedia teaching system based on VR technology
CN105844979A (en) * 2015-12-15 2016-08-10 齐建明 Augmented reality book, and education system and method based on augmented reality book
CN105915851A (en) * 2016-05-06 2016-08-31 安徽伟合电子科技有限公司 Equipment use teaching system
CN106033647A (en) * 2015-03-20 2016-10-19 李佰聪 Programming education system
CN106530858A (en) * 2016-12-30 2017-03-22 武汉市马里欧网络有限公司 AR-based Children's English learning system and method
CN106683193A (en) * 2016-12-07 2017-05-17 歌尔科技有限公司 Three-dimensional model design method and design device
CN106780761A (en) * 2016-12-13 2017-05-31 浙江工业大学 Autistic child interest point information acquisition system based on augmented reality technology
CN106781777A (en) * 2017-02-14 2017-05-31 西安三好软件技术股份有限公司 The architecture tutoring system that a kind of actual situation is combined
CN107093339A (en) * 2017-06-23 2017-08-25 四川众航信息科技有限公司 Display methods of imparting knowledge to students and system
CN107368314A (en) * 2017-07-19 2017-11-21 哈尔滨工业大学 Course Design of Manufacture teaching auxiliary system and development approach based on mobile AR
CN107610217A (en) * 2017-08-22 2018-01-19 中广核工程有限公司 A kind of nuclear power generating equipment virtually identifies display systems and method
CN107657666A (en) * 2017-09-28 2018-02-02 上海理工大学 A kind of virtual experimental system of Machine Control

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106033647A (en) * 2015-03-20 2016-10-19 李佰聪 Programming education system
CN105844979A (en) * 2015-12-15 2016-08-10 齐建明 Augmented reality book, and education system and method based on augmented reality book
CN105915851A (en) * 2016-05-06 2016-08-31 安徽伟合电子科技有限公司 Equipment use teaching system
CN105810025A (en) * 2016-05-10 2016-07-27 马骏 Interactive multimedia teaching system based on VR technology
CN106683193A (en) * 2016-12-07 2017-05-17 歌尔科技有限公司 Three-dimensional model design method and design device
CN106780761A (en) * 2016-12-13 2017-05-31 浙江工业大学 Autistic child interest point information acquisition system based on augmented reality technology
CN106530858A (en) * 2016-12-30 2017-03-22 武汉市马里欧网络有限公司 AR-based Children's English learning system and method
CN106781777A (en) * 2017-02-14 2017-05-31 西安三好软件技术股份有限公司 The architecture tutoring system that a kind of actual situation is combined
CN107093339A (en) * 2017-06-23 2017-08-25 四川众航信息科技有限公司 Display methods of imparting knowledge to students and system
CN107368314A (en) * 2017-07-19 2017-11-21 哈尔滨工业大学 Course Design of Manufacture teaching auxiliary system and development approach based on mobile AR
CN107610217A (en) * 2017-08-22 2018-01-19 中广核工程有限公司 A kind of nuclear power generating equipment virtually identifies display systems and method
CN107657666A (en) * 2017-09-28 2018-02-02 上海理工大学 A kind of virtual experimental system of Machine Control

Non-Patent Citations (9)

* Cited by examiner, † Cited by third party
Title
张宗波;伊鹏;王珉;吴宝贵;秦臻;: "用于线上教学的工程图学虚拟现实交互模型平台", 东华大学学报(自然科学版), no. 04 *
张海森等: "基于AR技术的跨平台移动终端的辅助学习***", 《图学学报》 *
张海森等: "基于AR技术的跨平台移动终端的辅助学习***", 《图学学报》, no. 01, 15 February 2018 (2018-02-15) *
李伟等: "分布式仿真课程实验环节教学设计与实践", 《实验技术与管理》 *
李伟等: "分布式仿真课程实验环节教学设计与实践", 《实验技术与管理》, no. 02, 28 February 2016 (2016-02-28) *
潘旭东;孙晓磊;李旦;王广林;闫纪红;: "基于AR技术的机械制造工艺课程设计教学辅助***开发", 实验技术与管理, no. 10 *
潘旭东等: "基于AR技术的机械制造工艺课程设计教学辅助***开发", 《实验技术与管理》 *
潘旭东等: "基于AR技术的机械制造工艺课程设计教学辅助***开发", 《实验技术与管理》, no. 10, 31 October 2017 (2017-10-31) *
马林山;赵庆峰;: "基于现实技术的图书馆空间参与式服务项目开设研究", 图书馆理论与实践, no. 02, pages 92 - 96 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110349467A (en) * 2019-07-12 2019-10-18 中国民用航空飞行学院 A kind of navigation training on maintenance system and method based on augmented reality
CN110349467B (en) * 2019-07-12 2020-10-20 中国民用航空飞行学院 Navigation maintenance training system and method based on augmented reality
CN111243373A (en) * 2020-03-27 2020-06-05 上海乂学教育科技有限公司 Panoramic simulation teaching system
CN113870440A (en) * 2021-10-13 2021-12-31 福州大学 MAR-based mechanical drawing mobile terminal learning aid system
CN116301390A (en) * 2023-05-24 2023-06-23 中科航迈数控软件(深圳)有限公司 Machine tool assembly guiding method and device, AR glasses and storage medium
CN116301390B (en) * 2023-05-24 2023-09-15 中科航迈数控软件(深圳)有限公司 Machine tool assembly guiding method and device, AR glasses and storage medium

Similar Documents

Publication Publication Date Title
CN108961420A (en) Machine-building teaching auxiliary system and development approach based on AR cloud storage technology
US9508179B2 (en) Flexible 3-D character rigging development architecture
US20150095882A1 (en) Method for the utilization of environment media in a computing system
Ijiri et al. Seamless integration of initial sketching and subsequent detail editing in flower modeling
CN107368314A (en) Course Design of Manufacture teaching auxiliary system and development approach based on mobile AR
US9508178B2 (en) Flexible 3-D character rigging blocks with interface obligations
CN103247004A (en) Information management method and system based on electromechanical integrated BIM (building information model)
Wu et al. Integrated application of BIM and eXtended reality technology: a review, classification and outlook
CN114329695A (en) BIM + MR construction management method based on HoloLens
CN107833503A (en) Distribution core job augmented reality simulation training system
CN105653510A (en) Electronic homework correction method, device and system
CN110442817A (en) A kind of development system and production method of web-based mixed reality
Güler et al. Developing an CNC lathe augmented reality application for industrial maintanance training
Mourtzis et al. An augmented reality application for robotic cell customization
CN105989623B (en) The implementation method of augmented reality application based on handheld mobile device
CN108665172A (en) A kind of interactive building engineering construction quality control method
CN1996367A (en) 360 degree automatic analog simulation device system and method for implementing same
Benito et al. Enterprise Augmented Reality Projects: Build real-world, large-scale AR solutions for various industries
CN101650553A (en) Application of robot manufacturing tool for developing robot contents and method for manufacturing contents
Sung et al. Using virtual reality technologies for manufacturing applications
US20200098194A1 (en) Virtual Reality Anchored Annotation Tool
Antoine et al. Esquisse: using 3D models staging to facilitate the creation of vector-based trace figures
Kentaro et al. Browser-Based Manipulation of Virtual Objects Through MVVM Architecture with Data Binding
CN109544701A (en) A kind of SDK for showing and editing for threedimensional model
Vidakovic et al. Design of augmented reality-based Android app for simulation and programming of industrial robots

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181207

RJ01 Rejection of invention patent application after publication