CN112987929A - AR visual scene learning method and system based on labor skill teaching materials - Google Patents
AR visual scene learning method and system based on labor skill teaching materials Download PDFInfo
- Publication number
- CN112987929A CN112987929A CN202110282124.3A CN202110282124A CN112987929A CN 112987929 A CN112987929 A CN 112987929A CN 202110282124 A CN202110282124 A CN 202110282124A CN 112987929 A CN112987929 A CN 112987929A
- Authority
- CN
- China
- Prior art keywords
- animation
- user
- page information
- scene
- teaching material
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 230000000007 visual effect Effects 0.000 title claims abstract description 12
- 238000011156 evaluation Methods 0.000 claims abstract description 29
- 230000003993 interaction Effects 0.000 claims abstract description 15
- 238000009877 rendering Methods 0.000 claims abstract description 8
- 230000002452 interceptive effect Effects 0.000 claims description 14
- 230000003014 reinforcing effect Effects 0.000 abstract 1
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000007654 immersion Methods 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses an AR visual scene learning method and system based on labor skill teaching materials, relating to the technical field of AR, and comprising the following specific steps: scanning page information of the teaching materials by using a mobile terminal, and sending the page information to an AR terminal; the AR terminal receives the page information and acquires an AR animation scene matched with the page information; rendering the AR animation scene to the current environment, and playing the AR animation on a teaching material; the user interacts with the AR animation according to the designated action; and after finishing the interaction with the AR animation, performing online learning evaluation. Combine AR technique and labor skill teaching material, reinforcing user's learning experience sense and sense of immersing, further consolidated the study result, promoted learning efficiency.
Description
Technical Field
The invention relates to the technical field of AR, in particular to an AR visual scene learning method and system based on labor skill teaching materials.
Background
The traditional labor skill paper teaching material focuses on theoretical knowledge, pictures in the teaching material are many and complex, the phenomenon that a user cannot master labor skill through black and white legends on the teaching material exists, most of popular electronic books on the market only directly move the content of the traditional paper teaching material to equipment, the generated interactivity is monotonous and hard, and for the labor skill teaching material, the user cannot restore the content of the teaching material in a real situation easily through imagination.
With the continuous development of the AR technology, the application industry range is wider, the combination of the AR technology and the labor skill teaching material is also a content of the application attempt, and compared with the conventional teaching material, the labor skill teaching material combining the AR technology for scene display can arouse the interest of the user, so how to apply the AR technology to the labor skill teaching material to enhance the interactivity between the teaching material and the user is a problem to be solved urgently by technical personnel in the field.
Disclosure of Invention
In view of this, the invention provides an AR visual scene learning system based on a labor skill teaching material, so as to solve the problems proposed in the background art, and apply the AR technology to the labor skill teaching material to enhance the interaction between the teaching material and the user.
In order to achieve the above object, a first aspect of the present invention provides an AR visual scene learning method based on a labor skill teaching material, which includes the following specific steps:
scanning page information of the teaching materials by using a mobile terminal, and sending the page information to an AR terminal;
the AR terminal receives the page information and acquires an AR animation scene matched with the page information;
rendering the AR animation scene to the current environment, and playing the AR animation on a teaching material;
the user interacts with the AR animation according to the designated action;
and after finishing the interaction with the AR animation, performing online learning evaluation.
By adopting the technical scheme, the method has the following beneficial technical effects: the combination of the augmented reality technology and the labor skill teaching material is an innovative form of education, the traditional paper teaching material is used as a carrier, and the content of the teaching material is displayed in front of a user in an AR form by identifying page information on the teaching material, so that the learning interest of the user is easily aroused, and the learning experience and immersion of the user are enhanced.
Preferably, the mobile terminal comprises a mobile phone, a computer and a wearable intelligent device.
Preferably, the mobile terminal stores an AR program for generating the AR animation scene.
Preferably, the specific steps of the user interacting with the AR animation according to the designated action are:
acquiring a virtual object in the AR animation scene through the mobile terminal;
matching the virtual object with a characteristic value in a preset characteristic database to determine whether the object is an interactive object;
and in the case that the virtual object is the interactive object, executing a preset interactive action on the virtual object according to an operation gesture of a user.
By adopting the technical scheme, the method has the following beneficial technical effects: compare in prior art the teaching form of scanning teaching material two-dimensional code instant broadcast teaching audio, the user can interact with the virtual object in the AR animation scene in the technical scheme of this application for the user carries out the sight study, promotes the interest and the experience sense of user's study.
Preferably, the online learning evaluation method comprises the following specific steps:
determining evaluation content based on the teaching materials learned by the user, wherein each knowledge point corresponds to a corresponding score;
questioning by the virtual object according to the evaluation content in the AR animation scene;
acquiring voice information input by a user;
analyzing the voice information, and outputting correct reply voice information by the virtual object according to an analysis result;
counting the scores of the learning evaluation of the user, and if the scores are lower than 60, repeatedly asking and answering wrong questions;
and if the score is more than 90 points, rewarding the user.
By adopting the technical scheme, the method has the following beneficial technical effects: the technical scheme of this application has not only considered the problem of user experience, has still considered the problem of how to detect user's study achievement, has studied the work skill after, carries out the knowledge question and answer to the user to the audio-visual user study achievement that shows of form of score, is less than passing, carries out repeated question and answer to the wrong question, when detecting the study achievement, has further consolidated the study result, has promoted learning efficiency.
The invention provides an AR visual scene learning system based on labor skill teaching materials, which comprises a teaching material content acquisition module, an AR terminal module, a human-computer interaction module and an online learning evaluation module, wherein,
the teaching material content acquisition module is used for acquiring page information of the teaching material according to the scanning result of the mobile terminal;
the AR terminal module is used for acquiring a matched AR animation scene according to the page information, rendering the scene to the current environment and playing AR animation on the teaching material;
the human-computer interaction module is used for performing human-computer interaction with the AR animation according to the specified action;
and the online learning evaluation module is used for performing online learning evaluation according to the learning content.
Through the technical scheme, the invention discloses and provides an AR visual scene learning method and system based on labor skill teaching materials, and compared with the prior art, the method and system have the following beneficial technical effects:
(1) the AR technology is combined with the labor skill teaching material to achieve innovation, the traditional paper teaching material is used as a carrier, and the page information on the teaching material is recognized, so that the content of the teaching material is displayed in front of a user in an AR mode, the learning interest of the user is easily aroused, and the learning experience and immersion of the user are enhanced.
(2) By using the AR technology, students can combine virtual environment with real environment, super-sensory experience is achieved, the experiment cost of school teaching can be reduced, and the experiment safety of teachers and students is improved.
(3) After the labor skills are learned, the user is asked and answered, learning results of the user are displayed visually in a score form, the learning results are detected, meanwhile, the learning results are further consolidated, and the learning efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic flow chart of the method of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses an AR visual scene learning method based on labor skill teaching materials in a first aspect, which comprises the following specific steps:
the method comprises the following steps: scanning page information of the teaching materials by using the mobile terminal, and sending the page information to the AR terminal;
specifically, the mobile terminal comprises a mobile phone, a computer and other intelligent terminals and wearable intelligent equipment, and an AR program for generating an AR animation scene is stored in the mobile terminal.
Step two: the AR terminal receives the page information and acquires an AR animation scene matched with the page information;
step three: rendering the AR animation scene to the current environment, and playing the AR animation on the teaching material;
step four: the user interacts with the AR animation according to the designated action;
it should be further explained that the specific steps of the user interacting with the AR animation according to the designated action are as follows:
acquiring a virtual object in an AR animation scene through a mobile terminal;
matching the virtual object with the characteristic values in a preset characteristic database to determine whether the object is an interactive object;
and in the case that the virtual object is an interactive object, executing a preset interactive action on the virtual object according to the operation gesture of the user.
Step five: and after finishing the interaction with the AR animation, performing online learning evaluation.
In the technical scheme of the application, the problem of user experience is considered, and the problem of how to detect the learning result of the user is also considered, so that the user can obtain the super-sense experience, and meanwhile, the user can learn knowledge and labor skills in a real-time manner.
Furthermore, the online learning evaluation method comprises the following specific steps:
determining evaluation content based on the teaching materials learned by the user, wherein each knowledge point corresponds to a corresponding score;
questioning by the virtual object in the AR animation scene according to the evaluation content;
acquiring voice information input by a user;
analyzing the voice information, and outputting correct reply voice information by the virtual object according to an analysis result;
counting the scores of the learning evaluation of the user, and if the scores are lower than 60, repeatedly asking and answering wrong questions;
and if the score is more than 90 points, rewarding the user.
For example: the method comprises the steps that a user scans page information of labor skill teaching materials by using a mobile phone, the content of a section of the labor skill teaching materials is 'I learn to erase a blackboard', an AR terminal receives a page information instruction, and an AR animation scene matched with the page information is obtained from an AR animation information base; rendering an AR animation scene to the current environment, and playing AR animation of 'I learn to wipe a blackboard' on a labor skill teaching material; acquiring a virtual object in an AR animation scene through a camera on a mobile phone; matching the virtual object with the characteristic values in a preset characteristic database to determine whether the object is an interactive object; when the virtual object is an interactive object, the virtual object is subjected to preset interactive action according to the operation gesture of the user, the interactive object is set to be a blackboard eraser, when the camera is aligned to the blackboard eraser, the user can interact with the blackboard eraser, and the interactive blackboard eraser not only can be used for watching videos and reading teaching material contents to learn labor skill teaching materials, but also can be used for experiencing by using AR.
It needs to be further explained that after interaction with the AR animation is completed, online learning evaluation is performed, and while the user obtains super-sensory experience, learning to knowledge and learning to labor skills are earnestly achieved.
Determining evaluation content based on the content of the labor skill teaching material which is learned by the user, namely that 'I learn to erase the blackboard', and corresponding scores are respectively corresponding to each knowledge point; questioning by the virtual object in the AR animation scene according to the evaluation content; the user answers the voice, and the AR terminal acquires the voice information input by the user; analyzing the voice information, and outputting correct reply voice information by the virtual object according to an analysis result; counting the scores of the learning evaluation of the user, and if the scores are lower than 60, repeatedly asking and answering wrong questions; and if the score is more than 90 points, rewarding the user.
The second aspect of the embodiment of the invention provides an AR visual scene learning system based on labor skill teaching materials, which comprises a teaching material content acquisition module, an AR terminal module, a human-computer interaction module and an online learning evaluation module, wherein,
the teaching material content acquisition module is used for acquiring page information of the teaching material according to the scanning result of the mobile terminal;
the AR terminal module is used for acquiring a matched AR animation scene according to the page information, rendering the scene to the current environment and playing the AR animation on the teaching material;
the human-computer interaction module is used for performing human-computer interaction with the AR animation according to the specified action;
and the online learning evaluation module is used for performing online learning evaluation according to the learning content.
The technical scheme of the invention is characterized in that the traditional paper teaching material is used as a carrier, and the content of the teaching material is displayed in front of a user in an AR form by identifying page information on the teaching material, so that the learning interest of the user is easily aroused, and the learning experience and immersion of the user are enhanced.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (6)
1. An AR visual scene learning method based on labor skill teaching materials is characterized by comprising the following specific steps:
scanning page information of the teaching materials by using a mobile terminal, and sending the page information to an AR terminal;
the AR terminal receives the page information and acquires an AR animation scene matched with the page information;
rendering the AR animation scene to the current environment, and playing the AR animation on a teaching material;
the user interacts with the AR animation according to the designated action;
and after finishing the interaction with the AR animation, performing online learning evaluation.
2. The method as claimed in claim 1, wherein the mobile terminal comprises a mobile phone, a computer and a wearable smart device.
3. The method as claimed in claim 1, wherein the mobile terminal stores an AR program for generating the AR animation scene.
4. The method as claimed in claim 1, wherein the specific steps of the user interacting with the AR animation according to the designated action are as follows:
acquiring a virtual object in the AR animation scene through the mobile terminal;
matching the virtual object with a characteristic value in a preset characteristic database to determine whether the object is an interactive object;
and in the case that the virtual object is the interactive object, executing a preset interactive action on the virtual object according to an operation gesture of a user.
5. The method as claimed in claim 4, wherein the on-line learning evaluation comprises the following specific steps:
determining evaluation content based on the teaching materials learned by the user, wherein each knowledge point corresponds to a corresponding score;
questioning by the virtual object according to the evaluation content in the AR animation scene;
acquiring voice information input by a user;
analyzing the voice information, and outputting correct reply voice information by the virtual object according to an analysis result;
counting the scores of the learning evaluation of the user, and if the scores are lower than 60, repeatedly asking and answering wrong questions;
and if the score is more than 90 points, rewarding the user.
6. An AR visual scene learning system based on labor skill teaching materials is characterized by comprising a teaching material content acquisition module, an AR terminal module, a human-computer interaction module and an online learning evaluation module, wherein,
the teaching material content acquisition module is used for acquiring page information of the teaching material according to the scanning result of the mobile terminal;
the AR terminal module is used for acquiring a matched AR animation scene according to the page information, rendering the scene to the current environment and playing AR animation on the teaching material;
the human-computer interaction module is used for performing human-computer interaction with the AR animation according to the specified action;
and the online learning evaluation module is used for performing online learning evaluation according to the learning content.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110282124.3A CN112987929A (en) | 2021-03-16 | 2021-03-16 | AR visual scene learning method and system based on labor skill teaching materials |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110282124.3A CN112987929A (en) | 2021-03-16 | 2021-03-16 | AR visual scene learning method and system based on labor skill teaching materials |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112987929A true CN112987929A (en) | 2021-06-18 |
Family
ID=76335917
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110282124.3A Pending CN112987929A (en) | 2021-03-16 | 2021-03-16 | AR visual scene learning method and system based on labor skill teaching materials |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112987929A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113742500A (en) * | 2021-07-15 | 2021-12-03 | 北京墨闻教育科技有限公司 | Situational scene teaching interaction method and system |
| CN114237389A (en) * | 2021-12-06 | 2022-03-25 | 华中师范大学 | Holographic imaging-based in-situ induction forming method in enhanced teaching environment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575132A (en) * | 2015-01-14 | 2015-04-29 | 蝶恋花动漫（天津）有限公司 | Interaction education method and system based on natural image recognition and reality augmentation technology |
| CN106155311A (en) * | 2016-06-28 | 2016-11-23 | 努比亚技术有限公司 | AR helmet, AR interactive system and the exchange method of AR scene |
| CN110471530A (en) * | 2019-08-12 | 2019-11-19 | 苏州悠优互娱文化传媒有限公司 | It is a kind of based on children's book equipped AR interactive learning method, apparatus, medium |
-
2021
- 2021-03-16 CN CN202110282124.3A patent/CN112987929A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575132A (en) * | 2015-01-14 | 2015-04-29 | 蝶恋花动漫（天津）有限公司 | Interaction education method and system based on natural image recognition and reality augmentation technology |
| CN106155311A (en) * | 2016-06-28 | 2016-11-23 | 努比亚技术有限公司 | AR helmet, AR interactive system and the exchange method of AR scene |
| CN110471530A (en) * | 2019-08-12 | 2019-11-19 | 苏州悠优互娱文化传媒有限公司 | It is a kind of based on children's book equipped AR interactive learning method, apparatus, medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113742500A (en) * | 2021-07-15 | 2021-12-03 | 北京墨闻教育科技有限公司 | Situational scene teaching interaction method and system |
| CN114237389A (en) * | 2021-12-06 | 2022-03-25 | 华中师范大学 | Holographic imaging-based in-situ induction forming method in enhanced teaching environment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Jones | Understanding the integral: Students’ symbolic forms | |
| Barreira et al. | MOW: Augmented Reality game to learn words in different languages: Case study: Learning English names of animals in elementary school | |
| US11012595B2 (en) | Augmented reality | |
| CN109101879B (en) | Posture interaction system for VR virtual classroom teaching and implementation method | |
| CN112987929A (en) | AR visual scene learning method and system based on labor skill teaching materials | |
| Martín-Gutiérrez et al. | Evaluating the usability of an augmented reality based educational application | |
| Anindhita et al. | Designing interaction for deaf youths by using user-centered design approach | |
| CN111046852A (en) | Personal learning path generation method, device and readable storage medium | |
| CN113555085A (en) | Working memory training method and device for cognitive disorder | |
| Papadaki et al. | The book of Ellie: An interactive book for teaching the alphabet to children | |
| Han et al. | The cross-cultural acceptance of tutoring robots with augmented reality services | |
| Luangrungruang et al. | Applying universal design for learning in augmented reality education guidance for hearing impaired student | |
| CN113556599A (en) | Video teaching method and device, television and storage medium | |
| Alkhasawneh et al. | The effect of using augmented reality technology in developing imaginative thinking among students with learning difficulties | |
| CN115756157A (en) | Training system based on internet virtual reality | |
| Akazawa et al. | A learning support system for 9× 9 multiplication table with Kinect | |
| CN114895795A (en) | Interaction method, interaction device, interaction platform, electronic equipment and storage medium | |
| CN113570227A (en) | Online education quality evaluation method, system, terminal and storage medium | |
| CN114095747A (en) | Live broadcast interaction system and method | |
| Flinton et al. | NETIVAR: NETwork information visualization based on augmented reality | |
| US20020152187A1 (en) | Expert system for intelligent teaching | |
| Clegg et al. | Multimedia and immersive training materials influence impressions of learning but not learning outcomes | |
| CN113409634B (en) | Task and path oriented digital language learning method | |
| Taylor et al. | Smartphone augmented reality for EFL learners | |
| Agno et al. | Digital Learning Readiness in Developing E-Module for Intensification of Basic Science Process Skills among Grade 3 Students in a Collaborative Learning Environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210618 |
|
| RJ01 | Rejection of invention patent application after publication |