CN112614399A - Dance teaching equipment based on virtual reality and teaching method thereof - Google Patents
Dance teaching equipment based on virtual reality and teaching method thereof Download PDFInfo
- Publication number
- CN112614399A CN112614399A CN202011341864.1A CN202011341864A CN112614399A CN 112614399 A CN112614399 A CN 112614399A CN 202011341864 A CN202011341864 A CN 202011341864A CN 112614399 A CN112614399 A CN 112614399A
- Authority
- CN
- China
- Prior art keywords
- module
- student
- dance
- virtual
- action
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/0015—Dancing
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses dance teaching equipment based on virtual reality and a dance teaching method thereof, wherein the dance teaching equipment comprises VR glasses, a network synchronization module, a human-computer interaction module, a cloud server and a somatosensory peripheral; the cloud server is used for the merchant to upload updated dance courses; the network synchronization module comprises a receiving module and a network module, the network module is connected with the cloud server and shares dance course data in the cloud server, and the receiving module automatically downloads an update package of dance courses; the system comprises three teaching modes, namely an exercise mode, a scoring mode and an assessment mode; compared with the prior art: adopt VR live action technique, carry out real person simulation teaching, still can experience the virtual reality scene of dancing of different scenes to set up body and feel the peripheral hardware, catch to the dance action, reached very good exercise effect, also very big arouses the interest of child's study, for present network course, can let child's study faster.
Description
Technical Field
The invention relates to dance teaching equipment based on virtual reality and a dance teaching method thereof.
Background
On-line teaching is taken as an emerging education mode, great influence is brought to life and study of people, the abdomen scripture can be satisfied without leaving home, but the on-line teaching mode has very poor effect on the courses in the aspects of body motions such as dance and martial arts, so that the on-line teaching mode is adopted for courses such as dance and martial arts generally, but the limitation of the mode is large, and for example, when the closed management is realized by the external environment, the teaching course cannot be performed on line.
Disclosure of Invention
In view of the above, the present invention provides a dance teaching apparatus based on virtual reality and a teaching method thereof, so as to solve at least one problem in the prior art.
In order to achieve the technical purpose, the technical scheme of the invention is as follows:
dance teaching equipment based on virtual reality comprises VR glasses, a network synchronization module, a human-computer interaction module, a cloud server and a somatosensory peripheral; the cloud server can be used for uploading updated dance courses; the network synchronization module comprises a receiving module and a network module, the network module is connected with the cloud server and shares dance course data in the cloud server, and the receiving module automatically downloads an update package of dance courses; the VR glasses are head-mounted display equipment with independent processors, and the receiving module, the network module and the human-computer interaction module are all embedded in the VR glasses;
the human-computer interaction module comprises a character selection module, a virtual environment selection module, an exercise module, a grading module, an intelligent AI conversation module, a correction module and an identification module;
through the cooperation of VR glasses and somatosensory peripherals, a user can select characters, select virtual environment, carry out intelligent AI conversation and correct actions by combining a human-computer interaction module, and remote interactive dance teaching is realized in the virtual reality environment.
Preferably, the recognition module can intelligently analyze and recognize dance motion information transmitted to the recognition module by the somatosensory peripheral, captures dance motion information of the student through the somatosensory peripheral, transmits the captured dance motion information to the recognition module, and compares, analyzes and recognizes the dance motion information of the student with standard motions in the receiving module;
the intelligent AI dialogue module provides a voice basis for the trainees at the exercise module and the scoring module, dance action information is recognized through the recognition module, then voice instructions are output to the intelligent AI dialogue module, the voice module outputs voice, and the trainees receive the voice information; the intelligent AI dialogue module receives the voice signal and transmits the voice signal to the recognition module to be compared with an internal database for analysis and recognition, and the corresponding voice signal is output or the corresponding functional module is opened after the recognition and the recognition;
the character selection module provides different character selections for the student, the teacher collects a three-dimensional image of the teacher through the somatosensory peripheral and transmits character information to the identification module, the identification module identifies an image signal and generates the three-dimensional character image, the three-dimensional character information is transmitted to the cloud server through the network module, and the three-dimensional image of the teacher is uploaded on the cloud server to provide basic data for the student to select the teacher according to personal preference during dance learning;
the virtual environment selection module provides different virtual scenes for the student when the student learns dancing, the background manager uploads the different virtual scenes to the cloud server, and basic data are provided for the student to select the different virtual scenes according to personal preference when the student learns dancing;
the dance teaching device comprises a practice module, a body sensing peripheral, a correction module, a recognition module, a VR virtual display device and an intelligent AI dialogue module, wherein the practice module corrects the error action of a student in the practice module, the body sensing peripheral collects dance action information of the student and uploads the action information to the recognition module, the comparison is carried out between the dance action information and a dance course database stored in the recognition module according to the action information transmitted to the recognition module from the body sensing peripheral, the comparison information is transmitted to the VR virtual display device and the intelligent AI dialogue module, when a certain action of the student does not reach a standard, a dance course is paused, a position with an nonstandard action is marked in a virtual scene, voice guidance is carried out, the student is prompted to repeat the previous action, and the dance course is continued after;
the dance training module is used for providing a basic scene for dance training for a student, supervising and urging the student to correct nonstandard actions in a dance process, capturing and collecting dance action information of the student through the somatosensory peripheral equipment, transmitting the dance action information to the recognition module, comparing the dance action information of the student with dance course packet data in the recognition module by the recognition module, transmitting the comparison information to the VR virtual display and intelligent AI dialogue module, and providing voice guidance for the student so that the student can conduct targeted training;
the scoring module scores each action of the dance exercise of the student, then scores comprehensively, captures and collects dance action information of the student through the somatosensory peripheral, transmits the dance action information to the recognition module, the recognition module compares the dance action information of the student with dance course package data inside the recognition module to score, uploads the score information to the cloud server through the network module, the background can download the data in the cloud server, and interviews and guidance are conducted by a special teacher according to scoring conditions and difficult points of the student.
Preferably, the human-computer interaction module further comprises a physical ability detection module;
the physical ability detection module detects physical ability of a student in real time, facial information and action information of the student are captured through the physical sensing peripheral device, then the information is transmitted to the recognition module, the recognition module carries out comprehensive processing on the information, so that the physical ability of the student is judged, the student reaching a set fatigue value sends out a voice prompt through the intelligent AI dialogue module, a rest setting time is suggested, a course is automatically stopped, after the set time is reached, the student appears in the physical sensing peripheral device area and wears VR glasses, the course continues, and the student can continue to learn;
preferably, the somatosensory peripheral comprises a rechargeable battery, a scanner, a signal emitter and a whole body motion capture sensing controller.
Preferably, the human-computer interaction module further comprises a remote video module;
the remote video module comprises a remote video camera and a remote signal matching module which are arranged on the somatosensory peripheral, the remote signal matching module comprises a signal transmitting end and a signal receiving end, one VR glasses terminal transmits a video request to the signal receiving end through the transmitting end, an operator confirms the video request signal of the signal receiving end at the other VR glasses terminal, and the signal transmitting end and the signal receiving end are successfully matched;
the remote video module is connected with two VR glasses through a remote signal pairing module, image signals of a student or a teacher are transmitted into virtual display interfaces of the VR glasses of the two VR glasses through an image sensor arranged in the somatosensory peripheral, online video connection is established, a whole-body motion capture sensor captures dance motion information of the student in real time and transmits the dance motion information to the recognition module, the recognition module marks out an nonstandard position after recognition, the nonstandard position is uploaded to a cloud server through a network module, the video is transmitted into the VR glasses of the corresponding teacher end in real time, and the teacher can check and evaluate the nonstandard motion marked out in the video;
preferably, the somatosensory peripheral is of a box structure, and a fixed sucker is arranged on the side face of the somatosensory peripheral.
The teaching method of the dance teaching equipment based on virtual reality comprises three teaching modes, namely an exercise mode, a grading mode and an assessment mode;
the exercise mode comprises the following steps:
(1) opening a network module to enable the network module to be connected with a cloud server, automatically receiving the course packet data, the virtual scene data and the three-dimensional character image data by a receiving module, and opening an exercise module on a virtual display interface by a student so as to enter an exercise mode;
(2) the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student;
(3) the receiving module guides the received three-dimensional character image data into a VR virtual display interface, a student can preview the three-dimensional character image, the three-dimensional image rotates, the student can observe the character image from various angles, and the student selects a corresponding teacher and then enters the next virtual display interface;
(4) the receiving module imports the received virtual scene data into a VR virtual display interface, the virtual scene data are arranged according to the sequence of the updated time, a student can preview the virtual scene, rotate the virtual scene, watch the virtual scene from multiple angles, and determine to enter the corresponding virtual scene;
(5) the teacher can see that the teacher leads in a virtual scene, a virtual reality world is presented in eyes of the student, the somatosensory peripheral device collects dance actions of the student in real time and transmits the collected dance action signals to the recognition module in real time, the recognition module compares the action signals with an internal dance database, if places with nonstandard actions are found, the course is paused, the student is subjected to voice prompt through intelligent AI voice, the previous action is repeated, the course is automatically continued after the action is standard, and the learning and training are continued;
the scoring mode includes the steps of:
(1) opening a network module to connect the network module with a cloud server, automatically receiving the course packet data and the virtual scene data by a receiving module, and opening a scoring module on a virtual display interface by a student so as to enter a scoring mode;
(2) the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student;
(3) the receiving module imports the received virtual scene data into a VR display interface, the virtual scene data are arranged according to the sequence of the updated time, a student can preview the virtual scene, rotate the virtual scene, watch the virtual scene in multiple angles, and enter the corresponding virtual scene after the virtual scene is selected;
(4) the student's that the peripheral hardware was gathered is felt to the body, and generate three-dimensional stereoscopic image through identification module, lead-in to the virtual scene in, the student can see self and put into in the virtual scene, the student dances according to the dance music rhythm in the course package, and there is a demonstration of grading in virtual display interface top, the dance action signal transmission who the peripheral hardware was gathered is felt to the body is after identification module, identification module compares with the data of inside course package, and generate the grading, each frame action all can be caught by accurate, the record is graded, after having jumped, there is a total grading, identification module can be with this dance's video and the graded fine and then upload the high in the clouds server through network module, can supply the mr to download at the background and watch.
The assessment mode comprises the following steps:
(1) opening a network module, connecting the network module with a cloud server, automatically receiving the course packet data, the scene model data and the three-dimensional character image data by a receiving module, and enabling a student to select a remote video module on a virtual display interface so as to enter an evaluation mode;
(2) the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student;
(3) the receiving module imports the received virtual scene data into a VR virtual display interface, the virtual scene data are arranged according to the sequence of the updated time, a student can preview the virtual scene, rotate the virtual scene, watch the virtual scene in multiple angles, and finally enter the virtual scene selected;
(4) the receiving module guides the received three-dimensional figure image data into a VR virtual display interface, a student can preview the three-dimensional figure image, the three-dimensional figure image rotates, the student can observe figure images from various angles, the student enters a video call after selecting a corresponding teacher, the student is in online video connection with the teacher through the network module, and the student enters an assessment scene after being connected;
(5) the body feels the student's that the peripheral hardware gathered image information and whole-body dance action information, and generate three-dimensional stereoscopic image through identification module, lead-in to the virtual scene in, the student can see self and put into in the virtual scene of VR, the student dances according to the dance music rhythm in the course package, the body feels behind the dance action signal transmission identification module that the peripheral hardware gathered, mark out nonstandard position after the identification module discernment, upload to high in the clouds server through the network module, in transmitting the video to the VR glasses that correspond mr end in real time again, mr can combine the nonstandard action examination evaluation of marking out in the video.
Adopt the beneficial effect that above-mentioned technical scheme brought:
adopt VR live action technique, carry out real person simulation teaching, still can experience the virtual reality scene of dancing of different scenes to set up body and feel the peripheral hardware, catch to the dance action, reached very good exercise effect, also very big arouses the interest of child's study, for present network course, can let child's study faster.
Drawings
FIG. 1 is a system architecture diagram of the present invention;
fig. 2 is a schematic diagram of the operation mode of the present invention.
Detailed Description
The technical solution of the present invention will be described in detail below with reference to the accompanying drawings and some embodiments.
The system designed by the invention as shown in fig. 1 comprises the following software and hardware:
VR glasses: the head-mounted display equipment with the independent processor has the function of displaying a virtual interface and can provide a hardware basis for a user to put in a virtual reality world; the head-mounted display equipment adopts small and exquisite, light and portable VR equipment in the prior art and is connected with a head fixing belt;
cloud server: the dance course package is a transfer station of data, and a service provider can upload the updated dance course package to a cloud server for a student to download; the trainees can also upload the trained dance videos to a cloud server for the teachers to download and verify; the method can ensure that the student receives the latest course in real time, is convenient for the student to learn, and simultaneously ensures that the teacher can know the dance practice condition of the student in time, and the problems existing on line can be solved by the teacher in time on line;
network module and receiving module: the network module can be connected with the cloud server and shares data in the cloud server so as to upload data or download data, the downloaded data is received and stored by the receiving module, and the receiving module can also automatically clean and optimize the stored data periodically so as to reduce the occupation of outdated data on an internal memory;
a character selection module: the method comprises the steps that different character selections are provided for a student, a teacher collects a three-dimensional image of the teacher through a somatosensory peripheral and transmits character information to an identification module, the identification module identifies an image signal and generates a three-dimensional character image, the three-dimensional character information is transmitted to a cloud server through a network module, and basic data are provided for the student to select the teacher according to personal preference during dance learning;
a virtual environment selection module: different virtual scenes are provided for the student when the student learns dancing, the background manager uploads the different virtual scenes to the cloud server, and basic data are provided for the student to select the different virtual scenes according to personal preference when the student learns dancing;
an identification module: dance motion information transmitted to the recognition module by the somatosensory peripheral can be intelligently analyzed and recognized, dance motion information of a student is captured through the somatosensory peripheral, the captured dance motion information is transmitted to the recognition module, and the recognition module compares, analyzes and recognizes the dance motion information of the student with standard motions in the receiving module;
intelligent AI dialogue module: providing a voice basis for the trainees in the exercise module and the scoring module, identifying dance action information through the identification module, outputting voice instructions to the intelligent AI dialogue module, outputting voice through the voice module, and receiving voice information by the trainees; the intelligent AI dialogue module receives the voice signal and transmits the voice signal to the recognition module to be compared with an internal database for analysis and recognition, and the corresponding voice signal is output or the corresponding functional module is opened after the recognition and the recognition; the operation of the student is greatly facilitated through the voice function instruction;
a correction module: correcting the wrong actions of the student in the exercise module, acquiring dance action information of the student by the somatosensory peripheral, uploading the action information to the recognition module, comparing the action information with a dance course database stored in the recognition module according to the action information transmitted from the somatosensory peripheral to the recognition module, transmitting the comparison information to VR virtual display equipment and the intelligent AI dialogue module, pausing a dance course when a certain action of the student does not reach a standard, marking a position with an nonstandard action in a virtual scene, performing voice guidance, prompting the student to repeat the previous action, and continuing the dance course after the student repeats the action until the action reaches the standard;
physical stamina detection module: detecting physical ability of a student in real time, capturing facial information and action information of the student through the somatosensory peripheral, transmitting the information to the recognition module, and comprehensively processing the information by the recognition module, so that the physical ability of the student is judged, the student reaching a set fatigue value sends out a voice prompt by the intelligent AI dialogue module, the rest set time is recommended, the course is automatically stopped, and after the set time is reached, the student appears in the somatosensory peripheral area and wears VR glasses, the course continues, and the student can continue to learn;
an exercise module: providing a basic scene for dance practice for a student, supervising the student to correct nonstandard movements in a dance process, capturing and collecting dance movement information of the student through a somatosensory peripheral, transmitting the dance movement information to an identification module, comparing the dance movement information of the student with dance course packet data in the recognition module by the identification module, transmitting the comparison information to a VR virtual display and intelligent AI dialogue module, and providing voice guidance for the student so that the student can practice pertinently;
a scoring module: scoring each action of dance practice of the student, then comprehensively scoring, capturing and collecting dance action information of the student through the somatosensory peripheral, transmitting the dance action information to the recognition module, comparing and scoring the dance action information of the student with dance course packet data in the recognition module, uploading the scoring information to the cloud server through the network module, downloading the data in the cloud server by the background, and performing offline interview and tutoring through a special teacher according to the scoring condition and difficult points of the student;
a remote video module: the remote video camera and the remote signal matching module are arranged on the somatosensory peripheral, the remote signal matching module comprises a signal transmitting end and a signal receiving end, one VR glasses terminal transmits a video request to the signal receiving end through the transmitting end, an operator confirms the video request signal of the signal receiving end at the other VR glasses terminal, and the signal transmitting end and the signal receiving end are successfully matched; the remote video module needs to be connected with two pieces of VR glasses through a remote signal pairing module, image signals of a student or a teacher are transmitted into virtual display interfaces of the VR glasses of the two sides through an image sensor arranged in the somatosensory peripheral device, online video connection is established, a whole-body motion capture sensor captures dance motion information of the student in real time and transmits the dance motion information to the recognition module, the recognition module marks out an nonstandard position after recognition, the dance motion information is uploaded to a cloud server through a network module and then transmits the video to the VR glasses of the corresponding teacher end in real time, and the teacher can check and evaluate the nonstandard motion marked out in the video;
in addition, when the student exercises dance, the student can send a voice instruction to pause the dance exercise interface;
in this embodiment, the somatosensory peripheral includes, but is not limited to, a rechargeable battery, a scanner, a signal transmitter, a whole body motion capture sensing controller; the body is felt the peripheral hardware and is the box structure, and the side is equipped with fixed suction cup or other parts that are used for fixing, and the student sends sensing or control command to the virtual reality scene through the body is felt the peripheral hardware, and the virtual scene feedback body is felt and is experienced and act on one's body through the body is felt the peripheral hardware, makes the student have a real virtual reality and immerses the sense.
As shown in fig. 2, the teaching method of the dance teaching device based on virtual reality includes three teaching modes, an exercise mode, a scoring mode and an assessment mode;
an example of the practice mode is as follows:
the method comprises the steps that a network module is opened, the network module is connected with a cloud server, a receiving module automatically receives course package data, virtual scene data and three-dimensional character image data, and a student issues a voice command to open an exercise mode, so that an exercise module on a virtual display interface is opened, and the exercise mode is entered; the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student; the receiving module guides the received three-dimensional figure image data into a VR virtual display interface, a student sends a voice instruction of ' preview teacher ' to preview the three-dimensional figure image, the three-dimensional figure image rotates to enable the student to observe figure images from various angles, the student sends a voice instruction of ' select Nth teacher ' to select a corresponding teacher ' and then enters the next virtual display interface; the receiving module imports the received virtual scene data into a VR virtual display interface, the virtual scene data are arranged according to the sequence of the updated time, and the trainee can send a voice instruction of ' preview virtual scene ', can preview the virtual scene, rotate the virtual scene, watch the virtual scene from multiple angles, select the Nth virtual scene ' through the voice instruction, and determine to enter the corresponding virtual scene; the teacher can see that the teacher leads in a virtual scene, a virtual reality world is presented in eyes of the student, the somatosensory peripheral device collects dance actions of the student in real time and transmits the collected dance action signals to the recognition module in real time, the recognition module compares the action signals with an internal dance database, if places with nonstandard actions are found, the course is paused, the student is subjected to voice prompt through intelligent AI voice, the previous action is repeated, the course is automatically continued after the action is standard, and the learning and training are continued;
an example of a scoring pattern is as follows:
the network module is opened, the network module is connected with the cloud server, the receiving module automatically receives the curriculum package data and the virtual scene data, and a student opens a scoring module on a virtual display interface through a voice instruction so as to enter a scoring mode; the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student; the receiving module imports the received virtual scene data into a VR display interface, the virtual scene data are arranged according to the sequence of the updated time, a student can send a voice instruction of 'preview virtual scene', can preview the virtual scene, rotates the virtual scene, watches the virtual scene in multiple angles, and sends the voice instruction of 'enter the Nth virtual scene' after selection, so that the virtual scene enters the corresponding virtual scene; the image information of a student collected by the somatosensory peripheral is generated, a three-dimensional image is generated through the recognition module and guided into the virtual scene, the student can see that the student is placed in the virtual scene, the student dances according to dance music rhythm in the curriculum bag, score display is carried out above a virtual display interface, dance action signals collected by the somatosensory peripheral are transmitted to the recognition module, the recognition module is compared with data of an internal curriculum bag and generates scores, each frame of action can be accurately captured, recorded and scored, after the dance action is finished, a total score is carried out, the recognition module uploads videos of the dance and scored details to the cloud server through the network module, and a teacher can download and watch the videos and scored details in the background;
examples of assessment modes are as follows:
the method comprises the steps that a network module is opened, the network module is connected with a cloud server, a receiving module automatically receives course package data, scene model data and three-dimensional character image data, a student sends a voice command to open a remote video module, and selects the remote video module on a virtual display interface, so that the student enters an examination mode; the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student; the receiving module imports the received virtual scene data into a VR virtual display interface, the virtual scene data are arranged according to the sequence of the updated time, a student sends a voice instruction of 'preview virtual scene', can preview the virtual scene, rotates the virtual scene, watches the virtual scene in multiple angles, and finally issues a voice instruction of 'entering the Nth virtual scene', and enters the determined and selected virtual scene; the receiving module guides the received three-dimensional figure image data into a VR virtual display interface, a student can issue a voice instruction of 'preview teacher' to preview the three-dimensional figure image, the three-dimensional image rotates to enable the student to observe figure images from various angles, the student sends a voice instruction of 'select Nth teacher' to select the corresponding teacher, then the student enters a video call-out, and the student is in online video connection with the teacher through a network module and enters an examination scene after the student is connected with the teacher; the body feels the student's that the peripheral hardware gathered image information and whole-body dance action information, and generate three-dimensional stereoscopic image through identification module, lead-in to the virtual scene in, the student can see self and put into in the virtual scene of VR, the student dances according to the dance music rhythm in the course package, the body feels behind the dance action signal transmission identification module that the peripheral hardware gathered, mark out nonstandard position after the identification module discernment, upload to high in the clouds server through the network module, in transmitting the video to the VR glasses that correspond mr end in real time again, mr can combine the nonstandard action examination evaluation of marking out in the video.
In addition, the invention is not limited to dance teaching, such as martial arts teaching, text communication course, and the like.
The above embodiments are only for illustrating the technical idea of the present invention, and the protection scope of the present invention is not limited thereby, and any modifications made on the basis of the technical scheme according to the technical idea of the present invention fall within the protection scope of the present invention.
Claims (7)
1. The utility model provides a dance teaching equipment based on virtual reality which characterized in that: the system comprises VR glasses, a network synchronization module, a man-machine interaction module, a cloud server and a somatosensory peripheral; the cloud server can be used for uploading updated dance courses; the network synchronization module comprises a receiving module and a network module, the network module is connected with the cloud server and shares dance course data in the cloud server, and the receiving module automatically downloads an update package of dance courses; the VR glasses are head-mounted display equipment with independent processors, and the receiving module, the network module and the human-computer interaction module are all embedded in the VR glasses;
the human-computer interaction module comprises a character selection module, a virtual environment selection module, an exercise module, a grading module, an intelligent AI conversation module, a correction module and an identification module;
through the cooperation of VR glasses and somatosensory peripherals, a user can select characters, select virtual environment, carry out intelligent AI conversation and correct actions by combining a human-computer interaction module, and remote interactive dance teaching is realized in the virtual reality environment.
2. A virtual reality based dance teaching apparatus according to claim 1, wherein: the recognition module can intelligently analyze and recognize dance action information transmitted to the recognition module by the somatosensory peripheral, captures dance action information of the student through the somatosensory peripheral, transmits the captured dance action information to the recognition module, and compares, analyzes and recognizes the dance action information of the student with standard actions in the receiving module;
the intelligent AI dialogue module provides a voice basis for the trainees at the exercise module and the scoring module, dance action information is recognized through the recognition module, then voice instructions are output to the intelligent AI dialogue module, the voice module outputs voice, and the trainees receive the voice information; the intelligent AI dialogue module receives the voice signal and transmits the voice signal to the recognition module to be compared with an internal database for analysis and recognition, and the corresponding voice signal is output or the corresponding functional module is opened after the recognition and the recognition;
the character selection module provides different character selections for the student, the teacher collects a three-dimensional image of the teacher through the somatosensory peripheral and transmits character information to the identification module, the identification module identifies an image signal and generates the three-dimensional character image, the three-dimensional character information is transmitted to the cloud server through the network module, and the three-dimensional image of the teacher is uploaded on the cloud server to provide basic data for the student to select the teacher according to personal preference during dance learning;
the virtual environment selection module provides different virtual scenes for the student when the student learns dancing, the background manager uploads the different virtual scenes to the cloud server, and basic data are provided for the student to select the different virtual scenes according to personal preference when the student learns dancing;
the dance teaching device comprises a practice module, a body sensing peripheral, a correction module, a recognition module, a VR virtual display device and an intelligent AI dialogue module, wherein the practice module corrects the error action of a student in the practice module, the body sensing peripheral collects dance action information of the student and uploads the action information to the recognition module, the comparison is carried out between the dance action information and a dance course database stored in the recognition module according to the action information transmitted to the recognition module from the body sensing peripheral, the comparison information is transmitted to the VR virtual display device and the intelligent AI dialogue module, when a certain action of the student does not reach a standard, a dance course is paused, a position with an nonstandard action is marked in a virtual scene, voice guidance is carried out, the student is prompted to repeat the previous action, and the dance course is continued after;
the dance training module provides a basic scene for dance training for a student, supervises and urges the student to correct nonstandard movements in a dance process, captures and collects dance movement information of the student through the somatosensory peripheral device, transmits the dance movement information to the recognition module, compares the dance movement information of the student with dance course packet data in the recognition module, transmits the comparison information to the VR virtual display and intelligent AI dialogue module, and provides voice guidance for the student so that the student can conduct targeted training;
the scoring module scores each action of the dance exercise of the student, then scores comprehensively, captures and collects dance action information of the student through the somatosensory peripheral, transmits the dance action information to the recognition module, the recognition module compares the dance action information of the student with dance course package data inside the recognition module to score, uploads the score information to the cloud server through the network module, the background can download the data in the cloud server, and interviews and guidance are conducted by a special teacher according to scoring conditions and difficult points of the student.
3. A virtual reality based dance teaching apparatus according to claim 1, wherein: the human-computer interaction module also comprises a physical ability detection module;
physical stamina detection module real-time detection student's physical stamina, the facial information and the action information of catching student through the body sense peripheral hardware, then with information transmission to identification module, identification module carries out integrated processing to information, thereby student's physical stamina is judged, reach the student who sets for fatigue value, send voice prompt by intelligent AI dialogue module, the time of suggestion rest setting, the course automatic shutdown, after the settlement time, the student appears in the body sense peripheral hardware region and has worn VR glasses, then the course continues, the student can continue to study.
4. A virtual reality based dance teaching apparatus according to claim 1, wherein: the somatosensory peripheral comprises a rechargeable battery, a scanner, a signal emitter and a whole body motion capture sensing controller.
5. A virtual reality based dance teaching apparatus according to claim 1, wherein: the human-computer interaction module also comprises a remote video module;
the remote video module comprises a remote video camera and a remote signal matching module which are arranged on the somatosensory peripheral, the remote signal matching module comprises a signal transmitting end and a signal receiving end, one VR glasses terminal transmits a video request to the signal receiving end through the transmitting end, an operator confirms the video request signal of the signal receiving end at the other VR glasses terminal, and the signal transmitting end and the signal receiving end are successfully matched;
the remote video module needs to pair the module through remote signal and connect two VR glasses to in feeling the virtual display interface of VR glasses with student or mr's image signal transmission both sides through the image sensor who sets up in the peripheral hardware in the body, establish online video connection, whole body action capture sensor catches student's dance action information in real time, transmit identification module, mark out nonstandard position after identification module discerns, upload to high in the clouds server through the network module, in transmitting the VR glasses that correspond the mr end in real time again with the video, mr can combine the nonstandard action examination and appraisal marked out in the video.
6. A virtual reality based dance teaching apparatus according to claim 5, wherein: the somatosensory peripheral is of a box structure, and a fixed sucker is arranged on the side face of the somatosensory peripheral.
7. A teaching method of dance teaching equipment based on virtual reality according to any one of claims 1 to 6, comprising: the system comprises three teaching modes, namely an exercise mode, a scoring mode and an assessment mode;
the exercise mode comprises the following steps:
(1) opening a network module to enable the network module to be connected with a cloud server, automatically receiving the course packet data, the virtual scene data and the three-dimensional character image data by a receiving module, and opening an exercise module on a virtual display interface by a student so as to enter an exercise mode;
(2) the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student;
(3) the receiving module guides the received three-dimensional character image data into a VR virtual display interface, a student can preview the three-dimensional character image, the three-dimensional image rotates, the student can observe the character image from various angles, and the student selects a corresponding teacher and then enters the next virtual display interface;
(4) the receiving module imports the received virtual scene data into a VR virtual display interface, the virtual scene data are arranged according to the sequence of the updated time, a student can preview the virtual scene, rotate the virtual scene, watch the virtual scene from multiple angles, and determine to enter the corresponding virtual scene;
(5) the teacher can see that the teacher leads in a virtual scene, a virtual reality world is presented in eyes of the student, the somatosensory peripheral device collects dance actions of the student in real time and transmits the collected dance action signals to the recognition module in real time, the recognition module compares the action signals with an internal dance database, if places with nonstandard actions are found, the course is paused, the student is subjected to voice prompt through intelligent AI voice, the previous action is repeated, the course is automatically continued after the action is standard, and the learning and training are continued;
the scoring mode includes the steps of:
(1) opening a network module to connect the network module with a cloud server, automatically receiving the course packet data and the virtual scene data by a receiving module, and opening a scoring module on a virtual display interface by a student so as to enter a scoring mode;
(2) the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student;
(3) the receiving module imports the received virtual scene data into a VR display interface, the virtual scene data are arranged according to the sequence of the updated time, a student can preview the virtual scene, rotate the virtual scene, watch the virtual scene in multiple angles, and enter the corresponding virtual scene after the virtual scene is selected;
(4) the student's that the peripheral hardware was gathered is felt to the body, and generate three-dimensional stereoscopic image through identification module, lead-in to the virtual scene in, the student can see self and put into in the virtual scene, the student dances according to the dance music rhythm in the course package, and there is a demonstration of grading in virtual display interface top, the dance action signal transmission who the peripheral hardware was gathered is felt to the body is after identification module, identification module compares with the data of inside course package, and generate the grading, each frame action all can be caught by accurate, the record is graded, after having jumped, there is a total grading, identification module can be with this dance's video and the graded fine and then upload the high in the clouds server through network module, can supply the mr to download at the background and watch.
The assessment mode comprises the following steps:
(1) opening a network module, connecting the network module with a cloud server, automatically receiving the course packet data, the scene model data and the three-dimensional character image data by a receiving module, and enabling a student to select a remote video module on a virtual display interface so as to enter an evaluation mode;
(2) the receiving module imports the received dance course package data into a VR virtual display interface, and the dance course packages are sequenced according to the updated time for selection by a student;
(3) the receiving module imports the received virtual scene data into a VR virtual display interface, the virtual scene data are arranged according to the sequence of the updated time, a student can preview the virtual scene, rotate the virtual scene, watch the virtual scene in multiple angles, and finally enter the virtual scene selected;
(4) the receiving module guides the received three-dimensional figure image data into a VR virtual display interface, a student can preview the three-dimensional figure image, the three-dimensional figure image rotates, the student can observe figure images from various angles, the student enters a video call after selecting a corresponding teacher, the student is in online video connection with the teacher through the network module, and the student enters an assessment scene after being connected;
(5) the body feels the student's that the peripheral hardware gathered image information and whole-body dance action information, and generate three-dimensional stereoscopic image through identification module, lead-in to the virtual scene in, the student can see self and put into in the virtual scene of VR, the student dances according to the dance music rhythm in the course package, the body feels behind the dance action signal transmission identification module that the peripheral hardware gathered, mark out nonstandard position after the identification module discernment, upload to high in the clouds server through the network module, in transmitting the video to the VR glasses that correspond mr end in real time again, mr can combine the nonstandard action examination evaluation of marking out in the video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011341864.1A CN112614399A (en) | 2020-11-25 | 2020-11-25 | Dance teaching equipment based on virtual reality and teaching method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011341864.1A CN112614399A (en) | 2020-11-25 | 2020-11-25 | Dance teaching equipment based on virtual reality and teaching method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112614399A true CN112614399A (en) | 2021-04-06 |
Family
ID=75225249
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011341864.1A Pending CN112614399A (en) | 2020-11-25 | 2020-11-25 | Dance teaching equipment based on virtual reality and teaching method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112614399A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113572769A (en) * | 2021-07-23 | 2021-10-29 | 河南省洛阳正骨医院（河南省骨科医院） | VR immersion type traditional Chinese medicine culture transmission system based on 5G real-time transmission |
| CN113694501A (en) * | 2021-08-31 | 2021-11-26 | 重庆科华安全设备有限责任公司 | Intelligent guidance system applied to pull-up |
| CN113867532A (en) * | 2021-09-30 | 2021-12-31 | 上海千丘智能科技有限公司 | Evaluation system and evaluation method based on virtual reality skill training |
| CN114170857A (en) * | 2021-12-14 | 2022-03-11 | 广西电网有限责任公司南宁供电局 | Teaching system for cable fault diagnosis based on virtual reality technology |
| CN114360313A (en) * | 2021-12-29 | 2022-04-15 | 南京财经大学 | Auxiliary cross-border e-commerce actual combat teaching method and device using AR glasses |
| CN114452622A (en) * | 2022-01-24 | 2022-05-10 | 宁波大学 | Intelligent movement guidance system and method based on visual AI |
| CN115273222A (en) * | 2022-06-23 | 2022-11-01 | 武汉元淳传媒有限公司 | Multimedia interaction analysis control management system based on artificial intelligence |
| CN115311913A (en) * | 2021-05-08 | 2022-11-08 | 咪付（广西）网络技术有限公司 | Action training system based on artificial intelligence |
| CN115830952A (en) * | 2023-02-08 | 2023-03-21 | 杭州南粟科技有限公司 | Pronunciation and limb training method and system assisted by music |
| WO2023045144A1 (en) * | 2021-09-27 | 2023-03-30 | 华中师范大学 | Method for operating comprehensive stereoscopic teaching field system |
| CN117499748A (en) * | 2023-11-02 | 2024-02-02 | 江苏濠汉信息技术有限公司 | Classroom teaching interaction method and system based on edge calculation |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106128174A (en) * | 2016-08-18 | 2016-11-16 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN107349594A (en) * | 2017-08-31 | 2017-11-17 | 华中师范大学 | A kind of action evaluation method of virtual Dance System |
| CN109363688A (en) * | 2018-11-28 | 2019-02-22 | 河南职业技术学院 | Physical efficiency monitoring method and device in teaching process of physical education |
| CN109817031A (en) * | 2019-01-15 | 2019-05-28 | 张赛 | A kind of limb motion teaching method based on VR technology |
-
2020
- 2020-11-25 CN CN202011341864.1A patent/CN112614399A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106128174A (en) * | 2016-08-18 | 2016-11-16 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN107349594A (en) * | 2017-08-31 | 2017-11-17 | 华中师范大学 | A kind of action evaluation method of virtual Dance System |
| CN109363688A (en) * | 2018-11-28 | 2019-02-22 | 河南职业技术学院 | Physical efficiency monitoring method and device in teaching process of physical education |
| CN109817031A (en) * | 2019-01-15 | 2019-05-28 | 张赛 | A kind of limb motion teaching method based on VR technology |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115311913A (en) * | 2021-05-08 | 2022-11-08 | 咪付（广西）网络技术有限公司 | Action training system based on artificial intelligence |
| CN113572769A (en) * | 2021-07-23 | 2021-10-29 | 河南省洛阳正骨医院（河南省骨科医院） | VR immersion type traditional Chinese medicine culture transmission system based on 5G real-time transmission |
| CN113694501A (en) * | 2021-08-31 | 2021-11-26 | 重庆科华安全设备有限责任公司 | Intelligent guidance system applied to pull-up |
| WO2023045144A1 (en) * | 2021-09-27 | 2023-03-30 | 华中师范大学 | Method for operating comprehensive stereoscopic teaching field system |
| CN113867532A (en) * | 2021-09-30 | 2021-12-31 | 上海千丘智能科技有限公司 | Evaluation system and evaluation method based on virtual reality skill training |
| CN114170857A (en) * | 2021-12-14 | 2022-03-11 | 广西电网有限责任公司南宁供电局 | Teaching system for cable fault diagnosis based on virtual reality technology |
| CN114360313A (en) * | 2021-12-29 | 2022-04-15 | 南京财经大学 | Auxiliary cross-border e-commerce actual combat teaching method and device using AR glasses |
| CN114452622A (en) * | 2022-01-24 | 2022-05-10 | 宁波大学 | Intelligent movement guidance system and method based on visual AI |
| CN115273222A (en) * | 2022-06-23 | 2022-11-01 | 武汉元淳传媒有限公司 | Multimedia interaction analysis control management system based on artificial intelligence |
| CN115273222B (en) * | 2022-06-23 | 2024-01-26 | 广东园众教育信息化服务有限公司 | Multimedia interaction analysis control management system based on artificial intelligence |
| CN115830952A (en) * | 2023-02-08 | 2023-03-21 | 杭州南粟科技有限公司 | Pronunciation and limb training method and system assisted by music |
| CN117499748A (en) * | 2023-11-02 | 2024-02-02 | 江苏濠汉信息技术有限公司 | Classroom teaching interaction method and system based on edge calculation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112614399A (en) | Dance teaching equipment based on virtual reality and teaching method thereof | |
| CN110890140B (en) | Virtual reality-based autism rehabilitation training and capability assessment system and method | |
| CN113706960B (en) | Nursing operation exercise platform based on VR technology and use method | |
| US11210963B2 (en) | Method and apparatus for providing personalised audio-visual instruction | |
| CN109011508A (en) | A kind of intelligent coach system and method | |
| CN107633719A (en) | Anthropomorphic representation artificial intelligence tutoring system and method based on multilingual man-machine interaction | |
| EP1351208A2 (en) | Networked learning system | |
| CN110739040A (en) | rehabilitation evaluation and training system for upper and lower limbs | |
| CN111523444B (en) | Classroom behavior detection method based on improved Openpost model and facial micro-expression | |
| CN104766503A (en) | cardiopulmonary resuscitation teaching system and method | |
| CN110490173B (en) | Intelligent action scoring system based on 3D somatosensory model | |
| WO2016123648A1 (en) | Frameworks, devices and methodologies configured to enable delivery of interactive skills training content, including content with multiple selectable expert knowledge variations | |
| CN108335747A (en) | Cognitive training system | |
| CN203118082U (en) | Network course learning and examination anti-cheating monitoring device | |
| CN111523445B (en) | Examination behavior detection method based on improved Openpost model and facial micro-expression | |
| CN113694343A (en) | Immersive anti-stress psychological training system and method based on VR technology | |
| CN116611969B (en) | Intelligent learning and scoring system for traditional martial arts | |
| TW201919735A (en) | Moveable fitness equipment controller, information transmission and collection device combined with fitness equipment, and fitness equipment and control method | |
| CN215875885U (en) | Immersion type anti-stress psychological training system based on VR technology | |
| CN116188211A (en) | Online education learning assessment system | |
| CN113100755B (en) | Limb rehabilitation training and evaluating system based on visual tracking control | |
| US20240198177A1 (en) | Exercise instruction and feedback systems and methods | |
| CN113012505A (en) | Interactive dance teaching practice platform and method based on Internet | |
| CN112546604B (en) | Real-time interaction system and method based on strength type fitness equipment | |
| CN114265501B (en) | Dynamic identification system for motion scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |