CN114832349B

CN114832349B - Yuanzhou swimming teaching auxiliary system and use method thereof

Info

Publication number: CN114832349B
Application number: CN202210530860.0A
Authority: CN
Inventors: 夏海生; 李智军; 聂忠强
Original assignee: University of Science and Technology of China USTC
Current assignee: University of Science and Technology of China USTC
Priority date: 2022-05-16
Filing date: 2022-05-16
Publication date: 2023-03-10
Anticipated expiration: 2042-05-16
Also published as: CN114832349A

Abstract

The invention provides a metachrosis swimming teaching auxiliary system and a using method thereof, wherein the metachrosis swimming teaching auxiliary system comprises data acquisition equipment, a remote end and virtual reality presentation equipment; the data acquisition module acquires human body data in the training process of a user; the remote end processes the human body data; and the virtual reality presenting equipment presents the processed human body data into a visual model. The Yuanzhou swimming teaching auxiliary system can design training items according to swimming actions favored by a user, constructs a human body third person weighing visual angle diagram in the Yuanzhou virtual environment by collecting human body movement information, provides corresponding virtual character swimming standard actions at the same time, and visually feeds back information to the user in real time through VR, so that the user can train swimming better; meanwhile, training data can be recorded and stored, and a user can check the training data conveniently after finishing training.

Description

Yuanzhou swimming teaching auxiliary system and use method thereof

Technical Field

The invention relates to the technical field of swimming teaching equipment, in particular to a Yuanzhou swimming teaching auxiliary system and a using method thereof.

Background

Traditional swimming training relies primarily on the experience and visual judgment of a trainer. The swimming pool is stood beside the pool, and the swimming effect is observed through the postures, actions and water surface postures of athletes, so that the efficiency is low.

A relatively advanced device on the market uses one camera to capture the entire swimming process of an athlete, and analyzes and repeats it from the captured image to improve the training effect. The method is time-consuming and labor-consuming, lacks efficient swimming images, and has imaging results opposite to one side and still is influenced by subjective judgment of workers.

Chinese patent publication No. CN109821211A discloses a virtual reality-based swimming teaching system, which comprises a head-mounted device, a mechanical arm device and a main control device, wherein the head-mounted device comprises VR glasses, a head cover fixed to the tops of the VR glasses, earphones fixed to the backs of the VR glasses, and a face mask movably fixed to the earphones through a knob, and an airflow sensor for detecting the breathing rate of a user is arranged inside the face mask; the mechanical arm device comprises a bottom support assembly, a waist support assembly fixed on the bottom support assembly and a joint mechanical arm assembly fixedly connected with the waist support assembly; a sensor assembly and a motor are arranged in the joint mechanical arm assembly; the main control device judges whether the swimming posture of the user is correct or not by processing the data detected by the sensor assembly, and controls the motor to change the moving resistance of the mechanical arm device for simulating the resistance of the swimming state.

In view of the above-mentioned related technologies, the inventor considers that hardware equipment for teaching assistance in swimming training in the prior art, which can effectively collect swimming state conditions and human body movement conditions, is relatively lacking.

Disclosure of Invention

Aiming at the defects in the prior art, the invention aims to provide a teaching auxiliary system for Yuanzhou swimming and a using method thereof.

The invention provides a teaching auxiliary system for metauniverse swimming, which comprises data acquisition equipment, a remote end and virtual reality presentation equipment, wherein the data acquisition equipment is connected with the remote end;

the data acquisition module acquires human body data in the training process of a user;

the remote end processes the human body data;

and the virtual reality presenting equipment presents the processed human body data into a visual model.

Preferably, the data acquisition equipment comprises an angle measurement module and a human muscle electric signal acquisition module;

the angle measurement module is used for collecting the angle and the angular speed of the joint of the human body to obtain joint information and transmitting the joint information to the processing end;

the human muscle electric signal acquisition module is used for acquiring muscle electric signals of human body force-exerting muscles to obtain myoelectric signals and transmitting the myoelectric signals to the processing end.

Preferably, the remote end comprises a computer, and the computer comprises a human joint motion model observer module and a human muscle observer module;

the human body joint motion model observer module is used for constructing a virtual scene of a metauniverse and converting the recorded joint information into the motion condition of joints of a human body in the virtual scene to obtain a virtual scene containing the motion condition of the joints;

the human body muscle observer module is used for converting the recorded electromyographic signals into muscle force conditions of a human body in the motion process;

the virtual reality presentation equipment forms a human body virtual model by a virtual scene containing joint motion conditions and muscle force applying conditions.

Preferably, the remote end further comprises an information base;

the information base stores standard motion data;

and the virtual reality presenting equipment forms a standard motion model by using the standard motion data.

Preferably, the standard sport data comprises the force condition of standard swimming;

the computer compares the muscle force-exerting situation with the force-exerting situation of standard swimming to obtain a comparison result and a human muscle force-exerting suggestion;

the virtual reality presentation equipment presents the comparison result and the human muscle exertion suggestion, and feeds the comparison result and the human muscle exertion suggestion back to the user in real time to remind the user of exertion skills of muscles during swimming.

Preferably, the computer further comprises a storage module;

the storage module stores a Yuanzhou swimming teaching auxiliary program for user training and locally records human body joint information, electromyographic signals, muscle strength conditions, virtual scenes containing joint motion conditions and standard motion data;

and the storage module transmits the locally recorded data to an information base.

Preferably, the remote end comprises a computer or a smart phone;

the computer or smartphone accesses information stored in an information repository.

The application method of the auxiliary teaching system for the Yuanzhou swimming provided by the invention comprises the following steps:

a data acquisition step: collecting human body data in the training process of a user;

the processing steps are as follows: processing the human body data;

virtual reality presenting step: and presenting the processed human body data as a visual model.

Preferably, the data acquisition step comprises the steps of:

angle measurement: collecting the angle and the angular speed of the joints of the human body to obtain joint information, and transmitting the joint information to a processing end;

collecting human muscle electric signals: muscle electric signals are acquired for the muscle exerting force of the human body, myoelectric signals are obtained, and the myoelectric signals are transmitted to the processing end.

Preferably, the processing step comprises the steps of:

human joint motion model observation step: constructing a virtual scene of the metauniverse, and converting the recorded joint information into the movement condition of joints of the human body in the virtual scene to obtain a virtual scene containing the movement condition of the joints;

human muscle observation step: converting the recorded electromyographic signals into muscle force exerting conditions of the human body in the movement process;

in the virtual reality presenting step, a virtual scene containing joint motion conditions and muscle force conditions are used for forming a human body virtual model.

Compared with the prior art, the invention has the following beneficial effects:

1. the auxiliary system for teaching the Yuancosmic swimming can design a training project according to swimming actions preferred by a user, constructs a human body third person perspective view diagram in the Yuancosmic virtual environment by collecting motion information of a human body, provides corresponding virtual character swimming standard actions at the same time, visually feeds back information to the user in real time through VR, and facilitates the user to train the swimming better;

2. the invention can record and store the training data at the same time, which is convenient for the user to check after finishing the training;

3. the invention realizes real-time fitting of the virtual human body model, feeds back the real-time fitting to the user, establishes a mutual trust mechanism, and greatly improves the practicability and the interactivity of the auxiliary teaching system for the Yuancosmic swimming.

Drawings

Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:

FIG. 1 is a schematic structural diagram of the teaching aid system for meta-universe swimming according to the present invention;

FIG. 2 is a schematic diagram of a human body virtual model construction for a teaching auxiliary system for meta-universe swimming according to the present invention;

fig. 3 is a schematic diagram of VR visual contents for the teaching auxiliary system for meta-universe swimming according to the present invention.

Detailed Description

The present invention will be described in detail with reference to specific examples. The following examples will aid those skilled in the art in further understanding the present invention, but are not intended to limit the invention in any manner. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the concept of the invention. All falling within the scope of the present invention.

The embodiment of the invention discloses a teaching auxiliary system for Yuanzhou swimming, which comprises data acquisition equipment, a remote end, virtual reality presentation equipment and a data transmission module, as shown in figures 1 and 2. The data acquisition module acquires human body data in the training process of a user. The remote end processes the human body data. And the virtual reality presenting equipment presents the processed human body data into a visual model.

The data acquisition equipment comprises an angle measurement module (angle measurement sensor) and a human muscle electric signal acquisition module (muscle electric signal acquisition device).

The angle measurement module is used for collecting the angle and the angular speed of the joint of the human body to obtain joint information and transmitting the joint information to the processing end. The module is used for collecting the angle and the angular speed of the main joints of the human body and transmitting the collected information to the computer.

The human muscle electric signal acquisition module is used for acquiring muscle electric signals of human body force-exerting muscles to obtain myoelectric signals and transmitting the myoelectric signals to the processing end. The module is used for acquiring muscle electric signals of main force-exerting muscles of a human body and transmitting acquired information to a computer.

The angle measurement module and the human muscle electric signal acquisition module jointly form a wearable multi-mode sensing network, and can acquire myoelectric signals, main joint angles and angular velocities of a human body when the human body carries out swimming motions, so that a human body underwater body area network is constructed, and all-dimensional human motion information is obtained.

The remote end comprises a computer, an information base, a computer and a smart phone.

The computer comprises a human body joint motion model observer module, a human body muscle observer module, a preprocessing module and a storage module.

The human body joint motion model observer module is used for constructing a virtual scene of a metasma, and converting the recorded joint information into the motion condition of the joints of the human body in the virtual scene to obtain the virtual scene containing the motion condition of the joints. The module is used for converting the main joint angles and the angular velocities of the human body acquired by the angle measurement module into the movement of joints of the human body in a virtual environment and constructing a virtual scene of a metasma. The virtual scene of the universe converts the motion situation of the human body in reality into the motion situation of the human body in the virtual environment, so that a user can observe the virtual scene conveniently.

The human body muscle observer module is used for converting the recorded electromyographic signals into the muscle force-exerting condition of the human body in the motion process. The module is used for converting the human body main force-exerting muscle acquired by the human body muscle electric signal acquisition module into the muscle force-exerting condition of the human body in the exercise process.

The storage module stores a teaching auxiliary program for the Yuanzhou swimming for training of a user, and locally records the preprocessed human body joint information, the preprocessed electromyographic signals, the muscle strength condition, the virtual scene containing the joint motion condition and the standard motion data.

The computer is internally provided with a storage module which is used for storing the auxiliary program for the teaching of the Yuanzhou swimming, locally recording data of a user in the swimming process and communicating the locally recorded data in a wireless or wired mode.

The preprocessing module (angle data preprocessing module and myoelectricity data preprocessing module): the collected information is preprocessed, and the process comprises the following steps: denoising the electromyographic signals, extracting characteristic quantity (such as RMS) of the electromyographic signals, and smoothing angle values, angular velocity values and moments of the joints. Of course, all smoothing methods used in the prior art may be used without specific limitations, such as the conventional smoothing filtering and kalman filtering. RMS denotes root mean square, which is a method of performing feature quantity processing on data (the sum of squares of R0 terms is divided by R0 to obtain the square, i.e., the root mean square result).

For an input electromyographic signal x (n), wherein n is a sampling point, extracting the RMS characteristic quantity of the electromyographic signal x (n) to obtain x0 (n), wherein the sampling number of RMS processing of x0 (n) to x (n) is R0, which can be adjusted according to actual conditions, and R0 is usually 50. x0 (n) is 10ms per frame, i.e., a sampling rate of 100HZ. x0 (n) is related to x (n) as follows:

wherein i = n-R0+1, n is a sampling point, R0 is the number of samples, i is a sampling starting point, and from i to n, a total of R0 points are obtained.

And a virtual reality presentation device (VR module) forms a human body virtual model by using a virtual scene containing joint motion conditions and muscle force conditions. The VR module realizes signal transmission with a computer, and forms a specific image in a display visual field of the VR module through receiving image information of the metacosmic virtual scene transmitted by the computer.

The information base stores standard exercise data. And the virtual reality presenting equipment forms a standard motion model by using the standard motion data. The standard sport data includes the exertion of standard swimming.

The computer compares the muscle force-exerting situation with the force-exerting situation of standard swimming to obtain a comparison result and a human muscle force-exerting suggestion. This process may be implemented in the human muscle observer or in a memory module of the computer.

The virtual reality presentation equipment presents the comparison result and the human muscle exertion suggestion, and the comparison result and the human muscle exertion suggestion are fed back to the user in real time to remind the user of exertion skills of muscles during swimming. The human muscle exertion suggestion is displayed in VR, the actual exertion situation of the human muscle can be obtained through the human muscle observer module and compared with the standard motion data, then the exertion suggestion is provided, and finally the suggestion is fed back to the user by VR.

The computer is in communication connection with the remote information base, and when a user uses the teaching auxiliary system for the metacarpal swimming, the computer calls a data record set of the remote information base and simultaneously transmits standard swimming action data to the VR module; after the user finishes the use of the auxiliary system for the metauniverse swimming teaching, the computer transmits the use record to the remote information base, and the remote information base updates the data record set.

The storage module transmits the locally recorded data to the information base.

The computer or smartphone accesses information stored in the information repository.

The data transmission module submits the human motion information acquired by the wearable multi-modal sensor network to a computer through wired or wireless transmission, and the computer records important information through analysis and transmits the important information to a remote information base for storage.

The embodiment of the invention also discloses a method for using the auxiliary teaching system for the meta swimming, which comprises the following steps as shown in figures 2 and 3:

a data acquisition step: human body data in the training process of a user are collected.

The data acquisition step comprises the following steps: angle measurement: collecting the angle and angular speed of the joint of the human body to obtain joint information, and transmitting the joint information to the processing terminal. Human muscle electric signal acquisition: muscle electric signals are acquired for the muscle exerting force of the human body, myoelectric signals are obtained, and the myoelectric signals are transmitted to the processing end.

The processing steps are as follows: and processing the human body data.

The processing steps include the following steps: human joint motion model observation step: and constructing a virtual scene of the metauniverse, and converting the recorded joint information into the movement condition of the joints of the human body in the virtual scene to obtain the virtual scene containing the movement condition of the joints. Human muscle observation: and converting the recorded electromyographic signals into the muscle force condition of the human body in the motion process.

Virtual reality presenting step: and presenting the processed human body data as a visual model. And forming a human body virtual model by using the virtual scene containing the joint motion condition and the muscle force applying condition.

The embodiment of the invention also discloses a using method of the Yuanzhou swimming teaching auxiliary system, which comprises the following steps as shown in figures 2 and 3:

step 1: wear the VR module on the user.

Step 2: the angle measurement module is worn on the user.

And step 3: wearing a human muscle electric signal acquisition module on the body of a user, starting a computer to carry out self-checking, and carrying out preparation work;

and 4, step 4: and (3) calling a storage module to test a swimming training program (a metachronal swimming teaching auxiliary program) by using a computer. The image information is sent to the VR equipment through the computer, three horizontal information areas are divided in a display visual field of the VR module, specific images are formed in different information areas, and information is obtained by a user according to the specific images.

The first piece of information area content is human motion information acquired through the wearable multi-modal sensing network, the acquired information is substituted into the human joint motion model observer module and the human muscle observer module, a third person named visual angle model of the human body in the metas, namely a human body virtual model, can be more visually fed back to the motion conditions of the four limbs of the user, and therefore adjustment and correction can be carried out.

The second information area content is that, through the human muscle observer module, the computer can analyze the force condition of the human muscle, compares the force condition with the force condition of standard swimming transmitted by the remote information base, and feeds back to the user in real time through the VR module, so as to remind the user of the force technique of the muscle during swimming, and perform better training.

The third information area content is that the computer transmits the human motion information acquired by the wearable multi-mode sensing network to the remote information base in a wired or wireless way, and the remote information base can match the standard swimming Yuanzhou third person name visual angle model, so that the user can better simulate the standard swimming posture, and the swimming training effect is achieved.

In the training process of a user, the computer transmits the collected information to the remote information base, and after the user completes training or suspends the training, the user can access the remote information base through the computer or the smart phone to visually know and analyze the motion condition of the user in the training process.

The user trains according to the swimming training procedure, and at the in-process of training, angle measurement module is used for gathering the angle and the angular velocity of the main joint of human body, and human muscle electricity signal acquisition module is used for carrying out muscle electricity signal acquisition to human main muscle of exerting oneself.

The data transmission module submits the acquired human motion information (joint angle, joint angular velocity and muscle electric signal) to the angle data preprocessing module and the myoelectric data preprocessing module through wired or wireless transmission respectively.

The angle data preprocessing module preprocesses the joint angle and the joint angular speed.

The myoelectric data preprocessing module preprocesses the muscle electric signal.

The storage module stores the preprocessed joint angle, joint angular velocity and electromyographic signals and sends the preprocessed information to the human joint motion model observer module and the human muscle observer module.

The human body joint motion model observer module is used for converting the main joint angles and angular velocities of the preprocessed human body into the motion of joints of the human body in a virtual environment and constructing a virtual scene of a meta universe.

The human body muscle observer module converts the muscle electrical signals of the main power muscle of the human body after pretreatment into the muscle power condition of the human body in the motion process.

The storage module stores a virtual scene containing joint movement conditions and muscle force conditions of a human body in the movement process, and sends the information to the VR module or the information base.

The remote information base stores the virtual scene containing the joint movement condition and the muscle force condition of the human body in the movement process into a data record set.

The storage module retrieves a data record set of the remote information base, and simultaneously transmits standard swimming action data to the VR module, or retrieves muscle strength conditions in the standard swimming action data.

And the VR module receives the virtual scene of the joint movement condition and the muscle force condition of the human body in the movement process, and forms and displays a human body virtual model. And receiving standard swimming action data, and forming and displaying a standard action model.

The human muscle observer or the storage module compares the human muscle exertion situation with the muscle exertion situation in the standard swimming action data.

The VR module feeds back to the user in real time, reminds the user to have an effect on the skill of the muscle when swimming, and carries out better training.

The computer or smartphone can access the information in the remote information repository.

The information in the information base comprises preprocessed human joint information, preprocessed electromyographic signals, muscle exertion conditions, virtual scenes containing joint motion conditions (dragging observation can be carried out along a time axis), comparison results, human muscle exertion suggestions and standard motion data (the virtual scenes containing the standard joint motion conditions and the standard muscle exertion conditions), and the information is stored in a data record set.

The embodiment of the invention also discloses a storage medium (computer readable storage medium) which stores a computer program, wherein the computer program controls and executes the Yuanzhou swimming teaching auxiliary system or the use method of the Yuanzhou swimming teaching auxiliary system, and the step of the use method of the Yuanzhou swimming teaching auxiliary system is realized when the program is executed. .

The embodiment of the invention also discloses electronic equipment, which comprises a memory, a processor and computer instructions; the computer instructions are stored on a memory and run on a processor; when the computer instructions are executed by the processor, the operating method of the metastic swimming teaching auxiliary system or the metastic swimming teaching auxiliary system is controlled and executed, and the operating method of the metastic swimming teaching auxiliary system is realized when the program is executed.

The auxiliary teaching system for the Yuanzhou swimming comprises a computer, an angle measuring module (an angle measuring sensor), a human muscle electric signal collecting module (a muscle electric signal collector), a human joint motion model observer module, a human muscle observer module, a VR module, a remote information base and a data transmission module, and is the auxiliary teaching system for the Yuanzhou swimming, which is used for correcting the wrong actions of learners and improving the swimming capacity. The invention relates to a Yuanzhou swimming teaching auxiliary system, which comprises the following steps: acquiring the angle and the angular speed of main joints of a human body; acquiring electric signals of main muscles of a human body; substituting the obtained muscle electric signal into a human muscle observer to obtain the muscle force condition of the human body in the real-time motion process; substituting the obtained joint angle and angular velocity into a dynamic equation of a human body joint motion model observer to obtain the motion condition of the joint of the human body in the virtual environment; the joint movement condition and the muscle exertion condition in the virtual environment are fed back to the user in real time in a VR/AR mode, so that the user can observe the movement condition of the body of the user conveniently, and the action of the user can be better adjusted, thereby achieving the purpose of assisting teaching. The angle information of the main joints of the human body is obtained, so that the virtual human body model is accurately fitted, modeling visualization is fed back to a user in real time, and the function of constructing the metachrosis interaction by combining a user terminal is achieved. The system realizes real-time fitting of the virtual human body model, feeds back the real-time fitting to the user, establishes a mutual trust mechanism, and greatly improves the practicability and the interactivity of the auxiliary teaching system for the Yuancosmic swimming.

It is well within the knowledge of a person skilled in the art to implement the system and its various devices, modules, units provided by the present invention in a purely computer readable program code means that the same functionality can be implemented by logically programming method steps in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system and various devices, modules and units thereof provided by the invention can be regarded as a hardware component, and the devices, modules and units included in the system for realizing various functions can also be regarded as structures in the hardware component; means, modules, units for performing the various functions may also be regarded as structures within both software modules and hardware components for performing the method.

The foregoing description has described specific embodiments of the present invention. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.

Claims

1. A metachrosis swimming teaching auxiliary system is characterized by comprising data acquisition equipment, a remote end and virtual reality presentation equipment;

the data acquisition equipment acquires human body data in the training process of a user;

the remote end processes the human body data;

the virtual reality presenting equipment presents the processed human body data into a visual model;

the data acquisition equipment comprises an angle measurement module and a human muscle electric signal acquisition module;

the angle measurement module is used for collecting the angle and the angular velocity of the joint of the human body to obtain joint information and transmitting the joint information to the processing end;

the human body muscle electric signal acquisition module is used for acquiring muscle electric signals of the human body force exerting muscles to obtain myoelectric signals and transmitting the myoelectric signals to the processing end;

the remote end comprises a computer, and the computer comprises a human joint motion model observer module and a human muscle observer module;

the virtual reality presenting equipment forms a human body virtual model by using a virtual scene containing joint motion conditions and muscle force applying conditions.

2. The metastic swimming teaching assistance system according to claim 1, wherein the remote terminal further comprises an information base;

the information base stores standard motion data;

3. The metastic swimming teaching aid system according to claim 2, wherein the standard sports data includes a force situation of standard swimming;

the virtual reality presenting equipment presents the comparison result and the human muscle exertion suggestion, feeds the comparison result and the human muscle exertion suggestion back to the user in real time, and reminds the user of the exertion skill of the muscle during swimming.

4. The system of claim 2, wherein the computer further comprises a memory module;

5. The metastic swimming teaching aid system according to claim 4, wherein the remote terminal includes a computer or a smart phone;

6. A method for using a teaching aid system for teaching Yuancosmic swimming according to any one of claims 1 to 5, comprising the steps of:

a data acquisition step: collecting human body data in a user training process;

the processing steps are as follows: processing the human body data;

7. The method of using a metastic swimming teaching aid system according to claim 6, wherein the data collecting step includes the steps of:

collecting human muscle electric signals: muscle electric signals are acquired from the muscle exerting force of the human body, myoelectric signals are obtained, and the myoelectric signals are transmitted to the processing end.

8. The method of using a metastic swimming teaching aid system according to claim 7, wherein the processing step includes the steps of:

human joint motion model observation step: constructing a virtual scene of the meta universe, and converting the recorded joint information into the movement condition of the joints of the human body in the virtual scene to obtain a virtual scene containing the movement condition of the joints;

human muscle observation: converting the recorded electromyographic signals into muscle force exerting conditions of the human body in the movement process;

in the virtual reality presenting step, a virtual scene containing joint movement conditions and muscle force applying conditions are used for forming a human body virtual model.