CN115331783A - Training method for visual stimulation of autism of children based on VR (virtual reality) interaction technology - Google Patents
Training method for visual stimulation of autism of children based on VR (virtual reality) interaction technology Download PDFInfo
- Publication number
- CN115331783A CN115331783A CN202210960856.8A CN202210960856A CN115331783A CN 115331783 A CN115331783 A CN 115331783A CN 202210960856 A CN202210960856 A CN 202210960856A CN 115331783 A CN115331783 A CN 115331783A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- autism
- game
- children
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/825—Fostering virtual characters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Developmental Disabilities (AREA)
- Social Psychology (AREA)
- Psychiatry (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Hospice & Palliative Care (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Psychology (AREA)
- Child & Adolescent Psychology (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Pharmaceuticals Containing Other Organic And Inorganic Compounds (AREA)
- Medicines Containing Plant Substances (AREA)
Abstract
The invention belongs to the technical field of computers, in particular to a visual stimulation child autism training method based on a VR interaction technology, which aims at solving the problem of low individuation degree and provides the following scheme, comprising the following steps: the technology can provide VR games and videos suitable for patients through disease conditions and individual differences of different patients and can interact with parents or doctors in games to avoid obstacles for treatment caused by the fact that the autistic children dare not to face strangers in reality due to contradictory psychology. Provides a better training environment through VR to help patients treat autism and dare to face society.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a visual stimulation child autism training method based on a VR interaction technology.
Background
Patent with application number CN202011448001.4 discloses a serious game-based autism children life skill training method, which includes constructing a serious game-based virtual life scene, enabling the virtual life scene to contain at least one virtual interaction scene, generating a virtual to-be-trained role model of an autism children user in the virtual life scene, and according to multi-mode interaction operation information of the autism children user for the virtual life scene, realizing that the autism children user reflects the interaction condition of the autism children user for the virtual life scene to the self replacement in a voice, posture, gesture or expression manner? And controlling the virtual character model to be trained to execute corresponding actions on the virtual character model to be trained, and displaying a response corresponding to the action executed by the virtual character model to be trained to the autistic child user through the virtual life scene, so that the autistic child user is helped to know the corresponding life skills in the virtual life scene in a mode of visually observing the virtual life scene, and the training of the life skills of the autistic child is facilitated.
However, the autism child life skill training method based on the serious game also has some problems, for example, the personalization degree of the training method is not high enough, the intelligent game design needs to be continuously perfected after more sample data experiments are performed clinically, and the personalization and the intelligence degree are low.
Disclosure of Invention
Based on the problem of low personalization and intelligence degree in the background technology, the invention provides a visual stimulation child autism training method based on a VR interaction technology.
The invention provides a training method for visual stimulation of autism of children based on VR interaction technology, which comprises the following steps:
s1: acquiring archive information of the autism child through a questionnaire or self-testing game data, wherein the archive information comprises basic personal data, state information and game data, intelligent evaluation is performed according to the acquired basic personal data, state information and game data of the autism child, the state information specifically comprises the color, shape, speed, agility and space perception ability of a patient on videos and images in games, the personal data specifically comprises age, illness time, illness symptoms, illness frequency and illness degree, and the game data comprises game results, time, heart rate data, blink data and arm activity data of the patient;
s2: calculating by using a machine learning artificial intelligence algorithm according to the patient information of the autism children to obtain a VR game model and generate an individualized VR game;
s3: in the VR game, reward and punishment are carried out along with the result of the game participation of the patient, and the game result is fed back to the VR model for machine learning calculation so as to adjust a game reward and punishment mechanism according to the performance of the patient, so that the effect of treating the autism is achieved, and the patient and the family need to wear VR glasses at the same time, so that the virtual images of the family and the patient can be synchronized and interacted;
s4: the biological and action information of family members and doctors is collected in advance to form a database, so that a classification result is obtained, and the synchronization of the virtual image and the user is realized in the game;
s5: corresponding games and videos are obtained in VR through patient information of autism children and the expression of patients in the games, the patients interact with virtual images of family members and doctors through the games and the videos in VR glasses, expression, language and actions are synchronized, virtual image data are continuously fed back to a biological and action information database in the games and are compared and updated, and the accuracy is improved through self-updating of an interaction system;
s6: the system has an intelligent analysis function, and can generate an analysis report according to monthly, quarterly and annual data so as to judge the effect of the training process.
Preferably, in S1, before using the VR device, the online questionnaire is written using HTML, data is transferred by a post method in a manner of creating a database pool, and the acquired data is synchronized to a local database; sql is created by using ER diagrams to clarify the relation of each table in the database, and Mysql is used to create a database VR, wherein the main tables have user information tables-online questionnaires from HTML, including age, disease symptoms, individual monitoring and preferences, vr game data-including duration and score, a user summary table, and an independent user id is provided when each user registers, and each table can be connected and mutually called by virtue of the user id, so that an autism diagnosis database is created according to materials provided by medical students, and a medical diagnosis database is continuously updated according to game results, thereby improving diagnosis accuracy and success rate; database data visualization was achieved using echart, forming two reports: the game data report comprises completion degree, duration, score and after-game disease diagnosis, a personalized report is formed for each patient, complete information can be collected, and the analysis capability of a database algorithm is enhanced.
Preferably, the information collecting section: the self-closing child user information base data stream is created by using streaming time series, a byte data sequence with a starting point and an end point comprises the original input stream and the latest self-closing child data analysis result, a large amount of detail data can be continuously and automatically generated, the detail reflection of the self-closing child in a VR game is analyzed, the complex analysis of the self-closing child needs to analyze an update reservation in a real-time mode and is just matched with the real-time update of the VR game, the limitation that the data stream can only be read once or for a few times is changed, the patient information is convenient to collect, and the database can be perfected.
Preferably, the acquisition of the profile information of the autistic child is embodied as follows: the method comprises the steps of performing database association before logging, associating a system with a hospital or an autism child information base, reading data, performing real-time backup and updating by using a streaming time model during operation, and comparing each time of data with the previous data to obtain a latest result; the method comprises the steps of constructing a schematic diagram of data stream data by using a time series model to construct V-optimal, wherein the V-optimal is from a past database, constructing a proper histogram from the schematic diagram, easily updating the data of the schematic diagram and realizing the dynamic of the histogram, accurately judging the severity of autism children by using the accurate query of the histogram, constructing packets with different precisions by using a deterministic buffering technology and a random buffering technology, and gradually dividing the input autism child data into the packets, thereby completing the construction of the dynamic histogram, facilitating the analysis and the processing of new information to obtain an effective conclusion, more intuitively seeing the improvement condition of the autism children through the dynamic histogram and effectively obtaining the archive information of the autism children.
Preferably, in S2, the operating tool: openGL-based VR modeling techniques: (1) The three-dimensional modeling process can be simple, basic 3D graphs can be simply drawn by using auxiliary functions contained in an OpenGL library, and a high-complexity model can be realized by other synthetic methods, wherein the synthetic basic method comprises the following steps: 1. synthesizing simple geometric bodies, wherein OpenGL contains cone and sphere simple geometric bodies, and parameters of the geometric bodies can be changed for synthesis; 2. synthesizing a curved surface body, and obtaining a Bezier curve (surface) or drawing an NURBS curve or curved surface through calculating an evaluation program; 3. triangle synthesis, which is a preferred design primitive of OpenGL because the triangle is the simplest figure and any polygon can be expressed by the triangle; (2) The modeling environment can be vividly simulated, the model can be effectively decorated by coloring rendering, illumination change, texture mapping and depth detection depending on an auxiliary function provided by OpenGL, the design experience with high reality can be provided for a user, and the actual needs of the user are reflected really; (3) The efficient real-time animation response is realized, and due to the fact that the operation function capable of performing double caching on animation color, depth, templates and accumulation is provided, openGL can continuously display the animation, so that a program algorithm is greatly simplified, and the speed of dynamic display of the image is increased; (4) The OpenGL has better flexibility, can work in different hardware platforms, standard windows and operating systems as an independent linear software interface, is convenient to model and is convenient for subsequent processes to carry out.
Preferably, the modeling is implemented by the following method: 1. acquiring the file information of the autism children: the system comprises family information, basic information, state information, demand information and an evaluation report of a user, wherein the evaluation report judges 1-5 levels of different degrees according to the perceptions of the autistic children on different virtual simulation image colors, shapes, object motion speeds and space size factors and the perceptions of different sounds in tone, frequency and volume, and the children can be customized to a specific treatment scheme and a treatment scene according to the judgment; 2. adopting a preset method to construct a virtual simulation game model: establishing a human body model in VR content according to file information and training data of the past autism children, and reserving a data interface for the human body model; enabling the autistic children and other people to wear motion capture equipment at joints to acquire position information of an end effector, enabling the other people to be family members, friends, teachers and other ASD children, and calculating human motion data including joint rotation angles and positions by utilizing an IK reverse dynamics algorithm; then endowing the information to a reserved interface of the human body model, driving the human body model to move according to a target person wearing hardware, and displaying the information in the content to synchronously express the action instruction or gesture information of the person; the method comprises the following steps that a camera obtains an image of a target object, a server side amplifies, identifies and processes interactive data through a desktop system and a projection system, and then characteristic points are extracted from the image; then, a PNP algorithm is utilized to obtain the coordinates of the feature points in the camera coordinate system; converting the coordinates under the camera coordinate system into a world coordinate system by using a rotation theory, obtaining information of characteristic points under the world coordinate system, and finally obtaining position information, so that the action of the autistic child is coordinated with the operation of a virtual scene; 3. adopting a preset method to construct a virtual simulation game scene: different virtual simulation game scenes are constructed by utilizing a multi-feature three-dimensional dense reconstruction method, selection is carried out according to the acceptable degree of children, and various basic features of a model are analyzed firstly as follows: in the aspects of light and shadow intensity, texture information and modeling concave-convex, a three-dimensional model with high fitting degree with a target object is reconstructed, the algorithm firstly needs to extract characteristic points of Harris and DoG from an image, carries out characteristic point matching according to the Euclidean distance degree of the selected characteristic points, then carries out characteristic matching on the image, repeatedly obtains sparse point cloud data through a triangulation principle, carries out TNCC sorting on the obtained point cloud, weights the reliability of the point cloud under each visual angle, sorts the seed points according to the reliability, uses the point cloud with high reliability as an expandable initial seed point, obtains more concentrated space directed point cloud or patch, deletes unreliable point cloud data, completes the reconstruction process, has better stability and robustness, and can reconstruct more exquisite details aiming at a model with stronger concave-convex feeling; 4. inputting the archive information to obtain a corresponding virtual simulation game and audio music; inputting the file information of the autism children into a virtual simulation game model to obtain a virtual simulation game suitable for different autism children, and simultaneously acquiring corresponding audio music according to the file information of the autism children to further strengthen stimulation; 5. the interaction between the autism children and other people is realized through a preset principle: acquiring interactive data of the autism children and other people with VR games through VR glasses and earphones; the facial expression and action information of the person is subjected to feature extraction, an interaction result is obtained according to interaction data, the autistic children receive the result through feedback information of VR glasses and earphones, when the system is applied specifically, corresponding voice over the voice and a guide arrow are given out by the system according to a treatment scheme of the children, sentence patterns and articles are changed to repeat until the children can move correctly, and besides, family members can also be properly induced, so that the effects of participation and treatment of the children are achieved; 6. the method comprises the following steps of detecting the vital signs of the autism children by using preset detection equipment: the life characteristics comprise heart rate data, blink data and arm activity data of the autism children, the data are uploaded to a cloud end, a personal database of the children is established, a chart is drawn to serve as basic data for judging the perception attention of the autism children to the VR game, meanwhile, the system can conduct statistics comparison analysis on the life characteristic data of each autism child every month, every quarter and every half year to form a corresponding tree graph and a line graph, the size and the change condition of the perception attention of the system to different VR games are judged, the effect of the training process is judged according to the result, the modeling effect is good, and the model can run more smoothly.
Preferably, the flow chart of the three-dimensional modeling by using OpenGL is as follows: in the VC environment, when performing three-dimensional modeling by using OpenGL, in the data preparation stage, usually, feature point data and surface data need to be measured first, and stored into an input.
Preferably, in S3, the VR game implements an exercise tool: the Unity is interactive software for realizing 3d interactive content creation, scenes in real life or unreal fictional scenes can be drawn and displayed for 3d by creating a model of the Unity or referring to a template which is already built by others, the Unity has strong compatibility and can be compatible with a large number of different VR helmets, and a Unity game engine provides a VR mode and can directly preview scene settings on a computer, so that a VR game can smoothly run, and the fluency of the VR game is enhanced.
Preferably, the VR game embodies: the method comprises the steps of constructing scenes and interactive browsing by using a UI interface, constructing living environments familiar to users, including families and schools, only using cylinders and cuboids which are the most basic in the Unity, and possibly not constructing ideal models, so that a Unity built-in modeling tool, namely a builder, can be used, the builder provides a large number of shape templates and can customize parameters so as to design various shapes as required, a designer can use tools of points, lines and planes to pinch the ideal shapes, then three-dimensional coordinates and unit measurement are used for ensuring that the models still maintain reasonable position relation in the dynamic state, the builder can also provide physical modeling technologies, such as cuboids, dining tables and sofas which are made of different materials, wherein the physical characteristics such as surface hardness, deformation degree and the like are involved, after the basic models are constructed, interaction is realized by writing a GameObject type program, the past information and results of the users are obtained by using a database, machine learning analysis is carried out, the most suitable degree of the users is selected, for example, the current situation of the users can be recorded in a social score mode before entering the social environment with high difficulty, and the social difficulty can be treated by comparing the social score with other social situations, such as 75, and the social situations; if the score is between 74-50, the user may enter a medium difficulty scenario, may attempt to handle something that happens in a somewhat familiar environment such as a school; if the user's score is below 49, it is preferable to practice scene simulation with the familiar person in a familiar environment; after entering the situation, the user is guided by the voice over the board, the voice familiar to the user can be previously input into the template prop of Unity, the voice over the board is automatically triggered after the situation is triggered, and the user is guided to perform some situation conversations; in order to ensure that the current state of a user can be accurately analyzed and judged, the dialogue response of the user needs to be analyzed, and the Unity has a voice recognition function and is mainly divided into the following three recognitions: keyword recognition-once a user says some keywords, a call-to-ok function can be triggered, for example, actively calling to say hello, a bonus function can be triggered, and a database is updated; grammarRecognizer grammar recognition-detecting user grammar, judging its language ability, also can real-time update database; the DictionationRecognizer dictation recognition, which is to convert the voice of the user into a text document, can be used for detecting whether the user speaks some keywords or not, and can also be used for recording the performance of the user, so that the doctor can conveniently diagnose in the future; and finally, performing score evaluation according to whether the user completes scene exercise and dialogue performance, updating a database of the user, acquiring a large number of users for machine learning and error analysis by the model, dividing the users into a training set, a verification set and a test set, fitting the model by the training set, training a plurality of models, acquiring parameters of the model with the best effect by the verification set to obtain the optimal model, and finally performing model prediction by the test set to achieve the highest accuracy in future popularization.
Preferably, the VR glasses include VR glasses main part and the equal articulated mirror leg in VR glasses main part both sides, the operation panel has been bolted on the surface of mirror leg, the bottom on mirror leg surface is bonded with the gasbag cover, the inlet end of gasbag cover and the bottom intercommunication of operation panel, the inside bolt of operation panel has miniature electric push rod, the output end bolt of miniature electric push rod has the rack, the rear side of rack and the inside sliding connection of operation panel, the tooth meshing of rack bottom has the pinion, the axle center department of pinion is connected with the inside rotation of operation panel, the rear side bolt of pinion has the eccentric wheel, the outside rotation of eccentric wheel has cup jointed the connecting ring, the bottom of connecting ring articulates there is the transfer line, the rear side of transfer line and the inside sliding connection of operation panel, the lug sliding connection of transfer line bottom has the balladeur train, the rear side bolt of balladeur train has the gear, the axle center department of gear is connected with the inside rotation of operation panel, the tooth meshing of bull gear has drive gear, the left side of articulated surface articulates there is articulated piston rod in the axle center department of bull gear and the inside rotation of operation panel bottom of piston block and piston block.
The invention has the beneficial effects that:
the technology can provide VR games and videos suitable for patients through the condition and individual difference of different patients, and can interact with parents or doctors in the games to avoid the barrier of treating autistic children caused by the fact that the children dare not to face strangers in reality due to the conflicting psychology. Provides a better training environment through VR to help patients treat autism and dare to face society.
Drawings
FIG. 1 is a flow chart of the present invention;
FIG. 2 is a schematic front view of the present invention;
FIG. 3 is a schematic view of the internal structure of the operation box according to the present invention;
fig. 4 is a schematic perspective view of a rack according to the present invention;
fig. 5 is a perspective view of the bull gear according to the present invention.
In the figure: 1. a VR glasses body; 2. temples; 3. an operation box; 4. an air bag cover; 5. a miniature electric push rod; 6. a rack; 7. a pinion gear; 8. an eccentric wheel; 9. a connecting ring; 10. a transmission rod; 11. a carriage; 12. a bull gear; 13. a transmission gear; 14. a hinged lever; 15. a piston block.
Detailed Description
The present invention will be further illustrated with reference to the following specific examples.
Referring to FIGS. 1-5, examples
The embodiment provides a training method for visual stimulation of autism of children based on a VR interaction technology, which comprises the following steps:
s1: acquiring archive information of the autistic children through questionnaires or self-testing game data, wherein the archive information comprises basic personal data, state information and game data, and intelligently evaluating according to the obtained basic personal data, state information and game data of the autistic children, the state information specifically comprises colors, shapes, speeds, agility and space perception abilities of images of a patient in videos and games, the personal data specifically comprises ages, illness time, illness symptoms, illness frequency and illness degree, the game data comprises game results, time, heart rate data, blink data and arm activity data of the patient, before VR equipment is used, an HTML is used for writing an online questionnaire, a database pool is created, a post method is used for transmitting data, and the acquired data are synchronized to the local; sql is created by using ER diagrams to clarify the relation of each table in the database, and Mysql is used to create a database VR, wherein the main tables have user information tables-online questionnaires from HTML, including age, disease symptoms, individual monitoring and preferences, vr game data-including duration and score, a user summary table, and an independent user id is provided when each user registers, and each table can be connected and mutually called by virtue of the user id, so that an autism diagnosis database is created according to materials provided by medical students, and a medical diagnosis database is continuously updated according to game results, thereby improving diagnosis accuracy and success rate; database data visualization was achieved using echart, forming two reports: the system comprises a disease condition diagnosis user information report and a game data report, wherein the game data report comprises the completion degree, the duration, the score and the disease condition diagnosis after game, a personalized report is formed for each patient, and an information collection part comprises: the method comprises the steps of using streaming time series to create a self-closing child user information base data stream, having a byte data sequence of a starting point and an end point, containing the previous input stream and the latest self-closing child data analysis result, continuously and automatically generating a large amount of detail data, analyzing the detail reflection of the self-closing child in a VR game, analyzing an update reservation in a real-time manner by complex analysis, just matching with the real-time update of the VR game, changing the limit that the data stream can only be read once or a few times, and specifically implementing acquisition of the file information of the autistic child: the method comprises the steps of performing database association before logging, associating a system with a hospital or an autism child information base, reading data, performing real-time backup and updating by using a streaming time model during operation, and comparing each time of data with the previous data to obtain a latest result; the method comprises the steps of constructing a V-optimal by using a time series model to process past static histogram data, wherein the V-optimal is from a past database, firstly constructing a sketch of data stream data, then constructing a proper histogram from the sketch to facilitate sketch data updating and realize histogram dynamic, and then accurately judging the severity of autism children by using accurate query of the histogram, constructing buckets with different precisions by using a deterministic bucket and a random bucket technology, and then gradually dividing the input autism child data into the buckets so as to complete the construction of the dynamic histogram, so that new information can be analyzed and processed to obtain an effective conclusion, and the improvement condition of the autism children can be seen more intuitively through the dynamic histogram;
s2: according to the patient information of the autism children, calculating by using a machine learning artificial intelligence algorithm to obtain a VR game model and generate a personalized VR game, and applying tools: openGL-based VR modeling techniques: (1) The three-dimensional modeling process can be simple and convenient, basic 3D graphics can be simply drawn by using auxiliary functions contained in an OpenGL library, and a high-complexity model can be realized by other synthetic methods, wherein the synthetic basic methods comprise the following steps: 1. synthesizing simple geometric bodies, wherein OpenGL contains cone and sphere simple geometric bodies, and parameters of the geometric bodies can be changed for synthesis; 2. synthesizing a curved surface body, and obtaining a Bezier curve (surface) or drawing an NURBS curve or curved surface through calculating an evaluation program; 3. triangle synthesis, which is a preferred design primitive of OpenGL because the triangle is the simplest figure and any polygon can be expressed by the triangle; (2) The modeling environment can be vividly simulated, the model can be effectively decorated by coloring rendering, illumination change, texture mapping and depth detection depending on an auxiliary function provided by OpenGL, the design experience with high reality can be provided for a user, and the actual needs of the user are reflected really; (3) The efficient real-time animation response is realized, and due to the fact that the operation function capable of performing double caching on animation color, depth, templates and accumulation is provided, openGL can continuously display the animation, so that a program algorithm is greatly simplified, and the speed of dynamic display of the image is increased; (4) The method has better flexibility, the OpenGL is used as an independent linear software interface, can work in different hardware platforms, standard windows and operating systems, and the modeling is specifically realized as follows: 1. acquiring file information of the autism children: the system comprises family information, basic information, state information, demand information and an evaluation report of a user, wherein the evaluation report judges 1-5 levels of different degrees according to the perceptions of autistic children on different virtual simulation image colors, shapes, object motion speeds and space size factors and the perceptions of different sound tones, sound colors, frequencies and volumes, and the children are customized to specific treatment schemes and treatment scenes according to the judgment; 2. adopting a preset method to construct a virtual simulation game model: establishing a human body model in VR content according to file information and training data of the past autism children, and reserving a data interface for the human body model; enabling the autistic children and other people to wear motion capture equipment at joints to acquire position information of an end effector, enabling the other people to be family members, friends, teachers and other ASD children, and calculating human motion data including joint rotation angles and positions by utilizing an IK reverse dynamics algorithm; then endowing the information to a reserved interface of the human body model, driving the human body model to move according to a target person wearing hardware, and displaying the information in the content to synchronously express action instructions or gesture information of the person; the method comprises the following steps that a camera obtains an image of a target object, a server side amplifies, identifies and processes interactive data through a desktop system and a projection system, and then characteristic points are extracted from the image; then, coordinates of the feature points under a camera coordinate system are obtained by using a PNP algorithm; converting the coordinate of the camera coordinate system into the world coordinate system by using a rotation theory, obtaining the information of the characteristic points of the world coordinate system, and finally obtaining the position information, so that the action of the autistic children is coordinated with the operation of the virtual scene; 3. adopting a preset method to construct a virtual simulation game scene: different virtual simulation game scenes are constructed by utilizing a multi-feature three-dimensional dense reconstruction method, selection is carried out according to the acceptable degree of children, and various basic features of the model are analyzed firstly as follows: in the aspects of light and shadow intensity, texture information and modeling concave-convex, a three-dimensional model with high fitting degree with a target object is reconstructed, the algorithm firstly needs to extract characteristic points of Harris and DoG from an image, carries out characteristic point matching according to the Euclidean distance degree of the selected characteristic points, then carries out characteristic matching on the image, repeatedly obtains sparse point cloud data through a triangulation principle, carries out TNCC sorting on the obtained point cloud, weights the reliability of the point cloud under each visual angle, sorts the seed points according to the reliability, uses the point cloud with high reliability as an expandable initial seed point, obtains more concentrated space directed point cloud or patch, deletes unreliable point cloud data, completes the reconstruction process, has better stability and robustness, and can reconstruct more exquisite details aiming at a model with stronger concave-convex feeling; 4. inputting archive information to obtain a corresponding virtual simulation game and audio music; inputting the file information of the autism children into the virtual simulation game model to obtain a virtual simulation game suitable for different autism children, and simultaneously obtaining corresponding audio music according to the file information of the autism children to further strengthen stimulation; 5. the interaction between the autism children and other people is realized through a preset principle: acquiring interactive data of the autism children and other people with VR games through VR glasses and earphones; the method comprises the steps that characteristics of expression and action information of a person are extracted, an interaction result is obtained according to interaction data, the autistic child receives the result through feedback information of VR glasses and earphones, when the method is applied specifically, a system gives corresponding voice and guide arrow repeated prompts according to a treatment scheme of the child, sentence patterns and articles are changed to repeat until the child can act correctly, and in addition, family members can also be properly induced, so that the effects of participation and treatment of the child are achieved; 6. detecting the vital signs of the autism children by using preset detection equipment: the vital signs include heart rate data, blink data and arm activity data of autism children, upload the data to the cloud, establish the personal database of the children, and draw charts, as the basic data for judging the perception attention of the autism children to VR games, and simultaneously, the system can carry out monthly, quarterly and semiannual statistical comparison and analysis on the vital sign data of each autism child, form corresponding dendrograms and line graphs, and judge the size and the change condition of the perception attention of different VR games, with this effect of judging the training process, openGL is used for carrying out the flow schematic diagram of three-dimensional modeling: in a VC (virtual circuit) environment, when OpenGL is applied to three-dimensional modeling, the data preparation stage usually needs to measure characteristic point data and surface data firstly, store the point data and the surface data into an input.
S3: reward and punishment with the result that the patient participated in the recreation in the VR recreation to carry out machine learning's calculation with according to patient's performance with the calculation of playing result feedback to the VR model and adjust the reward punishment mechanism of game, in order to reach the effect of treatment autism, VR glasses are worn simultaneously to patient and family members 'needs, realize family members and patient virtual image's synchronization and interaction, and the application tool is realized in the VR recreation: unity is interactive software for realizing 3d interactive content creation, scenes in real life or unreal fictional scenes can be drawn and displayed for 3d by creating a model of Unity or referring to a template which is already built by others, unity has strong compatibility and can be compatible with a large number of different VR helmets, a Unity game engine provides a VR mode, scene setting can be directly previewed on a computer, and a VR game is specifically implemented: the method comprises the steps of constructing scenes and interactive browsing by using a UI interface, constructing living environments familiar to users, including families and schools, only using cylinders and cuboids which are the most basic in the Unity, and possibly not constructing ideal models, so that a Unity built-in modeling tool, namely a builder, can be used, the builder provides a large number of shape templates and can customize parameters so as to design various shapes as required, a designer can use tools of points, lines and planes to pinch the ideal shapes, then three-dimensional coordinates and unit measurement are used for ensuring that the models still maintain reasonable position relation in the dynamic state, the builder can also provide physical modeling technologies, such as cuboids, dining tables and sofas which are made of different materials, wherein the physical characteristics such as surface hardness, deformation degree and the like are involved, after the basic models are constructed, interaction is realized by writing a GameObject type program, the past information and results of the users are obtained by using a database, machine learning analysis is carried out, the most suitable degree of the users is selected, for example, the current situation of the users can be recorded in a social score mode before entering the social environment with high difficulty, and the social difficulty can be treated by comparing the social score with other social situations, such as 75, and the social situations; if the score is between 74-50, the user may enter a medium difficulty scenario, may attempt to handle something that happens in a somewhat familiar environment such as a school; if the user's score is below 49, it is preferable to practice scene simulation with the familiar person in a familiar environment; after entering the situation, the user is guided by the voice over the board, the voice familiar to the user can be previously input into the template prop of Unity, the voice over the board is automatically triggered after the situation is triggered, and the user is guided to perform some situation conversations; in order to ensure that the current state of a user can be accurately analyzed and judged, the dialogue response of the user needs to be analyzed, and the Unity has a voice recognition function and is mainly divided into the following three recognitions: keyword recognition of a keyword recognition device-once a user says some keywords, a call function can be triggered, for example, actively calling to say hello, a bonus function can be triggered, and a database is updated; grammarRecognizer grammar recognizes-detects the grammar of the user, judges the language ability of the user and can update the database in real time; the DictionationRecognizer dictation recognition, namely, the voice of the user is converted into a text document, so that whether the user speaks some keywords or not can be detected, the user performance can also be recorded, and the diagnosis of doctors is facilitated in the future; finally, score evaluation is carried out according to whether the user completes scene exercise and dialogue performance, a database of the user is updated, the model needs to acquire a large number of users for machine learning and error analysis, the users need to be divided into a training set, a verification set and a test set, the model is fitted through the training set, a plurality of models are trained, parameters of the model with the best effect are acquired through the verification set to obtain the optimal model, model prediction is carried out through the test set, the highest accuracy is achieved in future popularization, and in the machine learning process, the data accuracy is ensured under the condition that the privacy is ensured by applying differential privacy;
s4: the biological and action information of family members and doctors is collected in advance to form a database, so that a classification result is obtained, and the synchronization of the virtual image and the user is realized in the game;
s5: corresponding games and videos are obtained in VR through patient information of autism children and the expression of patients in the games, the patients interact with virtual images of family members and doctors through the games and the videos in VR glasses, expression, language and actions are synchronized, virtual image data are continuously fed back to a biological and action information database in the games and are compared and updated, and the accuracy is improved through self-updating of an interaction system;
s6: the system has an intelligent analysis function, and can generate an analysis report according to monthly, quarterly and annual data so as to judge the effect of the training process.
VR glasses include VR glasses main body 1 and mirror leg 2 hinged on both sides of VR glasses main body 1, VR glasses main body 1 adopts VR glasses main body, operation box 3 is bolted on surface of mirror leg 2, air bag cover 4 is bonded on bottom of mirror leg 2 surface, air bag cover 4 can enhance buffering effect of mirror leg 2, air inlet end of air bag cover 4 is communicated with bottom of operation box 3, operation box 3 is communicated with air bag cover 4 through pipeline, micro electric push rod 5 is bolted on inside of operation box 3, rack 6 is bolted on output end of micro electric push rod 5, micro electric push rod 5 can rapidly extend and retract, rack 6 can drive rack 6 to move left and right, rear side of rack 6 is connected with inside of operation box 3 in sliding mode, sliding frame is connected on rear side of rack 6, rear side of sliding frame is connected with inside of operation box 3 in sliding mode, rack 6 bottom tooth of rack 6 is engaged with pinion 7, axis of pinion 7 is connected with inside of operation box 3 in rotating mode, pinion 7 can drive eccentric wheel 7 and eccentric wheel 8 is connected with eccentric wheel 8 through eccentric wheel 10, eccentric wheel 8 is connected with eccentric wheel 8, eccentric wheel 8 is connected with eccentric wheel of eccentric wheel, eccentric wheel 8 in sliding ring in sliding mode, the convex block at the bottom of the transmission rod 10 is connected with a sliding frame 11 in a sliding mode, the connecting ring 9 can drive the transmission rod 10 to move upwards, the convex block of the transmission rod 10 can slide in a sliding hole of the sliding frame 11 and drive the sliding frame 11 to rotate upwards, the rear side of the sliding frame 11 is bolted with a large gear 12, the axis of the large gear 12 is rotatably connected with the inside of the operation box 3, the sliding frame 11 can drive the large gear 12 to rotate, the large gear 12 is rotatably arranged with the operation box 3 through a bearing, the large gear 12 can stably rotate, teeth of the large gear 12 are meshed with a transmission gear 13, the axis of the transmission gear 13 is rotatably connected with the inside of the operation box 3, the left side of the surface of the transmission gear 13 is hinged with a hinged rod 14, the large gear 12 can drive the transmission gear 13 to rotate, the transmission gear 13 can drive the hinged rod 14 to move up and down, the bottom end of the hinged rod 14 is hinged with a piston block 15, and the surface of the piston block 15 is slidably connected with the bottom end inside the operation box 3.
The working principle is as follows: the patient wears VR glasses main part 1 through mirror leg 2, switch on the power of miniature electric push rod 5, miniature electric push rod 5 can stretch out and draw back fast, when miniature electric push rod 5 retracts left, miniature electric push rod 5 can drive rack 6 to move left, rack 6 can drive pinion 7 anticlockwise rotation, pinion 7 passes through the bearing and rotates with control box 3 to set up, let pinion 7 can rotate steadily, be eccentric structure between pinion 7 and eccentric wheel 8, can drive eccentric wheel 8 to reciprocate in pinion 7 drives eccentric wheel 8 rotation process, eccentric wheel 8 can rotate and drive connecting ring 9 and reciprocate in the inside of connecting ring 9, when connecting ring 9 moves up, connecting ring 9 can drive transfer line 10 and move up, the lug of transfer line 10 can slide in the slide opening of balladeur train 11 and drive balladeur 11 and rotate up, balladeur train 11 can drive gear wheel 12 and rotate clockwise, gear wheel 12 passes through the bearing and the control box 3 and rotates and sets up, let gear wheel 12 can rotate steadily, gear wheel 12 can drive transmission gear 13 and rotate anticlockwise, drive gear 13 can drive articulated pole 14 and move down, articulated pole 14 can drive piston block 15 and move down, when the piston block moves up and sets up and the piston case 4 changes in the air pressure, the piston sleeve produces the change of air bag, the piston sleeve, the bottom of air pressure change of air bag is utilized to produce the change.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (10)
1. A training method for visual stimulation of autism of children based on VR interaction technology is characterized by comprising the following steps:
s1: acquiring archive information of the autism child through a questionnaire or self-testing game data, wherein the archive information comprises basic personal data, state information and game data, intelligent evaluation is performed according to the acquired basic personal data, state information and game data of the autism child, the state information specifically comprises the color, shape, speed, agility and space perception ability of a patient on videos and images in games, the personal data specifically comprises age, illness time, illness symptoms, illness frequency and illness degree, and the game data comprises game results, time, heart rate data, blink data and arm activity data of the patient;
s2: calculating by using a machine learning artificial intelligence algorithm according to the patient information of the autism children to obtain a VR game model and generate an individualized VR game;
s3: reward and punish with the result that the patient participates in the game in VR game, and feedback the game result to VR model and carry on the calculation of machine learning in order to adjust the reward and punishment mechanism of the game according to patient's performance, in order to achieve the effect of treating autism, patient and family need wear VR glasses at the same time, realize family and patient's fictional synchronization and interaction;
s4: the biological and action information of family members and doctors is collected in advance to form a database, so that a classification result is obtained, and the synchronization of the virtual image and the user is realized in the game;
s5: corresponding games and videos are obtained in VR through patient information of autism children and the expression of patients in the games, the patients interact with virtual images of family members and doctors through the games and the videos in VR glasses, expression, language and actions are synchronized, virtual image data are continuously fed back to a biological and action information database in the games and are compared and updated, and the accuracy is improved through self-updating of an interaction system;
s6: the system has an intelligent analysis function, and can generate an analysis report according to monthly, quarterly and annual data so as to judge the effect of the training process.
2. The VR interaction technology-based training method for visual stimulation of autism of children as claimed in claim 1, wherein in S1, before using the VR device, an online questionnaire is written using HTML, data is transferred by a post method by creating a database pool, and the obtained data is synchronized into a local database; the method comprises the steps of using an ER diagram to clarify the relation of each table in a database, using Mysql to create a database VR. Sql, wherein a main table comprises a user information table, an online questionnaire from HTML (hypertext markup language), including age, disease symptoms, individual monitoring and preferences, vr game data, including duration and score, a user general table, each user has an independent user id when registering, all tables can be connected and mutually called by the user ids, creating an autism diagnosis database according to materials provided by medical students, and continuously updating the medical diagnosis database according to game results, so that the diagnosis accuracy and success rate are improved; database data visualization was achieved using echart, forming two reports: the system comprises a disease condition diagnosis user information report and a game data report, wherein the game data report comprises the completion degree, the duration, the score and the disease condition diagnosis after the game, and a personalized report is formed for each patient.
3. The training method for visual stimulation childhood autism according to claim 2, wherein the information collecting part: the self-closing child user information base data stream is created by using streaming time series, a byte data sequence with a starting point and an end point comprises the original input stream and the latest self-closing child data analysis result, a large amount of detail data can be continuously and automatically generated, the detail reflection of the self-closing child in a VR game is analyzed, the complex analysis of the detail reflection needs to analyze an update reservation in a real-time mode and is just matched with the real-time update of the VR game, and the limitation that the data stream can only be read once or for a few times is changed.
4. The VR interaction technology-based visual stimulus childhood autism training method of claim 3, wherein obtaining the profile information of the autism childhood is implemented: the method comprises the steps of performing database association before logging, associating a system with a hospital or an autism child information base, reading data, performing real-time backup and updating by using a streaming time model during operation, and comparing each time of data with the previous data to obtain a latest result; the method comprises the steps of constructing a sketch map of data stream data by using a time series model to construct V-optimal, constructing a proper histogram from the sketch map, easily updating the sketch map data and realizing the dynamic of the histogram, accurately judging the severity of autism children by using accurate query of the histogram, constructing packets with different precisions by using a deterministic buffering and a random buffering technology, and gradually dividing the input autism children data into the packets, thereby completing the construction of the dynamic histogram, facilitating analysis and processing of new information to obtain an effective conclusion, and more intuitively seeing the improvement condition of the autism children through the dynamic histogram.
5. The method for training on visual stimulation childhood autism according to claim 1, wherein in S2, using a tool: VR modeling technology based on OpenGL: (1) The three-dimensional modeling process can be simple, basic 3D graphs can be simply drawn by using auxiliary functions contained in an OpenGL library, and a high-complexity model can be realized by other synthetic methods, wherein the synthetic basic method comprises the following steps: 1. synthesizing simple geometric bodies, wherein OpenGL contains cone and sphere simple geometric bodies, and parameters of the cone and sphere simple geometric bodies can be changed for synthesis; 2. synthesizing a curved surface body, and obtaining a Bezier curve (surface) or drawing an NURBS curve or curved surface through calculating an evaluation program; 3. triangle synthesis, which is a preferred design primitive of OpenGL because triangles are the simplest graphics and any polygon can be expressed by the triangle; (2) The modeling environment can be vividly simulated, the model can be effectively decorated by coloring rendering, illumination change, texture mapping and depth detection depending on an auxiliary function provided by OpenGL, the design experience with high reality can be provided for a user, and the actual needs of the user are reflected really; (3) The efficient real-time animation response is realized, and due to the fact that the operation function capable of performing double caching on animation color, depth, templates and accumulation is provided, openGL can continuously display the animation, so that a program algorithm is greatly simplified, and the speed of dynamic display of the image is increased; (4) The OpenGL has better flexibility, and can work in different hardware platforms, standard windows and operating systems as an independent linear software interface.
6. The VR interaction technology based training method for visual stimulation of autism in children as claimed in claim 5, wherein the modeling is implemented by: 1. acquiring file information of the autism children: the system comprises family information, basic information, state information, demand information and an evaluation report of a user, wherein the evaluation report judges 1-5 levels of different degrees of perception of different virtual simulation image colors, shapes, object motion speeds and space size factors according to the autism children, judges the perception of different sounds in tone, frequency and volume, and customizes a specific treatment scheme and a treatment scene for the children according to the judgment; 2. adopting a preset method to construct a virtual simulation game model: establishing a human body model in VR content according to the file information and training data of the past autism children, and reserving a data interface for the human body model; enabling the autistic children and other people to wear motion capture equipment at joints to acquire position information of an end effector, enabling the other people to be family members, friends, teachers and other ASD children, and calculating human motion data including joint rotation angles and positions by utilizing an IK reverse dynamics algorithm; then endowing the information to a reserved interface of the human body model, driving the human body model to move according to a target person wearing hardware, and displaying the information in the content to synchronously express the action instruction or gesture information of the person; the method comprises the following steps that a camera obtains an image of a target object, a server side amplifies, identifies and processes interactive data through a desktop system and a projection system, and then characteristic points are extracted from the image; then, coordinates of the feature points under a camera coordinate system are obtained by using a PNP algorithm; converting the coordinates under the camera coordinate system into a world coordinate system by using a rotation theory, obtaining information of characteristic points under the world coordinate system, and finally obtaining position information, so that the action of the autistic child is coordinated with the operation of a virtual scene; 3. adopting a preset method to construct a virtual simulation game scene: different virtual simulation game scenes are constructed by utilizing a multi-feature three-dimensional dense reconstruction method, selection is carried out according to the acceptable degree of children, and various basic features of the model are analyzed firstly as follows: in the aspects of light and shadow intensity, texture information and modeling concave-convex, a three-dimensional model with high fitting degree with a target object is reconstructed, the algorithm firstly needs to extract characteristic points of Harris and DoG from an image, carries out characteristic point matching according to the Euclidean distance degree of the selected characteristic points, then carries out characteristic matching on the image, repeatedly obtains sparse point cloud data through a triangulation principle, carries out TNCC sorting on the obtained point cloud, weights the reliability of the point cloud under each visual angle, sorts the seed points according to the reliability, uses the point cloud with high reliability as an expandable initial seed point, obtains more concentrated space directed point cloud or patch, deletes unreliable point cloud data, completes the reconstruction process, has better stability and robustness, and can reconstruct more exquisite details aiming at a model with stronger concave-convex feeling; 4. inputting the archive information to obtain a corresponding virtual simulation game and audio music; inputting the file information of the autism children into a virtual simulation game model to obtain a virtual simulation game suitable for different autism children, and simultaneously acquiring corresponding audio music according to the file information of the autism children to further strengthen stimulation; 5. the interaction between the autism children and other people is realized through a preset principle: acquiring interactive data of the autism children and other people with VR games through VR glasses and earphones; the facial expression and action information of the person is subjected to feature extraction, an interaction result is obtained according to interaction data, the autistic children receive the result through feedback information of VR glasses and earphones, and when the system is applied specifically, corresponding voice over the voice and a guide arrow are given out by the system according to a treatment scheme of the children, sentence patterns and articles are changed to repeat until the children can act correctly, and besides, family members can also be properly induced, so that the effects of participation and treatment of the children are achieved; 6. detecting the vital signs of the autism children by using preset detection equipment: the vital signs comprise heart rate data, blink data and arm activity data of the autism children, the data are uploaded to a cloud end, a child personal database is established, a chart is drawn to serve as basic data for judging the perception attention of the autism children to the VR game, meanwhile, the system can conduct statistics comparison analysis on the vital sign data of each autism child every month, every quarter and every half year to form a corresponding tree-shaped graph and a line-shaped graph, the size and the change condition of the perception attention of the system to different VR games are judged, and therefore the effect of the training process is judged.
7. The method of claim 6, wherein the flow diagram of three-dimensional modeling using OpenGL is as follows: in the VC environment, when OpenGL is applied to perform three-dimensional modeling, in the data preparation stage, usually, feature point data and surface data need to be measured first, and stored into an input.
8. The method of claim 1, wherein in S3, the VR game implements an exercise tool for: the Unity is interactive software for realizing 3d interactive content creation, scenes in real life or unreal fictional scenes can be drawn and displayed for 3d by creating a model of the Unity or referring to a template which is constructed by others, the Unity has strong compatibility and can be compatible with a large number of different VR helmets, and a VR mode is provided by a Unity game engine, so that scene setting can be previewed on a computer directly.
9. The VR interaction technology-based training method for visually stimulating childhood autism according to claim 8, wherein the VR game embodies: the method comprises the steps of constructing scenes and interactive browsing by using a UI interface, constructing a living environment familiar to a user, including families and schools, and only using the most basic cylinders and cuboids in the Unity, wherein the most basic cylinders and cuboids can not be used for constructing an ideal model, so that a Unity built-in modeling tool-a builder can be used for providing a large number of shape templates and customizing parameters so as to design various shapes as required, a designer can use a point, line and plane tool to pinch the ideal shapes, then three-dimensional coordinates and unit measurement are used for ensuring that the model keeps reasonable position relation in dynamic state, the builder can also provide a physical modeling technology, interaction is realized by compiling GameObject programs after the basic model is constructed, the past information and results of the user are obtained by using a database, machine learning analysis is carried out, and the difficulty degree of the situation which is most suitable for the user is selected; after entering the situation, the user is guided by the voice over the voice, the voice familiar to the user can be input into the template property of Unity, the voice over the voice is automatically triggered after the situation is triggered, and the user is guided to carry out some situation conversations; in order to ensure that the current state of the user can be accurately analyzed and judged, the dialogue response of the user needs to be analyzed, unity has a voice recognition function, and the function is mainly divided into the following three types: keyword recognition of the keyword recognizer; grammarRecognizer grammar recognition; dictation recognition by a DictatationRecognizer; and finally, performing score evaluation according to whether the user completes scene exercise and dialogue performance, updating a database of the user, acquiring a large number of users for machine learning and error analysis by the model, dividing the users into a training set, a verification set and a test set, fitting the model by the training set, training a plurality of models, acquiring parameters of the model with the best effect by the verification set to obtain the optimal model, and finally performing model prediction by the test set to achieve the highest accuracy in future popularization.
10. Training method for visual stimulation childhood autism based on VR interaction technology according to claim 1, wherein VR glasses comprise VR glasses body (1) and legs (2) hinged on both sides of VR glasses body (1), the surface of the legs (2) is bolted with an operation box (3), the bottom of the surface of the legs (2) is bonded with an air bag sleeve (4), the air inlet end of the air bag sleeve (4) is communicated with the bottom of the operation box (3), the inside of the operation box (3) is bolted with a micro electric push rod (5), the output end of the micro electric push rod (5) is bolted with a rack (6), the rear side of the rack (6) is connected with the inside of the operation box (3) in a sliding manner, the teeth at the bottom of the rack (6) are engaged with a pinion (7), the axis of the pinion (7) is connected with the inside of the operation box (3) in a rotating manner, the rear side of the pinion (7) is bolted with an eccentric (8), the outside of the eccentric (8) is sleeved with a connection ring (9), the connection ring (9) is hinged with a connection ring (9), the sliding side of the rack (10) is connected with a sliding manner, the slide block (10) is connected with a sliding manner of the rack (10), and the slide block (10) is connected with a rack (10), the axle center department of gear wheel (12) is connected with the inside rotation of control box (3), the tooth meshing of gear wheel (12) has drive gear (13), the axle center department of drive gear (13) is connected with the inside rotation of control box (3), the left side on drive gear (13) surface articulates there is hinge bar (14), the bottom of hinge bar (14) articulates there is piston block (15), the surface of piston block (15) and the inside bottom sliding connection of control box (3).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210960856.8A CN115331783A (en) | 2022-08-11 | 2022-08-11 | Training method for visual stimulation of autism of children based on VR (virtual reality) interaction technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210960856.8A CN115331783A (en) | 2022-08-11 | 2022-08-11 | Training method for visual stimulation of autism of children based on VR (virtual reality) interaction technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115331783A true CN115331783A (en) | 2022-11-11 |
Family
ID=83921655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210960856.8A Pending CN115331783A (en) | 2022-08-11 | 2022-08-11 | Training method for visual stimulation of autism of children based on VR (virtual reality) interaction technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115331783A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115985462A (en) * | 2023-02-10 | 2023-04-18 | 四川大学 | Rehabilitation and intelligence-developing training system for children cerebral palsy |
| CN116269388A (en) * | 2023-03-23 | 2023-06-23 | 王曦 | Intelligent screen interaction psychological assessment system, method, electronic equipment and storage medium |
-
2022
- 2022-08-11 CN CN202210960856.8A patent/CN115331783A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115985462A (en) * | 2023-02-10 | 2023-04-18 | 四川大学 | Rehabilitation and intelligence-developing training system for children cerebral palsy |
| CN116269388A (en) * | 2023-03-23 | 2023-06-23 | 王曦 | Intelligent screen interaction psychological assessment system, method, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115331783A (en) | Training method for visual stimulation of autism of children based on VR (virtual reality) interaction technology | |
| Durupinar et al. | Perform: Perceptual approach for adding ocean personality to human motion using laban movement analysis | |
| Aristidou et al. | Emotion control of unstructured dance movements | |
| Chao et al. | Human motion retrieval from hand-drawn sketch | |
| Forsythe et al. | What paint can tell us: A fractal analysis of neurological changes in seven artists. | |
| CN106023288A (en) | Image-based dynamic substitute construction method | |
| CN103258340B (en) | Is rich in the manner of articulation of the three-dimensional visualization Mandarin Chinese pronunciation dictionary of emotional expression ability | |
| CN102789732B (en) | Transesophageal ultrasonic visual simulation system and method used for teaching and clinical skill training | |
| CN112734946B (en) | Vocal music performance teaching method and system | |
| Ping et al. | Computer facial animation: A review | |
| CN111973201A (en) | Multi-dimensional virtual psychological sand table intelligent analysis method and device based on eye movement interaction | |
| Pelachaud et al. | Final report to NSF of the standards for facial animation workshop | |
| Giese et al. | Metrics of the perception of body movement | |
| CN107533365A (en) | Changed using the pupil size depending on heartbeat to express the system of the method for the social telepresenc of avatar and application this method | |
| Amara et al. | Emotion recognition for affective human digital twin by means of virtual reality enabling technologies | |
| CN111399662B (en) | Human-robot interaction simulation device and method based on high-reality virtual avatar | |
| Lee et al. | Designing an expressive avatar of a real person | |
| Lance et al. | Glances, glares, and glowering: how should a virtual human express emotion through gaze? | |
| Haber et al. | Facial modeling and animation | |
| Mao et al. | A sketch-based approach to human body modelling | |
| Alkawaz et al. | A crucial investigation of facial skin colour research trend and direction | |
| CN108648796A (en) | A kind of virtual reality mirror image therapeutic equipment | |
| Yang et al. | Life-sketch: a framework for sketch-based modelling and animation of 3D objects | |
| TW200818056A (en) | Drivable simulation model combining curvature profile and skeleton and method of producing the same | |
| Van Wyk | Virtual human modelling and animation for real-time sign language visualisation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |