CN208888762U - A kind of mouse input system based on virtual reality system - Google Patents
A kind of mouse input system based on virtual reality system Download PDFInfo
- Publication number
- CN208888762U CN208888762U CN201820524072.XU CN201820524072U CN208888762U CN 208888762 U CN208888762 U CN 208888762U CN 201820524072 U CN201820524072 U CN 201820524072U CN 208888762 U CN208888762 U CN 208888762U
- Authority
- CN
- China
- Prior art keywords
- mouse
- true
- hand
- virtual
- true mouse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Position Input By Displaying (AREA)
Abstract
The mouse input system based on virtual reality system that the utility model discloses a kind of can give the true tactile force feedback of user, the interactive experience and the sense of reality of the input of lifting system mouse, while promoting input efficiency by virtual reality fusion technology.The system includes position tracking device, depth camera, true mouse, computer and head-mounted display HMD.Position tracking device is set on true mouse, and the real-time position information for obtaining true mouse is sent to computer.The top of the positive or true mouse of true mouse is arranged in depth camera, and acquisition obtains user's hand depth image；It include hand shape and hand position data in hand depth image.Computer controls HMD according to hand depth image and renders hand shape in the corresponding position of virtual scene.Computer controls HMD according to true mouse real-time position information and renders virtual mouse in the corresponding position of virtual scene, and virtual mouse is consistent with true mouse geometry.
Description
Technical field
The utility model relates to technical field of virtual reality, and in particular to a kind of mouse input based on virtual reality system
System.
Background technique
At present in technical field of virtual reality, when being related to the virtual reality system for mouse, general use is based on
The body-sensing virtual mouse of Kinect
Body-sensing virtual mouse based on Kinect: the program is based on Kinect somatosensory device, carries out skeleton data to user
Acquisition develops a kind of body-sensing virtual mouse software based on gesture motion control.This method using Kinect depth camera into
The acquisition of row data is carried out behavioral value, identification based on RGB color information and depth information, and is obtained using cluster algorithm
The palm location information of user and the direction of motion information of arm are obtained, and then identifies the gesture feature of user, reaches operation computer
Effect.
The body-sensing virtual mouse software carries out operation computer by gesture, and compared with traditional mouse, operation is inflexible,
Average recognition rate is 84.80%, and there are identification errors, leverages interactive efficiency.Since preset gesture is numerous, study at
This height is unfavorable for being easily accepted by a user, and the gesture motion of numerous complicated also limits the use crowd of system.
Have a kind of 3D wireless mouse for being applicable to virtual reality at present: the program is directed to three-dimensional desktop environment, devises
A kind of 3D wireless mouse being applicable to virtual reality.The mouse action is similar with conventional mouse, including right and left key and idler wheel.Mouse
Mark is internal to be added with three-dimensional sensors and processor chips, for acquiring the location information of mouse in three dimensions, and
Digital Signal Processing is carried out to essential information, and by the wireless transmitter module inside mouse, is transferred to computer, is done further
Mouse position and input calculate.
The 3D wireless mouse use space sensor carries out real-time tracking to mouse position, due to calibrated error and environment
The influence of the factors such as noise, there are errors for the position of tracking.When longer between when the system is in use, it is also possible to error accumulation is caused,
Lead to mouse shake or positional fault, input accuracy reduces.When user wears the helmet, the object of real world can not be seen
Body, therefore when user will use mouse, the position of mouse can not be accurately found, system convenience is lower.
To sum up, both the above is directed in the virtual system of mouse, can not be to the operation of mouse and virtually existing by user's hand
Real environment combines, and lacks tactile force feedback, reduces the sense of reality of input experience and virtual reality system；Simultaneously because can not
Tracking in real time is carried out efficiently to user's hand, causes interactive efficiency slack-off.
Utility model content
The mouse input system based on virtual reality system that in view of this, the present invention provides a kind of, can pass through
Virtual reality fusion technology, gives the true tactile force feedback of user, the interactive experience and the sense of reality of the input of lifting system mouse, simultaneously
Promote input efficiency.
In order to achieve the above objectives, a kind of the technical solution of the utility model are as follows: mouse input based on virtual reality system
System, including position tracking device, depth camera, true mouse, computer and head-mounted display HMD.
Position tracking device is set on true mouse, and the real-time position information for obtaining true mouse is sent to computer.
The top of the positive or true mouse of true mouse is arranged in depth camera, and acquisition obtains user's hand depth
Image；It include hand shape and hand position data in hand depth image.
Computer controls HMD according to hand depth image and renders hand shape in the corresponding position of virtual scene.
Computer controls HMD according to true mouse real-time position information and renders virtual mouse in the corresponding position of virtual scene
Mark, virtual mouse are consistent with true mouse geometry.
Further, position tracking device includes the induction point of base station and setting quantity.
The quantity of induction point is arbitrarily chosen, and induction point is optical sensor or ultrasonic sensor.
The induction point of setting quantity is set to the surface of true mouse.
Base station, for emitting signal, emitted signal is received by induction point；Base station is also used to obtain the induction of induction point
Signal obtains true mouse real-time position information according to inductive signal.
Further, the induction point of quantity is set as optical sensor, and quantity is at least 3；Base station is Lighthouse
Base station.
Further, depth camera Leapmotion.
The utility model has the advantages that
1, the utility model uses true mouse, tracks true mouse position using position tracking device, is taken the photograph using depth
Camera scans user's hand, and is rendered into HMD head-mounted display virtual environment, realizes that user passes through viewing in virtual environment
Virtual mouse and phantom hand control true mouse, realize the information input of mouse.It is capable of providing really compared to technology before
Percussion mouse force feedback, improve the sense of reality, comfort level, accuracy.Secondly, the utility model be not limited to before technology void
Quasi- hand, can be used simpler three-dimensional hand shape and interacts.The utility model can be realized user in virtual scene
Mouse is used as in true environment, realizes efficiently inputting for information.
Simultaneously in the utility model depth camera use, the position of user's hand can be accurately provided, simplified
Technology needs to carry out the Complicated Flow of image procossing, segmentation before, so that the interaction technique is simple, interactive efficiency is high.
Detailed description of the invention
Fig. 1 is a kind of mouse input system composed structure based on virtual reality system provided by the embodiment of the utility model
Figure.
Fig. 2 (a) is the first depth camera provided by the embodiment of the utility model and true mouse position relational graph；
Fig. 2 (b) is second of depth camera provided by the embodiment of the utility model and true mouse position relational graph.
Specific embodiment
With reference to the accompanying drawings and examples, the utility model is described in detail.
The utility model provides a kind of mouse input system based on virtual reality system, composed structure such as Fig. 1 institute
Show, which includes
Position tracking device, depth camera, true mouse, computer and head-mounted display HMD；
Position tracking device is set on true mouse, and the real-time position information for obtaining true mouse is sent to computer.
In the utility model embodiment, position tracking device includes the induction point of base station and setting quantity.
Induction point is fixed on mouse surface, and appearance, size, position and the quantity of induction point can freely be chosen, guarantee to feel
Optical sensor, ultrasonic sensor etc. can be used in the signal for answering base station to issue, induction point, but not limited to this.
Base station, for emitting signal, emitted signal is received by induction point；Base station is also used to obtain the induction of induction point
Signal obtains true mouse real-time position information according to inductive signal.In the utility model embodiment, the position of base station guarantees can
With transmitting and receiving signal, quantity, model etc. are chosen according to different tracking systems.
Specifically, the Lighthouse laser of HTC Vive can be used in position tracking device in the utility model embodiment
The base station Lighthouse can be used in tracing and positioning scheme, and base station is placed in the edge of VR system, guarantee with the helmet and
The distance of mouse is consistently less than 4 meters.Induction point selects optical sensor, and quantity will at least have 3, and dispersion is embedded in mouse side
Face, or 3 optical sensors are integrated into a tracker (tracker), it is external to be fixed on mouse.Base station issues x, y
The laser scanning signal in direction, sensor receive laser scanning, recording laser arrival time, according to the scanning speed of laser and
Initial position, and then calculate position of the optical sensor relative to base station passes through calibration in computer vision and track side
Method can calculate the 6DOF pose of mouse using 3 optical sensors in real time.
The top of the positive or true mouse of true mouse is arranged in depth camera, and acquisition obtains user's hand depth
Image；It include hand shape and hand position data in hand depth image.
In the utility model embodiment, depth camera can be embedded in true mouse front, such as Fig. 2 (a), to true mouse
It marks a certain range of space to be tracked, by the data processing of computer, three-dimensional auxiliary hand shape is rendered in HMD.Three
Dimension auxiliary hand shape is moved with the movement of true hand, and position corresponds in real time.Depth camera can also be placed near mouse
Position carries out depth tracking to certain space such as Fig. 2 (b).Leapmotion can be used in depth camera.
Available light in tracking range is filtered into infrared ray using optical filter by Leapmotion, and one is formed above equipment virtually
Plane reticule will cause infrared reflection when target object occurs mobile and return to the position where target object
And moving direction.Leapmotion is upper, and there are two high-definition cameras, obtain high-definition picture by stereoscopic shooting, and simulate
The binocular stereo vision of human eye carries out three-dimensional coordinate positioning to space object using triangulation, the data of generation is passed through
USB returns to computer, carries out processing and shows.Computer can be used leapmotion and mention for unity in hand-type rendering display
Hand-type in the core resource packet of confession presets body resource, can also be by unity, and the hand-type grid that creating has bone to bind passes through
Selection bone is mobile to control hand, then encloses special efficacy to appearance, but not limited to this.Depth camera also can be used
Realsense, Kinect etc., but not limited to this.
Computer controls HMD according to hand depth image and renders hand shape in the corresponding position that goes out of virtual scene；Meter
Calculation machine can carry out color to hand when carrying out shape rendering to the hand close to depth camera tracking range, details etc.
Modification, such as point of use cloud, small cube etc. (such as annex), but not limited to this.Compared with the system that traditional hand is rebuild, the program
Algorithm is simple, and calculation amount is small, and is not in the problem of virtual hand deformity when there is complicated hand gesture.Virtual
In the modification of hand, the reinforcement of color, details etc. can be carried out to finger fingertip, the tip that mark is sold visually protrudes hand
Grasping direction, so as to provide the user with preferably grasp experience.
Computer controls HMD according to true mouse real-time position information and renders virtual mouse in the corresponding position of virtual scene
Mark, virtual mouse are consistent with true mouse geometry.Computer shows the virtual image of mouse in HMD, virtual mouse
Identical as the geometry of true mouse, position is fitted completely.
To sum up, the above is only the preferred embodiments of the present utility model only, is not intended to limit the protection of the utility model
Range.Within the spirit and principle of the utility model, any modification, equivalent replacement, improvement and so on should be included in
Within the protection scope of the utility model.
Claims (4)
1. a kind of mouse input system based on virtual reality system characterized by comprising
Position tracking device, depth camera, true mouse, computer and head-mounted display HMD；
The position tracking device is set on the true mouse, and the real-time position information for obtaining the true mouse is sent
To the computer；
The top of the positive or described true mouse of the true mouse is arranged in the depth camera, and acquisition obtains user
Hand depth image；It include the hand shape and hand position data in the hand depth image；
The computer according to the hand depth image control the HMD virtual scene go out corresponding position render it is described
Hand shape；
The computer controls the HMD according to the true mouse real-time position information and renders in the corresponding position of virtual scene
Virtual mouse, the virtual mouse are consistent with the true mouse geometry.
2. the system as claimed in claim 1, which is characterized in that the position tracking device includes the sense of base station and setting quantity
Ying Dian；
The quantity of the induction point is arbitrarily chosen, and the induction point is optical sensor or ultrasonic sensor；
The induction point of the setting quantity is set to the surface of the true mouse；
The base station, for emitting signal, emitted signal is received by the induction point；The base station is also used to obtain described
The inductive signal of induction point obtains the true mouse real-time position information according to the inductive signal.
3. system as claimed in claim 2, which is characterized in that the induction point for setting quantity is optical sensor, quantity
At least 3；The base station is the base station Lighthouse.
4. the system as claimed in claim 1, which is characterized in that the depth camera is Leapmotion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201820524072.XU CN208888762U (en) | 2018-04-13 | 2018-04-13 | A kind of mouse input system based on virtual reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201820524072.XU CN208888762U (en) | 2018-04-13 | 2018-04-13 | A kind of mouse input system based on virtual reality system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN208888762U true CN208888762U (en) | 2019-05-21 |
Family
ID=66492514
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201820524072.XU Active CN208888762U (en) | 2018-04-13 | 2018-04-13 | A kind of mouse input system based on virtual reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN208888762U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108363494A (en) * | 2018-04-13 | 2018-08-03 | 北京理工大学 | A kind of mouse input system based on virtual reality system |
-
2018
- 2018-04-13 CN CN201820524072.XU patent/CN208888762U/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108363494A (en) * | 2018-04-13 | 2018-08-03 | 北京理工大学 | A kind of mouse input system based on virtual reality system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11954808B2 (en) | Rerendering a position of a hand to decrease a size of a hand to create a realistic virtual/augmented reality environment | |
| CN103914152B (en) | Multi-point touch and the recognition methods and system that catch gesture motion in three dimensions | |
| TWI454968B (en) | Three-dimensional interactive device and operation method thereof | |
| CN103345064B (en) | The 3D recognition methods of the cap that a kind of integrated 3D identifies and cap | |
| CN104102343B (en) | Interactive input system and method | |
| CN203941499U (en) | A kind of action collection and feedback system based on stereoscopic vision | |
| CN106454311B (en) | A kind of LED 3-D imaging system and method | |
| CN102169366B (en) | Multi-target tracking method in three-dimensional space | |
| CN104423578B (en) | Interactive input system and method | |
| KR20240051334A (en) | Head-mounted display for virtual and mixed reality with inside-out positional, user body and environment tracking | |
| WO2016094109A2 (en) | Natural user interface camera calibration | |
| CN103793060A (en) | User interaction system and method | |
| KR102147430B1 (en) | virtual multi-touch interaction apparatus and method | |
| CN103336575A (en) | Man-machine interaction intelligent glasses system and interaction method | |
| EP2939214A1 (en) | Using photometric stereo for 3d environment modeling | |
| JP2011022984A (en) | Stereoscopic video interactive system | |
| CN104246664B (en) | The transparent display virtual touch device of pointer is not shown | |
| CN104637080B (en) | A kind of three-dimensional drawing system and method based on man-machine interaction | |
| CN108363494A (en) | A kind of mouse input system based on virtual reality system | |
| CN106200985A (en) | Desktop type individual immerses virtual reality interactive device | |
| CN113672099A (en) | Electronic equipment and interaction method thereof | |
| CN112068757B (en) | Target selection method and system for virtual reality | |
| CN104349157A (en) | 3D displaying apparatus and method thereof | |
| JP2009258884A (en) | User interface | |
| CN208888762U (en) | A kind of mouse input system based on virtual reality system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |