CN106648091A - Method and device of simultaneously and accurately responding to gyro and gesture dragging interaction and mobile phone - Google Patents
Method and device of simultaneously and accurately responding to gyro and gesture dragging interaction and mobile phone Download PDFInfo
- Publication number
- CN106648091A CN106648091A CN201611169821.3A CN201611169821A CN106648091A CN 106648091 A CN106648091 A CN 106648091A CN 201611169821 A CN201611169821 A CN 201611169821A CN 106648091 A CN106648091 A CN 106648091A
- Authority
- CN
- China
- Prior art keywords
- gyroscope
- camera
- gesture
- measurement model
- sphere
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000003993 interaction Effects 0.000 title abstract description 5
- 239000011159 matrix material Substances 0.000 claims abstract description 37
- 230000008859 change Effects 0.000 claims abstract description 18
- 238000012544 monitoring process Methods 0.000 claims abstract description 7
- 238000006243 chemical reaction Methods 0.000 claims abstract description 4
- 238000005259 measurement Methods 0.000 claims description 34
- 230000009466 transformation Effects 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 14
- 230000000007 visual effect Effects 0.000 claims description 14
- 238000012937 correction Methods 0.000 claims description 8
- 238000003672 processing method Methods 0.000 claims description 5
- 230000009471 action Effects 0.000 description 7
- 238000009877 rendering Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000001427 coherent effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a method of simultaneously and accurately responding to gyro and gesture dragging interaction. The method includes the steps that the change of a gyro of a mobile phone and gesture dragging operation on a screen of the mobile phone are monitored simultaneously, when initial data of the gyro are obtained and converted into a rotary matrix, each data item in the gyro rotary matrix is filtered through a low-pass filter to filter out overhigh change values, then the rotary matrix is applied to a camera placed on a sphere center, the same rotary conversion is carried out on the camera, and when the distance and direction of transverse dragging on the screen by a user are obtained through monitoring, a spherical model is controlled to rotate in the dragging direction around the X axis or Y axis of the own coordinate system of the camera. The initial gyro data are pretreated through the low-pass filter, the problems that rotary conversion is unsmooth or incoherent due to the precision problem of the gyro, and videos shake as the gyro precision is not enough.
Description
Technical field
The present invention relates to Android platform panoramic video is realized in panoramic video play-back technology field, more particularly to one kind
Play simultaneously and accurate response gyroscope pulls the method and apparatus for interacting with gesture.
Background technology
Nearly 2 years, virtual reality technology obtained development at full speed, and such as Oculus of foreign countries, Google, Samsung are all sent out
Cloth oneself VR products, including the SDK of virtual reality hardware device and application.At present main VR equipment has three big
Class.One class is VR glasses, and this kind of product needed coordinates mobile phone to use, and mobile phone is inserted in VR eyes, coordinates VR applications to carry out body
Test virtual reality effect, VR applications are run on mobile phone, comparison is representational be Google Cardboard and
DayDream View；Another kind of is that VR heads show, and this kind of needs and computer or game host are used cooperatively, apply in computer or
In person's main frame, the aobvious signal of video signal for being only responsible for showing to come from main frame or computer transmission of VR heads, such as HTC VIVE；Last
Class is referred to as VR all-in-ones, that is, need not be by other equipment, and user only needs to take this equipment, anywhere can
Experience VR effects.
At present the application form of main flow has two big class on these VR equipment, and a class is game application, and another kind of is exactly complete
Scape Video Applications.Panoramic video is different from conventional video, there is provided a kind of brand-new interactive mode and experience.How to carry for user
Become us firstly the need of the problem for solving for virtual reality experience more true to nature.
Also there are the company of many research panoramic video technologies, such as the DayDream that Google companies issue both at home and abroad at present
SDK (predecessor is Carboard SDK), the SDK provide a kind of complete to realize according to gyro data change conversion viewing angle
The mode of scape video playback.
Interact in the action with user and be primarily present two class problems：One is most supports single interaction side
Formula, i.e., adjust the mode at visual angle according to gyro data change.Although portioned product also supports that gesture is pulled and gyroscope two
Person, but both can not simultaneously be responded, can only switch between gyroscope pattern and gesture dragging pattern, such as UtoVR
Deng；Two be most of product when gyroscope is responded directly is processed using the initial data of gyroscope, and some mobile phone tops
Spiral shell instrument data are often not accurate enough, and the change of gyroscope spin data often has certain jitter phenomenon, i.e. hand
When machine is static, the data that gyroscope is returned can also occur certain change sometimes, result in and finally start in broadcasting Video timeshift
Machine may result in video jitter, and Consumer's Experience is poor.
The content of the invention
The purpose of the present invention is to be directed to technological deficiency present in prior art, and provides one kind and realize Android platform
Panoramic video is played simultaneously and accurate response gyroscope pulls the method and apparatus for interacting with gesture.
To realize that the technical scheme that the purpose of the present invention is adopted is：
It is a kind of to realize that simultaneously and accurately response gyroscope pulls the method for interacting with gesture, including,
A Sphere Measurement Model is set up on the target view that Android video images are drawn, one is created and is regarded for control
The camera at angle is simultaneously placed on the sphere center position of Sphere Measurement Model；
Player carries out decoding operate and generates video texture to panoramic video, is then attached to video texture described
The inner surface of Sphere Measurement Model,
While listening for the gesture drag operation in the gyroscope change and mobile phone screen of mobile phone, when the original for getting gyroscope
Beginning data are simultaneously converted into the form of spin matrix, and each data item in gyroscope spin matrix is adopted into LPF
Device is filtered so that too high changing value is filtered, and being then applied to spin matrix on the camera for be positioned over the centre of sphere makes it do together
The rotation transformation of sample, gets distance and direction that user laterally pulls on screen and controls Sphere Measurement Model around camera when monitoring
The X-axis or Y-axis of local Coordinate System is rotated by the direction for pulling.
The processing method of described low pass filter is,
R [n]=R [n-1]+a* (X [n]-R [n-1])
Wherein X [n] represents a certain element value in the spin matrix that current gyro is collected, and R [n-1] represents the last time
The real a certain element value being used in the spin matrix of rotation transformation after having calculated, R [n] represents the end value after correction, and a is strong
Positive divisor.
Distance and direction that user laterally pulls on screen are got, Sphere Measurement Model is then caused around camera own coordinate
The Y-axis of system is rotated by the direction for pulling, and the angular dimension of rotation is corresponding with the distance for pulling；User is got in screen
Distance and direction that upper longitudinal direction pulls, then cause Sphere Measurement Model to carry out by the direction for pulling around the X-axis of camera local Coordinate System
Rotation, the angular dimension of rotation is corresponding with the distance for pulling.
Described Sphere Measurement Model and camera is created using OpenGL ES.
It is a kind of to realize that simultaneously and accurately response gyroscope pulls the device for interacting with gesture, including,
MBM, to set up a Sphere Measurement Model on the target view that Android video images are drawn, creates one
The individual sphere center position for controlling the camera at visual angle and be placed on Sphere Measurement Model；
Playing module, to carry out decoding operate to panoramic video and generate video texture, then adheres to video texture
In the inner surface of described Sphere Measurement Model,
Rotary module, while listening for the gesture drag operation in the gyroscope change and mobile phone screen of mobile phone, when getting
The initial data of gyroscope is simultaneously converted into the form of spin matrix, and each data item in gyroscope spin matrix is entered
Row is filtered so that too high changing value is filtered, and then spin matrix be applied to do it on the camera for be positioned over the centre of sphere same
Rotation transformation, gets distance and direction that user laterally pulls on screen and controls Sphere Measurement Model around camera itself when monitoring
The X-axis or Y-axis of coordinate system is rotated by the direction for pulling.
The processing method of described low pass filter is,
R [n]=R [n-1]+a* (X [n]-R [n-1])
Wherein X [n] represents a certain element value in the spin matrix that current gyro is collected, and R [n-1] represents the last time
The real a certain element value being used in the spin matrix of rotation transformation after having calculated, R [n] represents the end value after correction, and a is strong
Positive divisor.
Described Sphere Measurement Model and camera is created using OpenGL ES.
A kind of mobile phone with described device.
Compared with prior art, the invention has the beneficial effects as follows：
Present invention achieves panoramic video can pull to adjust video visual angle by gyroscope and gesture simultaneously when playing
Function.Pre-processed using low pass filter for original gyro data, reduced due to gyroscope precision problem
Caused rotation transformation is unsmooth or even incoherent problem, solves the problems, such as that gyroscope precision not enough causes video jitter.
Description of the drawings
Fig. 1 show realizing the broadcasting of Android platform panoramic video simultaneously and accurately responding gyroscope and hand for the present invention
Gesture pulls the schematic flow sheet of the method and apparatus of interaction.
Specific embodiment
The present invention is described in further detail below in conjunction with the drawings and specific embodiments.It should be appreciated that described herein
Specific embodiment only to explain the present invention, be not intended to limit the present invention.
Panoramic video：Also known as 720 degree or 360 degree of panoramic videos (hereinafter referred to as " panoramic video ").Different from traditional
Ordinary video, panoramic video can be in any viewing dynamic video of upper and lower 360 degree of shooting angle or so, and let us has a kind of true
Sensation on the spot in person in positive meaning, and it will not limited by time, space and region.Panoramic video it be not single
Static panorama graphic form, but embrace a wide spectrum of ideas with the depth of field, dynamic image, sound etc., it is provided simultaneously with counterpoint of sound and picture, sound picture same
Step.
OpenGL(Open Graphics Library)：OpenGL (writing Open Graphics Library entirely) is specified
Justice one is across programming language, the professional graphic package interface of cross-platform DLL specification.It is used for 3-D view (two
Dimension also can), be that One function is powerful, call convenient underlying graphics storehouse.OpenGL is the most extensively received in industry field
2D/3D figure API, its from be born expedited the emergence of various computer platforms and the thousands of outstanding application program on equipment so far.
OpenGL is independently of Windows or other operating systems, is also network readezvous point.Comprising CAD, content creation,
In the industry fields such as the energy, amusement, development of games, manufacturing industry, pharmacy industry and virtual reality, OpenGL helper persons realize
The high visual performance power PaintShop of high-performance, great impulsive force on the hardware devices such as PC, work station, supercomputer
Exploitation.
OpenGL ES(OpenGL for Embedded Systems)：It is the subset of OpenGL 3-D graphic API, for
The embedded devices such as mobile phone, PDA and game host and design.
To improve the fine granularity of control, the present invention realizes that top is played simultaneously and accurately responded to Android platform panoramic video
Spiral shell instrument pulls the method for interacting with gesture, including,
Step 101, sets up a Sphere Measurement Model on the target view that Android video images are drawn, and creates a use
In control visual angle camera and be placed on the sphere center position of Sphere Measurement Model；
In this step, it is possible to use create described Sphere Measurement Model and camera, specific spherical model using OpenGL ES
Size can need to be adjusted according to the displaying of oneself.
Step 102, player carries out decoding operate and generates video texture to panoramic video, is then attached to described ball
The inner surface of surface model is simultaneously watched with camera,
As player carries out decoding operate to panoramic video, continuous new video image can must be got, then by these
Video image is converted into video texture, is then attached to the inner surface of the Sphere Measurement Model created in previous step, and with video
Decoding operate carry out, continuous renewal is attached to video texture on sphere.
Step 103, while listening for the gesture drag operation in the gyroscope change and mobile phone screen of mobile phone, when getting top
The initial data of spiral shell instrument is simultaneously converted into the form of spin matrix, and then spin matrix is applied to the camera for being positioned over the centre of sphere
On make it do same rotation transformation；Get distance and direction that user laterally pulls on screen and control sphere when monitoring
Model is rotated around the X-axis or Y-axis of camera local Coordinate System by the direction for pulling；Specifically, user is got on screen
The distance for laterally pulling and direction, then cause Sphere Measurement Model to be revolved by the direction for pulling around the Y-axis of camera local Coordinate System
Turn, the angular dimension of rotation is corresponding with the distance for pulling；Distance and direction that user longitudinally pulls on screen are got, so
Afterwards so that Sphere Measurement Model is rotated around the X-axis of camera local Coordinate System by the direction for pulling, angular dimension and the dragging of rotation
Distance it is corresponding.Correspondence model rotation, both action controls are individually controlled when two actions occur simultaneously
It is upper separate, it is directly that last result is superimposed, operand is reduced, control is more directly convenient succinct.
Each data item in gyroscope spin matrix is filtered using low pass filter simultaneously, too high change
Change value is filtered, so as to eliminate the shake of gyroscope so that rotation transformation is smoother more coherent.
The concrete set-up mode of low pass filter is as follows, according to the data collected from gyroscope, forms a spin moment
Battle array, this matrix be not applied directly on camera carry out it is rotationally-varying.For the value of each element in spin matrix, according to
Equation below is modified:
R [n]=R [n-1]+a* (X [n]-R [n-1])
Wherein X [n] represents a certain element value in the spin matrix that current gyro is collected, and R [n-1] represents the last time
The real a certain element value being used in the spin matrix of rotation transformation after having calculated, R [n] represents the end value after correction, a corrections
The factor, the span of a is 0.1-1.2, and the present invention uses 0.15.Will be real according to the spin matrix obtained after correction
For rotationally-varying.The present invention is pre-processed for original gyro data using low pass filter, is reduced due to top
Rotation transformation is unsmooth caused by spiral shell instrument precision problem or even incoherent problem, and also solving gyroscope precision not enough causes to regard
The problem of frequency shake.In addition implementation does not rely on specific player, and flexibility ratio is higher.
Step 104, rotates at visual angle and utilizes shape library simultaneously, as OpenGL ES or opengl carry out model and picture
Render.Render is always constantly in the operation for carrying out, i.e., to render in rotation.Angle of the content for actually rendering according to rotation
What degree was adjusted.User can be reached by gesture dragging and mobile rotating mobile to adjust the visual angle of video-see.From upper
Step is stated it can also be seen that all of operation is all the logic of Video Rendering layer, OPENGLES is a shape library, is rendered
Process logic still to be realized by rendering layer, render process and traditional player logic of VR are peeled away, both separate, and do not have
There is coupling, player can be higher with unrestricted choice, flexibility ratio.Therefore project can flexibly select according to the actual needs to play
Device, the restriction that there is no that class of Cardboard SDK.
In order to the data variation and gesture that respond gyroscope simultaneously are pulled, when user carries out gesture dragging, according to gesture
The distance of dragging and direction, corresponding rotation transformation is done to Sphere Measurement Model, and this change can make the content that camera perspective is seen
Change；The process of gyroscope is also similar, and when gyro data changes, the spin matrix for making camera keeps
It is consistent with gyroscope direction of rotation.Because the target rotation of two kinds of action controls is different, when two actions occur simultaneously, computing
Also will not be superimposed, but action can be embodied directly on visual angle, and being realized using two kinds of effect superpositions of which can
High-speed response gyroscope rotates, while the interactive mode at adjustment visual angle also can be pulled by gesture.
Meanwhile, the invention also discloses one kind realizes that Android platform panoramic video is played respond gyroscope and hand simultaneously
Gesture pulls the device of interaction, including,
MBM, a ball is set up on the target view that Android video images are drawn using OpenGL ES
Surface model, creates a sphere center position for being used to control the camera at visual angle and be placed on Sphere Measurement Model；
Playing module, to carry out decoding operate to panoramic video and generate video texture, then adheres to video texture
In the inner surface of described Sphere Measurement Model,
Rotary module, while listening for the gesture drag operation in the gyroscope change and mobile phone screen of mobile phone, when getting
The initial data of gyroscope is simultaneously converted into the form of spin matrix, and then spin matrix is applied to the phase for being positioned over the centre of sphere
Make it do same rotation transformation on machine, when monitoring the user horizontal distance for pulling and direction and control ball on screen are got
Surface model is rotated around the X-axis or Y-axis of camera local Coordinate System by the direction for pulling；That is, user is got horizontal on screen
To the distance and direction that pull, Sphere Measurement Model is then caused to be rotated by the direction for pulling around the Y-axis of camera local Coordinate System,
The angular dimension of rotation is corresponding with the distance for pulling；Distance and direction that user longitudinally pulls on screen are got, then
So that Sphere Measurement Model is rotated around the X-axis of camera local Coordinate System by the direction for pulling, angular dimension and the dragging of rotation
Apart from corresponding.Described rotary module also includes low pass filter, to by each data in gyroscope spin matrix
Item is filtered too high changing value to filter, and is eliminated the shake of gyroscope so that rotation transformation is smoother more coherent.
The processing method of described low pass filter is,
R [n]=R [n-1]+a* (X [n]-R [n-1])
Wherein X [n] represents a certain element value in the spin matrix that current gyro is collected, and R [n-1] represents the last time
The real a certain element value being used in the spin matrix of rotation transformation after having calculated, R [n] represents the end value after correction, and a is strong
Positive divisor.
Rendering module, to rotate at visual angle shape library is utilized simultaneously, and such as opengl carries out rendering for model and picture.
The invention provides one kind realizes that simultaneously response gyroscope pulls to interact with gesture in Android platform carrying out entirely
The device of scape video playback, the device is applied to supports contact action and the smart mobile phone containing gyroscope.Mobile phone is responded simultaneously
Drag gesture on gyroscope and mobile phone screen realizes more flexible interactive mode.User only needs to drag at visual angle by gesture
Assigned direction is pulled to, if thinking that at any time change of perspective can also at any time utilize gyroscope change of perspective in watching process.
Two ways is acted on simultaneously, and user can flexible operating as needed.
The above is only the preferred embodiment of the present invention, it is noted that for the common skill of the art
For art personnel, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications
Also should be regarded as protection scope of the present invention.
Claims (8)
- It is 1. a kind of to realize that simultaneously and accurately response gyroscope pulls the method for interacting with gesture, it is characterised in that to include,A Sphere Measurement Model is set up on the target view that Android video images are drawn, creating one is used to control visual angle Camera is simultaneously placed on the sphere center position of Sphere Measurement Model；Player carries out decoding operate and generates video texture to panoramic video, then video texture is attached to into described sphere The inner surface of model,While listening for the gesture drag operation in the gyroscope change and mobile phone screen of mobile phone, when the original number for getting gyroscope According to and be converted into the form of spin matrix, each data item in gyroscope spin matrix is entered using low pass filter Row is filtered so that too high changing value is filtered, and then spin matrix be applied to do it on the camera for be positioned over the centre of sphere same Rotation transformation, gets distance and direction that user laterally pulls on screen and controls Sphere Measurement Model around camera itself when monitoring The X-axis or Y-axis of coordinate system is rotated by the direction for pulling.
- 2. as claimed in claim 1 to realize that simultaneously and accurately response gyroscope pulls the method for interacting with gesture, its feature exists It is in, the processing method of described low pass filter,R [n]=R [n-1]+a* (X [n]-R [n-1])Wherein X [n] represents a certain element value in the spin matrix that current gyro is collected, and R [n-1] represents last calculating The real a certain element value being used in the spin matrix of rotation transformation after complete, R [n] represents the end value after correction, a be correct because Son.
- 3. as claimed in claim 1 to realize that simultaneously and accurately response gyroscope pulls the method for interacting with gesture, its feature exists In, distance and direction that user laterally pulls on screen are got, Sphere Measurement Model is then caused around the Y of camera local Coordinate System Axle is rotated by the direction for pulling, and the angular dimension of rotation is corresponding with the distance for pulling；Get user to indulge on screen To the distance and direction that pull, Sphere Measurement Model is then caused to be rotated by the direction for pulling around the X-axis of camera local Coordinate System, The angular dimension of rotation is corresponding with the distance for pulling.
- 4. as claimed in claim 1 to realize that simultaneously and accurately response gyroscope pulls the method for interacting with gesture, its feature exists In using the described Sphere Measurement Model of OpenGL ES establishments and camera.
- It is 5. a kind of to realize that simultaneously and accurately response gyroscope pulls the device for interacting with gesture, it is characterised in that to include,MBM, to set up a Sphere Measurement Model on the target view that Android video images are drawn, creates a use In control visual angle camera and be placed on the sphere center position of Sphere Measurement Model；Playing module, to carry out decoding operate to panoramic video and generate video texture, is then attached to institute by video texture The inner surface of the Sphere Measurement Model stated,Rotary module, while listening for the gesture drag operation in the gyroscope change and mobile phone screen of mobile phone, when getting gyro The initial data of instrument is simultaneously converted into the form of spin matrix, and each data item in gyroscope spin matrix was carried out So that too high changing value is filtered, being then applied to spin matrix on the camera for be positioned over the centre of sphere makes it do same rotation for filter Conversion, gets distance and direction that user laterally pulls on screen and controls Sphere Measurement Model around camera own coordinate when monitoring The X-axis or Y-axis of system is rotated by the direction for pulling.
- 6. as claimed in claim 5 to realize that simultaneously and accurately response gyroscope pulls the device for interacting with gesture, its feature exists It is in, the processing method of described low pass filter,R [n]=R [n-1]+a* (X [n]-R [n-1])Wherein X [n] represents a certain element value in the spin matrix that current gyro is collected, and R [n-1] represents last calculating The real a certain element value being used in the spin matrix of rotation transformation after complete, R [n] represents the end value after correction, a be correct because Son.
- 7. as claimed in claim 6 to realize that simultaneously and accurately response gyroscope pulls the device for interacting with gesture, its feature exists In using the described Sphere Measurement Model of OpenGL ES establishments and camera.
- 8. a kind of mobile phone of the device with as described in any one of claim 5-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611169821.3A CN106648091A (en) | 2016-12-16 | 2016-12-16 | Method and device of simultaneously and accurately responding to gyro and gesture dragging interaction and mobile phone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611169821.3A CN106648091A (en) | 2016-12-16 | 2016-12-16 | Method and device of simultaneously and accurately responding to gyro and gesture dragging interaction and mobile phone |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106648091A true CN106648091A (en) | 2017-05-10 |
Family
ID=58823900
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611169821.3A Pending CN106648091A (en) | 2016-12-16 | 2016-12-16 | Method and device of simultaneously and accurately responding to gyro and gesture dragging interaction and mobile phone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106648091A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481324A (en) * | 2017-07-05 | 2017-12-15 | 微幻科技(北京)有限公司 | A kind of method and device of virtual roaming |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160067617A1 (en) * | 2014-09-05 | 2016-03-10 | Ballcraft, Llc | Detecting the Changing Position Of A Face To Move And Rotate A Game Object In A Virtual Environment |
| CN105721703A (en) * | 2016-02-25 | 2016-06-29 | 杭州映墨科技有限公司 | Method for carrying out panoramic positioning and orientation by utilizing mobile phone device sensor |
| CN105872353A (en) * | 2015-12-15 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | System and method for implementing playback of panoramic video on mobile device |
| CN105898460A (en) * | 2015-12-10 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Method and device for adjusting panorama video play visual angle of intelligent TV |
-
2016
- 2016-12-16 CN CN201611169821.3A patent/CN106648091A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160067617A1 (en) * | 2014-09-05 | 2016-03-10 | Ballcraft, Llc | Detecting the Changing Position Of A Face To Move And Rotate A Game Object In A Virtual Environment |
| CN105898460A (en) * | 2015-12-10 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Method and device for adjusting panorama video play visual angle of intelligent TV |
| CN105872353A (en) * | 2015-12-15 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | System and method for implementing playback of panoramic video on mobile device |
| CN105721703A (en) * | 2016-02-25 | 2016-06-29 | 杭州映墨科技有限公司 | Method for carrying out panoramic positioning and orientation by utilizing mobile phone device sensor |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481324A (en) * | 2017-07-05 | 2017-12-15 | 微幻科技(北京)有限公司 | A kind of method and device of virtual roaming |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10016679B2 (en) | Multiple frame distributed rendering of interactive content | |
| CN104870063B (en) | For cloud processing and the system and method for the content being superimposed on the stream-type video frame of remote processing application | |
| JP7008733B2 (en) | Shadow generation for inserted image content | |
| US9886102B2 (en) | Three dimensional display system and use | |
| EP3116616B1 (en) | Gaming device with volumetric sensing | |
| US20180357810A1 (en) | Foveal adaptation of particles and simulation models in a foveated rendering system | |
| US20150193979A1 (en) | Multi-user virtual reality interaction environment | |
| LaViola et al. | 3D spatial interaction: applications for art, design, and science | |
| CN107533230A (en) | Head mounted display tracing system | |
| CN103902489B (en) | Generate and execute the method and system of the Miniapp of computer application | |
| US11765335B2 (en) | Synthetic stereoscopic content capture | |
| CN107735152A (en) | Expanded field of vision for virtual reality (VR) viewing renders again | |
| CN107209568A (en) | Phone control and presence in virtual reality | |
| CN105913471B (en) | The method and apparatus of picture processing | |
| WO2016114930A2 (en) | Systems and methods for augmented reality art creation | |
| EP3634593B1 (en) | Optimized deferred lighting and foveal adaptation of particles and simulation models in a foveated rendering system | |
| CN105872353A (en) | System and method for implementing playback of panoramic video on mobile device | |
| US20210326027A1 (en) | Method and apparatus for controlling movement of virtual object, terminal, and storage medium | |
| CN107423010A (en) | A kind of information processing method and electronic equipment | |
| CN104216533B (en) | A kind of wear-type virtual reality display based on DirectX9 | |
| CN108174174A (en) | VR image display methods, device and terminal | |
| CN106980377A (en) | The interactive system and its operating method of a kind of three dimensions | |
| CN106610721A (en) | Method and apparatus for realizing simultaneous response to gyroscope and gesture dragging interaction, and mobile phone | |
| Jiang et al. | A SLAM-based 6DoF controller with smooth auto-calibration for virtual reality | |
| WO2022012349A1 (en) | Animation processing method and apparatus, electronic device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |