CN106484091A - A kind of direction synchronous method of headset equipment - Google Patents

A kind of direction synchronous method of headset equipment Download PDF

Info

Publication number
CN106484091A
CN106484091A CN201610149948.2A CN201610149948A CN106484091A CN 106484091 A CN106484091 A CN 106484091A CN 201610149948 A CN201610149948 A CN 201610149948A CN 106484091 A CN106484091 A CN 106484091A
Authority
CN
China
Prior art keywords
headset equipment
video pictures
directioin parameter
parameter
degrees
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610149948.2A
Other languages
Chinese (zh)
Other versions
CN106484091B (en
Inventor
刘新宇
贡闽
张雪锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hulu Technology Co Ltd
Original Assignee
Hulu Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hulu Technology Co Ltd filed Critical Hulu Technology Co Ltd
Priority to CN201610149948.2A priority Critical patent/CN106484091B/en
Publication of CN106484091A publication Critical patent/CN106484091A/en
Application granted granted Critical
Publication of CN106484091B publication Critical patent/CN106484091B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Abstract

The present invention proposes a kind of direction synchronous method of headset equipment, and the picture direction that can be allowed in video and the direction of user are consistent, and improves user and helmets the vivid effect of viewing video, improves Consumer's Experience.It is consistent with user direction that the present invention realizes video pictures direction, mainly develops design in terms of three:One is after video pictures shoot, and carries out adding the directioin parameter of picture when picture integrating is designed, and the parameter can be extracted to this analysis;Two is comprising compass chip and gyroscope in headset equipment, can analyze the directioin parameter of headset equipment, two parameters of the angle number of degrees of direction parameter comprising orientation and headset equipment and horizontal plane;Three is the calibration unification for completing video direction and user's helmet direction using means such as mobile phone A PP according to setting process.

Description

A kind of direction synchronous method of headset equipment
Technical field
The present invention is applied to Virtual Reality and the augmented reality AR helmet, including but not limited to VR and AR head The headset equipment field of helmet.
Background technology
Recently, Virtual Reality (Virtual Reality) and augmented reality AR (Augmented Reality) Developed is like a raging fire.The film that the VR and AR helmet not only can watch IMAX effect and 3D effect is put on, Even 360 degree of panoramic pictures, 360 degree of panoramic videos and 360 degree of cineramas can be watched.
No matter being 360 degree of panoramic pictures with single camera rotary taking, or taken the photograph with omnirange multi-cam 360 degree of panoramic videos and film that shadow machine (accompanying drawing 1) shoots.360 degree are watched entirely VR the and AR helmet is put on Before scape picture, video and film, it is required for being corrected the direction of the helmet and synchronous.Current calibration side Before formula is the app for opening VR, first mobile phone is placed horizontally in calibration gyroscope on desktop.Enter 360 degree After panoramic video, the player that APP is carried can show the picture of one default direction of user, and user can be with base Video is watched in default frame, it is also possible to turn to adjust by user and want the different directions picture that sees. Assume user normally towards direction when the picture seen be not the direction for oneself wanting to see picture, Ke Yitong Cross by the reset key on handle and change itself direction adjusting, need could to allow user after repeatedly debugging Towards be intended to towards target direction and see the target video picture wanting to see.
This direction and video pictures adjustment mode have two problems, and one is that adjustment is complicated, needs repeatedly by multiple Position key and user change the adjustment of itself direction;Two be the picture direction seen in video and user itself towards Direction is inconsistent, it may appear that the situation of actual direction and user's sense of direction contradiction, reduces Consumer's Experience.Such as, When user is towards due west side, in the helmet, but see the picture that the sun very true to nature rises, this scene and The sense of direction of user just has conflict, and user has unconformable sensation.Even occur, oneself in picture Southward walk always, it is seen that adjoin time each sight spot picture of appearance from north orientation in the south, and actually user now real face To be the north, the heat heat shone by user's back, and it is seen that oneself is towards Due South in picture, this Planting Consumer's Experience allows user's heart feel very contradiction.
Content of the invention
The present invention proposes a kind of direction synchronous method of headset equipment, the picture direction that can be allowed in video It is consistent with the direction of user, raising user helmets and watches the vivid effect of video, improves Consumer's Experience.
It is consistent with user direction that the present invention realizes video pictures direction, mainly develops design in terms of three:
One is after video pictures shoot, and carries out adding the directioin parameter of picture when picture integrating is designed, and should Parameter can be extracted to this analysis.
Two is comprising compass chip and gyroscope in headset equipment, can analyze headset equipment Directioin parameter, two parameters of the angle number of degrees of direction parameter comprising orientation and headset equipment and horizontal plane, Wherein direction parameter is used for indicating the four corners of the world orientation of the helmet, with the angle information of horizontal plane by the helmet with The angle number of degrees of horizontal plane represent.When the helmet is the elevation angle with horizontal plane direction, with horizontal plane to helmet direction Rotate up through the number of degrees represent elevation scale, and before number of rotation plus "+" number;When the helmet and level When face direction is the angle of depression, with horizontal plane to helmet direction be rotated down through the number of degrees represent, and in swing Add "-" number before number.The built-in processor of the helmet can be exported the directioin parameter of the helmet to the mobile phone in the helmet, And data analysis and process is carried out in the APP that mobile phone is installed.
Three is that mobile phone A PP plays 360 degree of panoramic videos, opens the fixation side that gives tacit consent to during panoramic video by video To entrance, while the directioin parameter of the acquiescence fixed-direction is extracted processor, the direction ginseng that now extracts Number includes direction parameter and the angle number of degrees with horizontal plane of video.Processor is directioin parameter and the head of video Helmet exports the directioin parameter of the user of processor and is contrasted, and completes video direction and user according to flow process The calibration unification in helmet direction.
The direction synchronous method that the present invention is proposed accordingly and direction sychronisation as follows.
A kind of direction synchronous method of headset equipment, it is characterised in that:Video pictures carry out picture after the picture is taken The directioin parameter of picture is added during the Integration Design of face, and the parameter can be extracted for this analysis;Head Wear comprising orienting device in formula equipment, the directioin parameter for obtaining headset equipment can be analyzed;Set in wear-type During standby broadcasting video pictures, the calibration in video pictures direction and headset equipment direction is completed according to setting process.
Foregoing direction synchronous method, it is characterised in that:The directioin parameter is comprising orientation and angle degree Number, orientation be headset equipment towards four corners of the world orientation, the angle number of degrees are headset equipment and level The angle number of degrees in face.
Foregoing direction synchronous method, it is characterised in that described complete video direction and headset equipment side Setting process to calibration is comprised the following steps:Extract the directioin parameter of video pictures;Receive headset equipment The directioin parameter for transmitting;Compare the horizontal plane angle number of degrees of video pictures and the horizontal plane angle of headset equipment Whether the number of degrees are consistent, adjust the horizontal plane angle number of degrees and the headset equipment one of video pictures if inconsistent Cause;Whether the orientation of relatively video pictures is consistent with the orientation of headset equipment, adjusts if inconsistent and regards The orientation of frequency picture is consistent with headset equipment.
Foregoing direction synchronous method, it is characterised in that:The orienting device of headset equipment is by compass Chip and gyroscope composition.
Foregoing direction synchronous method, it is characterised in that:The headset equipment is the VR helmet or AR The helmet.
A kind of direction sychronisation of headset equipment, the directioin parameter for video pictures and headset equipment Directioin parameter calibration, it is characterised in that include:Directioin parameter extraction element, for extracting video pictures Directioin parameter;Orienting device, for determining the directioin parameter of headset equipment;Calibrating installation, completes to regard The comparison of the directioin parameter of frequency picture and the directioin parameter of headset equipment, and according to comparative result by video The directioin parameter of picture is calibrated to the directioin parameter of headset equipment.
Foregoing direction sychronisation, it is characterised in that:The headset equipment is the VR helmet or AR The helmet.
Foregoing direction sychronisation, it is characterised in that:The orienting device by compass chip and Gyroscope constitutes.
Foregoing direction sychronisation, it is characterised in that:The calibrating installation is for being provided with corresponding function The mobile phone of APP.
Description of the drawings
Fig. 1 is the schematic diagram of 360 degree of panoramic cameras.
Fig. 2 is the device configuration schematic diagram of the VR and AR helmet.
Fig. 3 is the helmet horizontal by the schematic diagram during elevation angle.
Fig. 4 is the helmet horizontal by the schematic diagram during angle of depression.
Fig. 5 constitutes schematic diagram for directioin parameter.
Fig. 6 is video pictures direction calibration flow chart.
Specific embodiment
Fig. 1 show 360 panoramic cameras, can shoot 360 degree of panoramic videos and film with the video camera. The video camera is camera in spherical shape periphery entirely, when starting 360 degree of panoramic videos shootings, all cameras Never direction and angle are while start shooting.The picture that the untreated front difference camera of image shoots has repetition, During later stage Video processing, need to accept or reject the content of shooting of different cameras and spliced, and different The video pictures that direction and angle are seen identify directioin parameter exist in video file for posterior direction contrast and Use during calibration.There is the directioin parameter in video file includes direction parameter and the angle number of degrees with horizontal plane, Direction parameter is used for identifying the four corners of the world direction of user, uses account with the angle number of degrees of horizontal plane for identifying The degree that faces upward or bow of helmet relative level.
Mark defined with the angle number of degrees of horizontal plane as follows in video file, is needed in the helmet Look up the video pictures that sees, now video pictures be defined as "+" direction, head with the horizontal plane angle number of degrees The number of degrees that helmet is rotated when being rotated upwardly to and can see the video pictures from horizontal plane are the angle number of degrees, and at this It is stored in video file before the number of degrees plus after "+".As shown in figure 3, the helmet be rotated upwardly to from horizontal plane permissible See that the number of degrees rotated during target video picture are 30 degree, just the folder with horizontal plane of the target video picture Angle number is defined as+30 °, and+30 ° are present in video file, for extracting contrast and analyzing later Use.
Need in the helmet to overlook the video pictures that sees, now video pictures is fixed with the horizontal plane angle number of degrees Justice is "-" direction, and the number of degrees that the helmet is rotated when being rotated downwardly to and can see the video pictures from horizontal plane are The angle number of degrees, and be stored in video file before the number of degrees plus after "-".As shown in figure 4, the helmet is from level Face down to rotate to and can see that the number of degrees rotated during target video picture are 30 degree, just the target video is drawn Face be defined as -30 ° with the angle number of degrees of horizontal plane, and -30 ° are present in video file, for carrying later Take out contrast and analysis is used.
The helmet feeds back to the directioin parameter of user the APP installed in mobile phone, has been necessary for obtaining in the helmet and has used The device of family directioin parameter.As shown in Fig. 2 helmet schematic diagram, built-in Compass chip c in the helmet With gyroscope b.Compass chip c can obtain the direction parameter of user, and direction parameter is used for indicating the helmet Four corners of the world orientation.Gyroscope b is used for sensing pitching motion and the angle of user's head, and pitch rate leads to Cross the angle number of degrees parameter of the helmet and horizontal plane to weigh.When user faces upward the number of degrees of head with the horizontal 30 degree, As shown in figure 3, the helmet is+30 ° the angle degree indicia with horizontal plane, and+30 ° of parameter feedbacks are given The APP installed in mobile phone.When the number of degrees that user bows one's head are with the horizontal 30 degree, as shown in figure 4, the helmet It is -30 ° the angle degree indicia with horizontal plane, and -30 ° of parameter feedbacks to the APP installed in mobile phone.
Mobile phone A PP receives user's directioin parameter of helmet feedback, and extracts the direction ginseng of current video picture Count, then comparative analysis user directioin parameter and video pictures directioin parameter.Wherein, directioin parameter include with The horizontal plane angle number of degrees and direction parameter two parts content, as the directioin parameter of Fig. 5 is constituted shown in schematic diagram.
The video pictures directioin parameter comparative analysis that mobile phone A PP is received after user's directioin parameter and extracted, presses The synchronous calibration in user direction and video pictures direction is completed according to Fig. 6 video pictures direction calibration flow chart, tool Body step is analyzed as follows.
First, judge user's directioin parameter in the horizontal plane angle number of degrees and video pictures directioin parameter in Whether consistent with the horizontal plane angle number of degrees.If in user's directioin parameter with the horizontal plane angle number of degrees and video Inconsistent with the horizontal plane angle number of degrees in directioin parameter, APP allows video pictures to be adjusted to and user's directioin parameter In the video pictures consistent with horizontal plane angle number, now the direction parameter of video is constant, that is, video Picture four corners of the world direction is constant, direction parameter in approach axis parameter after the completion of the adjustment of the horizontal plane angle number of degrees Comparative analysis step;If joining with the horizontal plane angle number of degrees and video pictures direction in user's directioin parameter Consistent with the horizontal plane angle number of degrees in number, the directioin parameter of video pictures does not adjust and jumps directly to direction ginseng The comparative analysis step of the direction parameter in number.
After the completion of previous step video pictures with the adjustment of the horizontal plane angular separation number of degrees, video pictures side is entered Position parameter tuning step.First, the direction parameter in user's directioin parameter and video pictures directioin parameter are judged In direction parameter whether consistent.If the direction parameter in user's directioin parameter and video pictures directioin parameter In direction parameter inconsistent, it is consistent with the direction parameter in user's directioin parameter that APP allows video pictures to be adjusted to Video pictures, now video pictures is constant with the horizontal plane angle number of degrees, that is, video pictures pitching shape State is constant, and after the completion of direction parameter adjustment, whole user direction and video pictures direction synchronous adjustment are completed, depending on Frequency enters normal playing status;If in the direction parameter in user's directioin parameter and video pictures directioin parameter Direction parameter consistent, the directioin parameter of the video pictures video that do not adjust enters normal playing status.
The present invention proposes a kind of direction synchronous method of headset equipment, the picture direction that can be allowed in video It is consistent with the direction of user, raising user helmets and watches the vivid effect of video, improves Consumer's Experience. For those skilled in the art, it is modified slightly realizing the identical function of the present invention with modification.This Inspired by the present invention, do not surmount modification and the modification of basic thought of the present invention, all in the protection model of the present invention Within enclosing.
The present invention is applied to general headset equipment, including but not limited to the headset equipment neck of VR, AR helmet Domain is all within protection domain.

Claims (9)

1. the direction synchronous method of a kind of headset equipment, it is characterised in that:
Video pictures carry out adding the directioin parameter of picture, and the parameter when picture integrating is designed after the picture is taken Can be extracted for this analysis;
Include orienting device in headset equipment, the directioin parameter for obtaining headset equipment can be analyzed;
When headset equipment plays video pictures, video pictures direction and wear-type is completed according to setting process The calibration of device orientation.
2. direction synchronous method as claimed in claim 1, it is characterised in that:
The directioin parameter comprising orientation and the angle number of degrees, orientation for headset equipment towards the four corners of the world Orientation, the angle number of degrees are the angle number of degrees of headset equipment and horizontal plane.
3. direction synchronous method as claimed in claim 1 or 2, it is characterised in that described complete video pictures The setting process of direction and headset equipment direction calibration is comprised the following steps:
Extract the directioin parameter of video pictures;
Receive the directioin parameter that headset equipment is transmitted;
The horizontal plane angle number of degrees whether one of relatively the horizontal plane angle number of degrees of video pictures and headset equipment Cause, the horizontal plane angle number of degrees for adjusting video pictures if inconsistent are consistent with headset equipment;
Whether the orientation of relatively video pictures is consistent with the orientation of headset equipment, adjusts if inconsistent and regards The orientation of frequency picture is consistent with headset equipment.
4. direction synchronous method as claimed in claim 3, it is characterised in that:
The orienting device of headset equipment is made up of compass chip and gyroscope.
5. direction synchronous method as claimed in claim 3, it is characterised in that:
The headset equipment is the VR helmet or the AR helmet.
6. a kind of direction sychronisation of headset equipment, sets for the directioin parameter and wear-type of video pictures The calibration of standby directioin parameter, it is characterised in that include:
Directioin parameter extraction element, for extracting the directioin parameter of video pictures;
Orienting device, for determining the directioin parameter of headset equipment;
Calibrating installation, completes the comparison of the directioin parameter of video pictures and the directioin parameter of headset equipment, and And the directioin parameter of video pictures is calibrated to the directioin parameter of headset equipment according to comparative result.
7. direction sychronisation as claimed in claim 6, it is characterised in that:
The headset equipment is the VR helmet or the AR helmet.
8. direction sychronisation as claimed in claims 6 or 7, it is characterised in that:
The orienting device is made up of compass chip and gyroscope.
9. direction sychronisation as claimed in claims 6 or 7, it is characterised in that:
The calibrating installation is the mobile phone for being provided with corresponding function APP.
CN201610149948.2A 2016-03-16 2016-03-16 A kind of direction synchronous method of headset equipment Expired - Fee Related CN106484091B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610149948.2A CN106484091B (en) 2016-03-16 2016-03-16 A kind of direction synchronous method of headset equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610149948.2A CN106484091B (en) 2016-03-16 2016-03-16 A kind of direction synchronous method of headset equipment

Publications (2)

Publication Number Publication Date
CN106484091A true CN106484091A (en) 2017-03-08
CN106484091B CN106484091B (en) 2019-05-31

Family

ID=58238571

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610149948.2A Expired - Fee Related CN106484091B (en) 2016-03-16 2016-03-16 A kind of direction synchronous method of headset equipment

Country Status (1)

Country Link
CN (1) CN106484091B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080129666A1 (en) * 2006-12-05 2008-06-05 Susumu Shimotono Method and Apparatus for Changing a Display Direction of a Screen of a Portable Electronic Device
CN101986184A (en) * 2010-05-06 2011-03-16 徐晗 Dynamic visual angle liquid crystal glasses
CN103543831A (en) * 2013-10-25 2014-01-29 梁权富 Head-mounted panoramic player
CN103677715A (en) * 2013-12-13 2014-03-26 深圳市经伟度科技有限公司 Immersive virtual reality experiencing system
CN104394451A (en) * 2014-12-05 2015-03-04 宁波菊风***软件有限公司 Video presenting method for intelligent mobile terminal
CN104407700A (en) * 2014-11-27 2015-03-11 曦煌科技(北京)有限公司 Mobile head-wearing type virtual reality and augmented reality device
CN104914582A (en) * 2015-07-07 2015-09-16 吴展雄 Head-mounted wireless virtual reality display device
CN204741528U (en) * 2015-04-22 2015-11-04 四川大学 Intelligent control ware is felt to three -dimensional immersive body

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080129666A1 (en) * 2006-12-05 2008-06-05 Susumu Shimotono Method and Apparatus for Changing a Display Direction of a Screen of a Portable Electronic Device
CN101986184A (en) * 2010-05-06 2011-03-16 徐晗 Dynamic visual angle liquid crystal glasses
CN103543831A (en) * 2013-10-25 2014-01-29 梁权富 Head-mounted panoramic player
CN103677715A (en) * 2013-12-13 2014-03-26 深圳市经伟度科技有限公司 Immersive virtual reality experiencing system
CN104407700A (en) * 2014-11-27 2015-03-11 曦煌科技(北京)有限公司 Mobile head-wearing type virtual reality and augmented reality device
CN104394451A (en) * 2014-12-05 2015-03-04 宁波菊风***软件有限公司 Video presenting method for intelligent mobile terminal
CN204741528U (en) * 2015-04-22 2015-11-04 四川大学 Intelligent control ware is felt to three -dimensional immersive body
CN104914582A (en) * 2015-07-07 2015-09-16 吴展雄 Head-mounted wireless virtual reality display device

Also Published As

Publication number Publication date
CN106484091B (en) 2019-05-31

Similar Documents

Publication Publication Date Title
CN106415447B (en) Information processing unit, information processing method and image processing system
US10802578B2 (en) Method for displaying image, storage medium, and electronic device
US10382680B2 (en) Methods and systems for generating stitched video content from multiple overlapping and concurrently-generated video instances
CN106125930A (en) A kind of virtual reality device and the method for main perspective picture calibration
CN108139204B (en) Information processing apparatus, method for estimating position and/or orientation, and recording medium
CN106385576B (en) Stereoscopic Virtual Reality live broadcasting method, device and electronic equipment
CN107431796B (en) The omnibearing stereo formula of panoramic virtual reality content captures and rendering
EP3007038B1 (en) Interaction with three-dimensional video
EP3198866B1 (en) Reconstruction of three-dimensional video
CA2928248C (en) Image display device and image display method, image output device and image output method, and image display system
CN103916605B (en) Mobile computing device with shadow real-time broadcast ability in shadow
CN103513421B (en) Image processor, image treatment method and image processing system
EP2920638B1 (en) Video display system and method of displaying video
US11399170B2 (en) Image processing apparatus, image processing method, and storage medium
CN106406361B (en) Method and device for controlling intelligent hat and intelligent hat
US20130044129A1 (en) Location based skins for mixed reality displays
CN106507178B (en) Video broadcasting method and device
CN110244840A (en) Image processing method, relevant device and computer storage medium
CN105340279A (en) Display update time reduction for a near-eye display
CN106199066B (en) The direction calibration method, apparatus of intelligent terminal
CN110463195A (en) Method and apparatus for rendering timing text and figure in virtual reality video
US20180192031A1 (en) Virtual Reality Viewing System
CN107404641A (en) Method for processing video frequency, video broadcasting method, set top box and VR equipment
US11328487B2 (en) Method and program for providing augmented reality image by using depth data
JPWO2020129115A1 (en) Information processing system, information processing method and computer program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190531

Termination date: 20200316