CN106713891B - The method and system of cube panoramic video are played based on D3D interfaces - Google Patents
The method and system of cube panoramic video are played based on D3D interfaces Download PDFInfo
- Publication number
- CN106713891B CN106713891B CN201611165389.0A CN201611165389A CN106713891B CN 106713891 B CN106713891 B CN 106713891B CN 201611165389 A CN201611165389 A CN 201611165389A CN 106713891 B CN106713891 B CN 106713891B
- Authority
- CN
- China
- Prior art keywords
- panoramic video
- cube
- display window
- cube model
- panorama
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
- Studio Circuits (AREA)
Abstract
The present invention discloses the method for playing cube panoramic video based on D3D interfaces, including：Receive panoramic video playing request, according to panoramic video playing request load ask broadcasting panoramic video, and panoramic video is detached, decode after obtain picture frame；Activation trigger instructs, and creates cube model, is fitted to picture frame correspondence on the panorama mapping face of cube model according to preset mapping relations；Position of the display window on the panorama mapping face of cube model in player is detected, and obtains display window corresponding image on the panorama mapping face of cube model and is shown；Receive the depth of field stretch/shrink request of panoramic video, ask to obtain the angular field of view after depth of field stretch/shrink according to depth of field stretch/shrink, acquisition is fitted on the panorama mapping face of cube model, and the image in the angular field of view after depth of field stretch/shrink, and is shown in display window.The switching that the present invention realizes cube panoramic video and plane panoramic video plays.
Description
Technical field
The present invention relates to the technical fields of video playing, complete based on D3D interfaces broadcasting cube more particularly, to one kind
The method and system of scape video.
Background technology
Panoramic video, i.e., 720 degree either 360 degree of panoramic videos it be on the technology of 720 degree or 360 degree panoramas
Development extends to, and converts static panoramic pictures to dynamic picture frame, panoramic video can in shooting angle bottom left
Dynamic video is arbitrarily watched within the scope of 360 degree right, user is allowed to have a kind of feeling on the spot in person.It is used when making panoramic video
One group of video camera shoots the picture of 360 degree (or 720 degree) simultaneously around shooting point, and is allowed to after the image mosaic in later stage
The video of picture around shooting point can be showed without distortions at any time.
Direct3D, abbreviation D3D are Microsofts to improve a set of display routine interface that 3D display performance is developed, it is carried
Abundant 3D function libraries have been supplied, have been game and video player standard widely used in Windows operating system.
D3D calls the medium of video card as operating system and various application software (such as video player), can be under
Video card is operated by video driver, to can above provide the interface of various displays for operating system and various application programs
Function and display function.Operating system and application software (such as video player) only need the interface function for calling D3D to provide
Image display function is can be achieved with function, is shared out the work and help one another by this, greatly reduces software development cycle and cost.
Video broadcasting field, common planar video and panoramic video may be by D3D and played out as the medium of calling video card.
Existing common player can only play the picture frame of plane, and the playing flow of ordinary playing device is：Load regards
Frequently-and video information-carry out video separation-decoding video frame-decoded picture frame of display is obtained, according to normal image frame
Form playing panoramic video can only obtain the picture of inaccurate image plane frame, panoramic video broadcasting cannot be reached at all
Effect.And existing panorama player can only playing panoramic video file, if being obtained using panorama player plays planar video
Can only be distortion picture.Because panorama player plays is 360 centered on shooting point degree by splicing
Picture on perspective plane is inconvenient to store to the panorama of this projection at present, but usually becomes the panorama of projection
It changes and is stored as rectangular image storage, the fitting of remapping of the rectangular image of storage is projected into panorama when playing the panoramic video
Video pictures, then choose the visible partial video part in the user visual field and play out, if in this way by planar video
It fits on panoramic projection model to play out and is just certain to cause distortion phenomenon.In the prior art there are no it is a kind of both can be with
Playing planar video again can be with the scheme of playing panoramic video.
Therefore it provides a kind of can not only play planar video in player but also can be this in the method for playing panoramic video
Field urgent problem to be solved.
Invention content
In view of this, the present invention provides a kind of method and system playing cube panoramic video based on D3D interfaces, solution
Determined not only cannot can play planar video in player in the prior art but also can be with playing panoramic video the technical issues of.
In order to solve the above-mentioned technical problem, the present invention proposes a kind of side playing cube panoramic video based on D3D interfaces
Method, including：
Triggering command of the setting for triggering panoramic video broadcasting in the player based on D3D interfaces is touched according to described
Send instructions and create cube model, and panoramic video is fitted on the panorama mapping face of the cube model；
Panoramic video playing request is received, the aphorama played is asked according to panoramic video playing request load
Frequently, and to the panoramic video detached, decode after obtain picture frame；
The triggering command is activated, cube model is created according to pre-set size, according to preset mapping relations
Described image frame correspondence is fitted on the panorama mapping face of the cube model；
Pre-set display window in the player is detected, the position on the panorama mapping face of the cube model
It sets, and obtains the display window corresponding image on the panorama mapping face of the cube model, in the display window
In shown；
The depth of field stretch/shrink request for receiving the panoramic video, according to depth of field stretch/shrink request and the preset depth of field
The correspondence ratio of stretch/shrink and angular field of view, obtains the angular field of view after depth of field stretch/shrink, and acquisition is fitted in the cube model
Panorama mapping face on, and the image in the angular field of view after the depth of field stretch/shrink, and being carried out in the display window
Displaying.
Further, wherein described image frame correspondence is fitted into the cube model according to the mapping relations
On panorama mapping face, further for：
After obtaining panoramic video, cube model is established based on D3D interfaces, and according to preset mapping relations, really
Determine the correspondence of the texture coordinate of cube apex and picture frame, texture mapping is then carried out according to the correspondence.
Further, wherein the mapping relations, to be set in advance in the picture frame of the panoramic video and described cube
The one-to-one relationship of position on the panorama mapping face of body Model.
Further, wherein pre-set display window in the player is detected, in the complete of the cube model
Position on scape mapping face, and the display window corresponding image on the panorama mapping face of the cube model is obtained,
Shown in the display window, further for：
Pre-set display window in the player is detected, the position on the panorama mapping face of the cube model
It sets, and obtains the display window on the panorama mapping face of the cube model after corresponding image, regarded in the display
It is shown in window；
It is moved in the position of three dimensions according to display window described in input control, the position according to the three dimensions is true
The image for being positioned within the scope of the display window, and being fitted on the panorama mapping face of the cube model, and will be described
Image after display window movement on the panorama mapping face of the cube model is shown in the display window；Wherein,
The input includes：View direction, visual angle size, the depth of field and the form size of user.
Further, wherein this method further comprises：
When detecting planar video play instruction, the triggering command is disabled according to the out code；
Described image frame is obtained, and the picture frame contents of the display window corresponding position are sent to player and are put down
After plane video renders, it is shown in the display window.
On the other hand, the present invention also provides a kind of systems playing cube panoramic video based on D3D interfaces, including：If
Set module, panoramic video acquisition module, cube model creation module and panoramic video playing module；Wherein,
The setup module, for being arranged in the player based on D3D interfaces for triggering touching for panoramic video broadcasting
Send instructions, cube model is created according to the triggering command, and panoramic video is fitted to the panorama of the cube model
On mapping face；
The panoramic video acquisition module is asked for receiving panoramic video playing request according to panoramic video broadcasting
Ask load ask broadcasting panoramic video, and the panoramic video is detached, decode after obtain picture frame；
The cube model creation module creates vertical for activating the triggering command according to pre-set size
Described image frame is corresponded to the panorama mapping face for fitting to the cube model according to preset mapping relations by cube model
On；
The panoramic video playing module, for detecting pre-set display window in the player, described vertical
Position on the panorama mapping face of cube model, and the display window is obtained on the panorama mapping face of the cube model
Corresponding image is shown in the display window；
The depth of field stretch/shrink request for receiving the panoramic video, according to depth of field stretch/shrink request and the preset depth of field
The correspondence ratio of stretch/shrink and angular field of view obtains the angular field of view after depth of field stretch/shrink, and acquisition is fitted in the cube model
On panorama mapping face, and the image in the angular field of view after the depth of field stretch/shrink, and opened up in the display window
Show.
Further, wherein the cube model creation module is further used for：
After obtaining panoramic video, cube model is established based on D3D interfaces, and according to preset mapping relations, really
Determine the correspondence of the texture coordinate of cube apex and picture frame, texture mapping is then carried out according to the correspondence.
Further, wherein the mapping relations, to be set in advance in the picture frame of the panoramic video and described cube
The one-to-one relationship of position on the panorama mapping face of body Model.
Further, wherein the panoramic video playing module is further used for：
Pre-set display window in the player is detected, the position on the panorama mapping face of the cube model
It sets, and obtains the display window on the panorama mapping face of the cube model after corresponding image, regarded in the display
It is shown in window；
It is moved in the position of three dimensions according to display window described in input control, the position according to the three dimensions is true
The image for being positioned within the scope of the display window, and being fitted on the panorama mapping face of the cube model, and will be described
Image after display window movement on the panorama mapping face of the cube model is shown in the display window；Wherein,
The input includes：View direction, visual angle size, the depth of field and the form size of user.
Further, wherein the system further comprises：Planar video playing module, is used for：
When detecting planar video play instruction, the triggering command is disabled according to the out code；
Described image frame is obtained, and the corresponding picture frame contents of the display window are sent to player progress plane and are regarded
After frequency renders, it is shown in the display window.
Compared with prior art, the method and system of the invention that cube panoramic video is played based on D3D interfaces, are realized
Following advantageous effect：
(1) method and system of the present invention that cube panoramic video is played based on D3D interfaces, in video player
Middle setting panoramic video is instructed with the switching control that planar video plays, and cube aphorama is called according to corresponding control instruction
Frequency plays or planar video plays, and solving not only cannot can play planar video in player in the prior art but also can broadcast
The technical issues of putting panoramic video.
(2) method and system of the present invention that cube panoramic video is played based on D3D interfaces, can be according to user
Request carry out the broadcasting of corresponding visual form, avoid because the not corresponding video distortion brought of video play mode is existing
As, and the position correspondence of panoramic image frame and cubical each mapping face is easily set up, it avoids in fitting panorama
Complicated calculations process when picture frame.
(3) method and system of the present invention that cube panoramic video is played based on D3D interfaces, according to anticipating
Good cube panoramic video picture carries out display broadcasting after creating cube model fitting panoramic video, can be suitble to handle
The tripod problem that other panoramic videos cannot be handled.
Certainly, implementing any of the products of the present invention specific needs while must not reach all the above technique effect.
By referring to the drawings to the detailed description of exemplary embodiment of the present invention, other feature of the invention and its
Advantage will become apparent.
Description of the drawings
It is combined in the description and the attached drawing of a part for constitution instruction shows the embodiment of the present invention, and even
With its explanation together principle for explaining the present invention.
Figure 1A is that the flow of the method based on D3D interfaces broadcasting cube panoramic video described in the embodiment of the present invention 1 is shown
It is intended to；
Figure 1B is that panoramic video picture described in the embodiment of the present invention 1 fits to the schematic diagram on cube model；
Fig. 2 is the flow signal for playing the method for cube panoramic video described in the embodiment of the present invention 2 based on D3D interfaces
Figure；
Fig. 3 is the structural representation for the system for playing cube panoramic video described in the embodiment of the present invention 3 based on D3D interfaces
Figure.
Specific implementation mode
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should be noted that：Unless in addition having
Body illustrates that the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The range of invention.
It is illustrative to the description only actually of at least one exemplary embodiment below, is never used as to the present invention
And its application or any restrictions that use.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable
In the case of, the technology, method and apparatus should be considered as part of specification.
In shown here and discussion all examples, any occurrence should be construed as merely illustrative, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should be noted that：Similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined, then it need not be further discussed in subsequent attached drawing in a attached drawing.
Embodiment 1
As shown in Figure 1A, show to play the flow of the method for cube panoramic video described in the present embodiment based on D3D interfaces
It is intended to, the present embodiment the method solves and not only cannot can play planar video in player in the prior art but also can broadcast
The technical issues of putting panoramic video.The method for playing cube panoramic video based on D3D interfaces described in the present embodiment includes following
Step：
Step 101, triggering command of the setting for triggering panoramic video broadcasting in the player based on D3D interfaces, root
Cube model is created according to the triggering command, and panoramic video is fitted on the panorama mapping face of the cube model.
Step 102, user ask playing panoramic video in player, and send panoramic video playing request, described
The mark of the panoramic video is carried in panoramic video playing request.
Step 103 receives panoramic video playing request, and broadcasting is asked according to panoramic video playing request load
Panoramic video, and the panoramic video is detached, decode after obtain picture frame.
According to the mark of the panoramic video, is searched in video database and obtain corresponding panoramic video.Preferably,
In video database, the panoramic video by anticipating is store, the panoramic video of shooting is processed into and is met cube
The image format in six faces of body, and the position correspondence of corresponding panoramic image frame on each face is pre-set, it avoids
Not the phenomenon that panoramic video that position is not played out to caused by when panoramic image frame textures does not meet actual conditions.
It is highly preferred that when handling image, the installation space coordinate system in the corresponding cube of image is obtained and is stored complete
The coordinate fastened in space coordinate of scape picture frame and the space coordinates establish mode, and aphorama is played in player
When frequency, cube model is created according to the mode of establishing of the space coordinates, is fastened in space coordinate in conjunction with panoramic image frame
Coordinate, panoramic image frame is fitted on cube model.
Step 104, the activation triggering command, create cube model according to pre-set size, are reflected according to described
Relationship is penetrated to fit to described image frame correspondence on the panorama mapping face of the cube model.
As shown in Figure 1B, it is that panoramic video picture described in the present embodiment 1 fits to the schematic diagram on cube model, panorama
The trailing flank image 401 of video and bottom surface the image 402 corresponding trailing flank and bottom surface for fitting to cube model respectively；It is other each
A side image is also corresponding to conform in cube model the mapping cube for forming panoramic image frame.
Pre-set display window in step 105, the detection player is mapped in the panorama of the cube model
Position on face, and the display window corresponding image on the panorama mapping face of the cube model is obtained, described
It is shown in display window.
User cannot see that entire panoramic video picture by player, and can only see the picture of the video in visual range
Therefore face in playing panoramic video, only need to show the picture frame in user's visual range in form.
Step 106, the depth of field stretch/shrink request for receiving the panoramic video, ask according to the depth of field stretch/shrink and set in advance
The correspondence ratio of fixed depth of field stretch/shrink and angular field of view obtains the angular field of view after depth of field stretch/shrink, and acquisition is fitted in described cube
On the panorama mapping face of body Model, and the image in the angular field of view after the depth of field stretch/shrink, and will be fitted in described vertical
Image on the panorama mapping face of cube model and in the angular field of view after the depth of field stretch/shrink is in the display window
It is shown.
Because in player, the processing cube model size of establishment is fixed, but the bat of each panoramic video
The size for taking the photograph picture is different, and each panoramic video is conformed to identical size on cube model, will certainly
The problem for causing some panoramic video pictures excessive or too small zooms out/furthers operation by what this step was arranged, can facilitate use
Proper viewing size is found at family, improves user experience.
Preferably, in the present embodiment, the standard size range that picture frame is bonded on cube can also be set, preceding
When phase carries out panoramic image frame processing, the size of panoramic image frame and storage are measured；The aphorama of user is received in player
When frequency playing request, obtain the size of panoramic image frame compared with standard size range, in conjunction with preset size range with
The adjusting relationship of the depth of field first regulates the depth of field of panoramic video, then the panoramic image frame obtained in user's visual range is shown
It plays.
The method based on cube model playing panoramic video described in the present embodiment, according to the cube anticipated
Panoramic video picture carries out display broadcasting after creating cube model fitting panoramic video, can be suitble to handle other aphoramas
The problems such as tripod that frequency cannot be handled, the function of zooming out/further panoramic video picture according to user's operation is also achieved, is promoted
User experience.
Embodiment 2
As shown in Fig. 2, the flow signal of the method to play cube panoramic video described in the present embodiment based on D3D interfaces
Figure, the present embodiment describe cube panoramic video textures and the particular content of display broadcasting on the basis of embodiment 1.This
Method based on cube model playing panoramic video described in embodiment includes the following steps：
Step 201, triggering command of the setting for triggering panoramic video broadcasting in the player based on D3D interfaces, root
Cube model is created according to the triggering command, and panoramic video is fitted on the panorama mapping face of the cube model.
Step 202, user ask playing panoramic video in player, and send panoramic video playing request, described
The mark of the panoramic video is carried in panoramic video playing request.
Step 203 receives panoramic video playing request, and broadcasting is asked according to panoramic video playing request load
Panoramic video, and the panoramic video is detached, decode after obtain picture frame.
Step 204 after obtaining panoramic video, activates the triggering command, cube model is established based on D3D interfaces, and
According to preset mapping relations, the correspondence of the texture coordinate of cube apex and picture frame is determined, then according to institute
It states correspondence and carries out texture mapping.Wherein, the mapping relations, to be set in advance in picture frame and the institute of the panoramic video
State the one-to-one relationship of position on the panorama mapping face of cube model.
Pre-set display window in step 205, the detection player is mapped in the panorama of the cube model
Position on face, and the display window is obtained on the panorama mapping face of the cube model after corresponding image, in institute
It states in display window and is shown.
Step 206 is moved according to display window described in input control in the position of three dimensions, according to the three dimensions
Location determination be located within the scope of the display window, and the image being fitted on the panorama mapping face of the cube model,
And the image after moving the display window on the panorama mapping face of the cube model includes in the display window
In；Wherein, described input includes：Direction, visual angle size, the depth of field and the form size of user's viewing.
Step 207, the depth of field stretch/shrink request for receiving the panoramic video, ask according to the depth of field stretch/shrink and set in advance
The correspondence ratio of fixed depth of field stretch/shrink and angular field of view obtains the angular field of view after depth of field stretch/shrink, and acquisition is fitted in described cube
On the panorama mapping face of body Model, and the image in the angular field of view after the depth of field stretch/shrink, and in the display window
In be shown.
When detecting planar video play instruction, the triggering command is disabled according to the out code for step 208；It obtains
Described image frame is taken, and the picture frame contents of the display window corresponding position are sent to player and carry out planar video rendering
Afterwards, it is shown in the display window.
The method based on cube model playing panoramic video described in the present embodiment, is arranged panorama in video player
Video is instructed with the switching control that planar video plays, and is played according to corresponding control instruction calling cube panoramic video or flat
Plane video plays, and solve not only cannot can play planar video but also can be with playing panoramic video in player in the prior art
The technical issues of.
Embodiment 3
As shown in figure 3, the structural representation of the system to play cube panoramic video described in the present embodiment based on D3D interfaces
Scheme, the system described in the present embodiment is used to implement the side based on cube model playing panoramic video described in above-described embodiment
Method.The video optimized described in the present embodiment decodes the system played：Setup module 301, panoramic video acquisition module 302,
Cube model creation module 303 and panoramic video playing module 304.
Wherein, the setup module 301 connects with 302 phase lotus root of the panoramic video acquisition module, for based on D3D interfaces
Player in setting for trigger panoramic video broadcasting triggering command, according to the triggering command create cube model,
And panoramic video is fitted on the panorama mapping face of the cube model.
The panoramic video acquisition module 302 and 303 phase lotus root of the setup module 301 and cube model creation module
It connects, for receiving panoramic video playing request, the panoramic video played is asked according to panoramic video playing request load,
And the panoramic video is detached, decode after obtain the mapping on cube model of picture frame and described image frame and close
System；
The cube model creation module 303 and the panoramic video acquisition module 302 and panoramic video playing module
304 phase lotus roots connect, and after obtaining panoramic video, activate the triggering command, and cube model, and root are established based on D3D interfaces
According to preset mapping relations, the correspondence of the texture coordinate of cube apex and picture frame is determined, then according to
Correspondence carries out texture mapping.
The panoramic video playing module 304 connects with 303 phase lotus root of the cube model creation module, described for detecting
Position of the pre-set display window on the panorama mapping face of the cube model in player, and obtain the display
Form corresponding image on the panorama mapping face of cube model after texture mapping, is shown in the display window；
The depth of field stretch/shrink request for receiving the panoramic video, according to depth of field stretch/shrink request and the preset depth of field
The correspondence ratio of stretch/shrink and angular field of view obtains the angular field of view after depth of field stretch/shrink, and acquisition is fitted in the cube model
On panorama mapping face, and the image in the angular field of view after the depth of field stretch/shrink, and opened up in the display window
Show.
The cube model creation module 303, is further used for：
The picture frame of the panoramic video and the mapping relations are obtained based on D3D, detects and is set in advance in the player
The display window set, the position on the panorama mapping face of the cube model, and the display window is obtained described vertical
Corresponding image on the panorama mapping face of cube model；
Vision of the display window on the panorama mapping face of the cube model is obtained according to the mapping relations
Image accordingly fits to the visual pattern on the panorama mapping face of the cube model.
The mapping relations are reflected to be set in advance in the panorama of picture frame and the cube model of the panoramic video
Penetrate the one-to-one relationship of position on face.
The panoramic video playing module 304, is further used for：
Pre-set display window in the player is detected, the position on the panorama mapping face of the cube model
It sets, and obtains the display window on the panorama mapping face of the cube model after corresponding image, regarded in the display
It is shown in window；
It is moved in the position of three dimensions according to display window described in input control, the position according to the three dimensions is true
The image for being positioned within the scope of the display window, and being fitted on the panorama mapping face of the cube model, and will be described
Image after display window movement on the panorama mapping face of the cube model is shown in the display window；Wherein,
The input includes：View direction, visual angle size, the depth of field and the form size of user.
Above system further comprises：Planar video playing module 305 and 304 phase lotus root of the panoramic video playing module
It connects, is used for：
When detecting planar video play instruction, the triggering command is disabled according to the out code；
Described image frame is obtained, and the picture frame contents of the display window corresponding position are sent to player and are put down
After plane video renders, it is shown in the display window.
By above each embodiment it is found that the present invention based on D3D interfaces play cube panoramic video method and
System, existing advantageous effect are：
(1) method and system of the present invention based on cube model playing panoramic video, in video player
Panoramic video is arranged to instruct with the switching control that planar video plays, cube panoramic video is called according to corresponding control instruction
It plays or planar video plays, solving not only cannot can play planar video in player in the prior art but also can play
The technical issues of panoramic video.
(2) method and system of the present invention based on cube model playing panoramic video, can be according to user's
Request carries out the broadcasting of corresponding visual form, avoids because of the not corresponding video distortion phenomenon brought of video play mode,
And the position correspondence of panoramic image frame and cubical each mapping face is easily set up, it avoids in fitting panoramic picture
Complicated calculations process when frame.
(3) method and system of the present invention based on cube model playing panoramic video, according to anticipating
Cube panoramic video picture, create cube model fitting panoramic video after carry out display broadcasting, can be suitble to handle it
The tripod problem that its panoramic video cannot be handled.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, apparatus or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, the present invention can be used in one or more wherein include computer usable program code computer
The computer program production implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
Although some specific embodiments of the present invention are described in detail by example, the skill of this field
Art personnel it should be understood that example above merely to illustrating, the range being not intended to be limiting of the invention.The skill of this field
Art personnel are it should be understood that can without departing from the scope and spirit of the present invention modify to above example.This hair
Bright range is defined by the following claims.
Claims (8)
1. a kind of method playing cube panoramic video based on D3D interfaces, which is characterized in that including：
Triggering command of the setting for triggering panoramic video broadcasting in the player based on D3D interfaces, the triggering command are used
In on the panorama mapping face that instruction creates cube model and panoramic video is fitted to the cube model；
Panoramic video playing request is received, the panoramic video played is asked according to panoramic video playing request load, and
Picture frame is obtained after the panoramic video is detached, decoded；
The triggering command is activated, cube model is created according to pre-set size, according to preset mapping relations by institute
Picture frame correspondence is stated to fit on the panorama mapping face of the cube model；
Position of the pre-set display window on the panorama mapping face of the cube model in the player is detected, and
The display window corresponding image on the panorama mapping face of the cube model is obtained, is carried out in the display window
Display；
Receive the panoramic video the depth of field stretch/shrink request, according to the depth of field stretch/shrink request and the preset depth of field stretch/
Contracting and the corresponding ratio of angular field of view, obtain the angular field of view after depth of field stretch/shrink, and acquisition is fitted in the complete of the cube model
Image on scape mapping face and in the angular field of view after the depth of field stretch/shrink, and be shown in the display window；
When detecting planar video play instruction, the triggering command is disabled according to out code；
Described image frame is obtained, and the picture frame contents of the display window corresponding position are sent to player progress plane and are regarded
After frequency renders, it is shown in the display window.
2. the method according to claim 1 for playing cube panoramic video based on D3D interfaces, which is characterized in that according to
The mapping relations by described image frame correspondence fit on the panorama mapping face of the cube model, further for：
After obtaining panoramic video, cube model is established based on D3D interfaces, and according to preset mapping relations, determine vertical
Then the correspondence of the texture coordinate of cube vertex and picture frame carries out texture mapping according to the correspondence.
3. the method according to claim 1 for playing cube panoramic video based on D3D interfaces, which is characterized in that described
Mapping relations, to be set in advance in position on the picture frame of the panoramic video and the panorama mapping face of the cube model
One-to-one relationship.
4. the method according to claim 1 for playing cube panoramic video based on D3D interfaces, which is characterized in that detection
Position of the pre-set display window on the panorama mapping face of the cube model in the player, and described in acquisition
Display window corresponding image on the panorama mapping face of the cube model, is shown in the display window, into
One step is：
Position of the pre-set display window on the panorama mapping face of the cube model in the player is detected, and
The display window is obtained on the panorama mapping face of the cube model after corresponding image, in the display window into
Row display；
It is moved in the position of three dimensions according to display window described in input control, according to the location determination position of the three dimensions
In within the scope of the display window and the image that is fitted on the panorama mapping face of the cube model, and the display is regarded
Image after window movement on the panorama mapping face of the cube model is shown in the display window；Wherein,
The input includes：View direction, visual angle size, the depth of field and the form size of user.
5. a kind of system playing cube panoramic video based on D3D interfaces, which is characterized in that including：Setup module, aphorama
Frequency acquisition module, cube model creation module, panoramic video playing module and planar video playing module；Wherein,
The setup module refers to for being arranged in the player based on D3D interfaces for triggering the triggering of panoramic video broadcasting
It enables, the triggering command, which is used to indicate to create cube model and panoramic video is fitted to the panorama of the cube model, reflects
It penetrates on face；
The panoramic video acquisition module adds for receiving panoramic video playing request according to the panoramic video playing request
Carry ask broadcasting panoramic video, and the panoramic video is detached, decode after obtain picture frame；
The cube model creation module creates cube for activating the triggering command according to pre-set size
Model fits to described image frame correspondence on the panorama mapping face of the cube model according to preset mapping relations；
The panoramic video playing module, for detecting in the player pre-set display window in the cube mould
Position on the panorama mapping face of type, and it is corresponding on the panorama mapping face of the cube model to obtain the display window
Image is shown in the display window；
Receive the panoramic video the depth of field stretch/shrink request, according to the depth of field stretch/shrink request and the preset depth of field stretch/
The angular field of view to contract after obtaining depth of field stretch/shrink with the corresponding ratio of angular field of view, acquisition are fitted in the complete of the cube model
Image on scape mapping face and in the angular field of view after the depth of field stretch/shrink, and be shown in the display window；
Planar video playing module, is used for：
When detecting planar video play instruction, the triggering command is disabled according to out code；
Described image frame is obtained, and the corresponding picture frame contents of the display window are sent to player and carry out planar video wash with watercolours
After dye, it is shown in the display window.
6. the system according to claim 5 for playing cube panoramic video based on D3D interfaces, which is characterized in that described
Cube model creation module, is further used for：
After obtaining panoramic video, cube model is established based on D3D interfaces, and according to preset mapping relations, determine vertical
Then the correspondence of the texture coordinate of cube vertex and picture frame carries out texture mapping according to the correspondence.
7. the system according to claim 5 for playing cube panoramic video based on D3D interfaces, which is characterized in that described
Mapping relations, to be set in advance in position on the picture frame of the panoramic video and the panorama mapping face of the cube model
One-to-one relationship.
8. the system according to claim 5 for playing cube panoramic video based on D3D interfaces, which is characterized in that described
Panoramic video playing module, is further used for：
Position of the pre-set display window on the panorama mapping face of the cube model in the player is detected, and
The display window is obtained on the panorama mapping face of the cube model after corresponding image, in the display window into
Row display；
It is moved in the position of three dimensions according to display window described in input control, according to the location determination position of the three dimensions
In within the scope of the display window and the image that is fitted on the panorama mapping face of the cube model, and the display is regarded
Image after window movement on the panorama mapping face of the cube model is shown in the display window；Wherein,
The input includes：View direction, visual angle size, the depth of field and the form size of user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611165389.0A CN106713891B (en) | 2016-12-16 | 2016-12-16 | The method and system of cube panoramic video are played based on D3D interfaces |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611165389.0A CN106713891B (en) | 2016-12-16 | 2016-12-16 | The method and system of cube panoramic video are played based on D3D interfaces |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106713891A CN106713891A (en) | 2017-05-24 |
| CN106713891B true CN106713891B (en) | 2018-08-10 |
Family
ID=58938988
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611165389.0A Active CN106713891B (en) | 2016-12-16 | 2016-12-16 | The method and system of cube panoramic video are played based on D3D interfaces |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106713891B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107155065A (en) * | 2017-06-28 | 2017-09-12 | 哈尔滨市舍科技有限公司 | A kind of virtual photograph device and method |
| CN109348246B (en) * | 2018-11-21 | 2021-11-30 | 北京未来媒体科技股份有限公司 | 4K panoramic super-fusion video live broadcast method and device |
| CN109348245B (en) * | 2018-11-21 | 2021-10-22 | 北京未来媒体科技股份有限公司 | 4K panoramic super-fusion multi-channel monitoring method and device |
| CN110913278B (en) * | 2019-12-06 | 2022-04-08 | 深圳创维新世界科技有限公司 | Video playing method, display terminal and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101000461A (en) * | 2006-12-14 | 2007-07-18 | 上海杰图软件技术有限公司 | Method for generating stereoscopic panorama by fish eye image |
| CN105245838A (en) * | 2015-09-29 | 2016-01-13 | 成都虚拟世界科技有限公司 | Panoramic video playing method and player |
| CN105898344A (en) * | 2016-04-12 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and device for playing panoramic video |
| CN105959675A (en) * | 2016-05-25 | 2016-09-21 | 腾讯科技（深圳）有限公司 | Video data processing method and device |
| CN106131540A (en) * | 2016-07-29 | 2016-11-16 | 暴风集团股份有限公司 | Method and system based on D3D playing panoramic video |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8928729B2 (en) * | 2011-09-09 | 2015-01-06 | Disney Enterprises, Inc. | Systems and methods for converting video |
| US9047688B2 (en) * | 2011-10-21 | 2015-06-02 | Here Global B.V. | Depth cursor and depth measurement in images |
-
2016
- 2016-12-16 CN CN201611165389.0A patent/CN106713891B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101000461A (en) * | 2006-12-14 | 2007-07-18 | 上海杰图软件技术有限公司 | Method for generating stereoscopic panorama by fish eye image |
| CN105245838A (en) * | 2015-09-29 | 2016-01-13 | 成都虚拟世界科技有限公司 | Panoramic video playing method and player |
| CN105898344A (en) * | 2016-04-12 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and device for playing panoramic video |
| CN105959675A (en) * | 2016-05-25 | 2016-09-21 | 腾讯科技（深圳）有限公司 | Video data processing method and device |
| CN106131540A (en) * | 2016-07-29 | 2016-11-16 | 暴风集团股份有限公司 | Method and system based on D3D playing panoramic video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106713891A (en) | 2017-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106131540B (en) | Method and system based on D3D playing panoramic videos | |
| CN106713891B (en) | The method and system of cube panoramic video are played based on D3D interfaces | |
| US8970624B2 (en) | Entertainment device, system, and method | |
| US9584766B2 (en) | Integrated interactive space | |
| US10739936B2 (en) | Zero parallax drawing within a three dimensional display | |
| US8542250B2 (en) | Entertainment device, system, and method | |
| US8520901B2 (en) | Image generation system, image generation method, and information storage medium | |
| US20110306413A1 (en) | Entertainment device and entertainment methods | |
| US20040113885A1 (en) | New input devices for augmented reality applications | |
| US20170195664A1 (en) | Three-dimensional viewing angle selecting method and apparatus | |
| CN106791906B (en) | Multi-user network live broadcast method and device and electronic equipment thereof | |
| US9703400B2 (en) | Virtual plane in a stylus based stereoscopic display system | |
| US11430192B2 (en) | Placement and manipulation of objects in augmented reality environment | |
| GB2501929A (en) | Augmented reality game apparatus | |
| US11957995B2 (en) | Toy system for augmented reality | |
| CN108282694B (en) | Panoramic video rendering method and device and electronic equipment | |
| CN106447788B (en) | Method and device for indicating viewing angle | |
| US20190362559A1 (en) | Augmented reality method for displaying virtual object and terminal device therefor | |
| US10321126B2 (en) | User input device camera | |
| JP2021034885A (en) | Image generation device, image display device, and image processing method | |
| US20240070973A1 (en) | Augmented reality wall with combined viewer and camera tracking | |
| CN109949396A (en) | A kind of rendering method, device, equipment and medium | |
| WO2019241712A1 (en) | Augmented reality wall with combined viewer and camera tracking | |
| CN111149356A (en) | Method for projecting immersive audiovisual content | |
| JPH0955959A (en) | Picture display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20190705 Granted publication date: 20180810 |