CN106454314A - Panoramic video decoding method and device - Google Patents
Panoramic video decoding method and device Download PDFInfo
- Publication number
- CN106454314A CN106454314A CN201610927275.9A CN201610927275A CN106454314A CN 106454314 A CN106454314 A CN 106454314A CN 201610927275 A CN201610927275 A CN 201610927275A CN 106454314 A CN106454314 A CN 106454314A
- Authority
- CN
- China
- Prior art keywords
- coordinate range
- present frame
- rotation
- panoramic video
- attitude
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/527—Global motion vector estimation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention relates to a panoramic video decoding method and device. The method comprises the following steps: determining a coordinate range of a user in watching a local region of a current frame of a panoramic video; carrying out decoding on the local region of the current frame according to the coordinate range to obtain decoded data corresponding to the current frame; and playing the current frame according to the coordinate range and the decoded data. The method is characterized by determining the coordinate range of the user in watching the local region of the current frame of the panoramic video; carrying out decoding on the local region of the current frame according to the coordinate range to obtain decoded data corresponding to the current frame; and playing the current frame according to the coordinate range and the decoded data; and the panoramic video decoding method and device can save decoding resources, help to improve decoding performance of the device and can reduce requirement for computing power of the device.
Description
Technical field
The present invention relates to video technique field, more particularly to a kind of panoramic video coding/decoding method and device.
Background technology
In correlation technique, when being decoded to panoramic video, decoding data whole to be decoded to panoramic video,
The corresponding decoding data of various pieces of panoramic video is obtained, further according to the local of the viewing visual angle playing panoramic video of user.
Due to only watching the local of panoramic video when user watches panoramic video, therefore the data whole to be decoded of panoramic video are carried out
Decoding can be caused to waste to decoding resource.
Content of the invention
Technical problem
In view of this, the technical problem to be solved in the present invention is, panoramic video decoding technique causes to waste to decoding resource.
Solution
In order to solve above-mentioned technical problem, according to one embodiment of the invention, there is provided a kind of panoramic video coding/decoding method,
Including：
Determine the coordinate range of the regional area of the present frame of user's viewing panoramic video；
According to the coordinate range, the regional area of the present frame is decoded, obtains the corresponding solution of the present frame
Code data；
The present frame is played according to the coordinate range and the decoding data.
For said method, in a kind of possible implementation, according to office of the coordinate range to the present frame
Portion region is decoded, and obtains the corresponding decoding data of the present frame, including：
All pixels in coordinate range described in the present frame are decoded, and to sitting described in the present frame
Mark extraneous all pixels to be filled with processing, obtain the corresponding decoding data of the present frame.
For said method, in a kind of possible implementation, to coordinate range described in the present frame outside institute
Pixel is had to be filled with processing, including：
All pixels outside to coordinate range described in the present frame are filled with 0.
For said method, in a kind of possible implementation, the office of the present frame of user's viewing panoramic video is determined
The coordinate range in portion region, including：
Obtain current pose and the initial attitude of terminal unit；
Direction of rotation and the anglec of rotation of the terminal unit is determined according to the current pose and the initial attitude；
The user is determined according to the corresponding coordinate range of the initial attitude, the direction of rotation and the anglec of rotation
Watch the coordinate range of the regional area of the present frame.
For said method, in a kind of possible implementation, the office of the present frame of user's viewing panoramic video is determined
The coordinate range in portion region, including：
Obtain the current pose of terminal unit and a upper attitude；
Direction of rotation and the anglec of rotation of the terminal unit is determined according to the current pose and a upper attitude；
The user is determined according to the corresponding coordinate range of the upper attitude, the direction of rotation and the anglec of rotation
Watch the coordinate range of the regional area of the present frame.
In order to solve above-mentioned technical problem, according to another embodiment of the present invention, there is provided a kind of panoramic video decoding dress
Put, including：
Coordinate range determining module, for determining the coordinate model of the regional area of the present frame of user's viewing panoramic video
Enclose；
Decoder module, for being decoded to the regional area of the present frame according to the coordinate range, obtains described
The corresponding decoding data of present frame；
Playing module, for playing the present frame according to the coordinate range and the decoding data.
For said apparatus, in a kind of possible implementation, the decoder module is used for：
All pixels in coordinate range described in the present frame are decoded, and to sitting described in the present frame
Mark extraneous all pixels to be filled with processing, obtain the corresponding decoding data of the present frame.
For said apparatus, in a kind of possible implementation, the decoder module is used for：
All pixels outside to coordinate range described in the present frame are filled with 0.
For said apparatus, in a kind of possible implementation, the coordinate range determining module includes：
First attitude acquisition submodule, for obtaining current pose and the initial attitude of terminal unit；
First direction of rotation and angle-determining submodule, for determining according to the current pose and the initial attitude
The direction of rotation of the terminal unit and the anglec of rotation；
First coordinate range determination sub-module, for according to the corresponding coordinate range of the initial attitude, the rotation side
Determine that the user watches the coordinate range of the regional area of the present frame to the anglec of rotation.
For said apparatus, in a kind of possible implementation, the coordinate range determining module includes：
Second attitude acquisition submodule, for the current pose for obtaining terminal unit and a upper attitude；
Second direction of rotation and angle-determining submodule, for determining according to the current pose and a upper attitude
The direction of rotation of the terminal unit and the anglec of rotation；
Second coordinate range determination sub-module, for according to the corresponding coordinate range of the upper attitude, the rotation side
Determine that the user watches the coordinate range of the regional area of the present frame to the anglec of rotation.
Beneficial effect
The coordinate range of the regional area of the present frame of panoramic video is watched by determining user, according to the coordinate range pair
The regional area of present frame is decoded, and obtains the corresponding decoding data of present frame, and according to the coordinate range and solution yardage
According to present frame is played, panoramic video coding/decoding method according to embodiments of the present invention and device can be saved decoding resource, contribute to
The decoding performance of raising equipment, can reduce the requirement of the computing capability to equipment.
According to below with reference to the accompanying drawings to detailed description of illustrative embodiments, the further feature of the present invention and aspect will become
Clear.
Description of the drawings
Comprising in the description and the accompanying drawing of the part that constitutes description together illustrates the present invention's with description
Exemplary embodiment, feature and aspect, and for explaining the principle of the present invention.
The flow chart that Fig. 1 illustrates panoramic video coding/decoding method according to an embodiment of the invention；
Fig. 2 illustrates an exemplary flow process of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Figure；
Fig. 3 illustrates the stream of the another exemplary of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Cheng Tu；
Fig. 4 illustrates the structured flowchart of panoramic video decoding apparatus according to another embodiment of the present invention；
Fig. 5 illustrates an exemplary structured flowchart of panoramic video decoding apparatus according to another embodiment of the present invention；
Fig. 6 shows a kind of structured flowchart of panoramic video decoding device of an alternative embodiment of the invention.
Specific embodiment
Various exemplary embodiments, feature and the aspect of the present invention are described in detail below with reference to accompanying drawing.Identical in accompanying drawing
Reference represent the same or analogous element of function.The various aspects of embodiment are although shown in the drawings, but are removed
Non-specifically is pointed out, it is not necessary to accompanying drawing drawn to scale.
Special word " exemplary " means " as example, embodiment or illustrative " here.Here as " exemplary "
Illustrated any embodiment is should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, in order to better illustrate the present invention, giving numerous details in specific embodiment below.
It will be appreciated by those skilled in the art that without some details, the present invention can equally be implemented.In some instances, for
Method well known to those skilled in the art, means, element and circuit are not described in detail, in order to highlight the purport of the present invention.
Embodiment 1
The flow chart that Fig. 1 illustrates panoramic video coding/decoding method according to an embodiment of the invention.The execution master of the present embodiment
Body can be mobile phone, panel computer, notebook computer or PC (Personal Computer, PC) etc., and here is not made
Limit.As shown in figure 1, the method mainly includes：
In step s 11, determine the coordinate range of the regional area of the present frame of user's viewing panoramic video.
Wherein, panoramic video can exceed the video of the normal viewing angle of user for visual angle.For example, panoramic video can be water
360 degree of angle, the video of vertical angle of view 180 degree is looked squarely, in this case, each frame of panoramic video may map to a sphere
On.Visual angle due to panoramic video exceedes the normal viewing angle of user, and therefore, user is when each frame of panoramic video is watched, every
The secondary regional area that can only see each frame.For example, user is watching panorama by the handheld device such as mobile phone or panel computer
During video, panoramic video, Huo Zheke can be watched by rotating mobile phone or each visual angle of panel computer unrestricted choice
To watch panoramic video by each visual angle of the virtual key unrestricted choice on mobile phone or panel computer.Again for example, Yong Hu
During panoramic video being watched by terminal units such as notebook computer or PC, can pass through on notebook computer or PC
Physical button or each visual angle of virtual key unrestricted choice viewing panoramic video.
In the present embodiment, before the present frame to panoramic video is decoded, determine user's viewing panoramic video
The coordinate range of the regional area of present frame.Wherein, the present frame of panoramic video can be the frame that will play of panoramic video.
In the present embodiment, the changing coordinates scope of user's viewing panoramic video can be defined as the current of user's viewing panoramic video
The coordinate range of the regional area of frame.For example, during user's viewing panoramic video, shown working as can be determined in real time
Front coordinate range, so as to determine the regional area of the present frame of user's viewing panoramic video according to shown changing coordinates scope
Coordinate range.
In step s 12, according to the coordinate range, the regional area of present frame is decoded, obtains present frame corresponding
Decoding data.
As an example of the present embodiment, only all pixels in the coordinate range can be decoded, be worked as
The corresponding decoding data of previous frame such that it is able to farthest save decoding resource and improve the decoding performance of equipment.
Another example as the present embodiment, it may be determined that the geometric center of the coordinate range, by the geometric center left side
90 degree of LOOK RIGHT, the coordinate range of 90 degree of upper downwards angle of visibility are defined as the first coordinate range, and to all in the first coordinate range
Pixel is decoded, and obtains the corresponding decoding data of present frame.
As another example of the present embodiment, the regional area of the present frame of panoramic video can be watched according to user
Coordinate range determines the second coordinate range, and wherein, the second coordinate range includes the local of the present frame of user's viewing panoramic video
The coordinate range in region, and the second coordinate range is more than the coordinate model of the regional area of the present frame of user's viewing panoramic video
Enclose.Wherein, the second coordinate range can be slightly larger than the coordinate range of the regional area of the present frame of user's viewing panoramic video, example
Such as, the second coordinate range can be the 1.3 of the area of the coordinate range of the regional area of the present frame of user's viewing panoramic video
Times.According to the example can not only save decoding resource, improve equipment decoding performance, moreover it is possible to user change viewing visual angle and
In the case that viewing visual angle after change still corresponds to the second coordinate range, normal play present frame.
In step s 13, present frame is played according to the coordinate range and decoding data.
In the present embodiment, according to the coordinate range, decoding data is mapped, is rendered on screen.
Panoramic video coding/decoding method according to embodiments of the present invention can save decoding resource, be favorably improved the solution of equipment
Code performance, can reduce the requirement of the computing capability to equipment.For example, if being only decoded to the pixel of half in every frame,
One times of amount of calculation can be reduced, the decoding resource of half is saved, lift one times of decoding performance.
In a kind of possible implementation, according to the coordinate range, the regional area of present frame is decoded, obtains
The corresponding decoding data of present frame, including：All pixels in the coordinate range in present frame are decoded, and to present frame
In all pixels outside the coordinate range be filled with processing, obtain the corresponding decoding data of present frame.
In a kind of possible implementation, to the coordinate range in present frame outside all pixels be filled with process,
Including：All pixels outside to the coordinate range in present frame are filled with 0.For example, outside for the coordinate range in present frame
All pixels, are filled with 0x00000000.
Fig. 2 illustrates an exemplary flow process of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Figure.As shown in Fig. 2 determine the coordinate range of the regional area of the present frame of user's viewing panoramic video, including：
In the step s 21, current pose and the initial attitude of terminal unit are obtained.
In this example, can be obtained by gyroscope or other motion sensors when the panoramic video is commenced play out
The initial attitude of terminal unit is taken, and records the initial attitude of terminal unit.During user's viewing panoramic video, may be used also
To obtain the current pose of terminal unit in real time by gyroscope or other motion sensors.For example, terminal unit is current
Attitude can be the currency of gyroscope, and the initial attitude of terminal unit can be the initial value of gyroscope.
Direction of rotation and the anglec of rotation of terminal unit in step S22, is determined according to current pose and initial attitude.
According to current pose and the initial attitude of terminal unit, for example, according to currency and the initial value of gyroscope, permissible
The direction of rotation of computing terminal equipment and the anglec of rotation.
In step S23, determine that user watches according to the corresponding coordinate range of initial attitude, direction of rotation and the anglec of rotation
The coordinate range of the regional area of present frame.
Fig. 3 illustrates the stream of the another exemplary of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Cheng Tu.As shown in figure 3, determine the coordinate range of the regional area of the present frame of user's viewing panoramic video, including：
In step S31, the current pose of terminal unit and a upper attitude is obtained.
In this example, can be during user's viewing panoramic video, in real time by gyroscope or other motions
Sensor obtains the current pose of terminal unit.For example, the current pose of terminal unit can be the currency of gyroscope, terminal
A upper attitude of equipment can be upper one value of gyroscope.
In step s 32, direction of rotation and the anglec of rotation of terminal unit is determined according to current pose and a upper attitude.
According to current pose and a upper attitude of terminal unit, for example, according to currency and a upper value of gyroscope, permissible
The direction of rotation of computing terminal equipment and the anglec of rotation.
In step S33, determine that user watches according to the corresponding coordinate range of a upper attitude, direction of rotation and the anglec of rotation
The coordinate range of the regional area of present frame.
So, by determining user, the coordinate range of the regional area of the present frame of panoramic video is watched, according to the coordinate
Scope is decoded to the regional area of present frame, obtains the corresponding decoding data of present frame, and according to the coordinate range and
Decoding data plays present frame, and panoramic video coding/decoding method according to embodiments of the present invention can be saved decoding resource, contribute to
The decoding performance of raising equipment, can reduce the requirement of the computing capability to equipment.
Embodiment 2
Fig. 4 illustrates the structured flowchart of panoramic video decoding apparatus according to another embodiment of the present invention.Fig. 4 can be used for fortune
Panoramic video coding/decoding method shown in row Fig. 1.For convenience of description, part related to the present embodiment illustrate only in the diagram.
As shown in figure 4, the panoramic video decoding apparatus include：Coordinate range determining module 41, for determining user's viewing
The coordinate range of the regional area of the present frame of panoramic video；Decoder module 42, for working as to described according to the coordinate range
The regional area of previous frame is decoded, and obtains the corresponding decoding data of the present frame；Playing module 43, for according to the seat
Mark scope and the decoding data play the present frame.
Fig. 5 illustrates an exemplary structured flowchart of panoramic video decoding apparatus according to another embodiment of the present invention.Fig. 5
Can be used for running the panoramic video coding/decoding method shown in Fig. 1 to Fig. 3.For convenience of description, illustrate only and this reality in Figure 5
Apply the part of example correlation.In Fig. 5, label has identical function with Fig. 4 identical component, for simplicity's sake, omits to these groups
The detailed description of part.With reference to Fig. 5：
In a kind of possible implementation, the decoder module 42 is used for：To coordinate range described in the present frame
Interior all pixels are decoded, and to coordinate range described in the present frame outside all pixels be filled with process, obtain
To the corresponding decoding data of the present frame.
In a kind of possible implementation, the decoder module 42 is used for：To coordinate range described in the present frame
Outer all pixels are filled with 0.
In a kind of possible implementation, the coordinate range determining module 41 includes：First attitude acquisition submodule
411, for obtaining current pose and the initial attitude of terminal unit；First direction of rotation and angle-determining submodule 412, use
In the direction of rotation and the anglec of rotation that determine the terminal unit according to the current pose and the initial attitude；First sits
Mark range determination submodule 413, for according to the corresponding coordinate range of the initial attitude, the direction of rotation and the rotation
User described in angle-determining watches the coordinate range of the regional area of the present frame.
In a kind of possible implementation, the coordinate range determining module 41 includes：Second attitude acquisition submodule
414, for the current pose for obtaining terminal unit and a upper attitude；Second direction of rotation and angle-determining submodule 415, use
In the direction of rotation and the anglec of rotation that determine the terminal unit according to the current pose and a upper attitude；Second sits
Mark range determination submodule 416, for according to the corresponding coordinate range of the upper attitude, the direction of rotation and the rotation
User described in angle-determining watches the coordinate range of the regional area of the present frame.
It should be noted that so, by determining user, the coordinate model of the regional area of the present frame of panoramic video is watched
Enclose, according to the coordinate range, the regional area of present frame is decoded, the corresponding decoding data of present frame is obtained, and according to this
Coordinate range and decoding data play present frame, and panoramic video decoding apparatus according to embodiments of the present invention can save decoding
Resource, is favorably improved the decoding performance of equipment, can reduce the requirement of the computing capability to equipment.
Embodiment 3
Fig. 6 shows a kind of structured flowchart of panoramic video decoding device of an alternative embodiment of the invention.Described complete
Scape video decoding apparatus 1100 can be possess the host server of computing capability, personal computer PC or portable just
Take formula computer or terminal etc..The specific embodiment of the invention is not limited to implementing for calculate node.
The panoramic video decoding device 1100 includes processor (processor) 1110, communication interface
(Communications Interface) 1120, memorizer (memory) 1130 and bus 1140.Wherein, processor 1110,
Communication interface 1120 and memorizer 1130 complete mutual communication by bus 1140.
Communication interface 1120 is used for and network device communications, and wherein the network equipment includes such as Virtual Machine Manager center, is total to
Enjoy storage etc..
Processor 1110 is used for configuration processor.Processor 1110 is probably a central processor CPU, or special collection
Become circuit ASIC (Application Specific Integrated Circuit), or be arranged to implement the present invention
One or more integrated circuits of embodiment.
Memorizer 1130 is used for depositing file.Memorizer 1130 may include high-speed RAM memorizer, it is also possible to also include non-
Volatile memory (non-volatile memory), for example, at least one disk memory.Memorizer 1130 can also be deposited
Memory array.Memorizer 1130 is also possible to by piecemeal, and described piece can be combined into virtual volume by certain rule.
In a kind of possible embodiment, said procedure can be the program code for including computer-managed instruction.The journey
Sequence is particularly used in：Realize the operation of each step in embodiment 1.
Those of ordinary skill in the art are it is to be appreciated that each exemplary cell in embodiment described herein and algorithm
Step, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These functions are actually with hardware also
It is software form realizing, the application-specific depending on technical scheme and design constraint.Professional and technical personnel can be directed to
Specific application selects different methods to realize described function, but this realizes the model it is not considered that beyond the present invention
Enclose.
If realized using in the form of computer software the function and as independent production marketing or use when,
To a certain extent it is believed that all or part (part for for example prior art being contributed) of technical scheme is
Embody in form of a computer software product.The computer software product is generally stored inside the non-volatile of embodied on computer readable
In storage medium, use so that computer equipment (can be that personal computer, server or network set including some instructions
Standby etc.) execute all or part of step of various embodiments of the present invention method.And aforesaid storage medium include USB flash disk, portable hard drive,
Read only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic
Dish or CD etc. are various can be with the medium of store program codes.
The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, and any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by the scope of the claims.
Claims (10)
1. a kind of panoramic video coding/decoding method, it is characterised in that include：
Determine the coordinate range of the regional area of the present frame of user's viewing panoramic video；
According to the coordinate range, the regional area of the present frame is decoded, obtains the corresponding solution yardage of the present frame
According to；
The present frame is played according to the coordinate range and the decoding data.
2. method according to claim 1, it is characterised in that according to partial zones of the coordinate range to the present frame
Domain is decoded, and obtains the corresponding decoding data of the present frame, including：
All pixels in coordinate range described in the present frame are decoded, and to coordinate model described in the present frame
Enclose outer all pixels to be filled with processing, obtain the corresponding decoding data of the present frame.
3. method according to claim 2, it is characterised in that all pictures outside to coordinate range described in the present frame
Element is filled with processing, including：
All pixels outside to coordinate range described in the present frame are filled with 0.
4. method according to claim 1, it is characterised in that determine the partial zones of the present frame of user's viewing panoramic video
The coordinate range in domain, including：
Obtain current pose and the initial attitude of terminal unit；
Direction of rotation and the anglec of rotation of the terminal unit is determined according to the current pose and the initial attitude；
Determine that the user watches according to the corresponding coordinate range of the initial attitude, the direction of rotation and the anglec of rotation
The coordinate range of the regional area of the present frame.
5. method according to claim 1, it is characterised in that determine the partial zones of the present frame of user's viewing panoramic video
The coordinate range in domain, including：
Obtain the current pose of terminal unit and a upper attitude；
Direction of rotation and the anglec of rotation of the terminal unit is determined according to the current pose and a upper attitude；
Determine that the user watches according to the corresponding coordinate range of the upper attitude, the direction of rotation and the anglec of rotation
The coordinate range of the regional area of the present frame.
6. a kind of panoramic video decoding apparatus, it is characterised in that include：
Coordinate range determining module, for determining the coordinate range of the regional area of the present frame of user's viewing panoramic video；
Decoder module, for being decoded to the regional area of the present frame according to the coordinate range, obtains described current
The corresponding decoding data of frame；
Playing module, for playing the present frame according to the coordinate range and the decoding data.
7. device according to claim 6, it is characterised in that the decoder module is used for：
All pixels in coordinate range described in the present frame are decoded, and to coordinate model described in the present frame
Enclose outer all pixels to be filled with processing, obtain the corresponding decoding data of the present frame.
8. device according to claim 7, it is characterised in that the decoder module is used for：
All pixels outside to coordinate range described in the present frame are filled with 0.
9. device according to claim 6, it is characterised in that the coordinate range determining module includes：
First attitude acquisition submodule, for obtaining current pose and the initial attitude of terminal unit；
First direction of rotation and angle-determining submodule, described in determining according to the current pose and the initial attitude
The direction of rotation of terminal unit and the anglec of rotation；
First coordinate range determination sub-module, for according to the corresponding coordinate range of the initial attitude, the direction of rotation and
The anglec of rotation determines that the user watches the coordinate range of the regional area of the present frame.
10. device according to claim 6, it is characterised in that the coordinate range determining module includes：
Second attitude acquisition submodule, for the current pose for obtaining terminal unit and a upper attitude；
Second direction of rotation and angle-determining submodule, described in determining according to the current pose and a upper attitude
The direction of rotation of terminal unit and the anglec of rotation；
Second coordinate range determination sub-module, for according to the corresponding coordinate range of the upper attitude, the direction of rotation and
The anglec of rotation determines that the user watches the coordinate range of the regional area of the present frame.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610927275.9A CN106454314A (en) | 2016-10-24 | 2016-10-24 | Panoramic video decoding method and device |
| CN201910237726.XA CN109922342A (en) | 2016-10-24 | 2016-10-24 | Panoramic video coding/decoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610927275.9A CN106454314A (en) | 2016-10-24 | 2016-10-24 | Panoramic video decoding method and device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910237726.XA Division CN109922342A (en) | 2016-10-24 | 2016-10-24 | Panoramic video coding/decoding method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106454314A true CN106454314A (en) | 2017-02-22 |
Family
ID=58177297
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910237726.XA Pending CN109922342A (en) | 2016-10-24 | 2016-10-24 | Panoramic video coding/decoding method and device |
| CN201610927275.9A Pending CN106454314A (en) | 2016-10-24 | 2016-10-24 | Panoramic video decoding method and device |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910237726.XA Pending CN109922342A (en) | 2016-10-24 | 2016-10-24 | Panoramic video coding/decoding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN109922342A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107484004A (en) * | 2017-07-24 | 2017-12-15 | 北京奇艺世纪科技有限公司 | A kind of method for processing video frequency and device |
| CN114666603A (en) * | 2022-05-06 | 2022-06-24 | 厦门美图之家科技有限公司 | Video decoding method and device, electronic equipment and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110267026A (en) * | 2019-07-05 | 2019-09-20 | 浙江开奇科技有限公司 | Data processing method, mobile terminal and system based on 5G network |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110069147A1 (en) * | 2009-09-18 | 2011-03-24 | Hon Hai Precision Industry Co., Ltd. | Panoramic camera, and system and method for monitoring target places using the panoramic camera |
| CN103294358A (en) * | 2013-05-17 | 2013-09-11 | 北京小米科技有限责任公司 | Method, device and equipment for controlling screen to rotate |
| CN104580967A (en) * | 2013-10-24 | 2015-04-29 | ***通信集团公司 | Map projection method based on portable projector, and device for projection |
| CN105791882A (en) * | 2016-03-22 | 2016-07-20 | 腾讯科技（深圳）有限公司 | Video coding method and device |
| CN105847850A (en) * | 2016-03-28 | 2016-08-10 | 乐视控股（北京）有限公司 | Panorama video real time playing method and apparatus |
| CN105872467A (en) * | 2016-04-14 | 2016-08-17 | 普宙飞行器科技（深圳）有限公司 | Real-time panoramic audio-video wireless sharing method and real-time panoramic audio-video wireless sharing platform based on unmanned aerial vehicle |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104735464A (en) * | 2015-03-31 | 2015-06-24 | 华为技术有限公司 | Panorama video interactive transmission method, server and client end |
| CN105898344A (en) * | 2016-04-12 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and device for playing panoramic video |
-
2016
- 2016-10-24 CN CN201910237726.XA patent/CN109922342A/en active Pending
- 2016-10-24 CN CN201610927275.9A patent/CN106454314A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110069147A1 (en) * | 2009-09-18 | 2011-03-24 | Hon Hai Precision Industry Co., Ltd. | Panoramic camera, and system and method for monitoring target places using the panoramic camera |
| CN103294358A (en) * | 2013-05-17 | 2013-09-11 | 北京小米科技有限责任公司 | Method, device and equipment for controlling screen to rotate |
| CN104580967A (en) * | 2013-10-24 | 2015-04-29 | ***通信集团公司 | Map projection method based on portable projector, and device for projection |
| CN105791882A (en) * | 2016-03-22 | 2016-07-20 | 腾讯科技（深圳）有限公司 | Video coding method and device |
| CN105847850A (en) * | 2016-03-28 | 2016-08-10 | 乐视控股（北京）有限公司 | Panorama video real time playing method and apparatus |
| CN105872467A (en) * | 2016-04-14 | 2016-08-17 | 普宙飞行器科技（深圳）有限公司 | Real-time panoramic audio-video wireless sharing method and real-time panoramic audio-video wireless sharing platform based on unmanned aerial vehicle |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107484004A (en) * | 2017-07-24 | 2017-12-15 | 北京奇艺世纪科技有限公司 | A kind of method for processing video frequency and device |
| CN107484004B (en) * | 2017-07-24 | 2020-01-03 | 北京奇艺世纪科技有限公司 | Video processing method and device |
| CN114666603A (en) * | 2022-05-06 | 2022-06-24 | 厦门美图之家科技有限公司 | Video decoding method and device, electronic equipment and storage medium |
| CN114666603B (en) * | 2022-05-06 | 2024-05-03 | 厦门美图之家科技有限公司 | Video decoding method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109922342A (en) | 2019-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107018336B (en) | The method and apparatus of method and apparatus and the video processing of image procossing | |
| EP2029248B1 (en) | Control of data processing using cumulative inter-frame motion | |
| CN108227916A (en) | For determining the method and apparatus of the point of interest in immersion content | |
| EP3913924B1 (en) | 360-degree panoramic video playing method, apparatus, and system | |
| CN104870063A (en) | Systems and methods for cloud processing and overlaying of content on streaming video frames of remotely processed applications | |
| CN108282648A (en) | A kind of VR rendering intents, device, Wearable and readable storage medium storing program for executing | |
| CN106598404A (en) | Window display method and mobile terminal | |
| CN112288665A (en) | Image fusion method and device, storage medium and electronic equipment | |
| CN106454314A (en) | Panoramic video decoding method and device | |
| CN112135161A (en) | Dynamic effect display method and device of virtual gift, storage medium and electronic equipment | |
| CN106170094A (en) | The live broadcasting method of panoramic video and device | |
| CN107945101A (en) | Image processing method and device | |
| CN103533286A (en) | Methods and systems with static time frame interpolation exclusion area | |
| CN108063946A (en) | Method for encoding images and device, storage medium and electronic device | |
| CN106797398A (en) | Method and system for providing from virtual desktop serve to client | |
| CN106131535A (en) | Video capture method and device, video generation method and device | |
| CN109448050A (en) | A kind of method for determining position and terminal of target point | |
| CN106791346B (en) | A kind of method and device of image prediction | |
| CN106331879A (en) | Screen comment display method and device based on panoramic video | |
| CN111462339A (en) | Display method and device in augmented reality, medium and electronic equipment | |
| US9489771B2 (en) | Techniques for spatially sorting graphics information | |
| CN110267079B (en) | Method and device for replacing human face in video to be played | |
| CN106293078A (en) | Virtual reality exchange method based on photographic head and device | |
| CN108235138A (en) | Method, processing unit and its computer system of preview video | |
| CN115393487B (en) | Virtual character model processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170222 |
|
| RJ01 | Rejection of invention patent application after publication |