CN109922342A - Panoramic video coding/decoding method and device - Google Patents
Panoramic video coding/decoding method and device Download PDFInfo
- Publication number
- CN109922342A CN109922342A CN201910237726.XA CN201910237726A CN109922342A CN 109922342 A CN109922342 A CN 109922342A CN 201910237726 A CN201910237726 A CN 201910237726A CN 109922342 A CN109922342 A CN 109922342A
- Authority
- CN
- China
- Prior art keywords
- coordinate range
- present frame
- panoramic video
- rotation
- terminal device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/527—Global motion vector estimation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention relates to panoramic video coding/decoding method and devices.This method comprises: determining that user watches the coordinate range of the regional area of the present frame of panoramic video;It is decoded according to regional area of the coordinate range to the present frame, obtains the corresponding decoding data of the present frame;The present frame is played according to the coordinate range and the decoding data.By determining that user watches the coordinate range of the regional area of the present frame of panoramic video, it is decoded according to regional area of the coordinate range to present frame, obtain the corresponding decoding data of present frame, and present frame is played according to the coordinate range and decoding data, panoramic video coding/decoding method and device according to the present invention can save decoding resource, the decoding performance for helping to improve equipment can reduce the requirement to the computing capability of equipment.
Description
The application be on October 24th, 2016 applying date, application No. is 201610927275.9, invention and created names to be
The divisional application of the application of panoramic video coding/decoding method and device.
Technical field
The present invention relates to video technique field more particularly to a kind of panoramic video coding/decoding methods and device.
Background technique
In the related technology, when being decoded to panoramic video, the whole of panoramic video data to be decoded are decoded,
The corresponding decoding data of various pieces of panoramic video is obtained, further according to the part of the viewing visual angle playing panoramic video of user.
Due to only watching the part of panoramic video when user watches panoramic video, the whole of panoramic video data to be decoded are carried out
Decoding can cause to waste to decoding resource.
Summary of the invention
Technical problem
In view of this, the technical problem to be solved by the present invention is to panoramic video decoding technique causes to waste to decoding resource.
Solution
In order to solve the above-mentioned technical problem, an embodiment according to the present invention provides a kind of panoramic video coding/decoding method,
Include:
Determine that user watches the coordinate range of the regional area of the present frame of panoramic video;
It is decoded according to regional area of the coordinate range to the present frame, obtains the corresponding solution of the present frame
Code data;
The present frame is played according to the coordinate range and the decoding data.
For the above method, in one possible implementation, according to the coordinate range to the office of the present frame
Portion region is decoded, and obtains the corresponding decoding data of the present frame, comprising:
All pixels in coordinate range described in the present frame are decoded, and are sat to described in the present frame
All pixels outside mark range are filled processing, obtain the corresponding decoding data of the present frame.
For the above method, in one possible implementation, to coordinate range described in the present frame outside institute
There is pixel to be filled processing, comprising:
To 0 filling of all pixels outside coordinate range described in the present frame.
For the above method, in one possible implementation, determine that user watches the office of the present frame of panoramic video
The coordinate range in portion region, comprising:
Obtain the current pose and initial attitude of terminal device;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and the initial attitude;
The user is determined according to the corresponding coordinate range of the initial attitude, the direction of rotation and the rotation angle
Watch the coordinate range of the regional area of the present frame.
For the above method, in one possible implementation, determine that user watches the office of the present frame of panoramic video
The coordinate range in portion region, comprising:
The current pose of acquisition terminal device and a upper posture;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and a upper posture;
The user is determined according to the corresponding coordinate range of the upper posture, the direction of rotation and the rotation angle
Watch the coordinate range of the regional area of the present frame.
In order to solve the above-mentioned technical problem, according to another embodiment of the present invention, a kind of panoramic video decoding dress is provided
It sets, comprising:
Coordinate range determining module, for determining that user watches the coordinate model of the regional area of the present frame of panoramic video
It encloses;
Decoder module obtains described for being decoded according to regional area of the coordinate range to the present frame
The corresponding decoding data of present frame;
Playing module, for playing the present frame according to the coordinate range and the decoding data.
For above-mentioned apparatus, in one possible implementation, the decoder module is used for:
All pixels in coordinate range described in the present frame are decoded, and are sat to described in the present frame
All pixels outside mark range are filled processing, obtain the corresponding decoding data of the present frame.
For above-mentioned apparatus, in one possible implementation, the decoder module is used for:
To 0 filling of all pixels outside coordinate range described in the present frame.
For above-mentioned apparatus, in one possible implementation, the coordinate range determining module includes:
First posture acquisition submodule, for obtaining the current pose and initial attitude of terminal device;
First direction of rotation and angle determine submodule, for being determined according to the current pose and the initial attitude
The direction of rotation of the terminal device and rotation angle;
First coordinate range determines submodule, for according to the corresponding coordinate range of the initial attitude, the rotation side
Determine that the user watches the coordinate range of the regional area of the present frame to the rotation angle.
For above-mentioned apparatus, in one possible implementation, the coordinate range determining module includes:
Second posture acquisition submodule, for obtain terminal device current pose and a upper posture;
Second direction of rotation and angle determine submodule, for being determined according to the current pose and a upper posture
The direction of rotation of the terminal device and rotation angle;
Second coordinate range determines submodule, for according to the corresponding coordinate range of the upper posture, the rotation side
Determine that the user watches the coordinate range of the regional area of the present frame to the rotation angle.
Beneficial effect
By determining that user watches the coordinate range of the regional area of the present frame of panoramic video, according to the coordinate range pair
The regional area of present frame is decoded, and obtains the corresponding decoding data of present frame, and according to the coordinate range and solution yardage
According to present frame is played, panoramic video coding/decoding method and device according to an embodiment of the present invention can save decoding resource, facilitate
The decoding performance for improving equipment, can reduce the requirement to the computing capability of equipment.
According to below with reference to the accompanying drawings becoming to detailed description of illustrative embodiments, other feature of the invention and aspect
It is clear.
Detailed description of the invention
Comprising in the description and constitute the attached drawing of part of specification and specification together illustrate it is of the invention
Exemplary embodiment, feature and aspect, and principle for explaining the present invention.
Fig. 1 shows the flow chart of panoramic video coding/decoding method according to an embodiment of the invention;
Fig. 2 shows an illustrative processes of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Figure;
Fig. 3 shows the stream of the another exemplary of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Cheng Tu;
Fig. 4 shows the structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention;
Fig. 5 shows an illustrative structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention;
Fig. 6 shows a kind of structural block diagram of panoramic video decoding device of another embodiment of the invention.
Specific embodiment
Below with reference to attached drawing various exemplary embodiments, feature and the aspect that the present invention will be described in detail.It is identical in attached drawing
Appended drawing reference indicate element functionally identical or similar.Although the various aspects of embodiment are shown in the attached drawings, remove
It non-specifically points out, it is not necessary to attached drawing drawn to scale.
Dedicated word " exemplary " means " being used as example, embodiment or illustrative " herein.Here as " exemplary "
Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, in order to better illustrate the present invention, numerous details is given in specific embodiment below.
It will be appreciated by those skilled in the art that without certain details, the present invention equally be can be implemented.In some instances, for
Method, means, element and circuit well known to those skilled in the art are not described in detail, in order to highlight purport of the invention.
Embodiment 1
Fig. 1 shows the flow chart of panoramic video coding/decoding method according to an embodiment of the invention.The execution master of the present embodiment
Body can be mobile phone, tablet computer, laptop or PC (Personal Computer, PC) etc., not make herein
It limits.As shown in Figure 1, this method specifically includes that
In step s 11, determine that user watches the coordinate range of the regional area of the present frame of panoramic video.
Wherein, panoramic video can be more than the video of the normal viewing angle of user for visual angle.For example, panoramic video can be water
The video at 360 degree of angle, vertical angle of view 180 degree is looked squarely, in this case, each frame of panoramic video may map to a spherical surface
On.Since the visual angle of panoramic video is more than the normal viewing angle of user, user is when watching each frame of panoramic video, often
The secondary regional area that can only see each frame.For example, user is watching panorama by handheld devices such as mobile phone or tablet computers
During video, panoramic video, Huo Zheke can be watched by rotation mobile phone or each visual angle of tablet computer unrestricted choice
To watch panoramic video by each visual angle of virtual key unrestricted choice on mobile phone or tablet computer.For another example user exists
It perhaps can be by laptop or PC during the terminal devices such as PC watch panoramic video by laptop
Physical button or each visual angle of virtual key unrestricted choice watch panoramic video.
In the present embodiment, before the present frame to panoramic video is decoded, determine that user watches panoramic video
The coordinate range of the regional area of present frame.Wherein, the present frame of panoramic video can be the frame that will be played of panoramic video.
In the present embodiment, the changing coordinates range that user watches panoramic video can be determined as user and watches the current of panoramic video
The coordinate range of the regional area of frame.For example, can determine shown work as in real time during user watches panoramic video
Preceding coordinate range, to determine that user watches the regional area of the present frame of panoramic video according to shown changing coordinates range
Coordinate range.
In step s 12, it is decoded according to regional area of the coordinate range to present frame, it is corresponding to obtain present frame
Decoding data.
As an example of the present embodiment, only all pixels in the coordinate range can be decoded, worked as
The corresponding decoding data of previous frame, so as to farthest save decoding resource and improve the decoding performance of equipment.
As another example of the present embodiment, the geometric center of the coordinate range can be determined, by a geometric center left side
90 degree of LOOK RIGHT, 90 degree of upper downwards angle of visibility coordinate range be determined as the first coordinate range, and to all in the first coordinate range
Pixel is decoded, and obtains the corresponding decoding data of present frame.
As another example of the present embodiment, the regional area of the present frame of panoramic video can be watched according to user
Coordinate range determines the second coordinate range, wherein the second coordinate range includes the part that user watches the present frame of panoramic video
The coordinate range in region, and the second coordinate range is greater than the coordinate model of the regional area of the present frame of user's viewing panoramic video
It encloses.Wherein, the second coordinate range can watch the coordinate range of the regional area of the present frame of panoramic video, example slightly larger than user
Such as, the second coordinate range can watch the 1.3 of the area of the coordinate range of the regional area of the present frame of panoramic video for user
Times.Can not only save according to the example decoding resource, improve equipment decoding performance, moreover it is possible to user change viewing visual angle and
In the case that viewing visual angle after change is still correspond to the second coordinate range, normal play present frame.
In step s 13, present frame is played according to the coordinate range and decoding data.
In the present embodiment, decoding data mapped according to the coordinate range, be rendered on screen.
Panoramic video coding/decoding method according to an embodiment of the present invention can save decoding resource, help to improve the solution of equipment
Code performance can reduce the requirement to the computing capability of equipment.For example, if being only decoded to the pixel of half in every frame,
The calculation amount that one times can be reduced saves the decoding resource of half, promotes one times of decoding performance.
In one possible implementation, it is decoded, is obtained according to regional area of the coordinate range to present frame
The corresponding decoding data of present frame, comprising: all pixels in present frame in the coordinate range are decoded, and to present frame
In all pixels outside the coordinate range be filled processing, obtain the corresponding decoding data of present frame.
In one possible implementation, processing is filled to all pixels in present frame outside the coordinate range,
It include: to 0 filling of all pixels in present frame outside the coordinate range.For example, in present frame outside the coordinate range
All pixels are filled with 0x00000000.
Fig. 2 shows an illustrative processes of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Figure.As shown in Fig. 2, determining that user watches the coordinate range of the regional area of the present frame of panoramic video, comprising:
In the step s 21, the current pose and initial attitude of terminal device are obtained.
In this example, it can be obtained when starting to play the panoramic video by gyroscope or other motion sensors
The initial attitude of terminal device is taken, and records the initial attitude of terminal device.During user watches panoramic video, may be used also
The current pose of terminal device is obtained to pass through gyroscope or other motion sensors in real time.For example, terminal device is current
Posture can be the current value of gyroscope, and the initial attitude of terminal device can be the initial value of gyroscope.
In step S22, direction of rotation and the rotation angle of terminal device are determined according to current pose and initial attitude.
It, can be with for example, according to the current value and initial value of gyroscope according to the current pose and initial attitude of terminal device
The direction of rotation of computing terminal equipment and rotation angle.
In step S23, determine that user watches according to the corresponding coordinate range of initial attitude, direction of rotation and rotation angle
The coordinate range of the regional area of present frame.
Fig. 3 shows the stream of the another exemplary of step S11 in panoramic video coding/decoding method according to an embodiment of the invention
Cheng Tu.As shown in figure 3, determining that user watches the coordinate range of the regional area of the present frame of panoramic video, comprising:
In step S31, obtain terminal device current pose and a upper posture.
In this example, gyroscope or other movements can be passed through in real time during user watches panoramic video
The current pose of sensor acquisition terminal device.For example, the current pose of terminal device can be the current value of gyroscope, terminal
A upper posture for equipment can be a upper value for gyroscope.
In step s 32, direction of rotation and the rotation angle of terminal device are determined according to current pose and a upper posture.
It, can be with for example, according to the current value of gyroscope and a upper value according to the current pose of terminal device and a upper posture
The direction of rotation of computing terminal equipment and rotation angle.
In step S33, determine that user watches according to the corresponding coordinate range of a upper posture, direction of rotation and rotation angle
The coordinate range of the regional area of present frame.
In this way, by determining that user watches the coordinate range of the regional area of the present frame of panoramic video, according to the coordinate
Range is decoded the regional area of present frame, obtains the corresponding decoding data of present frame, and according to the coordinate range and
Decoding data plays present frame, and panoramic video coding/decoding method according to an embodiment of the present invention can save decoding resource, facilitate
The decoding performance for improving equipment, can reduce the requirement to the computing capability of equipment.
Embodiment 2
Fig. 4 shows the structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention.Fig. 4 can be used for transporting
Row panoramic video coding/decoding method shown in FIG. 1.For ease of description, only the parts related to this embodiment are shown in Fig. 4.
As shown in figure 4, the panoramic video decoding apparatus includes: coordinate range determining module 41, for determining that user watches
The coordinate range of the regional area of the present frame of panoramic video;Decoder module 42, for being worked as according to the coordinate range to described
The regional area of previous frame is decoded, and obtains the corresponding decoding data of the present frame;Playing module 43, for according to the seat
It marks range and the decoding data plays the present frame.
Fig. 5 shows an illustrative structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention.Fig. 5
It can be used for running Fig. 1 to panoramic video coding/decoding method shown in Fig. 3.For ease of description, it is illustrated only and this reality in Fig. 5
Apply the relevant part of example.Label component function having the same identical with Fig. 4 in Fig. 5 is omitted to these groups for simplicity
The detailed description of part.Referring to Fig. 5:
In one possible implementation, the decoder module 42 is used for: to coordinate range described in the present frame
Interior all pixels are decoded, and are filled processing to all pixels outside coordinate range described in the present frame, are obtained
To the corresponding decoding data of the present frame.
In one possible implementation, the decoder module 42 is used for: to coordinate range described in the present frame
0 filling of outer all pixels.
In one possible implementation, the coordinate range determining module 41 includes: the first posture acquisition submodule
411, for obtaining the current pose and initial attitude of terminal device;First direction of rotation and angle determine submodule 412, use
In the direction of rotation and rotation angle that determine the terminal device according to the current pose and the initial attitude;First sits
Range determination submodule 413 is marked, for according to the corresponding coordinate range of the initial attitude, the direction of rotation and the rotation
Angle determines that the user watches the coordinate range of the regional area of the present frame.
In one possible implementation, the coordinate range determining module 41 includes: the second posture acquisition submodule
414, for obtain terminal device current pose and a upper posture;Second direction of rotation and angle determine submodule 415, use
In the direction of rotation and rotation angle that determine the terminal device according to the current pose and a upper posture;Second sits
Range determination submodule 416 is marked, for according to the corresponding coordinate range of the upper posture, the direction of rotation and the rotation
Angle determines that the user watches the coordinate range of the regional area of the present frame.
It should be noted that in this way, by determining that user watches the coordinate model of the regional area of the present frame of panoramic video
It encloses, is decoded according to regional area of the coordinate range to present frame, obtain the corresponding decoding data of present frame, and according to this
Coordinate range and decoding data play present frame, and panoramic video decoding apparatus according to an embodiment of the present invention can save decoding
Resource helps to improve the decoding performance of equipment, can reduce the requirement to the computing capability of equipment.
Embodiment 3
Fig. 6 shows a kind of structural block diagram of panoramic video decoding device of another embodiment of the invention.It is described complete
Scape video decoding apparatus 1100 can be the host server for having computing capability, personal computer PC or it is portable just
Take formula computer or terminal etc..The specific embodiment of the invention does not limit the specific implementation of calculate node.
The panoramic video decoding device 1100 includes processor (processor) 1110, communication interface
(Communications Interface) 1120, memory (memory) 1130 and bus 1140.Wherein, processor 1110,
Communication interface 1120 and memory 1130 pass through bus 1140 and complete mutual communication.
Communication interface 1120 is used for and network device communications, and wherein the network equipment includes such as Virtual Machine Manager center, is total to
Enjoy storage etc..
Processor 1110 is for executing program.Processor 1110 may be a central processor CPU or dedicated collection
At circuit ASIC (Application Specific Integrated Circuit), or it is arranged to implement the present invention
One or more integrated circuits of embodiment.
Memory 1130 is for storing file.Memory 1130 may include high speed RAM memory, it is also possible to further include non-
Volatile memory (non-volatile memory), for example, at least a magnetic disk storage.Memory 1130 is also possible to deposit
Memory array.Memory 1130 is also possible to by piecemeal, and described piece can be combined into virtual volume by certain rule.
In a kind of possible embodiment, above procedure can be the program code for including computer operation instruction.The journey
Sequence is particularly used in: realizing the operation of each step in embodiment 1.
Those of ordinary skill in the art may be aware that each exemplary cell and algorithm in embodiment described herein
Step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions actually with hardware also
It is software form to realize, the specific application and design constraint depending on technical solution.Professional technician can be directed to
It is specific that described function is realized using different methods is selected, but this realization is it is not considered that exceed model of the invention
It encloses.
If realizing the function and when sold or used as an independent product in the form of computer software,
To a certain extent it is believed that all or part (such as the part that contributes to existing technology) of technical solution of the present invention is
It embodies in form of a computer software product.The computer software product is generally stored inside computer-readable non-volatile
In storage medium, including some instructions are used so that computer equipment (can be personal computer, server or network to set
It is standby etc.) execute all or part of the steps of various embodiments of the present invention method.And storage medium above-mentioned include USB flash disk, mobile hard disk,
Read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic
The various media that can store program code such as dish or CD.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (6)
1. a kind of panoramic video coding/decoding method characterized by comprising
The changing coordinates range that user watches the panoramic video is determined as the part that user watches the present frame of panoramic video
The coordinate range in region;
Only all pixels in coordinate range described in the present frame are decoded, and to coordinate described in the present frame
0 filling of all pixels outside range, obtains the corresponding decoding data of the present frame, wherein not to institute in the present frame
The pixel stated outside coordinate range is decoded;
The present frame is played according to the coordinate range and the decoding data.
2. the method according to claim 1, wherein determining that user watches the partial zones of the present frame of panoramic video
The coordinate range in domain, comprising:
Obtain the current pose and initial attitude of terminal device;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and the initial attitude;
User's viewing is determined according to the corresponding coordinate range of the initial attitude, the direction of rotation and the rotation angle
The coordinate range of the regional area of the present frame.
3. the method according to claim 1, wherein determining that user watches the partial zones of the present frame of panoramic video
The coordinate range in domain, comprising:
The current pose of acquisition terminal device and a upper posture;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and a upper posture;
User's viewing is determined according to the corresponding coordinate range of the upper posture, the direction of rotation and the rotation angle
The coordinate range of the regional area of the present frame.
4. a kind of panoramic video decoding apparatus characterized by comprising
Coordinate range determining module, it is complete that the changing coordinates range for user to be watched to the panoramic video is determined as user's viewing
The coordinate range of the regional area of the present frame of scape video;
Decoder module for being only decoded to all pixels in coordinate range described in the present frame, and is worked as to described
0 filling of all pixels outside coordinate range described in previous frame, obtains the corresponding decoding data of the present frame, wherein not right
Pixel outside coordinate range described in the present frame is decoded;
Playing module, for playing the present frame according to the coordinate range and the decoding data.
5. device according to claim 4, which is characterized in that the coordinate range determining module includes:
First posture acquisition submodule, for obtaining the current pose and initial attitude of terminal device;
First direction of rotation and angle determine submodule, for according to the current pose and initial attitude determination
The direction of rotation of terminal device and rotation angle;
First coordinate range determines submodule, for according to the corresponding coordinate range of the initial attitude, the direction of rotation and
The rotation angle determines that the user watches the coordinate range of the regional area of the present frame.
6. device according to claim 4, which is characterized in that the coordinate range determining module includes:
Second posture acquisition submodule, for obtain terminal device current pose and a upper posture;
Second direction of rotation and angle determine submodule, for according to the current pose and the upper posture determination
The direction of rotation of terminal device and rotation angle;
Second coordinate range determines submodule, for according to the corresponding coordinate range of the upper posture, the direction of rotation and
The rotation angle determines that the user watches the coordinate range of the regional area of the present frame.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910237726.XA CN109922342A (en) | 2016-10-24 | 2016-10-24 | Panoramic video coding/decoding method and device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910237726.XA CN109922342A (en) | 2016-10-24 | 2016-10-24 | Panoramic video coding/decoding method and device |
CN201610927275.9A CN106454314A (en) | 2016-10-24 | 2016-10-24 | Panoramic video decoding method and device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610927275.9A Division CN106454314A (en) | 2016-10-24 | 2016-10-24 | Panoramic video decoding method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109922342A true CN109922342A (en) | 2019-06-21 |
Family
ID=58177297
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610927275.9A Pending CN106454314A (en) | 2016-10-24 | 2016-10-24 | Panoramic video decoding method and device |
CN201910237726.XA Pending CN109922342A (en) | 2016-10-24 | 2016-10-24 | Panoramic video coding/decoding method and device |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610927275.9A Pending CN106454314A (en) | 2016-10-24 | 2016-10-24 | Panoramic video decoding method and device |
Country Status (1)
Country | Link |
---|---|
CN (2) | CN106454314A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110267026A (en) * | 2019-07-05 | 2019-09-20 | 浙江开奇科技有限公司 | Data processing method, mobile terminal and system based on 5G network |
CN114666603A (en) * | 2022-05-06 | 2022-06-24 | 厦门美图之家科技有限公司 | Video decoding method and device, electronic equipment and storage medium |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107484004B (en) * | 2017-07-24 | 2020-01-03 | 北京奇艺世纪科技有限公司 | Video processing method and device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110069147A1 (en) * | 2009-09-18 | 2011-03-24 | Hon Hai Precision Industry Co., Ltd. | Panoramic camera, and system and method for monitoring target places using the panoramic camera |
CN104580967A (en) * | 2013-10-24 | 2015-04-29 | ***通信集团公司 | Map projection method based on portable projector, and device for projection |
CN104735464A (en) * | 2015-03-31 | 2015-06-24 | 华为技术有限公司 | Panorama video interactive transmission method, server and client end |
CN105791882A (en) * | 2016-03-22 | 2016-07-20 | 腾讯科技(深圳)有限公司 | Video coding method and device |
CN105898344A (en) * | 2016-04-12 | 2016-08-24 | 乐视控股(北京)有限公司 | Method and device for playing panoramic video |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103294358B (en) * | 2013-05-17 | 2016-12-28 | 小米科技有限责任公司 | A kind of control the method for screen rotation, device and equipment |
CN105847850A (en) * | 2016-03-28 | 2016-08-10 | 乐视控股(北京)有限公司 | Panorama video real time playing method and apparatus |
CN105872467A (en) * | 2016-04-14 | 2016-08-17 | 普宙飞行器科技(深圳)有限公司 | Real-time panoramic audio-video wireless sharing method and real-time panoramic audio-video wireless sharing platform based on unmanned aerial vehicle |
-
2016
- 2016-10-24 CN CN201610927275.9A patent/CN106454314A/en active Pending
- 2016-10-24 CN CN201910237726.XA patent/CN109922342A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110069147A1 (en) * | 2009-09-18 | 2011-03-24 | Hon Hai Precision Industry Co., Ltd. | Panoramic camera, and system and method for monitoring target places using the panoramic camera |
CN104580967A (en) * | 2013-10-24 | 2015-04-29 | ***通信集团公司 | Map projection method based on portable projector, and device for projection |
CN104735464A (en) * | 2015-03-31 | 2015-06-24 | 华为技术有限公司 | Panorama video interactive transmission method, server and client end |
CN105791882A (en) * | 2016-03-22 | 2016-07-20 | 腾讯科技(深圳)有限公司 | Video coding method and device |
CN105898344A (en) * | 2016-04-12 | 2016-08-24 | 乐视控股(北京)有限公司 | Method and device for playing panoramic video |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110267026A (en) * | 2019-07-05 | 2019-09-20 | 浙江开奇科技有限公司 | Data processing method, mobile terminal and system based on 5G network |
CN114666603A (en) * | 2022-05-06 | 2022-06-24 | 厦门美图之家科技有限公司 | Video decoding method and device, electronic equipment and storage medium |
CN114666603B (en) * | 2022-05-06 | 2024-05-03 | 厦门美图之家科技有限公司 | Video decoding method and device, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN106454314A (en) | 2017-02-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107018336B (en) | The method and apparatus of method and apparatus and the video processing of image procossing | |
US20170186219A1 (en) | Method for 360-degree panoramic display, display module and mobile terminal | |
EP2029248B1 (en) | Control of data processing using cumulative inter-frame motion | |
CN103414844B (en) | Video jitter modification method and device | |
CN109743892B (en) | Virtual reality content display method and device | |
CN110392251B (en) | Dynamic projection method and system based on virtual reality | |
CN108537721A (en) | Processing method, device and the electronic equipment of panoramic picture | |
CN104157007B (en) | The method and device of Video processing | |
CN108196669B (en) | Game role model correction method and device, processor and head-mounted display equipment | |
WO2016197469A1 (en) | Method and apparatus for generating unlocking interface, and electronic device | |
CN102411791B (en) | Method and equipment for changing static image into dynamic image | |
CN108668108B (en) | Video monitoring method and device and electronic equipment | |
CN112288665A (en) | Image fusion method and device, storage medium and electronic equipment | |
CN109922342A (en) | Panoramic video coding/decoding method and device | |
CN111583381B (en) | Game resource map rendering method and device and electronic equipment | |
JP2018530219A (en) | Method, apparatus and system for facilitating navigation in extended scenes | |
CN106997613A (en) | Generated according to the 3D models of 2D images | |
CN109448050A (en) | A kind of method for determining position and terminal of target point | |
CN108063946A (en) | Method for encoding images and device, storage medium and electronic device | |
CN111462339A (en) | Display method and device in augmented reality, medium and electronic equipment | |
CN116057577A (en) | Map for augmented reality | |
CN106791346B (en) | A kind of method and device of image prediction | |
CN108553895A (en) | User interface element and the associated method and apparatus of three-dimensional space model | |
CN106210859B (en) | Panoramic video rendering method and device | |
CN106293078A (en) | Virtual reality exchange method based on photographic head and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20200526 Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Applicant after: Alibaba (China) Co.,Ltd. Address before: Room 02, 2nd floor, E/F, 555 Dongchuan Road, Baoshan District, Shanghai, 2001 Applicant before: CHUANXIAN NETWORK TECHNOLOGY (SHANGHAI) Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190621 |
|
RJ01 | Rejection of invention patent application after publication |