CN108366243B - A kind of video jitter removing method and device - Google Patents
A kind of video jitter removing method and device Download PDFInfo
- Publication number
- CN108366243B CN108366243B CN201810065195.6A CN201810065195A CN108366243B CN 108366243 B CN108366243 B CN 108366243B CN 201810065195 A CN201810065195 A CN 201810065195A CN 108366243 B CN108366243 B CN 108366243B
- Authority
- CN
- China
- Prior art keywords
- video
- frequency band
- rotation angle
- debounce
- axis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C1/00—Measuring angles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
This application involves technical field of image processing more particularly to a kind of video jitter removing methods and device, to solve the problems, such as that there is debounce efficiency is lower when carrying out debounce to panoramic video stream in the prior art；Video jitter removing method provided by the embodiments of the present application includes: to determine that each video frame is along the shooting rotation angle for presetting axis in the panoramic video stream for the panoramic video stream obtained；According to each video frame along the shooting rotation angle for presetting axis, the debounce video-frequency band in the panoramic video stream is determined；The removal of rotation class shake is carried out to the debounce video-frequency band in the panoramic video stream.In this way, a part of video-frequency band for picking out panoramic video stream carries out debounce processing, and is no longer that debounce processing is carried out to video frame all in panoramic video stream, therefore, video frame quantity when carrying out debounce processing can be reduced, and then improves the debounce efficiency of panoramic video stream.
Description
Technical field
This application involves technical field of image processing more particularly to a kind of video jitter removing methods and device.
Background technique
With the fast development of image processing techniques, there is more and more panoramic videos, the best sight of panoramic video
The mode of seeing is watched by the way that virtual reality (Virtual Reality, VR) head is aobvious, if not carrying out debounce to panoramic video
Processing, when through VR aobvious viewings, it is easy to generate user dizzy, significantly influence user experience.
It in the prior art, is to all video frames in panoramic video stream when carrying out debounce processing to panoramic video stream
It is all smoothed, but the shake in video frame has plenty of the rotation as caused by expected rotation, such as at turning to camera
Caused by shake, some be then as caused by unexpected rotation, abnormal rotate of camera such as in straight line shooting process and draw
The shake risen.Generally, the video-frequency band comprising expected rotation, due to the shooting angle of camera during shooting the video-frequency band
It is varied widely, so the difference in these video-frequency bands between each video frame is bigger, even if carrying out to these video-frequency bands
Debounce processing can not reduce spinning sensation of the user when watching panoramic video, therefore, to the panoramic video comprising expected rotation
Duan Jinhang debounce can not play good debounce effect, and can reduce the debounce processing efficiency of panoramic video stream.
As it can be seen that there is a problem that debounce efficiency is lower when carrying out debounce to panoramic video stream in the prior art.
Summary of the invention
The embodiment of the present application provides a kind of video jitter removing method and device, to solve in the prior art to panoramic video
Stream carries out there is a problem that debounce efficiency is lower when debounce.
A kind of video jitter removing method provided by the embodiments of the present application, comprising:
For the panoramic video stream of acquisition, determine that each video frame is along the shooting rotation for presetting axis in the panoramic video stream
Angle；
According to each video frame along the shooting rotation angle for presetting axis, the debounce video-frequency band in the panoramic video stream is determined；
Debounce processing is carried out to the debounce video-frequency band in the panoramic video stream.
A kind of video de-jitter apparatus provided by the embodiments of the present application, comprising:
Rotation angle determining module is shot, for determining and respectively regarding in the panoramic video stream for the panoramic video stream obtained
Frequency frame is along the shooting rotation angle for presetting axis；
Debounce video-frequency band determining module, for, along the shooting rotation angle for presetting axis, determining the panorama according to each video frame
Debounce video-frequency band in video flowing；
Debounce module, for carrying out debounce processing to the debounce video-frequency band in the panoramic video stream.
A kind of electronic equipment provided by the embodiments of the present application, including at least one processing unit and at least one storage
Unit, wherein the storage unit is stored with program code, when said program code is executed by the processing unit, so that
The electronic equipment executes the step of above-mentioned video jitter removing method.
A kind of computer readable storage medium provided by the embodiments of the present application, including program code, work as said program code
When running on an electronic device, the step of making the electronic equipment execute above-mentioned video jitter removing method.
In the embodiment of the present application, for the panoramic video stream of acquisition, determine that each video frame is along default axis in panoramic video stream
Shooting rotation angle determine the debounce video-frequency band in panoramic video stream further according to each video frame along the shooting rotation angle for presetting axis,
And then debounce processing is carried out to debounce video-frequency band, in this way, a part of video-frequency band for picking out panoramic video stream carries out debounce processing,
And be no longer that debounce processing is carried out to video frame all in panoramic video stream, therefore, it is possible to reduce when progress debounce processing
Video frame quantity, and then improve the debounce efficiency of panoramic video stream.
Detailed description of the invention
Fig. 1 is the flow chart of video jitter removing method provided by the embodiments of the present application；
Fig. 2 is the schematic diagram of the video frame provided by the embodiments of the present application with the storage of Equirectangular projection pattern；
Fig. 3 is the schematic diagram of the video frame provided by the embodiments of the present application with the storage of Stereographic projection pattern；
Fig. 4 is handled the video frame stored with Stereographic projection pattern to be provided by the embodiments of the present application
Schematic diagram；
Fig. 5 is the schematic diagram provided by the embodiments of the present application by after 180 ° of video frame rotation；
Fig. 6 is the flow chart of the new video-frequency band without spin of determination provided by the embodiments of the present application；
Fig. 7 is the flow chart provided by the embodiments of the present application that debounce processing is carried out to each debounce video-frequency band；
Fig. 8 is schematic diagram of each video frame provided by the embodiments of the present application along the shooting rotation angle for presetting axis；
Fig. 9 is the schematic diagram of the video-frequency band without spin determined and rotating video section provided by the embodiments of the present application；
Figure 10 is provided by the embodiments of the present application by first rotating video section and adjacent two video-frequency band conjunctions without spin
The schematic diagram of video-frequency band after and；
Figure 11 is the schematic diagram of the rotating video section finally determined and debounce video-frequency band provided by the embodiments of the present application；
Figure 12 is the flow chart of another video jitter removing method provided by the embodiments of the present application；
Figure 13 is video de-jitter apparatus structure chart provided by the embodiments of the present application；
Figure 14 is that the hardware configuration of the electronic equipment provided by the embodiments of the present application for realizing video jitter removing method is illustrated
Figure.
Specific embodiment
In the embodiment of the present application, for the panoramic video stream of acquisition, determine that each video frame is along default axis in panoramic video stream
Shooting rotation angle determine the debounce video-frequency band in panoramic video stream further according to each video frame along the shooting rotation angle for presetting axis,
And then debounce processing is carried out to debounce video-frequency band, in this way, a part of video-frequency band for picking out panoramic video stream carries out debounce processing,
And be no longer that debounce processing is carried out to video frame all in panoramic video stream, therefore, it is possible to reduce when progress debounce processing
Video frame quantity, and then improve the debounce efficiency of panoramic video stream.
The embodiment of the present application is described in further detail with reference to the accompanying drawings of the specification.
Embodiment one
As shown in Figure 1, being the flow chart of video jitter removing method provided by the embodiments of the present application, comprising the following steps:
S101: for the panoramic video stream of acquisition, determine that each video frame is along the shooting rotation for presetting axis in panoramic video stream
Angle.
Wherein, default axis can be common x-axis, y-axis or z-axis, or other customized axis do not limit herein
It is fixed.
For any video frame, which refers to camera from the upper video frame of shooting along the shooting rotation angle for presetting axis
To the angle rotated through when shooting the video frame along default axis, because of the not upper video of first video frame in panoramic video stream
Frame, so first video frame can be preset value along the shooting rotation angle for presetting axis, such as 0 °, other each video frames are along pre-
If the shooting rotation angle of axis is to be mounted on magazine sensor institute according to when shooting the video frame and shooting a upper video frame
What the azimuth of acquisition determined, alternatively, being determined according to the characteristics of image of the video frame and a upper video frame.
Illustrate to calculate each video frame along the method for the shooting rotation angle for presetting axis below with reference to specific embodiment.
1, determine each video frame along the shooting rotation angle for presetting axis according to characteristics of image.
Assuming that including 100 video frames in the panoramic video stream obtained, and each video frame is thrown with Equirectangular
Shadow mode stores, as shown in Fig. 2, can choose for the schematic diagram of the video frame stored with Equirectangular projection pattern
Any mode calculates the shooting rotation angle that axis is preset on each video frame edge in panoramic video stream below.
Mode one
Video frame is converted to Stereographic projection pattern, such as Fig. 3 from Equirectangular projection pattern by a
It is shown, for the schematic diagram of the video frame stored with Stereographic projection pattern.
B retains the content in Stereographic projection in border circular areas to carry out rotation comparison, by border circular areas it
Outer content filled black, as shown in Figure 4.
C, for video frame with Scale invariant features transform (Scale-invariant feature transform,
SIFT) operator or acceleration robust features (Speed-up robust features, SURF) operator carry out feature extraction.
D carries out Flann-based characteristic matching for two adjacent video frames.
E obtains the matrix of affine transformation according to the characteristic point to match, includes that there are two videos in the matrix of affine transformation
Shooting between frame rotates angle.
Mode two
N column pixel leftmost in video frame is moved on to the rightmost side of video frame by a, is equivalent to and is revolved video frame around z-axis
Turn, rotates angle, θ=n/ video width * 360, wherein n is integer.
As shown in figure 5, being by the schematic diagram after 180 ° of video frame rotation.
B calculates the mean square error (Mean-square Error, MSE) between rotation rear video frame and previous video frame.
C takes the smallest angle of MSE in all rotation angles, if the MSE value is less than preset threshold value, by all rotations
The smallest angle of MSE is as the video frame along the shooting rotation angle of z-axis in gyration.
2, azimuth when according to shooting video frame determines each video frame along the shooting rotation angle for presetting axis.
If camera azimuthal sensor when for acquiring shooting is equipped in camera, in the video frame that pans
When, it can use azimuth when sensor acquisition camera shooting video frame, and the azimuth of acquisition is deposited together with video frame
Storage, later, to any video frame, can calculate azimuth and the azimuth when collection video frame when acquiring a upper video frame it
Difference will preset the shooting rotation angle of axis later as video frame edge in difference map to default axis.
S102: according to each video frame along the shooting rotation angle for presetting axis, the debounce video-frequency band in panoramic video stream is determined.
Here it is possible to first determine video-frequency band of the rotational steps in expected range in panoramic video stream along default axis, it will
These video-frequency bands are used as rotating video section as video-frequency band without spin, using remaining video-frequency band, later according to video-frequency band without spin with
Rotating video section determines debounce video-frequency band.
Optionally, shooting of each video frame along default axis in the video-frequency band along the rotational steps of default axis in expected range
The absolute value of rotation angle is respectively less than first threshold, and each video frame along the sum of shooting rotation angle for presetting axis absolute value less than the
Two threshold values, these feature descriptions shooting orientation of camera during shooting video-frequency band do not vary widely, compare
Meet the characteristics of video-frequency band shot when expected rotation does not occur for camera, therefore, these video-frequency bands can be regarded as without spin
Video-frequency band.
For example, standard when selecting video-frequency band without spin can be video frame each in video-frequency band along the shooting rotation for presetting axis
The absolute value at angle is respectively less than 0.3 °, and the absolute value of the cumulative sum of the shooting rotation angle of axis is preset less than 10 ° in each video frame edge；Also
It can be respectively less than 0.2 ° along the absolute value for the shooting rotation angle for presetting axis for video frame each in video-frequency band, and each video frame is along default
Which criteria for selection the absolute value of the cumulative sum of the shooting rotation angle of axis specifically selects, by technical staff according to reality less than 5 °
Demand determines, it is not limited here.
It is possible to further which according to rotating video section and without spin in video-frequency band, each video frame is rotated along the shooting for presetting axis
The duration of angle and each video-frequency band determines new video-frequency band without spin, later, to each video-frequency band without spin, however, it is determined that the nothing
The duration of rotating video section be greater than third threshold value, then can using this without spin video-frequency band as debounce video-frequency band, wherein third threshold
Value is preset by technical staff.
Specifically, new video-frequency band without spin can be determined according to process shown in fig. 6:
S601a: being loaded into a rotating video section, determine the duration of the rotating video section less than the 4th threshold value, and adjacent nothing
When the sum of duration of rotating video section is greater than five threshold values, the rotating video section and adjacent video-frequency band without spin are closed
And obtain a video-frequency band to be processed.
When initial, loading is first rotating video section.
Since there may be brief stays in rotary course for camera, camera has in the video-frequency band that dwell phase is shot can
Energy and without spin video-frequency band, but these of short duration video-frequency bands are not effective video section in fact, are carried out to this kind of video-frequency band
Debounce is not of practical significance, therefore the shooting duration of video of video-frequency band can be used to filter this kind of video-frequency band.
S602a: to each video frame in video-frequency band to be processed, when calculating camera is shot from shooting video-frequency band to be processed
Between earliest video frame to rotation angle when shooting the video frame along default axis, obtain the maximum rotation angle in video-frequency band to be processed
With minimum rotation angle.
Wherein, to any video frame, the video frame video frame earliest relative to shooting time in video-frequency band to be processed it
Between along default axis rotation angle, between video frame that can be earliest to the video frame and time along the shooting rotation angle of default axis into
Row is cumulative to be obtained.
S603a: the difference between maximum rotation angle and minimum rotation angle is calculated.
S604a: if the difference between maximum rotation angle and minimum rotation angle less than the 6th threshold value, by video-frequency band to be processed
As new video-frequency band without spin, original rotating video section and adjacent video-frequency band without spin are replaced.
In practical application, the rotation angle in rotating video section between each frame video is bigger, therefore, can be according to be processed
The difference between maximum rotation angle and minimum rotation angle in video-frequency band between each video frame and the earliest video frame of shooting time,
Judge during shooting video-frequency band to be processed whether camera occurs expected rotation, if maximum rotation angle and minimum rotation angle it
Between difference less than the 6th threshold value, it is determined that expected rotation does not occur for camera during shooting the video-frequency band to be processed, i.e.,
Original rotating video section and adjacent video without spin can be replaced using video-frequency band to be processed as new video-frequency band without spin
Section, conversely, not dealing with then.
S605a: next rotating video section is judged whether there is, if so, into 601a；Otherwise, process terminates.
In the above process, the 4th threshold value, the 5th threshold value and the 6th threshold value are preset by technical staff.
S103: debounce processing is carried out to the debounce video-frequency band in panoramic video stream.
Here, when carrying out debounce processing to each debounce video-frequency band, one can be selected for the video frame in the video-frequency band
Along the target rotation angle for presetting axis, each video frame edge in the video-frequency band is calculated later and presets the shooting rotation angle of axis and along default
Difference between the target rotation angle of axis, and then corresponding video frame is rotated according to the difference, make the video frame along pre-
If the shooting rotation angle of axis and the difference between the target rotation angle of default axis are zero.Smoothing processing is done compared to video frame
Debounce mode, the debounce mode for carrying out rotation processing frame by frame to each video frame in debounce video-frequency band can effectively remove video frame
Between relative rotation therefore can more effectively mitigate the spinning sensation of user, debounce effect is also more preferable.
It optionally, can be by designated frame (such as first video in the video-frequency band for any debounce video-frequency band
Frame) shooting rotation angle as target rotation angle；Alternatively, calculating the shooting rotation angle that axis is preset on each video frame edge in the video-frequency band
Average value, using the average value as the video-frequency band along preset axis target rotation angle.
In the specific implementation process, debounce processing can be carried out to each debounce video-frequency band according to process shown in Fig. 7:
S701a: a target rotation angle along default axis is selected for debounce video-frequency band.
For example, the shooting rotation angle of axis is preset as the target along default axis in first video frame edge in debounce video-frequency band
Rotation angle.
S702a: be loaded into debounce video-frequency band in a video frame, calculate the video frame along preset axis shooting rotation angle with
Difference θ between the target rotation angle for presetting axis.
S703a: judging whether θ is equal to zero, if so, into S705a；If it is not, then entering S704a.
S704a: rotating current video frame according to-θ, makes the shooting rotation angle and mesh of the video frame along default axis
The difference θ marked between rotation angle is equal to zero.
S705a: judge whether the video frame is the last one video frame in debounce video-frequency band, if so, process terminates；
Otherwise, into S702a.
In the embodiment of the present application, for the panoramic video stream of acquisition, determine that each video frame is along default axis in panoramic video stream
Shooting rotation angle determine the debounce video-frequency band in panoramic video stream further according to each video frame along the shooting rotation angle for presetting axis,
And then debounce processing is carried out to debounce video-frequency band, in this way, a part of video-frequency band for picking out panoramic video stream carries out debounce processing,
And be no longer that debounce processing is carried out to video frame all in panoramic video stream, therefore, it is possible to reduce when progress debounce processing
Video frame quantity, and then improve the debounce efficiency of panoramic video stream.
Embodiment two
Assuming that the panoramic video stream obtained is to advance to shoot along a certain path using tripod, it include 5000 videos
Frame, and the frame per second of video is 50fps.
Firstly, first video frame in panoramic video stream is revolved along the shooting for presetting axis after getting panoramic video stream
Corner is set as 0 °, to other each video frames, calculates the relatively previous video frame of the video frame along the shooting rotation angle for presetting axis.
Assuming that each video frame calculated is as shown in Figure 8 along the schematic diagram for the shooting rotation angle for presetting axis, wherein i is the serial number of video frame,
I=0,1 ..., 5000, the number below video frame, such as 0.0,0.3 etc. represents corresponding video frame along the shooting rotation for presetting axis
Angle.
Secondly, panoramic video stream is divided into video-frequency band without spin and rotating video section.
For example, selecting the standard of video-frequency band without spin is video frame each in video-frequency band along the exhausted of the shooting rotation angle for presetting axis
0.2 ° is respectively less than to value, and the absolute value of the cumulative sum of the shooting rotation angle of axis is preset less than 5 ° in each video frame edge, it is assumed that from Fig. 8
In the video-frequency band without spin that selects in each video frame and rotating video section it is as shown in Figure 9, wherein dotted line indicates rotating video section,
Solid line indicates video-frequency band without spin, the number in Fig. 9, such as 300,320, represents the serial number of video frame.
Again, debounce video-frequency band is determined according to video-frequency band without spin and rotating video section.
In the specific implementation process, axis can be preset in each video frame edge according to rotating video section and without spin in video-frequency band
The duration of rotation angle and each video-frequency band is shot, determines new video-frequency band without spin, later, to each video-frequency band without spin, really
When the duration of the fixed video-frequency band without spin is greater than 5000m, then using this without spin video-frequency band as debounce video-frequency band.
It specifically, is rotating video section from the 300th~320 frame in reference Fig. 9, Fig. 9, before adjacent with the rotating video section
One without spin video-frequency band be 0~300 frame, the latter without spin video-frequency band be 320~720 frames, determine rotating video section 300~
The shooting duration of video of 320 frames be less than 1000ms, and the shooting duration of video of adjacent 0~300 frame of video-frequency band without spin and 320~720 frames it
When with being greater than 5000ms, this 3 video-frequency bands are merged to obtain 0~720 frame of video-frequency band to be processed, it is to be processed when determining
The difference of maximum rotation angle and minimum rotation angle in 0~720 frame of video-frequency band is 3 ° (less than 5 °), then can be by video to be processed
0~720 frame of section replaces original 300~320 frame of rotating video section and adjacent video without spin as new video-frequency band without spin
0~300 frame of section and 320~720 frames, i.e. 0~720 frame become first video-frequency band without spin, after replacement as shown in Figure 10.
Later, with similar method, other each rotating video sections in panoramic video stream are handled from front to back,
It as shown in figure 11, is the signal of the rotating video section and debounce video-frequency band that are finally marked off to 5000 video frames shown in Fig. 9
Figure, wherein part shown in double-lined arrow is the debounce video-frequency band determined in panoramic video stream, and dotted line show rotating video
Section, number such as 720,900 represents the serial number of video frame in Figure 11.
After having executed aforesaid operations to all rotating video sections, to each video-frequency band without spin (including original
Video-frequency band and new video-frequency band without spin without spin), however, it is determined that the duration of the video-frequency band without spin is greater than 5000ms, then can will
Video-frequency band is determined as a debounce video-frequency band without spin for this.
Finally, carrying out debounce processing to each debounce video-frequency band.
In the specific implementation process, the above process can be executed according to process shown in Figure 12:
S1201: being loaded into a rotating video section, by the rotating video section and adjacent front and back without spin video-frequency band form to
Handle video-frequency band.
Here, by rotating video section and it is adjacent before and after before video-frequency band forms video-frequency band to be processed without spin, can be with
Determine that the duration of rotating video section is less than 1000ms, and the sum of shooting duration of video of adjacent video-frequency band without spin is greater than 5000ms.
S1202: it is pre- relative to first video frame edge in video-frequency band to be processed to calculate each video frame in video-frequency band to be processed
If the shooting rotation angle of axis.
S1203: the poor θ in calculation processing video-frequency band between maximum rotation angle and minimum rotation angle.
S1204: θ is judged whether less than 5 °, if so, into S1205；Otherwise, into S1207.
S1205: using video-frequency band to be processed as new video-frequency band without spin, original rotating video section and adjacent nothing are replaced
Rotating video section.
S1206: next rotating video section is judged whether there is, if so, into S1201；Otherwise, into S1207.
S1207: to each video-frequency band without spin, however, it is determined that this without spin video-frequency band duration be greater than 5000ms, then should
Video-frequency band is determined as a debounce video-frequency band without spin.
S1208: it is loaded into a debounce video-frequency band.
S1209: debounce processing is carried out to debounce video-frequency band.
It specifically, can be using the shooting rotation angle of first default axis in video frame edge in each debounce video-frequency band as the view
The target rotation angle of frequency range calculates target of each video frame along the shooting rotation angle for presetting axis and along default axis in the video-frequency band
Difference between rotation angle, the difference can be obtained by the rotation angle between each video frame and previous video frame that adds up, it
The video frame is rotated according to the difference along default axis between the shooting rotation angle and target rotation angle of the video frame afterwards,
Make the difference zero between the shooting rotation angle of the video frame along default axis and target rotation angle.
S1210: judge whether there is next debounce video-frequency band in panoramic video stream, if so, into S1208；Otherwise, it flows
Journey terminates.
In the embodiment of the present application, each video frame in panoramic video stream is obtained first relative to a upper video frame when shooting
Panoramic video stream is divided into video-frequency band and debounce video-frequency band comprising expected shake according to rotation angle by rotation angle, later, according to
The feature of video-frequency band and debounce video-frequency band comprising expected shake, generates one or more debounce video-frequency bands, in each debounce piece
Target rotation angle is set along default axis in section, each video frame in the debounce segment to target is rotated along default axis later and rotates
Angle, the expected rotation and unexpected shake of camera can be efficiently differentiated out by this method, and can be made in a video-frequency band
Each video frame azimuth save it is consistent, so that the unexpected rotation of panorama camera causes when eliminating due to panoramic video shooting
Float.
Embodiment three
Based on the same inventive concept, one kind video corresponding with video jitter removing method is additionally provided in the embodiment of the present application to go
Jitter apparatus, since the principle that the device solves the problems, such as is similar to the embodiment of the present application video jitter removing method, the reality of the device
The implementation for the method for may refer to is applied, overlaps will not be repeated.
It as shown in figure 13, is video de-jitter apparatus structure chart provided by the embodiments of the present application, comprising:
Rotation angle determining module 1301 is shot, for determining in the panoramic video stream for the panoramic video stream obtained
Each video frame is along the shooting rotation angle for presetting axis；
Debounce video-frequency band determining module 1302, described in, along the shooting rotation angle for presetting axis, being determined according to each video frame
Debounce video-frequency band in panoramic video stream；
Debounce module 1303, for carrying out debounce processing to the debounce video-frequency band in the panoramic video stream.
Optionally, debounce video-frequency band determining module 1302 is specifically used for:
Video-frequency band of the rotational steps in the panoramic video stream along default axis in expected range is determined, by the video
Duan Zuowei video-frequency band without spin, and using remaining video-frequency band as rotating video section；
According to the video-frequency band without spin and rotating video section, the debounce video-frequency band is determined.
Optionally, axis is preset on each video frame edge in the video-frequency band along the rotational steps of default axis in expected range
The absolute value of shooting rotation angle is respectively less than first threshold, and each video frame is small along the absolute value of the sum of the shooting rotation angle for presetting axis
In second threshold.
Optionally, debounce video-frequency band determining module 1302 is specifically used for:
According to the rotating video section and without spin in video-frequency band each video frame along the shooting rotation angle for presetting axis and each
The duration of video-frequency band determines new video-frequency band without spin；
To each video-frequency band without spin, however, it is determined that the duration of the video-frequency band without spin is greater than third threshold value, then will be described
Video-frequency band is as debounce video-frequency band without spin.
Optionally, debounce video-frequency band determining module 1302 is specifically used for:
To first rotating video section, when determine the duration of the rotating video section less than the 4th threshold value, and adjacent irrotationality
When turning the sum of duration of video-frequency band greater than five threshold values, the rotating video section and adjacent video-frequency band without spin are closed
And obtain a video-frequency band to be processed；
If determining described to be processed along the shooting rotation angle for presetting axis according to video frame each in the video-frequency band to be processed
The difference of maximum rotation angle and minimum rotation angle is less than the 6th threshold value in section, then using the video-frequency band to be processed as newly without spin
Video-frequency band replaces original rotating video section and adjacent video-frequency band without spin；Wherein, maximum rotation angle and minimum rotation angle are
It is determined according to video frame each in the video-frequency band to be processed along the shooting rotation angle for presetting axis；
To next rotating video section, return when determine the duration of the rotating video section less than the 4th threshold value, and it is adjacent
When the sum of duration of video-frequency band is greater than five threshold values without spin, the rotating video section and adjacent video-frequency band without spin are carried out
The step of merging, obtaining a video-frequency band to be processed, until having handled all rotating video sections.
Optionally, the shooting rotation angle that axis is preset on first video frame edge in the panoramic video stream is preset value；It is other
Each video frame is to be mounted on phase according to when shooting the video frame and shooting a upper video frame along the shooting rotation angle for presetting axis
What the sensor azimuth collected in machine determined, alternatively, being true according to the characteristics of image of the video frame and a upper video frame
Fixed.
Optionally, debounce module 1303 is specifically used for:
A target rotation angle along default axis is selected for the debounce video-frequency band；
To each video frame in the debounce video-frequency band, calculate the video frame along preset the shooting rotation angle of axis with it is described
Difference between the target rotation angle for presetting axis；
The video frame is rotated along axis is preset according to the difference of calculating, makes the video frame along the shooting rotation for presetting axis
Difference between angle and the target rotation angle along default axis is zero.
Optionally, debounce module 1303 is specifically used for:
Video frame will be specified to rotate along the shooting rotation angle for presetting axis as the target along default axis in the debounce video-frequency band
Angle；Alternatively,
Each video frame in the debounce video-frequency band is calculated to make the average value along the average value for the shooting rotation angle for presetting axis
It is the debounce video-frequency band along the target rotation angle for presetting axis.
Example IV
As shown in figure 14, show for the hardware configuration of the electronic equipment provided by the embodiments of the present application for realizing video debounce
It is intended to, including at least one processing unit 1401 and at least one storage unit 1402, wherein storage unit is stored with journey
Sequence code, when program code is executed by the processing unit, so that the step of electronic equipment executes above-mentioned video jitter removing method.
Embodiment five
A kind of computer readable storage medium provided by the embodiments of the present application, including program code, work as said program code
When running on an electronic device, make electronic equipment execute above-mentioned video jitter removing method the step of.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is process of the reference according to method, apparatus (system) and computer program product of the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although the preferred embodiment of the application has been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the application range.
Obviously, those skilled in the art can carry out various modification and variations without departing from the essence of the application to the application
Mind and range.In this way, if these modifications and variations of the application belong to the range of the claim of this application and its equivalent technologies
Within, then the application is also intended to include these modifications and variations.
Claims (9)
1. a kind of video jitter removing method characterized by comprising
For the panoramic video stream of acquisition, determine that each video frame is along the shooting rotation angle for presetting axis in the panoramic video stream；
According to each video frame along the shooting rotation angle for presetting axis, the debounce video-frequency band in the panoramic video stream is determined；
Debounce processing is carried out to the debounce video-frequency band in the panoramic video stream；
According to each video frame along the shooting rotation angle for presetting axis, the debounce video-frequency band in the panoramic video stream is determined, comprising:
It determines video-frequency band of the rotational steps in the panoramic video stream along default axis in expected range, the video-frequency band is made
For video-frequency band without spin, and using remaining video-frequency band as rotating video section；
According to the rotating video section and without spin in video-frequency band each video frame along the shooting rotation angle and each video for presetting axis
The duration of section determines new video-frequency band without spin；
To each video-frequency band without spin, however, it is determined that the duration of the video-frequency band without spin is greater than third threshold value, then by the irrotationality
Turn video-frequency band as debounce video-frequency band.
2. the method as described in claim 1, which is characterized in that the view along the rotational steps of default axis in expected range
Each video frame is respectively less than first threshold along the absolute value for the shooting rotation angle for presetting axis in frequency range, and each video frame is along default axis
The absolute value for shooting the sum of rotation angle is less than second threshold.
3. the method as described in claim 1, which is characterized in that respectively regarded according to the rotating video section and without spin in video-frequency band
Frequency frame determines new video-frequency band without spin along the duration for the shooting rotation angle and each video-frequency band for presetting axis, comprising:
To first rotating video section, when determining that the duration of the rotating video section less than the 4th threshold value, and adjacent regards without spin
When the sum of duration of frequency range is greater than five threshold values, the rotating video section and adjacent video-frequency band without spin are merged, obtained
To a video-frequency band to be processed；
If determining the video-frequency band to be processed along the shooting rotation angle for presetting axis according to video frame each in the video-frequency band to be processed
The difference of middle maximum rotation angle and minimum rotation angle is less than the 6th threshold value, then using the video-frequency band to be processed as new view without spin
Frequency range replaces original rotating video section and adjacent video-frequency band without spin；Wherein, maximum rotation angle and minimum rotation angle are roots
It is determined according to video frame each in the video-frequency band to be processed along the shooting rotation angle for presetting axis；
To next rotating video section, return when determine the duration of the rotating video section less than the 4th threshold value, and adjacent irrotationality
When turning the sum of duration of video-frequency band greater than five threshold values, the rotating video section and adjacent video-frequency band without spin are closed
And the step of obtaining a video-frequency band to be processed, until having handled all rotating video sections.
4. the method as described in claim 1, which is characterized in that first video frame is along default axis in the panoramic video stream
Shooting rotation angle is preset value；Other each video frames are according in the shooting video frame and bat along the shooting rotation angle for presetting axis
Be mounted on what magazine sensor azimuth collected determined when taking the photograph a video frame, alternatively, be according to the video frame and
What the characteristics of image of a upper video frame determined.
5. the method as described in claim 1, which is characterized in that carry out debounce to the debounce video-frequency band in the panoramic video stream
Processing, comprising:
A target rotation angle along default axis is selected for the debounce video-frequency band；
To each video frame in the debounce video-frequency band, the video frame is calculated along the shooting rotation angle of presetting axis and described along default
Difference between the target rotation angle of axis；
According to calculating difference to the video frame along preset axis rotate, make the video frame along preset axis shooting rotation angle with
Difference between the target rotation angle along default axis is zero.
6. method as claimed in claim 5, which is characterized in that select a target along default axis to revolve for the debounce video-frequency band
Corner, comprising:
Video frame will be specified along the shooting rotation angle of default axis as the target rotation angle along default axis in the debounce video-frequency band；Or
Person,
The average value that the shooting rotation angle of axis is preset on each video frame edge in the debounce video-frequency band is calculated, using the average value as this
Debounce video-frequency band is along the target rotation angle for presetting axis.
7. a kind of video de-jitter apparatus characterized by comprising
Rotation angle determining module is shot, for determining each video frame in the panoramic video stream for the panoramic video stream obtained
Along the shooting rotation angle for presetting axis；
Debounce video-frequency band determining module, for, along the shooting rotation angle for presetting axis, determining the panoramic video according to each video frame
Debounce video-frequency band in stream；
Debounce module, for carrying out debounce processing to the debounce video-frequency band in the panoramic video stream；
The debounce video-frequency band determining module, specifically for the rotational steps in the determination panoramic video stream along default axis in the phase
The video-frequency band in range is hoped, using the video-frequency band as video-frequency band without spin, and using remaining video-frequency band as rotating video section；Root
According to the rotating video section and without spin in video-frequency band each video frame along the shooting rotation angle and each video-frequency band for presetting axis when
It is long, determine new video-frequency band without spin；To each video-frequency band without spin, however, it is determined that the duration of the video-frequency band without spin is greater than the
Three threshold values, then by the video-frequency band without spin as debounce video-frequency band.
8. a kind of electronic equipment, which is characterized in that including at least one processing unit and at least one storage unit, wherein
The storage unit is stored with program code, when said program code is executed by the processing unit, so that the electronics is set
The step of standby perform claim requires 1~6 any the method.
9. a kind of computer readable storage medium, which is characterized in that including program code, when said program code is in electronic equipment
When upper operation, the step of making the electronic equipment perform claim require 1~6 any the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810065195.6A CN108366243B (en) | 2018-01-23 | 2018-01-23 | A kind of video jitter removing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810065195.6A CN108366243B (en) | 2018-01-23 | 2018-01-23 | A kind of video jitter removing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108366243A CN108366243A (en) | 2018-08-03 |
| CN108366243B true CN108366243B (en) | 2019-10-29 |
Family
ID=63006923
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810065195.6A Active CN108366243B (en) | 2018-01-23 | 2018-01-23 | A kind of video jitter removing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108366243B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109688327B (en) * | 2018-12-18 | 2020-08-07 | 影石创新科技股份有限公司 | Method and device for preventing panoramic video from shaking and portable terminal |
| TWI700000B (en) * | 2019-01-29 | 2020-07-21 | 威盛電子股份有限公司 | Image stabilization method and apparatus for panoramic video, and method for evaluating image stabilization algorithm |
| CN110602386B (en) * | 2019-08-28 | 2021-05-14 | 维沃移动通信有限公司 | Video recording method and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231456A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | Method for correcting panorama video jitter using angle sensor |
| CN104537663A (en) * | 2014-12-26 | 2015-04-22 | 广东中科遥感技术有限公司 | Method for rapid correction of image dithering |
| CN105191283A (en) * | 2013-03-29 | 2015-12-23 | 索尼公司 | Image-capturing device, solid-state image-capturing element, camera module, electronic device, and image-capturing method |
| CN105872353A (en) * | 2015-12-15 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | System and method for implementing playback of panoramic video on mobile device |
| CN106507094A (en) * | 2016-10-31 | 2017-03-15 | 北京疯景科技有限公司 | The method and device of correction panoramic video display view angle |
| CN106780370A (en) * | 2016-11-25 | 2017-05-31 | 阿依瓦（北京）技术有限公司 | A kind of image de-jittering device and method thereof |
| CN106791360A (en) * | 2016-11-22 | 2017-05-31 | 北京疯景科技有限公司 | Generate the method and device of panoramic video |
| CN107040694A (en) * | 2017-04-07 | 2017-08-11 | 深圳岚锋创视网络科技有限公司 | A kind of method, system and the portable terminal of panoramic video stabilization |
| CN107071279A (en) * | 2017-04-01 | 2017-08-18 | 深圳市圆周率软件科技有限责任公司 | A kind of method and system of panoramic picture frame stabilization |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009536492A (en) * | 2006-05-09 | 2009-10-08 | エヌエックスピー ビー ヴィ | Processing device for performing jitter extraction and equipment having such processing device |
| CA2763649A1 (en) * | 2012-01-06 | 2013-07-06 | 9237-7167 Quebec Inc. | Panoramic camera |
-
2018
- 2018-01-23 CN CN201810065195.6A patent/CN108366243B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231456A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | Method for correcting panorama video jitter using angle sensor |
| CN105191283A (en) * | 2013-03-29 | 2015-12-23 | 索尼公司 | Image-capturing device, solid-state image-capturing element, camera module, electronic device, and image-capturing method |
| CN104537663A (en) * | 2014-12-26 | 2015-04-22 | 广东中科遥感技术有限公司 | Method for rapid correction of image dithering |
| CN105872353A (en) * | 2015-12-15 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | System and method for implementing playback of panoramic video on mobile device |
| CN106507094A (en) * | 2016-10-31 | 2017-03-15 | 北京疯景科技有限公司 | The method and device of correction panoramic video display view angle |
| CN106791360A (en) * | 2016-11-22 | 2017-05-31 | 北京疯景科技有限公司 | Generate the method and device of panoramic video |
| CN106780370A (en) * | 2016-11-25 | 2017-05-31 | 阿依瓦（北京）技术有限公司 | A kind of image de-jittering device and method thereof |
| CN107071279A (en) * | 2017-04-01 | 2017-08-18 | 深圳市圆周率软件科技有限责任公司 | A kind of method and system of panoramic picture frame stabilization |
| CN107040694A (en) * | 2017-04-07 | 2017-08-11 | 深圳岚锋创视网络科技有限公司 | A kind of method, system and the portable terminal of panoramic video stabilization |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108366243A (en) | 2018-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108366243B (en) | A kind of video jitter removing method and device | |
| US10818029B2 (en) | Multi-directional structured image array capture on a 2D graph | |
| US20190244372A1 (en) | System and method for infinite smoothing of image sequences | |
| Goldstein et al. | Video stabilization using epipolar geometry | |
| CN104796596B (en) | A kind of information processing method and electronic equipment | |
| CN108564617A (en) | Three-dimensional rebuilding method, device, VR cameras and the panorama camera of more mesh cameras | |
| US11176704B2 (en) | Object pose estimation in visual data | |
| Bell et al. | A non-linear filter for gyroscope-based video stabilization | |
| WO2014145322A1 (en) | Systems and methods for tracking camera orientation and mapping frames onto a panoramic canvas | |
| CN103198488B (en) | PTZ surveillance camera realtime posture rapid estimation | |
| CN102256061B (en) | Two-dimensional and three-dimensional hybrid video stabilizing method | |
| CN107798702B (en) | Real-time image superposition method and device for augmented reality | |
| US11783443B2 (en) | Extraction of standardized images from a single view or multi-view capture | |
| CN106296598B (en) | 3 d pose processing method, system and camera terminal | |
| EP3084680A1 (en) | Systems, methods, and apparatus for generating metadata relating to spatial regions of non-uniform size | |
| CN109040575A (en) | The processing method of panoramic video, device, equipment, computer readable storage medium | |
| JP6794545B2 (en) | How to configure a virtual camera, systems and equipment | |
| CA2870480A1 (en) | Hybrid precision tracking | |
| CN112085790A (en) | Point-line combined multi-camera visual SLAM method, equipment and storage medium | |
| CN107995408A (en) | A kind of 360 ° of panoramic shooting systems and method | |
| Ma et al. | Effective video stabilization via joint trajectory smoothing and frame warping | |
| CN109285122A (en) | A kind of method and apparatus carrying out image procossing | |
| CN109587572B (en) | Method and device for displaying product, storage medium and electronic equipment | |
| CN110553628A (en) | Depth camera-based flying object capturing method | |
| JP2020153677A (en) | Rotation state estimation device, method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 101318 2-02, building 15-3, ronghuiyuan, airport economic core area, Shunyi District, Beijing Patentee after: WEIHUAN TECHNOLOGY (BEIJING) Co.,Ltd. Address before: 100094 room No. 1, building No. 1, building No. 1, Yongcheng North Road, Haidian District, Beijing, Haidian District, room 3, floor 385 Patentee before: WEIHUAN TECHNOLOGY (BEIJING) Co.,Ltd. |