CN104284241B - A kind of video clipping method and device - Google Patents

A kind of video clipping method and device Download PDF

Info

Publication number
CN104284241B
CN104284241B CN201410488331.4A CN201410488331A CN104284241B CN 104284241 B CN104284241 B CN 104284241B CN 201410488331 A CN201410488331 A CN 201410488331A CN 104284241 B CN104284241 B CN 104284241B
Authority
CN
China
Prior art keywords
video
scene
scene switching
picture
frequency band
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410488331.4A
Other languages
Chinese (zh)
Other versions
CN104284241A (en
Inventor
项东涛
乐晓诚
孙豹
刘志红
刘辉
熊伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201410488331.4A priority Critical patent/CN104284241B/en
Publication of CN104284241A publication Critical patent/CN104284241A/en
Application granted granted Critical
Publication of CN104284241B publication Critical patent/CN104284241B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Studio Circuits (AREA)

Abstract

The present invention provides a kind of video clipping method and devices, wherein the described method includes: the video to pre- editing carries out scene switching identification, obtains at least one scene switching picture and at least one scene switching video-frequency band;Scene switching picture and scene switching video-frequency band have corresponding relationship;In scene switching picture, the scene switching picture for belonging to the same video scene is selected;According to the corresponding relationship of scene switching picture and scene switching video-frequency band, and, belong to the scene switching picture of the same video scene, determines the scene switching video-frequency band for belonging to the same video scene;The scene switching video-frequency band for belonging to the same video scene determined is merged into a video, completes video clipping.The present invention has liberated editorial staff, editorial staff can several videos of editing simultaneously, for live stream editing, also not needing editorial staff's a moment ceaselessly stares at video and carries out preview, improves the working efficiency of video clipping.

Description

A kind of video clipping method and device
Technical field
The present invention relates to technical field of video processing, more particularly to a kind of video clipping method and device.
Background technique
Existing video clipping process is all the segment judged in video by way of artificial preview.For example, to variety Program video carry out editing process, be all editorial staff by the entire video of preview come when judging Pgmtime segment and advertisement Between section, then completed by video clipping software.
This method is high to the skill requirement of editorial staff, and the process of the entire video of preview is time-consuming, and video is cut The low efficiency collected, the especially news footage of editing live stream are higher to the effective requirement of editing.
Moreover, the mode of artificial preview not only needs editorial staff to concentrate one's energy, but also an editorial staff is in same a period of time Between section can only one video of editing.
Summary of the invention
The present invention provides a kind of video clipping method and device, to solve existing video clipping process to editorial staff's The problem of skill requirement height, video clipping low efficiency etc..
To solve the above-mentioned problems, the invention discloses a kind of video clipping methods, comprising:
Scene switching identification is carried out to the video of pre- editing, obtains at least one scene switching picture and at least one scene Switch Video section;The scene switching picture and the scene switching video-frequency band have corresponding relationship;
In the scene switching picture, the scene switching picture for belonging to the same video scene is selected;
According to the corresponding relationship of the scene switching picture and the scene switching video-frequency band, and, it is described belong to it is same The scene switching picture of video scene determines the scene switching video-frequency band for belonging to the same video scene;
The scene switching video-frequency band for belonging to the same video scene determined is merged into a video, completes view Frequency editing.
Preferably, the video to pre- editing carries out scene switching identification, obtain at least one scene switching picture and At least one scene switching video-frequency band, comprising:
Scene switching identification is carried out according to the picture color difference of continuous two video frames of the video of pre- editing;
When the picture color difference of continuous two video frames is less than predetermined threshold, determine that continuous two video frames belong to The same video scene;
It is a scene switching video-frequency band by the coding video frames for belonging to the same video scene;
Using first video frame of the scene switching video-frequency band as the scene switching picture of the scene switching video-frequency band;
When the picture color difference of continuous two video frames is more than or equal to the predetermined threshold, continuous two views are determined Frequency frame is belonging respectively to different video scenes;
In the different video scenes of the video of pre- editing, the scene switching picture of different video scenes is determined respectively With scene switching video-frequency band, at least one scene switching picture and at least one scene switching video-frequency band are obtained.
Preferably, the video to pre- editing carries out scene switching identification, obtain at least one scene switching picture and After at least one scene switching video-frequency band, which comprises
It is H.264 standard by the video data encoding of the scene switching video-frequency band;
It is Advanced Audio Coding AAC standard by the audio data coding of the scene switching video-frequency band.
Preferably, described in the scene switching picture, select the scene switching figure for belonging to the same video scene Piece, comprising:
It is described in the scene switching picture, select belong to the same video scene beginning scene switching picture and End scene switches picture.
Preferably, the corresponding relationship according to the scene switching picture and the scene switching video-frequency band, and, it is described The scene switching picture for belonging to the same video scene determines the scene switching video for belonging to the same video scene Section, comprising:
According to the corresponding relationship of the scene switching picture and the scene switching video-frequency band, and, it is described belong to it is same The beginning scene switching picture and end scene of video scene switch picture, determine corresponding with the beginning scene switching picture Beginning scene switching video-frequency band, and, with the corresponding end scene Switch Video section of end scene switching picture;
According to the time sequencing of scene switching video-frequency band, the beginning scene switching video-frequency band is cut with the end scene Whole scene switching video-frequency bands between video-frequency band are changed, the scene switching video of the same video scene is determined to belong to Section;The scene switching video-frequency band for belonging to the same video scene includes the beginning scene switching video-frequency band and described End scene Switch Video section.
The invention also discloses a kind of video clipping devices, comprising:
Scene switching identification module obtains at least one scene for carrying out scene switching identification to the video of pre- editing Switch picture and at least one scene switching video-frequency band;The scene switching picture has corresponding with the scene switching video-frequency band Relationship;
Picture selecting module, for selecting the scene for belonging to the same video scene in the scene switching picture Switch picture;
Video-frequency band determining module, for being closed according to the scene switching picture is corresponding with the scene switching video-frequency band System, and, the scene switching picture for belonging to the same video scene determines the scene for belonging to the same video scene Switch Video section;
Video merging module, the scene switching video-frequency band for belonging to the same video scene for that will determine merge For a video, video clipping is completed.
Preferably, the scene switching identification module, comprising:
Scene switching identifies submodule, for according to the picture color differences of continuous two video frames of the video of pre- editing into The identification of row scene switching;
Video scene determines submodule, for when the picture color difference of continuous two video frames be less than predetermined threshold when, really Fixed continuous two video frames belong to the same video scene;
Scene switching video-frequency band determines submodule, and the coding video frames for that will belong to the same video scene are a field Scape Switch Video section;
Scene switching picture determines submodule, for using first video frame of the scene switching video-frequency band as this The scene switching picture of scape Switch Video section;
The video scene determines submodule, is also used to the picture color difference when continuous two video frames more than or equal to described When predetermined threshold, determine that continuous two video frames are belonging respectively to different video scenes;
The scene switching video-frequency band determines that submodule in the different video scenes of the video of pre- editing, determines respectively The scene switching video-frequency band of different video scenes obtains at least one scene switching video-frequency band;
The scene switching picture determines that submodule in the different video scenes of the video of pre- editing, determines not respectively The scene switching picture of same video scene, obtains at least one scene switching picture.
Preferably, described device further include:
Coding module is obtained for carrying out scene switching identification in video of the scene switching identification module to pre- editing To after at least one scene switching picture and at least one scene switching video-frequency band, by the video of the scene switching video-frequency band Data encoding is H.264 standard;It is Advanced Audio Coding AAC standard by the audio data coding of the scene switching video-frequency band.
Preferably, the picture selecting module is selected in the scene switching picture and belongs to the same video scene Beginning scene switching picture and end scene switch picture.
Preferably, the video-frequency band determining module is according to pair of the scene switching picture and the scene switching video-frequency band Should be related to, and, the beginning scene switching picture for belonging to the same video scene and end scene switch picture, determine with The corresponding beginning scene switching video-frequency band of the beginning scene switching picture, and, it is corresponding with end scene switching picture End scene Switch Video section;According to the time sequencing of scene switching video-frequency band, by the beginning scene switching video-frequency band with Whole scene switching video-frequency bands between the end scene Switch Video section, are determined to belong to the same video scene Scene switching video-frequency band;The scene switching video-frequency band for belonging to the same video scene includes the beginning scene switching Video-frequency band and the end scene Switch Video section.
Compared with the background art, the present invention includes the following advantages:
The present invention is that the video of pre- editing is carried out to scene switching identification, and identification obtains the field one by one with corresponding relationship Scape Switch Video section and one by one scene switching picture.Next it only needs to judge to scene switching picture, select The scene switching picture for belonging to the same video scene further selects scene switching view corresponding with scene switching picture Scene switching video-frequency band is merged into a video file, the editing to video can be realized by frequency range.The present invention has liberated editor Personnel, an editorial staff the several videos of editing can not need editorial staff yet and not stop at a moment for live stream editing simultaneously Ground stares at video and carries out preview, improves the working efficiency of video clipping.
Detailed description of the invention
Fig. 1 is a kind of video clipping method flow chart in the embodiment of the present invention;
Fig. 2 is another video clipping method flow chart in the embodiment of the present invention;
Fig. 3 is a kind of video clipping structure drawing of device in the embodiment of the present invention;
Fig. 4 is another video clipping structure drawing of device in the embodiment of the present invention;
Fig. 5 is a kind of video clipping apparatus structure relation schematic diagram in the embodiment of the present invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real Applying mode, the present invention is described in further detail.
Below by enumerate several specific embodiments be discussed in detail a kind of video clipping provided by the invention method and Device.
Embodiment one
A kind of video clipping method provided in an embodiment of the present invention is discussed in detail.
Referring to Fig.1, a kind of video clipping method flow chart in the embodiment of the present invention is shown.
Step 100, scene switching identification is carried out to the video of pre- editing, obtains at least one scene switching picture and at least One scene switching video-frequency band.
Wherein, the scene switching picture and the scene switching video-frequency band have corresponding relationship.
For example, the video to pre- editing carries out scene switching identification, 5 scene switching pictures and 5 scene switchings are obtained Video-frequency band.5 scene switching pictures and 5 scene switching video-frequency bands have one-to-one relationship: picture a and video-frequency band A Corresponding, picture b is corresponding with video-frequency band B, and picture c is corresponding with video-frequency band C, and picture d is corresponding with video-frequency band D, picture e and video-frequency band E It is corresponding.
Step 102, in the scene switching picture, the scene switching picture for belonging to the same video scene is selected.
For example, selecting in 5 scene switching pictures obtained in above-mentioned steps 100 and belonging to the same video scene M Picture a, picture b and picture c, select the picture d and picture e for belonging to the same video scene N.
Step 104, according to the corresponding relationship of the scene switching picture and the scene switching video-frequency band, and, the category In the scene switching picture of the same video scene, the scene switching video-frequency band for belonging to the same video scene is determined.
Example is connected, according to the corresponding relationship of above-mentioned 5 scene switching pictures and above-mentioned 5 scene switching video-frequency bands, and, Belong to the picture a, picture b and picture c of the same video scene M, and belong to the picture d and picture e of the same video scene N, It determines the video-frequency band A, video-frequency band B and video-frequency band C that belong to the same video scene M, belongs to the video of the same video scene N Section D and video-frequency band E.
Step 106, the scene switching video-frequency band for belonging to the same video scene determined is merged into a view Frequently, video clipping is completed.
In another example by the video-frequency band A for belonging to the same video scene M, the video-frequency band B that are determined in above-mentioned steps 105 and Video-frequency band C merges into a video, and the video-frequency band D and video-frequency band E that belong to the same video scene N are merged into another view Frequently.It so far, is two videos by the video clipping of pre- editing.
In conclusion the embodiment of the present invention is that the video of pre- editing is carried out to scene switching identification, identification obtains having pair The video-frequency band of scene switching one by one that should be related to and one by one scene switching picture.Next it only needs to scene switching picture Judged, select the scene switching picture for belonging to the same video scene, is further selected and scene switching picture Corresponding scene switching video-frequency band, is merged into a video file for scene switching video-frequency band, the editing to video can be realized. The embodiment of the present invention has liberated editorial staff, editorial staff can several videos of editing simultaneously, for live stream editing, Do not need editorial staff's a moment ceaselessly stare at video carry out preview, improve the working efficiency of video clipping.
Embodiment two
A kind of video clipping method provided in an embodiment of the present invention is discussed in detail.
Referring to Fig. 2, a kind of video clipping method flow chart in the embodiment of the present invention is shown.
Step 200, scene switching identification is carried out to the video of pre- editing, obtains at least one scene switching picture and at least One scene switching video-frequency band.
Wherein, scene switching identification is based on (being adopted by eurovision system to the decoded YUV of the video of pre- editing A kind of colour coding method) data analysis.The scene switching picture and the scene switching video-frequency band have one by one Corresponding relationship.
Preferably, the step 200 may include substep:
Sub-step 2001 carries out scene switching knowledge according to the picture color difference of continuous two video frames of the video of pre- editing Not.
The video of the pre- editing is made of multiple continuous video frames, each video frame can be as a secondary picture Face, each video frame have unique color-values, and the color-values of two video frames are compared more available two videos The picture color of frame is poor, in general, picture color difference measures the difference of two video frames in the form of percentage.
Sub-step 2002 determines described continuous two when the picture color difference of continuous two video frames is less than predetermined threshold A video frame belongs to the same video scene;It is a scene switching video by the coding video frames for belonging to the same video scene Section;Using first video frame of the scene switching video-frequency band as the scene switching picture of the scene switching video-frequency band.
The predetermined threshold can be set as 50%, can also be set as other numerical value according to actual needs, and the present invention is real Example is applied to the specific value of predetermined threshold without limitation.
If the picture color difference of continuous two video frames is 40%, because of 40% < 50%, then continuous two video frames Belong to the same video scene, be a scene switching video-frequency band by continuous two coding video frames, by continuous two views First video frame of frequency frame, i.e. scene switching picture of the previous video frame as the scene switching video-frequency band.
Sub-step 2003 determines institute when the picture color difference of continuous two video frames is more than or equal to the predetermined threshold It states continuous two video frames and is belonging respectively to different video scenes.
If the picture color difference of continuous two video frames is 60%, because of 60% > 50% or continuous two video frames Picture color difference be 50%, 50%=50%, then continuous two video frames are belonging respectively to two different video scenes.
Sub-step 2004 determines different video scenes in the different video scenes of the video of pre- editing respectively Scene switching picture and scene switching video-frequency band obtain at least one scene switching picture and at least one scene switching video Section.
For example, determining that the video of pre- editing can be divided into 6 differences after carrying out scene switching identification to the video of pre- editing Video scene, determine the scene switching picture and scene switching video-frequency band of this 6 different video scenes respectively, obtain 6 Scene switching picture and 6 scene switching video-frequency bands.
Preferably, after the step 200, the embodiment of the present invention can also include the following steps:
It is H.264 standard by the video data encoding of the scene switching video-frequency band, and by the scene switching video-frequency band Audio data coding be Advanced Audio Coding AAC standard.
It H.264 is the new-generation digital video that International Organization for standardization (ISO) and International Telecommunication Union (ITU) propose jointly Compressed format.AAC is a kind of file compression formats for aiming at voice data design, is encoded using completely new algorithm, more Increase effect, has higher " cost performance ".
Scene switching identification, then the coding video frames obtained scene switching video-frequency band first are carried out to the video of pre- editing It is the audio of AAC format the corresponding audio coding of video frame of scene switching video-frequency band for the video of H.264 format.
Step 202, in the scene switching picture, the scene switching picture for belonging to the same video scene is selected.
Preferably, the step 202 can be with are as follows:
It is described in the scene switching picture, select belong to the same video scene beginning scene switching picture and End scene switches picture.
When the same video scene is there are when multiple scene switching pictures, the beginning scene of the video scene can choose out Switch picture and end scene switches picture, that is, selects the first width scene switching picture and last width field of the video scene Scape switches picture.
Step 204, according to the corresponding relationship of the scene switching picture and the scene switching video-frequency band, and, the category In the scene switching picture of the same video scene, the scene switching video-frequency band for belonging to the same video scene is determined.
Preferably, the step 204 may include substep:
Sub-step 2041, according to the corresponding relationship of the scene switching picture and the scene switching video-frequency band, and, it is described The beginning scene switching picture and end scene switching picture for belonging to the same video scene, determine to cut with the beginning scene The corresponding beginning scene switching video-frequency band of picture is changed, and, end scene corresponding with end scene switching picture switches Video-frequency band.
For example, the beginning scene switching picture of certain video scene is picture a, it is picture e that end scene, which switches picture, is determined The beginning scene switching video-frequency band of the video scene is video-frequency band A out, and the end scene Switch Video section of the video scene is view Frequency range E.
Sub-step 2042, according to the time sequencing of scene switching video-frequency band, by the beginning scene switching video-frequency band and institute Whole scene switching video-frequency bands between end scene Switch Video section are stated, the field of the same video scene is determined to belong to Scape Switch Video section;The scene switching video-frequency band for belonging to the same video scene includes the beginning scene switching view Frequency range and the end scene Switch Video section.
Example is connected, according to the time sequencing of scene switching video-frequency band, between video-frequency band A and video-frequency band E, there is also video-frequency bands B, video-frequency band C and video-frequency band D, then video-frequency band A, video-frequency band B, video-frequency band C, video-frequency band D and video-frequency band E belong to same video field Scape.
Step 206, the scene switching video-frequency band for belonging to the same video scene determined is merged into a view Frequently, video clipping is completed.
The scene switching video-frequency band of multiple video scenes of the video of pre- editing is merged into multiple videos respectively, completes view Frequency editing.
In conclusion the embodiment of the present invention is that the video of pre- editing is carried out to scene switching identification, identification obtains having pair The video-frequency band of scene switching one by one that should be related to and one by one scene switching picture.Next it only needs to scene switching picture Judged, select the scene switching picture for belonging to the same video scene, is further selected and scene switching picture Corresponding scene switching video-frequency band, is merged into a video file for scene switching video-frequency band, the editing to video can be realized. The embodiment of the present invention has liberated editorial staff, editorial staff can several videos of editing simultaneously, for live stream editing, Do not need editorial staff's a moment ceaselessly stare at video carry out preview, improve the working efficiency of video clipping.
Embodiment three
A kind of video clipping device provided in an embodiment of the present invention is discussed in detail.
Referring to Fig. 3, a kind of video clipping structure drawing of device in the embodiment of the present invention is shown.
The apparatus may include: scene switching identification module 300, picture selecting module 302, video-frequency band determining module 304, video merging module 306.
The relationship between the function and each module of each module is described in detail below.
Scene switching identification module 300 obtains at least one field for carrying out scene switching identification to the video of pre- editing Scape switches picture and at least one scene switching video-frequency band.
The scene switching picture and the scene switching video-frequency band have corresponding relationship.
Picture selecting module 302, for selecting the field for belonging to the same video scene in the scene switching picture Scape switches picture.
Video-frequency band determining module 304, for corresponding with the scene switching video-frequency band according to the scene switching picture Relationship, and, the scene switching picture for belonging to the same video scene determines the field for belonging to the same video scene Scape Switch Video section.
Video merging module 306, the scene switching video-frequency band for belonging to the same video scene for that will determine A video is merged into, video clipping is completed.
In conclusion the embodiment of the present invention is that the video of pre- editing is carried out to scene switching identification, identification obtains having pair The video-frequency band of scene switching one by one that should be related to and one by one scene switching picture.Next it only needs to scene switching picture Judged, select the scene switching picture for belonging to the same video scene, is further selected and scene switching picture Corresponding scene switching video-frequency band, is merged into a video file for scene switching video-frequency band, the editing to video can be realized. The embodiment of the present invention has liberated editorial staff, editorial staff can several videos of editing simultaneously, for live stream editing, Do not need editorial staff's a moment ceaselessly stare at video carry out preview, improve the working efficiency of video clipping.
Example IV
A kind of video clipping device provided in an embodiment of the present invention is discussed in detail.
Referring to Fig. 4, a kind of video clipping structure drawing of device in the embodiment of the present invention is shown.
The apparatus may include: scene switching identification module 400, picture selecting module 402, video-frequency band determining module 404, video merging module 406 and coding module 408.
Wherein, the scene switching identification module 400 may include: scene switching identification submodule 4001, video scene Determine submodule 4002, scene switching video-frequency band determines that submodule 4003, scene switching picture determine submodule 4004.
The relationship between each module, the function of each submodule and each module, each submodule is described in detail below.
Scene switching identification module 400 obtains at least one field for carrying out scene switching identification to the video of pre- editing Scape switches picture and at least one scene switching video-frequency band.
The scene switching picture and the scene switching video-frequency band have corresponding relationship.
Preferably, the scene switching identification module 400 may include:
Scene switching identifies submodule 4001, for the picture color according to continuous two video frames of the video of pre- editing Difference carries out scene switching identification.
Video scene determines submodule 4002, is less than predetermined threshold for the picture color difference when continuous two video frames When, determine that continuous two video frames belong to the same video scene.
Scene switching video-frequency band determines submodule 4003, and the coding video frames for that will belong to the same video scene are one A scene switching video-frequency band.
Scene switching picture determines submodule 4004, for using first video frame of the scene switching video-frequency band as The scene switching picture of the scene switching video-frequency band.
The video scene determines submodule 4002, is also used to be more than or equal to when the picture color difference of continuous two video frames When the predetermined threshold, determine that continuous two video frames are belonging respectively to different video scenes.
The scene switching video-frequency band determines that submodule 4003 in the different video scenes of the video of pre- editing, is distinguished The scene switching video-frequency band for determining different video scenes obtains at least one scene switching video-frequency band.
The scene switching picture determines submodule 4004 in the different video scenes of the video of pre- editing, and difference is true The scene switching picture of fixed different video scene, obtains at least one scene switching picture.
It preferably, will be described when the scene switching identification module 400 carries out scene switching identification to the video of pre- editing The video data encoding of the video of pre- editing is H.264 standard;It is advanced by the audio data coding of the video of the pre- editing Audio coding AAC standard;According to the video data and the audio data after coding, scene is carried out to the video of pre- editing Switching identification.
Picture selecting module 402, for selecting the field for belonging to the same video scene in the scene switching picture Scape switches picture.
Preferably, the picture selecting module 402 is selected in the scene switching picture and belongs to the same video field The beginning scene switching picture and end scene of scape switch picture.
Video-frequency band determining module 404, for corresponding with the scene switching video-frequency band according to the scene switching picture Relationship, and, the scene switching picture for belonging to the same video scene determines the field for belonging to the same video scene Scape Switch Video section.
Preferably, the video-frequency band determining module 404 can be regarded according to the scene switching picture and the scene switching The corresponding relationship of frequency range, and, the beginning scene switching picture for belonging to the same video scene and end scene switch picture, Determine beginning scene switching video-frequency band corresponding with the beginning scene switching picture, and, switch with the end scene The corresponding end scene Switch Video section of picture;According to the time sequencing of scene switching video-frequency band, by the beginning scene switching Whole scene switching video-frequency bands between video-frequency band and the end scene Switch Video section, are determined to belong to the same view The scene switching video-frequency band of frequency scene;The scene switching video-frequency band for belonging to the same video scene includes the beginning Scene switching video-frequency band and the end scene Switch Video section.
Video merging module 406, the scene switching video-frequency band for belonging to the same video scene for that will determine A video is merged into, video clipping is completed.
Coding module 408, for carrying out scene switching knowledge in video of the scene switching identification module 400 to pre- editing Not, after obtaining at least one scene switching picture and at least one scene switching video-frequency band, by the scene switching video-frequency band Video data encoding be H.264 standard;It is Advanced Audio Coding AAC by the audio data coding of the scene switching video-frequency band Standard.
In conclusion the embodiment of the present invention is that the video of pre- editing is carried out to scene switching identification, identification obtains having pair The video-frequency band of scene switching one by one that should be related to and one by one scene switching picture.Next it only needs to scene switching picture Judged, select the scene switching picture for belonging to the same video scene, is further selected and scene switching picture Corresponding scene switching video-frequency band, is merged into a video file for scene switching video-frequency band, the editing to video can be realized. The embodiment of the present invention has liberated editorial staff, editorial staff can several videos of editing simultaneously, for live stream editing, Do not need editorial staff's a moment ceaselessly stare at video carry out preview, improve the working efficiency of video clipping.
Embodiment five
A kind of video clipping device provided in an embodiment of the present invention is discussed in detail.
Referring to Fig. 5, a kind of video clipping apparatus structure relation schematic diagram in the embodiment of the present invention is shown.
The apparatus may include: edit operation module 500, backstage scheduler module 502, Video coding and scene Recognition mould Block 504, video merging module 506.
The relationship between the function and each module of each module is described in detail below.
Edit operation module 500, for the scene by each video scene in web browser real-time display live stream Switch picture;Pass through the corresponding scene switching video-frequency band of FLV (Flash Video) player preview video scene;Pass through formulation Scene switching picture is starting point and end point on the page, completes live streaming stream video demolition.
Backstage scheduler module 502, for starting Video coding and scene Recognition module 504;Record Video coding and scene The scene switching picture and corresponding scene switching video-frequency band that identification module 504 generates;Handle the scene of edit operation module 500 Switch the request of picture, and returns to scene switching picture list;The request for handling video cutting, finds corresponding scene switching Video-frequency band calls video merging module 506 to generate complete program request file.
Video coding and scene Recognition module 504, for live stream to be encoded into H.264 (video) and AAC (audio);Point The video scene variation for analysing video flowing, changes the corresponding scene switching video-frequency band of generation according to video scene and corresponding scene is cut Change picture, wherein the corresponding scene switching picture of a scene switching video-frequency band.
Preferably, Video coding and scene Recognition module 504 can generate continuous according to the video scene variation in video flowing Multiple FLV segmental files, the corresponding video scene of each FLV segmental file, and each FLV segmental file can correspond to life At the picture of a jpg format as scene switching picture for preview.
Preferably, Video coding and scene Recognition module 504 can also be by FLV segmental files and corresponding scene switching figure Piece is stored in local disk, and notifies that backstage scheduler module 502 is related to scene switching picture in detail FLV segmental file It is stored in database, for later retrieval.
Video merging module 506 for multiple scene switching video-frequency bands to be merged into a complete video file, and mentions Hand over publication.
Above-mentioned edit operation module 500, backstage scheduler module 502, Video coding and scene Recognition module 504, and, depending on The relationship of frequency merging module 506 can indicate are as follows:
1, edit operation module 500 starts backstage scheduler module 502.
2, backstage scheduler module 502 starts Video coding and scene Recognition module 504.
3, Video coding and scene Recognition module 504 carry out coding and scene Recognition to the video of pre- editing, obtain scene Switch picture and scene switching video-frequency band, scene switching picture is returned into backstage scheduler module 502.
4, scene switching picture is returned to edit operation module 500, edit operation module 500 by backstage scheduler module 502 Show all scene switching pictures.
5, edit operation module 500 selects the scene switching picture for belonging to same video scene.
6, backstage scheduler module 502 receives the video merging request of edit operation module 500, and selection belongs to same video field The scene switching video-frequency band of scape, and start video merging module 506.
7, video merging module 506 merges the scene switching video-frequency band for belonging to same video scene, and notifies Video coding Continue Video coding and scene Recognition with scene Recognition module 504.
Below by taking news demolition as an example, the relationship in the embodiment of the present invention between each module is introduced.
Step 1: edit operation module 500 notifies backstage scheduler module 502 to start a live stream scene Recognition.
Step 2: Video coding and scene Recognition module 504 ceaselessly analyze live streaming stream video, and each video scene is known It does not come out, and corresponding video scene is encoded into FLV file and scene switching picture is stored in disk, and backstage is notified to adjust It spends module 502 and is stored in database.
Step 3: edit operation module 500 requests backstage scheduler module 502 to return to designated time period according to system time All scene switching pictures, and be shown on browser page.
Step 4: edit operation module 500 according to the scene switching picture of display, determine news demolition beginning picture and Terminate picture, and relevant information is submitted into backstage scheduler module 502.
Step 5: backstage scheduler module 502 is found in the database according to the relevant information for starting picture and end picture Then corresponding FLV file calls video merging module 506 to generate a complete program request FLV file.
In conclusion the embodiment of the present invention is that the video of pre- editing is carried out to scene switching identification, identification obtains having pair The video-frequency band of scene switching one by one that should be related to and one by one scene switching picture.Next it only needs to scene switching picture Judged, select the scene switching picture for belonging to the same video scene, is further selected and scene switching picture Corresponding scene switching video-frequency band, is merged into a video file for scene switching video-frequency band, the editing to video can be realized. The embodiment of the present invention has liberated editorial staff, editorial staff can several videos of editing simultaneously, for live stream editing, Do not need editorial staff's a moment ceaselessly stare at video carry out preview, improve the working efficiency of video clipping.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It is provided for the embodiments of the invention a kind of video clipping method and device above, is described in detail, herein In apply that a specific example illustrates the principle and implementation of the invention, the explanation of above example is only intended to sides Assistant solves method and its core concept of the invention;At the same time, for those skilled in the art, think of according to the present invention Think, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not be construed as pair Limitation of the invention.

Claims (8)

1. a kind of video clipping method characterized by comprising
Scene switching identification is carried out to the video of pre- editing, obtains at least one scene switching picture and at least one scene switching Video-frequency band;The scene switching picture and the scene switching video-frequency band have corresponding relationship;The video to pre- editing into The identification of row scene switching includes: to analyze the decoded yuv data of the video of pre- editing, according to continuous the two of the video of pre- editing The picture color difference of a video frame carries out scene switching identification;
When the picture color difference of continuous two video frames is less than predetermined threshold, it is same to determine that continuous two video frames belong to A video scene;It is a scene switching video-frequency band by the coding video frames for belonging to the same video scene;
When the picture color difference of continuous two video frames is more than or equal to the predetermined threshold, continuous two video frames are determined It is belonging respectively to different video scenes;
In the scene switching picture, the scene switching picture for belonging to the same video scene is selected;It include: in the field Scape switches in picture, selects the beginning scene switching picture for belonging to the same video scene and end scene switching picture;
According to the corresponding relationship of the scene switching picture and the scene switching video-frequency band, and, it is described to belong to the same video The scene switching picture of scene determines the scene switching video-frequency band for belonging to the same video scene;
The scene switching video-frequency band for belonging to the same video scene determined is merged into a video, video is completed and cuts Volume.
2. the method according to claim 1, wherein the video to pre- editing carries out scene switching identification, Obtain at least one scene switching picture and at least one scene switching video-frequency band, further includes:
Using first video frame of the scene switching video-frequency band as the scene switching picture of the scene switching video-frequency band;
In the different video scenes of the video of pre- editing, scene switching picture and the field of different video scenes are determined respectively Scape Switch Video section obtains at least one scene switching picture and at least one scene switching video-frequency band.
3. the method according to claim 1, wherein the video to pre- editing carries out scene switching identification, After obtaining at least one scene switching picture and at least one scene switching video-frequency band, which comprises
It is H.264 standard by the video data encoding of the scene switching video-frequency band;
It is Advanced Audio Coding AAC standard by the audio data coding of the scene switching video-frequency band.
4. the method according to claim 1, wherein described cut according to the scene switching picture with the scene The corresponding relationship of video-frequency band is changed, and, the scene switching picture for belonging to the same video scene is determined to belong to the same institute State the scene switching video-frequency band of video scene, comprising:
According to the corresponding relationship of the scene switching picture and the scene switching video-frequency band, and, it is described to belong to the same video The beginning scene switching picture and end scene of scene switch picture, determine open corresponding with the beginning scene switching picture Beginning scene switching video-frequency band, and, end scene Switch Video section corresponding with end scene switching picture;
According to the time sequencing of scene switching video-frequency band, the beginning scene switching video-frequency band and end scene switching are regarded Whole scene switching video-frequency bands between frequency range, are determined to belong to the scene switching video-frequency band of the same video scene;Institute State that belong to the scene switching video-frequency band of the same video scene include the beginning scene switching video-frequency band and the end Scene switching video-frequency band.
5. a kind of video clipping device characterized by comprising
Scene switching identification module obtains at least one scene switching for carrying out scene switching identification to the video of pre- editing Picture and at least one scene switching video-frequency band;The scene switching picture has corresponding close with the scene switching video-frequency band System;The scene switching identification module is also used to analyze the decoded yuv data of the video of pre- editing, and the scene switching is known Other module includes: scene switching identification submodule, for the picture color according to continuous two video frames of the video of pre- editing Difference carries out scene switching identification;
The scene switching identification module further include: video scene determines submodule, for working as the picture of continuous two video frames When color difference is less than predetermined threshold, determine that continuous two video frames belong to the same video scene;
Scene switching video-frequency band determines submodule, for being that a scene is cut by the coding video frames for belonging to the same video scene Change video-frequency band;
The video scene determines submodule, is also used to be more than or equal to described make a reservation for when the picture color difference of continuous two video frames When threshold value, determine that continuous two video frames are belonging respectively to different video scenes;
Picture selecting module, for selecting the scene switching for belonging to the same video scene in the scene switching picture Picture;The picture selecting module selects the beginning scene for belonging to the same video scene in the scene switching picture Switch picture and end scene switches picture;
Video-frequency band determining module, for the corresponding relationship according to the scene switching picture and the scene switching video-frequency band, and, The scene switching picture for belonging to the same video scene determines the scene switching view for belonging to the same video scene Frequency range;
Video merging module, for the scene switching video-frequency band for belonging to the same video scene determined to be merged into one A video completes video clipping.
6. device according to claim 5, which is characterized in that the scene switching identification module, further includes:
Scene switching picture determines submodule, for cutting first video frame of the scene switching video-frequency band as the scene Change the scene switching picture of video-frequency band;
The scene switching video-frequency band determines that submodule in the different video scenes of the video of pre- editing, determines different respectively Video scene scene switching video-frequency band, obtain at least one scene switching video-frequency band;
The scene switching picture determines that submodule in the different video scenes of the video of pre- editing, determines different respectively The scene switching picture of video scene obtains at least one scene switching picture.
7. device according to claim 5, which is characterized in that described device further include:
Coding module, for carrying out scene switching identification to the video of pre- editing in the scene switching identification module, obtain to After a few scene switching picture and at least one scene switching video-frequency band, by the video data of the scene switching video-frequency band It is encoded to H.264 standard;It is Advanced Audio Coding AAC standard by the audio data coding of the scene switching video-frequency band.
8. device according to claim 5, which is characterized in that the video-frequency band determining module is according to the scene switching figure The corresponding relationship of piece and the scene switching video-frequency band, and, the beginning scene switching picture for belonging to the same video scene Switch picture with end scene, determines beginning scene switching video-frequency band corresponding with the beginning scene switching picture, and, End scene Switch Video section corresponding with end scene switching picture;According to the time sequencing of scene switching video-frequency band, By whole scene switching video-frequency bands between the beginning scene switching video-frequency band and the end scene Switch Video section, determine For the scene switching video-frequency band for belonging to the same video scene;The scene switching for belonging to the same video scene Video-frequency band includes the beginning scene switching video-frequency band and the end scene Switch Video section.
CN201410488331.4A 2014-09-22 2014-09-22 A kind of video clipping method and device Active CN104284241B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410488331.4A CN104284241B (en) 2014-09-22 2014-09-22 A kind of video clipping method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410488331.4A CN104284241B (en) 2014-09-22 2014-09-22 A kind of video clipping method and device

Publications (2)

Publication Number Publication Date
CN104284241A CN104284241A (en) 2015-01-14
CN104284241B true CN104284241B (en) 2019-01-22

Family

ID=52258645

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410488331.4A Active CN104284241B (en) 2014-09-22 2014-09-22 A kind of video clipping method and device

Country Status (1)

Country Link
CN (1) CN104284241B (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104732991B (en) * 2015-04-08 2017-08-25 成都索贝数码科技股份有限公司 A kind of fast finishing, the system and method selected and edit variety show magnanimity material
CN106375872A (en) * 2015-07-24 2017-02-01 三亚中兴软件有限责任公司 Method and device for video editing
CN105007524A (en) * 2015-07-29 2015-10-28 无锡天脉聚源传媒科技有限公司 Video processing method and device
CN105657537B (en) * 2015-12-23 2018-06-19 小米科技有限责任公司 Video clipping method and device
CN106804002A (en) * 2017-02-14 2017-06-06 北京时间股份有限公司 A kind of processing system for video and method
CN108830208A (en) * 2018-06-08 2018-11-16 Oppo广东移动通信有限公司 Method for processing video frequency and device, electronic equipment, computer readable storage medium
CN110119711B (en) * 2019-05-14 2021-06-11 北京奇艺世纪科技有限公司 Method and device for acquiring character segments of video data and electronic equipment
CN111263234B (en) * 2020-01-19 2021-06-15 腾讯科技(深圳)有限公司 Video clipping method, related device, equipment and storage medium
CN111601160A (en) * 2020-05-29 2020-08-28 北京百度网讯科技有限公司 Method and device for editing video
CN112911332B (en) * 2020-12-29 2023-07-25 百度在线网络技术(北京)有限公司 Method, apparatus, device and storage medium for editing video from live video stream
CN112381076B (en) * 2021-01-18 2021-03-23 西南石油大学 Method for preprocessing picture in video significance detection task
CN113709584A (en) * 2021-03-05 2021-11-26 腾讯科技(北京)有限公司 Video dividing method, device, server, terminal and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101872346A (en) * 2009-04-22 2010-10-27 中国科学院自动化研究所 Method for generating video navigation system automatically
CN103065153A (en) * 2012-12-17 2013-04-24 西南科技大学 Video key frame extraction method based on color quantization and clusters
CN103210651A (en) * 2010-11-15 2013-07-17 华为技术有限公司 Method and system for video summarization
CN103440640A (en) * 2013-07-26 2013-12-11 北京理工大学 Method for clustering and browsing video scenes
CN103716712A (en) * 2013-12-31 2014-04-09 上海艾麒信息科技有限公司 Video processing method based on mobile terminal
CN103905742A (en) * 2014-04-10 2014-07-02 北京数码视讯科技股份有限公司 Video file segmentation method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101872346A (en) * 2009-04-22 2010-10-27 中国科学院自动化研究所 Method for generating video navigation system automatically
CN103210651A (en) * 2010-11-15 2013-07-17 华为技术有限公司 Method and system for video summarization
CN103065153A (en) * 2012-12-17 2013-04-24 西南科技大学 Video key frame extraction method based on color quantization and clusters
CN103440640A (en) * 2013-07-26 2013-12-11 北京理工大学 Method for clustering and browsing video scenes
CN103716712A (en) * 2013-12-31 2014-04-09 上海艾麒信息科技有限公司 Video processing method based on mobile terminal
CN103905742A (en) * 2014-04-10 2014-07-02 北京数码视讯科技股份有限公司 Video file segmentation method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"一种基于镜头的视频场景检测方法";黄少年等;《计算机工程与应用》;20060710;第42卷(第19期);正文第2.2至2.4节

Also Published As

Publication number Publication date
CN104284241A (en) 2015-01-14

Similar Documents

Publication Publication Date Title
CN104284241B (en) A kind of video clipping method and device
US10430664B2 (en) System for automatically editing video
US6989868B2 (en) Method of converting format of encoded video data and apparatus therefor
CN108989885B (en) Video file transcoding system, segmentation method, transcoding method and device
EP1168840A2 (en) Method and apparatus for special video reproduction modes
US9438924B2 (en) Video encoding apparatus, video decoding apparatus, video encoding method, and video decoding method
WO2017107442A1 (en) Video transcoding method and device
JP4253139B2 (en) Frame information description method, frame information generation apparatus and method, video reproduction apparatus and method, and recording medium
CN113347489B (en) Video clip detection method, device, equipment and storage medium
CN107820095A (en) A kind of long term reference image-selecting method and device
CA2689441C (en) A system and method for time optimized encoding
CN105898373A (en) Video slicing method and device
CN110545418A (en) Self-adaptive video coding method based on scene
KR20180091829A (en) Transcoding method and apparatus
CN109618111B (en) Cloud-shear multi-channel distribution system
CN106231413B (en) A kind of automatic division processing method of audio, video data based on intelligent terminal and system
JP5096259B2 (en) Summary content generation apparatus and summary content generation program
CN114827663A (en) Distributed live broadcast frame insertion system and method
US20040223739A1 (en) Disc apparatus, disc recording method, disc playback method, recording medium, and program
WO2020227994A1 (en) Video decoding method, video decoding apparatus, storage medium and electronic device
CN107623852B (en) Method and device for coding and frame reduction of digital video signal
CN106354736A (en) Judgment method and device of repetitive video
CN105357531A (en) Rapid cutting packaging method based on video local encoding
CN101902631A (en) Method for rapidly positioning static scene in compressed video
JP2000023090A (en) Compressed moving image editing device and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant