CN106028088A - Insertion method and device of media data - Google Patents
Insertion method and device of media data Download PDFInfo
- Publication number
- CN106028088A CN106028088A CN201610437530.1A CN201610437530A CN106028088A CN 106028088 A CN106028088 A CN 106028088A CN 201610437530 A CN201610437530 A CN 201610437530A CN 106028088 A CN106028088 A CN 106028088A
- Authority
- CN
- China
- Prior art keywords
- timing node
- node
- timing
- information
- media data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012966 insertion method Methods 0.000 title claims abstract description 22
- 238000003780 insertion Methods 0.000 claims abstract description 97
- 230000037431 insertion Effects 0.000 claims abstract description 97
- 230000001143 conditioned effect Effects 0.000 claims description 88
- 238000004040 coloring Methods 0.000 claims description 85
- 239000000284 extract Substances 0.000 claims description 34
- 238000000034 method Methods 0.000 claims description 33
- 238000001514 detection method Methods 0.000 claims description 31
- 238000010168 coupling process Methods 0.000 claims description 15
- 238000005859 coupling reaction Methods 0.000 claims description 15
- 230000008878 coupling Effects 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 13
- 238000012216 screening Methods 0.000 claims description 12
- 238000003860 storage Methods 0.000 description 28
- 238000006073 displacement reaction Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 230000015654 memory Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 210000003205 muscle Anatomy 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000010200 validation analysis Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
- H04N21/26241—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the time of distribution, e.g. the best time of the day for inserting an advertisement or airing a children program
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses an insertion method and device of media data. The insertion method comprises the steps of obtaining a media resource waiting for insertion of the media data; detecting whether a time node with scene switching information satisfying a preset condition exists in the media resource; if the fact that the time node with the scene switching information satisfying the preset condition exists in the media resource is detected, regarding the time node as the insertion time node of the media data; and inserting the media data to the media resource according to the insertion time node. According to the insertion method and device of the media data, the technical problems of low efficiency and high error rate of manual insertion of the media data in the prior art are solved, and the effects of improving the insertion efficiency of media data, saving the labor force for insertion of the media data, reducing the error rate of the insertion of the media data, meeting the requirement of a user on media resource continuity and improving the watching experience of the user are achieved.
Description
Technical field
The present invention relates to multimedia resource field, in particular to the insertion side of a kind of media data
Method and device.
Background technology
Along with the fast development of the Internet, increasing user obtains media resource by the Internet
(such as, video resource), such as, by Tengxun's videoconference client, watch video online.Media number
Also begin to more pay close attention to interpolation matchmaker in media resource according to throwing in business (such as, advertisement putting business)
Volume data (such as, advertisement), therefrom can obtain more income.
But, existing media data is inserted in before media resource commences play out mostly, whole matchmaker
In the playing process of body resource, and it is not inserted into, causes media resource utilization rate low, obtain income relatively low.
In order to improve the utilization rate of media resource, manual type can be passed through, insert corresponding in media resource
Media data, but, when media resource is more, and when the media resource time is longer, by manually
It is inefficient that mode inserts media resource, and easily makes mistakes, and, it is optionally plugged in media resource
Media data, can cause the continuity of media resource to decline, and user's viewing experience is poor.
For of the prior art by the artificial skill that efficiency is low and error rate is high inserting media data
Art problem, the most not yet proposes effective solution.
Summary of the invention
Embodiments provide insertion method and the device of a kind of media data, existing at least to solve
There is the technical problem that efficiency is low and error rate is high by artificial insertion media data in technology.
An aspect according to embodiments of the present invention, it is provided that the insertion method of a kind of media data, bag
Include: obtaining the media resource being inserted into media data, wherein, media resource includes: be used for inserting matchmaker
Multiple timing nodes of volume data, and the image of each timing node;In detection media resource whether
There is scene handover information and meet pre-conditioned timing node, wherein, scene handover information at least wraps
Include one of following: movable information and colouring information;Scene switching letter is there is in media resource being detected
In the case of breath meets pre-conditioned timing node, during using timing node as the insertion of media data
Intermediate node;According to inserting timing node, media data is inserted media resource.
Another aspect according to embodiments of the present invention, additionally provides the insertion apparatus of a kind of media data,
Including: the first acquisition module, for obtaining the media resource being inserted into media data, wherein, media
Resource includes: for inserting multiple timing nodes of media data, and the image of each timing node;
Detection module, for detect whether media resource exists scene handover information meet pre-conditioned time
Intermediate node, wherein, scene handover information at least includes one of following: movable information and colouring information;
First processing module, meets pre-conditioned for there is scene handover information in media resource being detected
Timing node in the case of, using timing node as the insertion timing node of media data;Insert mould
Block, for according to inserting timing node, inserting media resource by media data.
In embodiments of the present invention, after getting the media resource being inserted into media data, pass through
Whether detection media resource exists scene handover information and meets pre-conditioned timing node, in detection
Exist in the case of scene handover information meets pre-conditioned timing node in media resource, by time
Intermediate node as the insertion timing node of media data, and according to insert timing node, by media data
Insert media resource.By the embodiment of the present invention, can be by detection media resource occurs that scene is cut
The timing node changed, obtains the insertion timing node of media data, thus realize in media resource from
Dynamic insert media data, solve of the prior art low by the artificial efficiency inserting media data and
The technical problem that error rate is high, improves the efficiency inserting media data, saves and inserts media data, fall
It is inserted into the error rate of media data, meets user's requirement successional to media resource, promote user
The experience of viewing.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the one of the application
Part, the schematic description and description of the present invention is used for explaining the present invention, is not intended that this
Bright improper restriction.In the accompanying drawings:
Fig. 1 is that the computer of a kind of insertion method for media data according to embodiments of the present invention is whole
The structured flowchart of end;
Fig. 2 is the flow chart of the insertion method of a kind of media data of according to embodiments of the present invention;
Fig. 3 is the schematic diagram of a kind of optional fusion same scene of according to embodiments of the present invention;
Fig. 4 is the schematic diagram of a kind of optional movement locus estimation of according to embodiments of the present invention;
Fig. 5 is the signal of a kind of optional media resource conversion resolution of according to embodiments of the present invention
Figure;
Fig. 6 is the signal of a kind of optional media resource color quantizing of according to embodiments of the present invention
Figure;
Fig. 7 is the insertion timing node of a kind of optional media data of according to embodiments of the present invention
Schematic diagram;
Fig. 8 is the flow process of the insertion method of a kind of optional media data of according to embodiments of the present invention
Figure;
Fig. 9 is the schematic diagram of the insertion apparatus of a kind of media data of according to embodiments of the present invention two;
Figure 10 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two
It is intended to;
Figure 11 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two
It is intended to;
Figure 12 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two
It is intended to;
Figure 13 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two
It is intended to;And
Figure 14 is the structured flowchart of a kind of terminal according to embodiments of the present invention.
Detailed description of the invention
In order to make those skilled in the art be more fully understood that the present invention program, below in conjunction with the present invention
Accompanying drawing in embodiment, is clearly and completely described the technical scheme in the embodiment of the present invention,
Obviously, described embodiment is only the embodiment of a present invention part rather than whole enforcement
Example.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creative work
The every other embodiment obtained under premise, all should belong to the scope of protection of the invention.
It should be noted that the term in description and claims of this specification and above-mentioned accompanying drawing
" first ", " second " etc. are for distinguishing similar object, without be used for describing specific order or
Precedence.Should be appreciated that the data of so use can be exchanged in the appropriate case, in order to retouch here
The embodiments of the invention stated can be real with the order in addition to those here illustrating or describing
Execute.Additionally, term " includes " and " having " and their any deformation, it is intended that cover and do not arrange
He comprises, such as, contain series of steps or the process of unit, method, system, product or
Equipment is not necessarily limited to those steps or the unit clearly listed, but can include the most clearly listing
Or for intrinsic other step of these processes, method, product or equipment or unit.
Embodiment 1
The embodiment of the method that the embodiment of the present invention one is provided can mobile terminal, terminal or
The arithmetic unit that person is similar to performs.As a example by running on computer terminals, Fig. 1 is according to this
A kind of structured flowchart of the terminal of the insertion method for media data of bright embodiment.Such as figure
Shown in 1, the terminal 10 for the insertion method of media data can include one or more
(only illustrating one in figure) (processor 102 can include but not limited to microprocessor to processor 102
The processing means of MCU or PLD FPGA etc.), for storing the memorizer of data
104 and for the transmitting device 106 of communication function.It will appreciated by the skilled person that
Structure shown in Fig. 1 is only signal, and the structure of above-mentioned electronic installation is not caused restriction by it.Such as,
Terminal 10 may also include the assembly more or more less than shown in Fig. 1, or have with
Configurations different shown in Fig. 1.
Memorizer 104 can be used for storing software program and the module of application software, such as the present invention
Programmed instruction/module that the insertion method of the media data in embodiment is corresponding, processor 102 is by fortune
Row is stored in the software program in memorizer 104 and module, thus perform the application of various function and
Data process, and i.e. realize the insertion method of above-mentioned media data.Memorizer 104 can include at a high speed with
Machine memorizer, may also include nonvolatile memory, such as one or more magnetic storage device, sudden strain of a muscle
Deposit or other non-volatile solid state memories.In some instances, memorizer 104 can be further
Including the memorizer remotely located relative to processor 102, these remote memories can pass through network
It is connected to terminal 10.The example of above-mentioned network include but not limited to the Internet, intranet,
LAN, mobile radio communication and combinations thereof.
Transmitting device 106 is for receiving via a network or sending data.Above-mentioned network is concrete
Example can include the wireless network that the communication providers of terminal 10 provides.In an example,
Transmitting device 106 includes a network adapter (Network Interface Controller, NIC),
It can be connected with other network equipments by base station thus can carry out communication with the Internet.At an example
In, transmitting device 106 can be radio frequency (Radio Frequency, RF) module, and it is used for passing through
Wireless mode and the Internet carry out communication.
Under above-mentioned running environment, the invention provides the insertion method of media data as shown in Figure 2.
Fig. 2 is the flow chart of the insertion method of a kind of media data of according to embodiments of the present invention, the method
May include steps of:
Step S21, obtains the media resource being inserted into media data, and wherein, media resource includes:
For inserting multiple timing nodes of media data, and the image of each timing node.
Above-mentioned media resource can be video resource, can comprise multiple for inserting matchmaker in video resource
The timing node of volume data, video resource can be by the image construction of multiple timing nodes.Above-mentioned media
Data can be advertisement.
In the optional scheme of one, can input and need to insert advertisement by the way of outside inputs
Video.
Whether step S23, exist scene handover information when meeting pre-conditioned in detection media resource
Intermediate node, wherein, scene handover information at least includes one of following: movable information and colouring information.
Above-mentioned scene handover information can be in media resource, for symbolizing the letter of on-the-spot scape switching
Breath, in actual processing procedure, can be indicated with movable information, colouring information.Above-mentioned pre-
If condition could be for determining in media resource the condition that scene switches whether occur, such as, motion
Information is more than particular value, or the similarity of colouring information is less than particular value.
In the optional scheme of one, after obtaining the video of input, video can be carried out scene
Whether there is movable information in change detection, i.e. detection video, colouring information meets scene switching condition
Timing node, thus obtain that video occurs the timing node that scene switches.
, in media resource being detected, there is scene handover information when meeting pre-conditioned in step S25
In the case of intermediate node, using timing node as the insertion timing node of media data.
In the optional scheme of one, the feelings of the timing node occurring that scene switches detected in video
Under condition, the timing node that the timing node detected can be inserted as advertisement, i.e. throw in user
The timing node of advertisement.
Step S27, according to inserting timing node, inserts media resource by media data.
In the optional scheme of one, timing node corresponding in video, example can be inserted advertisements into
As, during user watches video, when the timing node that video is current arrives the insertion of advertisement
In the case of intermediate node, suspend video playback, play the advertisement of input to user, when advertisement plays
After Biing, continue to play the video of user's viewing.
Use the embodiment of the present invention, after getting the media resource being inserted into media data, pass through
Whether detection media resource exists scene handover information and meets pre-conditioned timing node, in detection
Exist in the case of scene handover information meets pre-conditioned timing node in media resource, by time
Intermediate node as the insertion timing node of media data, and according to insert timing node, by media data
Insert media resource.By the embodiment of the present invention, can be by detection media resource occurs that scene is cut
The timing node changed, obtains the insertion timing node of media data, thus realize in media resource from
Dynamic insert media data, solve of the prior art low by the artificial efficiency inserting media data and
The technical problem that error rate is high, improves the efficiency inserting media data, saves and manually inserts media data,
Reduce the error rate inserting media data, meet user's requirement successional to media resource, promote and use
The experience of family viewing.
According to the above embodiment of the present invention, include at scene handover information: movable information or colouring information
In the case of, step S23, whether detection media resource exists scene handover information and meets default bar
The timing node of part, including:
Step S2311, from the image of each timing node, extracts the motion letter of each timing node
Breath or colouring information.
Above-mentioned movable information can be the destination object of display in image, such as, object, human body etc.
Motion vector, above-mentioned colouring information can be the color histogram of color in image.
In the optional scheme of one, can extract corresponding from the video image of each timing node
Motion vector or color histogram, obtain the scene handover information of each timing node.
Step S2313, calculates the colouring information of any one timing node and the face of adjacent time node
First similarity of color information.
In the optional scheme of one, in the video image from each timing node, obtain corresponding
After color histogram, the color histogram that can calculate any one timing node saves with adjacent time
The similarity of the color histogram of point.
Herein it should be noted that be the situation of movable information of each timing node extract
Under, do not perform step S2313.
Step S2315, it is judged that whether the movable information of any one timing node meets first is preset bar
Part, or the first similarity whether to meet second pre-conditioned.
Above-mentioned first pre-conditioned can be that minimum movement information or the motion letter that scene switches occurs
, such as, there is the least displacement vector that scene switches, or the displacement that scene switches occurs in breath interval
Vector is interval.Due to two same or like images, there is similar colouring information, i.e. two
The similarity of the colouring information of image is the highest, therefore, above-mentioned second pre-conditioned can be that scene occurs
The maximum similarity of switching, or occur that the similarity that scene switches is interval.
In the optional scheme of one, in the video image from each timing node, obtain corresponding
After motion vector, the motion vector of each timing node can be compared with least displacement vector
Relatively, or by the motion vector of each timing node compare with motion vector interval.
In the optional scheme of another kind, save with adjacent time being calculated any one timing node
After the similarity of the color histogram of point, calculated similarity can be entered with maximum similarity
Row compares, or calculated similarity is compared with similarity interval.
Step S2317, the movable information at any one timing node described meets described first to be preset
Condition, or described first similarity meet described second pre-conditioned in the case of, determine described arbitrarily
One timing node is described to meet pre-conditioned timing node.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime
The amount of shifting to, or the motion vector of node sometime is in motion vector interval, it is determined that this time
Intermediate node occurs that scene switches, i.e. this timing node is the timing node that scene switches occur.
In the optional scheme of another kind, if calculated similarity is similar less than or equal to maximum
Spend, or calculated similarity is in similarity interval, it is determined that this timing node goes out scene
Scape switches, i.e. the timing node that scene switches occurs in this timing node position.
According to the above embodiment of the present invention, include at scene handover information: movable information and colouring information
In the case of, step S23, whether detection media resource exists scene handover information and meets default bar
The timing node of part, including:
Step S2331, from the image of each timing node, extracts the motion letter of each timing node
Breath and colouring information.
In the optional scheme of one, can extract corresponding from the video image of each timing node
Motion vector or color histogram, obtain the scene handover information of each timing node.
Step S2333, it is judged that whether the movable information of any one timing node meets first is preset bar
Part.
In the optional scheme of one, in the video image from each timing node, obtain corresponding
After motion vector, the motion vector of each timing node can be compared with least displacement vector
Relatively, or by the motion vector of each timing node compare with motion vector interval.
Step S2335, the movable information at any one timing node meets the first pre-conditioned feelings
Under condition, calculate the of the colouring information of any one timing node and the colouring information of adjacent time node
Two similarities.
In order to avoid occurring sentencing, determining that node is to occur that scene is cut sometime by movable information more
After the timing node changed, two images that be will appear from scene switching by colouring information are needed to carry out face
Color ratio relatively, will compare with the colouring information of adjacent time node by the colouring information of this timing node
Relatively.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime
The amount of shifting to, or the motion vector of node sometime is in motion vector interval, then can calculate
The similarity of the color histogram of the color histogram of this timing node and adjacent time node, during to this
Intermediate node is verified.
Step S2337, it is judged that it is pre-conditioned whether the first similarity meets second.
In the optional scheme of one, can compare with maximum similarity with calculated similarity
Relatively, or by calculated similarity compare with similarity interval.
Step S2339, the second similarity meet second pre-conditioned in the case of, determine any one
Individual timing node is timing node.
In the optional scheme of one, if calculated similarity is less than or equal to minimum similarity degree,
Or calculated similarity is in similarity interval, it is determined that this timing node passes through checking,
Determine that this timing node is the timing node that scene switches occur.
By above-mentioned steps S2331 to step S2339, satisfied can determined by movable information
After one pre-conditioned timing node, by colouring information, this timing node is verified, only
Can be as the insertion timing node of media data by the timing node of checking, thus segmentum intercalaris when reducing
That puts chooses error, reduces the error rate that media data inserts further.
Herein it should be noted that obtain by checking timing node after, as it is shown on figure 3,
The image by 6 timing nodes verified, timing node 1-6 the most as shown in Figure 3 can be obtained
Image, although, the similarity of the colouring information of each adjacent timing node is relatively low, but, as
The similarity of the colouring information of the timing node 1 shown in Fig. 3, timing node 3 and timing node 6 is very
Height, the similarity of the colouring information of timing node 2, timing node 4 and timing node 5 is the highest, i.e.
The image of above-mentioned 6 timing nodes belongs to same scene.Believe iff according to movable information and color
Breath judges, using the inserting as media data of any one timing node in above-mentioned 6 timing nodes
Angle of incidence node, it may appear that inserted by media data in same scene, causes user to watch media resource
During, experience sense is poor, occurs being sick of sense to media data.
In order to solve the problems referred to above, obtain scene handover information in detection and meet pre-conditioned time segmentum intercalaris
After Dian, scene switching can be merged, the scene repeated is fused into identical field
Scape, can avoid being inserted in same scene media data.
According to the above embodiment of the present invention, in step S25, using timing node inserting as media data
Before angle of incidence node, said method also includes:
Step S271, from timing node, segmentum intercalaris when obtaining two in preset range of time difference
Point.
Herein it should be noted that owing to the time difference between the timing node of same scene is less, because of
In preset range two timing nodes of time difference can be judged, above-mentioned preset range by this
Can be the time difference of the timing node of the same scene obtained by lot of experiment validation, such as, can
Being 5 minutes.
In the optional scheme of one, time difference can be obtained and exists from the timing node by checking
Any two timing node in preset range, such as, time difference is less than or equal to any the two of 5 minutes
Individual timing node.
Step S273, it is judged that whether the image of two timing nodes is same scene.
Step S275, in the case of the image of two timing nodes is same scene, from time segmentum intercalaris
Point is deleted at least one timing node between two timing nodes, and two timing nodes,
Timing node after screening.
In the optional scheme of one, if it is determined that the time difference any two time in preset range
The image of node belongs to same scene, is melted by all timing nodes within two timing nodes
Close, and reject from the timing node that detection obtains, the timing node after being screened.
Step S277, the timing node after screening is as the insertion timing node of media data.
By above-mentioned steps S271 to step S273, time difference can got in preset range
Two timing nodes after, whether be same scene by judging the image of two timing nodes, right
Detect that meeting pre-conditioned timing node screens, and obtains the timing node of non-equal scene,
Thus reduce the error rate that media data inserts, promote the viewing experience of user.
According to the above embodiment of the present invention, step S273, it is judged that whether the image of two timing nodes
For same scene, including:
Step S2731, calculates the third phase of colouring information of two timing nodes like degree.
Step S2733, it is judged that it is pre-conditioned whether third phase meets second like degree.
Step S2735, third phase like degree meet second pre-conditioned in the case of, when determining two
The image of intermediate node is same scene.
In the optional scheme of one, getting the time difference any two time in preset range
After node, the similarity of the color histogram of these two timing nodes can be calculated, if calculated
To similarity more than occurring at the maximum similarity that scene switches, or calculated similarity
In similarity interval, it is determined that the image of these two timing nodes is same or like image, thus
The image determining these two timing nodes is same scene.
According to the above embodiment of the present invention, step S2311 or step S2331, from each timing node
Image in, extract the movable information of each timing node, including:
Step S235, carries out movement locus estimation, when obtaining each to the image of each timing node
The motion vector of intermediate node.
Herein it should be noted that the accuracy of motion vector in order to ensure each timing node, can
With the image by any one timing node of comparison with adjacent multiple timing nodes, obtain segmentum intercalaris time this
The motion vector of point.
In the optional scheme of one, as shown in Figure 4, media resource includes 5 timing nodes,
Timing node A, timing node A1, timing node A2, timing node A3 and timing node B,
In order to the image of timing node A is carried out movement locus estimation, can be according to above-mentioned 5 timing nodes
Image, the square object in image is carried out Displacement Estimation, with the square in timing node A
The position of object is starting point, with the position of the square object in timing node B as terminal, obtains phase
The motion vector (as shown by the arrows in Figure 4) answered, thus obtain the motion vector of timing node A.
If herein also, it should be noted the image of any one timing node and adjacent time node
In there is not identical object, timing node 1 as shown in Figure 3 and timing node 2, it is determined that two
Individual image is not same or like image, occurs that scene switches, and can be made by maximum displacement vector
Motion vector for this node.
Herein also, it should be noted carry out the speed of movement locus estimation to improve each timing node
Degree, before media resource is carried out movement locus estimation, can reduce media resource, will
Media resource is converted to the media resource of small in resolution, such as, as it is shown in figure 5, can be by left side
The video of bigger resolution, is converted to the video of right side small in resolution.
According to the above embodiment of the present invention, step S2311 or step S2331, from each timing node
Image in, extract the colouring information of each timing node, including:
Step S237, the color of image based on each timing node, obtain each timing node
Color histogram.
In the optional scheme of one, can using the color of the image of each timing node as feature,
The color histogram of structural map picture.
Herein it should be noted that for the impact reducing noise, and the color improving structural map picture is straight
The speed of side's figure, in the color of image based on each timing node, obtains the face of each timing node
Before Color Histogram, media resource can be carried out color quantizing process, be transformed into 1024 kinds of colors,
For example, it is possible to by video as shown in Figure 6, be converted to the video of 1024 kinds of colors.
According to the above embodiment of the present invention, in step S25, using timing node inserting as media data
Before angle of incidence node, said method also includes:
Step S291, obtain media data insertion information, wherein, insertion information at least include as
Lower any one or more information: the quantity of media data, inserts the time period and inserts time interval.
Step S293, obtains the timing node with insertion information matches in timing node.
Step S295, using the timing node of coupling as the insertion timing node of media data.
In the optional scheme of one, after obtaining the timing node that scene switches occurs, Ke Yigen
According to the quantity of the advertisement needing insertion, time period and interval, and the insertion of the advertisement inserted as required
Information, screens the timing node obtained, and the scene obtaining the insertion information matches with advertisement is cut
The timing node changed, as the insertion timing node of advertisement.Such as, as it is shown in fig. 7, pass through screening
After can be using the timing node of this image as the insertion timing node of advertisement.
By above-mentioned steps S291 to step S295, can be right according to the insertion information of media data
The timing node detected screens, and obtains the insertion timing node of media data, thus realizes inserting
Angle of incidence node has higher controllability.
According to the above embodiment of the present invention, step S293, with insertion information in acquisition timing node
The timing node joined, including:
Step S2931, obtains and is in the multiple timing nodes inserted in the time period.
Step S2933, according to quantity and the insertion time interval of media data, to multiple timing nodes
Screen, obtain the timing node of coupling.
In the optional scheme of one, can choose within being positioned at the time period according to the time period of advertisement
Multiple timing nodes, and according to the quantity of advertisement and interval, from multiple timing nodes, choose coupling
Timing node, as the insertion timing node of advertisement.
The insertion method of media data provided above-described embodiment below is in another optional embodiment
In be described, concrete steps as shown in Figure 8:
Step S81, input medium resource.
Optionally, the video of input is obtained.
Step S82, carries out estimation to media resource, obtains each timing node in media resource
Movable information.
Optionally, the video of input is carried out movement locus estimation, obtains the displacement of each timing node
Vector.
Step S83, according to the movable information of any one timing node, it is judged that whether this timing node
Timing node for scene switching.
Optionally, the most pre-more than or equal to first by judging the motion vector of any one timing node
If threshold value, or within whether being in the first preset range, judge whether this timing node is scene
The timing node of switching, if the motion vector of this timing node is more than or equal to the first predetermined threshold value, or
Within person is in the first preset range, it is determined that this timing node is the timing node of scene switching, enters
Enter step S84;Otherwise, step S88 is entered.
Step S84, carries out color by timing node with the image of adjacent time node and compares, obtain face
The similarity of color information.
Optionally, after obtaining the timing node of scene switching, the image of this timing node is constructed
Color histogram, and the color histogram of the image of the timing node adjacent with this timing node, and
Calculate the similarity of two color histograms.
Step S85, according to the similarity of colouring information, it is judged that whether this timing node is scene switching
Timing node.
Optionally, whether the similarity by judging two color histograms presets threshold less than or equal to second
Value, or within whether being in the second preset range, judge whether this timing node is scene switching
Timing node, if the similarity of two color histograms is less than or equal to the second predetermined threshold value, or
Within being in the second preset range, it is determined that this timing node is the timing node of scene switching, enters
Step S86;Otherwise, step S88 is entered.
Step S86, meets the time segmentum intercalaris of pre-conditioned scene switching by this timing node and time difference
Point merges.
Optionally, obtain in the timing node of scene switching, meet pre-with the time difference of this timing node
If the timing node of scope, calculate the similarity of two color histograms, and judge two color histograms
The similarity of figure whether less than or equal to the second predetermined threshold value, or whether be in the second preset range it
In, if the similarity of two color histograms is more than the second predetermined threshold value, or it is pre-to be not in second
Within the scope of if, it is determined that the image of two timing nodes is same scene, need to merge.
Step S87, determines the timing node that scene switches.
Optionally, from the timing node of scene switching, delete this two timing nodes, and be in
Timing node between two timing nodes, determines the timing node that scene switches.
Step S88, determines that this timing node is not the timing node of scene switching.
Optionally, if the motion vector of this timing node is less than the first predetermined threshold value, or non-source
Within the first preset range, it is determined that this timing node is not the timing node of scene switching, it is impossible to
For inserting media data.If the similarity of two color histograms is more than the second predetermined threshold value, or
Within person is not in the second preset range, it is determined that segmentum intercalaris when this timing node is not scene switching
Point, it is impossible to be used for inserting media data.
By above-mentioned steps S81 to step S88, by the scene handover information in media resource is entered
Row extracts, and analyzes, and sets up the screening model of the timing node of scene switching, and then chooses optimal matchmaker
The insertion timing node of volume data.Media data insert timing node choose have the highest controlled
Property, including choosing the number of media data, timing node, interval etc..Selected timing node
Can be as accurate as microsecond, and insert media data and do not interfere with user's viewing experience to the story of a play or opera, can
To deal carefully with the contradiction before media data insertion and Consumer's Experience.
It should be noted that for aforesaid each method embodiment, in order to be briefly described, therefore by it all
Being expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not subject to
The restriction of described sequence of movement, because according to the present invention, some step can use other orders
Or carry out simultaneously.Secondly, those skilled in the art also should know, reality described in this description
Executing example and belong to preferred embodiment, involved action and module not necessarily present invention institute is necessary
's.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive root
The mode of required general hardware platform can be added by software according to the method for above-described embodiment to realize, when
So can also pass through hardware, but a lot of in the case of the former is more preferably embodiment.Based on such reason
Solving, the part that prior art is contributed by technical scheme the most in other words can be with soft
The form of part product embodies, this computer software product be stored in a storage medium (as
ROM/RAM, magnetic disc, CD) in, including some instructions with so that a station terminal equipment (can
To be mobile phone, computer, server, or the network equipment etc.) perform each embodiment institute of the present invention
The method stated.
Embodiment 2
According to embodiments of the present invention, a kind of insertion method for implementing above-mentioned media data is additionally provided
The insertion apparatus of media data, as it is shown in figure 9, this device includes: the first acquisition module 91, inspection
Survey module 93, the first processing module 95 and insertion module 97.
Wherein, the first acquisition module 91, for obtaining the media resource being inserted into media data, wherein,
Media resource includes: for inserting multiple timing nodes of media data, and each timing node
Image.
Above-mentioned media resource can be video resource, can comprise multiple for inserting matchmaker in video resource
The timing node of volume data, video resource can be by the image construction of multiple timing nodes.Above-mentioned media
Data can be advertisement.
In the optional scheme of one, can input and need to insert advertisement by the way of outside inputs
Video.
Detection module 93, is used for detecting in media resource and whether there is the satisfied default bar of scene handover information
The timing node of part, wherein, scene handover information at least includes one of following: movable information and color
Information.
Above-mentioned scene handover information can be in media resource, for symbolizing the letter of on-the-spot scape switching
Breath, in actual processing procedure, can be indicated with movable information, colouring information.Above-mentioned pre-
If condition could be for determining in media resource the condition that scene switches whether occur, such as, motion
Information is more than particular value, or the similarity of colouring information is less than particular value.
In the optional scheme of one, after obtaining the video of input, video can be carried out scene
Whether there is movable information in change detection, i.e. detection video, colouring information meets scene switching condition
Timing node, thus obtain that video occurs the timing node that scene switches.
First processing module 95, meets pre-for there is scene handover information in media resource being detected
If in the case of the timing node of condition, using timing node as the insertion timing node of media data.
In the optional scheme of one, the feelings of the timing node occurring that scene switches detected in video
Under condition, the timing node that the timing node detected can be inserted as advertisement, i.e. throw in user
The timing node of advertisement.
Insert module 97, for according to inserting timing node, media data being inserted media resource.
In the optional scheme of one, timing node corresponding in video, example can be inserted advertisements into
As, during user watches video, when the timing node that video is current arrives the insertion of advertisement
In the case of intermediate node, suspend video playback, play the advertisement of input to user, when advertisement plays
After Biing, continue to play the video of user's viewing.
Use the embodiment of the present invention, after getting the media resource being inserted into media data, pass through
Whether detection media resource exists scene handover information and meets pre-conditioned timing node, in detection
Exist in the case of scene handover information meets pre-conditioned timing node in media resource, by time
Intermediate node as the insertion timing node of media data, and according to insert timing node, by media data
Insert media resource.By the embodiment of the present invention, can be by detection media resource occurs that scene is cut
The timing node changed, obtains the insertion timing node of media data, thus realize in media resource from
Dynamic insert media data, solve of the prior art low by the artificial efficiency inserting media data and
The technical problem that error rate is high, improve insert media data efficiency, save and artificial insert media number
According to, reduce the error rate inserting media data, meet user's requirement successional to media resource, carry
Rise the experience of user's viewing.
According to the above embodiment of the present invention, as shown in Figure 10, include at scene handover information: motion
In the case of information or colouring information, above-mentioned detection module 93 includes: first extracts submodule 101,
First calculating sub module 103, first judges that submodule 105 and first determines submodule 107.
Wherein, first extracts submodule 101, for from the image of each timing node, extracts every
The movable information of individual timing node or colouring information.
Above-mentioned movable information can be the destination object of display in image, such as, object, human body etc.
Motion vector, above-mentioned colouring information can be the color histogram of color in image.
In the optional scheme of one, can extract corresponding from the video image of each timing node
Motion vector or color histogram, obtain the scene handover information of each timing node.
First calculating sub module 103, for calculating the colouring information of any one timing node with adjacent
First similarity of the colouring information of timing node.
In the optional scheme of one, in the video image from each timing node, obtain corresponding
After color histogram, the color histogram that can calculate any one timing node saves with adjacent time
The similarity of the color histogram of point.
Herein it should be noted that extract submodule extract be each timing node motion letter
In the case of breath, do not perform the function of the first calculating sub module.
First judges submodule 105, the fullest for judging the movable information of any one timing node
Foot is first pre-conditioned, or the first similarity whether to meet second pre-conditioned.
Above-mentioned first pre-conditioned can be that minimum movement information or the motion letter that scene switches occurs
, such as, there is the least displacement vector that scene switches, or the displacement that scene switches occurs in breath interval
Vector is interval.Due to two same or like images, there is similar colouring information, i.e. two
The similarity of the colouring information of image is the highest, therefore, above-mentioned second pre-conditioned can be that scene occurs
The maximum similarity of switching, or occur that the similarity that scene switches is interval.
In the optional scheme of one, in the video image from each timing node, obtain corresponding
After motion vector, the motion vector of each timing node can be compared with least displacement vector
Relatively, or by the motion vector of each timing node compare with motion vector interval.
In the optional scheme of another kind, save with adjacent time being calculated any one timing node
After the similarity of the color histogram of point, calculated similarity can be entered with maximum similarity
Row compares, or calculated similarity is compared with similarity interval.
First determines submodule 107, meets for the movable information at any one timing node described
Described first pre-conditioned, or described first similarity meet described second pre-conditioned in the case of,
Determine that any one timing node described is described to meet pre-conditioned timing node.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime
The amount of shifting to, or the motion vector of node sometime is in motion vector interval, it is determined that this time
Intermediate node occurs that scene switches, i.e. this timing node is the timing node that scene switches occur.
In the optional scheme of another kind, if calculated similarity is similar less than or equal to maximum
Spend, or calculated similarity is in similarity interval, it is determined that this timing node goes out scene
Scape switches, i.e. the timing node that scene switches occurs in this timing node position.
According to the above embodiment of the present invention, as shown in figure 11, include at scene handover information: motion
In the case of information and colouring information, above-mentioned detection module 93 includes: second extracts submodule 111,
Second judges submodule 113, and the second calculating sub module 115, the 3rd judges submodule 117 and second
Determine submodule 119.
Wherein, second extracts submodule 111, for from the image of each timing node, extracts every
The movable information of individual timing node and colouring information.
In the optional scheme of one, can extract corresponding from the video image of each timing node
Motion vector or color histogram, obtain the scene handover information of each timing node.
Second judges submodule 113, the fullest for judging the movable information of any one timing node
Foot first is pre-conditioned.
In the optional scheme of one, in the video image from each timing node, obtain corresponding
After motion vector, the motion vector of each timing node can be compared with least displacement vector
Relatively, or by the motion vector of each timing node compare with motion vector interval.
Second calculating sub module 115, meets first for the movable information at any one timing node
In the case of pre-conditioned, calculate colouring information and the adjacent time node of any one timing node
Second similarity of colouring information.
In order to avoid occurring sentencing, determining that node is to occur that scene is cut sometime by movable information more
After the timing node changed, two images that be will appear from scene switching by colouring information are needed to carry out face
Color ratio relatively, will compare with the colouring information of adjacent time node by the colouring information of this timing node
Relatively.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime
The amount of shifting to, or the motion vector of node sometime is in motion vector interval, then can calculate
The similarity of the color histogram of the color histogram of this timing node and adjacent time node, during to this
Intermediate node is verified.
3rd judges submodule 117, pre-conditioned for judging whether the first similarity meets second.
In the optional scheme of one, can compare with maximum similarity with calculated similarity
Relatively, or by calculated similarity compare with similarity interval.
Second determines submodule 119, for the second similarity meet second pre-conditioned in the case of,
Determine that any one timing node is timing node.
In the optional scheme of one, if calculated similarity is less than or equal to minimum similarity degree,
Or calculated similarity is in similarity interval, it is determined that this timing node passes through checking,
Determine that this timing node is the timing node that scene switches occur.
By such scheme, can be determining satisfied first pre-conditioned time segmentum intercalaris by movable information
After Dian, by colouring information, this timing node is verified, only by the timing node of checking
Can as the insertion timing node of media data, thus reduce timing node choose error, enter one
Step reduces the error rate that media data inserts.
Herein it should be noted that obtain by checking timing node after, as it is shown on figure 3,
The image by 6 timing nodes verified, timing node 1-6 the most as shown in Figure 3 can be obtained
Image, although, the similarity of the colouring information of each adjacent timing node is relatively low, but, as
The similarity of the colouring information of the timing node 1 shown in Fig. 3, timing node 3 and timing node 6 is very
Height, the similarity of the colouring information of timing node 2, timing node 4 and timing node 5 is the highest, i.e.
The image of above-mentioned 6 timing nodes belongs to same scene.Believe iff according to movable information and color
Breath judges, using the inserting as media data of any one timing node in above-mentioned 6 timing nodes
Angle of incidence node, it may appear that inserted by media data in same scene, causes user to watch media resource
During, experience sense is poor, occurs being sick of sense to media data.
In order to solve the problems referred to above, obtain scene handover information in detection and meet pre-conditioned time segmentum intercalaris
After Dian, scene switching can be merged, the scene repeated is fused into identical field
Scape, can avoid being inserted in same scene media data.
According to the above embodiment of the present invention, as shown in figure 12, said apparatus also includes: second obtains
Module 121, it is judged that module 123, removing module 125 and the second processing module 127.
Wherein, the second acquisition module 121, for from timing node, obtain time difference at default model
Enclose interior two timing node.
Herein it should be noted that owing to the time difference between the timing node of same scene is less, because of
In preset range two timing nodes of time difference can be judged, above-mentioned preset range by this
Can be the time difference of the timing node of the same scene obtained by lot of experiment validation, such as, can
Being 5 minutes.
In the optional scheme of one, time difference can be obtained and exists from the timing node by checking
Any two timing node in preset range, such as, time difference is less than or equal to any the two of 5 minutes
Individual timing node.
Whether judge module 123, be same scene for judging the image of two timing nodes.
Removing module 125, is used in the case of the image of two timing nodes is same scene, from
Segmentum intercalaris when deleting at least one between two timing nodes, and two timing nodes in timing node
Point, the timing node after being screened.
In the optional scheme of one, if it is determined that the time difference any two time in preset range
The image of node belongs to same scene, is melted by all timing nodes within two timing nodes
Close, and reject from the timing node that detection obtains, the timing node after being screened.
Second processing module 127, for during by the timing node after screening as the insertion of media data
Intermediate node.
By such scheme, can get the time difference two timing nodes in preset range it
After, whether it is same scene by judging the image of two timing nodes, presets bar to detecting to meet
The timing node of part screens, and obtains the timing node of non-equal scene, thus reduces media data
The error rate inserted, promotes the viewing experience of user.
According to the above embodiment of the present invention, as shown in figure 13, above-mentioned judge module 123 includes: the
Three calculating sub module 131, the 4th judges that submodule 133 and the 3rd determines submodule 135.
3rd calculating sub module 131, for calculating the third phase of the colouring information of two timing nodes seemingly
Degree.
4th judges submodule 133, is used for judging whether third phase meets second like degree pre-conditioned.
3rd determines submodule 135, for third phase like degree meet second pre-conditioned in the case of,
The image determining two timing nodes is same scene.
In the optional scheme of one, getting the time difference any two time in preset range
After node, the similarity of the color histogram of these two timing nodes can be calculated, if calculated
To similarity more than occurring at the maximum similarity that scene switches, or calculated similarity
In similarity interval, it is determined that the image of these two timing nodes is same or like image, thus
The image determining these two timing nodes is same scene.
According to the above embodiment of the present invention, above-mentioned first extracts submodule 101 or above-mentioned second extracts son
Module 111 includes: estimate baryon module.
Wherein, estimate baryon module, for the image of each timing node is carried out movement locus estimation,
Obtain the motion vector of each timing node.
Herein it should be noted that the accuracy of motion vector in order to ensure each timing node, can
With the image by any one timing node of comparison with adjacent multiple timing nodes, obtain segmentum intercalaris time this
The motion vector of point.
In the optional scheme of one, as shown in Figure 4, media resource includes 5 timing nodes,
Timing node A, timing node A1, timing node A2, timing node A3 and timing node B,
In order to the image of timing node A is carried out movement locus estimation, can be according to above-mentioned 5 timing nodes
Image, the square object in image is carried out Displacement Estimation, with the square in timing node A
The position of object is starting point, with the position of the square object in timing node B as terminal, obtains phase
The motion vector (as shown by the arrows in Figure 4) answered, thus obtain the motion vector of timing node A.
If herein also, it should be noted the image of any one timing node and adjacent time node
In there is not identical object, timing node 1 as shown in Figure 3 and timing node 2, it is determined that two
Individual image is not same or like image, occurs that scene switches, and can be made by maximum displacement vector
Motion vector for this node.
Herein also, it should be noted carry out the speed of movement locus estimation to improve each timing node
Degree, before media resource is carried out movement locus estimation, can reduce media resource, will
Media resource is converted to the media resource of small in resolution, such as, as it is shown in figure 5, can be by left side
The video of bigger resolution, is converted to the video of right side small in resolution.
According to the above embodiment of the present invention, above-mentioned first extracts submodule 101 or above-mentioned second extracts son
Module 111 includes: process baryon module.
Wherein, process baryon module, for the color of image based on each timing node, obtain every
The color histogram of individual timing node.
In the optional scheme of one, can using the color of the image of each timing node as feature,
The color histogram of structural map picture.
Herein it should be noted that for the impact reducing noise, and the color improving structural map picture is straight
The speed of side's figure, in the color of image based on each timing node, obtains the face of each timing node
Before Color Histogram, media resource can be carried out color quantizing process, be transformed into 1024 kinds of colors,
For example, it is possible to by video as shown in Figure 6, be converted to the video of 1024 kinds of colors.
According to the above embodiment of the present invention, said apparatus also includes: the 3rd acquisition module, and the 4th obtains
Module and the 3rd processing module.
Wherein, the 3rd acquisition module, for obtaining the insertion information of media data, wherein, inserts letter
Breath at least includes following any one or more information: the quantity of media data, the insertion time period is with slotting
The angle of incidence is spaced.
4th acquisition module, is used for obtaining in timing node and the timing node inserting information matches.
3rd processing module, for will the timing node of coupling as segmentum intercalaris during the insertion of media data
Point.
In the optional scheme of one, after obtaining the timing node that scene switches occurs, Ke Yigen
According to the quantity of the advertisement needing insertion, time period and interval, and the insertion of the advertisement inserted as required
Information, screens the timing node obtained, and the scene obtaining the insertion information matches with advertisement is cut
The timing node changed, as the insertion timing node of advertisement.Such as, as it is shown in fig. 7, pass through screening
After can be using the timing node of this image as the insertion timing node of advertisement.
By such scheme, can be according to the insertion information of media data, to the timing node detected
Screen, obtain the insertion timing node of media data, thus realize inserting timing node and have relatively
High controllability.
According to the above embodiment of the present invention, above-mentioned 4th acquisition module includes: obtain submodule and screening
Submodule.
Wherein, obtain submodule, be in, for obtaining, the multiple timing nodes inserted in the time period.
Screening submodule, for the quantity according to media data and insertion time interval, to multiple times
Node screens, and obtains the timing node of coupling.
In the optional scheme of one, can choose within being positioned at the time period according to the time period of advertisement
Multiple timing nodes, and according to the quantity of advertisement and interval, from multiple timing nodes, choose coupling
Timing node, as the insertion timing node of advertisement.
Embodiment 3
Embodiments of the invention can provide a kind of terminal, and this terminal can be to calculate
Any one computer terminal in machine terminal group.Alternatively, in the present embodiment, above-mentioned meter
Calculation machine terminal can also replace with the terminal units such as mobile terminal.
Alternatively, in the present embodiment, above computer terminal may be located at the multiple of computer network
At least one network equipment in the network equipment.
Alternatively, Figure 14 is the structured flowchart of a kind of terminal according to embodiments of the present invention.
As shown in figure 14, this terminal A may include that one or more (only illustrating one in figure)
Processor 141, memorizer 143 and transmitting device 145.
Wherein, memorizer 143 can be used for storing software program and module, in the embodiment of the present invention
The insertion method of the media data programmed instruction/module corresponding with device, processor 141 is by running
It is stored in the software program in memorizer 143 and module, thus performs the application of various function and number
According to process, i.e. realize the insertion method of above-mentioned media data.Memorizer 143 can include the most random
Memorizer, it is also possible to include nonvolatile memory, such as one or more magnetic storage device, sudden strain of a muscle
Deposit or other non-volatile solid state memories.In some instances, memorizer 143 can be further
Including the memorizer remotely located relative to processor 141, these remote memories can pass through network
It is connected to terminal A.The example of above-mentioned network include but not limited to the Internet, intranet,
LAN, mobile radio communication and combinations thereof.
Above-mentioned transmitting device 145 is for receiving via a network or sending data.Above-mentioned net
Network instantiation can include cable network and wireless network.In an example, transmitting device 145 wraps
Include a network adapter (Network Interface Controller, NIC), its can by netting twine with
Other network equipments are connected with router thus can carry out communication with the Internet or LAN.A reality
In example, transmitting device 145 is radio frequency (Radio Frequency, RF) module, and it is for by nothing
Line mode and the Internet carry out communication.
Wherein, specifically, memorizer 143 is for storing ID Card Image pre-conditioned, to be detected
And application program.
Processor 141 can call information and the application journey of memorizer 143 storage by transmitting device
Sequence, to perform following step: obtain the media resource being inserted into media data, wherein, media resource
Including: for inserting multiple timing nodes of media data, and the image of each timing node;Inspection
Whether survey media resource exists scene handover information and meets pre-conditioned timing node, wherein, field
Scape handover information at least includes one of following: movable information and colouring information;Media resource detected
Middle exist in the case of scene handover information meets pre-conditioned timing node, using timing node as
The insertion timing node of media data;According to inserting timing node, media data is inserted media resource.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: cuts in scene
The information of changing includes: in the case of movable information or colouring information, from the image of each timing node,
Extract movable information or the colouring information of each timing node;Calculate the color of any one timing node
First similarity of the colouring information of information and adjacent time node;Judge any one timing node
It is first pre-conditioned whether movable information meets, or the first similarity whether to meet second pre-conditioned;
Movable information at any one timing node meets first pre-conditioned, or the first similarity meets
In the case of two is pre-conditioned, determine that any one timing node is to meet pre-conditioned time segmentum intercalaris
Point.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: cuts in scene
The information of changing includes: in the case of movable information and colouring information, from the image of each timing node,
Extract movable information and the colouring information of each timing node;Judge the motion of any one timing node
It is pre-conditioned whether information meets first;It is pre-that movable information at any one timing node meets first
If in the case of condition, calculate the colouring information of any one timing node and the face of adjacent time node
Second similarity of color information;Judge whether the second similarity meets second pre-conditioned;In the second phase
Like degree meet second pre-conditioned in the case of, determine that any one timing node is timing node.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: by the time
Before node is as the insertion timing node of media data, from timing node, obtain time difference in advance
If two timing nodes in scope;Whether the image judging two timing nodes is same scene;?
In the case of the image of two timing nodes is same scene, segmentum intercalaris when deleting two from timing node
At least one timing node between point, and two timing nodes, the timing node after being screened;
Timing node after screening is as the insertion timing node of media data.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: calculates two
The third phase of the colouring information of timing node is like degree;Judge whether third phase meets second like degree and preset bar
Part;Third phase like degree be unsatisfactory for second pre-conditioned in the case of, determine the figure of two timing nodes
Picture is same scene.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: to time each
The image of intermediate node carries out movement locus estimation, obtains the motion vector of each timing node.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: based on each
The color of the image of timing node, obtains the color histogram of each timing node.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: by the time
Before node is as the insertion timing node of media data, the insertion information of acquisition media data, wherein,
Insertion information at least includes following any one or more information: the quantity of media data, inserts the time
Section and insertion time interval;Obtain the timing node with insertion information matches in timing node;Will coupling
Timing node as the insertion timing node of media data.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: obtains and is in
Insert the multiple timing nodes in the time period;Quantity according to media data and insertion time interval are right
Multiple timing nodes screen, and obtain the timing node of coupling.
Embodiment 4
Embodiments of the invention additionally provide a kind of storage medium.Alternatively, in the present embodiment, on
State the program code of insertion method that storage medium can store the media data of above-described embodiment 1.
Alternatively, in the present embodiment, above-mentioned storage medium is many in may be located at the network of computer
At least one network equipment in the individual network equipment.
Alternatively, in the present embodiment, storage medium is arranged to storage for performing following steps
Program code:
S1, obtains the media resource being inserted into media data, and wherein, media resource includes: be used for inserting
Enter multiple timing nodes of media data, and the image of each timing node;
Whether S2, exist scene handover information in detection media resource and meet pre-conditioned time segmentum intercalaris
Point, wherein, scene handover information at least includes one of following: movable information and colouring information;
, in media resource being detected, there is scene handover information meet pre-conditioned timing node in S3
In the case of, using timing node as the insertion timing node of media data;
S4, according to inserting timing node, inserts media resource by media data.
Alternatively, storage medium is also configured to storage for the program code performing following steps:
Scene handover information includes: in the case of movable information or colouring information, from the figure of each timing node
In Xiang, extract movable information or the colouring information of each timing node;Calculate any one timing node
First similarity of colouring information of colouring information and adjacent time node;Judge any one time
It is first pre-conditioned whether the movable information of node meets, or whether the first similarity meets second and preset
Condition;Movable information at any one timing node meets first pre-conditioned, or the first similarity
Meet second pre-conditioned in the case of, determine when any one timing node is to meet pre-conditioned
Intermediate node.
Alternatively, storage medium is also configured to storage for the program code performing following steps:
Scene handover information includes: in the case of movable information and colouring information, from the figure of each timing node
In Xiang, extract movable information and the colouring information of each timing node;Judge any one timing node
Movable information whether to meet first pre-conditioned;Movable information at any one timing node meets
In the case of first is pre-conditioned, the colouring information calculating any one timing node saves with adjacent time
Second similarity of the colouring information of point;Judge whether the second similarity meets second pre-conditioned;?
Second similarity meet second pre-conditioned in the case of, determine segmentum intercalaris when any one timing node is
Point.
Alternatively, storage medium is also configured to storage for the program code performing following steps:
Using timing node as before the insertion timing node of media data, from timing node, obtain the time
The difference two timing nodes in preset range;Whether the image judging two timing nodes is identical field
Scape;In the case of the image of two timing nodes is same scene, from timing node, delete two
At least one timing node between timing node, and two timing nodes, after being screened time
Intermediate node;Timing node after screening is as the insertion timing node of media data.
Alternatively, storage medium is also configured to storage by the program code performing following steps: based on
Calculate the third phase of colouring information of two timing nodes like degree;Judge whether third phase meets second like degree
Pre-conditioned;Third phase like degree be unsatisfactory for second pre-conditioned in the case of, segmentum intercalaris when determining two
The image of point is same scene.
Alternatively, storage medium is also configured to storage for the program code performing following steps: right
The image of each timing node carries out movement locus estimation, obtains the motion vector of each timing node.
Alternatively, storage medium is also configured to storage for the program code performing following steps: base
In the color of the image of each timing node, obtain the color histogram of each timing node.
Alternatively, storage medium is also configured to storage for the program code performing following steps:
Using timing node as before the insertion timing node of media data, obtain the insertion letter of media data
Breath, wherein, insertion information at least includes following any one or more information: the quantity of media data,
Insert the time period and insert time interval;Obtain the time segmentum intercalaris with insertion information matches in timing node
Point;Using the timing node of coupling as the insertion timing node of media data.
Alternatively, storage medium is also configured to storage for the program code performing following steps: obtain
Take and be in the multiple timing nodes inserted in the time period;Quantity according to media data and between the insertion time
Every, multiple timing nodes are screened, obtains the timing node of coupling.
Alternatively, in the present embodiment, above-mentioned storage medium can include but not limited to: USB flash disk, only
Read memorizer (ROM, Read-Only Memory), random access memory (RAM, Random
Access Memory), portable hard drive, various Jie that can store program code such as magnetic disc or CD
Matter.
Alternatively, the concrete example in the present embodiment is referred in above-described embodiment 1 to embodiment 2
Described example, the present embodiment does not repeats them here.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
If the integrated unit in above-described embodiment realizes using the form of SFU software functional unit and as
When independent production marketing or use, can be stored in the storage medium that above computer can read.
Based on such understanding, prior art is contributed by technical scheme the most in other words
Part or completely or partially can the embodying with the form of software product of this technical scheme, this meter
Calculation machine software product is stored in storage medium, including some instructions with so that one or more calculates
Machine equipment (can be personal computer, server or the network equipment etc.) performs the present invention, and each is implemented
All or part of step of method described in example.
In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and certain is real
Execute the part not having to describe in detail in example, may refer to the associated description of other embodiments.
In several embodiments provided herein, it should be understood that disclosed client, can
Realize by another way.Wherein, device embodiment described above is only schematically,
The division of the most described unit, is only a kind of logic function and divides, and actual can have additionally when realizing
Dividing mode, the most multiple unit or assembly can gather or be desirably integrated into another system,
Or some features can ignore, or do not perform.Another point, shown or discussed coupling each other
Close or direct-coupling or communication connection can be the INDIRECT COUPLING by some interfaces, unit or module or
Communication connection, can be being electrical or other form.
The described unit illustrated as separating component can be or may not be physically separate,
The parts shown as unit can be or may not be physical location, i.e. may be located at a ground
Side, or can also be distributed on multiple NE.Can select therein according to the actual needs
Some or all of unit realizes the purpose of the present embodiment scheme.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit
In, it is also possible to it is that unit is individually physically present, it is also possible to two or more unit are integrated in
In one unit.Above-mentioned integrated unit both can realize to use the form of hardware, it would however also be possible to employ soft
The form of part functional unit realizes.
The above is only the preferred embodiment of the present invention, it is noted that for the art
For those of ordinary skill, under the premise without departing from the principles of the invention, it is also possible to make some improvement
And retouching, these improvements and modifications also should be regarded as protection scope of the present invention.
Claims (14)
1. the insertion method of a media data, it is characterised in that including:
Obtaining the media resource being inserted into media data, wherein, described media resource includes: use
In multiple timing nodes of the described media data of insertion, and the image of each timing node;
Detect and whether described media resource exists scene handover information when meeting pre-conditioned
Intermediate node, wherein, described scene handover information at least includes one of following: movable information and face
Color information;
Scene handover information is there is when meeting pre-conditioned in described media resource being detected
In the case of intermediate node, using described timing node as segmentum intercalaris during the insertion of described media data
Point;
According to described insertion timing node, described media data is inserted described media resource.
Method the most according to claim 1, it is characterised in that include at described scene handover information:
In the case of described movable information or described colouring information, the described media resource of described detection is
The no scene handover information that exists meets pre-conditioned timing node, including:
From the image of described each timing node, extract the motion letter of described each timing node
Breath or colouring information;
Calculate the colouring information of any one timing node and the colouring information of adjacent time node
The first similarity;
Judge whether the movable information of any one timing node meets first pre-conditioned, or institute
Stating the first similarity, whether to meet second pre-conditioned;
Movable information at any one timing node described meets described first pre-conditioned, or
Described first similarity meet described second pre-conditioned in the case of, determine described any one
Timing node is described to meet pre-conditioned timing node.
Method the most according to claim 1, it is characterised in that include at described scene handover information:
In the case of described movable information and described colouring information, the described media resource of described detection is
The no scene handover information that exists meets pre-conditioned timing node, including:
From the image of described each timing node, extract the motion letter of described each timing node
Breath and colouring information;
Judge whether the movable information of any one timing node meets first pre-conditioned;
Movable information at any one timing node described meets described first pre-conditioned
In the case of, calculate the colouring information of any one timing node described and the face of adjacent time node
Second similarity of color information;
Judge whether described second similarity meets second pre-conditioned;
Described second similarity meet described second pre-conditioned in the case of, determine described appointing
A timing node of anticipating is described timing node.
Method the most according to claim 3, it is characterised in that described timing node is made described
Before the insertion timing node of described media data, described method also includes:
From described timing node, obtain the time difference two timing nodes in preset range;
Whether the image judging said two timing node is same scene;
In the case of the image of said two timing node is described same scene, when described
In intermediate node delete between said two timing node, and said two timing node at least
One timing node, the timing node after being screened;
Using the timing node after described screening as the insertion timing node of described media data.
Method the most according to claim 4, it is characterised in that segmentum intercalaris during described judgement said two
Whether the image of point is same scene, including:
Calculate the third phase of colouring information of said two timing node like degree;
Judge whether described third phase meets like degree described second pre-conditioned;
Described third phase be unsatisfactory for like degree described second pre-conditioned in the case of, determine described
The image of two timing nodes is described same scene.
The most according to the method in claim 2 or 3, it is characterised in that described from described each time
In the image of node, extract the movable information of described each timing node, including:
The image of described each timing node is carried out movement locus estimation, obtain described each time
The motion vector of intermediate node.
The most according to the method in claim 2 or 3, it is characterised in that described from described each time
In the image of node, extract the colouring information of described each timing node, including:
The color of image based on described each timing node, obtains described each timing node
Color histogram.
Method the most according to claim 1, it is characterised in that described timing node is made described
Before the insertion timing node of described media data, described method also includes:
Obtain the insertion information of described media data, wherein, described insertion information at least include as
Lower any one or more information: the quantity of described media data, when inserting the time period and insert
Between be spaced;
Obtain the timing node with described insertion information matches in described timing node;
Using the timing node of described coupling as the insertion timing node of described media data.
Method the most according to claim 8, it is characterised in that in the described timing node of described acquisition
With the timing node of described insertion information matches, including:
Obtain and be in the described multiple timing nodes inserted in the time period;
Quantity according to described media data and described insertion time interval, to the plurality of time
Node screens, and obtains the timing node of described coupling.
10. the insertion apparatus of a media data, it is characterised in that including:
First acquisition module, for obtaining the media resource being inserted into media data, wherein, institute
State media resource to include: for inserting multiple timing nodes of described media data and each
The image of timing node;
Detection module, be used for detecting in described media resource whether exist scene handover information meet
Pre-conditioned timing node, wherein, described scene handover information at least includes one of following:
Movable information and colouring information;
, for there is scene handover information in described media resource being detected in the first processing module
In the case of meeting pre-conditioned timing node, using described timing node as described media number
According to insertion timing node;
Insert module, for according to described insertion timing node, described media data being inserted institute
State media resource.
11. devices according to claim 10, it is characterised in that at described scene handover information bag
Include: in the case of described movable information or described colouring information, described detection module includes:
First extracts submodule, for from the image of described each timing node, extracts described
The movable information of each timing node or colouring information;
First calculating sub module, for calculating the colouring information of any one timing node with adjacent
First similarity of the colouring information of timing node;
First judges submodule, the fullest for judging the movable information of any one timing node
Foot is first pre-conditioned, or described first similarity whether to meet second pre-conditioned;
First determines submodule, meets for the movable information at any one timing node described
Described first pre-conditioned, or described first similarity meets described second pre-conditioned situation
Under, determine that any one timing node described is described to meet pre-conditioned timing node.
12. devices according to claim 10, it is characterised in that at described scene handover information bag
Include: in the case of described movable information and described colouring information, described detection module includes:
Second extracts submodule, for from the image of described each timing node, extracts described
The movable information of each timing node and colouring information;
Second judges submodule, the fullest for judging the movable information of any one timing node
Foot first is pre-conditioned;
Second calculating sub module, meets for the movable information at any one timing node described
Described first pre-conditioned in the case of, calculate the colouring information of any one timing node described
The second similarity with the colouring information of adjacent time node;
3rd judges submodule, is used for judging whether described second similarity meets second and preset bar
Part;
Second determines submodule, described second pre-conditioned for meeting in described second similarity
In the case of, determine that any one timing node described is described timing node.
13. devices according to claim 12, it is characterised in that described device also includes:
Second acquisition module, for from described timing node, obtains time difference in preset range
Two interior timing nodes;
Whether judge module, be same scene for judging the image of said two timing node;
Removing module, for the feelings that image is described same scene at said two timing node
Under condition, from described timing node, delete said two timing node, and said two time
At least one timing node between node, the timing node after being screened;
Second processing module, is used for the timing node after described screening as described media data
Insertion timing node.
14. devices according to claim 13, it is characterised in that described judge module includes:
3rd calculating sub module, for calculating the 3rd of the colouring information of said two timing node
Similarity;
4th judges submodule, is used for judging whether described third phase meets like degree described second pre-
If condition;
3rd determines submodule, presets bar for being unsatisfactory for described second at described third phase like degree
In the case of part, determine that the image of said two timing node is described same scene.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610437530.1A CN106028088B (en) | 2016-06-16 | 2016-06-16 | The insertion method and device of media data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610437530.1A CN106028088B (en) | 2016-06-16 | 2016-06-16 | The insertion method and device of media data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106028088A true CN106028088A (en) | 2016-10-12 |
CN106028088B CN106028088B (en) | 2018-12-11 |
Family
ID=57088719
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610437530.1A Active CN106028088B (en) | 2016-06-16 | 2016-06-16 | The insertion method and device of media data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106028088B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107920275A (en) * | 2017-12-29 | 2018-04-17 | 广东欧珀移动通信有限公司 | Video broadcasting method, device, terminal and storage medium |
CN108228795A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | Add the method and device of business object |
CN108960589A (en) * | 2018-06-14 | 2018-12-07 | 阳光易购(北京)科技有限公司 | Clean vegetables service operation management method and device |
CN110611834A (en) * | 2019-08-28 | 2019-12-24 | 杭州当虹科技股份有限公司 | Streaming media advertisement interactive association accurate delivery method |
CN112261316A (en) * | 2020-09-22 | 2021-01-22 | 深圳市奥拓电子股份有限公司 | Method, device and system for switching scenes by video stitching processor |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1009166A2 (en) * | 1998-11-20 | 2000-06-14 | General Instrument Corporation | Splicing of video data in progressively refreshed video streams |
CN101755453A (en) * | 2007-05-31 | 2010-06-23 | 索尼计算机娱乐美国公司 | System and method for taking control of a system during a commercial break |
CN104918060A (en) * | 2015-05-29 | 2015-09-16 | 北京奇艺世纪科技有限公司 | Method and device for selecting position to insert point in video advertisement |
-
2016
- 2016-06-16 CN CN201610437530.1A patent/CN106028088B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1009166A2 (en) * | 1998-11-20 | 2000-06-14 | General Instrument Corporation | Splicing of video data in progressively refreshed video streams |
CN101755453A (en) * | 2007-05-31 | 2010-06-23 | 索尼计算机娱乐美国公司 | System and method for taking control of a system during a commercial break |
CN104918060A (en) * | 2015-05-29 | 2015-09-16 | 北京奇艺世纪科技有限公司 | Method and device for selecting position to insert point in video advertisement |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107920275A (en) * | 2017-12-29 | 2018-04-17 | 广东欧珀移动通信有限公司 | Video broadcasting method, device, terminal and storage medium |
CN108228795A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | Add the method and device of business object |
CN108960589A (en) * | 2018-06-14 | 2018-12-07 | 阳光易购(北京)科技有限公司 | Clean vegetables service operation management method and device |
CN110611834A (en) * | 2019-08-28 | 2019-12-24 | 杭州当虹科技股份有限公司 | Streaming media advertisement interactive association accurate delivery method |
CN112261316A (en) * | 2020-09-22 | 2021-01-22 | 深圳市奥拓电子股份有限公司 | Method, device and system for switching scenes by video stitching processor |
Also Published As
Publication number | Publication date |
---|---|
CN106028088B (en) | 2018-12-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106028088A (en) | Insertion method and device of media data | |
CN105380575A (en) | Control method and system for sweeping robot, cloud server and sweeping robot | |
CN106412277A (en) | Method and apparatus for loading virtual scene | |
EP3513566A1 (en) | Methods and systems of spatiotemporal pattern recognition for video content development | |
CN102541259A (en) | Electronic equipment and method for same to provide mood service according to facial expression | |
CN113687600A (en) | Simulation test method, simulation test device, electronic equipment and storage medium | |
US11504635B2 (en) | Vector-space framework for evaluating gameplay content in a game environment | |
CN106797498A (en) | Message processing device, information processing method and program | |
CN105975612A (en) | Picture processing method, device and equipment | |
CN109685785A (en) | A kind of image quality measure method, apparatus and electronic equipment | |
CN110956202A (en) | Image training method, system, medium and intelligent device based on distributed learning | |
CN106302477A (en) | A kind of net cast method of testing and system | |
CN115049057B (en) | Model deployment method and device, electronic equipment and storage medium | |
CN113096055B (en) | Training method and device for image generation model, electronic equipment and storage medium | |
CN109472764A (en) | Method, apparatus, equipment and the medium of image synthesis and the training of image synthetic model | |
CN113822654A (en) | Engineering project construction progress management method, device, equipment and storage medium | |
CN110019939A (en) | Video temperature prediction technique, device, terminal device and medium | |
CN108280096A (en) | Data cleaning method and data cleansing device | |
CN110058829A (en) | A kind of image processing method, device and storage medium | |
CN111432206A (en) | Video definition processing method and device based on artificial intelligence and electronic equipment | |
CN106162357A (en) | Obtain the method and device of video content | |
CN111783586A (en) | Food material management method and device, computing equipment and storage medium | |
CN114360018B (en) | Rendering method and device of three-dimensional facial expression, storage medium and electronic device | |
CN110852224B (en) | Expression recognition method and related device | |
CN105991583A (en) | Game application recommendation method, application server, terminal and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |