CN106028088A - Insertion method and device of media data - Google Patents

Insertion method and device of media data Download PDF

Info

Publication number
CN106028088A
CN106028088A CN201610437530.1A CN201610437530A CN106028088A CN 106028088 A CN106028088 A CN 106028088A CN 201610437530 A CN201610437530 A CN 201610437530A CN 106028088 A CN106028088 A CN 106028088A
Authority
CN
China
Prior art keywords
timing node
node
timing
information
media data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610437530.1A
Other languages
Chinese (zh)
Other versions
CN106028088B (en
Inventor
徐敘遠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201610437530.1A priority Critical patent/CN106028088B/en
Publication of CN106028088A publication Critical patent/CN106028088A/en
Application granted granted Critical
Publication of CN106028088B publication Critical patent/CN106028088B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26241Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the time of distribution, e.g. the best time of the day for inserting an advertisement or airing a children program

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an insertion method and device of media data. The insertion method comprises the steps of obtaining a media resource waiting for insertion of the media data; detecting whether a time node with scene switching information satisfying a preset condition exists in the media resource; if the fact that the time node with the scene switching information satisfying the preset condition exists in the media resource is detected, regarding the time node as the insertion time node of the media data; and inserting the media data to the media resource according to the insertion time node. According to the insertion method and device of the media data, the technical problems of low efficiency and high error rate of manual insertion of the media data in the prior art are solved, and the effects of improving the insertion efficiency of media data, saving the labor force for insertion of the media data, reducing the error rate of the insertion of the media data, meeting the requirement of a user on media resource continuity and improving the watching experience of the user are achieved.

Description

The insertion method of media data and device
Technical field
The present invention relates to multimedia resource field, in particular to the insertion side of a kind of media data Method and device.
Background technology
Along with the fast development of the Internet, increasing user obtains media resource by the Internet (such as, video resource), such as, by Tengxun's videoconference client, watch video online.Media number Also begin to more pay close attention to interpolation matchmaker in media resource according to throwing in business (such as, advertisement putting business) Volume data (such as, advertisement), therefrom can obtain more income.
But, existing media data is inserted in before media resource commences play out mostly, whole matchmaker In the playing process of body resource, and it is not inserted into, causes media resource utilization rate low, obtain income relatively low. In order to improve the utilization rate of media resource, manual type can be passed through, insert corresponding in media resource Media data, but, when media resource is more, and when the media resource time is longer, by manually It is inefficient that mode inserts media resource, and easily makes mistakes, and, it is optionally plugged in media resource Media data, can cause the continuity of media resource to decline, and user's viewing experience is poor.
For of the prior art by the artificial skill that efficiency is low and error rate is high inserting media data Art problem, the most not yet proposes effective solution.
Summary of the invention
Embodiments provide insertion method and the device of a kind of media data, existing at least to solve There is the technical problem that efficiency is low and error rate is high by artificial insertion media data in technology.
An aspect according to embodiments of the present invention, it is provided that the insertion method of a kind of media data, bag Include: obtaining the media resource being inserted into media data, wherein, media resource includes: be used for inserting matchmaker Multiple timing nodes of volume data, and the image of each timing node;In detection media resource whether There is scene handover information and meet pre-conditioned timing node, wherein, scene handover information at least wraps Include one of following: movable information and colouring information;Scene switching letter is there is in media resource being detected In the case of breath meets pre-conditioned timing node, during using timing node as the insertion of media data Intermediate node;According to inserting timing node, media data is inserted media resource.
Another aspect according to embodiments of the present invention, additionally provides the insertion apparatus of a kind of media data, Including: the first acquisition module, for obtaining the media resource being inserted into media data, wherein, media Resource includes: for inserting multiple timing nodes of media data, and the image of each timing node; Detection module, for detect whether media resource exists scene handover information meet pre-conditioned time Intermediate node, wherein, scene handover information at least includes one of following: movable information and colouring information; First processing module, meets pre-conditioned for there is scene handover information in media resource being detected Timing node in the case of, using timing node as the insertion timing node of media data;Insert mould Block, for according to inserting timing node, inserting media resource by media data.
In embodiments of the present invention, after getting the media resource being inserted into media data, pass through Whether detection media resource exists scene handover information and meets pre-conditioned timing node, in detection Exist in the case of scene handover information meets pre-conditioned timing node in media resource, by time Intermediate node as the insertion timing node of media data, and according to insert timing node, by media data Insert media resource.By the embodiment of the present invention, can be by detection media resource occurs that scene is cut The timing node changed, obtains the insertion timing node of media data, thus realize in media resource from Dynamic insert media data, solve of the prior art low by the artificial efficiency inserting media data and The technical problem that error rate is high, improves the efficiency inserting media data, saves and inserts media data, fall It is inserted into the error rate of media data, meets user's requirement successional to media resource, promote user The experience of viewing.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the one of the application Part, the schematic description and description of the present invention is used for explaining the present invention, is not intended that this Bright improper restriction.In the accompanying drawings:
Fig. 1 is that the computer of a kind of insertion method for media data according to embodiments of the present invention is whole The structured flowchart of end;
Fig. 2 is the flow chart of the insertion method of a kind of media data of according to embodiments of the present invention;
Fig. 3 is the schematic diagram of a kind of optional fusion same scene of according to embodiments of the present invention;
Fig. 4 is the schematic diagram of a kind of optional movement locus estimation of according to embodiments of the present invention;
Fig. 5 is the signal of a kind of optional media resource conversion resolution of according to embodiments of the present invention Figure;
Fig. 6 is the signal of a kind of optional media resource color quantizing of according to embodiments of the present invention Figure;
Fig. 7 is the insertion timing node of a kind of optional media data of according to embodiments of the present invention Schematic diagram;
Fig. 8 is the flow process of the insertion method of a kind of optional media data of according to embodiments of the present invention Figure;
Fig. 9 is the schematic diagram of the insertion apparatus of a kind of media data of according to embodiments of the present invention two;
Figure 10 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two It is intended to;
Figure 11 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two It is intended to;
Figure 12 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two It is intended to;
Figure 13 is showing of the insertion apparatus of a kind of optional media data of according to embodiments of the present invention two It is intended to;And
Figure 14 is the structured flowchart of a kind of terminal according to embodiments of the present invention.
Detailed description of the invention
In order to make those skilled in the art be more fully understood that the present invention program, below in conjunction with the present invention Accompanying drawing in embodiment, is clearly and completely described the technical scheme in the embodiment of the present invention, Obviously, described embodiment is only the embodiment of a present invention part rather than whole enforcement Example.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creative work The every other embodiment obtained under premise, all should belong to the scope of protection of the invention.
It should be noted that the term in description and claims of this specification and above-mentioned accompanying drawing " first ", " second " etc. are for distinguishing similar object, without be used for describing specific order or Precedence.Should be appreciated that the data of so use can be exchanged in the appropriate case, in order to retouch here The embodiments of the invention stated can be real with the order in addition to those here illustrating or describing Execute.Additionally, term " includes " and " having " and their any deformation, it is intended that cover and do not arrange He comprises, such as, contain series of steps or the process of unit, method, system, product or Equipment is not necessarily limited to those steps or the unit clearly listed, but can include the most clearly listing Or for intrinsic other step of these processes, method, product or equipment or unit.
Embodiment 1
The embodiment of the method that the embodiment of the present invention one is provided can mobile terminal, terminal or The arithmetic unit that person is similar to performs.As a example by running on computer terminals, Fig. 1 is according to this A kind of structured flowchart of the terminal of the insertion method for media data of bright embodiment.Such as figure Shown in 1, the terminal 10 for the insertion method of media data can include one or more (only illustrating one in figure) (processor 102 can include but not limited to microprocessor to processor 102 The processing means of MCU or PLD FPGA etc.), for storing the memorizer of data 104 and for the transmitting device 106 of communication function.It will appreciated by the skilled person that Structure shown in Fig. 1 is only signal, and the structure of above-mentioned electronic installation is not caused restriction by it.Such as, Terminal 10 may also include the assembly more or more less than shown in Fig. 1, or have with Configurations different shown in Fig. 1.
Memorizer 104 can be used for storing software program and the module of application software, such as the present invention Programmed instruction/module that the insertion method of the media data in embodiment is corresponding, processor 102 is by fortune Row is stored in the software program in memorizer 104 and module, thus perform the application of various function and Data process, and i.e. realize the insertion method of above-mentioned media data.Memorizer 104 can include at a high speed with Machine memorizer, may also include nonvolatile memory, such as one or more magnetic storage device, sudden strain of a muscle Deposit or other non-volatile solid state memories.In some instances, memorizer 104 can be further Including the memorizer remotely located relative to processor 102, these remote memories can pass through network It is connected to terminal 10.The example of above-mentioned network include but not limited to the Internet, intranet, LAN, mobile radio communication and combinations thereof.
Transmitting device 106 is for receiving via a network or sending data.Above-mentioned network is concrete Example can include the wireless network that the communication providers of terminal 10 provides.In an example, Transmitting device 106 includes a network adapter (Network Interface Controller, NIC), It can be connected with other network equipments by base station thus can carry out communication with the Internet.At an example In, transmitting device 106 can be radio frequency (Radio Frequency, RF) module, and it is used for passing through Wireless mode and the Internet carry out communication.
Under above-mentioned running environment, the invention provides the insertion method of media data as shown in Figure 2. Fig. 2 is the flow chart of the insertion method of a kind of media data of according to embodiments of the present invention, the method May include steps of:
Step S21, obtains the media resource being inserted into media data, and wherein, media resource includes: For inserting multiple timing nodes of media data, and the image of each timing node.
Above-mentioned media resource can be video resource, can comprise multiple for inserting matchmaker in video resource The timing node of volume data, video resource can be by the image construction of multiple timing nodes.Above-mentioned media Data can be advertisement.
In the optional scheme of one, can input and need to insert advertisement by the way of outside inputs Video.
Whether step S23, exist scene handover information when meeting pre-conditioned in detection media resource Intermediate node, wherein, scene handover information at least includes one of following: movable information and colouring information.
Above-mentioned scene handover information can be in media resource, for symbolizing the letter of on-the-spot scape switching Breath, in actual processing procedure, can be indicated with movable information, colouring information.Above-mentioned pre- If condition could be for determining in media resource the condition that scene switches whether occur, such as, motion Information is more than particular value, or the similarity of colouring information is less than particular value.
In the optional scheme of one, after obtaining the video of input, video can be carried out scene Whether there is movable information in change detection, i.e. detection video, colouring information meets scene switching condition Timing node, thus obtain that video occurs the timing node that scene switches.
, in media resource being detected, there is scene handover information when meeting pre-conditioned in step S25 In the case of intermediate node, using timing node as the insertion timing node of media data.
In the optional scheme of one, the feelings of the timing node occurring that scene switches detected in video Under condition, the timing node that the timing node detected can be inserted as advertisement, i.e. throw in user The timing node of advertisement.
Step S27, according to inserting timing node, inserts media resource by media data.
In the optional scheme of one, timing node corresponding in video, example can be inserted advertisements into As, during user watches video, when the timing node that video is current arrives the insertion of advertisement In the case of intermediate node, suspend video playback, play the advertisement of input to user, when advertisement plays After Biing, continue to play the video of user's viewing.
Use the embodiment of the present invention, after getting the media resource being inserted into media data, pass through Whether detection media resource exists scene handover information and meets pre-conditioned timing node, in detection Exist in the case of scene handover information meets pre-conditioned timing node in media resource, by time Intermediate node as the insertion timing node of media data, and according to insert timing node, by media data Insert media resource.By the embodiment of the present invention, can be by detection media resource occurs that scene is cut The timing node changed, obtains the insertion timing node of media data, thus realize in media resource from Dynamic insert media data, solve of the prior art low by the artificial efficiency inserting media data and The technical problem that error rate is high, improves the efficiency inserting media data, saves and manually inserts media data, Reduce the error rate inserting media data, meet user's requirement successional to media resource, promote and use The experience of family viewing.
According to the above embodiment of the present invention, include at scene handover information: movable information or colouring information In the case of, step S23, whether detection media resource exists scene handover information and meets default bar The timing node of part, including:
Step S2311, from the image of each timing node, extracts the motion letter of each timing node Breath or colouring information.
Above-mentioned movable information can be the destination object of display in image, such as, object, human body etc. Motion vector, above-mentioned colouring information can be the color histogram of color in image.
In the optional scheme of one, can extract corresponding from the video image of each timing node Motion vector or color histogram, obtain the scene handover information of each timing node.
Step S2313, calculates the colouring information of any one timing node and the face of adjacent time node First similarity of color information.
In the optional scheme of one, in the video image from each timing node, obtain corresponding After color histogram, the color histogram that can calculate any one timing node saves with adjacent time The similarity of the color histogram of point.
Herein it should be noted that be the situation of movable information of each timing node extract Under, do not perform step S2313.
Step S2315, it is judged that whether the movable information of any one timing node meets first is preset bar Part, or the first similarity whether to meet second pre-conditioned.
Above-mentioned first pre-conditioned can be that minimum movement information or the motion letter that scene switches occurs , such as, there is the least displacement vector that scene switches, or the displacement that scene switches occurs in breath interval Vector is interval.Due to two same or like images, there is similar colouring information, i.e. two The similarity of the colouring information of image is the highest, therefore, above-mentioned second pre-conditioned can be that scene occurs The maximum similarity of switching, or occur that the similarity that scene switches is interval.
In the optional scheme of one, in the video image from each timing node, obtain corresponding After motion vector, the motion vector of each timing node can be compared with least displacement vector Relatively, or by the motion vector of each timing node compare with motion vector interval.
In the optional scheme of another kind, save with adjacent time being calculated any one timing node After the similarity of the color histogram of point, calculated similarity can be entered with maximum similarity Row compares, or calculated similarity is compared with similarity interval.
Step S2317, the movable information at any one timing node described meets described first to be preset Condition, or described first similarity meet described second pre-conditioned in the case of, determine described arbitrarily One timing node is described to meet pre-conditioned timing node.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime The amount of shifting to, or the motion vector of node sometime is in motion vector interval, it is determined that this time Intermediate node occurs that scene switches, i.e. this timing node is the timing node that scene switches occur.
In the optional scheme of another kind, if calculated similarity is similar less than or equal to maximum Spend, or calculated similarity is in similarity interval, it is determined that this timing node goes out scene Scape switches, i.e. the timing node that scene switches occurs in this timing node position.
According to the above embodiment of the present invention, include at scene handover information: movable information and colouring information In the case of, step S23, whether detection media resource exists scene handover information and meets default bar The timing node of part, including:
Step S2331, from the image of each timing node, extracts the motion letter of each timing node Breath and colouring information.
In the optional scheme of one, can extract corresponding from the video image of each timing node Motion vector or color histogram, obtain the scene handover information of each timing node.
Step S2333, it is judged that whether the movable information of any one timing node meets first is preset bar Part.
In the optional scheme of one, in the video image from each timing node, obtain corresponding After motion vector, the motion vector of each timing node can be compared with least displacement vector Relatively, or by the motion vector of each timing node compare with motion vector interval.
Step S2335, the movable information at any one timing node meets the first pre-conditioned feelings Under condition, calculate the of the colouring information of any one timing node and the colouring information of adjacent time node Two similarities.
In order to avoid occurring sentencing, determining that node is to occur that scene is cut sometime by movable information more After the timing node changed, two images that be will appear from scene switching by colouring information are needed to carry out face Color ratio relatively, will compare with the colouring information of adjacent time node by the colouring information of this timing node Relatively.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime The amount of shifting to, or the motion vector of node sometime is in motion vector interval, then can calculate The similarity of the color histogram of the color histogram of this timing node and adjacent time node, during to this Intermediate node is verified.
Step S2337, it is judged that it is pre-conditioned whether the first similarity meets second.
In the optional scheme of one, can compare with maximum similarity with calculated similarity Relatively, or by calculated similarity compare with similarity interval.
Step S2339, the second similarity meet second pre-conditioned in the case of, determine any one Individual timing node is timing node.
In the optional scheme of one, if calculated similarity is less than or equal to minimum similarity degree, Or calculated similarity is in similarity interval, it is determined that this timing node passes through checking, Determine that this timing node is the timing node that scene switches occur.
By above-mentioned steps S2331 to step S2339, satisfied can determined by movable information After one pre-conditioned timing node, by colouring information, this timing node is verified, only Can be as the insertion timing node of media data by the timing node of checking, thus segmentum intercalaris when reducing That puts chooses error, reduces the error rate that media data inserts further.
Herein it should be noted that obtain by checking timing node after, as it is shown on figure 3, The image by 6 timing nodes verified, timing node 1-6 the most as shown in Figure 3 can be obtained Image, although, the similarity of the colouring information of each adjacent timing node is relatively low, but, as The similarity of the colouring information of the timing node 1 shown in Fig. 3, timing node 3 and timing node 6 is very Height, the similarity of the colouring information of timing node 2, timing node 4 and timing node 5 is the highest, i.e. The image of above-mentioned 6 timing nodes belongs to same scene.Believe iff according to movable information and color Breath judges, using the inserting as media data of any one timing node in above-mentioned 6 timing nodes Angle of incidence node, it may appear that inserted by media data in same scene, causes user to watch media resource During, experience sense is poor, occurs being sick of sense to media data.
In order to solve the problems referred to above, obtain scene handover information in detection and meet pre-conditioned time segmentum intercalaris After Dian, scene switching can be merged, the scene repeated is fused into identical field Scape, can avoid being inserted in same scene media data.
According to the above embodiment of the present invention, in step S25, using timing node inserting as media data Before angle of incidence node, said method also includes:
Step S271, from timing node, segmentum intercalaris when obtaining two in preset range of time difference Point.
Herein it should be noted that owing to the time difference between the timing node of same scene is less, because of In preset range two timing nodes of time difference can be judged, above-mentioned preset range by this Can be the time difference of the timing node of the same scene obtained by lot of experiment validation, such as, can Being 5 minutes.
In the optional scheme of one, time difference can be obtained and exists from the timing node by checking Any two timing node in preset range, such as, time difference is less than or equal to any the two of 5 minutes Individual timing node.
Step S273, it is judged that whether the image of two timing nodes is same scene.
Step S275, in the case of the image of two timing nodes is same scene, from time segmentum intercalaris Point is deleted at least one timing node between two timing nodes, and two timing nodes, Timing node after screening.
In the optional scheme of one, if it is determined that the time difference any two time in preset range The image of node belongs to same scene, is melted by all timing nodes within two timing nodes Close, and reject from the timing node that detection obtains, the timing node after being screened.
Step S277, the timing node after screening is as the insertion timing node of media data.
By above-mentioned steps S271 to step S273, time difference can got in preset range Two timing nodes after, whether be same scene by judging the image of two timing nodes, right Detect that meeting pre-conditioned timing node screens, and obtains the timing node of non-equal scene, Thus reduce the error rate that media data inserts, promote the viewing experience of user.
According to the above embodiment of the present invention, step S273, it is judged that whether the image of two timing nodes For same scene, including:
Step S2731, calculates the third phase of colouring information of two timing nodes like degree.
Step S2733, it is judged that it is pre-conditioned whether third phase meets second like degree.
Step S2735, third phase like degree meet second pre-conditioned in the case of, when determining two The image of intermediate node is same scene.
In the optional scheme of one, getting the time difference any two time in preset range After node, the similarity of the color histogram of these two timing nodes can be calculated, if calculated To similarity more than occurring at the maximum similarity that scene switches, or calculated similarity In similarity interval, it is determined that the image of these two timing nodes is same or like image, thus The image determining these two timing nodes is same scene.
According to the above embodiment of the present invention, step S2311 or step S2331, from each timing node Image in, extract the movable information of each timing node, including:
Step S235, carries out movement locus estimation, when obtaining each to the image of each timing node The motion vector of intermediate node.
Herein it should be noted that the accuracy of motion vector in order to ensure each timing node, can With the image by any one timing node of comparison with adjacent multiple timing nodes, obtain segmentum intercalaris time this The motion vector of point.
In the optional scheme of one, as shown in Figure 4, media resource includes 5 timing nodes, Timing node A, timing node A1, timing node A2, timing node A3 and timing node B, In order to the image of timing node A is carried out movement locus estimation, can be according to above-mentioned 5 timing nodes Image, the square object in image is carried out Displacement Estimation, with the square in timing node A The position of object is starting point, with the position of the square object in timing node B as terminal, obtains phase The motion vector (as shown by the arrows in Figure 4) answered, thus obtain the motion vector of timing node A.
If herein also, it should be noted the image of any one timing node and adjacent time node In there is not identical object, timing node 1 as shown in Figure 3 and timing node 2, it is determined that two Individual image is not same or like image, occurs that scene switches, and can be made by maximum displacement vector Motion vector for this node.
Herein also, it should be noted carry out the speed of movement locus estimation to improve each timing node Degree, before media resource is carried out movement locus estimation, can reduce media resource, will Media resource is converted to the media resource of small in resolution, such as, as it is shown in figure 5, can be by left side The video of bigger resolution, is converted to the video of right side small in resolution.
According to the above embodiment of the present invention, step S2311 or step S2331, from each timing node Image in, extract the colouring information of each timing node, including:
Step S237, the color of image based on each timing node, obtain each timing node Color histogram.
In the optional scheme of one, can using the color of the image of each timing node as feature, The color histogram of structural map picture.
Herein it should be noted that for the impact reducing noise, and the color improving structural map picture is straight The speed of side's figure, in the color of image based on each timing node, obtains the face of each timing node Before Color Histogram, media resource can be carried out color quantizing process, be transformed into 1024 kinds of colors, For example, it is possible to by video as shown in Figure 6, be converted to the video of 1024 kinds of colors.
According to the above embodiment of the present invention, in step S25, using timing node inserting as media data Before angle of incidence node, said method also includes:
Step S291, obtain media data insertion information, wherein, insertion information at least include as Lower any one or more information: the quantity of media data, inserts the time period and inserts time interval.
Step S293, obtains the timing node with insertion information matches in timing node.
Step S295, using the timing node of coupling as the insertion timing node of media data.
In the optional scheme of one, after obtaining the timing node that scene switches occurs, Ke Yigen According to the quantity of the advertisement needing insertion, time period and interval, and the insertion of the advertisement inserted as required Information, screens the timing node obtained, and the scene obtaining the insertion information matches with advertisement is cut The timing node changed, as the insertion timing node of advertisement.Such as, as it is shown in fig. 7, pass through screening After can be using the timing node of this image as the insertion timing node of advertisement.
By above-mentioned steps S291 to step S295, can be right according to the insertion information of media data The timing node detected screens, and obtains the insertion timing node of media data, thus realizes inserting Angle of incidence node has higher controllability.
According to the above embodiment of the present invention, step S293, with insertion information in acquisition timing node The timing node joined, including:
Step S2931, obtains and is in the multiple timing nodes inserted in the time period.
Step S2933, according to quantity and the insertion time interval of media data, to multiple timing nodes Screen, obtain the timing node of coupling.
In the optional scheme of one, can choose within being positioned at the time period according to the time period of advertisement Multiple timing nodes, and according to the quantity of advertisement and interval, from multiple timing nodes, choose coupling Timing node, as the insertion timing node of advertisement.
The insertion method of media data provided above-described embodiment below is in another optional embodiment In be described, concrete steps as shown in Figure 8:
Step S81, input medium resource.
Optionally, the video of input is obtained.
Step S82, carries out estimation to media resource, obtains each timing node in media resource Movable information.
Optionally, the video of input is carried out movement locus estimation, obtains the displacement of each timing node Vector.
Step S83, according to the movable information of any one timing node, it is judged that whether this timing node Timing node for scene switching.
Optionally, the most pre-more than or equal to first by judging the motion vector of any one timing node If threshold value, or within whether being in the first preset range, judge whether this timing node is scene The timing node of switching, if the motion vector of this timing node is more than or equal to the first predetermined threshold value, or Within person is in the first preset range, it is determined that this timing node is the timing node of scene switching, enters Enter step S84;Otherwise, step S88 is entered.
Step S84, carries out color by timing node with the image of adjacent time node and compares, obtain face The similarity of color information.
Optionally, after obtaining the timing node of scene switching, the image of this timing node is constructed Color histogram, and the color histogram of the image of the timing node adjacent with this timing node, and Calculate the similarity of two color histograms.
Step S85, according to the similarity of colouring information, it is judged that whether this timing node is scene switching Timing node.
Optionally, whether the similarity by judging two color histograms presets threshold less than or equal to second Value, or within whether being in the second preset range, judge whether this timing node is scene switching Timing node, if the similarity of two color histograms is less than or equal to the second predetermined threshold value, or Within being in the second preset range, it is determined that this timing node is the timing node of scene switching, enters Step S86;Otherwise, step S88 is entered.
Step S86, meets the time segmentum intercalaris of pre-conditioned scene switching by this timing node and time difference Point merges.
Optionally, obtain in the timing node of scene switching, meet pre-with the time difference of this timing node If the timing node of scope, calculate the similarity of two color histograms, and judge two color histograms The similarity of figure whether less than or equal to the second predetermined threshold value, or whether be in the second preset range it In, if the similarity of two color histograms is more than the second predetermined threshold value, or it is pre-to be not in second Within the scope of if, it is determined that the image of two timing nodes is same scene, need to merge.
Step S87, determines the timing node that scene switches.
Optionally, from the timing node of scene switching, delete this two timing nodes, and be in Timing node between two timing nodes, determines the timing node that scene switches.
Step S88, determines that this timing node is not the timing node of scene switching.
Optionally, if the motion vector of this timing node is less than the first predetermined threshold value, or non-source Within the first preset range, it is determined that this timing node is not the timing node of scene switching, it is impossible to For inserting media data.If the similarity of two color histograms is more than the second predetermined threshold value, or Within person is not in the second preset range, it is determined that segmentum intercalaris when this timing node is not scene switching Point, it is impossible to be used for inserting media data.
By above-mentioned steps S81 to step S88, by the scene handover information in media resource is entered Row extracts, and analyzes, and sets up the screening model of the timing node of scene switching, and then chooses optimal matchmaker The insertion timing node of volume data.Media data insert timing node choose have the highest controlled Property, including choosing the number of media data, timing node, interval etc..Selected timing node Can be as accurate as microsecond, and insert media data and do not interfere with user's viewing experience to the story of a play or opera, can To deal carefully with the contradiction before media data insertion and Consumer's Experience.
It should be noted that for aforesaid each method embodiment, in order to be briefly described, therefore by it all Being expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not subject to The restriction of described sequence of movement, because according to the present invention, some step can use other orders Or carry out simultaneously.Secondly, those skilled in the art also should know, reality described in this description Executing example and belong to preferred embodiment, involved action and module not necessarily present invention institute is necessary 's.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive root The mode of required general hardware platform can be added by software according to the method for above-described embodiment to realize, when So can also pass through hardware, but a lot of in the case of the former is more preferably embodiment.Based on such reason Solving, the part that prior art is contributed by technical scheme the most in other words can be with soft The form of part product embodies, this computer software product be stored in a storage medium (as ROM/RAM, magnetic disc, CD) in, including some instructions with so that a station terminal equipment (can To be mobile phone, computer, server, or the network equipment etc.) perform each embodiment institute of the present invention The method stated.
Embodiment 2
According to embodiments of the present invention, a kind of insertion method for implementing above-mentioned media data is additionally provided The insertion apparatus of media data, as it is shown in figure 9, this device includes: the first acquisition module 91, inspection Survey module 93, the first processing module 95 and insertion module 97.
Wherein, the first acquisition module 91, for obtaining the media resource being inserted into media data, wherein, Media resource includes: for inserting multiple timing nodes of media data, and each timing node Image.
Above-mentioned media resource can be video resource, can comprise multiple for inserting matchmaker in video resource The timing node of volume data, video resource can be by the image construction of multiple timing nodes.Above-mentioned media Data can be advertisement.
In the optional scheme of one, can input and need to insert advertisement by the way of outside inputs Video.
Detection module 93, is used for detecting in media resource and whether there is the satisfied default bar of scene handover information The timing node of part, wherein, scene handover information at least includes one of following: movable information and color Information.
Above-mentioned scene handover information can be in media resource, for symbolizing the letter of on-the-spot scape switching Breath, in actual processing procedure, can be indicated with movable information, colouring information.Above-mentioned pre- If condition could be for determining in media resource the condition that scene switches whether occur, such as, motion Information is more than particular value, or the similarity of colouring information is less than particular value.
In the optional scheme of one, after obtaining the video of input, video can be carried out scene Whether there is movable information in change detection, i.e. detection video, colouring information meets scene switching condition Timing node, thus obtain that video occurs the timing node that scene switches.
First processing module 95, meets pre-for there is scene handover information in media resource being detected If in the case of the timing node of condition, using timing node as the insertion timing node of media data.
In the optional scheme of one, the feelings of the timing node occurring that scene switches detected in video Under condition, the timing node that the timing node detected can be inserted as advertisement, i.e. throw in user The timing node of advertisement.
Insert module 97, for according to inserting timing node, media data being inserted media resource.
In the optional scheme of one, timing node corresponding in video, example can be inserted advertisements into As, during user watches video, when the timing node that video is current arrives the insertion of advertisement In the case of intermediate node, suspend video playback, play the advertisement of input to user, when advertisement plays After Biing, continue to play the video of user's viewing.
Use the embodiment of the present invention, after getting the media resource being inserted into media data, pass through Whether detection media resource exists scene handover information and meets pre-conditioned timing node, in detection Exist in the case of scene handover information meets pre-conditioned timing node in media resource, by time Intermediate node as the insertion timing node of media data, and according to insert timing node, by media data Insert media resource.By the embodiment of the present invention, can be by detection media resource occurs that scene is cut The timing node changed, obtains the insertion timing node of media data, thus realize in media resource from Dynamic insert media data, solve of the prior art low by the artificial efficiency inserting media data and The technical problem that error rate is high, improve insert media data efficiency, save and artificial insert media number According to, reduce the error rate inserting media data, meet user's requirement successional to media resource, carry Rise the experience of user's viewing.
According to the above embodiment of the present invention, as shown in Figure 10, include at scene handover information: motion In the case of information or colouring information, above-mentioned detection module 93 includes: first extracts submodule 101, First calculating sub module 103, first judges that submodule 105 and first determines submodule 107.
Wherein, first extracts submodule 101, for from the image of each timing node, extracts every The movable information of individual timing node or colouring information.
Above-mentioned movable information can be the destination object of display in image, such as, object, human body etc. Motion vector, above-mentioned colouring information can be the color histogram of color in image.
In the optional scheme of one, can extract corresponding from the video image of each timing node Motion vector or color histogram, obtain the scene handover information of each timing node.
First calculating sub module 103, for calculating the colouring information of any one timing node with adjacent First similarity of the colouring information of timing node.
In the optional scheme of one, in the video image from each timing node, obtain corresponding After color histogram, the color histogram that can calculate any one timing node saves with adjacent time The similarity of the color histogram of point.
Herein it should be noted that extract submodule extract be each timing node motion letter In the case of breath, do not perform the function of the first calculating sub module.
First judges submodule 105, the fullest for judging the movable information of any one timing node Foot is first pre-conditioned, or the first similarity whether to meet second pre-conditioned.
Above-mentioned first pre-conditioned can be that minimum movement information or the motion letter that scene switches occurs , such as, there is the least displacement vector that scene switches, or the displacement that scene switches occurs in breath interval Vector is interval.Due to two same or like images, there is similar colouring information, i.e. two The similarity of the colouring information of image is the highest, therefore, above-mentioned second pre-conditioned can be that scene occurs The maximum similarity of switching, or occur that the similarity that scene switches is interval.
In the optional scheme of one, in the video image from each timing node, obtain corresponding After motion vector, the motion vector of each timing node can be compared with least displacement vector Relatively, or by the motion vector of each timing node compare with motion vector interval.
In the optional scheme of another kind, save with adjacent time being calculated any one timing node After the similarity of the color histogram of point, calculated similarity can be entered with maximum similarity Row compares, or calculated similarity is compared with similarity interval.
First determines submodule 107, meets for the movable information at any one timing node described Described first pre-conditioned, or described first similarity meet described second pre-conditioned in the case of, Determine that any one timing node described is described to meet pre-conditioned timing node.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime The amount of shifting to, or the motion vector of node sometime is in motion vector interval, it is determined that this time Intermediate node occurs that scene switches, i.e. this timing node is the timing node that scene switches occur.
In the optional scheme of another kind, if calculated similarity is similar less than or equal to maximum Spend, or calculated similarity is in similarity interval, it is determined that this timing node goes out scene Scape switches, i.e. the timing node that scene switches occurs in this timing node position.
According to the above embodiment of the present invention, as shown in figure 11, include at scene handover information: motion In the case of information and colouring information, above-mentioned detection module 93 includes: second extracts submodule 111, Second judges submodule 113, and the second calculating sub module 115, the 3rd judges submodule 117 and second Determine submodule 119.
Wherein, second extracts submodule 111, for from the image of each timing node, extracts every The movable information of individual timing node and colouring information.
In the optional scheme of one, can extract corresponding from the video image of each timing node Motion vector or color histogram, obtain the scene handover information of each timing node.
Second judges submodule 113, the fullest for judging the movable information of any one timing node Foot first is pre-conditioned.
In the optional scheme of one, in the video image from each timing node, obtain corresponding After motion vector, the motion vector of each timing node can be compared with least displacement vector Relatively, or by the motion vector of each timing node compare with motion vector interval.
Second calculating sub module 115, meets first for the movable information at any one timing node In the case of pre-conditioned, calculate colouring information and the adjacent time node of any one timing node Second similarity of colouring information.
In order to avoid occurring sentencing, determining that node is to occur that scene is cut sometime by movable information more After the timing node changed, two images that be will appear from scene switching by colouring information are needed to carry out face Color ratio relatively, will compare with the colouring information of adjacent time node by the colouring information of this timing node Relatively.
In the optional scheme of one, if the motion vector of node is more than or equal to minimum bit sometime The amount of shifting to, or the motion vector of node sometime is in motion vector interval, then can calculate The similarity of the color histogram of the color histogram of this timing node and adjacent time node, during to this Intermediate node is verified.
3rd judges submodule 117, pre-conditioned for judging whether the first similarity meets second.
In the optional scheme of one, can compare with maximum similarity with calculated similarity Relatively, or by calculated similarity compare with similarity interval.
Second determines submodule 119, for the second similarity meet second pre-conditioned in the case of, Determine that any one timing node is timing node.
In the optional scheme of one, if calculated similarity is less than or equal to minimum similarity degree, Or calculated similarity is in similarity interval, it is determined that this timing node passes through checking, Determine that this timing node is the timing node that scene switches occur.
By such scheme, can be determining satisfied first pre-conditioned time segmentum intercalaris by movable information After Dian, by colouring information, this timing node is verified, only by the timing node of checking Can as the insertion timing node of media data, thus reduce timing node choose error, enter one Step reduces the error rate that media data inserts.
Herein it should be noted that obtain by checking timing node after, as it is shown on figure 3, The image by 6 timing nodes verified, timing node 1-6 the most as shown in Figure 3 can be obtained Image, although, the similarity of the colouring information of each adjacent timing node is relatively low, but, as The similarity of the colouring information of the timing node 1 shown in Fig. 3, timing node 3 and timing node 6 is very Height, the similarity of the colouring information of timing node 2, timing node 4 and timing node 5 is the highest, i.e. The image of above-mentioned 6 timing nodes belongs to same scene.Believe iff according to movable information and color Breath judges, using the inserting as media data of any one timing node in above-mentioned 6 timing nodes Angle of incidence node, it may appear that inserted by media data in same scene, causes user to watch media resource During, experience sense is poor, occurs being sick of sense to media data.
In order to solve the problems referred to above, obtain scene handover information in detection and meet pre-conditioned time segmentum intercalaris After Dian, scene switching can be merged, the scene repeated is fused into identical field Scape, can avoid being inserted in same scene media data.
According to the above embodiment of the present invention, as shown in figure 12, said apparatus also includes: second obtains Module 121, it is judged that module 123, removing module 125 and the second processing module 127.
Wherein, the second acquisition module 121, for from timing node, obtain time difference at default model Enclose interior two timing node.
Herein it should be noted that owing to the time difference between the timing node of same scene is less, because of In preset range two timing nodes of time difference can be judged, above-mentioned preset range by this Can be the time difference of the timing node of the same scene obtained by lot of experiment validation, such as, can Being 5 minutes.
In the optional scheme of one, time difference can be obtained and exists from the timing node by checking Any two timing node in preset range, such as, time difference is less than or equal to any the two of 5 minutes Individual timing node.
Whether judge module 123, be same scene for judging the image of two timing nodes.
Removing module 125, is used in the case of the image of two timing nodes is same scene, from Segmentum intercalaris when deleting at least one between two timing nodes, and two timing nodes in timing node Point, the timing node after being screened.
In the optional scheme of one, if it is determined that the time difference any two time in preset range The image of node belongs to same scene, is melted by all timing nodes within two timing nodes Close, and reject from the timing node that detection obtains, the timing node after being screened.
Second processing module 127, for during by the timing node after screening as the insertion of media data Intermediate node.
By such scheme, can get the time difference two timing nodes in preset range it After, whether it is same scene by judging the image of two timing nodes, presets bar to detecting to meet The timing node of part screens, and obtains the timing node of non-equal scene, thus reduces media data The error rate inserted, promotes the viewing experience of user.
According to the above embodiment of the present invention, as shown in figure 13, above-mentioned judge module 123 includes: the Three calculating sub module 131, the 4th judges that submodule 133 and the 3rd determines submodule 135.
3rd calculating sub module 131, for calculating the third phase of the colouring information of two timing nodes seemingly Degree.
4th judges submodule 133, is used for judging whether third phase meets second like degree pre-conditioned.
3rd determines submodule 135, for third phase like degree meet second pre-conditioned in the case of, The image determining two timing nodes is same scene.
In the optional scheme of one, getting the time difference any two time in preset range After node, the similarity of the color histogram of these two timing nodes can be calculated, if calculated To similarity more than occurring at the maximum similarity that scene switches, or calculated similarity In similarity interval, it is determined that the image of these two timing nodes is same or like image, thus The image determining these two timing nodes is same scene.
According to the above embodiment of the present invention, above-mentioned first extracts submodule 101 or above-mentioned second extracts son Module 111 includes: estimate baryon module.
Wherein, estimate baryon module, for the image of each timing node is carried out movement locus estimation, Obtain the motion vector of each timing node.
Herein it should be noted that the accuracy of motion vector in order to ensure each timing node, can With the image by any one timing node of comparison with adjacent multiple timing nodes, obtain segmentum intercalaris time this The motion vector of point.
In the optional scheme of one, as shown in Figure 4, media resource includes 5 timing nodes, Timing node A, timing node A1, timing node A2, timing node A3 and timing node B, In order to the image of timing node A is carried out movement locus estimation, can be according to above-mentioned 5 timing nodes Image, the square object in image is carried out Displacement Estimation, with the square in timing node A The position of object is starting point, with the position of the square object in timing node B as terminal, obtains phase The motion vector (as shown by the arrows in Figure 4) answered, thus obtain the motion vector of timing node A.
If herein also, it should be noted the image of any one timing node and adjacent time node In there is not identical object, timing node 1 as shown in Figure 3 and timing node 2, it is determined that two Individual image is not same or like image, occurs that scene switches, and can be made by maximum displacement vector Motion vector for this node.
Herein also, it should be noted carry out the speed of movement locus estimation to improve each timing node Degree, before media resource is carried out movement locus estimation, can reduce media resource, will Media resource is converted to the media resource of small in resolution, such as, as it is shown in figure 5, can be by left side The video of bigger resolution, is converted to the video of right side small in resolution.
According to the above embodiment of the present invention, above-mentioned first extracts submodule 101 or above-mentioned second extracts son Module 111 includes: process baryon module.
Wherein, process baryon module, for the color of image based on each timing node, obtain every The color histogram of individual timing node.
In the optional scheme of one, can using the color of the image of each timing node as feature, The color histogram of structural map picture.
Herein it should be noted that for the impact reducing noise, and the color improving structural map picture is straight The speed of side's figure, in the color of image based on each timing node, obtains the face of each timing node Before Color Histogram, media resource can be carried out color quantizing process, be transformed into 1024 kinds of colors, For example, it is possible to by video as shown in Figure 6, be converted to the video of 1024 kinds of colors.
According to the above embodiment of the present invention, said apparatus also includes: the 3rd acquisition module, and the 4th obtains Module and the 3rd processing module.
Wherein, the 3rd acquisition module, for obtaining the insertion information of media data, wherein, inserts letter Breath at least includes following any one or more information: the quantity of media data, the insertion time period is with slotting The angle of incidence is spaced.
4th acquisition module, is used for obtaining in timing node and the timing node inserting information matches.
3rd processing module, for will the timing node of coupling as segmentum intercalaris during the insertion of media data Point.
In the optional scheme of one, after obtaining the timing node that scene switches occurs, Ke Yigen According to the quantity of the advertisement needing insertion, time period and interval, and the insertion of the advertisement inserted as required Information, screens the timing node obtained, and the scene obtaining the insertion information matches with advertisement is cut The timing node changed, as the insertion timing node of advertisement.Such as, as it is shown in fig. 7, pass through screening After can be using the timing node of this image as the insertion timing node of advertisement.
By such scheme, can be according to the insertion information of media data, to the timing node detected Screen, obtain the insertion timing node of media data, thus realize inserting timing node and have relatively High controllability.
According to the above embodiment of the present invention, above-mentioned 4th acquisition module includes: obtain submodule and screening Submodule.
Wherein, obtain submodule, be in, for obtaining, the multiple timing nodes inserted in the time period.
Screening submodule, for the quantity according to media data and insertion time interval, to multiple times Node screens, and obtains the timing node of coupling.
In the optional scheme of one, can choose within being positioned at the time period according to the time period of advertisement Multiple timing nodes, and according to the quantity of advertisement and interval, from multiple timing nodes, choose coupling Timing node, as the insertion timing node of advertisement.
Embodiment 3
Embodiments of the invention can provide a kind of terminal, and this terminal can be to calculate Any one computer terminal in machine terminal group.Alternatively, in the present embodiment, above-mentioned meter Calculation machine terminal can also replace with the terminal units such as mobile terminal.
Alternatively, in the present embodiment, above computer terminal may be located at the multiple of computer network At least one network equipment in the network equipment.
Alternatively, Figure 14 is the structured flowchart of a kind of terminal according to embodiments of the present invention. As shown in figure 14, this terminal A may include that one or more (only illustrating one in figure) Processor 141, memorizer 143 and transmitting device 145.
Wherein, memorizer 143 can be used for storing software program and module, in the embodiment of the present invention The insertion method of the media data programmed instruction/module corresponding with device, processor 141 is by running It is stored in the software program in memorizer 143 and module, thus performs the application of various function and number According to process, i.e. realize the insertion method of above-mentioned media data.Memorizer 143 can include the most random Memorizer, it is also possible to include nonvolatile memory, such as one or more magnetic storage device, sudden strain of a muscle Deposit or other non-volatile solid state memories.In some instances, memorizer 143 can be further Including the memorizer remotely located relative to processor 141, these remote memories can pass through network It is connected to terminal A.The example of above-mentioned network include but not limited to the Internet, intranet, LAN, mobile radio communication and combinations thereof.
Above-mentioned transmitting device 145 is for receiving via a network or sending data.Above-mentioned net Network instantiation can include cable network and wireless network.In an example, transmitting device 145 wraps Include a network adapter (Network Interface Controller, NIC), its can by netting twine with Other network equipments are connected with router thus can carry out communication with the Internet or LAN.A reality In example, transmitting device 145 is radio frequency (Radio Frequency, RF) module, and it is for by nothing Line mode and the Internet carry out communication.
Wherein, specifically, memorizer 143 is for storing ID Card Image pre-conditioned, to be detected And application program.
Processor 141 can call information and the application journey of memorizer 143 storage by transmitting device Sequence, to perform following step: obtain the media resource being inserted into media data, wherein, media resource Including: for inserting multiple timing nodes of media data, and the image of each timing node;Inspection Whether survey media resource exists scene handover information and meets pre-conditioned timing node, wherein, field Scape handover information at least includes one of following: movable information and colouring information;Media resource detected Middle exist in the case of scene handover information meets pre-conditioned timing node, using timing node as The insertion timing node of media data;According to inserting timing node, media data is inserted media resource.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: cuts in scene The information of changing includes: in the case of movable information or colouring information, from the image of each timing node, Extract movable information or the colouring information of each timing node;Calculate the color of any one timing node First similarity of the colouring information of information and adjacent time node;Judge any one timing node It is first pre-conditioned whether movable information meets, or the first similarity whether to meet second pre-conditioned; Movable information at any one timing node meets first pre-conditioned, or the first similarity meets In the case of two is pre-conditioned, determine that any one timing node is to meet pre-conditioned time segmentum intercalaris Point.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: cuts in scene The information of changing includes: in the case of movable information and colouring information, from the image of each timing node, Extract movable information and the colouring information of each timing node;Judge the motion of any one timing node It is pre-conditioned whether information meets first;It is pre-that movable information at any one timing node meets first If in the case of condition, calculate the colouring information of any one timing node and the face of adjacent time node Second similarity of color information;Judge whether the second similarity meets second pre-conditioned;In the second phase Like degree meet second pre-conditioned in the case of, determine that any one timing node is timing node.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: by the time Before node is as the insertion timing node of media data, from timing node, obtain time difference in advance If two timing nodes in scope;Whether the image judging two timing nodes is same scene;? In the case of the image of two timing nodes is same scene, segmentum intercalaris when deleting two from timing node At least one timing node between point, and two timing nodes, the timing node after being screened; Timing node after screening is as the insertion timing node of media data.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: calculates two The third phase of the colouring information of timing node is like degree;Judge whether third phase meets second like degree and preset bar Part;Third phase like degree be unsatisfactory for second pre-conditioned in the case of, determine the figure of two timing nodes Picture is same scene.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: to time each The image of intermediate node carries out movement locus estimation, obtains the motion vector of each timing node.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: based on each The color of the image of timing node, obtains the color histogram of each timing node.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: by the time Before node is as the insertion timing node of media data, the insertion information of acquisition media data, wherein, Insertion information at least includes following any one or more information: the quantity of media data, inserts the time Section and insertion time interval;Obtain the timing node with insertion information matches in timing node;Will coupling Timing node as the insertion timing node of media data.
Optionally, above-mentioned processor 141 can also carry out the program code of following steps: obtains and is in Insert the multiple timing nodes in the time period;Quantity according to media data and insertion time interval are right Multiple timing nodes screen, and obtain the timing node of coupling.
Embodiment 4
Embodiments of the invention additionally provide a kind of storage medium.Alternatively, in the present embodiment, on State the program code of insertion method that storage medium can store the media data of above-described embodiment 1.
Alternatively, in the present embodiment, above-mentioned storage medium is many in may be located at the network of computer At least one network equipment in the individual network equipment.
Alternatively, in the present embodiment, storage medium is arranged to storage for performing following steps Program code:
S1, obtains the media resource being inserted into media data, and wherein, media resource includes: be used for inserting Enter multiple timing nodes of media data, and the image of each timing node;
Whether S2, exist scene handover information in detection media resource and meet pre-conditioned time segmentum intercalaris Point, wherein, scene handover information at least includes one of following: movable information and colouring information;
, in media resource being detected, there is scene handover information meet pre-conditioned timing node in S3 In the case of, using timing node as the insertion timing node of media data;
S4, according to inserting timing node, inserts media resource by media data.
Alternatively, storage medium is also configured to storage for the program code performing following steps: Scene handover information includes: in the case of movable information or colouring information, from the figure of each timing node In Xiang, extract movable information or the colouring information of each timing node;Calculate any one timing node First similarity of colouring information of colouring information and adjacent time node;Judge any one time It is first pre-conditioned whether the movable information of node meets, or whether the first similarity meets second and preset Condition;Movable information at any one timing node meets first pre-conditioned, or the first similarity Meet second pre-conditioned in the case of, determine when any one timing node is to meet pre-conditioned Intermediate node.
Alternatively, storage medium is also configured to storage for the program code performing following steps: Scene handover information includes: in the case of movable information and colouring information, from the figure of each timing node In Xiang, extract movable information and the colouring information of each timing node;Judge any one timing node Movable information whether to meet first pre-conditioned;Movable information at any one timing node meets In the case of first is pre-conditioned, the colouring information calculating any one timing node saves with adjacent time Second similarity of the colouring information of point;Judge whether the second similarity meets second pre-conditioned;? Second similarity meet second pre-conditioned in the case of, determine segmentum intercalaris when any one timing node is Point.
Alternatively, storage medium is also configured to storage for the program code performing following steps: Using timing node as before the insertion timing node of media data, from timing node, obtain the time The difference two timing nodes in preset range;Whether the image judging two timing nodes is identical field Scape;In the case of the image of two timing nodes is same scene, from timing node, delete two At least one timing node between timing node, and two timing nodes, after being screened time Intermediate node;Timing node after screening is as the insertion timing node of media data.
Alternatively, storage medium is also configured to storage by the program code performing following steps: based on Calculate the third phase of colouring information of two timing nodes like degree;Judge whether third phase meets second like degree Pre-conditioned;Third phase like degree be unsatisfactory for second pre-conditioned in the case of, segmentum intercalaris when determining two The image of point is same scene.
Alternatively, storage medium is also configured to storage for the program code performing following steps: right The image of each timing node carries out movement locus estimation, obtains the motion vector of each timing node.
Alternatively, storage medium is also configured to storage for the program code performing following steps: base In the color of the image of each timing node, obtain the color histogram of each timing node.
Alternatively, storage medium is also configured to storage for the program code performing following steps: Using timing node as before the insertion timing node of media data, obtain the insertion letter of media data Breath, wherein, insertion information at least includes following any one or more information: the quantity of media data, Insert the time period and insert time interval;Obtain the time segmentum intercalaris with insertion information matches in timing node Point;Using the timing node of coupling as the insertion timing node of media data.
Alternatively, storage medium is also configured to storage for the program code performing following steps: obtain Take and be in the multiple timing nodes inserted in the time period;Quantity according to media data and between the insertion time Every, multiple timing nodes are screened, obtains the timing node of coupling.
Alternatively, in the present embodiment, above-mentioned storage medium can include but not limited to: USB flash disk, only Read memorizer (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), portable hard drive, various Jie that can store program code such as magnetic disc or CD Matter.
Alternatively, the concrete example in the present embodiment is referred in above-described embodiment 1 to embodiment 2 Described example, the present embodiment does not repeats them here.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
If the integrated unit in above-described embodiment realizes using the form of SFU software functional unit and as When independent production marketing or use, can be stored in the storage medium that above computer can read. Based on such understanding, prior art is contributed by technical scheme the most in other words Part or completely or partially can the embodying with the form of software product of this technical scheme, this meter Calculation machine software product is stored in storage medium, including some instructions with so that one or more calculates Machine equipment (can be personal computer, server or the network equipment etc.) performs the present invention, and each is implemented All or part of step of method described in example.
In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and certain is real Execute the part not having to describe in detail in example, may refer to the associated description of other embodiments.
In several embodiments provided herein, it should be understood that disclosed client, can Realize by another way.Wherein, device embodiment described above is only schematically, The division of the most described unit, is only a kind of logic function and divides, and actual can have additionally when realizing Dividing mode, the most multiple unit or assembly can gather or be desirably integrated into another system, Or some features can ignore, or do not perform.Another point, shown or discussed coupling each other Close or direct-coupling or communication connection can be the INDIRECT COUPLING by some interfaces, unit or module or Communication connection, can be being electrical or other form.
The described unit illustrated as separating component can be or may not be physically separate, The parts shown as unit can be or may not be physical location, i.e. may be located at a ground Side, or can also be distributed on multiple NE.Can select therein according to the actual needs Some or all of unit realizes the purpose of the present embodiment scheme.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit In, it is also possible to it is that unit is individually physically present, it is also possible to two or more unit are integrated in In one unit.Above-mentioned integrated unit both can realize to use the form of hardware, it would however also be possible to employ soft The form of part functional unit realizes.
The above is only the preferred embodiment of the present invention, it is noted that for the art For those of ordinary skill, under the premise without departing from the principles of the invention, it is also possible to make some improvement And retouching, these improvements and modifications also should be regarded as protection scope of the present invention.

Claims (14)

1. the insertion method of a media data, it is characterised in that including:
Obtaining the media resource being inserted into media data, wherein, described media resource includes: use In multiple timing nodes of the described media data of insertion, and the image of each timing node;
Detect and whether described media resource exists scene handover information when meeting pre-conditioned Intermediate node, wherein, described scene handover information at least includes one of following: movable information and face Color information;
Scene handover information is there is when meeting pre-conditioned in described media resource being detected In the case of intermediate node, using described timing node as segmentum intercalaris during the insertion of described media data Point;
According to described insertion timing node, described media data is inserted described media resource.
Method the most according to claim 1, it is characterised in that include at described scene handover information: In the case of described movable information or described colouring information, the described media resource of described detection is The no scene handover information that exists meets pre-conditioned timing node, including:
From the image of described each timing node, extract the motion letter of described each timing node Breath or colouring information;
Calculate the colouring information of any one timing node and the colouring information of adjacent time node The first similarity;
Judge whether the movable information of any one timing node meets first pre-conditioned, or institute Stating the first similarity, whether to meet second pre-conditioned;
Movable information at any one timing node described meets described first pre-conditioned, or Described first similarity meet described second pre-conditioned in the case of, determine described any one Timing node is described to meet pre-conditioned timing node.
Method the most according to claim 1, it is characterised in that include at described scene handover information: In the case of described movable information and described colouring information, the described media resource of described detection is The no scene handover information that exists meets pre-conditioned timing node, including:
From the image of described each timing node, extract the motion letter of described each timing node Breath and colouring information;
Judge whether the movable information of any one timing node meets first pre-conditioned;
Movable information at any one timing node described meets described first pre-conditioned In the case of, calculate the colouring information of any one timing node described and the face of adjacent time node Second similarity of color information;
Judge whether described second similarity meets second pre-conditioned;
Described second similarity meet described second pre-conditioned in the case of, determine described appointing A timing node of anticipating is described timing node.
Method the most according to claim 3, it is characterised in that described timing node is made described Before the insertion timing node of described media data, described method also includes:
From described timing node, obtain the time difference two timing nodes in preset range;
Whether the image judging said two timing node is same scene;
In the case of the image of said two timing node is described same scene, when described In intermediate node delete between said two timing node, and said two timing node at least One timing node, the timing node after being screened;
Using the timing node after described screening as the insertion timing node of described media data.
Method the most according to claim 4, it is characterised in that segmentum intercalaris during described judgement said two Whether the image of point is same scene, including:
Calculate the third phase of colouring information of said two timing node like degree;
Judge whether described third phase meets like degree described second pre-conditioned;
Described third phase be unsatisfactory for like degree described second pre-conditioned in the case of, determine described The image of two timing nodes is described same scene.
The most according to the method in claim 2 or 3, it is characterised in that described from described each time In the image of node, extract the movable information of described each timing node, including:
The image of described each timing node is carried out movement locus estimation, obtain described each time The motion vector of intermediate node.
The most according to the method in claim 2 or 3, it is characterised in that described from described each time In the image of node, extract the colouring information of described each timing node, including:
The color of image based on described each timing node, obtains described each timing node Color histogram.
Method the most according to claim 1, it is characterised in that described timing node is made described Before the insertion timing node of described media data, described method also includes:
Obtain the insertion information of described media data, wherein, described insertion information at least include as Lower any one or more information: the quantity of described media data, when inserting the time period and insert Between be spaced;
Obtain the timing node with described insertion information matches in described timing node;
Using the timing node of described coupling as the insertion timing node of described media data.
Method the most according to claim 8, it is characterised in that in the described timing node of described acquisition With the timing node of described insertion information matches, including:
Obtain and be in the described multiple timing nodes inserted in the time period;
Quantity according to described media data and described insertion time interval, to the plurality of time Node screens, and obtains the timing node of described coupling.
10. the insertion apparatus of a media data, it is characterised in that including:
First acquisition module, for obtaining the media resource being inserted into media data, wherein, institute State media resource to include: for inserting multiple timing nodes of described media data and each The image of timing node;
Detection module, be used for detecting in described media resource whether exist scene handover information meet Pre-conditioned timing node, wherein, described scene handover information at least includes one of following: Movable information and colouring information;
, for there is scene handover information in described media resource being detected in the first processing module In the case of meeting pre-conditioned timing node, using described timing node as described media number According to insertion timing node;
Insert module, for according to described insertion timing node, described media data being inserted institute State media resource.
11. devices according to claim 10, it is characterised in that at described scene handover information bag Include: in the case of described movable information or described colouring information, described detection module includes:
First extracts submodule, for from the image of described each timing node, extracts described The movable information of each timing node or colouring information;
First calculating sub module, for calculating the colouring information of any one timing node with adjacent First similarity of the colouring information of timing node;
First judges submodule, the fullest for judging the movable information of any one timing node Foot is first pre-conditioned, or described first similarity whether to meet second pre-conditioned;
First determines submodule, meets for the movable information at any one timing node described Described first pre-conditioned, or described first similarity meets described second pre-conditioned situation Under, determine that any one timing node described is described to meet pre-conditioned timing node.
12. devices according to claim 10, it is characterised in that at described scene handover information bag Include: in the case of described movable information and described colouring information, described detection module includes:
Second extracts submodule, for from the image of described each timing node, extracts described The movable information of each timing node and colouring information;
Second judges submodule, the fullest for judging the movable information of any one timing node Foot first is pre-conditioned;
Second calculating sub module, meets for the movable information at any one timing node described Described first pre-conditioned in the case of, calculate the colouring information of any one timing node described The second similarity with the colouring information of adjacent time node;
3rd judges submodule, is used for judging whether described second similarity meets second and preset bar Part;
Second determines submodule, described second pre-conditioned for meeting in described second similarity In the case of, determine that any one timing node described is described timing node.
13. devices according to claim 12, it is characterised in that described device also includes:
Second acquisition module, for from described timing node, obtains time difference in preset range Two interior timing nodes;
Whether judge module, be same scene for judging the image of said two timing node;
Removing module, for the feelings that image is described same scene at said two timing node Under condition, from described timing node, delete said two timing node, and said two time At least one timing node between node, the timing node after being screened;
Second processing module, is used for the timing node after described screening as described media data Insertion timing node.
14. devices according to claim 13, it is characterised in that described judge module includes:
3rd calculating sub module, for calculating the 3rd of the colouring information of said two timing node Similarity;
4th judges submodule, is used for judging whether described third phase meets like degree described second pre- If condition;
3rd determines submodule, presets bar for being unsatisfactory for described second at described third phase like degree In the case of part, determine that the image of said two timing node is described same scene.
CN201610437530.1A 2016-06-16 2016-06-16 The insertion method and device of media data Active CN106028088B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610437530.1A CN106028088B (en) 2016-06-16 2016-06-16 The insertion method and device of media data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610437530.1A CN106028088B (en) 2016-06-16 2016-06-16 The insertion method and device of media data

Publications (2)

Publication Number Publication Date
CN106028088A true CN106028088A (en) 2016-10-12
CN106028088B CN106028088B (en) 2018-12-11

Family

ID=57088719

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610437530.1A Active CN106028088B (en) 2016-06-16 2016-06-16 The insertion method and device of media data

Country Status (1)

Country Link
CN (1) CN106028088B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107920275A (en) * 2017-12-29 2018-04-17 广东欧珀移动通信有限公司 Video broadcasting method, device, terminal and storage medium
CN108228795A (en) * 2017-12-29 2018-06-29 北京奇虎科技有限公司 Add the method and device of business object
CN108960589A (en) * 2018-06-14 2018-12-07 阳光易购(北京)科技有限公司 Clean vegetables service operation management method and device
CN110611834A (en) * 2019-08-28 2019-12-24 杭州当虹科技股份有限公司 Streaming media advertisement interactive association accurate delivery method
CN112261316A (en) * 2020-09-22 2021-01-22 深圳市奥拓电子股份有限公司 Method, device and system for switching scenes by video stitching processor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1009166A2 (en) * 1998-11-20 2000-06-14 General Instrument Corporation Splicing of video data in progressively refreshed video streams
CN101755453A (en) * 2007-05-31 2010-06-23 索尼计算机娱乐美国公司 System and method for taking control of a system during a commercial break
CN104918060A (en) * 2015-05-29 2015-09-16 北京奇艺世纪科技有限公司 Method and device for selecting position to insert point in video advertisement

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1009166A2 (en) * 1998-11-20 2000-06-14 General Instrument Corporation Splicing of video data in progressively refreshed video streams
CN101755453A (en) * 2007-05-31 2010-06-23 索尼计算机娱乐美国公司 System and method for taking control of a system during a commercial break
CN104918060A (en) * 2015-05-29 2015-09-16 北京奇艺世纪科技有限公司 Method and device for selecting position to insert point in video advertisement

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107920275A (en) * 2017-12-29 2018-04-17 广东欧珀移动通信有限公司 Video broadcasting method, device, terminal and storage medium
CN108228795A (en) * 2017-12-29 2018-06-29 北京奇虎科技有限公司 Add the method and device of business object
CN108960589A (en) * 2018-06-14 2018-12-07 阳光易购(北京)科技有限公司 Clean vegetables service operation management method and device
CN110611834A (en) * 2019-08-28 2019-12-24 杭州当虹科技股份有限公司 Streaming media advertisement interactive association accurate delivery method
CN112261316A (en) * 2020-09-22 2021-01-22 深圳市奥拓电子股份有限公司 Method, device and system for switching scenes by video stitching processor

Also Published As

Publication number Publication date
CN106028088B (en) 2018-12-11

Similar Documents

Publication Publication Date Title
CN106028088A (en) Insertion method and device of media data
CN105380575A (en) Control method and system for sweeping robot, cloud server and sweeping robot
CN106412277A (en) Method and apparatus for loading virtual scene
EP3513566A1 (en) Methods and systems of spatiotemporal pattern recognition for video content development
CN102541259A (en) Electronic equipment and method for same to provide mood service according to facial expression
CN113687600A (en) Simulation test method, simulation test device, electronic equipment and storage medium
US11504635B2 (en) Vector-space framework for evaluating gameplay content in a game environment
CN106797498A (en) Message processing device, information processing method and program
CN105975612A (en) Picture processing method, device and equipment
CN109685785A (en) A kind of image quality measure method, apparatus and electronic equipment
CN110956202A (en) Image training method, system, medium and intelligent device based on distributed learning
CN106302477A (en) A kind of net cast method of testing and system
CN115049057B (en) Model deployment method and device, electronic equipment and storage medium
CN113096055B (en) Training method and device for image generation model, electronic equipment and storage medium
CN109472764A (en) Method, apparatus, equipment and the medium of image synthesis and the training of image synthetic model
CN113822654A (en) Engineering project construction progress management method, device, equipment and storage medium
CN110019939A (en) Video temperature prediction technique, device, terminal device and medium
CN108280096A (en) Data cleaning method and data cleansing device
CN110058829A (en) A kind of image processing method, device and storage medium
CN111432206A (en) Video definition processing method and device based on artificial intelligence and electronic equipment
CN106162357A (en) Obtain the method and device of video content
CN111783586A (en) Food material management method and device, computing equipment and storage medium
CN114360018B (en) Rendering method and device of three-dimensional facial expression, storage medium and electronic device
CN110852224B (en) Expression recognition method and related device
CN105991583A (en) Game application recommendation method, application server, terminal and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant