CN101753913B - Method and device for inserting hyperlinks in video, and processor - Google Patents
Method and device for inserting hyperlinks in video, and processor Download PDFInfo
- Publication number
- CN101753913B CN101753913B CN2008102416251A CN200810241625A CN101753913B CN 101753913 B CN101753913 B CN 101753913B CN 2008102416251 A CN2008102416251 A CN 2008102416251A CN 200810241625 A CN200810241625 A CN 200810241625A CN 101753913 B CN101753913 B CN 101753913B
- Authority
- CN
- China
- Prior art keywords
- hyperlink
- key frame
- video
- picture
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The embodiment of the invention relates to a method and a device for inserting hyperlinks in a video, and a processor. The method comprises: establishing associated corresponding relationship between a picture and a hyperlink; selecting a key frame in the video; associating the key frame with the picture with the same target object by extracting the target object in the picture and the key frame in the video, establishing the associating relation of the key frame and the picture; according to the associated corresponding relationship between the picture and the hyperlink and the associated corresponding relationship between the key frame and the picture, obtaining the corresponding relationship between the key frame and the hyperlink, and generating a hyperlink file including the corresponding relationship between the key frame and the hyperlink; and executing the hyperlink file, and inserting the corresponding hyperlink in the key frame which plays the video. The embodiment of the invention realizes the automatic insertion of the hyperlinks in the video without human involvement, and greatly improves the efficiency and accuracy of inserting hyperlinks in the video, and the user experience of watching the video.
Description
Technical field
The present invention relates to the communications field, relate in particular to the method, device and the processor that in video transmission, insert hyperlink.
Background technology
Along with the continuous development of the communication technology, the communication service that video transmission technologies and video are relevant is also fast-developing thereupon.The video hot link promptly inserts some hyperlink icons in video display process, behind the clickable hyperlinks icon, can see the content of hyperlink.
At present, the technology of insertion hyperlink is common in the advertising business in the video.Common advertising business is that advertisement or advertisement hyperlink are directly intercutted in video, pushes away to the user under the active, does not consider user's impression, is a kind of mandatory advertisement, and the user is powerless to the advertisement of being sick of.In addition, in video display process, the advertisement of some user's pull-downs also occurred at present, that is: the user can select to click and watch or do not watch through drop-down menu, has solved force users to a certain extent and has seen this problem of advertisement, is accepted by popular.This interactivity has demonstrated fully the characteristics of rich-media ads, gives the user better interaction mode than traditional commercial breaks.
Prior art provides the method for inserting hyperlink in a kind of video, and its implementation procedure is: with a video player displaying video content, and while user's browsing video content; In the frame of video part that needs insert, suspend video playback, manually that this frame of video is related with a target hyperlink, generate the hypervideo file of being with hyperlink.
The above-mentioned process of in video, inserting hyperlink needs the people for browsing all frame of video, which frame to insert hyperlink so that confirm at.In concrete the realization, need artificial the participation, inefficiency needs a large amount of artificially for the overlength video, and almost be impossible realize in the video of real-time play, inserting advertisement.
Summary of the invention
The method of inserting hyperlink is provided in the embodiment of the invention in a kind of video, comprises: the related corresponding relation of setting up picture and hyperlink; Key frame in the selecting video; Through extracting the destination object in said picture and the said key frame of video, association has the key frame and the picture of same target object, sets up the related corresponding relation of said key frame and said picture; According to this picture and the related corresponding relation of hyperlink and the related corresponding relation of this key frame and this picture, obtain the corresponding relation of this key frame and this hyperlink, generate the hyperlink file that comprises this key frame and this hyperlink corresponding relation; Carry out this hyperlink file, in the key frame of playing this video, insert corresponding hyperlink.
A kind of processor is provided in the embodiment of the invention, is used for inserting hyperlink at video, comprising: hyperlink and picture associative cell are used to set up the related corresponding relation of picture and hyperlink; Select frame unit, be used for the key frame of selecting video information; The object matching unit is used for through extracting the destination object of said picture and said key frame of video, and association has the key frame and the picture of same target object, sets up the related corresponding relation of said key frame and said picture; The hyperlink file generating unit; Be used for according to this picture and the related corresponding relation of the related corresponding relation of this hyperlink with this key frame and this picture; Obtain the corresponding relation of this key frame and this hyperlink, generate the hyperlink file that comprises this key frame and this hyperlink corresponding relation; The hypervideo broadcast unit is carried out this hyperlink file, in the key frame of playing this video, inserts corresponding hyperlink.
The device that inserts hyperlink in a kind of video is provided in the embodiment of the invention; Comprise: be used to receive receiver, the processor of hyperlink, picture and video information and be used to export the transmitter of the video that inserts said hyperlink, wherein said processor is the processor that is used for inserting at video hyperlink that the embodiment of the invention provides.
The method that provides according to the embodiment of the invention, device and processor are searched the hyperlink relevant with keyframe content according to the analysis to key frame of video, and the position that this key frame is corresponding in video insertion hyperlink.Automatically realized in video, inserting hyperlink, need not human intervention; And the video that can like according to the user, push its interested other guide through the hyperlink in this video to the user, for example: advertisement, news or movie and television play.
Description of drawings
A kind of method flow diagram that in video insert hyperlink of Fig. 1 for providing in the embodiment of the invention one;
A kind of picture with the hyperlink related table of comparisons of Fig. 2 for providing in the embodiment of the invention one;
A kind of frame of video frame number with the picture related table of comparisons of Fig. 3 for providing in the embodiment of the invention one;
Fig. 4 is the related table of comparisons with hyperlink of frame of video frame number in a kind of hyperlink file that provides in the embodiment of the invention one;
A kind of method flow diagram that in video insert hyperlink of Fig. 5 for providing in the embodiment of the invention two;
Fig. 6 is the related table of comparisons with hyperlink of frame of video frame number in a kind of hyperlink file that provides in the embodiment of the invention two
A kind of apparatus structure sketch map that in video insert hyperlink of Fig. 7 for providing in the embodiment of the invention three;
The preparation implement body structure sketch map of Fig. 8 for providing in the embodiment of the invention four;
Fig. 9 another concrete structure sketch map of processor for providing in the embodiment of the invention five;
The hypervideo broadcast unit concrete structure sketch map of Figure 10 for providing in the embodiment of the invention five.
Specific embodiment
The method of in video, inserting hyperlink that Fig. 1 provides for the embodiment of the invention one comprises following concrete steps.
Step S101 sets up the related corresponding relation of picture and hyperlink, and detailed process is following:
Wherein, each picture can be corresponding with a hyperlink.This hyperlink can be that (Uniform Resource Locator, URL), content pointed can be text, audio frequency, video or three's a combination in any in a uniform resource locator address.Picture can be BMP (bitmap), and JPEG (Joint Photographic Experts Group, common picture format such as JPEG), and comprise a concrete destination object in this picture.For example: comprise people's face of a certain star in the picture, perhaps comprise the picture of a BMW or the sign of BMW in the picture.Background in this picture can be single, also can be not single.In addition, the single target object can be comprised in the picture, also a plurality of different target objects can be comprised simultaneously.The storage table of comparisons of some pictures of a kind of association and hyperlink is provided in the embodiment of the invention one, as shown in Figure 2.As far as knowing the knowledge capital those skilled in the art, expect that easily the mode of other non-forms stores the corresponding relation of these some pictures and hyperlink.
Step S102, the key frame in the selecting video, detailed process is following:
At first, read video information, video playback time and frame per second, calculate total video frame number.Here, video information can be that (Moving Picture Expert Group, Motion Picture Experts Group comprises MPEG-1 to MPEG, MPEG-2, common video format such as MPEG-4).
Secondly, select the selected frame number of frame and record.This selects frame to be meant the some frames in the selecting video continuous images sequence, according to number of video frames, adopts corresponding method to select frame.The frame of selecting is the key frame in this video.Three kinds of methods of selecting frame are provided in the embodiments of the invention.
Method one: video is carried out Shot Detection, choose key frame afterwards.Choosing of key frame can be first frame, intermediate frame or the tail frame of camera lens.The method that Shot Detection can adopt has: basic shot segmentation technique, image pixel difference method and color histogram difference method.The benefit of doing like this is, bigger difference is arranged between the different camera lenses, on the basis of Shot Detection, selects key frame, and bigger difference is arranged between key frame and the key frame, in ensuing target identification, avoids the unnecessary image and the coupling of frame of video.This method is applicable to the video that reproduction time is long, the video totalframes is bigger.
Method two: video is not carried out Shot Detection, choose some frames at a distance from some randomly.For example: every at a distance from frame of 10-30 frame selection.Here, can be according to the length adjustment frame of video space-number of video playback time, long video can be selected long frame period number, and short-sighted frequency can be selected short frame period number.Because the impression of viewing and admiring that how much has influence on the user of inserting number of ads in one section video is inserted too much advertisement and is caused that spectators are bored.This method is suitable for longer video equally, and selects the method for frame simple, reduces operand.
Method three: select frame by frame.This selects frame method to be fit to short video; Short video itself comprises less frame of video; And general camera lens switches often, selects frame to avoid Shot Detection consuming time by frame, and the identification possibility that also can guarantee in subsequent step S103, to detect destination object in the key frame is big.
Step S103, through picture among the same target object association above-mentioned steps S101 and the key frame among the above-mentioned steps S102, detailed process is following:
At first, the objectives object of key frame among picture and the step S102 among the extraction step S101.Wherein, The method that destination object extracts has: local invariant characteristic method (Scale Invariant feature transform; SIFT) but concrete list of references " special characteristics of image " (stinctiveimage features from scale-invariant keypoints, David G.Lowe, Di with yardstick consistency key point; Theinternational journal of computer vision, 2004); For destination object to be matched is people's face, except the SIFT algorithm, can also utilize face recognition algorithms to carry out object matching; But concrete list of references " based on the recognition of face under the illumination variation of Gabor phase place statistical model " (Facerecognition under varying lighting based on the probabilistic model ofGabor, Laiyun Qing, Shiguang Shan; Xinlin Chen; Wen Gao, Phase.IEEE, 2006); Feature extraction also can be selected additive method, and its principle is to extract stable characteristics of image, i.e. destination object is so that detect the destination object with shape facility when further mating.Step S101 picture destination object can extract once the back and preserve, and uses when mating as the succeeding target characteristics of objects.
Subsequently, key frame selected among picture among the step S101 and the step S102 is carried out the destination object characteristic matching, but list of references " special characteristics of image " (stinctiveimage features from scale-invariant keypoints with yardstick consistency key point; David G.Lowe, Di, theinternational journal of computer vision; 2004); And document " utilizing the nearest method of searching to carry out the shape index " (Shape indexing using approximatenearest-neighbour search in high-dimensional spaces, Jeffrey S.Beis and DavidG.Lowe, In Conference on Computer Vision and Pattern Recognition at higher dimensional space; HiltonHead; South Carolina, pp.774-781,1997); Find out key frame and picture, set up the related corresponding relation of this key frame and this corresponding picture with same destination object.Comprise the BMW icon simultaneously such as key frame of video and picture, then related this key frame of video and this picture.
Because picture with respect to the key frame negligible amounts of selecting in the video, can remove the destination object in the match video key frame through the destination object in the picture.Otherwise, also can remove to mate the destination object in the picture through the destination object in the key frame of video.Be principle to save the equipment operand in a word.
In addition, possibly comprise some destination objects in the common frame of video, therefore, maybe be related with a plurality of pictures.Situation according to realistic objective object coupling decide, and it is a kind of through related key frame frame number and picture that the embodiment of the invention provides, and the related table of comparisons of realization key frame and picture is as shown in Figure 3.As far as knowing the knowledge capital those skilled in the art, expect that easily the mode of other non-forms or non-frame number stores the corresponding relation of this key frame and picture.Wherein, frame number a, b ... n is a number of frames in the video, a, and b ... the ..n frame number possibly be a consecutive frame, also possibly be the frame number of some numbers of being separated by.Picture format can be various forms, for example: bitmap (bitmap, BMP), JPEG (Joint Photographic Experts Group, JPEG) etc.
Step S104 generates the corresponding hyperlink file of video among the above-mentioned steps S102, and detailed process is following:
At first, according to the related table of comparisons of key frame frame number among the step S103 with picture, the related table of comparisons with hyperlink of picture among the finding step S101 can obtain the related corresponding relation of key frame frame number and hyperlink, and is as shown in Figure 4.For example, information can be learnt from Fig. 2, Fig. 3, and the hyperlink that key frame frame number K1 is corresponding among Fig. 4 is URL1; The hyperlink that key frame frame number K2 is corresponding is URL1 and URL2.
Subsequently, generate the hyperlink file that comprises information shown in Figure 4.The hyperlink file is another file that is different from video file among the step S102.Comprised the relevant information of the corresponding hyperlink of this video in this hyperlink file.Wherein comprise some records, include several fields in every record.For example: frame of video frame number and hyperlink, specifically as shown in Figure 4.In order to better meet user experience, every record in this hyperlink file can also comprise other field, in follow-up embodiment, will further introduce.
Step S105 carries out the hyperlink file among the S104, inserts hyperlink in the video in playing the S102 step.
Read the hyperlink fileinfo, in displaying video, in the corresponding key frame of key frame frame number, insert corresponding hyperlink.
The hyperlink method of in video, inserting that adopts the above embodiment of the present invention to provide can be inserted hyperlink automatically in video, according to the user's interest video, push the user's interest content through hyperlink to the user, for example: advertisement, news.Conceivable, a BMW is arranged in the video that the user watches, the hyperlink that the embodiment of the invention just can be relevant with its content with this BMW automatically is related, and through clickable hyperlinks, the user just can obtain relevant advertisement of BMW or sales information etc. immediately.
In order in concrete the realization, to obtain better effect, the embodiment of the invention two is provided at the method for in video, inserting hyperlink that improvement is gone up on embodiment one basis.
Step S201 is identical with the embodiment of the invention one to step S203, repeats no more at this.
Step S204 confirms the thermal region in the key frame of video.
Said thermal region is the outstanding zone that shows in the video, usually can high bright demonstration.The embodiment of the invention two provides a kind of method of definite thermal region:
Detected the several features point when carrying out target identification among the step S203, these characteristic points are different in the distribution density of picture.In the target identification zone, the distribution of characteristic point is than comparatively dense, and in the driftlessness zone, characteristic point distributes more sparse even some places do not have.Thermal region confirms that method is following:
First row are searched these row and whether are comprised characteristic point from the video frame images left side.If comprise characteristic point, then write down the abscissa of this point.Otherwise, continue to search next column, comprise only classifying as of characteristic point up to finding.Abscissa is X1;
First row from video frame images the right are searched these row and whether are comprised characteristic point, if comprise characteristic point, then write down the abscissa of this point.Otherwise, continue to search next column, comprise only classifying as of characteristic point up to finding.Abscissa is X2;
First row is searched this row and whether is comprised characteristic point from the video frame images top, if comprise characteristic point, then writes down this characteristic point ordinate.Otherwise, continue to search next column, up to finding the behavior that comprises characteristic point to end.Ordinate Y1;
From following first row of video frame images, search this row and whether comprise characteristic point, if comprise characteristic point, then write down this characteristic point ordinate.Otherwise, continue to search, up to finding the behavior that comprises characteristic point to end.Ordinate Y2;
Thermal region left upper apex coordinate is that (X1, Y1), the bottom right apex coordinate is that (X2, Y2), thermal region is to be left upper apex with A to B, the rectangular area that B forms for the summit, bottom right to A.
Destination object accurately belongs to the zone in the frame of video, and comparatively dense is compared in the distribution of characteristic point.But, possibly still there is the point of some flase drops, more sparsely drop on outside the destination object zone.For accurate localization target area as far as possible comparatively, need to get rid of these sparse flase drop points.In order further to improve the accuracy that thermal region detects, the embodiment of the invention two further comprises step: get rid of the flase drop zone.Its method is following: utilize a scanning block block-by-block scanning calorimeter zone, remove the flase drop point, confirm new boundary point.For example, can select the pixel block of a 20*20, begin from the A point; In its thermal region, from top to bottom, from left to right scanning calorimeter is regional; (number of point is according to the dense degree decision of the SIFT characteristic point of object in the image, and the value range here chooses 1～10, also can adjust according to application need) drops on thermal region to determine whether to have only a few point; If, explain that then this point is the flase drop point, confirm the A point again according to scanning block.If begin scanning from the B point, its scanning direction is from top to bottom, and from right to left, method is similar to from the method for A spot scan.
Step S205, the thumbnail of picture among the generation step S203.
Because the dimension of picture that coupling obtains among the step S203 is general bigger, need it be dwindled to do icon.Can adopt convergent-divergent algorithm commonly used to dwindle.Size according to thumbnail requires is sampled to the original image picture element, obtains new image.Suppose that the original image size is M*N, requiring thumbnail size is K1M*K2N, (K1＜1, K2＜1), its convergent-divergent algorithm is following: the first step: establish original image and be F (i, j), i=1,2,3......, M, j=1,2,3......N.Calculate image G (x, y) the number of pixels after compressing.The number of pixels of both direction is respectively x=1, and 2,3......K1M, y=1,2,3......K2N.Second step: count out some pixel in the sampling original image according to image pixel.G (x, y)=F (c1*x, c2*y), wherein, c1=1/k1, c2=1/k2.X=1,2,3......K1M, y=1,2,3......K2N, c1*x, c2*y calculate both direction sampled point pixel location.Can obtain the thumbnail of said picture.
Step S206 generates the corresponding hyperlink file of video among the above-mentioned steps S202.
The hyperlink file is another file that is different from video file among the step S202 equally in the embodiment of the invention two.This hyperlink file the inside has comprised the relevant information of the corresponding hyperlink of this video.Wherein comprise some records, include several fields in every record.For example: the key frame frame number, coupling picture name, coupling picture URL, key frame thermal region position and hyperlink etc., specifically as shown in Figure 6.Wherein, the key frame frame number is used for the unique identification key frame of video; The coupling picture name is used to identify picture or the thumbnail that has the same target object with corresponding key frame; Coupling picture URL is used for obtaining the corresponding coupling picture or the thumbnail of step S205 picture through this URL; Key frame thermal region station location marker is the thermal region position in the key frame of confirming among the step S204; And hyperlink is the corresponding hyperlink of coupling picture that obtains according to corresponding relation among the step S201, through hyperlink URL obtain with key frame of video or coupling picture in the relevant content of destination object.
Step S207 carries out the hyperlink file among the S206, and the thermal region in the key frame of video in playing the S202 step inserts the thumbnail of coupling picture.
Video file among the step for playing S202, and obtain current displaying video frame frame number information.For example: the current frame of video frame number that obtains is K1, and the frame of video frame number field of each bar record of hyperlink file judges whether both are identical among more current frame number K1 and the step S206.Meet through relatively judging article one record; Then ((X11 Y11) inserts coupling picture Picture1 in (X12, Y12)) at the thermal region of the corresponding key frame of key frame frame number K1; The information of this picture Picture1 obtains through the URL of coupling picture; Be URL11 in this example, wherein, this picture Picture1 is related with corresponding hyperlink URL 1.Promptly click this picture Picture1 that inserts among the key frame of video K1 as the user, just can show the content that hyperlink URL 1 is pointed, for example: advertisement, music, news etc.In other embodiments, the hyperlink icon is ejected in a zone of frame of video that also can be implemented in current displaying video, and this figure can be the thumbnail of hyperlink file or the thumbnail of corresponding coupling picture.Secondly, the rectangular area that the instant heating area coordinate is specified can be confirmed according to the thermal region position of hyperlink file in the position of hyperlink icon.This zone can be zone, the lower right corner, also can be other zones, and the selection in this zone is a principle not influence the appreciation video mainly.If do not find corresponding record in the hyperlink file of current video frame frame number in step S206, then continue displaying video and obtain current frame number.
Consider and to show the hyperlink icon at continuous some frames.Can see and have enough time clicking with the user be principle, and the hyperlink icon is appeared on continuous some frame of video.For example, suppose that this time is 15 seconds, so, if frame per second is 30 o'clock, then from detected beginning frame number, continuous 450 frames show the hyperlink icon.Can adjust according to actual needs during this time.When with mode in thermal region position display hyperlinked picture, when successive frame shows, the thermal region of first detected frame, the associated hot zone position information of hyperlink file shows according to positional information among the read step S206.The thermal region of all the other follow-up continuous some frames needs to estimate; But reference video motion object extraction related algorithm; See list of references " based on the video motion object extraction of adaptive background estimation " author: Xie Zhiping for details, He Yan, He Guiming Wuhan University journal (2006); And list of references " towards video object segmentation and the track algorithm research of MPEG-4 " author: Gu Guanghua, University On The Mountain Of Swallows's journal (2004).In the position of continuous some frame estimating target objects, high bright demonstration thermal region in successive frame.Do not arrive when hyperlink icon display time of showing this moment, promptly shown 13 seconds, but be less than 15 seconds, and next hyperlink icon be need show the time that at this moment, several hyperlink need be simultaneously displayed on the frame of video.Way is following: then with the frame of video lower right corner or other area arrangement that need show of hyperlink icon in current broadcast, such as, can be according to putting in order from left to right, it is to be shown that time is up, and the hyperlink icon no longer shows.
Step S208, when the user clicks the picture thumbnail that shows among the step S207, the corresponding hyperlink content of setting up among the step S201 can be visited.
Click the thumbnail zone of coupling picture, corresponding hyperlink URL in the hyperlink file among the read step S206 obtains the content that hyperlink is pointed to.At this moment, open the IE browser automatically and browse the content that hyperlink is pointed to.In addition, can suspend and play former video file, also can not suspend continuous broadcast.Drag mouse, cursor moves in the video frame images scope, and when moving to the thermal region scope, this zone is highlight regions, and cursor shape changes, and representes that this zone can click.
In the specific embodiment two of the present invention; The execution sequence of each step can rationally be adjusted as required; For example: the execution sequence of step S204 and step S205 also can be before step S203; Equally, also can simplify above-mentioned each step as required, for example: step S204 and step S205 can select to optimize one of which on the basis of embodiment one.
Adopt the hyperlink method of in video, inserting that provides in the embodiment of the invention two; Consider user experience; Can the thumbnail of coupling picture be presented at the thermal region in the key frame of video; Not only can not influence the user and watch video, and when the user's interest destination object was arranged, its relevant advertisement or news content can be visited by the user easily.
A kind of apparatus structure sketch map that in video insert hyperlink of Fig. 7 for providing in the embodiment of the invention three.This device comprises receiver 100, processor 200 and transmitter 300.Receiver 100 is used to receive hyperlink, picture and video information.Processor 200 is used for: according to picture that receives and hyperlinked information, the related corresponding relation of foundation and picture and hyperlink is set up like the related mapping table of the present invention's picture shown in Figure 2 with hyperlink; According to receiving video information, the key frame in the selecting video information can pass through the Shot Detection method, and random choice method or select the frame method to choose key frame by frame is introduced in embodiments of the invention one in detail, repeats no more here; Through extracting the destination object in picture and the key frame of video, association has the key frame and the picture of same target object, sets up like the related mapping table of the present invention's key frame frame number shown in Figure 3 with picture; Further,, set up the related mapping table of the present invention's key frame frame number shown in Figure 4 and hyperlink, and generate the hyperlink file according to the related mapping table of aforementioned picture with hyperlink; Carry out this hyperlink file, in the key frame of playing the video file that receives, insert corresponding hyperlink, generate the hypervideo file.Processor 200 can also be realized by software fully in other embodiment of the present invention.Transmitter 300 is used for playing at this hypervideo file.The user promptly may have access to the user's interest content through clicking the hyperlink of inserting in this key frame of video, for example: advertisement, music and news etc.Through this technical scheme; Insert the hyperlink that to point to this destination object relevant information in all types of target object that in video, represents; Watch video through the user; Click its interested destination object, obtain user preferences, and the contents such as advertisement, music and news relevant with this destination object is provided through hyperlink.Effectively strengthened the accuracy that contents such as advertisement are thrown in, and thrown in targetedly again and improved user experience.In addition, the present invention inserts hyperlink in video, is accomplished automatically by processor 200, need not artificial the participation, has improved efficient and the accuracy of inserting hyperlink in the video greatly.
Be illustrated in figure 8 as the concrete structure sketch map of processor 100 in Fig. 7 of the present invention institute generator.In embodiments of the invention four, may further include in this processor 100: hyperlink and picture associative cell 10, select frame unit 11, object matching unit 12, hyperlink file generating unit 13 and hypervideo broadcast unit 14.It is related that hyperlink and picture associative cell 10 are used for picture that receives and hyperlinked information, and the related corresponding relation of foundation and picture and hyperlink is set up like the related mapping table of the present invention's picture shown in Figure 2 with hyperlink; Select frame unit 11 to be used for receiver, video information, the key frame in the selecting video information can pass through lens detection method, random choice method or select the frame method to choose key frame by frame; Object matching unit 12 is used for from the key frame and the reception picture that select frame unit 11 receptions to choose; Through extracting the destination object in picture and the key frame of video; Association has the key frame and the picture of same target object, sets up like the related mapping table of the present invention's key frame frame number shown in Figure 3 with picture; Hyperlink file generating unit 13 is used for according to hyperlink and picture associative cell 10 picture stored and the related mapping table of hyperlink and the key frame frame number of object matching unit 12 generations and the related mapping table of picture; Set up the related mapping table of the present invention's key frame frame number shown in Figure 4 and hyperlink, and generate the hyperlink file that comprises key frame frame number and the related mapping table of hyperlink; Hypervideo broadcast unit 14 is used for receiver, video information and hyperlink file, carries out this hyperlink file, in the key frame of playing the video file that receives, inserts corresponding hyperlink, generates the hypervideo file.
Processor 200 another concrete structure sketch mapes that provide for Fig. 7 of the present invention shown in Figure 9.In the embodiment of the invention five, comprise in the processor 100: hyperlink and picture associative cell 20, select frame unit 21, object matching unit 22, hyperlink file generating unit 23, hypervideo broadcast unit 24, confirm thermal region unit 25 and thumbnail generation unit 26.Wherein, corresponding unit 10,11 and 12 function are identical in hyperlink and picture associative cell 20, the function of selecting frame unit 21 and object matching unit 22 and the embodiment of the invention four, repeat no more at this.Thumbnail generation unit 26; Be used to generate and store the thumbnail of hyperlink and picture associative cell 20 picture that receives; Thumbnail generates and can adopt the convergent-divergent algorithm to generate; Like the detailed introduction of the embodiment of the invention two step S205, this thumbnail is used for inserting in frame of video the hyperlink click picture of hyperlink.Confirm that thermal region unit 25 is used to receive selected key frame of video, confirm the thermal region in the key frame, can adopt the method for definite thermal region that step S204 provides in the embodiment of the invention two, the thermal region in the key frame is with the form record of coordinate.Hyperlink file generating unit 23; Be used for according to hyperlink and picture associative cell 20 picture stored and the related mapping table of hyperlink; The key frame frame number that object matching unit 12 generates and the related mapping table of picture, thumbnail information in the thumbnail generation unit 26, and key frame thermal region information in definite thermal region unit 25; Set up the related mapping table of the present invention's key frame frame number shown in Figure 6 and hyperlink, and generate the hyperlink file; Wherein each bar record includes fields such as frame of video frame number, coupling picture name, coupling picture URL, key frame thermal region position and hyperlink in the related mapping table shown in Fig. 6.Introduce the effect of a field below in conjunction with instantiation: the name of the corresponding coupling of the frame of video frame number K1 of key frame picture is called Picture1, and different according to the destination object that comprises in the frame of video, the coupling picture that the frame of video frame number is corresponding can also have a plurality of.The coupling picture URL be used to provide the URL address that can have access to corresponding coupling picture-storage, also can provide can have access to the corresponding thumbnail storage of match map in the URL address of thumbnail generation unit 26.The thermal region position of the corresponding key frame of this frame of video frame number K1 is that ((X11, Y11), (X12, Y12)) is URL1 with the corresponding hyperlink URL of coupling picture Picture1.Hypervideo broadcast unit 24 is used for receiver, video information and hyperlink file, carries out this hyperlink file, in the key frame of playing the video file that receives, inserts corresponding hyperlink, promptly generates the hypervideo file.For example: the current frame of video frame number that obtains is K1, and the frame of video frame number field of each bar record of more current frame number K1 and hyperlink file judges whether both are identical.Meet through relatively judging article one record, then the thermal region of the corresponding key frame of key frame frame number K1 ((X11, Y11); (X12; Y12)) insert coupling picture Picture1 in, the information of this picture Picture1 obtains through the URL of coupling picture, is URL11 in this example; Wherein, this picture Picture1 is related with corresponding hyperlink URL 1.Promptly click this picture Picture1 that inserts among the key frame of video K1 as the user, just can show the content that hyperlink URL 1 is pointed, for example: advertisement, music, news etc.
The hypervideo broadcast unit concrete structure sketch map of Figure 10 for providing in the embodiment of the invention five.Hypervideo broadcast unit 24 comprises frame information relatively subelement 241 and hyperlinked picture demonstration subelement 242.Whether the frame of video frame number that frame information comparison subelement 241 is used in comparison current video frame frame number and each bar record of hyperlink file matees, if coupling is obtained the phase information in this record, as shown in Figure 6 article one record.Hyperlink icon display subelement 242 is used to obtain the corresponding key frame thermal region position of frame of video frame number, inserts the coupling the clicked picture that points to corresponding hyperlink in the thermal region position.This coupling picture can obtain from the URL address of coupling picture.
Can learn ground; Realize the apparatus structure of technical scheme of the present invention; Be not limited to the concrete structure that the embodiment of the invention three, four, five or six is provided, the division of each functional module only illustrates, can be as required in the practical application; Consider such as the configuration requirement of hardware or the facility of software practice; And above-mentioned functions is distributed by the different functional completion, the internal structure that is about to described processor is divided into different functional, to accomplish all or part of function of above description.
One of ordinary skill in the art will appreciate that all or part of step in the foregoing description method is to instruct relevant hardware to accomplish through program; The program of being somebody's turn to do can be stored in the computer read/write memory medium; The storage medium that is somebody's turn to do is like ROM/RAM, magnetic disc, CD etc.
Claims (12)
1. insert the method for hyperlink in the video, it is characterized in that, comprising:
Set up the related corresponding relation of picture and hyperlink;
Key frame in the selecting video;
Through extracting the destination object in said picture and the said key frame of video, association has the key frame and the picture of same target object, sets up the related corresponding relation of said key frame and said picture;
According to said picture and the related corresponding relation of hyperlink and the related corresponding relation of said key frame and said picture; Obtain the corresponding relation of said key frame and said hyperlink, generate the hyperlink file that comprises said key frame and said hyperlink corresponding relation;
Carry out said hyperlink file, in the key frame of playing said video, insert corresponding hyperlink.
2. method according to claim 1 is characterized in that, chooses key frame, chooses key frame or select the frame method to choose key frame through pursuing frame through randomized through the Shot Detection method.
3. method according to claim 1; It is characterized in that; Said through extracting the destination object in said picture and the said key frame of video, association has the key frame and the picture of same target object, sets up said key frame and comprises with the related corresponding relation of said picture:
Extract the destination object in said picture and the said key frame;
Said picture and said key frame are carried out the destination object characteristic matching, find out key frame and picture with same target object;
The said key frame that will have the same target object is related with said picture, sets up the related corresponding relation of said key frame and said picture.
4. according to the arbitrary described method of claim 1 to 3; It is characterized in that, further comprise: behind the key frame in the selecting video, confirm the thermal region position of said key frame; In generating said hyperlink file, further write down the corresponding thermal region positional information of said key frame; Carry out the said hyperlink file that comprises key frame thermal region positional information, in the key frame thermal region position of playing said video, insert corresponding hyperlink, said thermal region is the outstanding zone that shows in the video.
5. according to the arbitrary described method of claim 1 to 3; It is characterized in that, further comprise, generate and store the thumbnail of said picture; Further said thumbnail corresponding address information stored in record in generating the hyperlink file; Carry out the said hyperlink file that comprises the thumbnail address information, obtain corresponding thumbnail, in the key frame of playing said video, insert the thumbnail that points to said hyperlink through said thumbnail address.
6. a processor is characterized in that, is used for inserting hyperlink at video, comprising:
Hyperlink and picture associative cell are used to set up the related corresponding relation of picture and hyperlink;
Select frame unit, be used for the key frame of selecting video information;
The object matching unit is used for through extracting the destination object of said picture and said key frame of video, and association has the key frame and the picture of same target object, sets up the related corresponding relation of said key frame and said picture;
The hyperlink file generating unit; Be used for according to the related corresponding relation of said picture with the related corresponding relation of said hyperlink and said key frame and said picture; Obtain the corresponding relation of said key frame and said hyperlink, generate the hyperlink file that comprises said key frame and said hyperlink corresponding relation;
The hypervideo broadcast unit is carried out said hyperlink file, in the key frame of playing said video, inserts corresponding hyperlink.
7. processor according to claim 6 is characterized in that, further comprises:
Confirm the thermal region unit, be used for from selecting frame unit receiver, video key frame, and confirm that the thermal region position of said key frame, said thermal region are the outstanding zone that shows in the video.
8. processor according to claim 7 is characterized in that:
The hyperlink file generating unit also is used for generating the further corresponding thermal region positional information of the said key frame of record of hyperlink file;
The hypervideo broadcast unit also is used to carry out the said hyperlink file that comprises key frame thermal region positional information, in the key frame thermal region position of playing said video, inserts corresponding hyperlink.
9. processor according to claim 6 is characterized in that, further comprises:
The thumbnail generation unit is used to generate and store the thumbnail of said picture.
10. processor according to claim 9 is characterized in that:
The hyperlink file generating unit also is used for generating the further said thumbnail corresponding address information of record storage of hyperlink file;
The hypervideo broadcast unit also is used to carry out the said hyperlink file that comprises the thumbnail address information, obtains corresponding thumbnail through said thumbnail address, in the key frame of playing said video, inserts the thumbnail picture that points to said hyperlink.
11. processor according to claim 6 is characterized in that, said hypervideo broadcast unit also comprises:
Frame information is subelement relatively, is used for searching the record whether said hyperlink file has coupling according to the current video frame frame number, if exist, then obtains corresponding hyperlinked information;
Hyperlink shows subelement, is used for inserting said hyperlink at said current video.
12. insert the device of hyperlink in the video; Comprise: be used to receive receiver, the processor of hyperlink, picture and video information and be used to export the transmitter of the video that inserts said hyperlink, it is characterized in that: said processor is arbitrary processor in claim 6 to the claim 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102416251A CN101753913B (en) | 2008-12-17 | 2008-12-17 | Method and device for inserting hyperlinks in video, and processor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102416251A CN101753913B (en) | 2008-12-17 | 2008-12-17 | Method and device for inserting hyperlinks in video, and processor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101753913A CN101753913A (en) | 2010-06-23 |
| CN101753913B true CN101753913B (en) | 2012-04-25 |
Family
ID=42480197
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008102416251A Active CN101753913B (en) | 2008-12-17 | 2008-12-17 | Method and device for inserting hyperlinks in video, and processor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101753913B (en) |
Families Citing this family (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102420804B (en) * | 2010-09-27 | 2016-02-24 | 中国电信股份有限公司 | Client, information processing module of user's, content delivery method and system |
| CN103021432B (en) * | 2011-09-22 | 2017-06-16 | 南京中兴软件有限责任公司 | A kind of method and terminal for processing advertisement |
| CN102547480A (en) * | 2012-01-29 | 2012-07-04 | 北京明日时尚信息技术有限公司 | Implementation method for interactive video advertisement platform |
| CN103428539B (en) * | 2012-05-15 | 2017-08-22 | 腾讯科技（深圳）有限公司 | The dissemination method and device of a kind of pushed information |
| CN103686454A (en) * | 2012-09-24 | 2014-03-26 | 腾讯科技（深圳）有限公司 | Information acquisition method and apparatus |
| CN103856817B (en) * | 2012-11-29 | 2018-07-20 | 上海文广互动电视有限公司 | The interactive playback method and system of hypermedia |
| CN103856832B (en) * | 2012-11-29 | 2018-07-20 | 上海文广互动电视有限公司 | The making of hypermedia and delivery system and method |
| CN103856824B (en) * | 2012-12-08 | 2018-02-13 | 周成 | The method of the video of ejection tracking object in video |
| US9210526B2 (en) * | 2013-03-14 | 2015-12-08 | Intel Corporation | Audio localization techniques for visual effects |
| CN104182400A (en) * | 2013-05-22 | 2014-12-03 | 腾讯科技（深圳）有限公司 | Method and device for displaying promotion information |
| CN103442295A (en) * | 2013-08-23 | 2013-12-11 | 天脉聚源(北京)传媒科技有限公司 | Method and device for playing videos in image |
| CN104735552A (en) * | 2013-12-23 | 2015-06-24 | 北京中传数广技术有限公司 | Live video label inserting method and system |
| CN104751107B (en) * | 2013-12-30 | 2018-08-03 | ***通信集团公司 | A kind of Video Key data determination method, device and equipment |
| CN104618803B (en) | 2014-02-26 | 2018-05-08 | 腾讯科技（深圳）有限公司 | Information-pushing method, device, terminal and server |
| CN103970906B (en) * | 2014-05-27 | 2017-07-04 | 百度在线网络技术（北京）有限公司 | The method for building up and device of video tab, the display methods of video content and device |
| CN103986980B (en) * | 2014-05-30 | 2017-06-13 | 中国传媒大学 | A kind of hypermedia editing method and system |
| CN105260368B (en) * | 2014-07-15 | 2019-03-29 | 阿里巴巴集团控股有限公司 | A kind of editor of video data, the method for pushing of business object, device and system |
| CN104268273B (en) * | 2014-10-14 | 2018-09-04 | 北京百度网讯科技有限公司 | Processing method, device and browser, the browser plug-in of pushed information |
| JP6273386B2 (en) | 2015-02-24 | 2018-01-31 | ビセンゼ・ピーティーイー・リミテッド | Method and system for identifying associated media content |
| CN106162354A (en) * | 2015-04-08 | 2016-11-23 | 许怡详 | Video instant scene service-Engine |
| US10366144B2 (en) | 2016-04-01 | 2019-07-30 | Ebay Inc. | Analyzing and linking a set of images by identifying objects in each image to determine a primary image and a secondary image |
| CN106254925A (en) * | 2016-08-01 | 2016-12-21 | 乐视控股（北京）有限公司 | Destination object extracting method based on video identification, equipment and system |
| CN106210808B (en) * | 2016-08-08 | 2019-04-16 | 腾讯科技（深圳）有限公司 | Media information put-on method, terminal, server and system |
| CN110019951B (en) * | 2017-09-29 | 2021-06-04 | 华为软件技术有限公司 | Method and equipment for generating video thumbnail |
| CN110121083A (en) * | 2018-02-06 | 2019-08-13 | 上海全土豆文化传播有限公司 | The generation method and device of barrage |
| CN108427739B (en) * | 2018-03-01 | 2022-04-22 | 上海哔哩哔哩科技有限公司 | Page jump method, server and page jump system |
| CN108449409B (en) * | 2018-03-16 | 2022-03-25 | 五八有限公司 | Animation pushing method, device, equipment and storage medium |
| CN109085917A (en) * | 2018-06-20 | 2018-12-25 | 新华网股份有限公司 | Prompting message playing method and system |
| CN110933520B (en) * | 2019-12-10 | 2020-10-16 | 中国科学院软件研究所 | Monitoring video display method based on spiral abstract and storage medium |
| CN111327930A (en) * | 2020-02-28 | 2020-06-23 | 北京达佳互联信息技术有限公司 | Method and device for acquiring target object, electronic equipment and storage medium |
| CN112312203B (en) * | 2020-08-25 | 2023-04-07 | 北京沃东天骏信息技术有限公司 | Video playing method, device and storage medium |
| CN117609962B (en) * | 2024-01-23 | 2024-05-07 | 暨南大学 | Image hyperlink generation method based on feature point generation |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1221502A (en) * | 1997-04-02 | 1999-06-30 | 国际商业机器公司 | Method and apparatus for integrating hyperlinks in video |
| CN1946163A (en) * | 2006-10-25 | 2007-04-11 | 浙江大学 | Method for making and playing interactive video frequency with heat spot zone |
-
2008
- 2008-12-17 CN CN2008102416251A patent/CN101753913B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1221502A (en) * | 1997-04-02 | 1999-06-30 | 国际商业机器公司 | Method and apparatus for integrating hyperlinks in video |
| CN1946163A (en) * | 2006-10-25 | 2007-04-11 | 浙江大学 | Method for making and playing interactive video frequency with heat spot zone |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101753913A (en) | 2010-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101753913B (en) | Method and device for inserting hyperlinks in video, and processor | |
| CN107633241B (en) | Method and device for automatically marking and tracking object in panoramic video | |
| Pritch et al. | Nonchronological video synopsis and indexing | |
| CN101489139B (en) | Video advertisement correlation method and system based on visual saliency | |
| US20170201793A1 (en) | TV Content Segmentation, Categorization and Identification and Time-Aligned Applications | |
| US9930311B2 (en) | System and method for annotating a video with advertising information | |
| CN102244807B (en) | Adaptive video zoom | |
| CN102685550B (en) | Network video advertisement placing method and system | |
| WO2018107914A1 (en) | Video analysis platform, matching method, and accurate advertisement push method and system | |
| CN103024464B (en) | System and method with video-frequency playing content relevant information is provided | |
| CN106060578B (en) | Generate the method and system of video data | |
| CN100493195C (en) | Time-shifted television video matching method combining program content metadata and content analysis | |
| CN107431828B (en) | Method and system for identifying related media content | |
| CN101778257B (en) | Generation method of video abstract fragments for digital video on demand | |
| CN102511048B (en) | A kind of method and system comprising the video area of text for pre-service | |
| WO2016028813A1 (en) | Dynamically targeted ad augmentation in video | |
| CN1476725A (en) | Method and apparatus to track object in sports programs and select appropriate camera | |
| CN102290082A (en) | Method and device for processing brilliant video replay clip | |
| CN105187866A (en) | Advertisement putting method and apparatus | |
| CN101641873A (en) | Be used for determining advertisement and the position of other inserts and the scheme of sequential of medium | |
| TW200951833A (en) | Methods and systems for representation and matching of video content | |
| CN104602128A (en) | Video processing method and device | |
| TWI470999B (en) | Method, apparatus, and system for bitstream editing and storage | |
| CN105657514A (en) | Method and apparatus for playing video key information on mobile device browser | |
| Li et al. | Bridging the semantic gap in sports video retrieval and summarization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201221 Address after: Room 400, building 5, No.11 Deshengmenwai street, Xicheng District, Beijing 100032 (Desheng Park) Patentee after: MIGU CULTURE TECHNOLOGY Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right |