CN100508594C

CN100508594C - Commercial information searching method and apparatus, and provid method and apparatus accompanying information

Info

Publication number: CN100508594C
Application number: CNB2006100094790A
Authority: CN
Inventors: 中村理; 安部素嗣
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2005-02-23
Filing date: 2006-02-23
Publication date: 2009-07-01
Anticipated expiration: 2026-02-23
Also published as: CN1825945A; JP4534791B2; JP2006237879A

Abstract

Inquiry about information on a CM can be made based on a feature of that CM, and a server can be inquired about a CM which meets a condition such as keyword, thereby permitting the user to view his desired CM. Detecting a commercial message from a television broadcast, calculating a feature of the detected commercial message and accepting input information appendant to the commercial message, a CM information server creates a data base in which the calculated commercial-message feature and commercial message-appendant information are associated with each other. In response to a request for a commercial message search in which a keyword sent from the user via a network is taken as a key, the CM information server searches the data base for a commercial-message feature and sends the commercial-message feature detected in the data base to the user via the network. The user calculates a feature of the commercial message detected in the television broadcast to select a commercial message whose feature is coincident with the commercial-message feature sent from the CM information server. Also, in response to a request for commercial message-appendant information sent from the user via the network, the CM information server searches the data base on the basis of the commercial-message feature as a key to read commercial message-appendant information whose feature is coincident with the feature detected in the data base and sends it to the user via the network.

Description

Comercial message searching method and equipment and accompanying information provide method and apparatus

Technical field

The present invention relates to a kind of method, comercial message Search Results method of reseptance, comercial message search equipment, comercial message Search Results receiving equipment and comercial message recording reservation system of searching for comercial message via network.

Background technology

In the commercial TV broadcast world, the past has been followed the major part of TV programme and has broadcasted as comercial message (commercial message) from the effective means of commodity or service to the consumer that propagate (below be referred to as " CM ").But, generally,, therefore not talkatively provide about the commodity of propaganda in CM broadcasting or the enough information of service to the consumer who watches TV because CM broadcasting is limited on time span.In order to replenish so not enough information, described commodity are displayed on the shop, and perhaps the catalogue of commodity is distributed to the consumer.Current, because the internet is extensively universal, so the maker or seller of many commodity and the internet website that the service provider has them, at this, they provide about their commodity and the information of service.On the other hand, seen the broadcasting CM of commodity and will obtain and in fact to have entered the shop of selling these commodity about described commodity itself, the actor or the actress that in CM, occur, the consumer of further information of music etc. that is used for CM, obtain the catalogue of described commodity, and visit described internet website or carry out other behavior.

But, current, the consumer who has seen the television broadcasting CM of commodity or service and gone for about the information of described CM must write Business Name and the trade name that has been placed on the CM, and go to the shop of selling described commodity, visit the internet website of described company, perhaps carry out other behavior.The Internet service of current popular allows the consumer easily to search for various information in the access the Internet website.But attempting to search for such information after seeing TV again is quite to bother for many such consumers.Perhaps, the consumer can not obtain to be used to search for to be broadcasted the only information of all keywords and so on if necessary of the CM of finite time length as mentioned above.

In order to overcome above-mentioned inconvenience, for example, a kind of method has been proposed, wherein, the CM that server can journal once be broadcasted, and the broadcasting channel of the user can be by sending time from the described CM of broadcasting to server and the described CM of broadcasting obtains information about the CM of hope (referring to for example Japanese Patent Application Publication No.2002-10237; Below this is called " patent document 1 ").

For example, a kind of method has also been proposed, wherein, by in input signal, detecting the candidate interval of first signal according to the signal characteristic pattern that takes place at interval at the fixed time, in described candidate interval, before and extract the feature of the likelihood (likelihood) of indication first signal afterwards from input signal, and detect the interval of first signal according to the feature of being extracted, thus detect accurately or the comercial message part of retrieval television broadcasting signal (referring to for example Japanese Patent Application Publication No.2002-16873; Below this is called " patent document 2 ").

And, a kind of method has been proposed, the user who is used for detecting in vision signal that is write down and/or audio signal wishes to read the position to reproduce described signal, wherein, the vision signal that use has been write down when tracer signal and/or the characteristic vector of audio signal, and when the vision signal of reproducing recorded and/or audio signal, registered for example corresponding to characteristic vector by the signal location of user's appointment, detect the characteristic vector that surpasses predetermined threshold with at least one correlation of institute's registration feature vector in the characteristic vector that in tape deck, writes down, read a little according to the characteristic vector setting of being detected, and a little begin to reproduce described vision signal and/or audio signal (referring to for example Japanese Patent Application Publication No.2003-339010 from described reading; Below this is called " patent document 3 ").

Summary of the invention

But, have the problem that will solve: how to make the user can obtain the CM that satisfies condition to start with simply.Under the situation of wanting to collect the CM that a performer for example wherein occurs, the user needs oneself to check seriatim all CM of ever recorded.And when the user wants to watch when this user do not see as yet such as certain CM of one of a series of CM, he need watch television broadcasting always, up to that CM of broadcasting.The airtime and the channel of TV programme be can easily understand according to the television program broadcasting timetable, but airtime and the channel of any CM do not announced.What will remind in the solution of these problems is that CM also is literary works.That is, under the situation of the copyright owner's who does not have CM permission, do not allow legally to visit image itself in CM by internet etc.

But, because in above-mentioned patent document 1 in the disclosed conventional method, be based on time and the channel of the described CM of broadcasting about the inquiry of CM, therefore, if do not know such CM airtime and channel, then this method is inapplicable.For example, when the user watched just reproduced institute recording television programs, the user watched the time of program and the asynchronism(-nization) of in fact broadcasting CM.And, in fact be difficult to understand record from the CM of all television broadcasting station broadcasting.

Therefore, hope overcomes the above-mentioned shortcoming of prior art by a kind of method is provided, in described method, can be to server lookup about satisfying the CM of the condition such as keyword, and described server sends the feature of that CM, makes the CM that the user can watch him to wish according to described feature thus.

Also be desirable to provide a kind of method, wherein, come recording reservation this CM that satisfies condition according to the feature of CM.

Also be desirable to provide a kind of method, wherein, can inquire about information according to the feature of CM about this CM.

According to the present invention, a kind of CM searching method is provided, wherein, in television broadcasting, detect comercial message, as calculated the feature of the comercial message that detected, accepted the input of the information followed with described comercial message, and having created the comercial message feature wherein calculated and comercial message accompanying information is relative to each other under the situation of database of connection, the CM search equipment in response to the keyword that will send from CM Search Results receiving equipment via network as search key (key), request for the comercial message search, come from described database search comercial message feature according to described keyword as the search key, and be sent in the comercial message feature that detects in the described database to described CM Search Results receiving equipment via network, and described CM Search Results receiving equipment sends the searching request of the keyword that is used to search for described comercial message as the search key to described CM search equipment via network, and described CM Search Results receiving equipment receives the comercial message feature that is detected from described database by described CM search equipment via network, in television broadcasting, detect CM, calculate the feature of the comercial message that is detected, and select its calculated characteristics and the consistent comercial message of comercial message feature that receives from described CM search equipment via network.

According to the present invention, a kind of CM recording reservation method also is provided, wherein, in television broadcasting, detect comercial message, as calculated the feature of the comercial message that detected, accepted the input of the information followed with described comercial message, and having created the comercial message feature wherein calculated and comercial message accompanying information is relative to each other under the situation of database of connection, the CM search equipment in response to the keyword that will be via network sends from CM Search Results receiving equipment as the search key, request for the comercial message search, come from described database search comercial message feature according to described keyword as the search key, and be sent in the comercial message feature that detects in the described database to described CM Search Results receiving equipment via network, and described CM Search Results receiving equipment sends the searching request of the keyword that is used to search for described comercial message as the search key to described CM search equipment via network, and described CM Search Results receiving equipment receives by described CM search equipment detected comercial message feature in described database via network, recording reservation to its feature comercial message consistent with the comercial message feature that receives from the CM search equipment via network, in television broadcasting, detect CM, calculate the feature of the comercial message that is detected, and write down its calculated characteristics and the consistent comercial message of comercial message feature that receives from described CM search equipment via network.

According to the present invention, a kind of CM search equipment also is provided, comprise television broadcasting receiving device and control device, described control device is used for controlling following operation: detect comercial message in the television broadcasting that is received by described television broadcasting receiving device; Calculate the feature of the comercial message that is detected; The input of the information of described comercial message is followed in acceptance, and stores the comercial message accompanying information of being accepted in database, in described database, and comercial message feature of being calculated and the described comercial message accompanying information connection that is relative to each other; In response to the keyword that will send from CM Search Results receiving equipment via network as the search key, for the request of comercial message search, come according to as the keyword of search key and from described database search comercial message feature; And, be sent in the described comercial message feature that detects in the described database to described CM Search Results receiving equipment via network.

According to the present invention, a kind of CM Search Results receiving equipment also is provided, comprise television broadcasting receiving device and control device, described control device is used to control following operation: send to the CM search equipment via network the searching request of searching for key be used as in the keyword of the comercial message that will search for, and receive the comercial message feature that is detected by described CM search equipment via network in database; In the television broadcasting that receives by described television broadcasting receiving device, detect CM; Calculate the feature of the comercial message that is detected; And, select its calculated characteristics and the consistent comercial message of comercial message feature that receives from described CM search equipment via network.

According to the present invention, a kind of CM recording reservation system also is provided, comprise CM search equipment and CM Search Results receiving equipment, described CM search equipment comprises television broadcasting receiving device and control device, and described control device is used for controlling following operation: detect comercial message in the television broadcasting that is received by described television broadcasting receiving device; Calculate the feature of the comercial message that is detected; The input of the information of described comercial message is followed in acceptance, and stores the comercial message accompanying information of being accepted in database, in described database, and comercial message feature of being calculated and the described comercial message accompanying information connection that is relative to each other; In response to the keyword that will send from CM Search Results receiving equipment via network as the search key, for the request of comercial message search, and come from described database search comercial message feature according to keyword as the search key; And, be sent in the described comercial message feature that is detected in the described database via network to described CM Search Results receiving equipment, described CM Search Results receiving equipment comprises television broadcasting receiving device and control device, described control device is used to control following operation: send to the CM search equipment via network the searching request of searching for key be used as in the keyword of the comercial message that will search for, and receive the comercial message feature that is detected by described CM search equipment via network in database; In the television broadcasting that receives by described television broadcasting receiving device, detect CM; Calculate the feature of the comercial message that is detected; And, write down its calculated characteristics and the consistent comercial message of comercial message feature that receives from described CM search equipment via network.

According to the present invention, also provide a kind of CM accompanying information that method is provided, be used for providing equipment to provide the information of following comercial message from the CM accompanying information to CM accompanying information receiving equipment via network, described method makes and detect comercial message in television broadcasting, as calculated the feature of the comercial message that detected, accepted the input of the information followed with described comercial message, and having created the comercial message feature wherein calculated and comercial message accompanying information is relative to each other under the situation of database of connection, described CM accompanying information provides device responds in sending from CM accompanying information receiving equipment via network, for the request that sends the comercial message accompanying information, and search for the described comercial message feature of key from described database search comercial message accompanying information feature according to conduct, and read comercial message accompanying information, and send described comercial message accompanying information to described CM accompanying information receiving equipment via network about the feature that in described database, is detected.

According to the present invention, also provide a kind of CM accompanying information that equipment is provided, be used for providing the information of following comercial message to CM accompanying information receiving equipment via network, described equipment comprises television broadcasting receiving device and control device, and described control device is used for controlling following operation: detect comercial message in the television broadcasting that is received by described television broadcasting receiving device; Calculate the feature of the comercial message that is detected; The input of the information of described comercial message is followed in acceptance; In database, store the comercial message accompanying information of being imported, in described database, comercial message feature of being calculated and the described comercial message accompanying information connection that is relative to each other; In response to send from described CM accompanying information receiving equipment via network, for the request that sends the comercial message accompanying information, and, come from described database search comercial message accompanying information feature according to comercial message feature as the search key; Read comercial message accompanying information about the feature that in described database, detects; And, send described comercial message accompanying information to described CM accompanying information receiving equipment via network.

According to the present invention, a kind of CM accompanying information receiving equipment also is provided, be used for providing equipment to receive the information of following comercial message from the CM accompanying information via network, described CM accompanying information provides equipment to have database, the feature of comercial message and follow the information of the described comercial message connection that is relative to each other in described database, described equipment comprises television broadcasting receiving device and control device, and described control device is used to control following operation: detect the comercial message that is received by described television broadcasting receiving device; Calculate the feature of the comercial message that is detected; And provide equipment to send the comercial message feature of being calculated to described CM accompanying information, and provide equipment to receive comercial message from described CM accompanying information via network as database search search key via network.

According to the present invention, also provide a kind of CM accompanying information that system is provided, be used for providing equipment to provide CM accompanying information from the CM accompanying information to CM accompanying information receiving equipment via network, described system comprises that the CM accompanying information provides equipment and CM accompanying information receiving equipment, described CM accompanying information provides equipment to comprise television broadcasting receiving device and control device, and described control device is used for controlling following operation: detecting comercial message by the television broadcasting that described television broadcasting receiving device received; Calculate the feature of the comercial message that is detected; The input of the information of described comercial message is followed in acceptance; In database, store the comercial message accompanying information of being imported, in described database, comercial message feature of being calculated and the described comercial message accompanying information connection that is relative to each other; In response to send from described CM accompanying information receiving equipment via network, for the request that sends the comercial message accompanying information, according to coming from described database search comercial message accompanying information feature as the comercial message feature of search key; Read comercial message accompanying information about the feature that in described database, detects; And, send described comercial message accompanying information via network to described CM accompanying information receiving equipment, described CM accompanying information receiving equipment comprises television broadcasting receiving device and control device, and described control device is used to control following operation: detect the comercial message that is received by described television broadcasting receiving device; Calculate the feature of the comercial message that is detected; And provide equipment to send the comercial message feature of being calculated to described CM accompanying information, and provide equipment to receive comercial message from described CM accompanying information via network as database search search key via network.

According to the present invention, as user during from the CM consistent of the server search on network with keyword, described Search Results is returned to the user as the feature of the CM that is detected, and user itself is according to searching for described CM as the described feature of search key in his recorder/player.Therefore, the present invention makes the user can search for CM under situation from server to the user that do not return CM itself from.

And, according to CM recording reservation method of the present invention, wherein, write down and from the consistent CM of feature that server receives, make that the user can be to the recording reservation of the CM of its airtime and channel the unknown.

According to the present invention, when obtaining the CM accompanying information from the server on network, the user uses the feature of described CM, the video that replaces CM, be used as being used to discern the information of CM, thus, make and to reduce the data volume that will send to server from the user considerably, and come the described database of search in server with the speed of suitable raising.

And, according to the present invention, when obtaining the CM accompanying information from the server on network, the user uses the feature of described CM, the video that replaces CM is used as being used to discern the information of CM, thus, make to send CM video itself and described CM is copied as literary works that this will prevent to encroach on the copyright owner's of CM right effectively.

And, according to the present invention, when obtaining the CM accompanying information from the server on network, register the accompanying information that is obtained in the database of user in user's recorder/player, thus,, the CM accompanying information can provide same accompanying information to the user immediately when needing, because no longer need to server lookup when becoming, and, even when described recorder/player is not connected with described network, also can utilize described accompanying information.

By describing the preferred embodiments of the present invention with reference to the accompanying drawings in detail, these and other objects of the present invention, characteristics and advantage will become apparent.

Description of drawings

Fig. 1 is the block diagram according to CM recording reservation of the present invention system;

Fig. 2 also is the conceptual block diagram that is used to provide the CM information server of comercial message accompanying information;

Fig. 3 schematically illustrates in database some to has as yet for the tabulation of the CM of the accompanying information of its registration and each and all has tabulation for the CM of the accompanying information of its registration;

Fig. 4 shows the flow process of the operation of carrying out in the controller that comprises in the CM information server in the new CM of registration;

Fig. 5 also shows the flow process of the operation of carrying out in the CM information server in processing has as yet process for the tabulation of the CM of the accompanying information of its registration;

Fig. 6 show in response to make from the user about the inquiry of comercial message accompanying information and the flow process of the operation of the CM information server, carrying out;

Fig. 7 is a conceptual block diagram of wherein using the recorder/player of comercial message accompanying information;

Fig. 8 shows the flow process of the operation of carrying out in recorder/player in the new CM process of registration;

Fig. 9 also shows the flow process of the operation of carrying out in recorder/player in carrying out about the query script of comercial message accompanying information to the CM information server;

Figure 10 schematically illustrates mutual between recorder/player and CM information server;

Figure 11 is the concept map that connects according to another system of the present invention;

Figure 12 show handle in database having as yet for the list process of the CM of the accompanying information of its registration in the flow process of the operation carried out in the CM information server in CM recording reservation system;

Figure 13 shows the display screen of the tabulation that has shown the CM that registers on it in the tabulation that has as yet for the CM of the accompanying information of its registration;

Figure 14 shows the display screen when server managers input accompanying information;

Figure 15 shows and is used for to screen user notification comercial message accompanying information, that show on the outside output unit such as monitor;

Figure 16 A and B show the example of characteristics of image;

Figure 17 shows the example based on the search of feature;

Figure 18 A and B show the example such as the Feature Extraction of vision signal in television broadcasting;

Figure 19 shows the flow process of the operation of carrying out in the recorder/player the user in search CM process;

Figure 20 shows the example at the display screen of recorder/player;

Figure 21 schematically illustrates the search based on feature in recorder/player;

Figure 22 shows another example at the display screen of recorder/player;

Figure 23 shows another example at the display screen of recorder/player;

Figure 24 shows the flow process of the operation of carrying out in recorder/player in to the CM recording reservation;

Figure 25 shows another example at the display screen of recorder/player;

Figure 26 shows the flow process of the operation of carrying out at recorder/player in inquiring about about the comercial message accompanying information to the CM information server; And

Figure 27 schematically illustrates mutual between recorder/player and CM information server.

Embodiment

Come with reference to the accompanying drawings at as video camera (camcorder) system of embodiments of the invention and describe the present invention in detail.

The present invention is applied to for example structure, that generally be designated as drawing reference numeral 100 as shown in Figure 1 CM recording reservation system.

Fig. 1 is the concept map of the connection of whole C M recording reservation system 100.

As shown in the figure, CM recording reservation system 100 comprises a plurality of users 102 that are connected with internet 101 ₁..., 102 _n, CM information server 103 and be used for the broadcasting station 106 of broadcast TV program.

CM information server 103 comprises server 104 and database 105.Server 104 is 106 receiving television broadcastings from the broadcasting station, detect the CM in the television broadcasting that is received, and if described CM be new then described CM be registered in the database 105.The manager of server 104 collects the information of the CM that follows this new registration, such as the title of the broadcasting company of this CM and commodity, be used for the music of described CM, (following will being called as " comercial message accompanying informations ") such as the actor that occurs at described CM or actress, and the manager of server 104 is registered to these data in the database 105.The user 102 ₁-102 _n106 receptions and record television broadcasting when in the television broadcasting that is received, detecting CM from the broadcasting station.As the CM that is detected when being new, the user 102 ₁-102 _nWill be to 103 inquiries of CM information server about following the information of this CM.The CM that server 104 will be inquired about from database 105 search, and to the result of user notification search.

As user 102 ₁-102 _n(following will being commonly referred to as " user 102 ") via internet 101 when the CM information server 103 inquiry comercial message accompanying informations, to not any CM video (image and sound) itself to the data that server 104 sends from user 102, but the feature of CM video.Recently, reformed video compression technology significantly, to such an extent as to can be to represent video than littler data volume under the situation of compressed video not.But even also still amount is big under compressed situation for described video data, therefore sending video data itself is unpractical to be used for search.And, protect each CM video because wait by copyright, therefore send the right that CM may damage the copyright owner.For fear of such breach of privilege, the feature of extracting CM is used to replace described video.That is, described feature less than original video, and has enough independence and distinguishes between original video and other on size of data.Time series of the vectorization pixel value of the thumbnail that such feature for example comprises the time series of the pixel value of the vectorization of the average image of disclosed at least one frame with predetermined time interval in patent document 3, form by the unit that described the average image is divided into predetermined block etc.

Fig. 2 is the conceptual block diagram that is used to provide the CM information server 103 of comercial message accompanying information.

As shown in Figure 1, CM information server 103 comprises server 104 and database 105.Particularly, CM information server 103 comprises: radio receiver 201 is used for receiving television broadcasting; Controller 202, be provided at from radio receiver 202 broadcast singal vision signal and such as the vision signal attached information of channel information, broadcast mode information etc.; And be connected to memory cell 203, database 204, network controller 205, o controller 206, input controller 207 of controller 202 etc.

Radio receiver 201 receiving television broadcastings, and to controller 202 described vision signal of transmission and vision signal attached information, such as channel information, broadcast message etc.

Controller 202 reads the program that is used for detecting at the CM of the vision signal that provides from radio receiver 201 from memory cell 203, and beginning CM detects.Can by in patent document 2 for example in detail disclosed method carry out CM and detect.In this method, the CM candidate part of extracting each signal that includes the indicative character pattern from the audio signal and/or the vision signal of TV broadcast singal according to predetermined necessary condition, described TV broadcast singal is as in the TV broadcast singal of partly being made up of major part and comercial message, comprise major part and comercial message signal (first signal), in some features of described CM candidate part, detect wherein each as the side condition of the index of indication CM likelihood, and analyze the side condition that is extracted together and partly be actually cm section, accurately detect each CM thus to judge whether described CM candidate.And, the side condition that detects all or part of can be recorded and compare with other candidate CM in the TV broadcast singal or the candidate CM that is write down, with at described TV broadcast singal or wherein write down the CM that search is wished in the database of described TV broadcast singal.But CM detection method in the present invention can be not limited to above-mentioned this method, but can be the method that can accurately detect each CM.

When detecting CM, controller 202 reads from memory cell 203 and is used for judging whether that the CM that is detected has been registered in the program of database 204, and search database 204.If find and that the identical CM that is detected in database 204, then controller 202 is registered video and the feature thereof of the CM that is detected together in database 204.Be registered to that CM in the database 204 for example is included in or each all has not in the tabulation for the CM of the accompanying information of its registration, perhaps each all has in the tabulation for the CM of the accompanying information of its registration, as shown in Figure 3.The controller 202 new CM that at first registration will be registered in wherein each all has not for the tabulation of the CM of the accompanying information of its registration, and notify this registration to server managers by the message that on the outside output unit such as monitor shown in Figure 13, shows the CM registration.Server managers can be positioned at " last candidate " button of described monitor screen bottom and " next candidate " button by operation, one by one confirms all to have as yet at each to be the CM in the tabulation of the CM of the accompanying information of its registration.Know described new CM be registered to each all have as yet for the tabulation of the CM of the accompanying information of its registration in the time, server managers is checked the video of this CM of storage in database 204, collect the information of following with CM by the device (not shown), such as Business Name, trade name, actor (actress) etc., and come to provide described information to CM information server 103 via the outside input unit such as the keyboard (not shown).Be used for having accompanying information project and the line of input 1402-1405 that for example arranges as shown in figure 14 by the display screen of server managers input accompanying information.Server managers is writing information in the line of input 1402-1405 of accompanying information project.Controller 202 obtains the accompanying information of input via input controller 207, and registers described information in database 204.For example, as shown in Figure 3, imported accompanying information for it, each all has as yet and to be one of CM in the tabulation of the CM of the accompanying information of its registration, all had as yet tabulation for the CM of the accompanying information of its registration from each and move to each and all have tabulation for the CM of the accompanying information of its registration.In order to make server managers confirm the CM that in each all has tabulation for the CM of the accompanying information of its registration, registers, show with the form of for example tabulation shown in Figure 13 that each all has and be the CM in the tabulation of the CM of the accompanying information of its registration.For example, when the CM of server managers from that tabulation selects specific CM, incite somebody to action display screen as shown in figure 15.As shown in figure 15, screen 1501 comprises zone 1503 that shows the CM accompanying information and the zone 1502 that shows the video of that CM.In CM accompanying information viewing area 1503, shown the accompanying information that server managers has been imported.

Controller 202 is accepted the inquiry about CM from user 102 via network controller 205.The CM identifying information that sends from user 102 is the feature of CM.Controller 202 from memory cell 203 read be used for from database 204 search with in program from the consistent any CM of the keyword of user's inquiry, and search database 204.If found the CM consistent with described keyword in each all has as yet tabulation for the CM of the accompanying information of its registration, then controller 202 will send the feature of described CM via network controller 205 to user 102.If do not find such CM, then controller 202 will be notified this fact to user 102.In the previous case, from CM information server 103 to the feature of the described CM that the information that user 102 sends is found except being included in database 204, can also comprise accompanying information, such as Business Name, trade name, the actor (or actress) who in described CM, occurs, be used for the music of described CM etc.

And controller 202 is accepted via network controller 205 to inquire about from the CM accompanying information that user 102 sends.The CM accompanying information that sends from user 102 is the feature of described CM.Controller 202 is read the program that is used for judging whether to have registered at database 204 CM that is inquired about from memory cell 203, and searches for described database 204.If found the CM that is inquired about in each all has tabulation for the CM of the accompanying information of its registration, then described controller will send described CM accompanying information to user 102.If do not find that CM in database 204, then controller 202 will should the fact to user notification via network controller 205.

Now, the flow chart with reference to Fig. 4 illustrates by the new CM of 202 registrations of the controller in CM information server 103.

At first, at step S401, in the registration of new CM, controller 202 receiving television broadcastings.If described broadcasting is simulated, then controller 202 is with its digitlization.

At step S402, the vision signal that controller 202 detects in the television broadcasting that is received.

At step S403, controller 202 judges whether to have detected CM at step S402.If the judged result at step S403 is to affirm (being), promptly when detecting CM in step S402, controller 202 proceeds to step S404.On the contrary, if be negative (denying) in the judged result of step S403, if promptly do not detect CM as yet at step S402, then controller 202 returns step S401.

At step S404, the feature of controller 202 definite CM that detected is come search database 204 according to described feature, and is judged whether that the CM that is detected has been registered in the database 204.If the judged result at step S404 is not, if promptly do not find to have registered in database 204 and that the identical CM that is detected, then controller 202 proceeds to step S405.If in the judged result of step S404 for being that if promptly find to have registered in database 204 and that the identical CM that is detected, then controller 202 returns step S401.

At step S405, controller 202 each in database 204 all has as yet video and the feature thereof of registering the CM that is detected in the tabulation for the CM of the accompanying information of its registration.After finishing described registration, controller 202 returns S401, and wherein, it will be from the registration of the new CM of initial repetition.

Then, be described in the CM information server 103 with reference to the flow chart among Fig. 5 in the database 204 each all had as yet processing for the tabulation of the CM of the accompanying information of its registration.

At first, at step S501, all have as yet in the process for the tabulation of the CM of the accompanying information of its registration handling each, controller 202 judges whether to have registered new CM in the tabulation of this in database 204.If the judged result at step S501 is to affirm (being), promptly when finding to have registered new CM in described CM tabulation, then controller 202 proceeds to step S502.On the contrary, if judged result is negative (denying), if promptly do not find the CM that registration is new in described CM tabulation, then controller 202 will withdraw from described process.

At step S502, controller 202 is provided at each to server managers and all has as yet the CM that registers in the tabulation for the CM of the accompanying information of its registration.Controller 202 all has as yet tabulation for the CM of the accompanying information of its registration to show by sending in the database 204 each via o controller 206 to the outside output unit such as the monitor (not shown) on described outside output unit, carry out this operation.All have as yet on the outside output unit that for example is presented at for the CM in the tabulation of the CM of the accompanying information of its registration as shown in Figure 13 at each with the form of tabulation.

In next step S503, checked that each all has as yet for the server managers of the tabulation of the CM of the accompanying information of its registration will operate outside input unit such as keyboard, import the accompanying information of collecting by the method (not shown).For example, controller 202 by will from the outside input unit such as the keyboard (not shown) via input controller 207 to the accompanying information that controller 202 provides, with database 204 each all have as yet for the corresponding CM in the tabulation of the CM of the accompanying information of its registration is associated, carry out this input operation.On the outside output unit such as monitor, show, with back-level server manager in input operation.Screen comprises accompanying information project and the line of input 1402-1405 that for example arranges as shown in figure 14.

And, in step S504, the CM that controller 202 has been transfused to its accompanying information all has as yet tabulation for the CM of the accompanying information of its registration from each and moves to each and all have the tabulation for the CM of the accompanying information of its registration, and withdraws from described rules.

Note, when can being set to register new CM in database 204 at every turn, the sequence of operation shown in Fig. 5 begins, be set to perhaps be set in response to the order that provides from server managers in the scheduled time of for example each hour.

Then, the flow chart with reference to Fig. 6 illustrates the CM Query Information of handling from user 102 at server 104.

At first, at step S601, in the CM Query Information process of handling from user 102, controller 202 judges whether to have made inquiry about CM by the user.If the judged result at step S401 is to affirm (being), if promptly carry out the inquiry from user 102, then controller 202 proceeds to step S602.On the contrary, if judged result is negative (denying), if promptly do not carry out such inquiry, then controller 202 returns step S601.

At step S602, controller 202 is searched for each according to the keyword that sends from user 102 and is all had database 204 tabulation for the CM of the accompanying information of its registration.Controller 202 is by receiving the keyword of being inquired about via network controller 205, and each all has the tabulation for the CM of the accompanying information of its registration from database 204 search according to described keyword, carries out this search operation.

At next step S603, database 204 judges whether to have had been found that the CM with accompanying information consistent with the keyword of being inquired about in database 204.If the judged result at step S603 is to affirm (being), if promptly had been found that such CM, then controller 202 proceeds to step S604.On the contrary, if judged result is negative (denying), if promptly do not find such CM, then controller 202 proceeds to step S605.

At step S604, controller 202 sends the feature of the CM that has been found that to the user 102 who makes the CM inquiry, and returns step S601.

And at step S605, controller 202 sends indication to the user 102 who makes the CM inquiry and does not find the information of such CM, and returns step S601.Controller 202 is made user's 102 transmission information that CM inquires about by for example sending described information via network controller 205 to user 102 to.

Fig. 7 is a conceptual block diagram of wherein using the recorder/player of CM accompanying information.Totally represent described recorder/player with drawing reference numeral 700.

As shown in the figure, recorder/player 700 comprises: radio receiver 701 is used for receiving television broadcasting; Controller 702 has been provided the vision signal from radio receiver 701; Be connected to memory cell 703, database 704, network controller 705, o controller 706, input controller 707, video storage unit 708 of controller 702 etc.

Radio receiver 701 receiving television broadcastings, and provide the video that is received to the outside output unit such as the monitor (not shown) via o controller 706.Therefore, the user watches the broadcast program that is received on described outside output unit.

For record television broadcasting, the outside input unit of user's operation such as keyboard, mouse or remote controller etc. is with input command.Controller 702 receives input command via input controller 707.

Be provided at the broadcast program on the broadcasting channel of user's appointment to controller 702 from radio receiver 701, and controller 702 is stored in described broadcast program in the video storage unit 708 when reading the program that the CM that detects in the vision signal that provides from radio receiver 701 is provided from memory cell 703 and beginning to detect CM.

Can by in patent document 2 for example in detail disclosed method carry out CM and detect.In this method, extract CM candidate part according to predetermined necessary condition from the audio signal and/or the vision signal of TV broadcast singal, each described CM candidate partly comprises the signal that is used to indicate feature mode, described TV broadcast singal is as in the TV broadcast singal of partly being made up of major part and comercial message, comprise major part and comercial message signal (first signal), from some features of described CM candidate part, detecting side condition, each described side condition is the index of indication CM likelihood, and analyze the side condition extracted together to judge whether that described CM candidate partly is actual cm section, accurately detects each CM thus.And, the side condition that detects all or part of can be recorded and with the TV broadcast singal in other candidate CM or the candidate CM that is write down compare, with at described TV broadcast singal or wherein write down the CM that search is wished in the database of described TV broadcast singal.But CM detection method in the present invention can be not limited to above-mentioned method, but can be the method that can accurately detect each CM.

When detecting CM, controller 702 reads from memory cell 703 and is used for judging whether that the CM that is detected has been registered in the program of database 704, and search database 704.If find and that the identical CM that is detected in database 704, then controller 702 is registered video (and/or record position of the video of the CM in the program that is write down) and the feature thereof of the CM that is detected together in database 704.Be registered to that CM in the database 704 for example is included in or each all has as yet for the tabulation of the CM of the accompanying information of its registration or each all have tabulation for the CM of the accompanying information of its registration, as shown in Figure 3.The controller 702 new CM that at first registration will be registered in each all has as yet for the tabulation of the CM of the accompanying information of its registration.

The program that writes down in order to watch, the user waits input command by operation keyboard, mouse or remote controller.Controller 702 receives input command via input controller 707.Controller 702 reads the recorded program of user's appointment from video storage unit 708, and it is provided to outside output unit such as the monitor (not shown) via o controller 706.Therefore, the user can watch the program that is write down.

In order to search for CM, the user imports order such as the keyword that is used to search for by operation such as the outside input unit of (not shown) such as keyboard, mouse or remote controller.Controller 702 receives the order of input via input controller 707, and it is sent to CM information server 103 via network controller 705.Response from CM information server 103 is sent to controller 702 via network controller 705.If as from the response of CM information server 103 and send the feature of described CM, then controller 702 reads from memory cell 703 and is used for according to described feature and each all has as yet for the tabulation of the CM of the accompanying information of its registration and each and all has program for the tabulation of the CM of the accompanying information of its registration in database 704 search, search database 704, and via o controller 706 to the consistent each other CM of the outside output unit output characteristic such as the monitor (not shown), with to the user notification Search Results.If each in database 704 all has as yet in the tabulation for the CM of the accompanying information of its registration corresponding CM is arranged, then controller 702 moves to each with that CM and all has tabulation for the CM of the accompanying information of its registration.Figure 20 shows the screen 2001 of the outside output unit such as monitor, is used for to the user notification Search Results.Screen 2001 comprises the zone 2003 of for example wherein tabulation of the CM of Display And Keyboard correspondence and wherein shows the zone 2002 of the video of described CM.Screen 2001 can comprise the zone 2004 and the control area 2005 of the accompanying information that wherein shows CM in addition, and described control area 2005 is provided to select the CM that will reproduce from the CM tabulation of zone 2003.

If the user has wanted to obtain the information of following with CM in the program of watching television program or being write down, then he or she comes input command by the outside input unit of operation such as (not shown) such as keyboard, mouse, remote controller.Controller 702 receives described input command via input controller 707.For example, when the user pressed " CM inquiry " button that input unit externally provides, if this button is arranged, then controller 702 was interpreted as described push-botton operation the order of the CM that inquiry provides from o controller 706.Controller 702 obtains the feature of the CM of user's appointment from database 704, and sends it to CM information server 103 via network controller 705.Response from CM information server 103 will arrive controller 702 via network controller 705.If sent accompanying information, as response from CM information server 103, then controller 702 will be by providing accompanying information via o controller 706 to the outside output unit such as the monitor (not shown), coming provides accompanying information to user 102, and described CM each from database 704 all had as yet tabulation for the CM of the accompanying information of its registration moves to each and all have tabulation for the CM of the accompanying information of its registration.As shown in figure 15, be displayed on the outside output unit such as monitor with to user notification CM accompanying information with the screen of drawing reference numeral 1501 expression.Screen 1501 comprises the zone 1502 of the video that for example wherein shows CM and wherein shows the zone 1503 of CM accompanying information.

At this, the registration of the new CM in user 102 the recorder/player 700 is described with reference to the flow chart among Fig. 8.

At first, in the step S801 of the new CM of registration, controller 702 receiving television broadcastings.If described broadcasting is the broadcasting of simulation, then controller 702 writes down the video that is received then as required with its digitlization.

In step S802, the CM that controller 702 detects in the vision signal of the television broadcasting that is received.

In step S803, controller 702 judges whether to have detected CM at step S802.If the judged result at step S803 is to affirm (being), promptly when detecting CM in step S802, controller 702 proceeds to step S804.On the contrary, if be negative (denying) in the judged result of step S803, if promptly do not detect CM in step S802, then controller 802 will return step S801.

In step S804, the feature of controller 702 definite CM that detected is come search database 704 according to described feature, and is judged whether that the CM that is detected has been registered in the database 704.If the judged result in step S804 is negative (denying), if promptly do not find to have registered the CM identical with the CM that is detected in database 704, then controller 702 proceeds to step S805.If the judged result in step S804 is for affirming (being), if promptly find to have registered the CM identical with the CM that is detected in database 704, then controller 702 returns step S801.

At step S805, controller 702 is registered in the database 704 each together with the video of the CM that detected and feature thereof all to has as yet in the tabulation for the CM of the accompanying information of its registration.After finishing described registration, controller 702 returns S801, and wherein, it will be from the registration of the new CM of initial repetition.

In the operating process in the registration process of new CM shown in the flow chart in Fig. 8, at first detect CM, then the feature of definite CM that is detected.This is as shown in Figure 18 A.That is, in the vision signal 1801 of TV signal, detect CM 1802, and calculate the feature 1803 of the CM that is detected.

Yet, by extract with CM location and from the institute's calculated characteristics as shown in Figure 18 B corresponding to as described in calculate the feature 1805 of the major part of subsidiary any CM of television broadcastings or television broadcasting in the part 1806 of CM from the vision signal 1804 of television broadcasting, register new CM.In this case, in the process of the new CM of registration shown in the flow chart of Fig. 8, will carry out following operation.

At step S801, controller 702 receiving television broadcastings.If described broadcasting is analog broadcasting, then controller 702 writes down the video that is received then as required with its digitlization.At step S802, controller 702 detects CM in the vision signal of the television broadcasting that is received.At step S803, controller judges whether to detect CM at step S802.If the judged result at step S803 is to affirm (being), if promptly detected CM, then controller 702 proceeds to step S804.On the contrary, if judged result is negative (denying), promptly when not detecting CM, controller 702 returns step S801.At step S804, controller 702 comes search database 704 according to described feature, and judges whether that the CM that is detected has been registered in the database 704 from the feature of the CM that feature extraction detected that calculates among step S801.If the judged result at step S804 is negative (denying), if promptly have not yet registered the CM identical with the CM that is detected in database 704, then controller 702 proceeds to step S805.On the contrary, if judged result is to affirm (being), if promptly registered the CM identical with the CM that is detected in database 704, then controller 702 returns step S801.At step S805, controller 702 is registered video and the feature thereof of the CM that is detected in each all has as yet tabulation for the CM of the accompanying information of its registration.After finishing described registration, controller 702 returns step S801, and at this, it is from the new CM registration of initial repetition.

Then, with reference to the flow chart among Fig. 9 the CM information inquiry of being made to CM information server 103 by user 102 recorder/player 700 is described.When user instruction controller 702 carries out this CM information inquiry operation when CM information server 103 obtains CM information.

At first, in step S901, in this CM information inquiry, user entered keyword.In this operation, controller 702 obtains the search information of being imported by the user such as keyword via input controller 707 by the outside input unit of operation such as keyboard, mouse, remote controller etc.

In step S902, controller 702 sends the keyword of being imported to CM information server 103.In this transmit operation, controller 702 for example sends described keyword via network controller 705 to CM information server 103.

In step S903, controller 702 receives the CM feature that sends from CM information server 103.Receive in the operation at this, controller 702 receives described CM feature via network controller 705 from CM information server 103.

At step S904, controller 702 judges whether to comprise the CM feature consistent with the keyword of being inquired about the information that sends from CM information server 103.If the judged result at step S904 is to affirm (being), promptly when comprising the CM feature in the information from CM information server 103, controller 702 proceeds to step S905.On the contrary, if judged result is negative (denying), if promptly do not comprise such CM feature in described information, then controller 702 does not comprise such CM feature to user notification in from the information of CM information server 103, and withdraws from described rules.Controller 702 comes to the described fact of user notification by sending described information via o controller 706 to the outside output unit such as the monitor (not shown).

In step S905, at its feature of CM list search and the consistent CM of feature that sends from server.That is, controller 701 reads search utility from memory cell 703, and has the CM of the feature consistent with the feature that obtains from CM information server 103 from database 704 search.

Sketch the operation of this search below with reference to Figure 21.Sent to the consistent CM of keyword of CM information server 103 to user's 102 its features of transmission and user 102 from CM information server 103 via internet 101.In the example shown in Figure 21,5 CMs consistent with described keyword have feature A, B, C, D and E respectively.Described 5 CM features are compared with in CM tabulation those.In the CM tabulation, if its feature CM consistent with a CM feature exists, then this CM we can say consistent with described keyword.The feature of the CM that might send from CM information server 103 is inconsistent with the feature of any CM the CM tabulation.In the example shown in Figure 21, feature D is inconsistent with the feature of any CM in CM tabulation, and this is possible when the CM when correspondence is not recorded in user 102 the recorder/player 700 as yet.

At step S906, be associated with the corresponding CM that all has at each as yet in the tabulation of the CM of the accompanying information of its registration at the accompanying information that will comprise keyword, and the CM of correspondence is moved to each when all having tabulation for the CM of the accompanying information of its registration, the result of the search that controller 702 carries out according to the feature that obtains from CM information server 103 to user's 102 notices.Controller 702 is by showing as shown in figure 22 screen via o controller 706 at the outside output unit such as the monitor (not shown), and presents this information to user 102.Figure 22 shows the example from the Search Results of CM information server 103 in Figure 21.Want therein in the zone 2203 of display of search results, shown from the tabulation of 5 CM of CM information server transmission.Because in user 102 recorder/player 700, have CM A, CM B, have the CM C of feature C and have the video of the CM E of feature E, therefore make blockage blackening before them with feature B with feature A.But because there is not the video of the CM D with feature D in user 102 recorder/player 700, therefore the blockage before CM D remains unchanged black in to distinguish mutually with other CM.By operation control area 2005, the user can be reproduced in the CM that detects in the video display area 2002.Certainly, can not reproduce the CM D that its video is not recorded.

As mentioned above, even obtained the CM feature consistent with keyword from server, user 102 can not watch such CM, unless write down the consistent CM on feature with such CM in user 102 recorder/player 700.

But, exist the use of the feature of obtaining from CM information server 103 to make it possible to obtain the situation of the CM with described feature.For example, suppose when the user is chosen in CM D in the Search Results viewing area 2203 among Figure 22, will be presented at the screen shown in Figure 23.Whether display message viewing area 2302 is selected should preengage to write down CM D with the prompting user on screen 2301.When the user selects "Yes", will preengage described record.Though when the user does not know usually and will broadcast CM that on which broadcasting channel for example, like that, the CM record can be preengage in the flow chart as shown in Figure 24.

At first, at step S2401, the user selects the suitable broadcasting channel of CM, and the user wants record and reception broadcasting on described channel.Should be noted that from the common CM of unspecified commercial broadcast station broadcasting, still, must specify specific broadcasting channel, because only broadcast described CM from that broadcasting station for the CM of broadcasting station itself or specific program.For this reason, should send CM information and feature thereof to improve the efficient of CM recording reservation from CM information server 103.And if can know the time period that wherein will broadcast CM, then CM information server 103 should send the information about the described time period, so that obtain the efficient of improving of such CM recording reservation.

At next step S2402, the CM in the video that controller 702 detects on receiving channels.

At step S2403, controller 702 calculates the feature of the CM that is detected.At step S2404, controller 702 is compared the feature of the CM that the feature calculated and its record have been preengage, and is consistent each other to judge whether these features.When the judged result in step S2404 was sure (being), if promptly described feature is consistent each other, then controller 702 proceeded to step S2405.On the contrary, if judged result is negative (denying), promptly when described feature was consistent each other, controller 702 returned step S2402.

Even if after controller 702 returns step S2402 and repeats above-mentioned rules, the also CM that has not preengage with its record consistent any CM on feature, then the user can select another broadcasting channel or another time period at step S2401.

At step S2405, the CM that recorder/player 700 record and its record have been preengage consistent CM on feature.Therefore, can carry out the reservation recording of the CM of its airtime section and channel the unknown.After having write down the CM that its record preengage, the also blackening of blockage before the CM D in the Search Results viewing area 2503 for example, as shown in Figure 25, and the user can watch CM.

Though in illustrating,, also can be undertaken by the database in the recorder/player 700 of searching for user 102 as shown in Figure 19 according to inquiring about by the keyword of user's input about the flow chart among Fig. 9 of the inquiry of CM.

When CM information server 103 having been carried out several times the CM inquiry, the information of following with the CM that is inquired about has been acquired, and is registered in each and all has in the tabulation for the CM of the accompanying information of its registration.Therefore, all necessary if not all CM that satisfy condition, or in the environment of inaccessible network, also can only search for CM in the database in user 102 recorder/player 700.The rules of this search as shown in Figure 19.In this case, user 102 is at first at step S1901 input keyword.

At next step S1902, controller 702 detects CM in each all has the tabulation of the CM consistent with described keyword for the accompanying information of its registration and its accompanying information.

At next step S1903, the controller 702 outputs CM consistent with described keyword, and withdraw from described rules.Thereafter, controller 702 only needs as required to CM information server 103 inquiry CM.

Then, illustrate in user 102 recorder/player 700 and the communication between the CM information server 103 with reference to Figure 10.

Step 1:

In order to obtain the CM feature, be used for the keyword of CM search to 103 transmissions of CM information server from user 102 recorder/player 700.

Step 2:

CM information server 103 is according to the database of searching for as the keyword that is received of search key in CM information server 103.

Step 3:

When having found the CM consistent with described keyword as Search Results, CM information server 103 sends the feature of described CM to user 102 recorder/player 700.If the consistent CM of any and described keyword is arranged, then notifies this fact to user's recorder/player 700.If the CM consistent with described keyword arranged, then will always comprise the feature of described CM from the information that CM information server 103 sends to user 102.Described information can also comprise all CM as described company and the title of commodity, the actor who in described CM, occurs or actress, be used for the accompanying information of the music etc. and so on of described CM.

Step 4:

If comprise the feature of described CM from the information of CM information server 103 receptions, then user 102 recorder/player 700 provides Search Results from its feature of database search CM consistent with this feature and to user 102, simultaneously, the accompanying information that will comprise described keyword is registered in the database in user 102 recorder/player 700.If in the information that is received, do not comprise the CM feature, then do not obtain the CM consistent with described keyword to user notification.

And, the inquiry of being made to CM information server 103 by user 102 recorder/player 700 about the CM accompanying information is described with reference to the flow chart shown in Figure 26.When user 102 has imported when being used for from order that CM information server 103 obtains the CM accompanying information and/or when detecting new CM, carries out described inquiry.

At first, at step S2901, in the inquiry about the CM accompanying information, controller 702 is judged and is had the user and want the identical CM of the CM of the accompanying information known whether to be registered in each all to have in the tabulation for the CM of the accompanying information of its registration.If the judged result at step S2901 is to affirm (being), promptly when having registered accompanying information, controller 702 provides described accompanying information to the user, and withdraws from described rules.On the contrary, if be negative (denying) in the judged result of step S2901, if promptly registered described accompanying information, then controller 702 proceeds to step S2902.

At step S2902, controller 702 sends to CM information server 103 has the feature that the user wants the CM of the accompanying information that obtains.Controller 702 is by for example obtaining the CM feature from database 704, and sends described feature via network controller 705 to CM information server 103, and sends described CM feature.

At next step S2903, controller 702 receives accompanying information from CM information server 103.That is, controller 702 receives described accompanying information via network controller 705 from CM information server 103.

In next step S2904, controller 702 judges whether to comprise from the information that CM information server 103 returns the accompanying information of the CM that is carried out inquiry.If the judged result at step S2904 is to affirm (being), if promptly comprise described CM, then controller 702 proceeds to step S2905.On the contrary, if judged result for negating (denying), if promptly do not comprise such accompanying information, then controller 702 is to the described fact of user notification and withdraw from rules.

The CM that has just begun to be broadcasted according to circumstances has as yet not its accompanying information of registration in CM information server 103.In this case, the user can not obtain any accompanying information.Controller 702 is by providing described information via o controller 706 to the outside output unit such as the monitor (not shown), and to the user notification described accompanying information of registration in CM information server 103 as yet.

At step S2905, the accompanying information that controller 702 obtains from CM information server 103 to user notification, described accompanying information and each are all had as yet for the corresponding CM in the tabulation of the CM of the accompanying information of its registration is associated, and described CM is moved to each all have tabulation for the CM of the accompanying information of its registration.

Then, illustrate in user 102 recorder/player 700 and the communication between the CM information server 103 with reference to Figure 27.

Step 1:

For in response to user's order and/or automatically obtain the accompanying information of CM, controller 702 sends the feature of described CM to CM information server 103 from user 102 recorder/player 700.

Step 2:

Controller 702 is according to the database of searching for as the CM feature that is received of search key in CM information server 103.

Step 3:

When had been found that as Search Results with the CM that is received on feature during consistent CM, controller 702 sends accompanying information from the described CM of CM information server 103 to user 102 recorder/player 700.If with the CM that is received consistent CM on feature, then controller 702 is not found the information of accompanying information to user 102 recorder/player 700 transmissions.

Step 4:

If the information that is received from CM information server 103 comprises the accompanying information of the CM that is obtained, provide described accompanying information to the user in then in the database of controller 702 in the recorder/player 700 that described accompanying information is registered to the user.If do not comprise the accompanying information of the CM that is inquired about in the information that is received, then controller 702 is notified the described fact to user 102.

In above-mentioned example, also in user 102 recorder/player 700, be formed for storing the database of CM accompanying information.But, the invention is not restricted to this system, but the CM accompanying information provides the system can be by adaptive so that inquire about to CM information server 103 when needs are searched for.And in above-mentioned example, server managers provides the accompanying information of collecting by the method (not shown) to CM information server 103.But, the invention is not restricted to a kind of system in back, but described CM accompanying information provides the system can be by the adaptive so that tabulation of announcing CM on the World Wide Web (WWW) that shows on as shown in Figure 13 the screen for example, and specific or not specific people will come accompanying information via network input CM by for example using as shown in figure 14 screen.In this case, generally represent with drawing reference numeral 1000, the connection in CM recording reservation system such as Figure 11 illustrate conceptive.That is, the information importer 1107 ₁..., 1107 _m(following quilt totally is called " information importer 1107 ") is added to notion connection layout shown in Figure 1.

At this, with reference to the flow chart shown in Figure 12, manage in the database in the CM information server 103 in CM recording reservation system 1000 each in the open and all have as yet process for the tabulation of the CM of the accompanying information of its registration.

At step S1201, controller 202 judges whether that each in database all has as yet in the tabulation for the CM of the accompanying information of its registration and has registered new CM.If the judged result at step S1201 is to affirm (being), promptly when having registered new CM, controller 202 proceeds to step S1202.On the contrary, if judged result is negative (denying), if promptly do not register new CM, then controller 202 withdraws from described rules.

At step S1202, the CM that registers in each all has as yet tabulation for the CM of the accompanying information of its registration is provided to the information importer on network.Controller 202 all has as yet tabulation for the CM of the accompanying information of its registration by for example be presented in the database 204 each on the output unit such as the monitor (not shown) of the information importer on network via network controller 205, presents CM.Information importer's output unit display screen, described screen for example are illustrated in as shown in Figure 13 each all to has as yet and to be the CM in the tabulation of the CM of the accompanying information of its registration with the form of tabulation.

At step S1203, confirmed that each all has as yet the input unit of information importer's operation such as keyboard for the tabulation of the CM of the accompanying information of its registration, the accompanying information of collecting by the method (not shown) with input.For example, will all to have via the accompanying information of network controller 205 inputs and database 204 each from the described input unit such as the keyboard (not shown) of the information importer on network be that corresponding CM in the tabulation of CM of accompanying information of its registration is associated to controller 202 as yet.At this moment, display screen on the output unit such as monitor of the information importer on the network, to support the input of accompanying information, described screen illustrates accompanying information project and their the line of input 1402-1405 separately that for example arranges as shown in Figure 14.

At step S1204, the CM that has imported its accompanying information is all had as yet tabulation for the CM of the accompanying information of its registration and moves to each and all have tabulation for the CM of the accompanying information of its registration from each, and finishes described rules.

Note, the series operation shown in Figure 12 can be set, each when in database, register new CM, or provide when being used to begin the order of described rules as the information importer, begin with the predetermined time interval of for example each hour.

Note, though the embodiments of the invention that relate to based on the CM search of the CM feature as in the patent document 3 have been described, but the invention is not restricted to this method, but can be for example according to as the passing through method as shown in figure 16 of feature and definite quantity is obtained image.

Figure 16 shows the example of characteristics of image.Under the situation of NTSC method, 1 second video comprises about 30 images.As shown in Figure 16 A, an image is the matrix of 720 horizontal pixels and 480 vertical pixels, and forms a pixel from three rgb values.If represent each RGB with a byte, then an image has the data volume (720 * 480 * 3=1036800) of about 1MB.For example, 15 seconds CM comprises about 450 images, so it has the data volume of about 450MB.Even by for example MPEG-2, compress 15 seconds CM with the low rate of for example 2Mbps, it also will have the data volume of about 4MB.On the other hand, when shown in Figure 16 B, using the image brightness histogram like that, can represent an image with 11 bytes.In this example, by in the value scope of brightness at 0-255 of each pixel, and each value is standardized as under the hypothesis of being represented by a byte, and described brightness is formed histogram divided by 16.And, because the frequency of occurrences of black (near " 0 ") and white (near " 255 ") is not high, therefore ignore 5 frequency bands near black and white.In this case, 15 seconds time is corresponding to about 5kB.Though can not estimate original CM, can determine same feature according to same CM, and can determine different features according to different MC with high probability according to the feature shown in Figure 16 B.

Can according to whether the CM of television broadcasting be registered in and judged whether in the database 105 that this CM is new CM.Particularly, detect database 105 according to broadcasting CM as the search key.When in database 105, finding identical CM, the CM that is taken as the search key can be defined as not being any new CM.If do not find identical CM, then the CM that is taken as the search key can be defined as new CM.In this CM search, use the feature of CM to be sent to user 102, rather than CM video itself.For example, whether be the CM that in database, has registered if CM 1701 is judged, then CM 1703, CM 1705,1707 and 1709 in database are compared at video data rather than on feature with CM 1701, as shown in figure 17.That is, determine feature 1702 according to the video data of CM 1701.Similarly, also determine the feature 1704,1706,1708 and 1710 of the CM in database.Feature 1704,1706,1708 and 1710 in database is compared with the feature 1702 of CM 1701.In the example shown in Figure 17,, therefore can determine that CM 1701 and 1707 is mutually the same, and CM 1701 has been registered in the database because feature 1702 is consistent each other with 1708.Can use quite little data volume to carry out the described method of searching for CM according to any feature of the feature of CM rather than CM, therefore described method makes and can search for fast.In patent document 3, disclose in detail from the technology of the database 105 high-speed searchs feature consistent with key feature.

Those skilled in the art should be understood that as long as in the scope of appended claim or equivalent, can make up according to designing requirement and other factors, sub-portfolio and change.

The cross reference of related application

The present invention comprises the theme that the Japanese patent application JP2005-047799 that submits in Japan Patent office with on February 23rd, 2005 and the Japanese patent application JP2005-047800 that submits in Japan Patent office on February 23rd, 2005 are associated, and its whole content is merged in by reference at this.

Claims

1. comercial message searching method, wherein,

Detecting comercial message from television broadcasting, as calculated the feature of detected comercial message, accepted to follow the input of the information of described comercial message, and having created the comercial message feature wherein calculated and comercial message accompanying information is relative to each other under the situation of database of connection, the comercial message search equipment is in response to the request to comercial message search of the keyword that sends from commercial message Search Results receiving equipment via network as the search key, come from described database search comercial message feature according to described keyword, and be sent in detected comercial message feature in the described database to described comercial message Search Results receiving equipment via network as the search key; And

Described comercial message Search Results receiving equipment sends the searching request of the keyword that is used to search for described comercial message as the search key to described comercial message search equipment via network, and receive by described comercial message search equipment from the detected comercial message feature of described database via network, in television broadcasting, detect comercial message, calculate the feature of detected comercial message, and select its calculated characteristics and the consistent comercial message of comercial message feature that receives from described comercial message search equipment via network.

2. according to the process of claim 1 wherein, the request of described comercial message search equipment is connected to the specific of network or not specific people imports the comercial message accompanying information.

3. comercial message recording reservation method, wherein,

From television broadcasting, detect comercial message, as calculated the feature of detected comercial message, accepted to follow the input of the information of described comercial message, and having created the comercial message feature wherein calculated and comercial message accompanying information is relative to each other under the situation of database of connection, the comercial message search equipment in response to the keyword that sends from commercial message Search Results receiving equipment via network as the search key, request for the comercial message search, come from described database search comercial message feature according to described keyword, and be sent in detected comercial message feature in the described database to described comercial message Search Results receiving equipment via network as the search key; And

Described comercial message Search Results receiving equipment sends the searching request of the keyword that is used to search for described comercial message as the search key to described comercial message search equipment via network, and receive by described comercial message search equipment detected comercial message feature from described database via network, preengage the record of its calculated characteristics comercial message consistent with the comercial message feature that receives from commercial message search equipment via network, in television broadcasting, detect comercial message, calculate the feature of the comercial message that is detected, and write down its calculated characteristics and the consistent comercial message of comercial message feature that receives from described comercial message search equipment via network.

4. comercial message search equipment comprises:

Television broadcasting receiving device; And

Control device is used to control following operation:

In the television broadcasting that receives by described television broadcasting receiving device, detect comercial message;

Calculate the feature of the comercial message that is detected;

The input of the information of described comercial message is followed in acceptance, and stores the comercial message accompanying information of being accepted in database, in described database, and comercial message feature of being calculated and the described comercial message accompanying information connection that is relative to each other;

In response to the keyword that sends from commercial message Search Results receiving equipment via network as the search key, for the request of comercial message search, come according to as the keyword of search key and from described database search comercial message feature; And

Be sent in detected described comercial message feature in the described database via network to described comercial message Search Results receiving equipment.

5. comercial message Search Results receiving equipment comprises:

Television broadcasting receiving device; And

Control device is used to control following operation:

Send a keyword of the comercial message that will search for via network to the comercial message search equipment and be used as the searching request of searching for key, and receive by described comercial message search equipment detected comercial message feature in database via network;

Calculate the feature of the comercial message that is detected; And

Select its calculated characteristics and the consistent comercial message of comercial message feature that receives from described comercial message search equipment via network.

6. comercial message recording reservation system comprises:

The comercial message search equipment comprises:

Television broadcasting receiving device; And

Control device is used to control following operation:

Calculate the feature of the comercial message that is detected;

In response to the keyword that sends from commercial message Search Results receiving equipment via network as the search key, for the request of comercial message search, and come from described database search comercial message feature according to keyword as the search key; And

Be sent in detected described comercial message feature in the described database via network to described comercial message Search Results receiving equipment; And

Comercial message Search Results receiving equipment comprises:

Television broadcasting receiving device; And

Control device is used to control following operation:

Send a keyword of the comercial message that will search for via network to the comercial message search equipment and be used as the searching request of searching for key, and receive the comercial message feature that in database, detects by described comercial message search equipment via network;

Calculate the feature of the comercial message that is detected; And

Write down its calculated characteristics and the consistent comercial message of comercial message feature that receives from described comercial message search equipment via network.

7. a comercial message accompanying information provides method, and being used for provides equipment to provide the information of following comercial message to comercial message accompanying information receiving equipment via network from commercial message accompanying information, and described method makes:

In television broadcasting, detect comercial message, as calculated the feature of the comercial message that detected, accepted to follow comercial message feature that the input and having created of the information of described comercial message wherein calculated and comercial message accompanying information to be relative to each other under the situation of database of connection, described comercial message accompanying information provides operation of equipment:

In response to send from commercial message accompanying information receiving equipment via network, for the request that sends the comercial message accompanying information, and according to as the described comercial message feature of search key from described database search comercial message accompanying information feature, and read comercial message accompanying information about detected feature in described database; And

Send described comercial message accompanying information via network to described comercial message accompanying information receiving equipment.

8. a comercial message accompanying information provides equipment, and being used for provides the information of following comercial message via network to comercial message accompanying information receiving equipment, and described equipment comprises:

Television broadcasting receiving device; And

Control device is used to control following operation:

Calculate the feature of the comercial message that is detected;

The input of the information of described comercial message is followed in acceptance;

In database, store the comercial message accompanying information of being imported, in described database, comercial message feature of being calculated and the described comercial message accompanying information connection that is relative to each other;

In response to send from described comercial message accompanying information receiving equipment via network, for the request that sends the comercial message accompanying information, and, come from described database search comercial message accompanying information feature according to comercial message feature as the search key;

Read comercial message accompanying information about the feature that in described database, detects; And

9. comercial message accompanying information receiving equipment, be used for providing equipment to receive the information of following comercial message from commercial message accompanying information via network, described comercial message accompanying information provides equipment to have database, in described database, the feature of comercial message and follow the information of the described comercial message connection that is relative to each other, described equipment comprises:

Television broadcasting receiving device; And

Control device is used to control following operation:

The comercial message that detection is received by described television broadcasting receiving device;

Calculate the feature of detected comercial message; And

Provide equipment to send the comercial message feature of being calculated of searching for key as database search via network to described comercial message accompanying information, and provide equipment to receive comercial message from described comercial message accompanying information via network.

10. a comercial message accompanying information provides system, and being used for provides equipment to provide the comercial message accompanying information to comercial message accompanying information receiving equipment via network from commercial message accompanying information,

Described comercial message accompanying information provides equipment to comprise:

Television broadcasting receiving device; And

Control device is used to control following operation:

In by the television broadcasting that described television broadcasting receiving device received, detect comercial message;

Calculate the feature of detected comercial message;

In response to send from described comercial message accompanying information receiving equipment via network, for the request that sends the comercial message accompanying information, according to coming from described database search comercial message accompanying information feature as the comercial message feature of search key;

Send described comercial message accompanying information via network to described comercial message accompanying information receiving equipment; And

Described comercial message accompanying information receiving equipment comprises:

Television broadcasting receiving device; And

Control device is used to control following operation:

Calculate the feature of detected comercial message; And

11. a comercial message recording reservation system comprises:

The comercial message search equipment comprises

Television broadcast receiver; And

Controller is used to control following operation:

In the television broadcasting that receives by described television broadcast receiver, detect comercial message;

Calculate the feature of detected comercial message;

In response to the keyword that will send from commercial message Search Results receiving equipment via network as the search key, for the request of comercial message search, and come from described database search comercial message feature according to keyword as the search key; And

Be sent in the described comercial message feature that detects in the described database via network to described comercial message Search Results receiving equipment; And

Described comercial message Search Results receiving equipment comprises:

Television broadcast receiver; And

Controller is used to control following operation:

Send a keyword of the comercial message that will search for via network to the comercial message search equipment and be used as the searching request of searching for key, and receive by described comercial message search equipment detected comercial message feature in described database via network;

Calculate the feature of detected comercial message; And