CN101185330A - Bidirectional service system and multimedia content transmission device - Google Patents

Abstract

In an interactive service system (70), a service provider has an AV content creating/transmitting device (72) for transmitting AV content and an AV content related service providing device (75) for receiving a message, and a service requestor has an AV content reproducing device (74) for reproducing the AV content received from the AV content creating/ transmitting device (72) and then creating the message in accordance with sub-content of the AV content to transmit the message. The AV content creating/transmitting device (72) broadcasts AV data of the AV content via a relay station (13), while transmitting sub-content of the AV content via a network (16).

Description

The bi-directional service system of content of multimedia

Dispensing device and control method thereof, content of multimedia receiving system and control method thereof, sub-content reception apparatus and control method thereof, bi-directional service system control program, content of multimedia dispensing device control program, content of multimedia receiving system control program, sub-content reception apparatus control program and the recording medium that has write down said procedure

Technical field

The present invention relates to a kind ofly service requester be sent the content of multimedia include certain content and the incidental sub-content of this content, and above-mentioned service provider is sent the bi-directional service system and the control method thereof of the message relevant from above-mentioned service requester with above-mentioned content of multimedia from serving the provider, content of multimedia dispensing device and control method thereof, content of multimedia receiving system and control method thereof, sub-content reception apparatus and control method thereof, the bi-directional service system control program, content of multimedia dispensing device control program, content of multimedia receiving system control program, sub-content reception apparatus control program and the recording medium that has write down said procedure.

Background technology

Now, TV (television image) broadcasting is just changed to digital broadcasting from analog broadcasting.As the feature of this digital broadcasting, except that multichannelization, high image quality, high tone quality etc., can also exemplify out the realization of data broadcasting.

Data broadcasting is that the broadcasting dealer utilizes the electric wave of satellite TV broadcasting or surface wave TV broadcasting to send the broadcasting of data such as literal or program to not specific a plurality of terminals (TV receiver).By utilization broadcasting dealer's the data broadcasting function and the information input function and the communication function of terminal installation, realize that a kind of audiovisual user also can play two-way (interactive mode) service of certain effect to TV broadcasting.

In existing bi-directional service, send the AV content that constitutes by AV (audio visual) data and the incidental sub-content of these AV data to terminal.Include the BML data of recording and narrating with BML (BroadcastMarkup Language) in the sub-content.Terminal is by explaining and carry out this data, and broadcasted content and attached information are implemented the picture configuration and shown.In addition, be to implement for reciprocation by the ECMA script (script) that is included in the BML data from the input of terminal.Thereby, include the data of importing content and be sent to the BML answering server by telephone circuit, the Internet etc.

In addition, in the bi-directional service back-up system that patent documentation 1 is recorded and narrated, the broadcasting dealer sends the data broadcast program content, wherein, the data broadcast program content comprises service scenarios that bi-directional service uses, is used to discern the service scenarios code (SSC) of this service scenarios and the COS corresponding with above-mentioned SSC.Audiovisual user's receiver receives the data broadcast program content of sending from above-mentioned broadcasting dealer, and sends the reply data that includes SSC and COS to answering server.Answering server is with reference to memory, the service routine module corresponding with the COS in the reply data that above-mentioned receiver receives carried out specific, and the enforcement processing corresponding with specific server module.

In addition, in the present invention, will from service requester to the data definition of serving the provider and sending for " message " (message).This " message " comprises the request among Email or the WWW (World WideWeb) etc.

Patent documentation 1: the patent application Publication Laid-Open 2002-171508 of Japan communique, open day: on June 14th, 2002

Patent documentation 2: the patent application Publication Laid-Open 2004-343683 of Japan communique, open day: on December 2nd, 2004

As mentioned above, the bi-directional service system of prior art sends the content of multimedia that includes content and the incidental sub-content of this content.Therefore, will increase the burden of communication path more for a long time when the data volume of content of multimedia.

Summary of the invention

The present invention develops in view of the above problems, and its purpose is to provide a kind of bi-directional service system that prior art can alleviate the communication path burden that compares to.

To achieve these goals, bi-directional service of the present invention system constitutes, service requester is sent the content of multimedia that includes certain content and the incidental sub-content of this content from serving the provider, above-mentioned service provider is sent the bi-directional service system of the message relevant from above-mentioned service requester with above-mentioned content of multimedia, it is characterized in that: above-mentioned service provider upwards counts service requester with different communication paths and sends content and the sub-content that above-mentioned content of multimedia is comprised, and above-mentioned service requester sends above-mentioned message according to the transmission destination data that this service requester has.

In the prior art, content and sub-content are sent as content of multimedia.Therefore, utilize same communication path to send content and sub-content simultaneously, over-burden to cause communication path.

Because the present invention sends content and the sub-content that is comprised in the content of multimedia with different communication paths, so compare to the burden that prior art can alleviate communication path.In addition, under the place that can't use a certain communication path or environment, also can send content and sub-content by utilizing another communication path.

To achieve these goals, bi-directional service of the present invention system constitutes, service requester is sent the content of multimedia that includes certain content and the incidental sub-content of this content from serving the provider, above-mentioned service provider is sent the bi-directional service system of the message relevant from above-mentioned service requester with above-mentioned content of multimedia, it is characterized in that: above-mentioned service provider sends content and the sub-content that above-mentioned content of multimedia is comprised with same communication path to above-mentioned service requester, and above-mentioned service requester sends above-mentioned message according to the transmission destination data that this service requester had.

According to said structure, send the message relevant to serving the provider with content of multimedia based on the transmission destination data that service requester had.Thus, can send message to various transmissions destination.

In bi-directional service of the present invention system, the content and the sub-content that are sent to above-mentioned service requester preferably non-synchronously send.In this case, because content and sub-content are by the reduction of the possibility of synchronized transmission, so compare to the burden that prior art can alleviate communication path.In addition, the bi-directional service that can provide sub-content to record and narrate in timing with the asynchronism(-nization) that content is provided.

In addition, as the transmission destination data that service requester had, can utilize the directory that is stored in service requester, also can be the data that the user imports.

In bi-directional service of the present invention system, the sub-content of above-mentioned content of multimedia can comprise the transmission destination data of the transmission destination of representing above-mentioned message.Under these circumstances, service requester can send message according to the transmission destination data that is included in the above-mentioned sub-content.Thus, can guarantee message is sent to and serve the desirable transmission of provider destination.Therefore, except the server that bi-directional service is provided, can also send message to server such as broadcasting dealer, CM making dealer etc.

As the content that is comprised in the content of multimedia, can utilize the various contents of AV data, view data, video data, voice data, document data etc.

In addition, about the transmission of foregoing and sub-content, preferably the request with above-mentioned service requester irrespectively sends sub-content or broadcasts sub-content.In this case, owing to the request that need not from service requester, so can not cause trouble to the use user of request service.

To achieve these goals, content of multimedia dispensing device of the present invention has the sending part that sends the content of multimedia that includes certain content and the incidental sub-content of this content, and this content of multimedia dispensing device is characterised in that: above-mentioned sending part sends content and the sub-content that above-mentioned content of multimedia comprises by different communication paths.

In addition, to achieve these goals, the control method of content of multimedia dispensing device of the present invention is the control method of content of multimedia dispensing device that the content of multimedia that includes certain content and the incidental sub-content of this content is sent, it is characterized in that: comprise by different communication paths sending the content that above-mentioned content of multimedia comprises and the step of sub-content.

According to said structure and method, owing to send content and the sub-content that is comprised in the content of multimedia by different communication paths, so, compare to the burden that prior art can alleviate communication path as described above.In addition, under the place that can't use a certain communication path or environment, also can send content and sub-content by utilizing another communication path.

To achieve these goals, content of multimedia dispensing device of the present invention has the sending part that sends the content of multimedia that includes certain content and the incidental sub-content of this content, and this content of multimedia dispensing device is characterised in that: above-mentioned sending part sends content and the sub-content that above-mentioned content of multimedia comprises by same communication path.

To achieve these goals, the control method of content of multimedia dispensing device of the present invention is the control method of content of multimedia dispensing device that the content of multimedia that includes certain content and the incidental sub-content of this content is sent, it is characterized in that: comprise by same communication path and send the content that above-mentioned content of multimedia comprises and the step of sub-content.

In bi-directional service of the present invention system, foregoing and sub-content preferably non-synchronously are sent out.In this case, because the possibility that content and sub-content are sent simultaneously reduction, so, compare to prior art, can alleviate the burden of communication path.In addition, can provide the various services of the bi-directional service recorded and narrated by sub-content etc. with the time that content is provided timing inequality.

In addition, above-mentioned content of multimedia dispensing device preferably sends data (content of multimedia) to the different device that comprises external device (ED).

In playback content of multimedia one side, when the sub-content playback portion of the content playback portion of playback of content and the above-mentioned sub-content of resetting is independent separately, the content of multimedia dispensing device can be to this two send content of multimedia, also can send content, send sub-content to content playback portion to sub-content playback portion.

In addition, about the transmission of foregoing and sub-content, preferably the request with above-mentioned service requester irrespectively sends or broadcasts sub-content.In this case, owing to the request that need not from service requester, so can not cause trouble to the use user of request service.

In content of multimedia dispensing device of the present invention, above-mentioned sub-content preferably comprises the transmission destination data of the transmission destination of the expression message relevant with above-mentioned content of multimedia.

According to said structure, generate and send under the situation of above-mentioned message in the playback side of playback content of multimedia, will send above-mentioned message according to above-mentioned transmission destination data.Therefore, above-mentioned message can be sent to the desirable transmission of sub-content providers destination.

In addition, above-mentioned transmission destination data can be the data corresponding to foregoing.In this case, can send the destination according to each content alteration message.Its result can come certain content according to the transmission destination of message.

In content of multimedia dispensing device of the present invention, preferably, above-mentioned sub-content also comprises structured data, and the playback side that this structured data is illustrated in the above-mentioned content of multimedia of resetting generates the structure of this message under the situation of above-mentioned message.In this case, because the structure of message predesignated, so the device that has received message is processing messages easily.

To achieve these goals, content of multimedia receiving system of the present invention has the acceptance division that receives the content of multimedia that includes certain content and the incidental sub-content of this content, and this content of multimedia receiving system is characterised in that: above-mentioned acceptance division sends foregoing and above-mentioned sub-content by different communication paths.

In addition, to achieve these goals, the control method of content of multimedia receiving system of the present invention is the control method that receives the content of multimedia receiving system of the content of multimedia that includes certain content and the incidental sub-content of this content, it is characterized in that: comprise the step that receives foregoing and above-mentioned sub-content by different communication paths.

According to said structure and method, owing to receive content and the sub-content that is comprised in the content of multimedia with different communication paths, so, compare to the burden that prior art can alleviate communication path.In addition, under the place that can't use a certain communication path or environment, also can be by utilizing another communication path received content and sub-content.

To achieve these goals, content of multimedia receiving system of the present invention has the acceptance division that receives the content of multimedia that includes certain content and the incidental sub-content of this content, and this content of multimedia receiving system is characterised in that: above-mentioned acceptance division receives foregoing and above-mentioned sub-content by same communication path.

In addition, to achieve these goals, the control method of content of multimedia receiving system of the present invention is the control method that receives the content of multimedia receiving system of the content of multimedia that includes certain content and the incidental sub-content of this content, it is characterized in that comprising: the step that receives foregoing and above-mentioned sub-content by different communication paths.

In content of multimedia receiving system of the present invention, foregoing and sub-content are preferably non-synchronously received.In this case, because the possibility that content and sub-content are received simultaneously reduction, so, compare to the burden that prior art can alleviate communication path.The various services of bi-directional service of being recorded and narrated by sub-content etc. can be provided in the timing with the asynchronism(-nization) that content is provided in addition.

To achieve these goals, content of multimedia receiving system of the present invention has the acceptance division that receives the content of multimedia that includes certain content and the incidental sub-content of this content, and this content of multimedia receiving system is characterised in that: the above-mentioned sub-content that the request of above-mentioned acceptance division reception and this device irrespectively is sent out or broadcasts.

According to said structure, can under the situation that the content of multimedia receiving system does not have to ask, receive above-mentioned sub-content.Thus, carry out sub-requests for content because need not the user of content of multimedia receiving system, so, can not cause trouble to above-mentioned user.

In addition, the best illustration of above-mentioned content of multimedia receiving system is the situation that receives data (content of multimedia) from the outside.But the data (content of multimedia) that also can use this device to store replace from the data of outside reception.Like this, the data that this device is stored can be to receive from the outside and the data of storage, also can be the data that are built in this device when dispatching from the factory.

The sub-content playback portion that can also have in addition, the sub-content that above-mentioned acceptance division received of resetting.And, the content playback portion that can also have the content that above-mentioned acceptance division received of resetting.

Content of multimedia receiving system of the present invention preferably has generating unit that generates the message relevant with above-mentioned content of multimedia and the sending part that sends the message that is generated in addition, and the transmission destination that above-mentioned sending part is represented the transmission destination data that is had by this device sends above-mentioned message.

According to said structure, the transmission destination data that is had according to above-mentioned content of multimedia receiving system sends the message relevant with content of multimedia.Thus, can send message to various transmissions destination.

In addition, above-mentioned content of multimedia receiving system preferably sends data (message) to the different device that comprises external device (ED).

In addition, the message data Transmission system that preferably utilizes e-mail system or be similar to this system sends.In this case, can utilize existing systems.Because as long as in message, append addresses of items of mail, so can send message easily.

In addition, as the transmission destination data that service requester had, can utilize the directory that is stored in service requester, also the data that can utilize the user to import.

In content of multimedia receiving system of the present invention, in the sub-content that above-mentioned transmission destination data also can be contained in above-mentioned receiving system and received.In this case, the content of multimedia receiving system can send message according to the transmission destination data that is comprised in the above-mentioned sub-content.Thus, can send above-mentioned message to the desirable transmission of the provider of the provider of content of multimedia, particularly sub-content destination.

In content of multimedia receiving system of the present invention, above-mentioned generating unit preferably generates message according to the represented message structure of structured data in the sub-content that is comprised in above-mentioned receiving system reception.In this case, because the structure of message is predesignated, the message dispensing device need not the structure of regulation message, so, can generate message easily.

In addition, when the bi-directional service system has following apparatus, just can realize and above-mentioned same effect, that is: serve the message receiving apparatus that the provider comprises the content of multimedia dispensing device of the said structure that sends content of multimedia and receives the said structure of message, service requester comprises receiving multimedia content and generates and sends the content of multimedia receiving system of the said structure of message according to the sub-content of the content of multimedia that receives.

In addition, when the control method of bi-directional service system has following step, also can realize effect same as described above, that is: in the bi-directional service system of said structure, above-mentioned content of multimedia dispensing device sends content and the step of sub-content and above-mentioned content of multimedia receiving system sends above-mentioned message according to the transmission destination data that above-mentioned service requester had the step that above-mentioned content of multimedia comprises by different communication path or same communication path to above-mentioned content of multimedia receiving system.

In addition, can make computer carry out each step in the control method of above-mentioned content of multimedia dispensing device by content of multimedia dispensing device control program.In addition, also can make computer carry out each step in the control method of above-mentioned content of multimedia receiving system by content of multimedia receiving system control program.In addition, can make computer carry out each step in the control method of above-mentioned bi-directional service system by the bi-directional service system control program.

In addition, because above-mentioned content of multimedia dispensing device control program is stored in the recording medium of embodied on computer readable, so, can carry out above-mentioned content of multimedia dispensing device control program by computer arbitrarily.In addition, because above-mentioned content of multimedia receiving system control program is stored in the recording medium of embodied on computer readable, so, can carry out above-mentioned content of multimedia receiving system control program by computer arbitrarily.In addition, because above-mentioned bi-directional service system control program is stored in the recording medium that computer can read, so, can carry out above-mentioned bi-directional service system control program by computer arbitrarily.

As mentioned above, bi-directional service of the present invention system sends content and the sub-content that is comprised in the content of multimedia by different communication paths, so, compare to prior art, can obtain the effect that alleviates the communication path burden.

Description of drawings

Fig. 1 is the block diagram of schematic configuration of the bi-directional service system of expression an embodiment of the present invention.

Fig. 2 is the block diagram of the schematic configuration of the AV content generation device in the above-mentioned bi-directional service of the expression system.

Fig. 3 be the AV content in the above-mentioned bi-directional service of the expression system synthetic/block diagram of the schematic configuration of dispensing device.

Fig. 4 is the block diagram of the schematic configuration of the portable telephone terminal in the above-mentioned bi-directional service of the expression system.

Fig. 5 is the block diagram of the schematic configuration of the AV content related service generator in the above-mentioned bi-directional service of the expression system.

Fig. 6 is the figure that is illustrated in the data structure of employed AV content in the above-mentioned bi-directional service system.

Fig. 7 is the figure that represents to be comprised in an example of the sub-content in the above-mentioned AV content with the data that the XML form is recorded and narrated.

Fig. 8 is the figure that represents to be comprised in an example of the html document in the above-mentioned sub-content with the data that the HTML form is recorded and narrated.

Fig. 9 (a) is the figure of expression based on an example of the display frame of above-mentioned AV content, is the figure of expression key frame.

Fig. 9 (b) is the figure of expression based on an example of the display frame of above-mentioned AV content, is the figure of expression searching screen.

Figure 10 is the transmission sequential chart regularly that expression is contained in AV data in the above-mentioned AV content and sub-content.

Figure 11 is the figure of an example of the structure of the message that generates of the above-mentioned portable telephone terminal of expression and this message.

Figure 12 is the flow chart that the above-mentioned portable telephone terminal of expression is handled action.

Figure 13 is the processing sequence that expression is comprised in the conveying of the processing of each device in the above-mentioned bi-directional service system and the data between each device.

Figure 14 is the block diagram of schematic configuration of the bi-directional service system of expression another embodiment of the present invention.

Figure 15 is the block diagram of the schematic configuration of the AV content generation/dispensing device in the above-mentioned bi-directional service of the expression system.

Figure 16 is the block diagram of the schematic configuration of the AV content reproduction apparatus (AV contentreproducing device) in the above-mentioned bi-directional service of the expression system.

Figure 17 is the block diagram of the schematic configuration of the AV content related service generator in the above-mentioned bi-directional service of the expression system.

Figure 18 is the sequential chart that is illustrated in the example of the program ID that utilized in the above-mentioned bi-directional service system and scene ID.

Figure 19 is the figure that is comprised in an example of the sub-content in the above-mentioned AV content with the data representation that the XML form is recorded and narrated.

Figure 20 is the figure that is comprised in an example of the html document in the above-mentioned sub-content with the data representation that the HTML form is recorded and narrated.

Figure 21 (a) is the figure of expression based on an example of the display frame of above-mentioned AV content.

Figure 21 (b) is the figure of expression based on an example of the display frame of above-mentioned AV content.

Figure 22 is the figure of an example of the structure of the message that generates of the above-mentioned AV content reproduction apparatus of expression and this message.

Figure 23 is the flow chart of the processing action carried out of the above-mentioned AV replay device of expression.

Figure 24 is the generation of the message in the above-mentioned processing action of expression and the flow chart that sends the details of handling.

Figure 25 is the block diagram of schematic configuration of the modified example of the above-mentioned bi-directional service of expression system.

Figure 26 is the block diagram of schematic configuration of another variation of the above-mentioned bi-directional service of expression system.

Figure 27 is the figure that is comprised in another example of the sub-content in the above-mentioned AV content with the data representation that the XML form is recorded and narrated.

Figure 28 is the figure that is comprised in an example of the html document in the above-mentioned sub-content with the data representation that the HTML form is recorded and narrated.

Figure 29 is the figure of expression based on an example of the display frame of above-mentioned AV content.

Figure 30 is the figure that is comprised in other example of the sub-content in the above-mentioned AV content with the data representation that the XML form is recorded and narrated.

Figure 31 is the block diagram of schematic configuration of the bi-directional service system of expression another embodiment of the present invention.

Figure 32 is the block diagram of the schematic configuration of AV content generation/dispensing device in the above-mentioned bi-directional service of the expression system.

Figure 33 is the block diagram of the schematic configuration of the above-mentioned bi-directional service of expression system neutron content reproduction apparatus.

Figure 34 is the block diagram of the schematic configuration of AV data reproducing device in the above-mentioned bi-directional service of the expression system.

Figure 35 is the block diagram of the schematic configuration of AV content related service generator in the above-mentioned bi-directional service of the expression system.

Figure 36 is the figure with an example of the above-mentioned sub-content of data representation of XML form record.

Figure 37 is the figure that is comprised in an example of html document in the above-mentioned sub-content with the data representation that the HTML form is recorded and narrated.

Figure 38 (a) is the figure of expression based on an example of the display frame of above-mentioned AV data.

Figure 38 (b) is the figure of expression based on an example of the display frame of above-mentioned sub-content.

Figure 39 is the figure of an example of the structure of the message that generates of the above-mentioned sub-content reproduction apparatus of expression and this message.

Figure 40 is the flow chart of the processing action carried out of the above-mentioned sub-content reproduction apparatus of expression.

Figure 41 is the flow chart of the processing action carried out of the above-mentioned AV data reproducing device of expression.

Figure 42 is the block diagram of schematic configuration of the bi-directional service system of expression another embodiment of the present invention.

Figure 43 is the figure that is illustrated in an example of the sub-content of being utilized in the above-mentioned bi-directional service system with the data that the XML form is recorded and narrated.

Figure 44 is the figure that is comprised in an example of html document in the above-mentioned sub-content with the data representation that the HTML form is recorded and narrated.

Figure 45 (a) is the figure of expression based on an example of the display frame of above-mentioned AV content, is the figure of expression key frame.

Figure 45 (b) is the figure of expression based on an example of the display frame of above-mentioned AV content, is the figure of expression inquiry picture.

Figure 46 is the figure that represents an example of the programme information that the programme information storage part of AV content related service generator shown in Figure 5 is stored with form.

Figure 47 is the figure that is illustrated in an example of the database that the input content stores portion of above-mentioned AV content related service generator stored with form.

Figure 48 is the figure that is illustrated in an example of the database that the store information storage part of above-mentioned AV content related service generator stored with form.

Figure 49 is the flow chart of the processing action carried out of the above-mentioned AV content related service generator of expression.

Figure 50 is the figure that is illustrated in the structure of the above-mentioned sub-content under the situation of having utilized the MMS source template.

Figure 51 is the figure that is comprised in an example of the source template in the above-mentioned MMS source template with the data representation that the XML form is recorded and narrated.

Symbol description

10,70,100,120 bi-directional service systems

11AV content generation device (content of multimedia generating apparatus)

The 12AV content is synthesized/dispensing device (content of multimedia dispensing device, content of multimedia generating apparatus)

14 portable telephone terminals (content of multimedia replay device, message dispensing device)

15,75,105,125AV content related service generator (message receiving apparatus)

22,83AV content generating unit (generating unit)

23,34,85AV content sending part (content of multimedia sending part)

The 32AV content is synthesized portion's (generating unit)

36 programme information sending parts (content recognition information sending part)

44AV content acceptance division (acceptance division)

45 Department of Communication Forces (acceptance division)

50,92AV Context resolution portion (sub-content obtaining section, content obtaining section)

52 pictures configuration instruction unit (switching part)

54 playback portions (sub-content playback portion, content playback portion)

55 message generating units (generating unit, sending part)

60 programme information acceptance divisions (obtaining section)

61 message sink portions (acceptance division)

62,96 information analyzing section (obtaining section)

63 programme information judging parts (identification part)

64,97 input content stores portions (storage part)

66 acknowledgement messaging portions (portion is provided)

72,102,123AV content generation/dispensing device (content of multimedia dispensing device, content of multimedia generating apparatus)

74,124AV content reproduction apparatus (content of multimedia replay device, message dispensing device)

77AV content reproduction apparatus (content of multimedia replay device)

86ID sending part (content recognition information sending part)

93 sub-content transfering departments (sub-content sending part)

94,117 sub-content obtaining sections (sub-content obtaining section)

95ID acceptance division (obtaining section)

104AV data reproducing device (content reproduction apparatus)

107 sub-content reproduction apparatus (message dispensing device)

113 programming information sending parts (content recognition information sending part)

118AV data playback instruction unit (playback indication information sending part)

D10AV content (content of multimedia)

D11AV data (content)

D12, D22, D32, D42 content

D14 message sends the information (transmission destination data) of destination

D15 message structure information (structured data)

D18AV data identification information (content recognition information)

Embodiment

(execution mode 1)

Below, with reference to accompanying drawing 1～13 explanation one embodiment of the present invention.Fig. 1 represents the schematic configuration of the bi-directional service system of present embodiment.When portable telephone terminal shows CM, this bi-directional service system 10 provide a kind of can to propagate among the CM and be positioned at the service that near the store information this portable telephone terminal is searched for.In addition, Figure 13 is that expression is included in the processing of the device in the bi-directional service system 10 and the processing sequence of conveying of the data between the device.

As shown in Figure 1, bi-directional service system 10 be by communication network 16 connect AV content generation devices 11, AV content synthetic/12,1 of dispensing device or a plurality of portable telephone terminal (AV content reproduction apparatus 14) form the structure that can communicate by letter with AV content related service generator 15.In addition, portable telephone terminal 14 have by relay station 13 from the AV content synthetic/function that dispensing device 12 receives AV contents (content of multimedia) and resets.

In the present embodiment, AV content generation device 11 and AV content related service generator 15 belong to CM make the dealer all, the AV content is synthetic/dispensing device 12 and relay station 13 belong to the broadcasting dealer all, portable telephone terminal 14 belong to the audiovisual user all.In addition, can utilize mobile radio communication, telephone wire road network, the Internet, LAN well-known communication networks such as (Local AreaNetwork) as communication network 16.

AV content generation device 11 generates AV content (S10 of Figure 13), and by communication network 16 to the AV content synthetic/dispensing device 12 sends the AV content (S11 of Figure 13) that generates, wherein, this AV content includes and is used for the CM that reset as video and the audio frequency of CM with AV data and sub-content.

The AV content is synthetic/and dispensing device 12 synthesizes program AV data for the AV content that receives from AV content generation device 11, this program is used for the data (S12 of Figure 13) of being reset as the video and the audio frequency of TV program with the AV data, and sends the programme information (S13 of Figure 13) of expression AV content airtimes to AV content related service generator 15.Then, the AV content synthetic/dispensing device 12 broadcast the AV content (S14 of Figure 13) of having synthesized in the preset time section by relay station 13.

The AV content is the structure that includes AV data and the incidental sub-content of these AV data.In addition, above-mentioned sub-content can include the replay data of resetting with the AV data relatedly, also can contain the replay data relatively independent with the AV data.In addition, above-mentioned sub-content can contain 1 replay data, also can contain a plurality of replay data.

In the present embodiment, the AV data are to have synthesized CM with AV data and the program AV data with the AV data, are to reset the flow data (streaming data) of data accepted in real time.In addition, sub-content is attached the AV data in CM, and it comprises picture configuration specific data, sends destination data and the AV data are carried out specific data.Wherein, picture configuration specific data is the data of specifying the display frame configuration, this display frame configuration is used for the CM picture of demonstration CM and the searching screen of searching for are switched, and sending destination data is to represent from portable telephone terminal 14 to AV content related service generator 15 message structure that sends and the data that send the destination.In addition, the AV content also can comprise the program incidental sub-content of AV data.

In the present embodiment, portable telephone terminal 14 has the function of utilizing GPS (Global PositioningSystems) to obtain the latitude longitude information of this terminal present position.Portable telephone terminal 14 from the AV content synthetic/after dispensing device 12 receives the AV contents, the AV content of resetting and being received.That is, portable telephone terminal 14 disposes any one party in reset CM picture or the searching screen according to the display frame of appointment, and switches to the opposing party (S15 of Figure 13) according to user's operation.

At this moment, as audiovisual user (user of portable telephone terminal 14) when pressing the search key on the searching screen, portable telephone terminal 14 generates message (S16 of Figure 13) according to the data of the structure of expression message.This message comprises personal information (for example address, name etc.), addresses of items of mail, the positional information of present portable telephone terminal 14 and the information of specific CM that has been set in advance in the AV content reproduction apparatus 74.In the present embodiment, utilize channel information in the audiovisual and picture information switching time when switching to searching screen information as specific CM.Portable telephone terminal 14 sends the message (S17 of Figure 13) of generation according to the data of expression message transmission destination (the AV content related service generator 15 in the example as shown in the figure).

AV content related service generator 15 is according to the message that receives from portable telephone terminal 14 information that Searches Shops, and to portable telephone terminal 14 feedback search results.Therefore, the audiovisual user can learn that the position that CM propagates is near position, shop.

In addition, because in the sub-content of the AV content that AV content generation device 11 generates, comprise with AV content related service generator 15, so CM making dealer can utilize desirable device to receive message from portable telephone terminal 14 as the transmission destination data that sends the destination.Its result, CM makes the dealer can provide various services to the user of portable telephone terminal 14 according to the content of message, and can directly collect the reaction of the user of portable telephone terminal 14 to CM.

In addition, because the user of portable telephone terminal 14 does not need to import the transmission destination of message, so, not only having omitted input, can also prevent because the message misinformation that the input error causes.

Then, the details to each structure in the bi-directional service system 10 of present embodiment describes.

Fig. 2 represents the schematic configuration of AV content generation device 11.As mentioned above, AV content generation device 11 generates the AV content, and this AV content includes the CM that is used for being reset as video and the audio frequency of CM AV data and this CM incidental sub-content of AV data.As shown in the figure, AV content generation device 11 has AV data store 20, sub-content stores portion 21, AV content generating unit 22 and AV content sending part 23.

The storage CM of AV content stores portion 20 make dealers institute 1 or a plurality of CM AV data of generation in advance.In addition, the 21 storage CM of sub-content stores portion make attaching in each seed content of CM usefulness AV data that dealers institute generates in advance.AV data store 20 and sub-content stores portion 21 are made of the storage device such as HDD (hard disk drive) etc.In addition, will be about sub-content in aftermentioned.

AV content generating unit 22 is taken out desirable CM AV data from AV data store 20, and from sub-content stores portion 21 take out with this CM with the corresponding sub-content of AV data, and generation includes the AV content that CM uses AV data and sub-content.AV content generating unit 22 sends the AV content that generates to AV content sending part 23.AV content generating unit 22 is to carry out such as storage devices such as RAM or flash memory institute program stored by CPU to realize.

AV content sending part 23 by communication network 16 to the AV content synthetic/dispensing device 12 sends the AV content that receives from AV content generating unit 22.

In addition, sub-content stores portion 21 also can generate and store particular message not in advance and sends the sub-content of destination and corresponding CM and send the destination with the message of AV data.At this moment, AV content generating unit 22 is as long as take out desirable CM AV data from AV data store 20, send destination and above-mentioned sub-content from sub-content stores portion's 21 taking-ups message corresponding with this CM usefulness AV data, and message is sent the destination write above-mentioned sub-content, include the sub-content that writes and CM and get final product thereby generate with the AV content of AV data.

Thus,, CM can change message transmission destination according to CM because making the dealer, thus can provide different services by corresponding each CM, and can collect the reaction of user to each CM.

Fig. 3 represent the AV content synthetic/schematic configuration of dispensing device 12.As mentioned above, the AV content is synthetic/AV content that dispensing device 12 will receive from AV content generation device 11 and be used for synthesizing with the AV data as the program that the video and the audio frequency of TV program are reset, and in the preset time section, broadcast the AV content of having synthesized by relay station 13.As shown in the figure, the AV content synthetic/dispensing device 12 has AV content acceptance division 30, AV data store 31, the synthetic portion 32 of AV content, timing portion 33, AV content sending part 34, programme information generating unit 35 and programme information sending part 36.

AV content acceptance division 30 receives the AV content by communication network 16 from AV content generation device 11.AV content acceptance division 30 sends the AV content that has received to AV content synthetic portion 32.

AV data store 31 stored broadcast dealers 1 or a plurality of program AV data generating in advance.AV data store 31 is by constituting such as HDD storage devices such as (hard disk drives).

The synthetic portion 32 of AV content takes out desired program AV data from AV data store 31, and the program that takes out is synthesized with AV data and AV content, wherein, this AV content is the AV content that receives from AV content generation device 11 by communication network 16 and AV content acceptance division 30.Specifically, between program is with the AV data, insert CM AV data.At this moment, the airtime section of the airtime section of program and CM is by specific.

The AV content that the synthetic portion 32 of AV content sends after synthesizing to AV content sending part 34.In addition, the synthetic portion 32 of AV content sends program specific and the information of the airtime section of CM to programme information generating unit 35.The synthetic portion 32 of AV content carries out by the program such as memory device stores such as RAM or flash memories by CPU and realizes.

In addition, preferably between AV content acceptance division 30 and the synthetic portion 32 of AV content, be provided with AV content stores portion (not shown), the AV content that this AV content stores portion storage receives from AV content generation device 11.At this moment, the synthetic portion 32 of AV content can make above-mentioned program synthesize with the AV data with from the AV content that AV content generation device 11 receives in the desired moment.

Timing portion 33 is parts of metering time.Timing portion 33 sends the temporal information of being measured to AV content sending part 34.

AV content sending part 34 sends the AV content that receives from the synthetic portion 32 of AV content according to the time information that receives from timing portion 33 to relay station 13.Thus, the AV content is broadcasted by relay station 13.Figure 10 represents to be comprised in the AV data in the AV content and the delivery time of sub-content.As shown in the figure, the AV content is synthetic/and dispensing device 12 sends the AV data as flow data all the time, and only in the sub-content of certain timed sending.

Below get back to Fig. 3, programme information generating unit 35 generates programme information according to the information of the airtime section of program that receives from the synthetic portion 32 of AV content and CM.Programme information generating unit 35 sends the programme information that has generated to programme information sending part 36.

Programme information sending part 36 sends the programme information that receives from programme information generating unit 35 by communication network 16 to AV content related service generator 15.

Fig. 4 represents the schematic configuration of portable telephone terminal 14.As shown in the figure, portable telephone terminal 14 comprises control part 40, storage part 41, input part 42, efferent 43, AV content acceptance division 44, Department of Communication Force 45 and positional information obtaining section 46.

Control part 40 is controlled the various structures of portable telephone terminal 14 blanketly.The function of control part 40 is carried out to be stored in such as the program in the storage devices such as RAM or flash memory by CPU and is realized.In addition, will be to the detailed description of control part 40 in aftermentioned.

Storage part 41 storing various information.Storage part 41 is by constituting such as flash memory, HDD etc.In the present embodiment, storage part 41 storage terminal set informations 47.Terminal set information 47 includes personally identifiable informations such as user's address, name, age, occupation, and terminal identification information such as telephone number of portable telephone terminal 14, e-mail address.

Various information such as the selection information that input part 42 accepted users are imported, indication information, Word message for example can exemplify out keyboard, ten key, indicating equipment (Pointing device) etc.Input part 42 is according to user's input generation input signal and to control part 40 outputs.

Efferent 43 is to various information such as outside output character, image, sound.Specifically, efferent 43 is to be made of display device and audio output device spare, wherein, display device has the LCD (Liquid Crystal Display), EL (Electroluminescence) display, PDP (Plasma Display Panel) of various information such as showing output character or image etc., and audio output device spare has earphone, loud speaker etc.The user can see that efferent 43 exports the image (comprising rest image and motion video) that shows and literal etc., and can hear the sound and the music of the output of efferent 43 audio frequency.

AV content acceptance division 44 receives the electric wave of the AV content that sends from relay station 13, and it is carried out predetermined process and sends to control part 40.

Department of Communication Force 45 will become to be suitable for the form of data communication from the data conversion that control part 40 receives, and send converted signal to communication network 16.In addition, Department of Communication Force 45 will become original form from the signal transformation that communication network 16 receives, and send converted data to control part 40.

Positional information obtaining section 46 obtains the present positional information of portable terminal 14, and sends obtained positional information to control part 40.In the present embodiment, be used as obtaining the method for positional information with the method for utilizing GPS (GlobalPositioning Systems) to obtain present latitude longitude information, but also can use the user to pass through the method in the present address of input part 42 input portable telephone terminal 14, perhaps utilize the arbitrary method such as method in address of carrying out the base station of radio communication with portable telephone terminal 14.

Below describe control part 40 in detail.As shown in Figure 4, control part 40 comprises AV Context resolution portion 50, browser portion 51, picture configuration instruction unit 52, timing control part 53, playback portion 54, message generating unit 55 and response message obtaining section 56.

AV Context resolution portion 50 resolves the AV contents, this AV content be by relay station 13 and AV content acceptance division 44 from the AV content synthetic/AV content that dispensing device 12 is obtained.Specifically, AV Context resolution portion 50 discerns the AV data and sends these data to playback portion 54 from the AV content that obtains.In addition, AV Context resolution portion 50 recognin content and resolve this sub-content from the AV content that obtains is sent various indications according to analysis result to browser portion 51, picture configuration instruction unit 52 and timing control part 53.

Fig. 6 represents the structure of the AV content utilized in the present embodiment.As shown in the figure, AV content D10 is the structure that includes AV data D11 and sub-content D12.In addition, to comprise the information of the display frame configuration of relevant picture be picture configuration information D13 to sub-content D12, represented that the information of the transmission destination of message is that message sends destination information D14, represented that the information of message structure is message structure information D 15.

Picture configuration information D13 includes picture configuration appointed information D16 that has specified picture display frame configuration and the structure of having specified the displaying contents appointed information D17 of displaying contents.In addition, to include the information of specific AV data be AV data identification information (ID) D18 to message structure information D 15.

Get back to Fig. 4, AV Context resolution portion 50 sends the information of relevant picture configuration respectively to picture configuration instruction unit 52, to the information of browser portion 51 relevant html documents of transmission and relevant information, sends the information of relevant demonstration times to timing control part 53.

Browser portion 51 generates video data according to the html data that is included among the sub-content D12.In addition, browser portion 51 by Department of Communication Force 45 and communication network 16 visits outside by the specified URL of sub-content D12 (Uniform Resource Locator), and generate video data according to the data that obtain after obtaining various data such as html data, view data from the outside.Thereafter, browser portion 51 sends the video data that generates to playback portion 54.In addition, browser portion 51 sends the information that is comprised in the relevant information among the sub-content D12 according to the indication that obtains from input part 42 to message generating unit 55.

Picture configuration instruction unit 52 is indicated the 54 display frames configuration of playback portion according to the information of the relevant picture configuration that receives from AV Context resolution portion 50.In addition, timing control part 53 is controlled the demonstration time of playback portion 54 according to the information of the relevant demonstration time that receives from AV Context resolution portion 50.The control of this demonstration time is the appointment that a plurality of displaying contents are arranged in sub-content, and along with the variation of time, implements under the situation that the appointment of its displaying contents also changes.

54 pairs in playback portion deciphers from the AV data that AV Context resolution portion 50 receives, and the control of indication of sending according to picture configuration instruction unit 52 and timing control part 53 reset data of having deciphered and the video data that receives from browser portion 51.Playback portion 54 exports demonstration by the data that send after resetting to efferent 43.

Message generating unit 55 generates message according to the information of the relevant information that receives from browser portion 51, terminal set information 47 from be stored in storage part 41 and the information of the latitude longitude obtained from positional information obtaining section 46.Message generating unit 55 sends the message that generates by Department of Communication Force 45 and communication network 16 to AV content related service generator 15.

Response message obtaining section 56 obtains the response message that AV content related service generator 15 generates by communication network 16 and Department of Communication Force 45, and wherein, this response message is replied as the message that message generating unit 55 is generated.Response message obtaining section 56 is exported acquired message by browser portion 51, playback portion 54 and efferent 43 to the user.

Fig. 5 represents the schematic configuration of AV content related service generator 15.As shown in the figure, the structure of AV content related service generator 15 comprises programme information acceptance division 60, message sink portion 61, message parse portion 62, programme information judging part 63, input content stores portion 64, store information storage part 65, acknowledgement messaging portion 66 and programme information storage part 67.

Programme information acceptance division 60 by communication network 16 receive the AV contents synthetic/programme information that dispensing device 12 generates, and send the programme information that receives to programme information storage part 67.

The programme information that 67 storages of programme information storage part receive from programme information acceptance division 60.Figure 46 represents to be stored in an example of the programme information in the programme information storage part 67 with form.As shown in the figure, programme information comprises broadcast date, airtime, channel identifier and trade name, from the AV content synthetic/dispensing device 12 sends such a programme information to AV content related service generator 15.In addition, when CM making dealer only makes the CM of 1 commodity, can omit illustrated this trade name.

In addition, channel identifier shown in Figure 46 is the ID that is used for the uniqueness of specific channel.This is because the broadcasting dealer when utilizing a plurality of channels to broadcast a plurality of program simultaneously, needs specific which channel broadcasting AV content (CM) that is predefined in.

Therefore, the dealer only utilizes under the situation that 1 channel broadcasts in broadcasting, can omit from the AV content synthetic/channel identifier of dispensing device 12 to the programme information that AV content related service generator 15 sends.In this case, if the broadcasting dealer of AV content related service generator 15 energy particular sender appends the channel identifier corresponding with specific broadcasting dealer and gets final product in programme information.In addition, when channel number can not change because of the variation of region, can utilize channel number as channel identifier.

Message sink portion 61 receives the message that is generated by portable telephone terminal 14 by communication network 16, and sends the message that has received to message parse portion 62.

Message parse portion 62 resolves the message that receives from message sink portion 61, and sends the various information that are included in this message to each one.Specifically, message parse portion 62 sends picture information switching time and channel information (channel identifier) to programme information judging part 63, send terminal set information 47 and latitude longitude information to input content stores portion 64, and, to the addresses of items of mail of acknowledgement messaging portion 65 transmission latitude longitude information and transmit leg.

Programme information judging part 63 carries out specific to CM according to picture information switching time, the channel information that receive from message parse portion 62, the programme information that is stored in the programme information storage part 67.Programme information judging part 63 is stored information and the above-mentioned programme information of specific CM in input content stores portion 64.In addition, programme information judging part 63 sends the information of specific CM to acknowledgement messaging portion 66.

Input content stores portion 64 makes terminal set information 47, the latitude longitude information from 62 receptions of message parse portion and carries out correspondence from CM information, programme information that programme information judging part 63 receives and also store.Thus, CM makes the dealer and can learn: the CM that when broadcasts and whether interesting to it that has been positioned at audiovisual user audiovisual where.

Figure 47 represents in the present embodiment with form, is stored in an example of the database in the input content stores portion 64.Store in the input content stores portion 64 according to each CM and disparate databases.Database as shown in the figure is the example about the database of convenience store " NINE FIVE ".In this database, stored the channel information (channel identifier) that is included in the message, switching time information and latitude longitude information.

Store information storage part 65 stores store information, and what this store information had comprised shop title etc. carries out the latitude longitude information in information specific and this shop to the shop.In addition, input content stores portion 64 and store information storage part 65 are made of for example storage device such as flash memory, HDD.

Figure 48 represents in the present embodiment with form, is stored in an example of the database in the store information storage part 65.Store the disparate databases corresponding in the store information storage part 65 with each CM.Database as shown in the figure is the example about the database of convenience store " NINE FIVE ".The latitude and the longitude of shop title and this position, shop in this database, have been stored.

Acknowledgement messaging portion 66 generates receiving the response message of message.Acknowledgement messaging portion 66 sends the response message that has generated by communication network 16 to the portable telephone terminal 14 of message sender.

In the present embodiment, acknowledgement messaging portion 66 according to programme information judging part 63 specific CM information judge whether to utilizing the CM of store information.When being when utilizing the CM of store information, acknowledgement messaging portion 66 Searches Shops in store information storage part 65, the latitude longitude information that this shop has is the most approaching with the latitude longitude information that receives from message parse portion 62 on distance, and the store information that searches is sent to the transmit leg addresses of items of mail that receives from message parse portion 62 as response message.

In addition, the enforcement of above-mentioned search also can by relatively be included in the positional information (latitude longitude information) in the message and be stored in positional information in the store information storage part 65 be chosen in distance last with the immediate shop of positional information that is included in the message; Can also select the positional information that comprised with message the shortest shop on displacement by combinatorial path information.

Fig. 7 represents the example of sub-content D12.Under situation as shown in the figure, sub-content D12 records and narrates with XML (eXtensible Markup Language) form, but also can use the combination of any record form such as HTML (Hyper Text Markup Language) form, XHTML (eXtensible Hyper TextMarkup Language) form, SMIL (Synchronized Multimedia IntegrationLanguage) form or above-mentioned each form to record and narrate.In addition, record example shown in Figure 7 is to be used to illustrate simple record of the present invention.

In the present embodiment, at＜layout〉record and narrate picture configuration appointed information D16 in the label (tag).In illustrated example, fix at the picture middle finger of wide cut 240 pixels * height 320 pixels (QVGA (Quarter VideoGraphics Array)) and to state three zones, that is: highly be the upper area of 180 pixels, highly be the lower area and the overall region of 140 pixels.

In addition, at＜par〉record and narrate displaying contents appointed information D17 in the label.In illustrated example, displaying contents appointed information D17 comprises the displaying contents appointed information D17a of key frame and the displaying contents appointed information D17b of searching screen.

On key frame, highly be that the upper area of 180 pixels is designated as video (video) zone based on the AV data, highly be the content that the lower area of 140 pixels then shows html document " main.html ".Fig. 9 (a) expression is according to an example of the shown key frame of the displaying contents appointed information D17a of key frame.As shown in the figure, on key frame, upper area shows the content (video) of AV data, and the lower area demonstration is used for image switching " shop search " key to searching screen.

On the other hand, the content that shows html document " search.html " at the Zone Full of searching screen.Fig. 8 represents an example of above-mentioned html document " search.html ", and Fig. 9 (b) table is not according to an example of the shown key frame of the displaying contents appointed information D17b of searching screen.As shown in the figure, in searching screen, the content of shop search service, " OK " key of indication search and " television image " key that switches to key frame have been shown.

In addition, above-mentioned html document " main.html ", " search.html " are comprised among the sub-content D12.Because the person of ordinary skill in the field can make these html documents simply by Fig. 9 (a) and (b), record and narrate example so omit it in the present invention.

Get back to Fig. 7,＜message〉label is recorded and narrated has message to send destination information D14.At＜message〉recorded and narrated message structure information D 15 in the label.In the present embodiment, should＜message〉label is the basic format of message.

In illustrated embodiment,＜message〉label records and narrates the e-mail address that AV content related service generator 15 is arranged, and this e-mail address sends destination D14 as message.In addition, at＜message〉recorded and narrated＜channel in the label label,＜change label,＜gps label and＜email label.In these labels, recorded and narrated the information when generating message.In addition, these labels become the data identification information of identifying information (data) kind.

At＜channel〉recorded and narrated the channel information of expression TV program channel in the label, at＜change〉recorded and narrated information switching time that expression switches to the time of searching screen in the label.Above-mentioned channel information and switching time information become AV data identification information D 18.

In addition, at＜gps〉recorded and narrated the latitude longitude information of the current position of portable telephone terminal 14 in the label.At＜email〉record and narrate message sender information with e-mail address in the label.

As mentioned above, when the sub-content stores portion 21 of AV content generation device 11 has stored when not having particular message to send the sub-content of destination, message sends destination information D14 becomes " sendto=' [address] ' ".Then, in the sub-content that does not have particular message transmission destination, write message by AV content generating unit 22 and send the destination, make it become sub-content D12 shown in Figure 7.

Figure 11 represents the structure of the message that the message generating unit 55 of portable telephone terminal 14 is generated and an example of this message.As shown in the figure, channel information and switching time information as AV content particular data (AV data identification information) D18, wherein, channel information is recorded and narrated at＜channel〉in the label, switching time information recorded and narrated at＜change in the label.Recorded and narrated at＜gps as the latitude longitude information of input content in addition, in the label.Recorded and narrated at＜email as the message sender information of terminal use's personal information in the label.

Figure 12 represents the processing action that portable telephone terminal 14 is carried out.As shown in the figure, at first, AV content acceptance division 44 1 receives AV content (S20), and control part 40 is included in the AV data (S21) in the AV content with regard to resetting.

Then, control part 40 judges whether the user has asked image switching (S22).When the user does not ask image switching (S22 is " deny "), the above-mentioned repeatedly action of step S21 returned.On the other hand, when the user asks image switching (S22 is " be "), the switching time (S23) of control part 40 record pictures, be presented at the searching screen (S24) in the sub-content, the input of accepted user (S25).

Then, control part 40 judges whether the user has asked image switching (S26).When the user does not ask image switching (S26 is " deny "), the above-mentioned repeatedly action of step S21 returned.On the other hand, when the user asks image switching (S26 is " be "), control part 40 judges whether the user asks to send message (S26a).

When the user does not ask to send message (S26a is " deny "), the above-mentioned repeatedly action of step S25 returned.On the other hand, when the user asks to send message (S26a is " be "), control part 40 is write the input (S27) of access customer with the basic format of message, and writes terminal set information and latitude longitude information (S28), generates message afterwards and sends the message (S29) that generates.Then, return the above-mentioned repeatedly action of step S21.

Figure 49 represents the processing action that AV content related service generator 15 is done.Before the processing action of carrying out as shown in the figure, the programme information acceptance division 60 of AV content related service generator 15 need receive in advance from the AV content synthetic/programme information that dispensing device 12 sends out and it is stored in the programme information storage part 67.

As shown in figure 49, at first, message sink portion 61 receives the message (T20) that is generated by portable telephone terminal 14 by communication network 16, and message parse portion 62 resolves above-mentioned message and obtains channel information and picture information switching time (T21).Then, channel information judging part 63 comes CM is carried out specific (T22) according to above-mentioned channel information, picture information switching time and the programme information that is stored in the channel information storage part 67.Then, input contents (T23) such as input content stores portion 64 channel information that storage is obtained by message parse portion 62 in database and picture information switching time, wherein, this database and programme information judging part 63 specific CM corresponding.

Then, acknowledgement messaging portion 66 generates the CM corresponding response message (T24) specific with programme information judging part 63, and the response message (T25) that has generated to portable telephone terminal 14 transmissions of the transmit leg of message by communication network 16.For example under the situation of convenience store " NINE FIVE ", as mentioned above, the information that Searches Shops sends its result as response message.Then, finish the processing action of AV content related service generator 15.

(execution mode 2)

Below, with reference to Figure 14～Figure 24, Figure 50 and Figure 51 another embodiment of the present invention is described.Figure 14 represents the schematic configuration of the bi-directional service system of present embodiment.The bi-directional service system 70 of present embodiment provides a kind of can answering a questionnaire when the user sees TV programme to participate in the service of prize drawing.In addition, give identical symbol to structure identical with the processing action and processing action, and omit its explanation with the structure that has illustrated in the above-described embodiment.

As shown in figure 14, the structure of bi-directional service system 70 is by communication network 16, connects AV content generations/dispensing device 72, a plurality of AV content reproduction apparatus 74,77, AV content related service generator 75 and structure that formation can be communicated by letter.In addition, AV content reproduction apparatus 74 has the function that receives the AV content and reset from AV content generation/dispensing device 72 by relay station 13.

In the present embodiment, with the AV content generation device 11 shown in Fig. 1 and AV content synthetic/dispensing device 12 is transformed into 1 AV content generation/dispensing device 72.In addition, in the present embodiment, AV content generation/dispensing device 72, AV content related service generator 75 and relay station 13 own for the broadcasting dealer, and AV content reproduction apparatus 74,77 owns for looking the hearer.In example as shown in the figure, the dealer receives and the AV content reproduction apparatus 74 of playback AV content is the TV broadcasting receiver from broadcasting.

AV content generation/dispensing device 72 generates and includes the AV content of program with AV data and sub-content, and the AV content that has generated by relay station 13 broadcasting in the preset time section.

In the present embodiment, the AV data are flow datas that the data that receive from the broadcasting dealer are reset in real time.In addition, sub-content comprises: to the display frame of picture configuration carry out appointment picture configuration specific data, recorded and narrated the questionnaire content the questionnaire data, answer transmission destination data that message structure when sending as message and expression send the destination, the AV data carried out specific data with questionnaire.

Thus, AV content reproduction apparatus 74 1 receives the AV contents, just disposes according to appointed display frame to show based on the TV program video of AV data with based on the questionnaire content of questionnaire data.

At this moment, audiovisual user (user of AV content player 74) imports and presses transmission key on the picture at the content of questionnaire, and AV content reproduction apparatus 74 generates message according to the data of expression message structure.This message comprises: the information of audiovisual user input, be set in the personal information (for example address, name etc.) of AV content reproduction apparatus 74 and to be used for certain picture in the TV program is carried out information specific be program ID and scene ID in advance.And AV content reproduction apparatus 74 sends the message of generation according to the data of the transmission destination (being AV content related service generator 75 in illustrated embodiment) of expression message.

Thus, the broadcasting dealer who has AV content generation/dispensing device 72 and an AV content related service generator 75 can collect from the audiovisual user soon in TV program projection or after the projection questionnaire of TV program is answered.

In addition, owing in the sub-content of the AV content that AV content generation/dispensing device 72 is generated, include with AV content related service generator 75 as the transmission destination data that sends the destination, so the broadcasting dealer can use the message of desirable device reception from AV content reproduction apparatus 74.Its result, the broadcasting dealer not only can directly collect the reaction of audiovisual user to program, and can directly provide various services to the audiovisual user according to the content of message.

In addition, because the user of AV content reproduction apparatus 74 need not to import the transmission destination of message,, can also prevent the message misinformation that causes by the input error so can not only save the trouble of input.

In the bi-directional service system 70 of present embodiment, AV content reproduction apparatus 74 can also send the sub-content that is included in the AV content to other AV content reproduction apparatus 77 by communication network 16.As mentioned above, in sub-content, comprise the AV data are carried out specific data (program ID).

Therefore, the AV content reproduction apparatus 77 that the has received sub-content sub-content of can only resetting.When AV content reproduction apparatus 77 had the function that receives AV data and playback, AV content reproduction apparatus 77 can be according to above-mentioned sub-content playback AV data.In addition, in example as shown in figure 14, AV content reproduction apparatus 77 is portable telephone terminals.

Below describe each structure in the bi-directional service system 70 of present embodiment in detail.

Figure 15 represents the schematic configuration of AV content generation/dispensing device 72.As mentioned above, AV content generation device 72 generates the AV content and broadcasts the AV content that has generated by relay station 13 in the preset time section, wherein, this AV content includes the program that is used for being reset as the video and the audio frequency of TV program AV data and this program incidental sub-content of AV data.As shown in the figure, AV content generation/dispensing device 72 comprises AV data store 80, sub-content stores portion 81, program/scene ID configuration part 82, AV content generating unit 83, timing portion 84, AV content sending part 85 and ID sending part 86.

AV data store 80 stored broadcast dealers 1 or a plurality of program AV data of making in advance.In addition, the sub-content stores 81 stored broadcast dealers of portion make in advance, attach in program each seed content with the AV data.AV data store 80 and sub-content stores portion 81 are made of for example HDD storage devices such as (hard disk drives).Details about sub-content will be in aftermentioned.

Program/scene ID configuration part 82 is set and is used for program is carried out specific program ID and is used for scene in the program is carried out specific scene ID.Program/scene ID configuration part 82 sends program ID and the scene ID that is set to AV content generating unit 83 and ID sending part 86.ID sending part 86 sends from program ID and scene ID that program/scene ID configuration part 82 receives to AV content related service generator 75.

Figure 18 represents the example of program ID and scene ID.As shown in the figure, put down in writing the programm name and the program ID of the program that 3 channels are broadcasted in section (19 point～21 point) sometime, and the scene title and the scene ID that have put down in writing the scene of being broadcasted in a certain program.In illustrated example,, be used in combination the abbreviation of the Gregorian calendar, the moon, day and programm name as program ID.On the other hand, scene ID has used the abbreviation of scene title.

In addition, above-mentioned program ID has the possibility identical with the program ID of other channel.But, in this case, because the transmission destination of the message corresponding with the program of other channel is other broadcasting dealer, so, think that it brings the possibility of influence lower to providing of bi-directional service.

Below get back to Figure 15, AV content generating unit 83 is taken out desired program AV data from AV data store 80, and from sub-content stores portion 81 take out to should program with the sub-content of AV data, generate and comprise the AV content that program is used AV data and sub-content.In addition, append in the sub-content of AV content generating unit 83 in the AV content from program ID and scene ID that program/scene ID configuration part 82 receives.AV content generating unit 83 sends the AV content that has generated to AV content sending part 85.Program/scene ID configuration part 82 and AV content generating unit 83 are to carry out to be stored in such as the program in the storage devices such as RAM or flash memory by CPU to realize.

The 84 metering times of timing portion, and send the temporal information of being measured to AV content sending part 85.AV content sending part 85 sends the AV content that receives from AV content generating unit 83 according to the temporal information that receives from timing portion 84 to relay station 13.Thus, the AV content is broadcasted by relay station 13.

Figure 16 represents the schematic configuration of AV content reproduction apparatus 74,77.The AV content reproduction apparatus 74,77 of present embodiment and portable telephone terminal 14 shown in Figure 4, other structure is identical except following difference, that is: the concrete structure difference in the control part 90; Omitted positional information obtaining section 46; Appended AV content stores portion 91.Here, give identical symbol to having, and omit its explanation with the identical structure of structure that above-mentioned execution mode has illustrated.

The AV content that 91 storages of AV content stores portion receive from AV content generation/dispensing device 72.AV content stores portion 91 is made of mass storage devices such as HDD, DVD (Digital Versatile Disk) drivers.

Below describe control part 90 in detail.Control part 90 in the present embodiment compares to the control part 40 of portable telephone terminal shown in Figure 4 14, and other structure is identical except following difference, that is: the structure difference of AV Context resolution portion 92; Omitted response message obtaining section 56; Sub-content transfering department 93 and sub-content obtaining section 94 have been appended.In addition, give identical symbol to having, and omit its explanation with the identical structure of structure that above-mentioned execution mode has illustrated.

AV Context resolution portion 92 resolves the AV content, and this AV content obtains from AV content generation/dispensing device 72 by relay station 13 and AV content acceptance division 44.Specifically, AV Context resolution portion 92 identifies the AV data and sends to playback portion 54 from the AV content that obtains.In addition, AV Context resolution portion 92 recognin content and resolve this sub-content from the AV content that has obtained is sent various indications according to analysis result to browser portion 51, picture configuration instruction unit 52 and timing control part 53.

In addition, AV Context resolution portion 92 sends the sub-content of identification to sub-content transfering department 93.In addition, AV Context resolution portion 92 obtains sub-content and resolves from sub-content obtaining section 94, judges whether to utilize appointed AV data in this sub-content, is to judge whether these AV data are stored in the AV content stores portion 91 specifically.When these AV data are stored, AV Context resolution portion 92 reads out this AV data from AV content stores portion 91, in the same manner above-mentioned AV data are sent to playback portion 54 with the AV content that obtains from AV content generation/dispensing device 72, and send various indications to browser portion 51, picture configuration instruction unit 52 and timing control part 53 according to the analysis result of sub-content.

Sub-content transfering department 93 sends the sub-content that receives from AV Context resolution portion 92 by Department of Communication Force 45 and communication network 16 to other AV content reproduction apparatus.In addition, sub-content obtaining section 94 obtains sub-content by communication network 16 and Department of Communication Force 45 from other AV content reproduction apparatus, and the sub-content that obtains to 92 transmissions of AV Context resolution portion.

Figure 17 represents the summary structure of AV content related service generator 75.The AV content related service generator 75 of present embodiment compares to AV content related service generator 16 shown in Figure 5, other structure is identical except following difference, ID acceptance division 95 is set to replace programme information acceptance division 60 and programme information judging part 63 that is:; Message parse portion 96 is different with the structure of input content stores portion 97; Store information storage part 65 and acknowledgement messaging portion 66 have been saved.In addition, give identical symbol to having, and omit its explanation with the identical structure of structure that above-mentioned execution mode has illustrated.

ID acceptance division 95 receives program ID and the scene ID that AV content generation/dispensing device 72 generates.ID acceptance division 95 is stored to input content stores portion 97 with program ID and the scene ID that receives.

Message parse portion 96 resolves the message that receives from message sink portion 61, and sends the various information that are included in the message to input content stores portion 97.Above-mentioned various information specifically has program ID and scene ID, audiovisual user's input information and terminal set information.

Input content stores portion 97 stores program ID and the scene ID that receives from ID acceptance division 95, and the various information that receive from message parse portion 96.Thus, the broadcasting dealer can to understand the message that receives from AV content reproduction apparatus 74 be questionnaire for which scene that when is broadcasted.

Figure 19 represents the example of sub-content D22.Figure 21 (a) and (b) expression based on the shown display frame of above-mentioned sub-content D22.Because the data structure of sub-content D22 is identical with the data structure of sub-content D12 shown in Figure 6, so omit its explanation herein.In addition, in the illustrated case, sub-content D22 and sub-content D12 shown in Figure 7 use the XML form to record and narrate in the same manner, also can use the combination of any record form such as HTML form, XHTML form, SMIL form or above-mentioned each form to record and narrate.In addition, record example shown in Figure 19 is to be used to illustrate simple record of the present invention.

Present embodiment＜layout record and narrate in the label picture configuration appointed information D23 arranged.In the example shown in Figure 19 and Figure 21 (a) and Figure 21 (b), the picture of wide 640 pixels * high 480 pixels (VGA:Video Graphics Array) is divided into the big zone, top of fabric width 580 pixels * height 435 pixels and the zonule, bottom of fabric width 640 pixels * height 45 pixels.

In addition, the picture of fabric width 640 pixels * height 480 pixels is divided into and highly is the upper area of 240 pixels and highly is the lower area of 240 pixels.Then, the top left region and the right side that on the left of upper area further is divided into are 320 pixels are the right regions of 320 pixels.Right regions further is divided into highly to be the upper right top area of 140 pixels and highly to be the upper right bottom section of 100 pixels.In picture configuration appointed information D23, specify top left region, upper right top area, upper right bottom section and lower area.

In addition, at the 1st＜par〉record and narrate in the label the 1st displaying contents appointed information D27a is arranged.In the example shown in Figure 19 and Figure 21 (a), in big zone, top, show video based on the AV data, in the zonule, bottom, show the content of html document " onepoint.html ".In addition, the 1st＜par〉in the label designated 60 seconds demonstration time (dur=" 60s ").

At the 2nd＜par〉record and narrate the 2nd displaying contents appointed information D27b in the label.Based on the demonstration of the 2nd displaying contents appointed information D27b is that demonstration (60 seconds) at the 1st displaying contents appointed information D27a is implemented afterwards.In the example shown in Figure 19 and Figure 21 (b), at the video of top left region demonstration based on the AV data, in the content of upper right top area demonstration based on html document " summary.html ", in the content of upper right bottom section demonstration, in the content of lower area demonstration based on html document " enquete.html " based on html document " uranai.html ".

In addition, above-mentioned html document " summary.html ", " enquete.html " are comprised among the sub-content D22.On the other hand, in html document " uranai.html ", recorded and narrated URL.Therefore, AV content reproduction apparatus 74 is obtained html document " uranai.html " from the outside by communication network 16.

Figure 20 represents an example of above-mentioned html document " enquete.html ".As shown in the figure, record has questionnaire content and action when selecting " questionnaire transmission " key and the action when selecting " notifying friend " key in " enquete.html ".When selecting " questionnaire transmission " key, generate message.On the other hand, when selecting " notifying friend " key, sub-content is passed on.

Below get back to Figure 19,＜message〉label is recorded and narrated has message to send destination information D24.At＜message〉recorded and narrated message structure information D 25 in the label.In the present embodiment, should＜message label becomes the basic format of message.

In example as shown in the figure,＜message〉label records and narrates the e-mail address that AV content related service generator 75 is arranged, and this e-mail address sends destination information D24 as message.In addition, at＜message〉record and narrate in the label have＜program label,＜scene label,＜input label,＜name label,＜address label and＜tvid label.

At＜program〉recorded and narrated in the label TV program has been carried out specific program ID, at＜scene〉recorded and narrated in the label scene is carried out specific scene ID.These labels are recorded and narrated in advance at sub-content D22.

In addition, at＜input〉recorded and narrated the questionnaire content of audiovisual user input in the label, at＜name〉recorded and narrated audiovisual user's name in the label, at＜address〉recorded and narrated audiovisual user's address in the label, and at＜tvid the terminal (being AV content reproduction apparatus 74,77 in the present embodiment) recorded and narrated the audiovisual user in the label carries out specific Termination ID.In addition, answer a questionnaire and press record＜input behind " giving to curly hair " key the audiovisual user information in the label.In addition, record＜name when generating message〉label,＜address label and＜tvid information in the label.

Figure 22 represents the structure of the message that the message generating unit 55 of AV content reproduction apparatus 74 generates and an example of this message.As shown in the figure, as AV content particular data D28, program ID is recorded and narrated at＜program〉in the label, scene ID is recorded and narrated at＜scene〉in the label.Recorded and narrated at＜input as the questionnaire content of input content in addition, in the label.Audiovisual user's name and audiovisual user's address uses user's personal information, audiovisual user's name to be recorded and narrated at＜name as terminal〉in the label, audiovisual user's address is recorded and narrated at＜address〉in the label.Termination ID is recorded and narrated at＜tvid〉in the label.

In this example, the situation of utilizing MMS (Multimedia Messaging Service) source template is described with reference to Figure 50 and Figure 51 as the record of sub-content.

Figure 50 is illustrated in the structure of the sub-content when utilizing above-mentioned MMS source template.As shown in the figure, the MMS source template is made of source template and target medium.The structure that source template forms comprises: the metadata of source templates such as the title of template or explanation itself, be used for the data of heading messages such as decision message transmission destination or exercise question, about the data of the generation method of message.

Figure 51 represents the example that above-mentioned source template is recorded and narrated.In example as shown in the figure, the metadata of source template itself is recorded and narrated at＜head〉in the label.In addition, the data that are used for the information of decision message title are recorded and narrated at＜message〉in the label.In this label, the transmission destination of message is recorded and narrated at＜to-header〉in the label.And then the method that is used to generate message is specified in＜wizard〉in the label, in this label, the method for displacement target medium is specified in＜step〉in the label.

By source template represented in Figure 51, AV content player 74 can be replaced target medium, and the MMS source template that will contain the target medium of having replaced and above-mentioned source template sends to AV content related service generator 75 and other device as message.Promptly, AV content reproduction apparatus 74 can be with the text data that is transfused to as " enquete.txt " file, original target medium is replaced into above-mentioned " enquete.txt " file, and the MMS source template that will include later " enquete.txt " file of displacement sends to " [email protected] " as message.

Figure 23 represents the processing action that AV content reproduction apparatus 74,77 is carried out.As shown in the figure, at first, control part 90 judges whether to selecting channel to receive situation about broadcasting, the situation (S30) of perhaps whether attaching most importance to and putting the sub-content of being passed on.

Under the situation of selecting channel, content acceptance division 44 receives AV content (S31), and AV Context resolution portion 92 resolves AV content (S32), and carries out the picture configuration of AV content and show (S33) according to analysis result.

Then, control part 90 judges whether to receive next sub-content (S34).Under situation about having received (is "Yes" at S34), return the above-mentioned repeatedly action of step S32.On the other hand, do not having to carry out the generation and the transmission (S35) of message under the situation about receiving (is "No" at S34).Then, return the above-mentioned repeatedly action of step S34.In addition, will be about the processing action of the generation of detailed message and transmission in aftermentioned.

On the other hand, under the situation of sub-content of resetting, control part 90 reads in sub-content (S36), from the AV data (S37) of the corresponding sub-content of AV content stores portion 91 search, carries out the picture configuration and shows (S38) including the AV data that found and the AV content of above-mentioned sub-content.Then carry out the generation and the transmission (S39) of message, end process action then.

Figure 24 represents the generation of message and the processing running (S35, S39) of transmission.As shown in the figure, the at first input (S40) of control part 90 accepted users.Then, control part 40 judges whether the user asks to send message (S40a).

Do not ask to send the user under the situation of message (S40a is a "No"), return the above-mentioned repeatedly action of step S40.On the other hand, ask to send the user under the situation of message (S40a is a "Yes"), write the input (S41) of access customer, write terminal set information (S42), generate message and send message (S43) after generating with the basic format of message.Afterwards, return the customary step of former processing.

In addition, in the present embodiment,, also can receive the AV data consistent from AV content acceptance division 44 with the program ID the in progress program from the AV content stores portion 91 search AV data corresponding with sub-content.In this case, AV content reproduction apparatus 74 need be obtained the program ID and the scene ID of AV data by some method.As this method, can enumerate the method that for example AV content generation/dispensing device 72 transmissions include the AV data of program ID and scene ID, perhaps send the method for program ID and scene ID from the ID sending part 86 of AV content generation/dispensing device 72 to AV content reproduction apparatus 77 by communication network 16.

In addition, in the present embodiment, 77 pairs of sub-contents of being passed on from AV content reproduction apparatus 74 of AV content reproduction apparatus are reset, but since different with the screen resolution of AV content reproduction apparatus 74, so might show with the display size of sub-content appointment.In this case, AV content reproduction apparatus 77 is kept anyhow ratio and is dwindled demonstration, only shows that perhaps the sub-content of a part gets final product.

In addition, in above-mentioned steps S37, the search AV data corresponding in AV content stores portion 91 with sub-content, but qualified AV data conditions also may occur can not find or can't utilize this AV data conditions because of some reason.In this case, can not carry out demonstration, perhaps show and to utilize the information of AV data, and only show sub-content in the zone that the AV data should be shown based on the AV data.

In addition, in the present embodiment, AV data and sub-content that AV content generation/dispensing device 72 sends as the AV content to AV content reproduction apparatus 74 by identical broadcast wave also can send to AV content reproduction apparatus 74 by different communication paths.

Figure 25 represents that the communication path that AV content generation/dispensing device 72 passes through separately sends the AV data of formation AV contents and the modified example of sub-content to AV content reproduction apparatus 74.In illustrated example, AV content generation/dispensing device 72 sends AV data with the form of broadcast wave to AV content reproduction apparatus 74 from base station 13, on the other hand, sends sub-content by communication network 16 to AV content player 74.

AV content reproduction apparatus 74 shown in Figure 25 compares to AV content reproduction apparatus 74 shown in Figure 16, and other structure is identical except following difference, that is: AV content acceptance division 44 receives the AV data; AV content stores portion 91 storage AV data; Sub-content obtaining section 94 obtains sub-content by communication network 16 and Department of Communication Force 45 from AV content generation/dispensing device 72.

According to said structure, because the AV data that are included in the AV content are sent out by different separately communication paths with sub-content, so the prior art of comparing to can alleviate the burden of communication path.In addition, in place or environment that a side communication path can't use, also can send AV data and sub-content by utilizing another communication path.

In addition, the timing that obtains sub-content of sub-content obtaining section 94 can be different from the time that AV content acceptance division 44 receives the AV data.In this case, then need to make the AV data and the sub-content that receive in different timing to carry out synchronously.Synchronous in order to carry out this, with step S36～S38 shown in Figure 23 in the same manner in AV content stores portion 91 the corresponding AV data of the obtained sub-content of search and sub-content obtaining section 94 get final product.Perhaps, when the sub-content that obtains in sub-content obtaining section 94 comprised program ID, the AV data that AV content acceptance division 44 received by the program shown in this program ID in the time period that this program is broadcasted got final product.

In addition, AV content generation/dispensing device 72 can not receive sub-requests for content from AV content reproduction apparatus 74 yet, but sends sub-content to AV content reproduction apparatus 74.In this case, because AV content reproduction apparatus 74 does not need to send sub-requests for content to AV content generation/dispensing device 72, so can not cause trouble to the user that utilizes of AV content reproduction apparatus 74.

In addition, utilize program ID and scene ID information D 28 in the present embodiment, also can utilize a part of video or audio frequency in the AV content as specific AV data.Utilizing under the situation of a part of video in the information D 28 of as shown in figure 19 specific AV data, utilization＜screen/〉label is illustrated in the video of a part that increases in the message.In addition, utilizing under the situation of a part of audio frequency in the information D 28 of specific AV data, utilization＜audio/〉label is illustrated in the audio frequency of the scheduled period that increases in the message.

In addition, under the situation of utilizing a part of video or audio frequency, make the bi-directional service system of present embodiment form following structure and get final product.That is, in AV content generation/dispensing device 72 as shown in figure 15, ID sending part 86 sends the AV content that obtains from AV content generating unit 83 to AV content related service generator 75 and replaces the program ID and the scene ID that obtain from program/scene ID configuration part 82.

In AV content reproduction apparatus 74 as shown in figure 16, playback portion 54 sends the video data of AV content at a time or from the voice data of the AV content of a certain scheduled period in the moment to message generating unit 55.Message generating unit 55 increases above-mentioned video data or voice data in the message that generates, and sends to AV content related service generator 75 by Department of Communication Force 45 and communication network 16.

In addition, in AV content related service generator 75 as shown in figure 17, ID acceptance division 95 receives the AV content from AV content generation/dispensing device 72, and sends the content that receives to message parse portion 96.Video data that message parse portion 96 will be increased in the message from AV content reproduction apparatus 74 and voice data are searched for the AV content that receives from ID acceptance division 95 as main points, and according to Search Results specific program and scene.Thus, can hold which scene of when broadcasting from the message correspondence of AV content reproduction apparatus 74 receptions.

In addition, in the present embodiment, AV content generation/dispensing device 72 also can be in different timing (asynchronous) above-mentioned AV data of broadcasting and sub-content in AV data and the sub-content of same fixed time broadcast as the AV content.

Figure 26 represents AV content generation/dispensing device 72 by same broadcast wave, constitutes the AV data of AV content and the modified example of sub-content with different timings from base station 13 broadcasting.In example as shown in the figure, AV content generation/dispensing device 72 promptly sends AV data and sub-content to AV content reproduction apparatus 74 as broadcast wave from base station 13 by identical communication path.On the other hand, AV content generation/dispensing device 72 sends AV data and sub-content with different timings to AV content reproduction apparatus 74.

AV content reproduction apparatus 74 shown in Figure 26 compares to as shown in figure 16 AV content reproduction apparatus 74, and other is all identical except following difference, that is: AV content acceptance division 44 receives AV data and sub-content in different timings; AV content stores portion 91 storage AV data or sub-contents.

In this modified example, AV data and sub-content synchronization that AV content reproduction apparatus 74 need make different timing receive.Synchronous in order to carry out this, the search AV data corresponding with the obtained sub-content of AV content acceptance division 44 (with reference to Figure 16) get final product in AV content stores portion 91.Perhaps, when including program ID in the sub-content that AV content obtaining section 44 obtains, the AV data that AV content acceptance division 44 received by the represented program of this program ID in the time period that this program is broadcasted get final product.

Sub-content is sent out with different timings with the AV data, which timed sending can carry out multiple choices as for.For example, making the timing of transmission of the transmission of sub-content and AV data not overlap gets final product.In this case, can save the broadcast band of AV data when broadcasting.

In addition, sub-content is included in EPG (electric program guide) data, sends earlier than AV data.In this case, when the user selects certain program with reference to EPG, AV content reproduction apparatus 74 will be reset to sub-content that should program, can make above-mentioned program and sub-content be associated thus.In addition, the various services such as bi-directional service that can provide sub-content to record and narrate in timing with the asynchronism(-nization) that content is provided.

As shown in figure 26, AV content generation/dispensing device 72 is when the sub-content of AV content reproduction apparatus 74 broadcasting, because AV content reproduction apparatus 74 does not need to send sub-requests for content to AV content generation/dispensing device 72, so can not cause trouble to the user that utilizes of AV content reproduction apparatus 74.

In addition, in the present embodiment, AV content reproduction apparatus 74 is irrelevant with the state of device own, carries out demonstration based on sub-content D22 shown in Figure 21 (a) and Figure 21 (b) suchly, but also can be according to this demonstration of Status Change of device itself.At this, as the state of AV content reproduction apparatus 74, for example can enumerate: date that AV content reproduction apparatus 74 sets or time, in advance import personal information, program or the channel of the use user in the AV content reproduction apparatus 74 the rating contract information, whether watched the purpose information etc. of celebrating a festival.The information of the state of AV content reproduction apparatus 74 is used as the terminal set information 47 of storage part 41 and stores.

Figure 27 represents the example according to the sub-content of the Status Change demonstration of AV content reproduction apparatus 74.Sub-content D22 as shown in the figure compares to as shown in figure 19 sub-content D22, and other is all identical except following difference, that is: in the 2nd displaying contents appointed information D27b, appended state according to AV content reproduction apparatus 74, indication switch sub-content displaying contents＜condition label.

At＜condition〉recorded and narrated the condition that the terminal set information 47 stored in the storage part 41 of AV content reproduction apparatus 74 should satisfy in the label, and at＜condition recorded and narrated practiced content when satisfying above-mentioned condition in the label.In example shown in Figure 27, recorded and narrated the condition whether the expression AV content reproduction apparatus 74 that the user utilized just carries out the rating contract of " all entreating TV station 1 ", when carrying out above-mentioned rating contract, show content at the lower area of display frame according to html document " enquete.html " (with reference to Figure 20), on the other hand, when not carrying out above-mentioned rating contract, show content according to html document " enquete_subscription.html " at the lower area of display frame.

Figure 28 represents an example of above-mentioned html document " enquete_subscription.html ".Html document as shown in the figure " enquete_subscription.html " compares to html document shown in Figure 20 " enquete.html ", and other is all identical except following difference, that is: urge the content of questionnaire to record and narrate different; Having recorded and narrated " request transmission data " key and its moves and replaces " notifying friend " key and its action.When " request transmission data " when key is selected, generates the message of data request.

Figure 29 is the display frame that shows according to the represented sub-content D22 of Figure 27, is that the user that utilizes of expression AV content reproduction apparatus 74 does not carry out display frame under the situation of above-mentioned rating contract.In this case, as shown in the figure, show " request transmission data " key etc. at the lower area of display frame.

Therefore, AV content reproduction apparatus 74 is obtained sub-content D22 as shown in figure 27, is just carrying out under the situation of above-mentioned rating contract, shows the display frame shown in Figure 21 (b); When not carrying out above-mentioned rating contract, show display frame as shown in figure 29.That is, change the displaying contents of sub-content according to the state of AV content reproduction apparatus 74.

The service of specialization can be provided to the user who utilizes AV content reproduction apparatus 74 thus.In addition, even when hope changes the displaying contents of sub-content according to the date, owing to need not to resend sub-content according to the different dates, so can send sub-content more efficiently.

In addition, as＜condition〉condition in the label, except as above-mentioned having or not the channel rating contract, can also exemplify out such as the age of whether having passed through the specific date, having utilized the user whether more than or equal to a dating, other various conditions such as the corresponding program of audiovisual whether.

In addition, in the present embodiment, message is Email, and the transmission destination of message is an e-mail address.As mentioned above, message also can be the request that occurs in WWW.In this case, the transmission destination of message is the URL among the WWW.

Figure 30 represents when the sub-content of message when being request among the WWW.Sub-content D22 as shown in the figure compares to sub-content D22 shown in Figure 19, sends the destination information D24 other all identical as message except the URL (http://tv.animals.com/enquete.cgi) with WWW replaces e-mail address.

(execution mode 3)

Followingly another embodiment of the present invention is described with reference to Figure 31～Figure 41.Figure 31 represents the schematic configuration of the bi-directional service system of present embodiment.This bi-directional service system 100 provide a kind of can be while seeing that TV programme utilizes portable telephone terminal to participate in the service of live intelligence test.In addition, give identical symbol to having structure identical with the processing action and processing action, and omit its explanation with the structure that has illustrated in the above-described embodiment.

As shown in figure 31, the structure of bi-directional service system 100 is: can connect AV content generation/dispensing device 102 and AV content related service generator 105 communicatedly, and make it possible to communicate by communication network 16 connection AV content generation/dispensing devices 102, AV content related service generator 105 and sub-content reproduction apparatus 107.In addition, AV content reproduction apparatus 104 has by the function of relay station 13 from 102 receptions of AV content generation/dispensing device and playback AV data.

In the present embodiment, AV content generation/dispensing device 102, AV content related service generator 105 and relay station 13 own for the broadcasting dealer, and AV data reproducing device 104 and sub-content reproduction apparatus 107 own for the audiovisual user.In example as shown in the figure, the dealer receives and the AV data reproducing device 104 of playback AV data is the TV broadcasting receiver from broadcasting, and the dealer receives and the sub-content reproduction apparatus 107 of the sub-content of resetting is portable telephone terminal from broadcasting.

In addition, present embodiment compares to bilateral system shown in Figure 14 and has following difference, that is, the transmit path of AV data is different from the transmit path of the incidental sub-content of AV data, and it is sent to AV data reproducing device 104 and sub-content reproduction apparatus 107 respectively.

AV content generation/dispensing device 102 passes through relay station 13 section broadcasting AV data at the fixed time, and sends sub-content at reasonable time to sub-content reproduction apparatus 107 by communication network 16.

AV data reproducing device 104 is identical with existing TV broadcasting receiver, has the function of playback AV data, but does not have the function that sends message.On the other hand, sub-content reproduction apparatus 107 is identical with existing portable telephone terminal, has the function that sends message, but does not have the function of playback AV data.In addition, sub-content reproduction apparatus 107 also has and can utilize infrared ray, electric wave etc. to carry out the remote operation function of remote operation AV data reproducing device 104.

In the present embodiment, the AV data are flow datas that the data that receive from the broadcasting dealer are reset in real time.In addition, sub-content comprises: to the display frame configuration of participating in picture carry out appointment picture configuration specific data, to participate in that content records and narrates participate in data, for the message structure when sending message and participate in send the transmission destination data represented the destination, the AV data are carried out specific data.

Thus, after sub-content reproduction apparatus 107 receives sub-content, show according to sub-content and to participate in picture, and utilize remote operation to AV data reproducing device 104 indication playback AV data.Thus, AV data reproducing device 104 receives the AV data, and shows the video of TV program according to the AV data that receive.Like this, can make based on the demonstration of sub-content and deliver to different devices with demonstration branch based on the AV data.

At this moment, after audiovisual user (user of AV data reproducing device 104 and sub-content reproduction apparatus 107) imported the transmission key of participating on content and the selection picture, 107 data according to the expression message structure of sub-content reproduction apparatus generated message.In this message, comprise that information that the audiovisual user imports, the information that is set at personal information in the sub-content reproduction apparatus 107 (for example telephone number etc.) and is used for a certain scene in the specific T V program in advance are channel ID and airtime.Then, sub-content reproduction apparatus 107 sends the message of generation according to the data of expression message transmission destination (being AV content related service generator 105 in the example of figure).

Thus, can utilize existing TV broadcasting receiver and existing portable telephone terminal to realize bi-directional service simply.That is, when the audiovisual user confirms video by TV broadcasting receiver (AV data reproducing device 104), and operation portable telephone terminal (sub-content reproduction apparatus 107), can realize bi-directional service thus.

In addition, AV data reproducing device 104 need not the to reset function of sub-content, on the other hand, sub-content reproduction apparatus 107 need not the to reset function of AV data.Therefore, can oversimplify the function of AV data reproducing device 104 and sub-content reproduction apparatus 107.In addition, the equipment of sub-content of can not resetting that can be by making up existing TV broadcasting receiver etc. and the equipment of the sub-content of only resetting utilize bi-directional service.

In addition, include in the sub-content of the AV content that AV content generation/dispensing device 102 is generated AV content related service generator 105 as the transmission destination data that sends the destination, so the broadcasting dealer can receive the message that sends out from sub-content reproduction apparatus 107 with desirable device.Its result, the broadcasting dealer can realize the program of audiovisual user participation type with live form.In addition, because the user of sub-content reproduction apparatus 107 need not to import the transmission destination of message, so, both can omit the trouble of input, can prevent again because the message misinformation that the input error causes.

Below describe each structure in the bi-directional service system 100 of present embodiment in detail.

Figure 32 represents the schematic configuration of AV content generation/dispensing device 102.As mentioned above, AV content generation/dispensing device 102 by relay station 13 at the fixed time in the section broadcasting be used for the program AV data of being reset as the video and the audio frequency of TV program, and send to sub-content reproduction apparatus 107 by communication network 16 simultaneously and attach the sub-content of using the AV data in above-mentioned program.

The AV content generation/dispensing device 102 of present embodiment compares to AV content generation/dispensing device 72 shown in Figure 15, other structure is all identical except following difference, that is: AV data sending part 112 is set replaces AV content generating unit 83 and AV content sending part 85; Sub-content sending part 110 newly is set; Programming information storage part 111 is set replaces program/scene ID configuration part 82; Programming information sending part 113 is set replaces ID sending part 86.In addition, give same symbol to having, and omit its explanation with the identical structure of structure of above-mentioned execution mode explanation.

Sub-content sending part 110 is according to the temporal information that receives from timing portion 84, reads sub-content and sends to sub-content reproduction apparatus 107 by communication network 16 from sub-content stores portion 81 in suitable timing.

Programming storage part 11 is for example stored the broadcasting time started and the off-the-air time of each program as EPG (Electronic Program Guide).Programming storage part 11 is made of the storage device of flash memory, HDD etc.

AV data sending part 112 reads desired program AV data from AV data store 80, and sends the program of reading AV data according to programming time period of reading from programming information storage part 111 and the temporal information that receives from timing portion 84.Thus, broadcast predetermined AV data at preset time through relay station 13.

Programming information sending part 113 reads programming information from programming storage part 111, and sends to AV content related service generator 105.

Figure 33 represents the schematic configuration of sub-content reproduction apparatus 107.Sub-content reproduction apparatus 107 in the present embodiment compares to AV content reproduction apparatus shown in Figure 16 74,77, and other structure is identical except following difference, that is: the structure difference in the control part 115; AV content acceptance division 44 and AV content stores portion 91 have been omitted; Appended infrared ray sending part 116.In addition, give identical symbol to having, and omit its explanation with the identical structure of structure of above-mentioned execution mode explanation.

The indication that infrared ray sending part 116 sends according to control part 115 sends the remote operation signal with infrared ray to AV data reproducing device 104.In addition, can also utilize electric wave to replace infrared ray, also can utilize wired operation instead of wireless operation.

Below describe control part 115 in detail.Control part 115 in the present embodiment compares to the control part 90 of AV content reproduction apparatus shown in Figure 16 74,77, and other structure is identical except following difference, that is: the structure difference of sub-content obtaining section 117; Timing control part 53, AV Context resolution portion 92 and sub-content transfering department 93 have been omitted; Appended AV data playback instruction unit 118.In addition, give identical symbol to having, and omit its explanation with the identical structure of structure of above-mentioned execution mode explanation.

Sub-content obtaining section 117 obtains sub-content by communication network 16 and Department of Communication Force 45 from AV content generation/dispensing device 102.In addition, sub-content obtaining section 117 is resolved the content of sub-content, and based on this analysis result browser portion 51 and picture configuration instruction unit 52 is sent various indications.And then sub-content obtaining section 117 sends the channel data that is comprised in the sub-content to AV playback instruction unit 118.

AV playback instruction unit 118 is according to the channel data of obtaining from sub-content obtaining section 117, and pass through infrared ray sending part 116 to the 104 transmission AV data playbacks indications of AV data reproducing device, wherein, this AV data playback indication is the indication of the AV data of this channel of indication playback.Thus, can be by the video and the audio frequency of the specified channel of the AV replay device 104 sub-contents of output.

Figure 34 represents the schematic configuration of AV data reproducing device 104.As shown in the figure, AV data reproducing device 104 comprises AV data reception portion 120, infrared ray acceptance division 121 and AV data playback portion 122.

AV data reception portion 120 receives the AV data from AV content generation/dispensing device 102.AV data reception portion 120 sends the AV data that receive to AV data playback portion 122.Infrared ray acceptance division 121 utilizes infrared ray to receive the indication of AV data playback from sub-content reproduction apparatus 107.Infrared ray acceptance division 121 sends the AV data playback indication that has received to AV data playback portion 122.

AV data playback portion 122 obtains AV data playback indication by infrared ray acceptance division 121 from sub-content reproduction apparatus 107, indicates according to this AV data playback and selects channel, and obtain and the AV data of the selected channel of resetting from AV data reception portion 120.

Figure 35 represents the schematic configuration of AV content related service generator 105.The AV content related service generator 105 of present embodiment compares to AV content related service generator 15 shown in Figure 5, and other structure is all identical except following difference, has omitted store information storage part 65 and acknowledgement messaging portion 66 that is:.In addition, give identical symbol to having, and omit its explanation with the identical structure of structure of above-mentioned execution mode explanation.

Figure 36 represents the example of sub-content D32.Figure 38 represents the shown display frame based on above-mentioned sub-content D32.Because the data structure of sub-content D32 is identical with the data structure of sub-content D12 shown in Figure 6, so omit its explanation.In addition, under situation as shown in the figure, sub-content D32 and sub-content D12 shown in Figure 7 use the XML form to record and narrate in the same manner, but also can use the combination of any record form such as HTML form, XHTML form, SMIL form or above-mentioned each form to record and narrate.In addition, record example shown in Figure 36 is to be used to illustrate simple record of the present invention.

In the present embodiment, at＜layout〉recorded and narrated picture configuration appointed information D36 in the label.In Figure 36 and example shown in Figure 38, having specified the full viewing area and the fabric width of fabric width 640 pixels * height 480 pixels (VGA:Video Graphics Array) is the right side area of 320 pixels.

In addition, at＜par〉recorded and narrated displaying contents appointed information D37 in the label.In Figure 36 and example shown in Figure 38, show video in the full viewing area of picture, and show overlappingly with this based on the AV data, show the content of html document " info.html " in the right side area of picture.In addition, above-mentioned html document " info.html " is comprised among the sub-content D32.

In addition, in the present embodiment, AV data reproducing device 104 does not have the function of the sub-content of resetting, so show video based on the AV data in the full viewing area of picture according to displaying contents appointed information D37.Sub-content reproduction apparatus 107 does not have the function of playback AV data, so carry out the demonstration based on html document " info.html " according to displaying contents appointed information D37 in the right side area (the full viewing area of portable telephone terminal) of picture.

Figure 37 represents an example of above-mentioned html document " info.html ".Action when as shown in the figure, in " info.html ", recording and narrating input request that password is arranged and selection and " participate in " key.When selecting " participating in " key, generate message, and the message of this generation is sent to AV content related service generator 105.

Get back to Figure 36 below,＜message〉label is recorded and narrated has message to send destination information D34.At＜message〉recorded and narrated message structure information D 35 in the label.In the present embodiment, should＜message label is the basic format of message.

In example as shown in the figure,＜message〉label records and narrates the e-mail address that AV content related service generator 105 is arranged, and this e-mail address sends destination information D34 as message.In addition, at＜message〉record and narrate in the label have＜channel label,＜current label,＜input label,＜name label,＜tel label and＜tvid label.

Because＜channel〉label is identical with label shown in Figure 7, so omit its explanation.In addition,＜input〉label,＜name label and＜tvid label is identical with the described label of Figure 19, so omit its explanation.With shown in Figure 7 different being: at＜channel〉information in the label is the information that AV content generation/dispensing device 102 has been recorded and narrated in advance.

At＜current〉record and narrate the present temporal information that the present time of expression is arranged in the label.In addition, at＜tel〉record and narrate the telephone number that sub-content reproduction apparatus 107 (portable telephone terminal) is arranged in the label.Record＜tel when generating message〉information in the label.

Figure 39 represents the structure of the message that the message generating unit 55 of sub-content reproduction apparatus 107 is generated and an example of this message.As shown in the figure, channel information and present temporal information be as AV content particular data D38, and wherein, channel information is recorded and narrated at＜channel〉in the label; Present temporal information is recorded and narrated at＜current〉in the label.Recorded and narrated at＜input as the password of input content in addition, in the label.Audiovisual user's name and audiovisual user's telephone number are used user's personal information as terminal, and wherein, audiovisual user's name is recorded and narrated at＜name〉in the label; The audiovisual user's telephone number is recorded and narrated at＜tel〉in the label.In addition, Termination ID is recorded and narrated at＜tvid〉in the label.

Figure 40 represents the processing action that sub-content reproduction apparatus 107 carries out.As shown in the figure, at first, control part 115 receives sub-content (S50) from AV content generation/dispensing device 102, and resolve sub-content, carry out the picture configuration of sub-content and show (S51) according to this analysis result afterwards, and send AV data playback order (indication) to AV data reproducing device 104, reset and recorded and narrated the AV data (S52) of the channel in sub-content.

Then, the input (S53) of control part 115 accepted users writes (S54) with user's input (password) with the basic format of message, writes terminal set information (S55), generates message and sends the message (S56) that generates.Afterwards, end process.

Figure 41 represents the processing action that AV data reproducing device 104 carries out.As shown in the figure, at first, 104 standbies of AV data reproducing device are until receiving the AV data playback order (S60) of sending from sub-content reproduction apparatus 107, receive the order of AV data playback after AV data reproducing device 104 receive AV data (S61), carry out the playback (S62) of AV data.Reset after the end, end process is moved.

(execution mode 4)

Followingly another embodiment of the present invention is described with reference to Figure 42～Figure 45.Figure 42 represents the schematic configuration of the bi-directional service system of present embodiment.This bi-directional service system 120 provides a kind of service that can obtain information when the user uses portable phone to watch the video clips of TV play (video clip), and this information is about the information of user to the suggestion of program.In addition, to have with above-mentioned execution mode in the structure that the illustrates structure identical and handle to move and give identical symbol with handling action, and omit its explanation.

As shown in figure 42, the structure of bi-directional service system 120 is: connect AV content generation/dispensing device 123, AV content reproduction apparatus 124 and AV content related service generator 125 by communication network 16, make it possible to communicate.Different from the embodiment described above, the AV content generation/dispensing device 123 of present embodiment sends the AV content by communication network 16 to AV content reproduction apparatus 124.

In the present embodiment, AV content generation/dispensing device 123 owns for the programmer, and AV data reproducing device 124 owns for the audiovisual user.In example as shown in the figure, AV content reproduction apparatus 124 is a portable telephone terminal.

AV content generation/dispensing device 123 generates the AV content, and should send the AV content from the requirement of AV content reproduction apparatus 124.

In the present embodiment, the AV data are playback video clips from programmer's received data.In addition, sub-content comprises: picture configuration specific data, and it is used to specify the display frame configuration, and this display frame configuration is used for switching the key frame and the inquiry picture of display video; Send destination data, its expression is from structure and the transmission destination of AV content reproduction apparatus 124 to the message of AV content related service generator 125 transmissions; And the data of specific AV data.

In the present embodiment, after AV content reproduction apparatus 124 receives the AV content from AV content generation/dispensing device 123, dispose a wherein side who resets demonstration key frame or inquiry picture based on appointed display frame, switch to the opposing party's picture afterwards according to user's operation.

At this moment, when audiovisual user (user of AV content reproduction apparatus 124) presses the inquiry key of inquiring on the picture, AV content reproduction apparatus 124 will generate message according to the data of the structure of representing message.The information that in this message, includes personal information (for example address, name etc.), addresses of items of mail and the specific program in AV content reproduction apparatus 124, set in advance.In the present embodiment, be identifier (for example filename) with the AV data and the elapsed time after the beginning of resetting information as specific program.Then, AV content reproduction apparatus 124 selects the specified a plurality of message of quilt contents to send some in the destination, sends message to selecteed transmission destination.

AV content related service generator 125 comes stored information according to the message that receives from AV content reproduction apparatus 124.

Therefore, though in the AV content not by broadcasting but under the situation about sending, also can utilize bi-directional service based on sub-content by communication.

In addition, include in the sub-content of the AV content that AV content generation/dispensing device 123 is generated AV content related service generator 125 as a plurality of transmission destination datas that send the destination, selection based on the user of AV content reproduction apparatus 124, message is sent to a certain transmission destination, so the programmer can receive the message that sub-content reproduction apparatus 107 sends with each desirable device.In addition,, do not need the transmission destination of input information because the user of AV content reproduction apparatus 124 only need select the transmission destination of message to get final product, so, not only having omitted the trouble of input, can also prevent because the information misinformation that the input error causes.

Figure 43 represents the example of sub-content D42.In addition, the picture configuration appointed information D46 that comprises among the sub-content D42 and the displaying contents appointed information D47a of key frame, it is identical with the displaying contents formulation information D 17a that information D 16 and key frame are formulated in picture configuration shown in Figure 7, so, omit its explanation.Under situation as shown in the figure, sub-content D42 is to use the XML form to record and narrate, but also can use the HTML form, the combination of any record form such as XHTML form, SMIL form or above-mentioned each form records and narrates.In addition, record example shown in Figure 43 is to be used to illustrate simple record of the present invention.

Inquiring the region-wide of picture, show content based on html document " query.html ".Figure 44 represents an example of above-mentioned html document " query.html ".Figure 45 (b) expression is based on an example of the shown key frame of the displaying contents appointed information D47b of inquiry picture.As shown in the figure, show on the inquiry picture: key " transmission " that the selection of the key element of picture, the input of inquiry, transmission are inquired and the key that switches to key frame " return ".In the present embodiment, change the transmission destination of message accordingly with above-mentioned selection.In addition, above-mentioned html document " query.html " is comprised among the sub-content D42.

Below get back to Figure 43,＜message〉label is recorded and narrated has message to send destination information D44.At＜message〉recorded and narrated message structure information D 45 in the label.In the present embodiment, should＜message label is the basic format of message.In addition, when generating message, record and narrate message and send destination information D44 according to above-mentioned selection.

In example as shown in the figure, at＜message〉record and narrate in the label and have:＜video〉label,＜elapsed label,＜email label and＜input label.In addition,＜and video〉label beyond the label is by record information when generating message.

At＜video〉in the label, record and narrate in advance that the identifier of video clips is arranged is filename.At＜elapsed〉record and narrate in the label and have from reset elapsed time information after the beginning of video clips.Above-mentioned filename and elapsed time information become the information D 48 of specific AV data.

In addition, at＜email〉there is the message of recording and narrating with e-mail address to send ground information in the label.At＜input〉the inquiry content of recording and narrating with text data is arranged in the label.When inquiry was not transfused to, recording and narrating was " answer ".

(execution mode 5)

Another embodiment of the present invention below is described.Compare to Fig. 1～bi-directional service system 10 shown in Figure 13, the service that the AV content related service generator of the bi-directional service system of present embodiment can provide the transmission destination according to message is carried out specific.In addition, give identical symbol to having the structure identical with handling action with handling to move, and omit its explanation with the structure of explanation in the above-described embodiment.

Under these circumstances, AV content related service generator 15 can come specific CM (AV content) by the transmission ground of message, so there is no need to utilize programme information for specific CM.Therefore, the AV content shown in Fig. 1 synthetic/dispensing device 12 can omit the programme information that sends to AV content related service generator 15.Thus, AV content shown in Figure 3 synthetic/dispensing device 12 can omit programme information generating unit 35 and programme information sending part 36.In addition, AV content related service generator 15 shown in Figure 5 can omit programme information acceptance division 60, programme information judging part 63 and programme information storage part 67.

Its result, the bi-directional service system of present embodiment compare to that Fig. 1～bi-directional service system 10 shown in Figure 13 can simplified structure.

The present invention is not limited to the respective embodiments described above, can carry out various variations according to the scope shown in the claim, suitably makes up the technological means of different execution modes record and the execution mode that obtains also is contained within the technical scope of the present invention.

For example, in the above-described embodiment, use the AV data, also can utilize various contents such as view data, video data, voice data, document data as the content that is included in the content of multimedia.

In addition, directly send audiovisual users' such as name, telephone number personal information in the above-described embodiment from the AV content reproduction apparatus, for example also can send as following to AV data related service generator.

That is, at first, with broadcasting dealer when signing the channel contract, the corresponding relation with Termination ID and audiovisual user's personal information is stored in the AV content generation/dispensing device in advance.Then, the AV content reproduction apparatus omits personal information, sends the message that includes Termination ID to AV content related service generator.AV content related service generator inquiry AV content generation/dispensing device and obtain be included in the message that receives in the corresponding audiovisual user's of Termination ID personal information.Thus, because the AV content reproduction apparatus can omit the personal information of the audiovisual user in the message, can improve fail safe.

In addition, structure of the present invention also can be for following.

Promptly, in order to solve above-mentioned problem, bi-directional service of the present invention system constitutes, service requester is sent the content of multimedia that includes certain content and the incidental sub-content of this content from serving the provider, from above-mentioned service requester above-mentioned service provider is sent the message relevant with above-mentioned content of multimedia, it is characterized in that: above-mentioned service provider has content of multimedia dispensing device that sends above-mentioned content of multimedia and the message receiving apparatus that receives above-mentioned message; Above-mentioned service requester has the content of multimedia replay device of the content of multimedia that playback receives from above-mentioned content of multimedia dispensing device and generates and sends the message dispensing device of message according to the sub-content of above-mentioned content of multimedia; The sub-content of the content of multimedia that above-mentioned content of multimedia dispensing device is sent includes the transmission destination data of the transmission destination of representing above-mentioned message; Above-mentioned message dispensing device sends above-mentioned message according to the transmission destination data that is included in the above-mentioned sub-content.

According to said structure, the transmission destination data that includes the transmission destination of representing message in the sub-content of the content of multimedia that the content of multimedia dispensing device is sent, the message dispensing device sends message according to the transmission destination data that is included in the above-mentioned sub-content.Thus, can guarantee message is sent to and serve the desirable transmission of provider destination.Therefore, except the server that bi-directional service is provided, can also send message to for example broadcast service person, CM making dealer's etc. server.

In addition, each device of serving the provider also can form as one, and each device of service requester also can form as one.The data Transmission system that above-mentioned message is preferably utilized e-mail system or is similar to this system sends.In this case, owing to can utilize existing systems, and only in message, append addresses of items of mail and get final product, so can send message easily.

In addition, above-mentioned content of multimedia dispensing device can send content and the sub-content that above-mentioned content of multimedia comprises to above-mentioned content reproduction apparatus by different communication paths.

In addition, above-mentioned content of multimedia replay device can be separated into the sub-content reproduction apparatus of the above-mentioned sub-content in the content reproduction apparatus of the foregoing in the above-mentioned content of multimedia of resetting and the above-mentioned content of multimedia of resetting.In this case, above-mentioned sub-content reproduction apparatus and message dispensing device can form as one.And then above-mentioned content of multimedia dispensing device can send content and the sub-content that above-mentioned content of multimedia comprises to above-mentioned content reproduction apparatus and above-mentioned sub-content reproduction apparatus by different communication paths.

In the said structure of bi-directional service of the present invention system, preferably, the data identification information that in the sub-content of the content of multimedia that above-mentioned content of multimedia dispensing device sends, comprises the kind that is used for discerning the data that above-mentioned message comprises in advance, and the data and the above-mentioned data identification information that are comprised in the message that sends of above-mentioned message dispensing device are interrelated.In this case, even discrete discrepancy appears in the arrangement of data, owing to can come the kind of particular data by data identification information, so can read the data of desirable kind.

In the said structure of bi-directional service of the present invention system, above-mentioned message dispensing device preferably appends at least one the information in specific device or this device users in message.In this case, this device users there is no need indication and append above-mentioned customizing messages in message, so can not cause trouble to above-mentioned user.

But for example working as content is to receive under the situation of the flow data of data in playback in real time, preferably appends information in message, and wherein, this information is which data in the content are carried out information specific by playback.

In the said structure of bi-directional service system in the present invention, preferably, above-mentioned content of multimedia replay device has the switching part of the playback of the playback of switch contents and sub-content.In addition, above-mentioned message dispensing device preferably appends the information of serving provider's certain content that makes in message.At this, as the information of specific foregoing, the above-mentioned switching part that can exemplify out the content of multimedia replay device switches to the information in the moment of sub-content playback from content playback.

In addition, in the said structure of bi-directional service of the present invention system, preferably, foregoing is the AV data of the broadcast program of predetermined channel, and above-mentioned message dispensing device appends the information and the above-mentioned broadcasting information constantly of above-mentioned channel in message.

In addition, in the said structure of bi-directional service of the present invention system, preferably, foregoing sends with document form, above-mentioned message dispensing device append file identifier and from elapsed time of playback zero hour of content in message.

In addition, so long as the employed content of multimedia dispensing device of above-mentioned bi-directional service system just can reach effect same as described above.So long as the employed message dispensing device of above-mentioned bi-directional service system just can reach effect same as described above.

In order to solve above-mentioned problem, the data structure of sub-content of the present invention is the data structure of the incidental sub-content of content, it is characterized in that comprising: represent the structured data of structure of the message relevant and the transmission destination data of representing the transmission destination of above-mentioned message with content of multimedia, wherein, content of multimedia includes foregoing and above-mentioned sub-content.

According to said structure, include the transmission destination data in the sub-content of content of multimedia, this transmission destination data is represented the transmission destination of the message relevant with content of multimedia.Thus, generate and send in the playback side of playback content of multimedia under the situation of above-mentioned message, will send above-mentioned message according to above-mentioned transmission destination data.Therefore, above-mentioned message can be sent to desirable transmission destination, content of multimedia making side.

In addition, sending destination data can be the data corresponding with foregoing.In this case, can change the message transmission destination of each content.Its result can send the destination according to message and come certain content.

And then the said structure data preferably include the kind that is useful on the data that comprise in the above-mentioned message and carry out the recognition data identifying information.In this case, even discrete discrepancy appears in the data arrangement in the message, also can come the kind of particular data according to data identification information.Therefore, when message sender generates message, need not to rearrange the data in the message.In addition, can read the data of desirable kind at message receiver.

In addition, preferably, be that the message corresponding with which content is discerned to message.Thus, preferably, in data structure of the present invention, also include the content recognition information that is used to discern foregoing.

AV content generation device 11, AV content be synthetic/and the control part of each piece, the particularly replay device of dispensing device 12, replay device 14,74,77,104,107,124, AV content related service generator 15,75,105,125 and AV content generation/dispensing device 72,102,123 can be made of hardware logic, and also can the CPU of utilization as described below and realize by means of software.

That is, said apparatus has: the storage device (recording medium) etc. of carrying out CPU (central processing unit), the ROM (read only memory) that stores said procedure, the RAM (random access memory) that launches said procedure, storage said procedure and the various memory of data etc. of the control program command (CP command) be used to realize each function.In addition, in recording medium, can write down as being used to realize that the software of above-mentioned functions is the program code (execute form program, intermediate code program, source program) of the control program of said apparatus by computer with reading, and this recording medium offered said apparatus, read by computer (or CPU, MPU) and to be recorded in the program code in the aforementioned recording medium and to carry out it, so, also can realize purpose of the present invention.

As aforementioned recording medium, for example, can use following recording medium, that is: the tape class of tape, cassette tape etc., the dish class of CD that comprises the disk, CD-ROM, MO, MD, DVD, CD-R etc. of floppy disk (registered trade mark) or hard disk etc., the card class of IC-card (comprising storage card), light-card etc., perhaps the semiconductor memory class of mask model ROM, EPROM, EEPROM, flash rom etc.

In addition, also said apparatus can be constituted and to be connected with communication network, and supply with the said procedure code via communication network.As above-mentioned communication network, not special restriction, for example, can utilize the Internet (internet), Intranet (intranet), extranet (extranet), LAN, ISDN, VAN, CATV communication network, VPN (virtual private network) (virtual private network), line loop network, mobile communications network, satellite communication network etc.In addition, as the transmission medium that constitutes communication network, not special restriction, for example, can utilize the wire communication of IEEE1394, USB, power line, cable TV loop line, telephone wire, ADSL loop line etc., also can utilize the radio communication of infrared ray such as IrDA or remote controller etc., Bluetooth (registered trade mark), 802.11 cordless communication networks, HDR, mobile telephone network, satellite loop line, received terrestrial digital broadcasting network (terrestrialdigital net) etc.In addition, even the said procedure code by electronics transmit specialized, by the form of mounting in the computer data signal of carrier wave, also can realize the present invention.

The industry utilizability

Bi-directional service of the present invention system can be used as content of multimedia replay device and message dispensing device Be applicable to TV image receiver, portable telephone terminal, also go for PDA, PC etc. Other information communication terminals.

Claims (27)

1. bi-directional service system, service requester is sent the content of multimedia that includes certain content and the incidental sub-content of this content from serving the provider, from above-mentioned service requester above-mentioned service provider is sent the message relevant with above-mentioned content of multimedia, this bi-directional service system is characterised in that:

Above-mentioned service provider sends content and the sub-content that above-mentioned content of multimedia comprises by different communication paths to above-mentioned service requester;

Above-mentioned service requester sends above-mentioned message according to the transmission destination data that this service requester has.

2. bi-directional service system, service requester is sent the content of multimedia that includes certain content and the incidental sub-content of this content from serving the provider, from above-mentioned service requester above-mentioned service provider is sent the message relevant with above-mentioned content of multimedia, this bi-directional service system is characterised in that:

Above-mentioned service provider sends content and the sub-content that above-mentioned content of multimedia comprises by same communication path to above-mentioned service requester;

Above-mentioned service requester sends above-mentioned message according to the transmission destination data that this service requester had.

3. bi-directional service according to claim 2 system is characterized in that:

Non-synchronously send content and sub-content to above-mentioned service requester.

4. according to any described bi-directional service system in the claim 1 to 3, it is characterized in that:

The sub-content of above-mentioned content of multimedia includes the transmission destination data of the transmission destination of representing above-mentioned message.

5. a content of multimedia dispensing device has the sending part that sends content of multimedia, and this content of multimedia includes certain content and the incidental sub-content of this content, and this content of multimedia dispensing device is characterised in that:

Above-mentioned sending part sends content and the sub-content that above-mentioned content of multimedia comprises by different communication paths.

6. a content of multimedia dispensing device has the sending part that sends content of multimedia, and this content of multimedia includes certain content and the incidental sub-content of this content, and this content of multimedia dispensing device is characterised in that:

Above-mentioned sending part sends content and the sub-content that above-mentioned content of multimedia comprises by same communication path.

7. content of multimedia dispensing device according to claim 6 is characterized in that:

Foregoing and sub-content are non-synchronously sent.

8. according to any described content of multimedia dispensing device in the claim 5 to 7, it is characterized in that:

Above-mentioned sub-content includes the transmission destination data, and this transmission destination data is represented the transmission destination of the message relevant with above-mentioned content of multimedia.

9. content of multimedia dispensing device according to claim 8 is characterized in that:

Above-mentioned transmission destination data is the data corresponding with foregoing.

10. according to any described content of multimedia dispensing device in the claim 5 to 7, it is characterized in that:

Above-mentioned sub-content also comprises structured data, and this structured data is indicated in the structure of the above-mentioned message of the playback side generation of the above-mentioned content of multimedia of resetting.

11. a content of multimedia receiving system has the acceptance division of receiving multimedia content, this content of multimedia includes certain content and the incidental sub-content of this content, and this content of multimedia receiving system is characterised in that:

Above-mentioned acceptance division receives foregoing and above-mentioned sub-content by different communication paths.

12. a content of multimedia receiving system has the acceptance division of receiving multimedia content, this content of multimedia includes certain content and the incidental sub-content of this content, and this content of multimedia receiving system is characterised in that:

Above-mentioned acceptance division receives foregoing and above-mentioned sub-content by same communication path.

13. content of multimedia receiving system according to claim 12 is characterized in that:

Non-synchronously receive foregoing and above-mentioned sub-content.

14. a content of multimedia receiving system has the acceptance division of receiving multimedia content, this content of multimedia includes certain content and the incidental sub-content of this content, and this content of multimedia receiving system is characterised in that:

The above-mentioned sub-content that the request of above-mentioned acceptance division reception and this device irrespectively sends or broadcasts.

15. any described content of multimedia receiving system according in the claim 11 to 14 is characterized in that:

The sub-content playback portion that also has the sub-content that above-mentioned acceptance division received of resetting.

16. content of multimedia receiving system according to claim 15 is characterized in that:

The content playback portion that also has the content that above-mentioned acceptance division received of resetting.

17. any described content of multimedia receiving system according in the claim 11 to 16 is characterized in that:

Also have generating unit that generates the message relevant and the sending part that sends the message that is generated with above-mentioned content of multimedia;

Above-mentioned sending part sends above-mentioned message to sending the destination, and wherein, this transmission destination is represented by the transmission destination data that this device provides.

18. content of multimedia receiving system according to claim 17 is characterized in that:

Above-mentioned transmission destination data is comprised in the received sub-content of above-mentioned acceptance division.

19., it is characterized in that according to claim 17 or 18 described content of multimedia receiving systems:

Above-mentioned generating unit generates message according to the message structure of being represented by structured data, wherein, and in the received sub-content of the involved above-mentioned acceptance division of this structured data.

20. bi-directional service system, service requester is sent the content of multimedia that includes certain content and the incidental sub-content of this content from serving the provider, from above-mentioned service requester above-mentioned service provider is sent the message relevant with above-mentioned content of multimedia, this bi-directional service system is characterised in that:

Above-mentioned service provider has the content of multimedia dispensing device of any above-mentioned content of multimedia of described transmission in the claim 5 to 10;

Above-mentioned service requester has the content of multimedia receiving system of any above-mentioned content of multimedia of described reception in the claim 17 to 19;

Above-mentioned service provider also has the message receiving apparatus that receives above-mentioned message from above-mentioned content of multimedia receiving system.

21. the control method of a content of multimedia dispensing device, this content of multimedia dispensing device sends the content of multimedia that includes certain content and the incidental sub-content of this content, and this control method is characterised in that:

Comprise by different communication path or same communication path and send the content that above-mentioned content of multimedia comprises and the step of sub-content.

22. the control method of a content of multimedia receiving system, this content of multimedia receiving system receives the content of multimedia that includes certain content and the incidental sub-content of this content, and this control method is characterised in that:

Comprise the step that receives foregoing and above-mentioned sub-content by different communication path or same communication path.

23. the control method of a bi-directional service system, in this bi-directional service system, from serving the provider service requester is sent the content of multimedia that includes certain content and the incidental sub-content of this content, above-mentioned service provider is sent the message relevant with above-mentioned content of multimedia from above-mentioned service requester; Above-mentioned service provider has the content of multimedia dispensing device that sends above-mentioned content of multimedia, and above-mentioned service requester has the content of multimedia receiving system that receives above-mentioned content of multimedia; Above-mentioned service provider also has the message receiving apparatus that receives above-mentioned message from above-mentioned content of multimedia receiving system, and this control method is characterised in that, comprising:

Above-mentioned content of multimedia dispensing device sends the content that above-mentioned content of multimedia comprises and the step of sub-content by different communication path or same communication path to above-mentioned content of multimedia receiving system; And

Above-mentioned content of multimedia receiving system sends the step of above-mentioned message according to the transmission destination data that above-mentioned service requester provided.

24. the control program of a content of multimedia dispensing device is characterized in that:

Make the computer enforcement of rights require each step of the control method of 21 described content of multimedia dispensing devices.

25. the control program of a content of multimedia receiving system is characterized in that:

Make the computer enforcement of rights require each step of the control method of 22 described content of multimedia receiving systems.

26. a bi-directional service system control program is characterized in that:

Make the computer enforcement of rights require each step of the control method of 23 described bi-directional service systems.

27. the recording medium that can be read by computer is characterized in that:

Write down in the described content of multimedia dispensing device of claim 24 control program, claim 25 described content of multimedia receiving system control program and the described bi-directional service system control program of claim 26 at least one.

Images