WO2013042531A1 - 受信装置、受信方法、プログラム、及び情報処理システム - Google Patents
受信装置、受信方法、プログラム、及び情報処理システム Download PDFInfo
- Publication number
- WO2013042531A1 WO2013042531A1 PCT/JP2012/072354 JP2012072354W WO2013042531A1 WO 2013042531 A1 WO2013042531 A1 WO 2013042531A1 JP 2012072354 W JP2012072354 W JP 2012072354W WO 2013042531 A1 WO2013042531 A1 WO 2013042531A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- content
- command
- receiving device
- information processing
- identification result
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 112
- 230000010365 information processing Effects 0.000 title claims abstract description 92
- 239000000284 extract Substances 0.000 claims abstract description 25
- 238000001514 detection method Methods 0.000 claims description 117
- 230000008569 process Effects 0.000 claims description 78
- 230000005236 sound signal Effects 0.000 claims description 47
- 230000004044 response Effects 0.000 claims description 38
- 238000000605 extraction Methods 0.000 claims description 25
- 238000010304 firing Methods 0.000 claims description 10
- 230000004913 activation Effects 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 9
- 239000000725 suspension Substances 0.000 claims description 6
- 238000005516 engineering process Methods 0.000 abstract description 32
- 238000004891 communication Methods 0.000 description 39
- 230000007704 transition Effects 0.000 description 20
- 230000009471 action Effects 0.000 description 13
- 230000001360 synchronised effect Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 238000009826 distribution Methods 0.000 description 8
- 238000009792 diffusion process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000002347 injection Methods 0.000 description 3
- 239000007924 injection Substances 0.000 description 3
- 230000014759 maintenance of location Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000006266 hibernation Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4345—Extraction or processing of SI, e.g. extracting service information from an MPEG stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/237—Communication with additional data server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
- H04N21/4383—Accessing a communication channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
Definitions
- the present technology relates to a receiving device, a receiving method, a program, and an information processing system, and in particular, a receiving device, a receiving method, a program, and an information program that can provide an application program linked to AV content using the ACR technology.
- the present invention relates to an information processing system.
- a broadcast and communication hybrid service can be realized by transmitting control signals synchronized with those broadcast signals. Although it is being studied, it is difficult to realize the service unless the existing CATV network and satellite broadcasting network facilities and dedicated terminals are modified.
- ACR Automatic Content Recognition
- the present technology has been made in view of such a situation, and is intended to provide an application program that is executed in conjunction with AV content using the ACR technology.
- the reception device is identified using a reception unit that receives AV content, a feature amount extraction unit that extracts feature amounts from the received AV content data, and the extracted feature amounts.
- An identification result acquisition unit for acquiring the identification result of the AV content, and a command acquisition for acquiring a command for controlling the operation of the application program executed in conjunction with the AV content according to the acquired identification result
- a control unit that controls the operation of the application program according to the acquired command, and a detection unit that detects switching of the AV content to be viewed. The control unit switches the AV content. If the application program is executed in conjunction with the AV content, To Ryo.
- the detection unit detects switching of a channel from the first AV content to a second AV content different from the first AV content, and the control unit detects the second AV content from the first AV content.
- the application program executed in conjunction with the first AV content is terminated.
- a storage unit for storing first identification information for identifying the first AV content obtained from the identification result of the first AV content, wherein the feature amount extraction unit includes the first AV content;
- the identification result acquisition unit performs identification using the extracted feature amount
- the second AV content identification result is obtained, and the control unit obtains the stored first identification information and the second AV content obtained from the identification result of the second AV content. If the second identification result for identification is different, the application program is terminated.
- the reception unit directly receives the AV content transmitted from a transmission device, and the detection unit responds to an operation of switching the channel from the first AV content to the second AV content for the reception device. Thus, the switching of the channel is detected.
- the receiving unit is connected to an information processing apparatus that converts data of the AV content transmitted from a transmission apparatus according to the reception apparatus, in a manner compliant with the HDMI (High Definition Multimedia Interface) standard,
- the AV content after conversion is received from the information processing device, and the detection unit receives the second AV content from the first AV content according to the analysis result of the video signal of the AV content received from the information processing device. Detects channel switching to AV content.
- the detection unit Based on the video signal of the AV content received from the information processing apparatus, the detection unit includes a plurality of frames constituting the AV content that are continuously displayed on the same screen for a predetermined period, or the plurality of frames are Channel switching is detected by analyzing whether a black screen is continuously obtained for a predetermined interval.
- the detection unit detects switching of the channel from the first AV content to the second AV content according to the analysis result of the audio signal of the AV content received from the information processing apparatus.
- the detection unit determines whether the sample of the audio signal is in a no-signal state in a predetermined section or whether the sample is in a discontinuous state in the predetermined section. By detecting whether or not, channel switching is detected.
- the receiving unit is connected to an information processing device that converts the data of the AV content transmitted from the transmission device according to the reception device in a method compliant with the HDMI standard, and is converted from the information processing device.
- the AV content is received, and the detection unit detects switching of the channel in response to an operation of switching the channel from the first AV content to the second AV content with respect to the information processing apparatus.
- the receiving unit is connected to a selection device that selects and outputs desired AV content from among a plurality of AV contents input from a plurality of information processing devices in a manner compliant with the HDMI standard, so that the selection is performed.
- the AV content output from the device is received, and the detection unit detects switching of the AV content to be viewed according to a selection result of the AV content by the selection device.
- the identification result acquisition unit acquires the identification result of the AV content that is identified by using an ACR (Automatic Content Recognition) technique from the extracted feature quantity.
- ACR Automatic Content Recognition
- the feature amount extraction unit extracts the feature amount from one or both of a video signal and an audio signal of the AV content.
- the command indicates any one of acquisition or registration, acquisition or activation, event firing, interruption, or termination of the application program, and the control unit acquires or registers the application program according to each command. Controls event firing, suspension, or termination of the application program being registered, acquired, or started, or being executed.
- the receiving device may be an independent device or an internal block constituting one device.
- the reception method or program according to the first aspect of the present technology is a reception method or program corresponding to the reception device according to the first aspect of the present technology described above.
- AV content is received, feature values are extracted from the received AV content data, and identification is performed using the extracted feature values.
- the obtained identification result of the AV content is acquired, and a command for controlling the operation of the application program executed in conjunction with the AV content is acquired and acquired according to the acquired identification result.
- the operation of the application program is controlled, the switching of the AV content to be viewed is detected, and when the switching of the AV content is detected, the application executed in conjunction with the AV content The program is terminated.
- An information processing system is an information processing system including a reception device, a first information processing device, a second information processing device, and a third information processing device.
- a reception unit that receives AV content, a feature amount extraction unit that extracts a feature amount from the received AV content data, and transmits the extracted feature amount to the first information processing apparatus.
- An identification result acquisition unit that acquires the identification result of the AV content identified by using the feature amount in the information processing apparatus; and the identification information acquired from the first information processing apparatus is used as the second information processing.
- a command acquisition unit to be obtained, a control unit for controlling the operation of the application program acquired from the third information processing apparatus in response to the command acquired from the second information processing apparatus, and the AV content to be viewed A detecting unit that detects switching of the AV content, and when the switching of the AV content is detected, the control unit terminates the application program that is executed in conjunction with the AV content, and the first information
- the processing device includes a first providing unit that provides the identification result obtained by identifying the AV content using the feature amount in response to an inquiry from the receiving device, and the second information processing In response to an inquiry from the receiving device, the device includes a second providing unit that provides the command according to the identification result.
- the third information processing apparatus in response to an inquiry from the receiving device, comprising a third providing unit for providing the application program corresponding to the command.
- the reception device In the information processing system including the reception device, the first information processing device, the second information processing device, and the third information processing device, the reception device The AV content is received, the feature amount is extracted from the received data of the AV content, the extracted feature amount is transmitted to the first information processing device, and the first information processing device is transmitted.
- the identification result of the AV content identified using the feature amount is acquired, and the identification result acquired from the first information processing apparatus is transmitted to the second information processing apparatus, A command for controlling the operation of an application program executed in conjunction with the AV content is acquired from the information processing apparatus according to the identification result, and the second The operation of the application program acquired from the third information processing device is controlled according to the command acquired from the information processing device, the switching of the AV content to be viewed is detected, and the switching of the AV content is detected.
- the application program being executed in conjunction with the AV content is terminated, and the AV content is used by the first information processing device using the feature amount in response to an inquiry from the receiving device.
- the identification result obtained by identifying is provided, and the second information processing apparatus provides the command according to the identification result in response to an inquiry from the receiving apparatus, and the third information In response to an inquiry from the receiving device, according to the command by the processing device Serial application program is provided.
- FIG. 1 shows a broadcast system 1 according to the first embodiment.
- the broadcasting system 1 includes a broadcasting device 11, a receiving device 12, an ACR server 13, a command server 14, an application server 15, a CATV device 17, and a set top box 19.
- the receiving device 12, the ACR server 13, the command server 14, and the application server 15 are connected to each other via the Internet 16.
- the receiving device 12 is connected to the set top box 19 via the HDMI cable 20, and the CATV device 17 and the set top box 19 are connected via the CATV network 18.
- the broadcasting device 11 is provided by a broadcaster that broadcasts digital television programs, for example.
- the broadcast device 11 is configured to transmit (broadcast) a digital television broadcast signal of AV content.
- a digital television program will be described as an example of AV content transmitted from the broadcasting device 11.
- the receiving device 12 receives the digital television broadcast signal transmitted from the broadcasting device 11 and acquires video and audio of the digital television program.
- the receiving device 12 outputs the acquired video to a display (display 32 in FIG. 2 described later) and outputs sound to a speaker (speaker 31 in FIG. 2 described later).
- the receiving device 12 may exist as a single unit, or may be incorporated in, for example, a television receiver or a video recorder.
- the receiving device 12 has a light receiving unit (light receiving unit 71 in FIG. 2 described later) that receives a command corresponding to an operation on the remote controller 12R with infrared rays, and switches a channel, for example, according to the command. Various operations are performed. The detailed configuration of the receiving device 12 will be described later with reference to FIG.
- the receiving device 12 periodically accesses the ACR server 13 via the Internet 16 and inquires about the identification result of the digital television program. At this time, a feature amount extracted from the video signal and audio signal of the digital television program (hereinafter also referred to as “fingerprint information”) is transmitted to the ACR server 13.
- the ACR server 13 has a database in which feature amounts extracted from video signals and audio signals of arbitrary AV contents are registered, and responds to an inquiry from an arbitrary receiving device 12 connected to the Internet 16.
- the AV content is identified using ACR (Automatic Content Recognition) technology.
- the ACR server 13 identifies the digital television program by comparing the fingerprint information from the receiving device 12 with a database, and transmits the identification result to the receiving device 12 via the Internet 16. To do.
- the receiving device 12 accesses the command server 14 via the Internet 16 according to the identification result received from the ACR server 13, and performs the operation of the application program for data broadcasting executed in conjunction with the digital television program. Get commands to control.
- an application program executed in conjunction with AV content such as a digital television program will be described as a data broadcasting application.
- the command server 14 is a server provided by an operator such as a broadcaster or a cable television operator, for example, and manages commands for controlling the operation of the data broadcasting application.
- the command server 14 transmits a command to the receiving device 12 via the Internet 16 in response to an inquiry from the receiving device 12.
- the receiving device 12 controls the operation of the data broadcasting application according to the command received from the command server 14. In addition, the receiving device 12 accesses the application server 15 via the Internet 16 according to the command received from the command server 14, and acquires the data broadcasting application.
- the application server 15 is a server provided by an operator such as a broadcaster or a cable TV operator, for example, and manages an application for data broadcasting. In response to the inquiry from the receiving device 12, the application server 15 transmits the data broadcasting application to the receiving device 12 via the Internet 16.
- the CATV device 17 is provided by, for example, a cable television company.
- the CATV device 17 receives the digital television broadcast signal transmitted from the broadcasting device 11 and acquires the video and audio of the digital television program.
- the CATV device 17 converts the digital television broadcast signal into a cable television broadcast signal for transmitting (broadcasting) the cable television program, and retransmits it to the set top box 19 connected to the CATV network 18.
- the CATV device 17 is not limited to retransmitting the digital television program acquired from the broadcasting device 11 as a cable television program, but may transmit a program independently produced by a cable television operator.
- a cable television program will be described as an example of AV content transmitted from the CATV device 17.
- the set top box 19 is an STB (Set Top Box) for cable television and is connected to the CATV network 18.
- the set-top box 19 is connected to a receiving device 12 having an HDMI (High Definition Multimedia Interface) terminal via an HDMI cable 20.
- the set top box 19 converts the cable television broadcast signal received from the CATV device 17 via the CATV network 18 into a signal that can be handled by the receiving device 12. Then, the set top box 19 outputs the audio signal and the video signal obtained from the converted cable television broadcast signal to the receiving device 12 through the HDMI cable 20 together with the control signal based on the HDMI standard.
- the set-top box 19 has a light receiving unit (not shown) that receives a command corresponding to an operation on the remote controller 19R by infrared rays, and performs various operations such as channel switching according to the command. Do.
- the receiving device 12 receives an audio signal, a video signal, and other control signals from the set top box 19 to acquire video and audio of the cable television program, and displays the acquired video on a display (display 32 in FIG. 2). In addition to outputting, the sound is output to a speaker (speaker 31 in FIG. 2).
- the receiving device 12 accesses the ACR server 13 and identifies the fingerprint information extracted from the data of the cable television program, as in the case of the digital television program described above. Can be inquired. Then, the receiving device 12 can acquire a command from the command server 14 according to the identification result from the ACR server 13 and control the operation of the data broadcasting application. The receiving device 12 can also acquire a data broadcast application from the application server 15 in response to a command from the command server 14.
- a digital television program from the broadcasting device 11 or a cable television program from the CATV device 17 is received. Will be explained. Further, in the following description, when it is not necessary to distinguish between a digital television program and a cable television program, they are simply referred to as programs.
- FIG. 2 shows a configuration example of the receiving device 12 of FIG.
- the receiving device 12 includes a tuner 51, a demultiplexing unit 52, an audio decoder 53, a selector 54, an audio output unit 55, a video decoder 56, a selector 57, a video output unit 58, an HDMI terminal 59, a fingerprint extraction unit 60, a communication I / O. F61, command analysis unit 62, clock synchronization unit 63, control unit 64, memory 65, operation unit 66, application engine 67, cache memory 68, application memory 69, channel switching detection unit 70, and light receiving unit 71 .
- the tuner 51 receives a digital television broadcast signal from the broadcast device 11 via an antenna (not shown).
- the tuner 51 demodulates the digital television broadcast signal corresponding to the channel selected by the user, and outputs a transport stream (Transport Stream, hereinafter referred to as TS) obtained as a result to the demultiplexing unit 52.
- Transport Stream Transport Stream
- the demultiplexing unit 52 separates the TS input from the tuner 51 into an audio encoded signal and a video encoded signal, and outputs them to the audio decoder 53 and the video decoder 56, respectively. Further, the demultiplexing unit 52 extracts PCR (Program Clock Reference) from the TS packets constituting the TS and supplies the extracted PCR to the clock synchronization unit 63.
- PCR Program Clock Reference
- the audio decoder 53 decodes the input audio encoded signal and outputs an audio signal obtained as a result to the selector 54.
- the video decoder 56 decodes the input video encoded signal and outputs the resulting video signal to the selector 57.
- the HDMI terminal 59 is a terminal compliant with the HDMI standard, and is connected to the set top box 19 via the HDMI cable 20.
- the HDMI terminal 59 receives an audio signal and a video signal output from the set top box 19 together with a control signal based on the HDMI standard.
- the HDMI terminal 59 outputs an audio signal among the received various signals to the selector 54 and outputs a video signal to the selector 57.
- the selector 54 receives the audio signal from the audio decoder 53 and the audio signal from the HDMI terminal 59.
- the selector 54 selects an audio signal input from either the audio decoder 53 or the HDMI terminal 59 in accordance with control from the control unit 64, and outputs an audio output unit 55, a fingerprint extraction unit 60, and a channel switching detection unit. Output to 70. That is, the selector 54 switches the input to the audio decoder 53 side when a digital television program is viewed according to the control from the control unit 64, while when the cable television program is viewed, The input is switched to the HDMI terminal 59 side.
- the selector 57 receives the video signal from the video decoder 56 and the video signal from the HDMI terminal 59.
- the selector 57 selects a video signal input from either the video decoder 56 or the HDMI terminal 59 in accordance with control from the control unit 64, and outputs a video output unit 58, a fingerprint extraction unit 60, and a channel switching detection unit. Output to 70. That is, according to the control from the control unit 64, the selector 57 switches the input to the video decoder 56 side when a digital television program is viewed, while when the cable television program is viewed, The input is switched to the HDMI terminal 59 side.
- the audio output unit 55 outputs the audio signal input from the selector 54 to the speaker 31. Further, the video output unit 58 outputs the video signal input from the selector 57 to the display 32. As a result, the video of the AV content is displayed on the display 32, and the sound is output from the speaker 31, so that the program of the selected channel can be viewed. Note that the speaker 31 and the display 32 may be configured integrally with the receiving device 12.
- the fingerprint extraction unit 60 is supplied with an audio signal from the selector 54 and a video signal from the selector 57.
- the fingerprint extraction unit 60 extracts a feature amount from one or both of an audio signal and a video signal, and supplies the extracted feature amount to the communication I / F 61 as fingerprint information.
- the communication I / F 61 transmits the fingerprint information from the fingerprint extraction unit 60 to the ACR server 13 via the Internet 16. Further, the communication I / F 61 receives the program identification result transmitted from the ACR server 13 and supplies it to the control unit 64.
- the control unit 64 controls the operation of each unit of the receiving device 12 by executing a control program stored in the memory 65 in advance.
- the memory 65 stores a control program executed by the control unit 64 in advance. This control program can be updated based on digital television broadcast signals or update data acquired via the Internet 16. Further, the memory 65 appropriately stores various data from the control unit 64.
- the operation unit 66 accepts various operations from the user and notifies the control unit 64 of operation signals corresponding to the operations.
- control unit 64 controls the communication I / F 61 according to the identification result from the communication I / F 61, accesses the command server 14 via the Internet 16, and inquires about the command.
- the communication I / F 61 receives a command transmitted from the command server 14 and supplies the command to the command analysis unit 62.
- the command analysis unit 62 analyzes a command from the communication I / F 61 and supplies the analysis result to the control unit 64.
- the clock synchronization unit 63 is configured by, for example, a PLL (Phase Locked Loop), and the system clock corresponding to the PCR from the demultiplexing unit 52 is transmitted to each unit of the receiving device 12 such as the audio decoder 53, the video decoder 56, and the control unit 64. To supply. Thereby, since the receiving device 12 can obtain a system clock synchronized with the broadcasting device 11, it can reproduce an audio signal and a video signal.
- PLL Phase Locked Loop
- the control unit 64 controls the acquisition or registration, acquisition or activation (execution), event firing, interruption, or termination of the data broadcasting application linked to the program based on the analysis result from the command analysis unit 62.
- the control unit 64 controls the execution timing of the command based on the analysis result from the command analysis unit 62 based on the system clock from the clock synchronization unit 63.
- the application engine 67 controls the communication I / F 61 according to the control from the control unit 64, accesses the application server 15 via the Internet 16, and requests a data broadcasting application.
- the communication I / F 61 receives the data broadcasting application transmitted from the application server 15 and causes the cache memory 68 to hold the data broadcasting application.
- the application engine 67 reads and executes the data broadcasting application held in the cache memory 68 in accordance with the control from the control unit 64.
- the video signal of the data broadcasting application being executed is supplied to the video output unit 58.
- the video output unit 58 synthesizes the video signal input from the application engine 67 and the video signal input from the selector 57 and outputs the synthesized signal to the display 32.
- the application memory 69 includes a work memory 69A and a save memory 69B.
- the application engine 67 records data relating to the data broadcasting application being executed (specifically, including the hierarchy of the displayed information) in the work memory 69A. Further, the application engine 67 moves the data in the work memory 69A of the application memory 69 to the save memory 69B when suspending the data broadcasting application being executed. When the suspended data broadcasting application is resumed, the data in the save memory 69B is moved to the work memory 69A to restore the state before the suspension.
- the channel switching detection unit 70 detects switching of program channels. Specifically, the channel switching detection unit 70 detects the switching of the program channel by analyzing either one or both of the audio signal from the selector 54 and the video signal from the selector 57, and the detection result is obtained. This is supplied to the control unit 64.
- a command corresponding to an operation on the remote controller 12R or the remote controller 19R is input from the light receiving unit 71 to the channel switching detection unit 70.
- the channel switching detection unit 70 detects channel switching of a program based on a command from the light receiving unit 71 and supplies the detection result to the control unit 64.
- the control unit 64 controls the application engine 67 based on the detection result from the channel switching detection unit 70, and terminates the data broadcasting application being executed in conjunction with the program.
- FIG. 3 is a sequence diagram showing the cooperation between the devices at the time of channel selection and channel switching in the receiving device 12.
- the broadcast device 11 transmits a digital television broadcast signal
- the CATV device 17 transmits a cable television broadcast signal.
- the receiving device 12 when a user selects a desired channel, either the digital television broadcast signal from the broadcasting device 11 or the cable television broadcast signal from the CATV device 17 via the set top box 19 is selected. Is received.
- the receiving device 12 displays the video of the program corresponding to the received broadcast signal on the display 32 and outputs the corresponding sound from the speaker 31 (S11).
- the receiving device 12 periodically extracts feature amounts from the video signal and audio signal of the program (S12), and transmits these feature amounts to the ACR server 13 as fingerprint information (S13).
- the ACR server 13 performs ACR identification processing, and collates the fingerprint information from the receiving device 12 with the database, thereby identifying the program being selected by the receiving device 12 (S14). Specifically, as shown in FIG. 4, when the ACR server 13 receives an inquiry about the fingerprint information from the receiving device 12, the ACR identification processing unit 13A obtains the fingerprint information from the FP database 13B prepared in advance. The received program 12 identifies the program being selected.
- the fingerprint information is, for example, specific information of all or part of the AV content, and a large number of specific information of the AV content is registered in the FP database 13B in advance.
- the degree of similarity or coincidence of the unique information is determined.
- a known technique disclosed by various documents can be used as a method for determining the degree of similarity or the degree of coincidence.
- the AV content can be identified from the feature amount of the video signal and the audio signal without depending on the information such as the resolution, aspect ratio, bit rate, or format of the AV content.
- channel identification information information for identifying the channel number of the program
- time position information information indicating the acquisition destination of a command for controlling the operation of the data broadcasting application executed in conjunction with the program in correspondence with the channel identification information (hereinafter, command acquisition destination information). Is stored). For example, as the command acquisition destination information, a URL (Uniform ⁇ ⁇ ⁇ ⁇ Resource Locator) of the command server 14 is described.
- the ACR identification processing unit 13A acquires command acquisition destination information corresponding to the identified channel number from the FP database 13B. Then, the ACR identification processing unit 13A transmits the channel identification information, the time position information, and the command acquisition destination information as the identification result of the ACR identification process to the receiving device 12 that has made the inquiry (S15).
- the receiving device 12 acquires the identification result from the ACR server 13 and analyzes the identification result (S16). Further, the receiving device 12 accesses the command server 14 of the URL described in the command acquisition destination information according to the analysis result of the identification result, and transmits the channel identification information and the time position information. The command which can be executed is inquired (S17).
- the command server 14 transmits a command corresponding to the channel identification information and the time position information to the receiving device 12 in response to the inquiry from the receiving device 12 (S18). Specifically, for example, the command server 14 manages commands that can be executed for each program, and is executed in a time zone corresponding to time position information in a program corresponding to channel identification information from the receiving device 12. Identify possible commands. For example, the command server 14 is based on the time position information from the receiving device 12 until the next fingerprint information is extracted from the time when the target fingerprint information is extracted by the receiving device 12 (for example, Identify one or more commands to be run in a few seconds). Then, the command server 14 transmits the specified command to the receiving device 12 via the Internet 16.
- the receiving device 12 acquires a command from the command server 14 and analyzes the command (S19). Further, the receiving device 12 accesses the application server 15 according to the analysis result of the command, and requests a data broadcasting application to be executed in conjunction with the selected program (S20).
- the application server 15 transmits a data broadcast application to the receiving device 12 in response to the application request from the receiving device 12 (S21). Then, the receiving device 12 acquires and executes the data broadcast application from the application server 15 (S22). As a result, the video on which the data broadcasting application is superimposed on the program is displayed on the display 32.
- the channel switching detection unit 70 detects the switching of the channel (S24).
- any of the following detection methods can be employed.
- a first detection method there is a method of using a channel switching command from the remote controller 12R.
- this detection method when a digital television program from the broadcasting device 11 is selected in the receiving device 12, a channel switching command from the remote controller 12 ⁇ / b> R according to the user's channel selection operation is received by the light receiving unit 71.
- the channel switching detection unit 70 can detect the channel switching of the digital television program.
- the channel switching command is not limited to the case where the light receiving unit 71 receives light from the infrared light from the remote controller 12R.
- the channel switching detection unit 70 is switched from the operation unit 66 according to the user's channel selection operation on the operation unit 66. May be output.
- the channel switching detection unit 70 analyzes the video signal of the cable television program. Thus, channel switching can be detected according to the analysis result.
- the channel switching detection unit 70 analyzes whether a plurality of frames corresponding to the video signal of the cable television program are continuously displayed on the same screen (freeze screen) in a predetermined section. When a section in which the same screen continues is detected, it is possible to detect channel switching of the cable television program. Specifically, for example, the channel switching detection unit 70 obtains the inter-frame difference value of the video sample value for each corresponding position of the preceding and succeeding frames, and compares the average value with the threshold value ⁇ d. Then, when the frames whose average value is equal to or less than the threshold ⁇ d continues for N frames, the channel switching detection unit 70 considers that the same screen is continuous and detects channel switching.
- the channel switching detection unit 70 analyzes whether a plurality of frames corresponding to the video signal of the cable television program have a black screen continuously in a predetermined section, When a section in which black screens are continuous is detected, it is possible to detect channel switching of a cable television program. Specifically, for example, the channel switching detection unit 70 obtains an average value of the video sample values for each frame and compares the average value with the threshold value ⁇ b. Then, the channel switching detection unit 70 detects that the black screen is continuous when the frames having the average value equal to or less than the threshold value ⁇ b continue for N frames, and detects the channel switching.
- the receiving device 12 analyzes the video signal of the cable television program, and detects the switching of the channel when the same screen or the black screen is continuous, so that both specifications can be supported. ing.
- a third detection method there is a method of using the analysis result of the audio signal of the program.
- the receiving device 12 receives a cable television program from the CATV device 17 via the set top box 19
- the audio signal of the cable television program is analyzed, and the channel is determined according to the analysis result. Can be detected.
- the channel switching detection unit 70 analyzes whether a sample of an audio signal of a cable television program is in a no signal state in a predetermined section or whether a sample is in a discontinuous state in a predetermined section. Thus, when the no-signal state and the discontinuous state are detected, it is possible to detect the channel switching of the cable television program. Specifically, for example, the channel switching detection unit 70 obtains the level of audio energy for each predetermined time width of the audio signal, and compares the level with the threshold value ⁇ s. Then, the channel switching detection unit 70 can be regarded as a no-signal state when the time during which the level of the voice energy is equal to or lower than the threshold value ⁇ s continues for M seconds.
- the channel switching detection unit 70 obtains a difference between a predicted sample value obtained by linear prediction and an actually measured actual sample value for the audio signal, and compares the difference value with a threshold value ⁇ a.
- the channel switching detection part 70 can be regarded as a discontinuous state, when a difference value becomes more than threshold value (theta) a.
- the detection by the second detection method and the third detection method is performed at the same time, channel switching is detected based on the analysis results of both video and audio, so that detection accuracy is further improved.
- detection by the second detection method or the third detection method may be performed individually.
- the detection accuracy can be further improved by detecting both states. Only one of the states may be detected.
- the detection of the same screen or black screen for video signals and the detection of no-signal state or discontinuous state for audio signals as shown in the second detection method and the third detection method are performed. It is possible to assign points according to the detection states, and when the total of the points is equal to or greater than a preset value, it may be considered that the channel has been switched.
- a fourth detection method there is a method of using a channel switching command from the remote controller 19R.
- this detection method when a cable television program from the CATV device 17 is selected in the receiving device 12, a channel switching command from the remote controller 19 ⁇ / b> R is received by the light receiving unit 71 in accordance with the user's channel selection operation. When received, the channel switching detection unit 70 can detect the channel switching of the cable television program.
- the receiving device 12 cannot identify the command from the remote controller 19R, it can be regarded that the channel of the cable television program has been switched when the unrecognizable command is received by the light receiving unit 71.
- the command from the remote controller 19R is not only a command corresponding to channel switching, by setting a correspondence table of commands used in the set top box 19 in advance in the receiving device 12, the remote controller 19R It is only necessary to identify a command corresponding to channel switching.
- the receiving device 12 presumes that channel switching has been detected and extracts fingerprint information from the cable television program to be watched. It may be transmitted to the server 13.
- the receiving device 12 can acquire the identification result from the ACR server 13, the channel identification information before and after the detection of the estimated channel switching is compared, and whether or not the channel switching is normally performed. Can be determined. That is, when the channel is normally switched, the receiving device 12 learns that an unidentifiable command from the remote controller 19R is a command corresponding to channel switching. By learning the command in this way, the receiving device 12 can identify whether the command is a command corresponding to channel switching when the command is next received from the remote controller 19R.
- channel switching can be detected using the above detection methods, the above-described detection method is merely an example, and channel switching of a program is detected by a method that can detect other channel switching. You may make it do.
- the receiving apparatus 12 extracts fingerprint information from the video signal and audio signal of the program viewed after the channel switching (S 25) and transmits the fingerprint information to the ACR server 13. (S26). Then, the ACR server 13 performs ACR identification processing for comparing the fingerprint information from the receiving device 12 with the FP database 13B, and the receiving device 12 identifies the program being selected (S27). The ACR identification process is as described with reference to FIG. Then, the ACR server 13 transmits the identification result of the ACR identification process to the receiving device 12 that is the inquiry source (S28). Note that the processes in steps S25 to S28 correspond to the processes in steps S12 to S15 described above.
- the receiving device 12 compares the channel identification information obtained before the detection of channel switching with the channel identification information obtained after the detection of channel switching based on the identification result from the ACR server 13 (S29). If the channel identification information before and after detection of channel switching is different, the receiving device 12 forcibly terminates the data broadcasting application being executed because the channel has been switched normally (S30). As a result, the data broadcasting application that is displayed superimposed on the program before the channel switching is not displayed in the program after the channel switching.
- the data broadcasting application may be terminated immediately after step S24. Even in that case, the channel switching is confirmed by performing the processing of steps S25 to S29 thereafter.
- FIG. 7 The above-described cooperation between the devices is illustrated in FIG. 7 when illustrated together with the transition of the video displayed on the display 32 at the time of the cooperation.
- the processing performed by the ACR server 13, the command server 14, and the application server 15 for the receiving device 12 can be provided as a so-called cloud computing service. Therefore, in FIG. 7, the services provided by the ACR server 13, the command server 14, and the application server 15 are illustrated as an ACR identification service, a command providing service, and an application providing service, respectively.
- channel A (CH-A)
- the video P1 of the program CH-A is displayed on the display 32.
- the receiving device 12 periodically extracts fingerprint information (features) from the video signal and audio signal of the selected channel CH-A (S12-1), and transmits it to the ACR server 13 (S12-1). S13-1).
- the ACR server 13 executes the ACR identification service to identify the program CH-A being selected by the receiving device 12 and provides the identification result to the receiving device 12.
- the receiving device 12 accesses the command server 14 according to the identification result from the ACR server 13 and inquires about a command that can be executed by the receiving device 12.
- the command server 14 provides the receiving device 12 with a command corresponding to the inquiry from the receiving device 12 by executing a command providing service.
- the receiving device 12 accesses the application server 15 to access the data broadcasting application. Is requested (S19-1).
- the application server 15 provides the data broadcasting application to the receiving device 12 in response to a request from the receiving device 12 by executing the application providing service.
- the receiving device 12 registers the data broadcast application acquired from the application server 15 (S19-1).
- the receiving device 12 activates the acquired data broadcasting application. (S19-2).
- the video P2 in which the data broadcasting application CH-A indicating the program related information related to the program CH-A is superimposed on the program CH-A is displayed on the display 32.
- the receiving device 12 continues to extract and transmit fingerprint information (S12-2,..., S13-2,...), And according to the identification result from the ACR server 13, A command is acquired from the command server 14. Then, the receiving device 12 controls the operation of the data broadcasting application CH-A according to the acquired command (S19-3).
- the receiving device 12 uses, for example, the first to fourth detection methods described above. Channel switching is detected by any one of the detection methods (S24). Then, the receiving device 12 extracts fingerprint information from the video signal and audio signal of the program viewed after detecting the channel switching (S25), and transmits the fingerprint information to the ACR server 13 (S26). Get the identification result.
- the receiving device 12 compares the channel identification information of programs that are viewed before and after the detection of channel switching. If the channel identification information of these programs is different, the channel has been switched normally. Forcibly terminate application CH-A. In this case, only the video P3 of the program CH-B after detection of channel switching is displayed on the display 32. On the other hand, if the channel identification information of the program before and after the detection of channel switching is the same, for example, if it is a false detection, the channel has not been switched for some reason, so the data broadcasting application CH-A is continuously executed. Let In this case, the video P2 on which the data broadcasting application CH-A is superimposed on the program CH-A is displayed on the display 32 as it is, as before detection of channel switching.
- the data broadcasting application that is executed in conjunction with the program before the channel switching is detected is forcibly terminated, and only the program after the channel switching is displayed. .
- the data broadcasting application for the program that was selected before the channel switching from being continuously displayed as it is after the channel switching.
- the channel A (CH-A) is switched to the channel B (CH-B) as shown in FIG.
- Data broadcasting application CH-A is executed as it is.
- the video P4 in which the data broadcasting application CH-A is superimposed on the program CH-B is displayed on the display 32.
- the data broadcasting application CH-A is periodically extracted with fingerprint information until a command (terminating command to be described later) for ending the data broadcasting application being executed is acquired. The execution is continued and displayed superimposed on the program CH-B.
- the program CH-B is displayed by switching the channel
- the data broadcasting application CH-A for the program CH-A that is not related to the program CH-B is displayed.
- the channel switching is detected when the channel is switched, and the data broadcasting application is forcibly terminated when the channel switching is normally performed. .
- the cooperation between the devices constituting the broadcasting system 1 allows the receiving device 12 to perform data broadcasting according to the identification result obtained by the ACR identification processing for the program being viewed. It becomes possible to provide an application.
- the receiving device 12 when the channel of the program being viewed is switched, the data broadcasting application is forcibly terminated. Therefore, even when the channel is switched, the program and the data broadcasting application are synchronized. be able to.
- FIG. 9 shows an example of information items included in the command.
- Communication ID is information for identifying the command.
- the command ID of each command is the same.
- the “command effective time” is specified by any one of “absolute date”, “relative time”, and “PTS” indicating the time when the command is executed.
- “Absolute date and time” is specified when a command is executed when a specific date and time set in advance is reached regardless of the progress of the program.
- the “relative time” is specified when a command is executed when a specific time has elapsed from a reference time in the program. For example, as the relative time, a relative time from the start time of the program is designated.
- PTS Presentation Time Stamp
- the “command target device type” designates a device that is subject to data broadcast application control by the command.
- the external device is designated as the target device of the command.
- Command action means that the commands are “app acquisition” (Register), “app start” (Execute), “app end” (Terminate), “event firing” (Inject_event), “app suspend” (Suspend) Indicates whether it is either.
- the register command is a command for instructing the receiving device 12 to acquire or register a data broadcasting application.
- the registration of the data broadcasting application means that the priority and the expiration date are stored in association with the acquired data broadcasting application.
- the data broadcasting application is managed by the control unit 64 according to the priority and the retention period.
- the execute (Execute) command is a command for instructing the receiving device 12 to acquire or start a data broadcasting application.
- Terminate command is a command for causing the receiving device 12 to terminate the data broadcasting application being executed.
- the inject event (Inject_event) command is a command for causing the receiving device 12 to fire an event in the data broadcasting application being executed.
- the suspend command is a command for causing the receiving device 12 to pause the data broadcasting application being executed.
- the “command application distribution parameter” is a parameter for stochastically distributing the timing of applying the command in the target device such as the receiving device 12. Since the timing for accessing the command server 14 and the application server 15 is adjusted by this parameter, it is possible to reduce the load by distributing access to the server.
- Application ID is identification information of the data broadcasting application corresponding to the command.
- application type is information indicating the type of data broadcasting application corresponding to the command.
- operator ID is identification information of an operator (for example, a broadcasting station) that performs an execution service of a data broadcasting application corresponding to the command.
- App URL is information indicating the URL from which the data broadcasting application is acquired when the command action is “app acquisition” or “app activation”.
- App expiration date is information indicating the expiration date of the data broadcasting application.
- the “application holding priority” is information indicating a priority when acquiring and holding a data broadcasting application corresponding to the command. When a data broadcast application is registered, the application expiration date and the data broadcast application retention priority are stored, and the data broadcast application is managed according to the expiration date and priority.
- Event ID is identification information of an event to be fired in the data broadcasting application designated by the application ID when the command action is “event firing”.
- event additional data describes data that is referred to when an event is fired when the command action is “event firing”.
- the command element mainly includes a timing element, a diffusion element, an application element, and an event element in addition to a destination attribute and an action attribute.
- the destination attribute corresponds to the “command target device type” in FIG.
- “receiver” is specified when the target device of the command is the receiving device 12
- “external_1” or “external_2” is specified when the target device of the command is the external device.
- the action attribute corresponds to the “command action” in FIG.
- “execute” is designated when instructing acquisition or activation of the data broadcasting application
- “register” is designated when instructing acquisition or registration of the data broadcasting application.
- “suspend” is specified.
- “terminate” is designated when instructing the end of the data broadcasting application
- “event” is designated when the event is ignited in the data broadcasting application being executed.
- the “timing” element corresponds to the “command effective time” in FIG.
- the diffusion element corresponds to the “command application distribution parameter” in FIG.
- attributes of the diffusion element there are a rate attribute, a range attribute, and a period attribute, which specify the number of distributions, the maximum delay time, and the command application diffusion period, respectively.
- the application element corresponds to “application ID”, “application type”, “application URL”, “application retention priority”, and “application expiration date” in FIG. 9, and includes an id attribute, a type attribute, a url An attribute, a priority attribute, and an expire_date attribute are specified.
- the url attribute and expire_date attribute are indispensable items when the action attribute is “execute” or “register”.
- “0” is normally designated as the priority attribute
- “1” is designated when the priority is to be increased.
- the event element corresponds to the “event ID” and “event additional data” in FIG. 9, and an id attribute and a data attribute are designated.
- the event element is an indispensable item when the action attribute is “event”.
- FIG. 12 is a diagram illustrating a description example of a command.
- “receiver” is specified as the destination attribute and “execute” is specified as the action attribute in the command element. That is, the command is an execute command addressed to the receiving device 12.
- the timing element and application element are described between the start tag and end tag of the command element.
- timing element “pts” is specified as the unit attribute, and “1286743” is specified as the value. That is, the command is executed when the clock “1286743” has elapsed.
- “1” is specified as the id attribute
- “html” is specified as the type attribute
- “xxx.com/yyy” is specified as the url attribute
- “2011-01-21” is specified as the expire_date attribute. Yes. That is, it means that the data broadcasting application described in HTML (Hyper Text Markup Language) can be acquired from the application server 15 specified by the URL “xxx.com/yyy”.
- the command description method is arbitrary, and is not limited to FIG.
- FIG. 13 is a state transition diagram of the data broadcasting application that operates in the receiving device 12 in response to the register, execute, inject event, suspend, and terminate commands. As shown in the figure, the state of the data broadcasting application transitions to one of four types of a released state (Released), a ready state (Ready), a running state (Active), and a suspended state (Suspended). Is defined as
- the release state indicates a state in which the data broadcasting application is not acquired by the receiving device 12.
- the ready state indicates a state in which the data broadcasting application has been registered in the receiving device 12 and has not been activated.
- the executing state indicates a state in which the data broadcasting application is activated and is being executed.
- the dormant state is a state in which execution of the data broadcasting application is interrupted and information indicating the state at the time of the suspension is held in the save memory 69B.
- the register command is received, and when the data broadcasting application is acquired (registered) according to the register command, the data broadcasting application is in the ready state. Transition.
- the data broadcasting application When the data broadcasting application is transitioning to the running state or the paused state, a termination command is received, and when the data broadcasting application being executed is terminated according to the termination command, the data broadcasting application transitions to the ready state (in the figure). "A"). The transition to the ready state occurs not only based on the terminate command but also when another data broadcasting application is executed.
- the transition to the release state is made when the application expiration date of the command has elapsed (“B” in the figure).
- FIG. 14 shows the relationship between each command and state transition.
- FIG. 14 shows various types of commands received from the command server 14 and the application server 15 by transmitting the fingerprint information extracted from the AV content data such as programs and CMs to the ACR server 13 in the receiving device 12.
- the manner in which each of the data broadcasting applications is acquired is schematically shown.
- FIG. 14 similarly to FIGS. 7 and 8, it is assumed that the ACR identification service, the command providing service, and the application providing service are provided by the ACR server 13, the command server 14, and the application server 15, respectively.
- the data broadcasting application when the data broadcasting application is in the release state (when the data broadcasting application is not acquired in the receiving device 12), the data broadcasting application is acquired, held, and registered according to the register command. Transition to the ready state.
- the data broadcasting application when the data broadcasting application is in the ready state, the data broadcasting application is activated in response to the execute command.
- the data broadcasting application when the data broadcasting application is in the release state (when not acquired by another device) in another device other than the receiving device 12, the data broadcasting application is acquired according to the execute command. When activated, transition to the running state.
- the state is the running state. Will remain.
- the receiving apparatus 12 when the data broadcasting application is transitioning to the running state, the data broadcasting application is transitioned to the dormant state when the running data broadcasting application is interrupted in response to the suspend command. In the receiving device 12, when the data broadcasting application is transitioning to the dormant state, when the suspended data broadcasting application is resumed in response to the execute command, the receiving apparatus 12 transitions to the running state.
- the receiving device 12 when the data broadcasting application is transitioning to the running state, if channel switching is detected, the running data broadcasting application is forcibly terminated and put into the ready state. Transition.
- the data broadcasting application when the data broadcasting application is transitioning to the running state in the receiving device 12, the data broadcasting application is transitioned to the ready state when the running data broadcasting application is terminated in response to the terminate command.
- the data broadcasting application has transitioned to the ready state, the running state, or the suspension state, when the application expiration date of the data broadcasting application has elapsed, the data broadcasting application is deleted from the cache memory 68, The registration is deleted and a transition is made to the release state.
- FIG. 15 and FIG. 16 show command response processing (hereinafter referred to as command response processing according to the ACR identification result) when the receiving device 12 receives a command according to the identification result obtained by the ACR identification processing.
- command response processing hereinafter referred to as command response processing according to the ACR identification result
- FIG. 15 is a flowchart for explaining command response processing according to the ACR identification result.
- the command corresponding processing according to the ACR identification result is performed when the user is watching a program, that is, when the receiving device 12 receives the digital television broadcast signal from the broadcasting device 11 or the set top box 19 via the CATV device 17. It is repeatedly executed while receiving the cable television broadcast signal from.
- step S111 the fingerprint extraction unit 60 determines whether or not a predetermined time has elapsed, waits for the predetermined time to elapse, and extracts fingerprint information from the video signal and audio signal of the program ( Step S112). That is, the fingerprint extraction unit 60 periodically extracts fingerprint information at a predetermined interval such as several seconds.
- step S113 the fingerprint extraction unit 60 controls the communication I / F 61 to transmit the extracted fingerprint information to the ACR server 13 via the Internet 16, and to identify the identification result of the program being selected. Inquire.
- the ACR server 13 performs ACR identification processing based on the fingerprint information, and transmits the identification result to the receiving device 12. If the ACR server 13 cannot obtain the program identification result, the identification result is not transmitted.
- step S114 the control unit 64 controls the communication I / F 61 to determine whether or not the identification result is received from the ACR server 13 that is the inquiry destination of the identification result.
- step S114 If it is determined in step S114 that the identification result has not been received, the process returns to step S111, and the subsequent processes are repeated. For example, when the fingerprint information is extracted when the receiving device 12 selects a channel that is not broadcasting, the ACR server 13 cannot identify the program and transmits the identification result. (The identification result is transmitted, but it may be indicated as not applicable).
- step S115 the control unit 64 analyzes the identification result of the currently selected program received by the communication I / F 61.
- channel identification information, time position information, and command acquisition destination information of the program being selected are obtained as identification results.
- the control unit 64 stores the channel identification information of the program being selected in the memory 65.
- step S116 the control unit 64 controls the communication I / F 61, accesses the command server 14 corresponding to the URL indicated by the command acquisition destination information, and transmits the channel identification information and the time position information, thereby receiving the reception device. 12 inquires about commands that can be executed.
- the command server 14 a command that can be executed in the time zone corresponding to the time position information in the program corresponding to the channel identification information is acquired and transmitted to the receiving device 12.
- step S117 the control unit 64 controls the communication I / F 61 to determine whether or not a command has been received from the command server 14 as a command inquiry destination.
- step S117 If it is determined in step S117 that no command has been received, the process returns to step S111, and the subsequent processes are repeated.
- the command server 14 if there is no command that matches the condition defined by the channel identification information and the time position information, the command is not transmitted (the command is transmitted but indicates that processing is not required). It may be)
- step S118 the command analysis unit 62 reads the command ID included in the command, and determines whether or not the processing from step S119 onward is already executed for the command. If it is determined that the processing after step S119 has already been executed, the processing returns to step S111, and the subsequent processing is repeated. On the other hand, if it is determined that the process after step S119 is not executed for the command, the process proceeds to step S119.
- step S119 the command analysis unit 62 reads the command action included in the command, and determines whether the command is one of a register, execute, terminate, inject event, or suspend.
- step S120 the command analysis unit 62 determines whether or not the determination result in step S119 is a register. If it is determined that the register is a register, the process proceeds to step S121.
- step S121 the control unit 64 controls the communication I / F 61 to access the application server 15 corresponding to the application URL of the command and acquire the data broadcasting application specified by the application ID.
- the data broadcast application acquired by the communication I / F 61 is held in the cache memory 68.
- the control unit 64 stores the application expiration date and the application holding priority in the memory 65 in association with the acquired data broadcasting application. Thereby, the data broadcast application held in the cache memory 68 is managed by the control unit 64 according to the expiration date and the holding priority.
- step S120 If it is determined in step S120 that the determination result in step S119 is not a register, the process proceeds to step S122.
- step S122 the control unit 64 determines whether or not the determination result in step S119 is execute. If it is determined to be execute, the process proceeds to step S123.
- step S123 the application engine 67 determines whether the data broadcasting application specified by the command ID of the command is in a suspended state (suspended state) according to the control from the control unit 64. Specifically, when data indicating a dormant state is saved in the data broadcasting application specified by the command ID in the save memory 69B, it is determined that the data is being paused.
- step S123 If it is determined in step S123 that the data broadcasting application specified by the command ID is not paused, the process proceeds to step S124.
- step S124 the application engine 67 acquires the data broadcasting application specified by the command ID if it has not been acquired (does not exist in the cache memory 68) according to the control from the control unit 64.
- step S125 the control unit 64 performs a synchronization control process.
- the details of the synchronization control processing will be described with reference to the flowchart of FIG.
- step S151 the control unit 64 determines whether or not the command effective time included in the command is set. *
- step S151 If it is determined in step S151 that the command effective time is set, the process proceeds to step S152.
- step S152 the control unit 64 determines whether it is time to execute the command.
- This command effective time is specified by, for example, absolute date / time, relative time, or PTS.
- an absolute date it is determined whether or not a specific date set in advance has been reached.
- the relative time for example, it is determined whether or not a specific time set in advance has elapsed from the start time of the program.
- PTS it is determined whether or not it is time to execute a command based on the clock from the clock synchronization unit 63.
- step S152 the determination process is repeated until it is determined that it is time to execute the command. That is, the execution of the command is waited until the time for executing the command is reached.
- step S152 If it is determined in step S152 that it is time to execute the command, the process returns to step S125 in FIG. 15, and the subsequent processes are executed.
- step S126 the application engine 67 terminates the data broadcasting application that is currently being executed, according to the control from the control unit 64.
- step S127 the application engine 67 activates the data broadcasting application specified by the command ID in accordance with the control from the control unit 64.
- the data broadcasting application is started after the time for executing the command has elapsed, so that, for example, data broadcasting is performed in accordance with the progress of the program. For example, or a data broadcasting application can be activated at a specific time zone.
- step S152 in FIG. 16 is skipped, and steps S126 and S127 are executed immediately after the acquisition process in step S124 is completed. Is done. In this case, immediately after an unacquired data broadcast application is acquired, the data broadcast application is activated.
- step S123 If it is determined in step S123 that the data broadcasting application specified by the command ID is in a suspended state (suspended state), the process proceeds to step S128.
- step S1208 the control unit 64 performs the synchronization control process of FIG. That is, when the command effective time is set, the process of step S129 is performed when the command execution time comes, and when the command effective time is not set, the process of step S129 is immediately performed. Is done.
- step S129 the application engine 67 moves the data in the save memory 69B to the work memory 69A according to the control from the control unit 64, and activates the data broadcasting application specified by the command ID. As a result, the suspended data broadcasting application specified by the command ID is resumed from the suspended state. Thereafter, the process returns to step S111, and the subsequent processes are repeated.
- step S130 the control unit 64 determines whether or not the determination result in step S119 is an injection event. If it is determined that the determination event is an injection event, the process proceeds to step S131.
- step S131 the control unit 64 performs the synchronization control process of FIG. That is, when the command effective time is set, the process of step S132 is performed when the command execution time is reached, and when the command effective time is not set, the process of step S132 is immediately performed. Is done.
- step S132 the control unit 64 controls the application engine 67 only when the command ID of the command matches the command ID of the operating data broadcasting application, and the command in the operating data broadcasting application is controlled. Fire (execute) the event corresponding to the event ID. Thereafter, the process returns to step S111, and the subsequent processes are repeated.
- step S130 determines whether the determination result in step S119 is not an injection event. If it is determined in step S130 that the determination result in step S119 is not an injection event, the process proceeds to step S133.
- step S133 the control unit 64 determines whether or not the determination result in step S119 is suspend. If it is determined that the process is suspend, the process proceeds to step S134.
- step S134 the control unit 64 performs the synchronization control process of FIG. That is, when the command effective time is set, the process of step S135 is performed when the command execution time is reached, and when the command effective time is not set, the process of step S135 is immediately performed. Is done.
- step S135 the application engine 67, in accordance with control from the control unit 64, indicates data indicating the state of the currently executing data broadcasting application (that is, data currently written in the work memory 69A. Hierarchical structure in the information to be displayed. If there is, the information indicating the hierarchy of the displayed information is saved in the save memory 69B. Thereafter, the process returns to step S111, and the subsequent processes are repeated.
- step S133 If it is determined in step S133 that the determination result in step S119 is not suspend, the determination result in step S119 is termination, and the process proceeds to step S136.
- step S136 the control unit 64 performs the synchronization control process of FIG. That is, when the command effective time is set, the process of step S137 is performed when the command execution time comes, and when the command effective time is not set, the process of step S137 is immediately performed. Is done.
- step S137 the application engine 67 terminates the data broadcasting application specified by the command ID if it is being executed in accordance with the control from the control unit 64.
- step S138 the application engine 67 deletes the data related to the data broadcasting application specified by the command ID from the work memory 69A and the save memory 69B according to the control from the control unit 64, and also stores the data broadcasting application in the cache memory. Erasing from 68. Thereafter, the process returns to step S111, and the subsequent processes are repeated.
- step S111 If it is determined in step S111 that it is not time to extract fingerprint information that is periodically performed, the process proceeds to step S139.
- step S139 the channel switching detection unit 70 detects channel switching and determines whether or not the channel has been switched. If it is determined in step S139 that the channel has not been switched, the process returns to step S111, and the subsequent processes are repeated.
- step S140 fingerprint information is extracted from the video signal and audio signal of the program by the fingerprint extraction unit 60 and transmitted to the ACR server 13 as in steps S112 to S114 described above. If the identification result from the ACR server 13 is received by the communication I / F 61, the process proceeds to step S143.
- the control unit 64 acquires channel identification information of a program to be viewed after channel switching detection obtained from the identification result from the communication I / F 61, and also performs channel switching from the memory 65. The channel identification information of the program that was viewed before the detection is read out.
- step S143 the control unit 64 compares the channel identification information of the programs before and after the channel switching detection, and determines whether or not the channel identification information matches.
- step S143 the application engine 67 terminates the data broadcast application specified by the command ID if it is being executed in accordance with the control from the control unit 64.
- step S145 the application engine 67 deletes the data related to the data broadcasting application specified by the command ID from the work memory 69A and the save memory 69B according to the control from the control unit 64, and also stores the data broadcasting application in the cache memory. Erasing from 68. Thereafter, the process returns to step S111, and the subsequent processes are repeated.
- step S143 if it is determined in step S143 that the channel identification information matches, for example, if it is a false detection, the channel has not been switched normally for some reason, so the processing in steps S144 and 145 is skipped. Returns to step S111, and the subsequent processing is repeated.
- steps S124 to S127 after acquiring an unacquired data broadcast application in steps S124 to S127 (S124), when the time to execute the command is reached (S125), the acquired data broadcast application is displayed.
- steps S124 and S125 may be reversed. That is, in this case, until the time for executing the command, the acquisition of the unacquired data broadcasting application is not performed, and when the time for executing the command is reached, the unacquired data broadcasting application is acquired, Will be launched.
- FIG. 17 is a diagram showing an example of an operation scenario when the command effective time is not set.
- the receiving device 12 periodically displays a video of a program being selected when a program of channel A (CH-A) corresponding to a digital television broadcast signal or a cable television broadcast signal is displayed on the display 32. Fingerprint information is extracted from the signal and transmitted to the ACR server 13. The ACR server 13 that has received the fingerprint information performs ACR identification processing, and the identification result is transmitted to the receiving device 12.
- CH-A program of channel A
- the receiving device 12 inquires of the command server 14 about the command according to the identification result from the ACR server 13, but if there is no command that can be executed by the receiving device 12, a response from the command server 14. Is not done.
- the receiving device 12 periodically extracts fingerprint information, and in response thereto, inquiries to the ACR server 13 and the command server 14 are continuously performed.
- the receiving device 12 accesses the application server 15 corresponding to the application URL, acquires the data broadcasting application, and executes it.
- the program of channel A (CH-A) displayed on the display 32 includes program related information (“Video Synchronized application” in the figure) corresponding to the data broadcasting application for channel A (CH-A). Etc. are superimposed and displayed.
- the receiving device 12 when the channel being selected is switched from channel A (CH-A) to channel B (CH-B), for example, the receiving device 12 performs, for example, the first detection method to the fourth detection described above. Channel switching is detected by any of the detection methods. Then, the receiving device 12 extracts fingerprint information from the video signal and audio signal of the program viewed after detecting the channel switching, and transmits the fingerprint information to the ACR server 13 to acquire the identification result of the program. The receiving device 12 compares the channel identification information of the programs displayed on the display 32 before and after the detection of the channel switching. If the channel identification information of these programs is different, the channel has been switched normally. Forcibly terminate the data broadcasting application. As a result, the program related information superimposed on the channel A (CH-A) program is erased, and only the channel B (CH-B) program is displayed.
- CH-A channel A
- CH-B channel B
- the receiving device 12 accesses the application server 15 corresponding to the application URL and acquires the data broadcasting application. And run. Thereby, the program related information corresponding to the data broadcasting application for channel B (CH-B) (“Video Synchronized application” in the figure) is displayed on the program of channel B (CH-B) displayed on the display 32. Etc. are superimposed and displayed.
- the execute command has been described as the command received from the command server 14 in the receiving device 12, but other commands may be received. For example, if an inject event command is received during the execution of the data broadcasting application, the event is ignited in the data broadcasting application being executed, and if the suspend command is received, the data being executed Broadcast application is suspended. Further, for example, when a terminate command is received during execution of the data broadcast application, the data broadcast application being executed is terminated.
- the receiving device 12 since the command effective time is not set for the command transmitted by the command server 14, the receiving device 12 immediately executes the command received from the command server 14. become. In the receiving device 12, when the channel is switched, the data broadcasting application being executed is forcibly terminated.
- FIG. 18 is a diagram showing an example of an operation scenario when the command effective time is set.
- the receiving device 12 periodically extracts fingerprint information, and when receiving an execute command from the ACR server 13, the receiving device 12 accesses the application server 15 corresponding to the application URL and selects a data broadcasting application. get.
- the command effective time is set for the execute command
- execution of the execute command is waited until the time for executing the command is reached after acquiring the data broadcasting application (in the figure). "Waiting for sync").
- program related information corresponding to a data broadcasting application is displayed in synchronization with a specific scene of a program on channel A (CH-A)
- the time for synchronization with the specific scene is the command effective time. Since it is described, the data broadcasting application is started after waiting for the time to execute the command.
- the specific scene of the program of channel A (CH-A) and the program related information (“Video Synchronized application” in the figure) can be synchronized.
- the receiving device 12 detects channel switching, The data broadcasting application being executed is forcibly terminated. As a result, the program related information superimposed on the channel A (CH-A) program is erased, and only the channel B (CH-B) program is displayed.
- fingerprint information is continuously extracted, and when an execute command is received from the command server 14, the receiving device 12 accesses the application server 15 corresponding to the application URL and acquires a data broadcasting application. To do. In addition, the receiving device 12 waits for the time to execute the command and activates the data broadcasting application. Thereby, the program related information corresponding to the data broadcasting application for channel B (CH-B) (“Video Synchronized application” in the figure) is displayed on the program of channel B (CH-B) displayed on the display 32. Etc. are superimposed and displayed.
- CH-B Channel B
- the execute command has been described as the command received from the command server 14 in the receiving device 12, but other commands may be received.
- the event is ignited in the data broadcasting application being executed after the time for executing the command.
- a suspend command is received during execution of the data broadcasting application, the data broadcasting application being executed is suspended after waiting for the time to execute the command.
- a terminate command is received during execution of the data broadcasting application, the data broadcasting application being executed is terminated after waiting for the time to execute the command.
- the receiving device 12 since the command effective time is set for the command transmitted by the command server 14, the receiving device 12 waits for the time to execute the command and waits for the command server 14. The command received from will be executed. As a result, the receiving device 12 can execute a command at an arbitrary timing, not the resolution of fingerprint information extraction. In addition, when channel switching is detected, the receiving device 12 forcibly terminates the data broadcasting application that is being executed. Therefore, the receiving device 12 executes at the timing of channel switching, not the resolution of fingerprint information extraction. The data broadcasting application inside can be terminated.
- FIG. 19 shows a broadcast system 1 according to the second embodiment.
- an AV amplifier 41 having a function as an AV selector is connected between the receiving device 12 and the set top box 19 as compared with FIG. 1.
- the AV amplifier 41 has an input / output unit conforming to the HDMI standard, and an electronic device having an HDMI terminal such as a game machine 42 or an electronic device 43 is connected to the input side of the AV amplifier 41, for example,
- the receiving device 12 is connected to the output side via the HDMI cable 20.
- the AV amplifier 41 selects desired AV content from among a plurality of AV contents input from a plurality of electronic devices connected to the input side, and outputs the selected AV content to the receiving device 12 connected to the output side.
- the receiving device 12 detects the switching of the AV content to be viewed according to the AV content selection result by the AV amplifier 41. When the switching of the AV content to be viewed is detected, the receiving device 12 ends the data broadcasting application being executed in conjunction with the AV content.
- FIG. 20 illustrates a configuration example of the receiving device 12 of FIG.
- the input to the channel switching detection unit 70 is different from that in FIG. That is, in FIG. 20, only the notification signal from the HDMI terminal 59 is input to the channel switching detection unit 70.
- the HDMI terminal 59 inputs audio signals and video signals of AV content from the switching destination electronic device that are input via the HDMI cable 20 when the electronic device selected by the AV amplifier 41 is switched. Are supplied to the selector 54 and the selector 57, respectively.
- the HDMI terminal 59 outputs a notification signal for notifying the switching to the channel switching detection unit 70.
- the receiving device 12 when the input to the HDMI terminal 59 is switched from AV content from the set top box 19 to AV content from the game machine 42, the clock signal from the AV amplifier 41 becomes discontinuous and synchronized. Will need to be resynchronized.
- the HDMI terminal 59 outputs a notification signal for notifying switching of input AV content to the channel switching detection unit 70. Then, when the notification signal from the HDMI terminal 59 is detected, the channel switching detection unit 70 can detect switching of the AV content to be viewed and supply the detection result to the control unit 64.
- the AV amplifier 41 switches the input from the set-top box 19 to the game machine 42, when the data broadcasting application is superimposed on the cable television program in the receiving device 12, the data broadcasting is performed.
- the game screen can be displayed after the game application is terminated.
- the receiving apparatus 12 uses the AV content selection result output from the AV amplifier 41 as the fifth detection method in addition to the first detection method to the fourth detection method described above.
- a method of detecting switching of the AV content to be viewed can be employed.
- FIG. 21 is a diagram illustrating a specific example of a broadcasting system to which the present technology is applied.
- the AV content (“Content” in the figure) provided from the content provider (Content Provider) is assigned metadata related to the program (“Metadata” in the figure), and the broadcasting device 11 (“TV1” in the figure) that directly receives a digital television broadcast signal from 11 (“ASP (Authorized Service Provider)” in the figure) can acquire metadata transmitted together with the AV content. Therefore, the receiving device obtains and executes a data broadcasting application (“Application” in the figure) by accessing the application server 15 managed by a broadcaster or the like based on the metadata. Is possible.
- the receiving device 12 when receiving a digital television broadcast signal from the broadcasting device 11 via a CATV network or a satellite communication network, the signal after conversion by the set top box 19 (“STB (Set Top Box)” in the figure). Is received by the receiving device 12 (“TV2” in the figure) via the HDMI cable 20. In this case, the output from the set top box 19 is only AV content, metadata cannot be used, and information regarding the program cannot be acquired. Therefore, the receiving device 12 acquires the identification result by transmitting the fingerprint information (“Fingerprint” in the drawing) extracted from the AV content to the ACR server 13. Further, the receiving device 12 acquires a command from the command server 14 in accordance with the identification result from the ACR server 13. The receiving device 12 can acquire and execute a data broadcast application from the application server 15 in accordance with a command from the command server 14.
- STB Set Top Box
- the broadcasting system to which this technology is applied realizes a data broadcasting content service that is executed in conjunction with the program even when the program is retransmitted via the CATV network or satellite communication network. can do. That is, for example, as shown in FIGS. 1 and 19, the present technology is not limited to the case where the receiving device 12 directly receives a digital television broadcast signal from the broadcasting device 11, but also includes a CATV network 18 and a satellite communication network. As described above, since the set-top box 19 or the like is used, the present invention can also be applied to a case where metadata transmitted together with AV content cannot be sent to the receiving device 12.
- FIG. 22 shows a communication system 81 according to the present embodiment.
- a distribution server 91 connected to the Internet 16 is provided instead of the broadcasting device 11, the CATV device 17, the CATV network 18, and the set top box 19.
- the distribution server 91 distributes AV content such as VOD content to the receiving device 12 via the Internet 16 in response to a request from the receiving device 12.
- the receiving device 12 extracts fingerprint information from the video signal and audio signal of the VOD content from the distribution server 91 and transmits the fingerprint information to the ACR server 13.
- the ACR server 13 performs ACR identification processing.
- content identification information, time position information, and command acquisition destination information are transmitted as identification results. That is, when AV content from the broadcast apparatus 11 is acquired, channel identification information is obtained as an identification result.
- content identification information such as a content ID is identified. As a result.
- the receiving device 12 inquires about a command that can be executed by the receiving device 12 by accessing the command server 14 corresponding to the URL described in the command acquisition destination information and transmitting the content identification information and the time position information. . Then, the receiving device 12 controls the operation of the data broadcast application in accordance with the command from the command server 14.
- the receiving device 12 can receive the AV content not only via the broadcast network but also via the communication network. Since AV content received from either the broadcast network or the communication network is identified by the ACR server 13, the receiving device 12 can acquire a command according to the identification result from the command server 14. it can. Further, when channel switching is detected, the receiving device 12 inquires of the ACR server 13 about the identification result of the VOD content. Then, the receiving device 12 compares the content identification information obtained before and after the channel switching detection, and when the channel is switched normally, the data broadcast displayed superimposed on the VOD content before the channel switching. The app can be terminated.
- the ACR server 13 may transmit the identification result directly to the command server 14 without transmitting it to the receiving device 12.
- the receiving device 12 transmits the fingerprint information to the ACR server 13
- the ACR server 13 performs ACR identification processing and transmits the identification result to the command server 14.
- the command server 14 sends the command to the receiving device 12 according to the identification result from the ACR server 13.
- the receiving device 12 can perform an operation such as acquiring a command from the command server 14 only by transmitting the fingerprint information to the ACR server 13.
- the command server 14 transmits the data broadcast application acquisition command directly to the application server 15 without transmitting it to the reception apparatus 12.
- the fingerprint information is sent to the ACR server 13.
- an operation such as acquiring a data broadcasting application from the application server 15 becomes possible.
- the receiving device 12 and the set top box 19 and the AV amplifier 41 are configured to perform communication according to the HDMI standard.
- the communication standard is not limited to the HDMI standard, and at least the set top box 19 or the like. Any configuration is possible as long as data communication including video signals, audio signals, and control signals is possible.
- the series of processes described above can be executed by hardware or software.
- a program constituting the software is installed in the computer.
- the computer includes, for example, a general-purpose personal computer capable of executing various functions by installing a computer incorporated in dedicated hardware and various programs.
- FIG. 23 is a block diagram illustrating a configuration example of hardware of a computer that executes the above-described series of processes by a program.
- a CPU Central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- An input / output interface 105 is further connected to the bus 104.
- An input unit 106, an output unit 107, a recording unit 108, a communication unit 109, and a drive 110 are connected to the input / output interface 105.
- the input unit 106 includes a keyboard, a mouse, a microphone, and the like.
- the output unit 107 includes a display, a speaker, and the like.
- the recording unit 108 includes a hard disk, a nonvolatile memory, and the like.
- the communication unit 109 includes a network interface or the like.
- the drive 110 drives a removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
- the CPU 101 loads, for example, the program stored in the recording unit 108 to the RAM 103 via the input / output interface 105 and the bus 104 and executes the program, as described above. A series of processing is performed.
- the program executed by the computer 100 can be provided by being recorded in, for example, a removable medium 111 such as a package medium.
- the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
- the program can be installed in the recording unit 108 via the input / output interface 105 by attaching the removable medium 111 to the drive 110.
- the program can be received by the communication unit 109 via a wired or wireless transmission medium and installed in the recording unit 108.
- the program can be installed in the ROM 102 or the recording unit 108 in advance.
- the program executed by the computer 100 may be a program that is processed in time series in the order described in this specification, or a necessary timing such as when the call is performed in parallel. It may be a program in which processing is performed.
- processing steps for describing a program for causing the computer 100 to perform various processes do not necessarily have to be processed in time series in the order described in the flowchart, and may be performed in parallel or individually. (For example, parallel processing or object processing).
- the program may be processed by one computer, or may be processed in a distributed manner by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.
- the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Accordingly, a plurality of devices housed in separate housings and connected via a network and a single device housing a plurality of modules in one housing are all systems. .
- the present technology can take a configuration of cloud computing in which one function is shared by a plurality of devices via a network and is jointly processed.
- each step described in the above-described flowchart can be executed by one device or can be shared by a plurality of devices.
- the plurality of processes included in the one step can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.
- this technique can take the following structures.
- the detection unit detects switching of a channel from the first AV content to a second AV content different from the first AV content; When the switching of the channel from the first AV content to the second AV content is detected, the control unit ends the application program that is executed in conjunction with the first AV content.
- the receiving device according to 1).
- a storage unit for storing first identification information for identifying the first AV content obtained from the identification result of the first AV content;
- the feature amount extraction unit extracts a feature amount from data of the second AV content when switching of the channel from the first AV content to the second AV content is detected;
- the identification result acquisition unit acquires the identification result of the second AV content identified using the extracted feature amount,
- the stored first identification information is different from the second identification result for identifying the second AV content obtained from the identification result of the second AV content,
- the receiving device according to (2), wherein the application program is terminated.
- the receiving unit directly receives the AV content transmitted from a transmitting device, The detection unit detects switching of the channel according to an operation of switching the channel from the first AV content to the second AV content with respect to the reception device. (2) or (3) Receiver device.
- the receiving unit is connected to an information processing apparatus that converts data of the AV content transmitted from a transmission apparatus according to the reception apparatus, in a manner compliant with the HDMI (High Definition Multimedia Interface) standard, Receiving the converted AV content from the information processing device;
- the detection unit detects switching of the channel from the first AV content to the second AV content according to the analysis result of the video signal of the AV content received from the information processing device.
- the receiving device according to (3).
- the detection unit may be configured such that a plurality of frames constituting the AV content are continuously displayed on the same screen for a predetermined period, or the plurality The receiving device according to (5), wherein channel switching is detected by analyzing whether or not the frame of the frame becomes a black screen continuously for a predetermined period.
- the detection unit detects switching of the channel from the first AV content to the second AV content according to the analysis result of the audio signal of the AV content received from the information processing device.
- the detection unit determines whether the sample of the audio signal is in a no-signal state in a predetermined section or whether the sample is in a discontinuous state in the predetermined section.
- the switching device according to (7), wherein channel switching is detected by analyzing whether or not.
- the receiving unit is connected to an information processing device that converts the data of the AV content transmitted from the transmission device according to the reception device in a method compliant with the HDMI standard, and is converted from the information processing device.
- Receiving the AV content of The detection unit detects switching of the channel according to an operation of switching the channel from the first AV content to the second AV content with respect to the information processing apparatus. (2) or (3) Receiver.
- the receiving unit is connected to a selection device that selects and outputs desired AV content from among a plurality of AV contents input from a plurality of information processing devices in a manner compliant with the HDMI standard, so that the selection is performed.
- ACR Automatic Content Recognition
- the receiving device according to any one of (1) to (11), wherein the feature amount extraction unit extracts the feature amount from one or both of a video signal and an audio signal of the AV content.
- the command indicates one of acquisition or registration, acquisition or activation, event firing, interruption, or termination of the application program
- the control unit controls acquisition, registration, acquisition, or activation of the application program, or event firing, suspension, or termination of the application program that is being executed in accordance with each command.
- the receiving apparatus in any one.
- the receiving device is: Receive AV content, Extracting feature values from the received AV content data; Obtaining an identification result of the AV content identified using the extracted feature quantity; According to the acquired identification result, a command for controlling the operation of an application program executed in conjunction with the AV content is acquired, In accordance with the acquired command, control the operation of the application program, Detecting switching of the AV content to be viewed; A receiving method including a step of ending the application program executed in conjunction with the AV content when switching of the AV content is detected.
- the receiving device is: A receiving unit for receiving AV content; A feature amount extraction unit that extracts a feature amount from the received AV content data; An identification result acquisition unit that transmits the extracted feature quantity to the first information processing apparatus and acquires an identification result of the AV content identified by using the feature quantity in the first information processing apparatus; , The identification result acquired from the first information processing apparatus is transmitted to the second information processing apparatus and executed in conjunction with the AV content according to the identification result from the second information processing apparatus.
- a command acquisition unit for acquiring a command for controlling the operation of the application program to be executed;
- a control unit that controls the operation of the application program acquired from the third information processing apparatus in response to the command acquired from the second information processing apparatus;
- a detection unit for detecting switching of the AV content to be viewed;
- the control unit ends the application program being executed in conjunction with the AV content
- the first information processing device includes a first providing unit that provides the identification result obtained by identifying the AV content using the feature amount in response to an inquiry from the receiving device,
- the second information processing apparatus A second providing unit for providing the command according to the identification result in response to an inquiry from the receiving device;
- the third information processing apparatus An information processing system comprising: a third providing unit that provides the application program according to the command in response to an inquiry from the receiving device.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Systems (AREA)
Abstract
Description
[放送システムの構成例]
図1は、第1の実施の形態である放送システム1を示している。この放送システム1は、放送装置11、受信装置12、ACRサーバ13、コマンドサーバ14、アプリサーバ15、CATV装置17、及びセットトップボックス19から構成される。
図2は、図1の受信装置12の構成例を示している。
次に、図3乃至図8を参照して、図1の放送システム1を構成する各装置間の連携について説明する。図3は、受信装置12でのチャンネル選局時と、チャンネル切り替え時における各装置間の連携を示すシーケンス図である。
次に、図9乃至図12を参照して、コマンドサーバ14により提供されるコマンドの詳細について説明する。図9は、コマンドに含まれる情報の項目の一例を示している。
図12は、コマンドの記述例を示す図である。
図13は、レジスタ、エクスキュート、インジェクトイベント、サスペンド、及びターミネートの各コマンドに応じて受信装置12にて動作するデータ放送用アプリの状態遷移図である。同図に示すように、データ放送用アプリの状態は、解放状態(Released)、準備状態(Ready)、実行中状態(Active)、又は休止状態(Suspended)の4種類のうちのいずれかに遷移していると定義される。
次に、受信装置12が、ACR識別処理により得られる識別結果に応じたコマンドを受信したときのコマンド対応処理(以下、ACR識別結果に応じたコマンド対応処理という)について、図15及び図16を参照して説明する。
受信装置12において、図15のACR識別結果に応じたコマンド対応処理を行うことで、例えば、図17及び図18に示すようなデータ放送用アプリの運用が可能となる。
[放送システムの他の構成例]
図19は、第2の実施の形態である放送システム1を示している。この放送システム1は、図1と比べて、受信装置12とセットトップボックス19の間に、AVセレクタとしての機能を有するAVアンプ41が接続されている。
図20は、図19の受信装置12の構成例を示している。この受信装置12では、図2と比べて、チャンネル切替検出部70に対する入力が異なっている。すなわち、図20において、チャンネル切替検出部70には、HDMI端子59からの通知信号のみが入力される。
また、本技術によれば、AVコンテンツに対応したメタデータがなくても、ACRサーバ13によりAVコンテンツの識別が行われるため、例えば、以下のような運用が可能となる。
[通信システムの構成例]
前述した説明では、受信装置12が、放送装置11からのデジタルテレビジョン放送信号、又はCATV装置17からのケーブルテレビジョン放送信号に対応するAVコンテンツを受信する例を説明したが、AVコンテンツは、インターネット16を介してVOD(Video On Demand)により配信されるようにしてもよい。
前述した一連の処理は、ハードウェアにより実行することもできるし、ソフトウェアにより実行することもできる。一連の処理をソフトウェアにより実行する場合には、そのソフトウェアを構成するプログラムが、コンピュータにインストールされる。ここで、コンピュータには、専用のハードウェアに組み込まれているコンピュータや、各種のプログラムをインストールすることで、各種の機能を実行することが可能な、例えば汎用のパーソナルコンピュータなどが含まれる。
AVコンテンツを受信する受信部と、
受信した前記AVコンテンツのデータから特徴量を抽出する特徴量抽出部と、
抽出した前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得する識別結果取得部と、
取得した前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得するコマンド取得部と、
取得した前記コマンドに応じて、前記アプリケーションプログラムの動作を制御する制御部と、
視聴される前記AVコンテンツの切り替えを検出する検出部と
を備え、
前記制御部は、前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
受信装置。
(2)
前記検出部は、第1のAVコンテンツから、前記第1のAVコンテンツと異なる第2のAVコンテンツへのチャンネルの切り替えを検出し、
前記制御部は、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えが検出された場合、前記第1のAVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
(1)に記載の受信装置。
(3)
前記第1のAVコンテンツの前記識別結果から得られる前記第1のAVコンテンツを識別するための第1の識別情報を記憶する記憶部をさらに備え、
前記特徴量抽出部は、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えが検出された場合、前記第2のAVコンテンツのデータから特徴量を抽出し、
前記識別結果取得部は、抽出した前記特徴量を用いて識別された前記第2のAVコンテンツの識別結果を取得し、
前記制御部は、記憶された前記第1の識別情報と、前記第2のAVコンテンツの識別結果から得られる前記第2のAVコンテンツを識別するための第2の識別結果とが異なる場合、前記アプリケーションプログラムを終了させる
(2)に記載の受信装置。
(4)
前記受信部は、送信装置から送信される前記AVコンテンツを直接受信し、
前記検出部は、前記受信装置に対する前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えの操作に応じて、当該チャンネルの切り替えを検出する
(2)又は(3)に記載の受信装置。
(5)
前記受信部は、送信装置から送信される前記AVコンテンツのデータを前記受信装置に応じて変換する情報処理装置と、HDMI(High Definition Multimedia Interface)規格に準拠した方式で接続されることで、前記情報処理装置から変換後の前記AVコンテンツを受信し、
前記検出部は、前記情報処理装置から受信した前記AVコンテンツのビデオ信号の解析結果に応じて、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えを検出する
(2)又は(3)に記載の受信装置。
(6) 前記検出部は、前記情報処理装置から受信した前記AVコンテンツのビデオ信号に基づいて、前記AVコンテンツを構成する複数のフレームが所定の区間連続して同一画面となるか、又は前記複数のフレームが所定の区間連続して黒画面となるかを解析することで、チャンネルの切り替えを検出する
(5)に記載の受信装置。
(7)
前記検出部は、前記情報処理装置から受信した前記AVコンテンツのオーディオ信号の解析結果に応じて、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えを検出する
(2)、(3)、又は(5)のいずれかに記載の受信装置。
(8)
前記検出部は、前記情報処理装置から受信した前記AVコンテンツのオーディオ信号に基づいて、前記オーディオ信号のサンプルが所定の区間で無信号状態になるかと、前記サンプルが所定の区間で不連続状態になるかを解析することで、チャンネルの切り替えを検出する
(7)に記載の受信装置。
(9)
前記受信部は、送信装置から送信される前記AVコンテンツのデータを前記受信装置に応じて変換する情報処理装置と、HDMI規格に準拠した方式で接続されることで、前記情報処理装置から変換後の前記AVコンテンツを受信し、
前記検出部は、前記情報処理装置に対する前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えの操作に応じて、当該チャンネルの切り替えを検出する
(2)又は(3)に記載の受信装置。
(10)
前記受信部は、複数の情報処理装置から入力される複数のAVコンテンツの中から所望のAVコンテンツを選択して出力する選択装置と、HDMI規格に準拠した方式で接続されることで、前記選択装置から出力される前記AVコンテンツを受信し、
前記検出部は、前記選択装置による前記AVコンテンツの選択結果に応じて、視聴される前記AVコンテンツの切り替えを検出する
(1)に記載の受信装置。
(11)
前記識別結果取得部は、抽出した前記特徴量からACR(Automatic Content Recognition)技術を用いて識別される前記AVコンテンツの識別結果を取得する
(1)乃至(10)のいずれかに記載の受信装置。
(12)
前記特徴量抽出部は、前記AVコンテンツのビデオ信号及びオーディオ信号のいずれか一方又は双方から前記特徴量を抽出する
(1)乃至(11)のいずれかに記載の受信装置。
(13)
前記コマンドは、前記アプリケーションプログラムの取得若しくは登録、取得若しくは起動、イベント発火、中断、又は終了のうちのいずれかを示しており、
前記制御部は、各コマンドに応じて、前記アプリケーションプログラムの取得若しくは登録、若しくは取得若しくは起動、又は実行中の前記アプリケーションプログラムのイベント発火、休止、若しくは終了を制御する
(1)乃至(12)のいずれかに記載の受信装置。
(14)
受信装置の受信方法において
前記受信装置が、
AVコンテンツを受信し、
受信した前記AVコンテンツのデータから特徴量を抽出し、
抽出した前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得し、
取得した前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得し、
取得した前記コマンドに応じて、前記アプリケーションプログラムの動作を制御し、
視聴される前記AVコンテンツの切り替えを検出し、
前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
ステップを含む受信方法。
(15)
コンピュータに、
AVコンテンツを受信し、
受信した前記AVコンテンツのデータから特徴量を抽出し、
抽出した前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得し、
取得した前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得し、
取得した前記コマンドに応じて、前記アプリケーションプログラムの動作を制御し、
視聴される前記AVコンテンツの切り替えを検出し、
前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
ステップを含む処理を実行させるためのプログラム。
(16)
受信装置、第1の情報処理装置、第2の情報処理装置、及び第3の情報処理装置から構成される情報処理システムにおいて、
前記受信装置は、
AVコンテンツを受信する受信部と、
受信した前記AVコンテンツのデータから特徴量を抽出する特徴量抽出部と、
抽出した前記特徴量を前記第1の情報処理装置に送信して、前記第1の情報処理装置にて前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得する識別結果取得部と、
前記第1の情報処理装置から取得した前記識別結果を前記第2の情報処理装置に送信して、前記第2の情報処理装置から、前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得するコマンド取得部と、
前記第2の情報処理装置から取得した前記コマンドに応じて、前記第3の情報処理装置から取得した前記アプリケーションプログラムの動作を制御する制御部と、
視聴される前記AVコンテンツの切り替えを検出する検出部と
を備え、
前記制御部は、前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させ、
前記第1の情報処理装置は、 前記受信装置からの問い合わせに応じて、前記特徴量を用いて前記AVコンテンツを識別することで得られる前記識別結果を提供する第1の提供部を備え、
前記第2の情報処理装置は、
前記受信装置からの問い合わせに応じて、前記識別結果に応じた前記コマンドを提供する第2の提供部を備え、
前記第3の情報処理装置は、
前記受信装置からの問い合わせに応じて、前記コマンドに応じた前記アプリケーションプログラムを提供する第3の提供部を備える
情報処理システム。
Claims (16)
- AVコンテンツを受信する受信部と、
受信した前記AVコンテンツのデータから特徴量を抽出する特徴量抽出部と、
抽出した前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得する識別結果取得部と、
取得した前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得するコマンド取得部と、
取得した前記コマンドに応じて、前記アプリケーションプログラムの動作を制御する制御部と、
視聴される前記AVコンテンツの切り替えを検出する検出部と
を備え、
前記制御部は、前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
受信装置。 - 前記検出部は、第1のAVコンテンツから、前記第1のAVコンテンツと異なる第2のAVコンテンツへのチャンネルの切り替えを検出し、
前記制御部は、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えが検出された場合、前記第1のAVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
請求項1に記載の受信装置。 - 前記第1のAVコンテンツの前記識別結果から得られる前記第1のAVコンテンツを識別するための第1の識別情報を記憶する記憶部をさらに備え、
前記特徴量抽出部は、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えが検出された場合、前記第2のAVコンテンツのデータから特徴量を抽出し、
前記識別結果取得部は、抽出した前記特徴量を用いて識別された前記第2のAVコンテンツの識別結果を取得し、
前記制御部は、記憶された前記第1の識別情報と、前記第2のAVコンテンツの識別結果から得られる前記第2のAVコンテンツを識別するための第2の識別結果とが異なる場合、前記アプリケーションプログラムを終了させる
請求項2に記載の受信装置。 - 前記受信部は、送信装置から送信される前記AVコンテンツを直接受信し、
前記検出部は、前記受信装置に対する前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えの操作に応じて、当該チャンネルの切り替えを検出する
請求項2に記載の受信装置。 - 前記受信部は、送信装置から送信される前記AVコンテンツのデータを前記受信装置に応じて変換する情報処理装置と、HDMI(High Definition Multimedia Interface)規格に準拠した方式で接続されることで、前記情報処理装置から変換後の前記AVコンテンツを受信し、
前記検出部は、前記情報処理装置から受信した前記AVコンテンツのビデオ信号の解析結果に応じて、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えを検出する
請求項2に記載の受信装置。 - 前記検出部は、前記情報処理装置から受信した前記AVコンテンツのビデオ信号に基づいて、前記AVコンテンツを構成する複数のフレームが所定の区間連続して同一画面となるか、又は前記複数のフレームが所定の区間連続して黒画面となるかを解析することで、チャンネルの切り替えを検出する
請求項5に記載の受信装置。 - 前記検出部は、前記情報処理装置から受信した前記AVコンテンツのオーディオ信号の解析結果に応じて、前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えを検出する
請求項5に記載の受信装置。 - 前記検出部は、前記情報処理装置から受信した前記AVコンテンツのオーディオ信号に基づいて、前記オーディオ信号のサンプルが所定の区間で無信号状態になるかと、前記サンプルが所定の区間で不連続状態になるかを解析することで、チャンネルの切り替えを検出する
請求項7に記載の受信装置。 - 前記受信部は、送信装置から送信される前記AVコンテンツのデータを前記受信装置に応じて変換する情報処理装置と、HDMI規格に準拠した方式で接続されることで、前記情報処理装置から変換後の前記AVコンテンツを受信し、
前記検出部は、前記情報処理装置に対する前記第1のAVコンテンツから前記第2のAVコンテンツへのチャンネルの切り替えの操作に応じて、当該チャンネルの切り替えを検出する
請求項2に記載の受信装置。 - 前記受信部は、複数の情報処理装置から入力される複数のAVコンテンツの中から所望のAVコンテンツを選択して出力する選択装置と、HDMI規格に準拠した方式で接続されることで、前記選択装置から出力される前記AVコンテンツを受信し、
前記検出部は、前記選択装置による前記AVコンテンツの選択結果に応じて、視聴される前記AVコンテンツの切り替えを検出する
請求項1に記載の受信装置。 - 前記識別結果取得部は、抽出した前記特徴量からACR(Automatic Content Recognition)技術を用いて識別される前記AVコンテンツの識別結果を取得する
請求項1に記載の受信装置。 - 前記特徴量抽出部は、前記AVコンテンツのビデオ信号及びオーディオ信号のいずれか一方又は双方から前記特徴量を抽出する
請求項1に記載の受信装置。 - 前記コマンドは、前記アプリケーションプログラムの取得若しくは登録、取得若しくは起動、イベント発火、中断、又は終了のうちのいずれかを示しており、
前記制御部は、各コマンドに応じて、前記アプリケーションプログラムの取得若しくは登録、若しくは取得若しくは起動、又は実行中の前記アプリケーションプログラムのイベント発火、休止、若しくは終了を制御する
請求項1に記載の受信装置。 - 受信装置の受信方法において
前記受信装置が、
AVコンテンツを受信し、
受信した前記AVコンテンツのデータから特徴量を抽出し、
抽出した前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得し、
取得した前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得し、
取得した前記コマンドに応じて、前記アプリケーションプログラムの動作を制御し、
視聴される前記AVコンテンツの切り替えを検出し、
前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
ステップを含む受信方法。 - コンピュータに、
AVコンテンツを受信し、
受信した前記AVコンテンツのデータから特徴量を抽出し、
抽出した前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得し、
取得した前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得し、
取得した前記コマンドに応じて、前記アプリケーションプログラムの動作を制御し、
視聴される前記AVコンテンツの切り替えを検出し、
前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させる
ステップを含む処理を実行させるためのプログラム。 - 受信装置、第1の情報処理装置、第2の情報処理装置、及び第3の情報処理装置から構成される情報処理システムにおいて、
前記受信装置は、
AVコンテンツを受信する受信部と、
受信した前記AVコンテンツのデータから特徴量を抽出する特徴量抽出部と、
抽出した前記特徴量を前記第1の情報処理装置に送信して、前記第1の情報処理装置にて前記特徴量を用いて識別された前記AVコンテンツの識別結果を取得する識別結果取得部と、
前記第1の情報処理装置から取得した前記識別結果を前記第2の情報処理装置に送信して、前記第2の情報処理装置から、前記識別結果に応じて、前記AVコンテンツに連動して実行されるアプリケーションプログラムの動作を制御するためのコマンドを取得するコマンド取得部と、
前記第2の情報処理装置から取得した前記コマンドに応じて、前記第3の情報処理装置から取得した前記アプリケーションプログラムの動作を制御する制御部と、
視聴される前記AVコンテンツの切り替えを検出する検出部と
を備え、
前記制御部は、前記AVコンテンツの切り替えが検出された場合、前記AVコンテンツに連動して実行されている前記アプリケーションプログラムを終了させ、
前記第1の情報処理装置は、
前記受信装置からの問い合わせに応じて、前記特徴量を用いて前記AVコンテンツを識別することで得られる前記識別結果を提供する第1の提供部を備え、
前記第2の情報処理装置は、
前記受信装置からの問い合わせに応じて、前記識別結果に応じた前記コマンドを提供する第2の提供部を備え、
前記第3の情報処理装置は、
前記受信装置からの問い合わせに応じて、前記コマンドに応じた前記アプリケーションプログラムを提供する第3の提供部を備える
情報処理システム。
Priority Applications (10)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12833101.4A EP2760200A4 (en) | 2011-09-22 | 2012-09-03 | RECEIVING DEVICE, RECEIVING METHOD, PROGRAM, AND DATA PROCESSING SYSTEM |
CA2845593A CA2845593C (en) | 2011-09-22 | 2012-09-03 | Reception device, reception method, program, and information processing system |
CN201280044760.1A CN103814569B (zh) | 2011-09-22 | 2012-09-03 | 接收装置、接收方法、接收设备和信息处理*** |
BR112014006092A BR112014006092A2 (pt) | 2011-09-22 | 2012-09-03 | dispositivo de recepção, método de recepção, programa, e, sistema de processamento de informação |
KR1020147006557A KR102086870B1 (ko) | 2011-09-22 | 2012-09-03 | 수신 장치, 수신 방법, 프로그램 및 정보 처리 시스템 |
AU2012310795A AU2012310795B2 (en) | 2011-09-22 | 2012-09-03 | Reception device, reception method, program, and information processing system |
MX2014003104A MX336516B (es) | 2011-09-22 | 2012-09-03 | Dispositivo de recepcion, metodo de recepcion programa, y sistema de procesamiento de informacion. |
US14/241,759 US9503778B2 (en) | 2011-09-22 | 2012-09-03 | Reception device, reception method, program, and information processing system |
US15/290,814 US9967613B2 (en) | 2011-09-22 | 2016-10-11 | Reception device, reception method, program, and information processing system |
US15/356,009 US10440423B2 (en) | 2011-09-22 | 2016-11-18 | Reception device, reception method, program, and information processing system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011-207842 | 2011-09-22 | ||
JP2011207842A JP5948773B2 (ja) | 2011-09-22 | 2011-09-22 | 受信装置、受信方法、プログラム、及び情報処理システム |
Related Child Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/241,759 A-371-Of-International US9503778B2 (en) | 2011-09-22 | 2012-09-03 | Reception device, reception method, program, and information processing system |
US15/290,814 Continuation US9967613B2 (en) | 2011-09-22 | 2016-10-11 | Reception device, reception method, program, and information processing system |
US15/356,009 Continuation US10440423B2 (en) | 2011-09-22 | 2016-11-18 | Reception device, reception method, program, and information processing system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013042531A1 true WO2013042531A1 (ja) | 2013-03-28 |
Family
ID=47914308
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/072354 WO2013042531A1 (ja) | 2011-09-22 | 2012-09-03 | 受信装置、受信方法、プログラム、及び情報処理システム |
Country Status (10)
Country | Link |
---|---|
US (3) | US9503778B2 (ja) |
EP (1) | EP2760200A4 (ja) |
JP (1) | JP5948773B2 (ja) |
KR (1) | KR102086870B1 (ja) |
CN (1) | CN103814569B (ja) |
AU (1) | AU2012310795B2 (ja) |
BR (1) | BR112014006092A2 (ja) |
CA (1) | CA2845593C (ja) |
MX (1) | MX336516B (ja) |
WO (1) | WO2013042531A1 (ja) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105706457A (zh) * | 2013-11-15 | 2016-06-22 | 三星电子株式会社 | 显示装置和设置通用遥控器的方法 |
EP3026922A4 (en) * | 2013-07-26 | 2016-08-03 | Panasonic Ip Man Co Ltd | VIDEO RECEIVING DEVICE, ADDITIONAL INFORMATION DISPLAY PROCEDURE AND ADDITIONAL INFORMATION DISPLAY SYSTEM |
EP3043570A4 (en) * | 2013-09-04 | 2016-08-10 | Panasonic Ip Man Co Ltd | VIDEO RECEIVING DEVICE, VIDEO RECOGNITION METHOD, AND ADDITIONAL INFORMATION DISPLAY SYSTEM |
US9762951B2 (en) | 2013-07-30 | 2017-09-12 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, added-information display method, and added-information display system |
US9774924B2 (en) | 2014-03-26 | 2017-09-26 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method and additional information display system |
US9900650B2 (en) | 2013-09-04 | 2018-02-20 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method, and additional information display system |
US10194216B2 (en) | 2014-03-26 | 2019-01-29 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method, and additional information display system |
US10200765B2 (en) | 2014-08-21 | 2019-02-05 | Panasonic Intellectual Property Management Co., Ltd. | Content identification apparatus and content identification method |
US10298668B2 (en) | 2014-03-24 | 2019-05-21 | Square Enix Co., Ltd. | Interactive system, terminal apparatus, server apparatus, control method, program, and recording medium |
US10616613B2 (en) | 2014-07-17 | 2020-04-07 | Panasonic Intellectual Property Management Co., Ltd. | Recognition data generation device, image recognition device, and recognition data generation method |
Families Citing this family (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5372049B2 (ja) | 2011-02-04 | 2013-12-18 | 株式会社東芝 | メモリシステム |
US9501399B2 (en) * | 2011-02-04 | 2016-11-22 | Kabushiki Kaisha Toshiba | Memory system capable of controlling wireless communication function |
KR102060449B1 (ko) * | 2011-08-05 | 2019-12-30 | 소니 주식회사 | 수신 장치, 수신 방법, 프로그램 및 정보 처리 시스템 |
US9049496B2 (en) * | 2011-09-01 | 2015-06-02 | Gracenote, Inc. | Media source identification |
US9769503B2 (en) * | 2012-11-14 | 2017-09-19 | Saturn Licensing Llc | Information processor, information processing method and program |
US9146990B2 (en) * | 2013-01-07 | 2015-09-29 | Gracenote, Inc. | Search and identification of video content |
JP5838351B2 (ja) * | 2013-03-26 | 2016-01-06 | パナソニックIpマネジメント株式会社 | 映像受信装置及び受信映像の画像認識方法 |
JP2015167345A (ja) * | 2014-02-14 | 2015-09-24 | ミハル通信株式会社 | Catv監視装置およびcatv監視方法 |
CN104023251B (zh) * | 2014-06-13 | 2015-08-19 | 腾讯科技(深圳)有限公司 | 基于视频的互动方法和*** |
KR20160085076A (ko) * | 2015-01-07 | 2016-07-15 | 삼성전자주식회사 | 콘텐츠를 제공하는 방송 서버를 판단하는 방법 및 이를 제공하는 전자 장치 |
US10750236B2 (en) * | 2015-04-23 | 2020-08-18 | The Nielsen Company (Us), Llc | Automatic content recognition with local matching |
US9516377B1 (en) * | 2015-06-12 | 2016-12-06 | Sorenson Media, Inc. | Detecting channel change in automatic content recognition fingerprint matching |
US9918141B2 (en) * | 2015-08-05 | 2018-03-13 | Surewaves Mediatech Private Limited | System and method for monitoring and detecting television ads in real-time using content databases (ADEX reporter) |
US9699504B2 (en) * | 2015-09-28 | 2017-07-04 | Rovi Guides, Inc. | Systems and methods for identifying a source of media content based on a log of content identifiers |
US9854304B2 (en) | 2015-09-28 | 2017-12-26 | Rovi Guides, Inc. | Systems and methods for identifying a source of media content based on a log of fingerprints |
KR20170052364A (ko) * | 2015-11-04 | 2017-05-12 | 삼성전자주식회사 | 디스플레이장치 및 그 제어방법 |
EP3391651B1 (en) * | 2015-12-16 | 2022-08-10 | Roku, Inc. | Dynamic video overlays |
KR102560635B1 (ko) * | 2015-12-28 | 2023-07-28 | 삼성전자주식회사 | 컨텐트 인식 장치 및 그 동작 방법 |
KR102246597B1 (ko) * | 2016-01-05 | 2021-05-03 | 그레이스노트, 인코포레이티드 | 컨텐츠 특성 기반 트리거 피처를 갖는 컴퓨팅 시스템 |
US10063918B2 (en) | 2016-02-29 | 2018-08-28 | Gracenote, Inc. | Media channel identification with multi-match detection and disambiguation based on single-match |
US9930406B2 (en) | 2016-02-29 | 2018-03-27 | Gracenote, Inc. | Media channel identification with video multi-match detection and disambiguation based on audio fingerprint |
US9924222B2 (en) | 2016-02-29 | 2018-03-20 | Gracenote, Inc. | Media channel identification with multi-match detection and disambiguation based on location |
KR102504174B1 (ko) | 2018-05-11 | 2023-02-27 | 삼성전자주식회사 | 전자 장치 및 그의 제어방법 |
KR102546026B1 (ko) | 2018-05-21 | 2023-06-22 | 삼성전자주식회사 | 전자 장치 및 그의 컨텐츠 인식 정보 획득 |
KR102599951B1 (ko) * | 2018-06-25 | 2023-11-09 | 삼성전자주식회사 | 전자 장치 및 그의 제어방법 |
JP7313972B2 (ja) * | 2018-08-22 | 2023-07-25 | 日本放送協会 | 受信機および端末装置 |
KR20200080387A (ko) | 2018-12-18 | 2020-07-07 | 삼성전자주식회사 | 디스플레이 장치 및 그 제어 방법 |
AU2019457816A1 (en) * | 2019-07-19 | 2022-03-03 | Ibiquity Digital Corporation | Targeted fingerprinting of radio broadcast audio |
WO2023176997A1 (ko) * | 2022-03-17 | 2023-09-21 | 엘지전자 주식회사 | 디스플레이 장치 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005510145A (ja) * | 2001-11-16 | 2005-04-14 | タレス | コマンド付きの放送番組信号、関連コマンド書込み及び読取りシステム、制作及び放送チャネル |
JP2006245653A (ja) | 2005-02-28 | 2006-09-14 | Hitachi Kokusai Electric Inc | デジタル放送受信機 |
WO2007043483A1 (ja) * | 2005-10-07 | 2007-04-19 | Sharp Kabushiki Kaisha | 受信装置、サーバ、テレビ受像機、モバイル端末機器、システム、受信方法、情報処理プログラム、および記録媒体 |
JP2010182323A (ja) * | 2000-02-19 | 2010-08-19 | Digimarc Corp | 透かしエンコーダ及びデコーダイネーブルソフトウェア及び装置 |
JP2011155317A (ja) * | 2010-01-25 | 2011-08-11 | Canon Inc | デジタル放送受信装置、及びその制御方法 |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7372976B2 (en) | 1998-04-16 | 2008-05-13 | Digimarc Corporation | Content indexing and searching using content identifiers and associated metadata |
US8645838B2 (en) | 1998-10-01 | 2014-02-04 | Digimarc Corporation | Method for enhancing content using persistent content identification |
US8332478B2 (en) | 1998-10-01 | 2012-12-11 | Digimarc Corporation | Context sensitive connected content |
US20020032734A1 (en) | 2000-07-26 | 2002-03-14 | Rhoads Geoffrey B. | Collateral data combined with user characteristics to select web site |
US20020062382A1 (en) | 1999-05-19 | 2002-05-23 | Rhoads Geoffrey B. | Collateral data combined with other data to select web site |
US7298864B2 (en) | 2000-02-19 | 2007-11-20 | Digimarc Corporation | Digital watermarks as a gateway and control mechanism |
US8091025B2 (en) | 2000-03-24 | 2012-01-03 | Digimarc Corporation | Systems and methods for processing content objects |
US20030187798A1 (en) | 2001-04-16 | 2003-10-02 | Mckinley Tyler J. | Digital watermarking methods, programs and apparatus |
JP4370560B2 (ja) * | 2003-07-31 | 2009-11-25 | 日本電気株式会社 | 視聴調査システム、方法、視聴調査用プログラム、視聴調査端末およびサーバー |
WO2006126852A1 (en) | 2005-05-26 | 2006-11-30 | Electronics And Telecommunications Research Institute | Method and apparatus for synchronizing data service with video service in digital multimedia broadcasting |
CN101218819A (zh) * | 2005-05-26 | 2008-07-09 | 韩国电子通信研究院 | 数字多媒体广播中同步数据服务和视频服务的方法和装置 |
US8930984B2 (en) * | 2006-07-04 | 2015-01-06 | Koninklijke Philips N.V. | Method of content substitution |
US20080256115A1 (en) * | 2007-04-11 | 2008-10-16 | Oleg Beletski | Systems, apparatuses and methods for identifying transitions of content |
JP2009212743A (ja) | 2008-03-04 | 2009-09-17 | Sony Corp | 電子機器、送信方法及びプログラム |
JP4683067B2 (ja) * | 2008-04-17 | 2011-05-11 | ソニー株式会社 | 音声処理装置、音声処理方法およびプログラム |
US9390167B2 (en) * | 2010-07-29 | 2016-07-12 | Soundhound, Inc. | System and methods for continuous audio matching |
JP5152056B2 (ja) * | 2009-03-19 | 2013-02-27 | 富士通モバイルコミュニケーションズ株式会社 | 無線送信装置、無線受信装置および無線通信方法 |
DE102009016853A1 (de) * | 2009-04-08 | 2010-10-14 | Bayer Materialscience Ag | Verfahren zur Herstellung von Diaryl- oder Alkylarylcarbonaten aus Dialkylcarbonaten |
US20110063503A1 (en) * | 2009-07-06 | 2011-03-17 | Brand Steven M | Synchronizing secondary content to a multimedia presentation |
US8695053B2 (en) * | 2009-09-10 | 2014-04-08 | Jeffrey Huang | Apparatus and method for multimedia data reception, processing, routing, storage, and access using a web / cloud-computing synchronization of personal multimedia data |
US20110154200A1 (en) * | 2009-12-23 | 2011-06-23 | Apple Inc. | Enhancing Media Content with Content-Aware Resources |
JP5668512B2 (ja) * | 2011-02-15 | 2015-02-12 | ソニー株式会社 | 情報処理装置、及び、情報処理方法 |
-
2011
- 2011-09-22 JP JP2011207842A patent/JP5948773B2/ja active Active
-
2012
- 2012-09-03 US US14/241,759 patent/US9503778B2/en active Active
- 2012-09-03 CA CA2845593A patent/CA2845593C/en active Active
- 2012-09-03 EP EP12833101.4A patent/EP2760200A4/en not_active Ceased
- 2012-09-03 KR KR1020147006557A patent/KR102086870B1/ko active IP Right Grant
- 2012-09-03 MX MX2014003104A patent/MX336516B/es unknown
- 2012-09-03 BR BR112014006092A patent/BR112014006092A2/pt not_active Application Discontinuation
- 2012-09-03 AU AU2012310795A patent/AU2012310795B2/en active Active
- 2012-09-03 WO PCT/JP2012/072354 patent/WO2013042531A1/ja active Application Filing
- 2012-09-03 CN CN201280044760.1A patent/CN103814569B/zh active Active
-
2016
- 2016-10-11 US US15/290,814 patent/US9967613B2/en active Active
- 2016-11-18 US US15/356,009 patent/US10440423B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010182323A (ja) * | 2000-02-19 | 2010-08-19 | Digimarc Corp | 透かしエンコーダ及びデコーダイネーブルソフトウェア及び装置 |
JP2005510145A (ja) * | 2001-11-16 | 2005-04-14 | タレス | コマンド付きの放送番組信号、関連コマンド書込み及び読取りシステム、制作及び放送チャネル |
JP2006245653A (ja) | 2005-02-28 | 2006-09-14 | Hitachi Kokusai Electric Inc | デジタル放送受信機 |
WO2007043483A1 (ja) * | 2005-10-07 | 2007-04-19 | Sharp Kabushiki Kaisha | 受信装置、サーバ、テレビ受像機、モバイル端末機器、システム、受信方法、情報処理プログラム、および記録媒体 |
JP2011155317A (ja) * | 2010-01-25 | 2011-08-11 | Canon Inc | デジタル放送受信装置、及びその制御方法 |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3026922A4 (en) * | 2013-07-26 | 2016-08-03 | Panasonic Ip Man Co Ltd | VIDEO RECEIVING DEVICE, ADDITIONAL INFORMATION DISPLAY PROCEDURE AND ADDITIONAL INFORMATION DISPLAY SYSTEM |
US9955103B2 (en) | 2013-07-26 | 2018-04-24 | Panasonic Intellectual Property Management Co., Ltd. | Video receiving device, appended information display method, and appended information display system |
US9762951B2 (en) | 2013-07-30 | 2017-09-12 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, added-information display method, and added-information display system |
EP3043570A4 (en) * | 2013-09-04 | 2016-08-10 | Panasonic Ip Man Co Ltd | VIDEO RECEIVING DEVICE, VIDEO RECOGNITION METHOD, AND ADDITIONAL INFORMATION DISPLAY SYSTEM |
US9900650B2 (en) | 2013-09-04 | 2018-02-20 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method, and additional information display system |
US9906843B2 (en) | 2013-09-04 | 2018-02-27 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method, and display system for providing additional information to be superimposed on displayed image |
CN105706457A (zh) * | 2013-11-15 | 2016-06-22 | 三星电子株式会社 | 显示装置和设置通用遥控器的方法 |
US10298668B2 (en) | 2014-03-24 | 2019-05-21 | Square Enix Co., Ltd. | Interactive system, terminal apparatus, server apparatus, control method, program, and recording medium |
US11516284B2 (en) | 2014-03-24 | 2022-11-29 | Square Enix Co., Ltd. | Interactive system, terminal apparatus, server apparatus, control method, program, and recording medium |
US10735502B2 (en) | 2014-03-24 | 2020-08-04 | Square Enix Co., Ltd. | Interactive system, terminal apparatus, server apparatus, control method, program, and recording medium |
US9906844B2 (en) | 2014-03-26 | 2018-02-27 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method and additional information display system |
US10194216B2 (en) | 2014-03-26 | 2019-01-29 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method, and additional information display system |
US9774924B2 (en) | 2014-03-26 | 2017-09-26 | Panasonic Intellectual Property Management Co., Ltd. | Video reception device, video recognition method and additional information display system |
US10616613B2 (en) | 2014-07-17 | 2020-04-07 | Panasonic Intellectual Property Management Co., Ltd. | Recognition data generation device, image recognition device, and recognition data generation method |
US10200765B2 (en) | 2014-08-21 | 2019-02-05 | Panasonic Intellectual Property Management Co., Ltd. | Content identification apparatus and content identification method |
Also Published As
Publication number | Publication date |
---|---|
AU2012310795A1 (en) | 2014-03-20 |
EP2760200A4 (en) | 2015-03-18 |
US9503778B2 (en) | 2016-11-22 |
AU2012310795B2 (en) | 2017-06-08 |
US20170034573A1 (en) | 2017-02-02 |
BR112014006092A2 (pt) | 2017-04-04 |
US20140230002A1 (en) | 2014-08-14 |
US20170070771A1 (en) | 2017-03-09 |
CA2845593A1 (en) | 2013-03-28 |
US9967613B2 (en) | 2018-05-08 |
CN103814569B (zh) | 2017-09-12 |
US10440423B2 (en) | 2019-10-08 |
JP2013070268A (ja) | 2013-04-18 |
EP2760200A1 (en) | 2014-07-30 |
KR20140063686A (ko) | 2014-05-27 |
JP5948773B2 (ja) | 2016-07-06 |
MX336516B (es) | 2016-01-22 |
KR102086870B1 (ko) | 2020-03-09 |
CA2845593C (en) | 2020-01-28 |
MX2014003104A (es) | 2014-04-25 |
CN103814569A (zh) | 2014-05-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5948773B2 (ja) | 受信装置、受信方法、プログラム、及び情報処理システム | |
US11019406B2 (en) | Receiving device, receiving method, program, and information processing system | |
KR102001573B1 (ko) | 수신 장치, 수신 방법, 프로그램 및 정보 처리 시스템 | |
KR102017145B1 (ko) | 수신 장치, 수신 방법, 프로그램 및 정보 처리 시스템 | |
JP6250402B2 (ja) | 受信装置、受信方法、プログラム、及び情報処理システム | |
KR102019618B1 (ko) | 수신 장치, 수신 방법 및 프로그램 | |
JP2016001908A (ja) | 受信方法、受信装置、供給方法、および供給装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12833101 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012833101 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2845593 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14241759 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: 20147006557 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2014/003104 Country of ref document: MX |
|
ENP | Entry into the national phase |
Ref document number: 2012310795 Country of ref document: AU Date of ref document: 20120903 Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112014006092 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112014006092 Country of ref document: BR Kind code of ref document: A2 Effective date: 20140314 |