EP2785053A1 - Dispositif d'émission et dispositif de réception pour données vidéo en bande de base, et système d'émission/réception - Google Patents
Dispositif d'émission et dispositif de réception pour données vidéo en bande de base, et système d'émission/réception Download PDFInfo
- Publication number
- EP2785053A1 EP2785053A1 EP20120851594 EP12851594A EP2785053A1 EP 2785053 A1 EP2785053 A1 EP 2785053A1 EP 20120851594 EP20120851594 EP 20120851594 EP 12851594 A EP12851594 A EP 12851594A EP 2785053 A1 EP2785053 A1 EP 2785053A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- frame rate
- reception device
- video
- video signal
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 111
- 230000009467 reduction Effects 0.000 claims description 7
- 238000000034 method Methods 0.000 description 12
- 230000000717 retained effect Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- NRNCYVBFPDDJNE-UHFFFAOYSA-N pemoline Chemical compound O1C(N)=NC(=O)C1C1=CC=CC=C1 NRNCYVBFPDDJNE-UHFFFAOYSA-N 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/38—Transmitter circuitry for the transmission of television signals according to analogue transmission standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/006—Details of the interface to the display terminal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
- H04N21/25825—Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
- H04N21/4516—Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/0122—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
- G09G2330/02—Details of power systems and of start or stop of display operation
- G09G2330/021—Power management, e.g. power saving
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G2370/045—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller using multiple communication channels, e.g. parallel and serial
- G09G2370/047—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller using multiple communication channels, e.g. parallel and serial using display data channel standard [DDC] communication
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/14—Use of low voltage differential signaling [LVDS] for display data communication
Definitions
- the present invention relates to a baseband video data transmission/reception system capable of transmitting and receiving at least baseband video data.
- the present invention relates to a baseband video/audio data transmission/reception system capable of transmitting and receiving video data with low power consumption, and a transmission device and a reception device included in the system.
- HDMI specification has been known as a transfer specification for baseband video/audio data transmission/reception systems.
- Baseband refers to be being uncompressed.
- Video data is transmitted using three channels in HDMI specification.
- audio data or data used for control is time multiplexed to each video data and transmitted (e.g., cf. Non-Patent Literature 1 and Non-Patent Literature 2).
- FIG. 9 shows the configuration of a transmission/reception system 101 including a configuration compliant with HDMI specification.
- the transmission/reception system 101 includes a transmission device 102 and a reception device 103.
- Digital cameras, video cameras, and DVD players etc. correspond to the transmission device 102, and television receivers and monitors etc., correspond to the reception device 103.
- the transmission device 102 is a source device, and includes a microcomputer 102a, a video output circuit 102b, a TMDS output circuit 102c, and a transmitter 102d.
- the reception device 103 is a sink device, and includes an information storage 103a, a TMDS input circuit 103b, a memory 103c, and a synchronization signal generator 103d.
- the microcomputer 102a reads, through a DDC (Display Data Channel), EDID (Extended Display Identification Data) stored in the information storage 103a formed with a ROM of the reception device 103, and examines which specification of HDMI specification that can be handled by the reception device 103.
- EDID Extended Display Identification Data
- video format in which the reception device 103 can display is described.
- the video format is specified by a VIC (Video Identification Code) (cf. Non-Patent Literature 2 for detail).
- the video format includes a resolution and a field rate.
- the microcomputer 102a performs signal-processing control in the device, and, for example, performs a control of reading out recorded data from recording medium in the device to the video output circuit 102b and loading video data and audio data on a memory.
- the microcomputer 102a generates digital video signal after receiving the EDID from the reception device 103, and generates a VIC specifying the video format of the digital video signal.
- the VIC is transmitted in a packet named AVI InfoFrame.
- the TMDS output circuit 102c performs encoding and parallel serial conversion of uncompressed data outputted from the video output circuit 102b.
- the transmitter 102d outputs serial data to a transmission path with TMDS (Transiion Minimized Differential Signaling) method.
- TMDS Transiion Minimized Differential Signaling
- TMDS transmission path three data channels (DATA0, DATA1, and DATA2) and one clock channel are used.
- video data of any one of R-data, G-data, or B-data, audio data, and control data are converted to differential signals and transmitted by the transmitter 102d.
- the differential signal is a signal that represents Hi/Lo in a single signal as voltage difference of two signals.
- the video data is assigned to a display period and is transmitted as raster scan data.
- the audio data and the control data are assigned to a blanking period that is a vertical blanking period and a horizontal blanking period, and are transmitted as packet data.
- the control data is transmitted as an AVI InfoFrame packet.
- the TMDS input circuit 103b receives TMDS data and clocks from a receiver that is not shown, performs serial parallel conversion thereon, and then performs decoding of each data.
- the decoded data is retained in a reception memory in the memory 103c, and video data is written in a frame memory in the memory 103c from the reception memory based on a pixel clock transmitted by the synchronization signal generator 103d.
- the AVI InfoFrame packet is analyzed as soon as it is received.
- the data that has been written in the frame memory is used for video display in response to various timing signals generated by the synchronization signal generator 103d in accordance with the video format described in the AVI InfoFrame, and the audio data retained in the reception memory is used for audio output.
- a transmitter Tx switching between two output terminals of open drain occurs in cases of data D and data /D to become ON-state.
- Current outputted from a current source I differs regarding whether to flow through which one of two termination resistances R T connected to differential inputs of a receiver Rx via a transmission path of characteristic impedance Z 0 between data D and data /D, and switching of plus and minus of differential input voltages occurs.
- the two termination resistances R T are connected to reference voltage AVcc.
- transmission in the TMDS method generates swinging of differential signals every time each data is transmitted and received.
- the numerical swing becomes extremely large since video signals of 8 bits are converted to 10 bits by a TMDS encoder in consideration of transmission property in TMDS. Therefore, since alteration of 1 and 0 repeatedly occurs for a large number of times while frames of the same image are continuously transmitted during still image display, wasteful power consumption occurs due to operation of the transmitter and the receiver, and power loss associated with charge and discharge through a cable occurs.
- An object of the present invention is to provide a transmission device and a reception device, and a transmission/reception system for baseband video data having high affinity with the conventional HDMI specification and capable of further reducing power consumption.
- a transmission device of the present invention is configured to transmit, to a reception device, signals including a video signal, and includes: a controller configured to perform a control of reading information held by the reception device regarding a video specification that is supported, and transmitting the video signal that is supported by the reception device; and a transmitter configured to transmit the video signal in a form of baseband video data.
- the controller When the reception device is in an output mode in which an identical image is extendedly shown in a predetermined number of multiple frames or more: the controller performs a control of reading, from the information regarding the video specification, information regarding a horizontal resolution and a vertical resolution that are supported by the reception device and information regarding a frame rate that is supported by the reception device, and multiplexing, to the video signal during a blanking period of the video signal, information indicating a reduced frame rate that is selectable from a range supported by the reception device; and the transmitter transmits the baseband video data at the reduced frame rate.
- the information indicating the reduced frame rate may be information regarding division ratio with respect to a frame rate prior to reduction.
- the transmission device when the transmitter transmits a clock, it is possible to not reduce transmission rate of the clock in the output mode.
- a reception device of the present invention is configured to receive signals containing a video signal, and includes: a storage configured to store information regarding a video specification that is supported including information regarding a frame rate that is supported; a receiver configured to receive signals containing a video signal formed from baseband video data; a frame memory in which the video signal received by the receiver is written; and a synchronization signal generator configured to generate a first timing at which the video signal is written in the frame memory from the receiver, and a second timing at which the video signal is read out from the frame memory.
- the receiver outputs, when information indicating a reduced frame rate and information indicating a horizontal resolution and a vertical resolution during a blanking period of the received video signal are superimposed, the information indicating the frame rate to the synchronization signal generator.
- the synchronization signal generator generates the first timing at a frame rate in accordance with the information regarding the horizontal resolution and the vertical resolution and the information indicating the reduced frame rate.
- the reception device when the supported frame rate includes multiple values represented with a power of two, only a maximum value of the values represented by the power of two may be stored in the storage as information of a frame rate regarding each of the values represented by the power of two.
- a mask field indicating that the information regarding the predetermined frame rate only applies to the specific set of multiple video specifications may be stored in the storage.
- a transmission/reception system of the present invention includes: a transmission device configured to transmit signals containing a video signal, and a reception device configured to receive signals containing the video signal.
- the transmission device includes: a controller configured to perform a control of reading information held by the reception device regarding a video specification that is supported, and transmitting the video signal that is supported by the reception device; and a transmitter configured to transmit the video signal in a form of baseband video data.
- the controller When the reception device is in an output mode in which an identical image is extendedly shown in a predetermined number of multiple frames: the controller performs a control of reading, from the information regarding the video specification, information regarding a horizontal resolution and a vertical resolution that are supported by the reception device and information regarding a frame rate that is supported by the reception device, and multiplexing, to the video signal during a blanking period of the video signal, information indicating a reduced frame rate that is selectable from a range supported by the reception device; and the transmitter transmits the baseband video data at the reduced frame rate.
- the reception device includes: a storage configured to store information regarding a video specification that is supported including information regarding a frame rate that is supported; a receiver configured to receive signals containing the video signal transmitted from the transmission device; a frame memory in which the video signal received by the receiver is written; and a synchronization signal generator configured to generate a first timing at which the video signal is written in the frame memory from the receiver, and a second timing at which the video signal is read out from the frame memory.
- the receiver outputs, when information indicating the reduced frame rate and information indicating a horizontal resolution and a vertical resolution during a blanking period of the received video signal are superimposed, the information indicating the reduced frame rate to the synchronization signal generator.
- the synchronization signal generator generates, at the reduced frame rate, the first timing in accordance with information indicating the reduced frame rate.
- the transmission device and the reception device, and the transmission/reception system for baseband video data of the present invention it is possible to provide a baseband video/audio data transmission/reception system that has high affinity with the conventional HDMI specification and is capable of further reducing power consumption.
- Non-Patent Literature 1 and Non-Patent Literature 2 are examples of HDMI specification.
- FIG. 3 shows a configuration of a transmission/reception system 1 for a video signal that is baseband video data, according to the present embodiment.
- the transmission/reception system 1 includes a transmission device 2 and a reception device 3. Digital cameras, video cameras, and DVD players etc., correspond to the transmission device 2, and television receivers and monitors correspond to the reception device 3.
- the transmission device 2 is a source device, and includes a microcomputer 2a, a video output circuit 2b, a TMDS output circuit 2c, and a transmitter 2d.
- the microcomputer 2a forms a controller; and the video output circuit 2b, the TMDS output circuit 2c, and the transmitter 2d form a transmitter.
- the reception device 3 is a sink device, and includes an information storage (storage) 3a, a TMDS input circuit 3b, a reception memory 3c, a synchronization signal generator 3d, and a frame memory 3e.
- the TMDS input circuit 3b and the reception memory 3c form a receiver.
- FIG. 1 shows a detailed configuration of the transmission device 2.
- the microcomputer 2a includes, a pixel clock generation circuit 21 and an N divider circuit 22, in addition to a processor and a register that are not diagrammatically represented.
- the pixel clock generation circuit 21 generates a pixel clock with a rate that matches the resolution used as a reference in a video specification, using an internal clock generated by an internal clock generation circuit of the microcomputer 2a.
- the reference resolution of a video specification conforms to information regarding a horizontal resolution and a vertical resolution supported by the reception device 3, among information regarding the video specification read-out from the information storage 3a of the reception device 3 through DDC.
- the N divider circuit 22 generates a TMDS clock in accordance with a frame rate specified based on division ratio information which is information regarding a frame rate supported by the reception device 3, among information regarding the read-out video specification.
- the N divider circuit 22 when video data of moving pictures is to be transmitted to the reception device 3, the N divider circuit 22 generates the TMDS clock specified by a standard frame rate prescribed in information regarding frame rate. More specifically, the N divider circuit 22 generates a TMDS clock whose division ratio is 1 with respect to the pixel clock generated by the pixel clock generation circuit 2a, and outputs the TMDS clock to subsequent circuits.
- the transmission device 2 when the transmission device 2 is in an output mode for showing the same image extended in a predetermined number of multiple frames or more, as in the cases with still images, paused videos of moving pictures, and a slow-motion reproduction video of moving pictures; if a frame rate specified in the information regarding frame rate and is reduced to 1/N of the standard frame rate exists, the N divider circuit 22 generates a TMDS clock obtained through frequency dividing the pixel clock generated by the pixel clock generation circuit 2a by N, and outputs the TMDS clock to subsequent circuits. In addition, when the N-division operation is performed based on division ratio information, the N divider circuit 22 outputs, to the video output circuit 2b, information regarding division ratio N.
- the video output circuit 2b includes an output memory that retains data Da0 for channel CH0, data Da1 for channel CH1, and data Da2 for channel CH2. To the respective channels, transmission of video data da1 of R, G, or B is assigned. Data of each of the channels contain the video data da1, audio data da2, and control data da3. The data of each of the channels are data loaded through decoding of compressed data read out from a recording medium included in the transmission device 2, and data inputted from outside.
- the video data da1 of each of the channels is raster scan data assigned to a display period for display driving in the reception device 3.
- the audio data da2 and the control data da3 of each of the channels are packet data that are time multiplexed with a blanking period that is a vertical blanking period and horizontal blanking period outside of a display period.
- the control data da3 is generated in accordance with the content of video data or audio data by the video output circuit 2b.
- the control data da3 contains a synchronization signal used for synchronizing videos, attribute data indicating attributes of video data and audio data, and a control signal used for controlling the reception device 3.
- the attribute data contains data referred to as InfoFrame which is information used for controlling the reception device 3.
- InfoFrame an InfoFrame referred to AVI Infoframe exists, which specializes in performing control using video data information.
- the VIC is data described inside the AVI InfoFrame.
- One of the contents represented by the VIC includes a frame rate of a video.
- the reception device 3 that has received the control data da3 ordinarily displays videos at the frame rate described in the VIC.
- the video output circuit 2b When the video output circuit 2b receives information regarding division ratio N from the N divider circuit 22, the video output circuit 2b adds, to the control data da3, data having described therein the value of division ratio N in VSIF (Vendor Specific InfoFrame).
- the data Da0 for the channel CH0 contains the video data da1, the audio data da2, and the control data da3 consisting of the synchronization signal and the attribute data, and is transmitted to the channel CH0 as described later.
- the data Da1 for the channel CH1 contains the video data da1, the audio data da2, and the control data da3 consisting of the control signal and the attribute data, and is transmitted to the channel CH1 as described later.
- the data Da2 for the channel CH2 contains the video data da1, the audio data da2, and the control data da3 consisting of the control signal and the attribute data, and is transmitted to the channel CH2 as described later.
- a clock channel CK-CH the TMDS clock is transmitted.
- the TMDS output circuit 2c includes a TMDS encoder en0 for the channel CH0, a TMDS encoder en1 for the channel CH1, and a TMDS encoder en2 for the channel CH2.
- the data Da0 for the channel CH0 is inputted to the TMDS encoder en0
- the data Da1 for the channel CH1 is inputted to the TMDS encoder en1
- the data Da2 for the channel CH2 is inputted to the TMDS encoder en2.
- Each encoder includes an 8-bit to 10-bit converter BT1, a 4-bit to 10-bit converter BT2, and a 2-bit to 10-bit converter BT3.
- the video data da1 is inputted to the 8-bit to 10-bit converter BT1 and is encoded into data in 10 bits.
- the audio data da2 is inputted to the 4-bit to 10-bit converter BT2 and is encoded into data in 10 bits.
- the control data da3 is inputted to the 2-bit to 10-bit converter BT3 and is encoded into data in 10 bits.
- the transmitter 2d includes a timing generation circuit 23 and a data selector / serial converter 24.
- the timing generation circuit 23 generates, from the TMDS clock outputted from the N divider circuit 22, a timing signal of data which the transmitter 2d outputs to a TMDS transmission path.
- the data selector / serial converter 24 selects the control data da3, the audio data da2, and the video data da1 which are parallel data in 10 bits at the timing of the TMDS clock, and arranges those in the order of transmission timing to convert those into serial data. Then, the data selector / serial converter 24 outputs the generated serial data to the TMDS transmission path from an output buffer, one bit at a time, in accordance with the timing signal.
- the data selector / serial converter 24 can be achieved by, for example, a serializer.
- each of the data is transmitted through the channel CH0 (DATA0), the channel CH1 (DATA1), and the channel CH2 (DATA2).
- the TMDS clock that specifies a timing of every 10 bits is transmitted.
- FIG. 2 shows a detailed configuration of the reception device 3.
- the information storage 3a stores therein an EDID.
- the EDID information regarding video specification that is supported by the reception device 3, such as the video format, function, characteristics, and the like that can be handled by the reception device 3, are described.
- information indicating that reception is possible at a frame rated reduced through division of the standard frame rate by a certain number is newly described in a VSDB (Vendor Specification Data Block) of the EDID.
- the reduced frame rate that is described is 1/N of the standard frame rate, and the value of N is read by the transmission device 2 of the microcomputer 2a through the DDC as the division ratio information.
- Resolution information indicating a vertical resolution and a horizontal resolution that are supported by the reception device 3 is also read out by the microcomputer 2a.
- the TMDS input circuit 3b includes a data separator / parallel converter 31 and a TMDS decoder 32.
- the data separator / parallel converter 31 receives data via a TMDS transmission path by a receiver that is not diagrammatically represented, separates each of the received serial data that is in 10 bits by using the TMDS clock received from the clock channel, and converts that into parallel data using an internal clock.
- the data separator / parallel converter 31 outputs the TMDS clock to the TMDS decoder 32 and the synchronization signal generator 3d.
- the data separator / parallel converter 31 can be achieved by, for example, a deserializer.
- the TMDS decoder 32 decodes parallel data in 10 bits to parallel data in 8 bits.
- the TMDS decoder 32 includes a TMDS decoder de0 for the channel CH0, a TMDS decoder de1 for the channel CH1, and a TMDS decoder de2 for the channel CH2.
- the data for the channel CH0 is inputted to the TMDS decoder de0, and the data for the channel CH1 is inputted to the TMDS decoder de1, and the data for the channel CH2 is inputted to the TMDS decoder de2.
- Each of the decoders includes a 10-bit to 8-bit converter BT1', a 10-bit to 4-bit converter BT2', and a 10-bit to 2-bit converter BT3'.
- the data for the channel CH0 is inputted to the 10-bit to 8-bit converter BT1' and is decoded into the video data da1 in 8 bits.
- the data for the channel CH1 is inputted to the 10-bit to 4-bit converter BT2' and is decoded into the audio data da2 in 8 bits.
- the data for the channel CH2 is inputted to the 10-bit to 2-bit converter BT3' and is decoded into the control data da3 in 2 bits.
- the data Da0, Da1, and Da2 are decoded.
- the TMDS decoder 32 properly processes the received video data based on the attribute data or the control signal.
- the data Da0, Da1, and Da2 decoded to 8 bits are retained in the reception memory 3c.
- the synchronization signal generator 3d includes an N multiplier circuit 33.
- the N multiplier circuit 33 identifies whether or not the control data da3 retained in the reception memory 3c holds information of the division ratio N and the information regarding a horizontal resolution and a vertical resolution.
- the control data da3 holds the information of the division ratio N
- the N multiplier circuit 33 generates a pixel clock by frequency multiplying the TMDS clock outputted from the data separator / parallel converter 31 by N.
- the synchronization signal generator 3d generates various timing signals used for display driving, including a vertical synchronization signal and a horizontal synchronization signal from information regarding the synchronization signal and the control signal received from the transmission device 2 and held by the control data da3.
- the synchronization signal generator 3d reads video data for a single frame from the reception memory 3c and writes the data in the frame memory 3e at a timing (first timing) of the pixel clock generated by the N multiplier circuit 33.
- the same video data da1 is retained in the frame memory 3e until data of a new frame is retained in the reception memory 3c, and the same video data da1 is repeatedly read and used for N number of times to output video to a display device at a timing (second timing) of the pixel clock generated by the N multiplier circuit 33.
- the first timing is different from the second timing in that the first timing is a timing of a period excluding the duration in which the same video data da1 is retained in the frame memory 3e among the pixel clock.
- the reception device 3 has an advantage of being able to use the configuration of a conventional reception device almost without any modifications, since the reception device 3 has a configuration obtained by merely adding the items described by the information storage 3a in the EDID, and a configuration that is achievable by changing the division ratio of a frequency synthesizer at which the N multiplier circuit 33 generates the synchronous clock.
- a frame rate is transmitted to a reception device using the VIC.
- the transmission device 2 transmits a video signal at a rate lower than the usual frame rate.
- the reception device 3 outputs the video signal transmitted at a lower-than-usual rate as a video at an ordinary frame rate. In such manner, it is possible to reduce the amount of data flowing in a transmission path, and prevent reduction of the frame rate of a video that is displayed. Since the amount of data flowing through a transmission path can be reduced, power consumption of a physical interface that performs the actual transmission and reception is reduced.
- FIG. 4 is a conceptual diagram for describing the reduction of frame rate by the transmission/reception system 1.
- transmission is performed at a frame rate of 1/60 seconds (60 Hz)
- video data is transmitted in approximately every 16 milliseconds.
- FIG. 5 shows an illustrative example of a case in which the information storage 3a newly describes, in the EDID, information indicating reception is possible at a frame rate obtained by dividing an ordinary frame rate by a certain number.
- FIG. 5 shows the data structure of the VSDB.
- byte blocks having a size of 1 byte are arranged in order, and header information, storage address, and the like are defined on the top block side.
- Reserved bit areas represented by Rsvd (0) exist in byte blocks shown subsequent to the n-th block in the low order.
- "Low_Reflesh" indicating that processing at a reduce frame rate is possible is defined in the reserved bit areas using, for example, a single bit. Described in a subsequent block is the value of N indicating the value of the reduced frame rate that is supported.
- N is the division ratio used by the transmission device 2 for generating the TMDS clock.
- the supported frame rate includes multiple values represented by the power of two
- it becomes possible to suppress enlargement of the storage size for the EDID by only describing a maximum value of the values represented by the power of two as information of a frame rate regarding each of the values represented by the power of two. Since the ROM that stores the EDID only has a small finite area of storage capacity of generally about 256 bytes, not having extra space is common in the reserved bit areas. Therefore, by suppressing enlargement of the storage size consumed to achieve the present function, an advantageous effect of being able to secure storage areas to be consumed to achieve other functions can be obtained.
- a mask field indicating that information regarding the predetermined frame rate only applies to the specific set of multiple video specifications may be stored in the information storage 3a.
- a division ratio N is not applicable to all VIC lists but only applicable to a specific set of multiple VIC lists
- mask data for only extracting the specific set of multiple VIC numbers from all VIC numbers is described in a mask field. With this, enlargement of the storage size of the EDID can be further suppressed.
- a new InfoFrame is defined as one of the attribute data.
- information regarding how much the frame rate is to be reduced is described.
- a frame rate obtained by dividing the frame rate described in the VIC by a certain number is described in the VSIF, for example, when the frame rate described in the VIC is 60 Hz and the frame rate for transmission is 7.5 Hz, "8" is described in the new Info Frame.
- Doing so as described above has the following advantage. That is, by having the reception device 3 perform a calculation using the frame rate described in the VIC and the numerical value described in the new InfoFrame, it is possible to easily recognize how much the frame rate is reduced.
- the reception device 3 can recognize the frame rate in which videos should be outputted originally through a conventional method compliant with HDMI specification.
- FIG. 6 shows an illustrative example describing the value of the division ratio N in the VSIF.
- VSIF byte blocks having a size of 1 byte are arranged in order, and header information, storage address, and the like are defined on the top block side.
- the type of video format is described in from the fifth bit to the seventh bit of block PB4, and, for example, "100" indicating that the type of video format is "Low Reflesh mode" is described using three bits in the HDMI_Video_Format field in FIG. 6 .
- This "100" can be defined by, for example, selecting the number reserved for defining the type of video format for HDMI.
- N in the subsequent block PB5 is described as "D" when the "Low Reflesh mode" is defined in the block PB4.
- a single value can be selected as N described as "D” from a range that is supported by the reception device 3 as in the case with 2, 4, or 8.
- the transmission device 2 may use another method to notify, through a different means, the reception device 3 regarding the horizontal resolution and vertical resolution, and the frame rate at which the transmitted video should be outputted.
- a conceivable method is, for example, adding a signal line to notify the rate.
- the method of using the new InfoFrame has advantages of being able to adhere to the configuration of a conventional HDMI apparatus and only requiring a small amount of calculation.
- a clock of a video signal is transmitted in the clock channel.
- the TMDS clock is transmitted at a rate of 1/N.
- the clock transmitted in the clock channel may be transmitted as the original clock of the video signal. That is, for example, in a case with a video at 1080p / 60 Hz, the video signal clock has a clock speed of 148.5 MHz, and transmission continues at this clock even when the frame rate becomes low. Doing so has an advantage of being able to achieve a clock generation circuit on the reception side with a configuration identical to a conventional one.
- the transmission of the clock and video data is continuously performed even when the TMDS clock is transmitted at a rate of 1/N or at the original clock rate.
- the control data da3 contains information of the division ratio N and reduction of the frame rate can be recognized on the reception device 3 side, not having changes made to the transmission rate of the clock does not result in reception trouble.
- FIG. 7 shows a flowchart describing operations of the transmission device 2. These operations can be achieved by a control program or through hardware operations.
- the microcomputer 2a reads whether reception is possible at a low frame rate from the information storage 3a in the reception device 3 when power is turned on, when a cable is connected, or the like (step S701). As a result of the reading, when reception cannot be performed at a low frame rate, it is determined that transmission should be performed with the conventional HDMI transmission method (S710). When a mode in which transmission is possible in a low frame rate is executed such as when output from the video signal output circuit 2b is a still picture or when the frame rate is low, transmission is initiated in the low frame rate mode of the present embodiment (S702).
- the microcomputer 2a outputs, in a packet (InfoFrame) of the blanking period, each data, clock, and a control signal indicating a video signal is in the low frame transmission mode (S703), and, when the low frame rate transmission mode is not executed, determines that transmission should be performed with the conventional HDMI transmission method (S710).
- FIG. 8 shows a flowchart describing operations of the reception device 3. These operations can be achieved by a control program or through hardware operations.
- a signal is read, including information indicating whether execution of the low frame rate transmission mode is superimposed on the packet (new InfoFrame) of the blanking period of the transmitted video signal (S801), and, when the low frame rate transmission mode is not executed, the conventional HDMI reception is performed (S810).
- the video signal transmitted from the transmission device 2 is written as video image in area n+1 of the reception memory 3c (S802).
- loading (displaying) of the video signal to the frame memory 3e is performed by reading video data at an area n of the reception memory 3c used as storage at the latest renewal of videos.
- the video signal is read out from the frame memory 3e and displayed using the synchronization signal generated by the synchronization signal generation circuit 3d for displaying the video signal from the area n+1 in the reception memory 3c (S803).
- the configurations of the present embodiment also include one in which the information storage 3a described in FIG. 1 is realized through communication by CEC (Consumer Electronics Control).
- CEC Consumer Electronics Control
- DP Display Port
- data may be inserted similarly to a blanking period.
- DP loading EDID from the sync to the source is performed in an AUX channel, and the clock channel does not exist since there is asynchronous transmission.
- DVI Digital Visual Interface
- data may be inserted similarly to the blanking period.
- DDC Dynamic Data Channel
- a repeater may intermediate the communication between the transmission device and the reception device.
- the present invention is particularly useful as a transmission method for transmitting a still picture in way compliant with the conventional HDMI specification.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Graphics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011257534 | 2011-11-25 | ||
JP2011265462 | 2011-12-05 | ||
PCT/JP2012/000564 WO2013076881A1 (fr) | 2011-11-25 | 2012-01-30 | Dispositif d'émission et dispositif de réception pour données vidéo en bande de base, et système d'émission/réception |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2785053A1 true EP2785053A1 (fr) | 2014-10-01 |
EP2785053A4 EP2785053A4 (fr) | 2015-05-27 |
EP2785053B1 EP2785053B1 (fr) | 2020-12-02 |
Family
ID=48469356
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12851236.5A Active EP2785052B1 (fr) | 2011-11-25 | 2012-01-30 | Dispositif de transmission et dispositif de réception de données vidéo de bande de base, système émetteur-récepteur |
EP12851594.7A Active EP2785053B1 (fr) | 2011-11-25 | 2012-01-30 | Dispositif d'émission et dispositif de réception pour données vidéo en bande de base, et système d'émission/réception |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12851236.5A Active EP2785052B1 (fr) | 2011-11-25 | 2012-01-30 | Dispositif de transmission et dispositif de réception de données vidéo de bande de base, système émetteur-récepteur |
Country Status (4)
Country | Link |
---|---|
US (2) | US8872982B2 (fr) |
EP (2) | EP2785052B1 (fr) |
JP (2) | JP5695211B2 (fr) |
WO (2) | WO2013076881A1 (fr) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104521228B (zh) * | 2012-09-21 | 2017-12-19 | 松下知识产权经营株式会社 | 发送装置、接收装置、传输***以及传输方法 |
JP6177606B2 (ja) * | 2013-07-05 | 2017-08-09 | シナプティクス・ジャパン合同会社 | 表示システム及びプログラム |
WO2015019546A1 (fr) * | 2013-08-09 | 2015-02-12 | パナソニックIpマネジメント株式会社 | Système de caméra sans fil, dispositif central, méthode d'affichage d'image, et programme d'affichage d'image |
US9684942B2 (en) | 2013-09-11 | 2017-06-20 | Apple Inc. | Link aggregator for an electronic display |
JP6307856B2 (ja) * | 2013-11-28 | 2018-04-11 | ソニー株式会社 | 送信装置、広色域画像データ送信方法、受信装置、広色域画像データ受信方法およびプログラム |
KR102336587B1 (ko) * | 2014-11-26 | 2021-12-08 | 삼성디스플레이 주식회사 | 표시 시스템 |
JP6455121B2 (ja) * | 2014-12-12 | 2019-01-23 | 株式会社リコー | 情報処理装置、情報処理方法およびプログラム |
JP2018028559A (ja) * | 2015-01-07 | 2018-02-22 | シャープ株式会社 | 画像データ出力装置、画像データ出力方法、画像表示装置、および集積回路 |
KR20180024616A (ko) * | 2016-08-30 | 2018-03-08 | 삼성전자주식회사 | 디스플레이 장치 및 디스플레이 장치의 캘리브레이션 수행 방법 |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6307891B1 (en) * | 1997-04-22 | 2001-10-23 | Silicon Laboratories, Inc. | Method and apparatus for freezing a communication link during a disruptive event |
JP3764409B2 (ja) * | 2002-06-28 | 2006-04-05 | 株式会社東芝 | 指令送信装置及び指令送信方法 |
KR100945577B1 (ko) * | 2003-03-11 | 2010-03-08 | 삼성전자주식회사 | 액정 표시 장치의 구동 장치 및 그 방법 |
US7557801B2 (en) * | 2003-05-16 | 2009-07-07 | Semiconductor Energy Laboratory Co., Ltd. | Display device and driving method thereof |
JP4357356B2 (ja) * | 2004-05-10 | 2009-11-04 | 株式会社東芝 | 映像信号受信装置及び映像信号受信方法 |
US20060242669A1 (en) * | 2005-04-20 | 2006-10-26 | Jupiter Systems | Display node for use in an audiovisual signal routing and distribution system |
KR100707197B1 (ko) * | 2005-06-18 | 2007-04-13 | 삼성전자주식회사 | 이동통신 단말기를 이용한 디스플레이 시스템 |
KR100741721B1 (ko) * | 2005-08-16 | 2007-07-23 | 주식회사 유비원 | 정지영상을 함께 출력하는 보안감시시스템 |
US7519893B2 (en) * | 2005-10-14 | 2009-04-14 | Nvidia Corporation | Binary data encoding/decoding for parallel bus |
US20070176919A1 (en) * | 2006-01-31 | 2007-08-02 | Toshiba Matsushita Display Technology Co., Ltd. | Interface |
JP2007240741A (ja) * | 2006-03-07 | 2007-09-20 | Canon Inc | 画像制御装置及び画像制御方法 |
US7681051B2 (en) * | 2006-08-30 | 2010-03-16 | Agere Systems Inc. | Transitioning of a port in a communications system from an active state to a standby state |
US20080084834A1 (en) * | 2006-10-09 | 2008-04-10 | Zbigniew Stanek | Multiplexed connection interface for multimedia serial data transmission |
JP2008103806A (ja) * | 2006-10-17 | 2008-05-01 | Matsushita Electric Ind Co Ltd | 通信端末、通信システムおよび通信端末の制御方法 |
JP4829806B2 (ja) | 2007-01-30 | 2011-12-07 | キヤノン株式会社 | データ処理装置及びコンピュータプログラム |
JP2008283561A (ja) * | 2007-05-11 | 2008-11-20 | Sony Corp | 通信システム、映像信号伝送方法、送信装置、送信方法、受信装置および受信方法 |
JP5242111B2 (ja) | 2007-10-02 | 2013-07-24 | 株式会社ソニー・コンピュータエンタテインメント | 送信装置、画像データ送信方法、受信装置および受信装置における画像表示方法 |
JP5337370B2 (ja) * | 2007-11-13 | 2013-11-06 | ソニー エスパナ,エス.エー. | 表示装置、表示装置における映像信号送信方法、送信装置および映像信号の送信方法 |
TW200949822A (en) * | 2007-11-26 | 2009-12-01 | Tpo Displays Corp | Display system and method for reducing power consumption of same |
KR101453074B1 (ko) * | 2008-04-08 | 2014-10-23 | 삼성전자주식회사 | 디스플레이 인터페이스 시스템, 디스플레이 장치 및디스플레이 시스템 |
JP2009272778A (ja) * | 2008-05-01 | 2009-11-19 | Canon Inc | 画像伝送システム及び画像伝送方法 |
JP2010136197A (ja) * | 2008-12-05 | 2010-06-17 | Sharp Corp | 映像表示装置及び映像表示方法 |
JP2010193247A (ja) * | 2009-02-19 | 2010-09-02 | Sanyo Electric Co Ltd | Hdmi機器 |
JP5372687B2 (ja) * | 2009-09-30 | 2013-12-18 | ソニー株式会社 | 送信装置、送信方法、受信装置および受信方法 |
KR101622207B1 (ko) * | 2009-11-18 | 2016-05-18 | 삼성전자주식회사 | 디스플레이 구동장치, 디스플레이 구동시스템 및 디스플레이 구동방법 |
US20110222556A1 (en) * | 2010-03-10 | 2011-09-15 | Shefler David | Method circuit and system for adaptive transmission and reception of video |
-
2012
- 2012-01-30 WO PCT/JP2012/000564 patent/WO2013076881A1/fr active Application Filing
- 2012-01-30 WO PCT/JP2012/000565 patent/WO2013076882A1/fr active Application Filing
- 2012-01-30 EP EP12851236.5A patent/EP2785052B1/fr active Active
- 2012-01-30 JP JP2013545750A patent/JP5695211B2/ja active Active
- 2012-01-30 JP JP2013545751A patent/JP6008141B2/ja active Active
- 2012-01-30 EP EP12851594.7A patent/EP2785053B1/fr active Active
- 2012-01-30 US US14/353,140 patent/US8872982B2/en active Active
- 2012-01-30 US US14/353,144 patent/US8902368B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US8902368B2 (en) | 2014-12-02 |
US8872982B2 (en) | 2014-10-28 |
US20140267902A1 (en) | 2014-09-18 |
EP2785052A1 (fr) | 2014-10-01 |
JPWO2013076881A1 (ja) | 2015-04-27 |
WO2013076882A1 (fr) | 2013-05-30 |
JP6008141B2 (ja) | 2016-10-19 |
EP2785052A4 (fr) | 2015-03-11 |
EP2785053A4 (fr) | 2015-05-27 |
JPWO2013076882A1 (ja) | 2015-04-27 |
WO2013076881A1 (fr) | 2013-05-30 |
EP2785052B1 (fr) | 2019-03-13 |
US20140232940A1 (en) | 2014-08-21 |
JP5695211B2 (ja) | 2015-04-01 |
EP2785053B1 (fr) | 2020-12-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2785053B1 (fr) | Dispositif d'émission et dispositif de réception pour données vidéo en bande de base, et système d'émission/réception | |
US10805648B2 (en) | Image transmission device, image transmission method, image reception device, and image reception method | |
US8856840B2 (en) | Communication system, video signal transmission method, transmitter, transmitting method, receiver, and receiving method | |
EP2197209A1 (fr) | Dispositif d'émission, procédé d'émission de données image, dispositif de réception et procédé d'affichage d'image dans un dispositif de réception | |
US20110072473A1 (en) | Adapter device for wirelessly transmitting video signal from source device to adapter device for sink device | |
US10255875B2 (en) | Transmission device, transmission method, reception device, reception method, and transmission/reception system | |
CN103561226A (zh) | 发送设备、发送方法、接收设备以及接收方法 | |
EP3145207A1 (fr) | Appareil de communication, procédé de communication, et programme d'ordinateur | |
US20140204994A1 (en) | Auxiliary data encoding in video data | |
EP2995080B1 (fr) | Dispositifs et procédés de communication de données de bande latérale avec une vidéo non compressée | |
JP6609074B2 (ja) | 画像出力装置および出力方法 | |
WO2013076778A1 (fr) | Appareil de transmission d'image, appareil de réception d'image, procédé de transmission d'image et procédé de réception d'image | |
JP6472845B2 (ja) | 画像受信装置 | |
JP6200971B2 (ja) | 画像伝送装置および伝送方法 | |
JP2015109683A (ja) | 映像送信装置、映像受信装置、映像送信方法及び映像受信方法 | |
JP2013115453A (ja) | 画像伝送装置、画像伝送方法、画像受信装置および画像受信方法 | |
JPWO2013076778A1 (ja) | 映像送信装置、映像受信装置、映像送信方法及び映像受信方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20140423 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
RA4 | Supplementary search report drawn up and despatched (corrected) |
Effective date: 20150429 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 7/173 20110101AFI20150422BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20170511 |
|
GRAC | Information related to communication of intention to grant a patent modified |
Free format text: ORIGINAL CODE: EPIDOSCIGR1 |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTC | Intention to grant announced (deleted) | ||
INTG | Intention to grant announced |
Effective date: 20200821 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1342219 Country of ref document: AT Kind code of ref document: T Effective date: 20201215 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602012073554 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210303 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210302 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20201202 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1342219 Country of ref document: AT Kind code of ref document: T Effective date: 20201202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210302 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210405 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602012073554 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210402 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210130 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20210131 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
26N | No opposition filed |
Effective date: 20210903 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210131 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210131 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210402 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20120130 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230424 Year of fee payment: 13 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230420 Year of fee payment: 13 Ref country code: GB Payment date: 20240123 Year of fee payment: 13 |