WO2017126509A1 - 送信装置、送信方法、受信装置および受信方法 - Google Patents
送信装置、送信方法、受信装置および受信方法 Download PDFInfo
- Publication number
- WO2017126509A1 WO2017126509A1 PCT/JP2017/001434 JP2017001434W WO2017126509A1 WO 2017126509 A1 WO2017126509 A1 WO 2017126509A1 JP 2017001434 W JP2017001434 W JP 2017001434W WO 2017126509 A1 WO2017126509 A1 WO 2017126509A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- packet
- subtitle
- segment
- information
- region
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4348—Demultiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/278—Subtitling
Definitions
- the present technology relates to a transmission device, a transmission method, a reception device, and a reception method, and particularly to a transmission device that transmits text information of a subtitle.
- subtitle information is transmitted as bitmap data.
- a text character code that is, on a text basis.
- font development corresponding to the resolution is performed on the receiving side.
- the text information has timing information.
- TTML Timed Text Markup Language
- W3C World Wide Web Consortium
- the purpose of this technology is to increase the transmission efficiency when performing partial addition or change of the subtitle display.
- a packet generation unit that divides a document of subtitle text information having display timing information into a plurality of pieces, and generates a plurality of packets in which each divided part is arranged in a payload;
- a transmission apparatus includes a transmission unit that sequentially transmits the plurality of packets.
- the packet generation unit divides the subtitle text information document having the display timing information into a plurality of pieces, and generates a plurality of packets in which each divided portion is arranged in the payload.
- the document may be TTML or a document in a format derived from this TTML.
- the transmission unit sequentially transmits a plurality of packets.
- a plurality of packets including each divided portion obtained by dividing a document of subtitle text information having display timing information are sequentially transmitted. For this reason, when a partial addition / change of the subtitle display is performed, only the change / addition target part can be transmitted and the transmission efficiency can be increased.
- the packet generation unit may arrange packet type information corresponding to the attribute of the divided part arranged in the payload of the packet in the packet header.
- packet type information corresponding to the attribute of the divided part arranged in the payload of the packet in the packet header.
- the packet generation unit when the divided part arranged in the payload of the packet is subtitle information to be displayed in the predetermined region, the packet generation unit includes, in the header of the packet, identification information of the predetermined region May be arranged.
- identification information By arranging the identification information in this way, the receiving side can easily grasp which region the subtitle information arranged in the payload of the packet relates to. This identification information. This information is useful when adding or changing the display of subtitles in multiple regions in parallel.
- a document has a head part and a body part
- the packet generation unit when a divided part arranged in a packet is obtained by dividing the body part, Position information indicating whether the divided part is located at the first, middle or last of the body part may be arranged.
- Position information indicating whether the divided part is located at the first, middle or last of the body part may be arranged.
- a document has a head part and a body part
- the packet generation unit when a divided part arranged in a packet is obtained by dividing the body part, Order information indicating the order of the divided parts may be arranged.
- Order information indicating the order of the divided parts may be arranged.
- the packet generation unit generates a packet in which the updated predetermined element is arranged in the payload in order to declare the end time of the region in which only the start time is declared in the predetermined element. You may be like. Thereby, the end point of the region can be well declared.
- a receiving unit for sequentially receiving a plurality of packets generated by arranging each divided portion obtained by dividing a document of text information of a subtitle having display timing information into a plurality of pieces in a payload;
- a receiving apparatus includes a subtitle control unit configured to reconstruct the document using each divided portion arranged in the payloads of the plurality of packets to control subtitle display.
- the reception unit sequentially receives a plurality of packets generated by arranging each divided portion obtained by dividing a document of subtitle text information having display timing information into a plurality of pieces in a payload. . Then, the subtitle control unit controls the subtitle display by reconstructing the document by using the divided portions arranged in the payloads of the plurality of packets.
- the subtitle display is controlled based on each divided portion of the text information document of the subtitle having the display timing information, which is arranged in the payloads of the plurality of received packets. Therefore, even when the document is divided and sent, the subtitle display can be performed satisfactorily. In this case, when there is a partial addition / change of the subtitle display, only the change / addition target part is transmitted, so that the subtitle display change / addition process can be performed efficiently.
- FIG. 3 is a diagram illustrating an example of a TTML document (one region) when a TTML document is transmitted in a batch and transmission of the entire TTML document by a corresponding segment packet. It is a figure for demonstrating the display control of the subtitle based on the document (1 region) of TTML.
- FIG. 3 is a diagram illustrating an example of a TTML document (two regions) when a TTML document is transmitted in a batch, and transmission of the entire TTML document by a corresponding segment packet. It is a figure for demonstrating the display control of the subtitle based on the document (2 regions) of TTML.
- FIG. 3 is a diagram illustrating an example of a TTML document (one region) when a TTML document is divided and transmitted, and each divided portion of the TTML document is transmitted in corresponding segment packets.
- FIG. 2 is a diagram illustrating an example of a TTML document (two regions) when a TTML document is divided and transmitted, and each divided portion of the TTML document is transmitted in a corresponding segment packet.
- FIG. 1 is a diagram illustrating an example of a TTML document (two regions) when a TTML document is divided and transmitted, and each divided portion of the TTML document is transmitted in a corresponding segment packet.
- FIG. 3 is a diagram illustrating an example of a TTML document (one region) when a TTML document is divided and transmitted, and each divided portion of the TTML document is transmitted in corresponding segment packets.
- FIG. 2 is a diagram illustrating an example of a TTML document (two regions) when a TTML document is divided and transmitted, and each divided portion of the TTML document is transmitted in a corresponding segment packet. It is a figure which shows an example of a definition of a segment type. It is a figure which shows the structural example of the document segment which is a segment packet whose segment type is "0xA0".
- FIG. 10 is a diagram illustrating an example of a display operation sequence when a TTML document is divided and transmitted using a plurality of segment packets.
- FIG. 11 is a diagram illustrating another example of a display operation sequence when a TTML document is divided and transmitted using a plurality of segment packets.
- FIG. 1 shows a configuration example of a transmission / reception system 10 as an embodiment.
- the transmission / reception system 10 includes a broadcast transmission system 100 and a television receiver 200.
- the broadcast transmission system 100 transmits an MPEG-2 transport stream (hereinafter simply referred to as “transport stream”) TS as a multiplexed stream on a broadcast wave.
- transport stream MPEG-2 transport stream
- the transport stream TS has a subtitle stream as well as a video stream and an audio stream.
- the video stream is composed of video PES packets in which encoded image data is arranged in the payload.
- the audio stream is composed of audio PES packets in which encoded audio data is arranged in the payload.
- subtitle text information having display timing information, segment packets having all of the TTML document in this embodiment, or segment packets having respective divided portions obtained by dividing the TTML document are included in the payload.
- the subtitle PES packet is arranged.
- the TTML document has a head portion and a body portion.
- the header of the segment packet contains an attribute of information placed in the payload of the segment packet, that is, whether this information is the whole document or a part of the document, and if so, which part of the document (for example, ⁇ tt> part, ⁇ head> part, ⁇ body> part, etc.), packet type information corresponding to whether it is located.
- the identification of the predetermined region is included in the header of the segment packet.
- a region ID (region_id) is arranged as information.
- the divided part is located at the first, middle or last part of the body part in the header of the segment packet.
- the order information indicating the order of the divided parts is arranged in the header of the segment packet.
- a packet in which the updated predetermined element is placed in the payload is placed in the payload of the subtitle PES packet and transmitted.
- the television receiver 200 receives the transport stream TS transmitted from the broadcast transmission system 100 by broadcast waves.
- this transport stream TS has a subtitle stream together with a video stream and an audio stream.
- the subtitle stream is composed of a segment packet having the entire TTML document or a subtitle PES packet in which segment packets having respective divided portions obtained by dividing the TTML document are arranged in the payload. Has been.
- the television receiver 200 displays a subtitle based on a TTML document extracted from one segment packet or a TTML document reconstructed using each divided portion of a TTML document extracted from a plurality of segments. To control.
- FIG. 2 shows a configuration example of the stream generation unit 110 of the broadcast transmission system 100.
- the stream generation unit 110 includes a control unit 111, a video encoder 112, an audio encoder 113, a text format conversion unit 114, a subtitle encoder 115, and a TS formatter (multiplexer) 116.
- the control unit 111 is configured to include, for example, a CPU (Central Processing Unit), and controls the operation of each unit of the stream generation unit 110.
- the video encoder 112 receives the image data DV, encodes the image data DV, and generates a video stream (PES stream) composed of video PES packets having encoded image data in the payload.
- the audio encoder 113 receives the audio data DA, encodes the audio data DA, and generates an audio stream (PES stream) composed of audio PES packets having encoded audio data.
- the text format conversion unit 114 inputs text data (character code) DT as subtitle information, and obtains text information of a subtitle having a predetermined format having display timing information.
- text information for example, TTML or a derived format of TTML can be considered. In this embodiment, TTML is assumed.
- FIG. 3 shows an example of the structure of a TTML document (file).
- TTML is described on an XML basis.
- TTML has a head and a body. In the head, there are metadata, styling, layout, and the like.
- the metadata includes title information and copyright information.
- a region identifier and color information, font information, position information, and the like are arranged in association therewith.
- background color information, alignment information, and the like are arranged in association with the region identifier.
- text data of subtitles to be displayed in association with region identifiers, display start / end timing information, and the like are arranged.
- the subtitle encoder 115 generates a segment packet (timed text subtitling segment: TT subtitling) segment) including a TTML document obtained by the text format conversion unit 114. Then, the subtitle encoder 115 generates a subtitle stream (PES stream) composed of subtitle PES packets in which the segment packets are arranged in the payload.
- TT subtitling timed text subtitling segment
- PES stream subtitle stream
- the subtitle encoder 115 generates a segment packet including the entire TTML document in order to collectively transmit the TTML document.
- the subtitle encoder 115 divides the TTML document in order to divide and transmit the TTML document, and generates a plurality of segment packets including the divided portions.
- FIG. 4A shows an example of the structure of a subtitle PES packet (PES_packet).
- PES_startcode_prefix a fixed pattern “0x000001” is arranged.
- An 8-bit field of “stream_id” indicates a stream identifier.
- the 16-bit field of “PES_packet_length” indicates the number of subsequent bytes as the length (size) of the PES packet.
- PES_packet_length there is a field of “Optional_PES_header ()”. In this field, time stamps of PTS, DTS, and the like are arranged. After this field, there is a field “PES_packet_data_byte”. This field corresponds to the PES payload. In this field, “PES_data_byte_field ()” for containerizing data is arranged.
- FIG. 4B shows a structure example of “PES_data_byte_field ()”.
- the 8-bit field of “data_identifier” indicates an identifier for identifying the type of data in the container portion. Since the conventional subtitle (in the case of a bitmap) is supposed to be indicated by “0x20”, the text can be identified by a new value, for example, “0x21”.
- the 8-bit field of “subtitle_stream_id” indicates an identifier for identifying the type of the subtitle stream.
- a new value for example, “0x01”, can be distinguished from the conventional subtitle stream “0x00” that transmits a bitmap.
- FIG. 5 shows an example of a TTML document when a TTML document is transmitted in a batch, and a segment packet (Segment_type) that includes the entire TTML document and whose segment type (Segment_type) is “0xA0”. (Segment packet).
- the TTML document in the example shown is an example when there is one region.
- the region identifier (id) is “r1”, and color information and position information exist in association therewith.
- ⁇ span> indicates addition for each word or character.
- the region identifier “r1” is associated with the parent.
- the start timing “dT1” is an offset value from the start timing “T1” declared in ⁇ div>.
- the region identifier “r1” is associated with the parent.
- the start timing “dT3” is an offset value from the start timing “T1” declared in ⁇ div>.
- zzz ⁇ / span> includes information on start timing “dT5” and end timing “T10” in addition to the region identifier “r1”. Text data “zzz” is included.
- the region identifier “r1” is associated with the parent.
- the start timing “dT5” is an offset value from the start timing “T1” declared in ⁇ div>.
- the end timing “T10” is the same as the end timing “T10” declared in ⁇ div>. Since this end timing “T10” has already been declared with ⁇ div>, it is not necessarily required.
- subtitle display control as shown in FIG. 6B is performed in the region r1 shown in FIG. That is, the display of the region r1 is started at the timing “T1”. After that, “xxx” is displayed at timing “T1 + dT1”, “xxx yy” is displayed at timing “T1 + dT3”, “xxx yy zzz” is displayed at timing “T1 + dT5”, The display ends at timing “T10”.
- FIG. 7 also shows an example of a TTML document when a TTML document is transmitted in a batch, and transmission with a segment packet whose segment type is “0xA0” including the entire TTML document.
- the TTML document in the example shown is an example when there are two regions.
- the identifier (id) of the first region is “r1”, and color information and position information exist in association with it.
- the identifier (id) of the second region is “r2”, and color information and position information exist in association with it.
- the region identifier “r2” is associated with the parent.
- the start timing “dT2” is an offset value from the start timing “T2” declared in ⁇ div>.
- the region identifier “r2” is associated with the parent.
- the start timing “dT4” is an offset value from the start timing “T2” declared in ⁇ div>.
- the region identifier “r2” is associated with the parent.
- the start timing “dT6” is an offset value from the start timing “T2” declared in ⁇ div>.
- the end timing “T9” is the same as the end timing “T9” declared in ⁇ div>. Since this end timing “T9” has already been declared as ⁇ div>, it is not necessarily required.
- subtitle display control as shown in FIG. 8 (b) is performed in the regions r1 and r2 shown in FIG. 8 (a). That is, the display of the region r1 starts at the timing “T1”, and the display of the region r2 starts at the subsequent timing “T2”.
- a TTML document is divided and transmitted.
- the division of the TTML document is performed based on the following concept, for example. That is, ⁇ head> is completed and sent at once. If this ⁇ head> is updated, it will be a new document.
- ⁇ Tt>, ⁇ body>, ⁇ div>, and ⁇ p> can be sent open.
- ⁇ Span> must be sent completely. Use ⁇ div> or ⁇ p> to specify the region to display. This is to ensure the relevance of changes due to ⁇ span>.
- the reconfiguration of the TTML document on the receiving side is performed based on the following concept, for example.
- ⁇ head> is acquired first, and at the same time, only one TTML document is held.
- the ⁇ p> or ⁇ span> element is a child element of ⁇ div> or ⁇ p> with the same region identifier. If ⁇ div> or ⁇ p> is open and and “end” is not declared, it remains valid until “end” is declared or the TTML document is closed. When a TTML document is closed, all elements below ⁇ body> need to be closed.
- FIG. 9 shows an example of a TTML document when a TTML document (one region) is divided and transmitted, and a segment packet whose segment type is “0xA1” in the ⁇ tt> portion of the TTML document.
- the ⁇ head> portion is transmitted by a segment packet having a segment type “0xA2”
- the ⁇ body> portion is transmitted by a segment packet having a segment type “0xA3”.
- TTML document in the example shown is the same as the TTML document shown in FIG. 5, detailed description thereof will be omitted.
- a TTML document is reconstructed by each divided portion of the TTML document transmitted in each segment packet, and based on the reconstructed TTML document, the region r1 shown in FIG. Subtitle display control as shown in FIG. 6B is performed.
- FIG. 10 shows an example of a TTML document when a TTML document (two regions) is divided and transmitted, and a segment packet whose segment type is “0xA1” in the ⁇ tt> portion of the TTML document.
- the ⁇ head> portion is transmitted by a segment packet having a segment type “0xA2”
- the ⁇ body> portion is transmitted by a segment packet having a segment type “0xA3”.
- TTML document in the example shown is the same as the TTML document shown in FIG. 7, detailed description thereof is omitted.
- a TTML document is reconstructed by each divided portion of the TTML document transmitted in each segment packet, and based on the reconstructed TTML document, regions r1 and r2 shown in FIG. Subtitle display control as shown in FIG. 8B is performed in the area.
- FIG. 11 shows an example of TTML notation when a TTML document (one region) is divided and transmitted and each divided portion of the TTML document is transmitted in a corresponding segment packet.
- the ⁇ tt> part is transmitted in a segment packet with a segment type of “0xA1”
- the ⁇ head> part is transmitted in a segment packet with a segment type of “0xA2”
- the ⁇ body> The part is divided into a plurality of parts, and each divided part is transmitted by a segment packet whose segment type is “0xA3”.
- the region identifier (id) is “r1”, and color information and position information exist in association therewith.
- the region identifier “r1” is associated with the parent.
- the start timing “dT1” is an offset value from the start timing “T1” declared in ⁇ div>.
- the region identifier “r1” is associated with the parent.
- the start timing “dT3” is an offset value from the start timing “T1” declared in ⁇ div>.
- the region identifier “r1” is associated with the parent.
- the start timing “dT5” is an offset value from the start timing “T1” declared in ⁇ div>.
- ⁇ / Div>, ⁇ / body>, ⁇ / tt> exists after this ⁇ div>, the TTML document is closed, and at the same time, ⁇ div>, ⁇ body> are also closed.
- the segmented portion transmitted in each segment packet is reconstructed in a form of TTML notation that can be displayed at that time, and based on the reconstructed TTML, the region r1 shown in FIG.
- FIG. 12 shows an example of TTML notation when a TTML document (two regions) is divided and transmitted, and each divided portion of the TTML document is transmitted in a corresponding segment packet.
- the ⁇ tt> part is transmitted in a segment packet with a segment type of “0xA1”
- the ⁇ head> part is transmitted in a segment packet with a segment type of “0xA2”
- the ⁇ body> The part is divided into a plurality of parts, and each divided part is transmitted by a segment packet whose segment type is “0xA3”.
- the region identifier (id) is “r1”, and color information and position information exist in association therewith. Further, in this ⁇ layout>, the identifier (id) of the second region is “r2”, and color information and position information exist in association with it.
- the region identifier “r1” is associated with the parent.
- the start timing “dT1” is an offset value from the start timing “T1” declared in ⁇ div>.
- the region identifier “r2” is associated with the parent.
- the start timing “dT2” is an offset value from the start timing “T2” declared in ⁇ div>.
- the region identifier “r1” is associated with the parent.
- the start timing “dT3” is an offset value from the start timing “T1” declared in ⁇ div>.
- the region identifier “r2” is associated with the parent.
- the start timing “dT4” is an offset value from the start timing “T2” declared in ⁇ div>.
- the region identifier “r2” is associated with the parent.
- the start timing “dT6” is an offset value from the start timing “T2” declared in ⁇ div>.
- the region identifier “r1” is associated with the parent.
- the start timing “dT5” is an offset value from the start timing “T1” declared in ⁇ div>.
- ⁇ / Div>, ⁇ / body>, ⁇ / tt> exists after this ⁇ div>, the TTML document is closed, and at the same time, ⁇ div>, ⁇ body> are also closed.
- a TTML document is reconstructed by each divided portion of the TTML document transmitted in each segment packet, and based on the reconstructed TTML document, regions r1 and r2 shown in FIG. Subtitle display control as shown in FIG. 8B is performed in the area.
- FIG. 13 shows an example of the definition of the segment type (segment_type).
- “0xA0” indicates a segment packet for transmitting the entire TTML document.
- “0xA1” indicates a segment packet that transmits a ⁇ tt> portion.
- “0xA2” indicates a segment packet that transmits a ⁇ head> portion.
- “0xA3” indicates a segment packet that transmits a ⁇ body> portion.
- FIG. 14 shows a structure example of a document segment “document ⁇ segment () ”that is a segment packet with a segment type“ 0xA0 ”.
- FIG. 15 shows a structural example of a tt head segment “ttheadttsegment ()” that is a segment packet having a segment type “0xA1” or “0xA2”.
- FIG. 16 shows a structure example of a body segment “body ⁇ segment () ”that is a segment packet with a segment type“ 0xA3 ”.
- FIG. 17 shows the contents of main information in the structure example of each segment packet.
- the 8-bit field of “sync_byte” is a unique word indicating the start of a segment.
- An 8-bit field of “segment_type” is a segment type and indicates a segment type. In the case of this document segment, “segment_type” is set to “0xA0” (see FIG. 13).
- the 8-bit field “number_of_regions” indicates the number of regions included in the TTML document. There are as many 8-bit fields of “region_id” as there are regions.
- the field “region_id” indicates region identification information (id).
- the region identification information (id) corresponds to the region identification information (id) in the TTML document.
- a 16-bit field of “document_version_number” indicates an update of TTML document information. If an update is made, the value is incremented by one.
- the 8-bit field of “latency” displays the subtitle (subtitle display) from the subtitle image buffer (subtitle image buffer) after the first “segment_data_field ()” byte data is input to the buffer (text buffer described later) ) Indicates the amount of time delay until The value is, for example, 10 times the actual amount of time (in seconds).
- the 16-bit field of “segment_length” indicates the number of subsequent bytes as the length (size) of the document segment. After “segment_length”, there is a field “segment_data_field ()”. This field corresponds to the payload of a segment (segment packet). In the case of this document segment, the entire TTML document is arranged.
- the 8-bit field of “sync_byte” is a unique word indicating the start of a segment.
- An 8-bit field of “segment_type” is a segment type and indicates a segment type. In the case of this tt head segment, “segment_type” is set to “0xA1” or “0xA2” (see FIG. 13).
- the 16-bit field of “tthead_version_number” indicates an update of “tt” or “head” information. If an update is made, the value is incremented by one.
- the 16-bit field of “segment_length” indicates the number of subsequent bytes as the length (size) of the tt head segment. After “segment_length”, there is a field “segment_data_field ()”. This field corresponds to the payload of a segment (segment packet). In the case of this document segment, a ⁇ tt> or ⁇ head> portion is arranged.
- the 8-bit field of “sync_byte” is a unique word indicating the start of a segment.
- An 8-bit field of “segment_type” is a segment type and indicates a segment type. In the case of this body segment, “segment_type” is set to “0xA3” (see FIG. 13).
- fragment_start_flag indicates whether or not this body segment includes the first divided part of ⁇ body>. For example, “1” indicates that it is included, and “0” indicates that it is not included.
- a 1-bit field of “fragment_end_flag” indicates whether or not this body segment includes the last part of the ⁇ body> part. For example, “1” indicates that it is included, and “0” indicates that it is not included.
- fragment_start_flag ⁇ If this body segment includes an intermediate part of the ⁇ body> part, both “fragment_start_flag” and “fragment_end_flag” are “0”.
- the information in the fields of “fragment_start_flag” and “fragment_end_flag” constitutes position information indicating whether the divided part is located at the first, middle or last of the ⁇ body> part. If the entire ⁇ body> is included in this body segment, both “fragment_start_flag” and “fragment_end_flag” are “1”.
- the 8-bit field of“ number_of_regions ” indicates the number of regions included in this body segment. As many as the number of regions, an 8-bit field of “region_id” and a 1-bit field of “region_tag_update_flag” exist repeatedly.
- the field “region_id” indicates region identification information (id).
- the region identification information (id) corresponds to the region identification information (id) in the information arranged in the payload of the body segment.
- the field of “region_tag_update_flag” indicates whether or not update of a region tag is included. For example, “1” indicates that it is included, and “0” indicates that it is not included.
- the 16-bit field of “body_version_number” indicates an update of ⁇ body> information. If an update is made, the value is incremented by one.
- the information of “body_version_number” constitutes order information indicating the order of the divided parts.
- the 8-bit field of “latency” displays subtitles (subtitle display) from the subtitle image buffer (subtitle Image buffer) after the first byte data of “segment_data_field ()” is input to the buffer (text buffer described later) ) Indicates the amount of time delay until The value is, for example, 10 times the actual amount of time (in seconds).
- the 16-bit field of “segment_length” indicates the number of subsequent bytes as the length (size) of the body segment.
- segment_data_field () This field corresponds to the payload of the segment (segment packet). In the case of this body segment, the entire ⁇ body> portion or its divided portion is arranged.
- FIG. 18 shows an example of the correspondence between the TTML information arranged in the payload of each body segment and the segment information arranged in the header when the ⁇ body> portion is divided and transmitted. ing.
- the illustrated example corresponds to the example of FIG.
- segment_type 0xA3
- fragment_start_flag 1
- Fragment_end_flag 0
- region_id r1
- region_tag_update_flag 0
- body_version_number 1
- segment_type 0xA3
- fragment_start_flag 0
- fragment_end_flag 0
- region_id r1
- region_tag_update_flag 0
- body_version_number 2
- segment_type 0xA3
- fragment_start_flag “0”
- fragment_end_flag 0”
- body_version_number 3”.
- the TS formatter 116 transport-packets and multiplexes the video stream generated by the video encoder 112, the audio stream generated by the audio encoder 113, and the subtitle stream generated by the subtitle encoder 115, A transport stream TS as a multiplexed stream is obtained.
- the operation of the stream generation unit 110 shown in FIG. 2 will be briefly described.
- the image data DV is supplied to the video encoder 112.
- the image data DV is encoded, and a video stream (PES stream) including a video PES packet having encoded image data in a payload is generated.
- This video stream is supplied to the TS formatter 116.
- the audio data DA is supplied to the audio encoder 113.
- the audio encoder 113 encodes the audio data DA, and generates an audio stream (PES stream) composed of audio PES packets having encoded audio data. This audio stream is supplied to the TS formatter 116.
- text data (character code) DT as subtitle information is supplied to the text format conversion unit 114.
- This text format conversion unit 114 obtains subtitle text information in a predetermined format having display timing information, here, TTML. This TTML is supplied to the subtitle encoder 115.
- the subtitle encoder 115 generates a segment packet (segment) including a TTML document obtained by the text format conversion unit 114. Then, the subtitle encoder 115 generates a subtitle stream (PES stream) including a subtitle PES packet in which the segment packet is arranged in the payload. This subtitle stream is supplied to the TS formatter 116.
- the subtitle encoder 115 generates a segment packet including the entire TTML document in order to transmit the TTML document in a batch.
- the subtitle encoder 115 divides the TTML document, and generates a plurality of segment packets including each divided portion.
- the stream generated by each encoder is converted into a transport packet and multiplexed to generate a transport stream TS as a multiplexed stream.
- FIG. 19 shows a configuration example of the transport stream TS.
- a video PES packet “Video PES” that is a PES packet of the video stream identified by PID1.
- an audio PES packet “Audio PES” that is a PES packet of the audio stream identified by PID2.
- a subtitle PES packet “Subtitle PES” that is a PES packet of the subtitle stream identified by PID3.
- the PES packet is composed of a PES header (PES header) and a PES payload (PES payload).
- PES header PES header
- PES payload PES payload
- a DTS / PTS time stamp is inserted in the PES header
- a video encoded stream encoded image data
- audio PES packet a PTS time stamp is inserted in the PES header
- an audio encoded stream encoded audio data
- a PTS time stamp is inserted in the PES header, and the PES payload includes a segment packet (timed text subtitle) having the entire TTML document or a divided portion of the TTML document. Ring segment: TT subtitling segment) is inserted.
- the segment packet includes a document segment “document_segment ()”, a tt head segment “tthead_segment ()”, and a body segment “body_segment ()” (see FIGS. 14, 15, and 16).
- a value corresponding to “begin”, which is a relative time of TTML transmitted by the PES payload, is reflected in the PTS of the PES header.
- the TTML relative time of split transmission using the PES payload is “begin” (the value of “begin” of ⁇ span> is reflected as an offset from “begin” of ⁇ div> ) Is reflected in the PTS of the PES header.
- the transport stream TS includes a PMT (Program Map Table) as PSI (Program Specific Information).
- PSI Program Specific Information
- the PMT includes a program descriptor (Program Descriptor) that describes information related to the entire program.
- the PMT includes an elementary stream loop having information related to each elementary stream.
- Information such as a packet identifier (PID) is arranged in each loop.
- FIG. 20 shows a configuration example of the television receiver 200.
- the television receiver 200 includes a receiving unit 201, a TS analysis unit (demultiplexer) 202, a video decoder 203, a video superimposing unit 204, a panel drive circuit 205, and a display panel 206.
- the television receiver 200 includes an audio decoder 207, an audio output circuit 208, a speaker 209, and a subtitle decoder 210.
- the television receiver 200 also includes a CPU 221, a flash ROM 222, a DRAM 223, an internal bus 224, a remote control receiver 225, and a remote control transmitter 226.
- the CPU 221 controls the operation of each part of the television receiver 200.
- the flash ROM 222 stores control software and data.
- the DRAM 223 constitutes a work area for the CPU 221.
- the CPU 221 develops software and data read from the flash ROM 222 on the DRAM 223 to activate the software, and controls each unit of the television receiver 200.
- the remote control receiving unit 225 receives the remote control signal (remote control code) transmitted from the remote control transmitter 226 and supplies it to the CPU 221.
- the CPU 221 controls each part of the television receiver 200 based on this remote control code.
- the CPU 221, flash ROM 222, and DRAM 223 are connected to the internal bus 224.
- the receiving unit 201 receives the transport stream TS transmitted from the broadcast transmission system 100 on a broadcast wave.
- the transport stream TS includes a video stream, an audio stream, and a subtitle stream.
- the TS analysis unit 202 extracts video, audio, and subtitle streams from the transport stream TS.
- the audio decoder 207 performs a decoding process on the audio stream extracted by the TS analysis unit 202 to obtain audio data.
- the audio output circuit 208 performs necessary processing such as D / A conversion and amplification on the audio data, and supplies the audio data to the speaker 209.
- the video decoder 203 performs a decoding process on the video stream extracted by the TS analysis unit 202 to obtain image data.
- the subtitle decoder 210 performs a decoding process on the subtitle stream extracted by the TS analysis unit 202, and obtains bitmap data of each region to be superimposed on the image data.
- the subtitle decoder 210 extracts the TTML document from the segment packet. Then, bitmap data of each region is obtained based on the TTML document.
- the subtitle decoder 210 transmits each divided portion of the TTML document included in a plurality of segment packets (tt head segment, body segment) (FIGS. 9, 10, 11, and 12). Reference), each divided portion of the TTML document is extracted from the plurality of segment packets, the TTML document is reconstructed, and bitmap data of each region is obtained based on the reconstructed TTML document.
- the subtitle decoder 210 includes segment information (“segment_type”, “fragment_start_flag”, “fragment_end_flag”, “region_id”, “region_tag_update_flag”, “body_version_number”) arranged in the header of each segment packet. Etc.) to reconstruct the TTML document.
- the video superimposing unit 204 superimposes the bitmap data of each region obtained from the subtitle decoder 210 on the image data obtained by the video decoder 203.
- the panel drive circuit 205 drives the display panel 206 based on the display image data obtained by the video superimposing unit 204.
- the display panel 206 includes, for example, an LCD (Liquid Crystal Display), an organic EL display (organic electroluminescence display), and the like.
- FIG. 21 shows a configuration example of the subtitle decoder 210.
- the subtitle decoder 210 includes a buffer unit 211, a font renderer 215, and a subtitle image buffer 216.
- the buffer unit 211 includes a tt head buffer 212, a fragment buffer 213, and a text buffer 214.
- the tt head buffer 212 serves to buffer the ⁇ tt> portion and the ⁇ head> portion of the TTML document and manage the configuration of the document elements.
- the tt head buffer 212 has a capacity corresponding to at least the maximum size of attribute information defined by ⁇ tt> and ⁇ head>.
- the fragment buffer 213 is a buffer that temporarily passes through each divided portion when the ⁇ body> is divided and transmitted.
- the fragment buffer 213 has a capacity corresponding to at least the maximum size of information to be sent by ⁇ span>.
- the text buffer 214 is a buffer for collectively storing text data sent by ⁇ span> for a necessary period.
- the minimum size of the text buffer 214 is the size corresponding to the maximum number of characters to be displayed simultaneously. However, in order to increase the transmission flexibility, it is necessary to provide a size equivalent to the text buffer 214 multiple screen display.
- the maximum size of the text buffer 214 is a capacity for storing text during the program service.
- the font renderer 215 converts text data (font data) into bitmap data (binary image information).
- the subtitle image buffer 216 buffers the bitmap data (binary image information) obtained by the font renderer 215. In order to receive the text to be used for the next display while it is being displayed, at least two text display units that are temporally adjacent to either or both of the text buffer 214 and / or the subtitle image buffer 216 are displayed. Give the capacity of the size of text data for one.
- Attribute information defined by ⁇ tt> and ⁇ head> in the TTML document supplied from the TS analysis unit 202 is supplied to the CPU 221 through the tt head buffer 212. Also, the ⁇ body> portion (including the case of being fragmented and transmitted) in the TTML document supplied from the TS analysis unit 202 is buffered in the fragment buffer 213.
- time information such as display start timing and display end timing (timed information) is supplied to the CPU 221.
- the CPU 221 controls the subtitle display position, display timing, and the like based on attribute information (attribute information) and time information (timed information).
- text data is buffered in the text buffer 214.
- the text buffer 214 information on characters to be displayed at the same time is buffered, and character information is read out at a predetermined timing (for example, in synchronization with video picture display), and the font renderer 215 is instantly read.
- the text data (font data) is converted into bitmap data (binary image information) and supplied to the subtitle image buffer 216.
- Subtitles can be displayed before the reception of subtitles that are displayed at the same time ends.
- the text buffer 214 is switched to the next caption display.
- the bitmap data (binary image information) in the subtitle image buffer 216 is sent to the video superimposing unit 204 based on the position information from the CPU 221 and superimposed on the video data (image data).
- FIG. 22 shows an example of an operation sequence in a case where a TTML document is received after being divided and transmitted using a plurality of segment packets (Fragment packet reception) and displayed.
- a plurality of segment packets are received in a subtitle / access period (Subtitle ⁇ ⁇ ⁇ ⁇ ⁇ access period). Then, the display of the subtitle (subtitle) corresponding to the received TTML document is displayed in the subtitle display period (Subtitle display period).
- LT1 and LT2 indicate the amount of delay until reception starts after reception.
- LT1 is a value corresponding to the “begin” element of subtitle 1
- LT2 is a value corresponding to the “begin” element of subtitle 2.
- the definition is the same as a double buffer.
- the receiving unit 201 receives the transport stream TS transmitted from the broadcast transmission system 100 on the broadcast wave.
- the transport stream TS includes a video stream, an audio stream, and a subtitle stream.
- the transport stream TS is supplied to the TS analysis unit 202.
- the TS analysis unit 202 extracts video, audio, and subtitle streams from the transport stream TS.
- the video stream (PES stream) extracted by the TS analysis unit 202 is supplied to the video decoder 203.
- the video stream is decoded and image data is obtained. This image data is supplied to the video superimposing unit 204.
- the subtitle stream (PES stream) extracted by the TS analysis unit 202 is supplied to the subtitle decoder 210.
- decoding processing is performed on the subtitle stream, and bitmap data of each region to be superimposed on the image data is obtained.
- the TTML document is extracted from the segment packet, and the TTML document is extracted. Based on the above, bitmap data of each region is obtained.
- each divided portion of a TTML document is transmitted by being included in a plurality of segment packets (tt head segment, body segment) (see FIGS. 9, 10, 11, and 12).
- Each divided portion of the TTML document is extracted from the plurality of segment packets.
- segment information or the like is used to reconstruct a TTML document, and bitmap data of each region is obtained based on the reconstructed TTML document.
- the bitmap data of each region output from the subtitle decoder 210 is supplied to the video superimposing unit 204.
- the video superimposing unit 204 the bitmap data of each region output from the subtitle decoder 210 is superimposed on the image data obtained by the video decoder 203.
- Display image data obtained by the video superimposing unit 204 is supplied to the panel drive circuit 205.
- the panel drive circuit 205 drives the display panel 206 based on the display video data. As a result, an image in which each region is superimposed is displayed on the display panel 206 (see FIGS. 6 and 8).
- a TTML document can be divided and transmitted. In this case, it is performed by sequentially transmitting a plurality of segment packets including each divided portion of the TTML document in the payload.
- partial addition / change of the subtitle display, etc. only the change / addition target portion can be transmitted, and transmission efficiency can be improved.
- the transmission / reception system 10 shown in FIG. 1 when a plurality of segment packets including each divided portion of the TTML document in the payload are sequentially transmitted, the divided portions arranged in the payload of the segment packet are displayed in a predetermined region.
- identification information of a predetermined region is arranged in the header of this packet. Therefore, the reception side can easily grasp which region the subtitle information arranged in the payload of the segment packet relates to. This identification information is very useful information when adding and changing the display of subtitles of a plurality of regions in parallel.
- TTML is used as text information of a subtitle having a predetermined format having display timing information.
- the present technology is not limited to this, and other timed text information having information equivalent to TTML may be used.
- a TTML derivative format may be used.
- the transmission / reception system 10 including the broadcast transmission system 100 and the television receiver 200 is shown, but the configuration of the transmission / reception system to which the present technology can be applied is not limited thereto.
- a configuration of a set top box and a monitor in which the television receiver 200 is connected by a digital interface such as HDMI (High-Definition Multimedia Interface) may be used.
- HDMI High-Definition Multimedia Interface
- HDMI High-Definition Multimedia Interface
- the multiplexed stream is an MPEG-2 transport stream.
- the present technology can be similarly applied when the multiplexed stream is an MMT stream or a DASH / ISOBMFF stream.
- this technique can also take the following structures.
- a packet generation unit that divides a document of subtitle text information having display timing information into a plurality of pieces, and generates a plurality of packets in which each divided part is arranged in a payload;
- a transmission apparatus comprising a transmission unit that sequentially transmits the plurality of packets.
- the packet generator The transmission apparatus according to (1), wherein packet type information corresponding to the attribute of the divided portion arranged in the payload of the packet is arranged in a header of the packet.
- the packet generator When the divided portion arranged in the payload of the packet is subtitle information to be displayed in a predetermined region, the identification information of the predetermined region is arranged in the header of the packet (1) or (2)
- the transmitting device according to 1.
- the document has a head portion and a body portion, The packet generator When the divided part arranged in the packet is a divided part of the body part, The transmission apparatus according to any one of (1) to (3), wherein position information indicating whether the divided portion is positioned at a first, middle, or last position of the body part is arranged in a header of the packet.
- the document has a head portion and a body portion, The packet generator When the divided part arranged in the packet is a divided part of the body part, The transmission apparatus according to any one of (1) to (4), wherein order information indicating the order of the divided parts is arranged in a header of the packet.
- the packet generator To declare the end time of a region where only a start time is declared for a given element, The transmission device according to any one of (1) to (5), wherein the updated predetermined element is generated in a packet arranged in a payload. (7) The transmission device according to any one of (1) to (6), wherein the document is a document in TTML or a format derived from the TTML. (8) a packet generation step in which a packet generation unit divides a document of subtitle text information having display timing information into a plurality of pieces, and generates a plurality of packets in which each divided part is arranged in a payload; A transmission method, wherein the transmission unit includes a transmission step of sequentially transmitting the plurality of packets.
- a receiving unit that sequentially receives a plurality of packets generated by arranging each divided portion obtained by dividing a document of subtitle text information having display timing information into a plurality of pieces in a payload;
- a receiving apparatus comprising: a subtitle control unit configured to reconstruct the document using each divided portion arranged in the payloads of the plurality of packets to control subtitle display.
- a receiving step in which the receiving unit sequentially receives a plurality of packets generated by arranging each divided portion obtained by dividing a document of subtitle text information having display timing information into a plurality of pieces in a payload.
- a reception method comprising: a subtitle control step in which a subtitle control unit reconstructs the document using each divided portion arranged in payloads of the plurality of packets to control subtitle display.
- the main feature of the present technology is that a subtitle display portion is obtained by sequentially transmitting a plurality of packets each including a divided portion obtained by dividing a subtitle text information document having display timing information such as TTML.
- a subtitle display portion is obtained by sequentially transmitting a plurality of packets each including a divided portion obtained by dividing a subtitle text information document having display timing information such as TTML.
- display timing information such as TTML.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割し、各分割部分がそれぞれペイロードに配置された複数のパケットを生成するパケット生成部と、
上記複数のパケットを順次送信する送信部を備える
送信装置にある。
表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割して得られた各分割部分をそれぞれペイロードに配置して生成された複数のパケットを順次受信する受信部と、
上記複数のパケットのペイロードに配置された各分割部分を用いて上記ドキュメントを再構成してサブタイトル表示を制御するサブタイトル制御部を備える
受信装置にある。
1.実施の形態
2.変形例
[送受信システムの構成例]
図1は、実施の形態としての送受信システム10の構成例を示している。この送受信システム10は、放送送出システム100とテレビ受信機200により構成されている。放送送出システム100は、多重化ストリームとしてのMPEG-2トランスポートストリーム(以下、単に、「トランスポートストリーム」という)TSを、放送波に載せて送信する。
図2は、放送送出システム100のストリーム生成部110の構成例を示している。このストリーム生成部110は、制御部111と、ビデオエンコーダ112と、オーディオエンコーダ113と、テキストフォーマット変換部114と、サブタイトルエンコーダ115と、TSフォーマッタ(マルチプレクサ)116を有している。
「segment_length」の16ビットフィールドは、ドキュメント・セグメントの長さ(サイズ)として以降のバイト数を示す。「segment_length」の後に、「segment_data_field()」のフィールドが存在する。このフィールドが、セグメント(セグメントパケット)のペイロードに相当し、このドキュメント・セグメントの場合、TTMLのドキュメントの全体が配置される。
図20は、テレビ受信機200の構成例を示している。このテレビ受信機200は、受信部201と、TS解析部(デマルチプレクサ)202と、ビデオデコーダ203と、ビデオ重畳部204と、パネル駆動回路205と、表示パネル206を有している。また、このテレビ受信機200は、オーディオデコーダ207と、音声出力回路208と、スピーカ209と、サブタイトルデコーダ210を有している。また、このテレビ受信機200は、CPU221と、フラッシュROM222と、DRAM223と、内部バス224と、リモコン受信部225と、リモコン送信機226を有している。
なお、上述実施の形態においては、表示タイミング情報を持つ所定フォーマットのサブタイトルのテキスト情報としてTTMLを用いる例を示した。しかし、本技術は、これに限定されず、TTMLと同等の情報を持つその他のタイムドテキスト情報を用いることも考えられる。例えば、TTMLの派生フォーマットを用いてもよい。
(1)表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割し、各分割部分がそれぞれペイロードに配置された複数のパケットを生成するパケット生成部と、
上記複数のパケットを順次送信する送信部を備える
送信装置。
(2)上記パケット生成部は、
上記パケットのヘッダに、該パケットのペイロードに配置された上記分割部分の属性に対応したパケットタイプ情報を配置する
前記(1)に記載の送信装置。
(3)上記パケット生成部は、
上記パケットのペイロードに配置される分割部分が、所定のリージョンに表示すべきサブタイトルの情報であるとき、該パケットのヘッダに、上記所定のリージョンの識別情報を配置する
前記(1)または(2)に記載の送信装置。
(4)上記ドキュメントは、ヘッド部とボディ部を有し、
上記パケット生成部は、
上記パケットに配置される分割部分が上記ボディ部を分割したものであるとき、
該パケットのヘッダに、該分割部分が上記ボディ部の最初、中間あるいは最後のいずれに位置するかを示す位置情報を配置する
前記(1)から(3)のいずれかに記載の送信装置。
(5)上記ドキュメントは、ヘッド部とボディ部を有し、
上記パケット生成部は、
上記パケットに配置される分割部分が上記ボディ部を分割したものであるとき、
該パケットのヘッダに、該分割部分の順番を示す順番情報を配置する
前記(1)から(4)のいずれかに記載の送信装置。
(6)上記パケット生成部は、
所定のエレメントで開始時点だけが宣言されているリージョンの終了時点を宣言するために、
更新した上記所定のエレメントがペイロードに配置されたパケットを生成する
前記(1)から(5)のいずれかに記載の送信装置。
(7)上記ドキュメントは、TTMLあるいは該TTMLの派生フォーマットのドキュメントである
前記(1)から(6)のいずれかに記載の送信装置。
(8)パケット生成部が、表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割し、各分割部分がそれぞれペイロードに配置された複数のパケットを生成するパケット生成ステップと、
送信部が、上記複数のパケットを順次送信する送信ステップを有する
送信方法。
(9)表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割して得られた各分割部分をそれぞれペイロードに配置して生成された複数のパケットを順次受信する受信部と、
上記複数のパケットのペイロードに配置された各分割部分を用いて上記ドキュメントを再構成してサブタイトル表示を制御するサブタイトル制御部を備える
受信装置。
(10)受信部が、表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割して得られた各分割部分をそれぞれペイロードに配置して生成された複数のパケットを順次受信する受信ステップと、
サブタイトル制御部が、上記複数のパケットのペイロードに配置された各分割部分を用いて上記ドキュメントを再構成してサブタイトル表示を制御するサブタイトル制御ステップ有する
受信方法。
100・・・放送送出システム
110・・・ストリーム生成部
111・・・制御部
112・・・ビデオエンコーダ
113・・・オーディオエンコーダ
114・・・テキストフォーマット変換部
115・・・サブタイトルエンコーダ
116・・・TSフォーマッタ
200・・・テレビ受信機
201・・・受信部
202・・・TS解析部
203・・・ビデオデコーダ
204・・・ビデオ重畳部
205・・・パネル駆動回路
206・・・表示パネル
207・・・オーディオデコーダ
208・・・音声出力回路
209・・・スピーカ
210・・・サブタイトルデコーダ
211・・・バッファ部
212・・・ttヘッド・バッファ
213・・・フラグメント・バッファ
214・・・テキスト・バッファ
215・・・フォント・レンダラ
216・・・サブタイトル・イメージ・バッファ
221・・・CPU
222・・・フラッシュROM
223・・・DRAM
224・・・内部バス
225・・・リモコン受信部
226・・・リモコン送信機
Claims (10)
- 表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割し、各分割部分がそれぞれペイロードに配置された複数のパケットを生成するパケット生成部と、
上記複数のパケットを順次送信する送信部を備える
送信装置。 - 上記パケット生成部は、
上記パケットのヘッダに、該パケットのペイロードに配置された上記分割部分の属性に対応したパケットタイプ情報を配置する
請求項1に記載の送信装置。 - 上記パケット生成部は、
上記パケットのペイロードに配置される分割部分が、所定のリージョンに表示すべきサブタイトルの情報であるとき、該パケットのヘッダに、上記所定のリージョンの識別情報を配置する
請求項1に記載の送信装置。 - 上記ドキュメントは、ヘッド部とボディ部を有し、
上記パケット生成部は、
上記パケットに配置される分割部分が上記ボディ部を分割したものであるとき、
該パケットのヘッダに、該分割部分が上記ボディ部の最初、中間あるいは最後のいずれに位置するかを示す位置情報を配置する
請求項1に記載の送信装置。 - 上記ドキュメントは、ヘッド部とボディ部を有し、
上記パケット生成部は、
上記パケットに配置される分割部分が上記ボディ部を分割したものであるとき、
該パケットのヘッダに、該分割部分の順番を示す順番情報を配置する
請求項1に記載の送信装置。 - 上記パケット生成部は、
所定のエレメントで開始時点だけが宣言されているリージョンの終了時点を宣言するために、
更新した上記所定のエレメントがペイロードに配置されたパケットを生成する
請求項1に記載の送信装置。 - 上記ドキュメントは、TTMLあるいは該TTMLの派生フォーマットのドキュメントである
請求項1に記載の送信装置。 - パケット生成部が、表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割し、各分割部分がそれぞれペイロードに配置された複数のパケットを生成するパケット生成ステップと、
送信部が、上記複数のパケットを順次送信する送信ステップを有する
送信方法。 - 表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割して得られた各分割部分をそれぞれペイロードに配置して生成された複数のパケットを順次受信する受信部と、
上記複数のパケットのペイロードに配置された各分割部分を用いて上記ドキュメントを再構成してサブタイトル表示を制御するサブタイトル制御部を備える
受信装置。 - 受信部が、表示タイミング情報を持つサブタイトルのテキスト情報のドキュメントを複数個に分割して得られた各分割部分をそれぞれペイロードに配置して生成された複数のパケットを順次受信する受信ステップと、
サブタイトル制御部が、上記複数のパケットのペイロードに配置された各分割部分を用いて上記ドキュメントを再構成してサブタイトル表示を制御するサブタイトル制御ステップ有する
受信方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201780006554.4A CN108702529A (zh) | 2016-01-19 | 2017-01-17 | 发送设备、发送方法、接收设备和接收方法 |
EP17741387.9A EP3407611A1 (en) | 2016-01-19 | 2017-01-17 | Transmission device, transmission method, reception device, and reception method |
JP2017562823A JP6900907B2 (ja) | 2016-01-19 | 2017-01-17 | 送信装置、送信方法、受信装置および受信方法 |
US16/068,825 US11290785B2 (en) | 2016-01-19 | 2017-01-17 | Transmission apparatus, transmission method, reception apparatus, and reception method for transmitting subtitle text information |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016008353 | 2016-01-19 | ||
JP2016-008353 | 2016-01-19 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017126509A1 true WO2017126509A1 (ja) | 2017-07-27 |
Family
ID=59361745
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2017/001434 WO2017126509A1 (ja) | 2016-01-19 | 2017-01-17 | 送信装置、送信方法、受信装置および受信方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US11290785B2 (ja) |
EP (1) | EP3407611A1 (ja) |
JP (1) | JP6900907B2 (ja) |
CN (1) | CN108702529A (ja) |
WO (1) | WO2017126509A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108449651A (zh) * | 2018-05-24 | 2018-08-24 | 腾讯科技(深圳)有限公司 | 字幕添加方法及装置 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012169885A (ja) | 2011-02-15 | 2012-09-06 | Sony Corp | 表示制御方法、記録媒体、表示制御装置 |
JP2015518347A (ja) * | 2012-04-25 | 2015-06-25 | サムスン エレクトロニクス カンパニー リミテッド | マルチメディア送信システムのためのデータ送受信方法及び装置 |
JP2016006958A (ja) * | 2014-05-30 | 2016-01-14 | 日本放送協会 | 送信装置および受信装置、ならびにプログラム |
JP2016110645A (ja) * | 2014-11-28 | 2016-06-20 | 日本放送協会 | 分割装置および解析装置、ならびにプログラム |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI241824B (en) * | 2003-10-31 | 2005-10-11 | Benq Corp | Mobile phone and related method for displaying text message with various background images |
JP2006238147A (ja) | 2005-02-25 | 2006-09-07 | Toshiba Corp | コンテンツ再生装置、字幕再生方法及びプログラム |
JP4816262B2 (ja) * | 2006-06-06 | 2011-11-16 | ソニー株式会社 | 再生装置、再生方法および再生プログラム |
US20070288840A1 (en) * | 2006-06-13 | 2007-12-13 | David Andrew Girle | System and method for parsing large xml documents transported across networks as xml encapsulated chunks |
US20080040498A1 (en) * | 2006-08-10 | 2008-02-14 | Nokia Corporation | System and method of XML based content fragmentation for rich media streaming |
PL2362671T3 (pl) * | 2008-07-25 | 2014-05-30 | Koninklijke Philips Nv | Obsługa napisów przez wyświetlacz 3D |
JP2015109131A (ja) * | 2013-12-03 | 2015-06-11 | パナソニックIpマネジメント株式会社 | ファイル生成方法、再生方法、ファイル生成装置、再生装置および記録媒体 |
JP6331670B2 (ja) | 2014-05-12 | 2018-05-30 | ソニー株式会社 | 受信装置、および送信装置、並びにデータ処理方法 |
DE202014102663U1 (de) | 2014-06-06 | 2014-06-24 | Ti Automotive (Heidelberg) Gmbh | Schraubelement für den Anschluss von Rohrleitungen und Rohranschlusseinrichtung mit diesem Schraubelement |
FR3025925B1 (fr) * | 2014-09-17 | 2016-12-23 | France Brevets | Procede de controle de modes de presentation de sous-titres |
FR3025926B1 (fr) * | 2014-09-17 | 2018-11-02 | France Brevets | Procede de controle de la vitesse d'affichage des sous-titres |
-
2017
- 2017-01-17 JP JP2017562823A patent/JP6900907B2/ja active Active
- 2017-01-17 WO PCT/JP2017/001434 patent/WO2017126509A1/ja active Application Filing
- 2017-01-17 US US16/068,825 patent/US11290785B2/en active Active
- 2017-01-17 EP EP17741387.9A patent/EP3407611A1/en not_active Ceased
- 2017-01-17 CN CN201780006554.4A patent/CN108702529A/zh active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012169885A (ja) | 2011-02-15 | 2012-09-06 | Sony Corp | 表示制御方法、記録媒体、表示制御装置 |
JP2015518347A (ja) * | 2012-04-25 | 2015-06-25 | サムスン エレクトロニクス カンパニー リミテッド | マルチメディア送信システムのためのデータ送受信方法及び装置 |
JP2016006958A (ja) * | 2014-05-30 | 2016-01-14 | 日本放送協会 | 送信装置および受信装置、ならびにプログラム |
JP2016110645A (ja) * | 2014-11-28 | 2016-06-20 | 日本放送協会 | 分割装置および解析装置、ならびにプログラム |
Non-Patent Citations (4)
Title |
---|
"ARIB STD-B62 MULTIMEDIA CODING SPECIFICATION FOR DIGITAL BROADCASTING (SECOND GENERATION), version 1.0-E1", ASSOCIATION OF RADIO INDUSTRIES AND BUSINESSES, 2015.01,, January 2015 (2015-01-01), pages 60 - 75, Retrieved from the Internet <URL:http://www.arib.or.jp/english/html/overview/doc/6-STD-B62v10-1p2-E1.pdf> [retrieved on 20170407] * |
AKITSUGU BABA: "4. New Closed Captioning and Character Superimposition System and Service Examples for Super Hi-Vision Satellite Broadcasting", THE JOURNAL OF THE INSTITUTE OF IMAGE INFORMATION AND TELEVISION ENGINEERS, vol. 69, no. 9, 1 September 2015 (2015-09-01), pages 693 - 696, XP055496860, ISSN: 1342-6907, Retrieved from the Internet <URL:https://doi.org/10.3169/itej.69.693> * |
ARIB STD-B60 MMT-BASED MEDIA TRANSPORT SCHEME IN DIGITAL BROADCASTING SYSTEMS, July 2014 (2014-07-01), pages 29 - 30;114-121 * |
See also references of EP3407611A4 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108449651A (zh) * | 2018-05-24 | 2018-08-24 | 腾讯科技(深圳)有限公司 | 字幕添加方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
EP3407611A4 (en) | 2018-11-28 |
CN108702529A (zh) | 2018-10-23 |
US20190028773A1 (en) | 2019-01-24 |
EP3407611A1 (en) | 2018-11-28 |
JPWO2017126509A1 (ja) | 2018-11-08 |
US11290785B2 (en) | 2022-03-29 |
JP6900907B2 (ja) | 2021-07-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7020406B2 (ja) | 送信装置、送信方法、受信装置および受信方法 | |
JP6927374B2 (ja) | 受信装置および受信方法 | |
JP6825558B2 (ja) | 送信装置、送信方法、再生装置および再生方法 | |
RU2701172C2 (ru) | Передающее устройство, способ передачи, приемное устройство и способ приема | |
JP6760296B2 (ja) | 送信装置、送信方法、再生装置および再生方法 | |
US11765330B2 (en) | Transmitter, transmission method, receiver, and reception method | |
JP6900907B2 (ja) | 送信装置、送信方法、受信装置および受信方法 | |
CN109479154B (zh) | 发送装置、发送方法、接收装置和接收方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17741387 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017562823 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2017741387 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2017741387 Country of ref document: EP Effective date: 20180820 |