EP3205085A1 - Vorrichtung und verfahren zum schneiden von mehreren kodierten videoströmen ohne vorherige dekodierung - Google Patents
Vorrichtung und verfahren zum schneiden von mehreren kodierten videoströmen ohne vorherige dekodierungInfo
- Publication number
- EP3205085A1 EP3205085A1 EP15781610.9A EP15781610A EP3205085A1 EP 3205085 A1 EP3205085 A1 EP 3205085A1 EP 15781610 A EP15781610 A EP 15781610A EP 3205085 A1 EP3205085 A1 EP 3205085A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- video
- encoded
- data stream
- input data
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims description 38
- 238000005520 cutting process Methods 0.000 title description 4
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 6
- 230000008569 process Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
- H04N21/4383—Accessing a communication channel
- H04N21/4384—Accessing a communication channel involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
Definitions
- the application relates to video processing, and more particularly to an apparatus and method for slicing multiple encoded video streams without prior decoding.
- video streams are usually received by a plurality of cameras, from which a mixed output video stream is produced with a cut order to be determined, which is broadcast.
- the uncompressed camera video streams are merged for this purpose on a video switch, with which the desired image can be switched to the output.
- New developments in TV production mobile cameras, very high resolutions, etc.
- require a prior compression of the video streams which is usually achieved through the use of digital video codecs.
- An intra-frame (also called an intra-picture, I-frame, final sibiid or reference picture) in picture prediction in a group of pictures is an image which is independently decodable (from the other pictures). In a group of images, the prediction of the other images (which are not intra-frames) builds on the intra-frame. Intra-frames are well known to those skilled in the video signal processing art.
- Inter-frames are for example P-frames or B-frames.
- P-frames the image data of the P-frame (ua) is determined from the image data of previous images.
- B frames the image data of the B frame (ua) is determined from the image data of previous and subsequent images.
- Inter-frames, P-frames and B-frames are well known to those skilled in the art of video signal processing.
- H264 a video codec, in which such a subdivision of the images into intra-frames (reference images) and inter-frames (referencing images) make (for H.264, see for example [1]).
- Figure 2 shows two example video streams, specifically, the construction of H264 streams.
- GOPs group of pictures
- a reference image e.g., H264: I-frame
- a plurality of referencing images e.g., in H264: P-frames
- all single images can be decoded without error.
- a video switch (video switcher) is used for cutting, which makes it possible to cut uncompressed video streams.
- these video streams must be decoded in front of the input to the switch, which leads to a high computational effort, which increases the more compressed data streams are present in such a scenario , Thereafter, these can be used traditionally as uncompressed streams.
- Another approach to switching between encoded streams is the use of so-called S-frames.
- S-frames can only be used when switching between streams generated by the same source, which then only in their quality level (Resolution, data rate, etc.).
- An apparatus for generating a video output data stream by switching from a first video input data stream to a second video input data stream includes an interface for receiving encoded video frames of a first video input data stream, wherein each of the encoded video frames of the first video input data stream is either an encoded intra-frame or an encoded inter-frame.
- the apparatus further comprises a video data stream generator for generating the video output data stream, wherein the video data stream generator is configured to output one or more video frames of the first video input data stream as one or more encoded video frames of the video output data stream.
- the interface is adapted to receive a toggle command instructing to switch to the reception of encoded video frames of the second video input data stream, wherein each of the encoded video frames of the second video input data stream is either an encoded intra-frame or an encoded inter-frame. Further, the interface is configured to send a request command requesting the transmission of one of the encoded intraframes of the second video input data stream upon receipt of the switching command. Furthermore, the interface is configured to receive the encoded video frames of the second video input data stream.
- the video stream generator is adapted to issue, in response to a arrival of one of the intra-frames of the second video input data stream at the interface, that intra-frame and the encoded video frame of the second video input data stream received from the interface upon receipt of that intraframe as video frames of the video output data stream.
- the video stream generator may be configured to determine that intra-frame of the second video stream by the video stream generator, upon receiving the toggle command, to check each of the encoded video frames of the second video input stream received at the interface to see if that encoded video frame is an encoded intra-frame.
- the video data stream generator can be designed, for example, to output this IntraFrame as a video frame of the video output data stream.
- the video data stream generator may be configured, for example, none of the encoded interframes of the second video input data stream received from the interface After the switch command has been received and before the interface has received one of the encoded intra-frames of the second video input data stream upon receipt of the switch command, they are output as encoded video frames of the video output data stream. Further, the video data stream generator may be configured, for example, each of the encoded inter-frames of the second video input data stream received by the interface after the switching command has been received, and after the interface has received at least one of the encoded intra-frames of the second video input data stream upon receipt of the switching command has received to output as a video frame of the video output stream.
- the video stream generator may be e.g. to form each of the encoded video frames of the first video input data stream received from the interface after the switching command has been received and before the interface has received one of the encoded intra-frames of the second video input data stream after receiving the switching command as the encoded video frames of Output video output data stream.
- the device may also be e.g. a user interface by means of which a user can trigger the toggle command.
- the device may be e.g. a switching unit adapted to trigger the switching command, wherein the switching unit may be arranged to trigger the switching command independently of a user, and wherein the switching unit may be further configured to initiate the switching command regardless of when encoded intra-switching Frames of the second video input data stream are received by the interface.
- the toggle command may be a first toggle command
- the request command may be, for example, a first request command
- the interface may be configured to receive a second toggle command instructing to toggle to receive encoded video frames of a third video input data stream each of the encoded video frames of the third video input data stream is either an encoded intra-frame or an encoded inter-frame.
- the interface can be designed, for example, to send a second request command after receiving the second switching command requesting the transmission of one of the encoded intraframes of the third video input data stream.
- the interface may, for example, be configured to receive the encoded video frames of the third video input data stream.
- the video data stream generator may be formed, for example, after reception the second toggle command to check each of the encoded video frames received at the interface of the third video input data stream to see if that encoded video frame is an encoded intraframe.
- the video data stream generator may be configured, if this encoded video frame is an encoded intra-frame, to output this encoded intra-frame as a video frame of the video output data stream.
- the video stream generator may be configured, for example, not to receive any of the encoded inter-frames of the third video input data stream received by the interface after the second switching command has been received and before the interface receives one of the encoded intra-frames of the third video input data stream second switching command has been issued to output as encoded video frames of the video output data stream.
- the video stream generator may be configured to receive each of the encoded inter-frames of the third video input data stream received from the interface after the second switching command has been received and after the interface receives at least one of the encoded intra-frames of the third video input data stream after receipt of the second Switch command to output as a video frame of the video output data stream.
- the interface may e.g. be configured to receive an image group comprising one of the encoded intra-frames of the second video input data stream and at least ten of the encoded inter-frames of the second video input data stream, the interface being adapted to first encode the encoded intra-frame of the image group and then to receive the at least ten encoded interframes of the image group, the interface eg may be configured to receive no other video frame of the second video input data stream between the encoded intra-frame of the image sequences and between each of the encoded inter-frames of the second video input data stream.
- the video data stream generator may e.g. be configured to output the encoded intraframe of the image sequence and each of the at least ten encoded interframes of the image sequence as eleven or more consecutive encoded video frames of the video output data stream.
- the encoded intra-frame of the second video input data stream is subsequently followed by at least 30 intraframes of the second video input data stream.
- the system includes a device as described above, a first encoder, and a second encoder.
- the first encoder points an encoding unit and an interface, wherein the encoding unit of the first encoder is adapted to generate the encoded video frames of the first video input data stream, the interface of the first encoder configured to send the encoded video frames of the first video input data stream to the interface of the apparatus described above.
- the second encoder has a further encoding unit and a further interface, wherein the encoding unit of the second encoder is adapted to generate the encoded video frames of the second video input data stream, the interface of the second encoder being adapted to interface the encoded video frames of the second video input data stream to the interface of the above to send described device.
- the interface of the device described above is configured to send the request command to the interface of the second encoder after receipt of the switching command.
- the interface of the second encoder is adapted to receive the request command. Further, upon receiving the request command, the interface of the second encoder is adapted to send one of the encoded video frames of the second video input data stream, which is one of the encoded intraframes of the second video input data stream, to the interface of the apparatus described above.
- the interface of the second encoder may be configured between receiving the request command and transmitting said one of the encoded intra-frames of the second video input data stream, not one of the encoded video frames of the second video input data stream that is not an intra-frame. to send to the interface of the device described above.
- the interface of the second encoder may be configured to send a group of pictures to the interface of the apparatus described above, wherein the picture stream comprises one of the encoded intra-frames of the second video input data stream and at least ten of the encoded inter-frames of the second video input data stream .
- the interface of the second encoder may be designed, for example, first to send the encoded intraframe of the group of pictures and then the at least ten encoded interframes of the group of pictures to the interface of the device described above, wherein the interface of the second encoder may be formed not to send any other video frame of the second video input data stream between the encoded intra-frame of the image sequences and between each of the encoded inter-frames of the second video input data stream to the interface of the device described above.
- the interface of the apparatus described above can be set up, for example, to receive the picture group, the interface of the apparatus described above being configured, for example, for this purpose. may be initially receiving the encoded intraframe of the imagery and thereafter receiving the at least ten encoded interframes of the imagery, wherein the interface of the apparatus described above is configured to receive no other video frame of the second input video stream between the encoded intraframe of the imagery and to receive between each of the encoded inter-frames of the second video input data stream.
- the video data stream generator of the device described above can be designed, for example, to output the encoded intraframe of the image sequence and each of the at least ten encoded interframes of the image sequence as eleven or more consecutive encoded video frames of the video output data stream.
- the encoded intra-frame of the second video input data stream is subsequently followed by at least 30 intra-frames of the second video input data stream.
- the system may further comprise one or more terminals, each of the one or more terminals including an interface and a decoder.
- the interface of each of the one or more terminals may be configured to receive the video output data stream.
- the decoder of each of the one or more terminals may be configured to decode the encoded video frames of the video output data stream.
- a method for generating a video output data stream by switching from a first video input data stream to a second video input data stream comprising:
- each of the encoded video frames of the first video input data stream is either an encoded intra-frame or an encoded inter-frame.
- Embodiments realize that, despite the particular structure of such video codecs, mixing of such encoded video streams is possible.
- Embodiments are based on the concept of not directly executing the switch command, but the command is understood by the device according to one embodiment only as a request to comply with this command at the earliest possible time. However, this procedure would lead to large (image group structures) GOP structures that the switching process would be carried out very delayed. Embodiments accomplish this by sending a request command requesting an intra-frame of the data stream to be switched to.
- FIG. 1 shows a device according to an embodiment
- Figure 2 shows two example video streams, specifically, the construction of H264 streams.
- FIG. 3 shows a device according to a further embodiment, which also has a user interface
- FIG. 4 shows a device according to a further embodiment, which also has a switching unit
- Fig. 5 shows a device according to another embodiment
- FIG. 6 shows a system according to an embodiment comprising a device according to an embodiment and two encoders.
- FIG. 7 shows a system according to an embodiment, further comprising
- FIG. 8 shows a direct request for an intra-frame in an encoder in a system according to an embodiment.
- 1 shows an apparatus 100 for generating a video output data stream by switching from a first video input data stream to a second video input data stream according to an embodiment.
- the apparatus 100 includes an interface 110 for receiving encoded video frames of a first video input data stream, wherein each of the encoded video frames of the first video input data stream is either an encoded intra-frame or an encoded inter-frame.
- the apparatus 100 includes a video data stream generator 120 for generating the video output data stream, the video data stream generator 120 configured to output one or more video frames of the first video input data stream as one or more encoded video frames of the video output data stream.
- the interface 110 is configured to receive a toggle command instructing it to switch to the reception of encoded video frames of the second video input data stream.
- Each of the encoded video frames of the second video input data stream is in turn either an encoded intra-frame or an encoded inter-frame.
- the interface 110 is now configured to send a request command requesting the transmission of one of the encoded intra-frames of the second video input data stream upon receipt of the switching command. Furthermore, the interface 110 is configured to receive the encoded video frames of the second video input data stream.
- the video data stream generator 120 is formed in response to a arrival of one of the intra-frames of the second video input data stream at the interface 1 10, this intra-frame and the received from the interface after the arrival of this intra-frame encoded video frame of the second video input data stream as video frames of Output video output data stream.
- Exemplary embodiments of the invention concern, for example, the compilation of a video output data stream as a live stream, whereby the (first) video input data stream of a first camera from several camera live recordings, but then, in response to the switchover command, the (second) video input data stream of a second camera into the first Video output data stream to be inserted.
- the problem here is that the video input data streams only occasionally have intra-frames that can be decoded by themselves, but also a large number of consecutive inter-frames that require an intra-frame for their decoding.
- the present invention solves these technical difficulties by having interface 110 configured to send a request command requesting the transmission of one of the encoded intra-frames of the second video input data stream upon receipt of the switch command.
- a request command requesting the transmission of one of the encoded intra-frames of the second video input data stream upon receipt of the switch command.
- an encoder that provides the second video stream can be informed that an IntraFrame is needed.
- the encoder is informed of the desire of the device 100 to immediately receive an intra-frame, and can send this to the interface 1 10.
- the device 100 can also receive groups of images with a large number of interframes and still allow fast switching. remains possible. Not many intraframes need to be preemptively provisioned in the video input data streams to enable fast switching at any time. Instead, a required intra-frame is explicitly requested by the request command when the switch command is issued.
- the output data stream is to contain only relatively few IntraFrames, it is not necessary to recode the video input data streams in the device 100 (from input data streams having a relatively large number of intraframes to enable fast switching, recoded to an output data stream) relatively few intra-frames to keep the data rate low). Instead, the frames of the respectively selected video input data stream can be directly output as frames of the video output data stream as soon as the requested intra-frame arrives at the interface 110. Although an acceleration of the intra-frame preservation of the second data stream is achieved by the request command.
- the video data stream generator 120 may be provided e.g. be formed to determine arrival of the first intra-frame of the second video data stream by the video data stream generator 120, after receiving the switching command, to check whether each of the encoded video frames incoming at the interface 1 10 of the second video input data stream, whether this encoded - te video frame is an encoded intra-frame.
- the video stream generator 120 may then be configured to output this intra-frame as a video frame of the video output data stream.
- the video data stream generator may be configured, for example, not to receive any of the encoded inter-frames of the second video input data stream received by the interface after the switching command has been received and before the interface receives one of the encoded intra-frames of the second video input data stream upon receipt of the switching command has to output as encoded video frames of the video output stream.
- These inter-frames of the second video input data Currents are not decodable without an intra-frame of the second video input data stream. If they were nevertheless inserted in the video output data stream, this would lead to artifacts in a decoder which wants to receive and decode the video output data stream, which should be avoided.
- the video data stream generator 120 may be configured to receive each of the encoded inter-frames of the second video input data stream received by the interface 110 after the switching command has been received, and after the interface 110 receives at least one of the encoded intra-frames of the second video input data. after receiving the switching command, to output as a video frame of the video output data stream.
- These inter-frames of the second video input data stream are then decodable without artifacts for a decoder receiving and decoding the video output data stream, since the previous intra-frame of the second video input data stream has already been inserted into the video output data stream.
- the video stream generator may be e.g. to form each of the encoded video frames of the first video input data stream received from the interface after the switching command has been received and before the interface has received one of the encoded intra-frames of the second video input data stream after receiving the switching command as the encoded video frames of Output video output data stream.
- it may be useful to continue to insert the frames of the first video input data stream into the video output data stream for the short transition period until the arrival of the requested first intraframe of the second video input data stream, since these can each be decoded ,
- the device 100 may also be e.g. a user interface 1 12, by means of which a user can trigger the toggle command.
- Fig. 3 shows such a user interface 1 12, at which e.g. a live broadcast director switching from e.g. Camera image 1 on camera image 2 can trigger.
- the user interface may be a keyboard or buttons of a mixing console for mixing video streams.
- the apparatus 100 may further include a switching unit 14 that is configured to initiate the switching command 14, wherein the switching unit 14 may be configured to trigger the switching command independently of a user and wherein the switching unit 14 may be further configured to initiate the switching instruction independently of when it encoded Intra-frames of the second video input data stream from the interface 1 10 are received.
- the switching unit 14 may be a time switch, which makes it possible to switch between monitoring videos from different surveillance cameras at fixed or variable time intervals. A vote of the switching in the program logic of the switching unit to the input of I-frames would be technically complex. However, persistent artifacts in the video output stream that provides the watch video presented to the user are undesirable.
- the interface may be configured to receive a second toggle command instructing it to toggle to receive encoded video frames of a third video input data stream, each of the encoded video frames of the third video input data stream being either an encoded intra-frame or an encoded inter-frame is.
- the interface can be designed, for example, to send a wide request command after receiving the second switching command requesting the transmission of one of the encoded intra-frames of the third video input data stream.
- the interface may, for example, be configured to receive the encoded video frames of the third video input data stream.
- the video data stream generator may be configured, for example, after receiving the switch command to check each of the encoded video frames of the third video input data stream arriving at the interface to see if this encoded video frame is an encoded intraframe.
- the video data stream generator may be configured, if this encoded video frame is an encoded intra-frame, to output this encoded intra-frame as a video frame of the video output data stream.
- the video data stream generator may be configured, for example, not to receive any of the encoded inter-frames of the third video input data stream received by the interface after the second switching command has been received, and before the interface receives one of the encoded intra-frames of the third video input data stream upon receipt of the second switching command received as encoded video frames of the video output stream issue.
- the video stream generator may be configured to receive each of the encoded inter-frames of the third video input data stream received from the interface after the second switching command has been received and after the interface receives at least one of the encoded intra-frames of the third video input data stream of the second switching command has been issued as a video frame of the video output data stream.
- the interface may e.g. be configured to receive an image group comprising one of the encoded intra-frames of the second video input data stream and at least ten of the encoded inter-frames of the second video input data stream, the interface being adapted to first encode the encoded intra-frame of the image group and then to receive the at least ten encoded interframes of the image group, the interface eg may be configured to receive no other video frame of the second video input data stream between the encoded intra-frame of the image sequences and between each of the encoded inter-frames of the second video input data stream.
- the video data stream generator may e.g. be configured to output the encoded intraframe of the image sequence and each of the at least ten encoded interframes of the image sequence as eleven or more consecutive encoded video frames of the video output data stream.
- the encoded intra-frame of the second video input data stream is subsequently followed by at least 30 intra-frames of the second video input data stream.
- Fig. 6 shows a system according to an embodiment. The system includes the apparatus 100 described above, a first encoder 210, and a second encoder 220.
- the first encoder 210 comprises an encoding unit 21 1 and an interface 212, wherein the encoding unit 21 1 of the first encoder 210 is adapted to generate the encoded video frames of the first video input data stream, and wherein the interface 212 of the first encoder is formed encoded video frames of the first video deoe input data stream to the interface 1 10 of the device 100 described above to send.
- the second encoder 220 has a further encoding unit 221 and a further interface 222, wherein the encoding unit 221 of the second encoder 220 is configured to generate the encoded video frames of the second video input data stream and wherein the interface 222 of the second encoder 220 is formed, send the encoded video frames of the second video input data stream to the interface 110 of the apparatus 100 described above.
- the interface 110 of the apparatus 100 described above is configured to send the request command to the interface 222 of the second encoder 220 upon receiving the switch command.
- the interface 222 of the second encoder 220 is configured to receive the request command. Further, upon receiving the request command, the interface 222 of the second encoder 220 is adapted to send one of the encoded video frames of the second video input data stream, which is one of the encoded intra-frames of the second video input data stream, to the interface 110 of the apparatus 100 described above.
- the interface 222 of the second encoder 220 may be e.g.
- the interface 222 of the second encoder 220 may be configured to send a group of pictures to the interface 110 of the apparatus 100 described above, the frame being one of the encoded intra-frames of the second video input data stream and at least ten of the encoded inter-frame. Frames of the second video input data stream includes.
- the interface 222 of the second encoder 220 can be designed, for example, to first transmit the encoded intraframe of the picture group and then the at least ten encoded interframes of the picture group to the interface of the device 100 described above.
- the interface of the second encoder is configured to transmit no other video frame of the second video input data stream between the encoded intraframe of the image sequences and between each of the encoded interframes of the second video input data stream to the interface of the device 100 described above.
- the interface 110 of the device 100 described above is configured to receive the image group, the interface 110 of the device 100 being designed, for example, first the encoded intraframe of the image group and then the at least ten encoded interframes of the Receive image group, wherein the interface 1 10 of the device 100 described above is adapted to receive no other video frame of the second video input data stream between the encoded IntraFrame of the image sequences and between each of the encoded inter-frames of the second video input data stream.
- the video data stream generator 120 of the device 100 described above can be designed, for example, to output the encoded intraframe of the image sequence and each of the at least ten encoded interframes of the image sequence as eleven or more consecutive encoded video frames of the video output data stream.
- the encoded intra-frame of the second video input data stream is subsequently followed by at least 30 intra-frames of the second video input data stream.
- each of the one or more terminals having an interface 31 1, 321 and a decoder 321, 322 includes.
- the interface 31 1, 321 of each of the one or more terminals 310, 320 may be configured to receive the video output data stream.
- the decoder 312, 322 of each of the one or more terminals 310, 320 may be configured to decode the encoded video frames of the video output data stream.
- the system includes two or more terminals 310, 320.
- Fig. 8 shows a system according to another embodiment. Specifically, a direct request of an intra-frame (reference frame) is shown in an encoder according to an embodiment.
- the video stream generator 120 of the apparatus 100 described above includes a multiplexer 125 for generating the video output data stream by multiplexing the first video input data stream and the second video input data stream.
- I stands for an intra-frame
- P stands for an interframe (for example a P-frame)
- index 1 denotes the first video input data stream
- index 2 denotes the second video input data stream.
- the system registers this request, requests a new reference frame from the corresponding encoder 220, and begins analyzing the stream to be switched to.
- the provided device 100 it is possible to still use large GOP structures with low At. As a result, the data rate can be reduced while maintaining the same video quality and it is still possible to quickly change the power.
- this has the advantage of allowing more cameras in the same quality system to use the channel.
- the quality of the camera streams can be increased as they are allowed to consume more data rate.
- it is also often necessary to compress the cut signal at the output of the switch for further transmission (via satellite, Internet, etc.), which makes it necessary to decode the received signal from the camera, to cut in the video switch and then encode again.
- the unnecessary steps encode (recorder), then decode (video switch) and then encode (video switch at the output) are no longer needed. Instead, it only needs to be encoded on the side of the recorder.
- the decoding and encoding processes cost electricity, which leads to a reduced battery life in mobile systems.
- Embodiments can be used in any setup where multiple encoded streams are to be cut or switched: TV production, streaming services, live editing, OB trucks, mobile reporting, surveillance cameras, etc.
- aspects have been described in the context of a device, it will be understood that these aspects also constitute a description of the corresponding method, so that a block or a component of a device is also to be understood as a corresponding method step or as a feature of a method step , Similarly, aspects described in connection with or as a method step also represent a description of a corresponding block or detail or feature of a corresponding device.
- Some or all of the method steps may be performed by a hardware device (or using a hardware device). Apparatus), such as a microprocessor, a programmable computer or an electronic circuit. At some According to embodiments, some or more of the most important method steps may be performed by such an apparatus.
- embodiments of the invention may be implemented in hardware or in software.
- the implementation may be performed using a digital storage medium such as a floppy disk, a DVD, a BluRay disc, a CD, a ROM, a PROM, an EPROM, an EEPROM or FLASH memory, a hard disk, or other magnetic or optical Memory are stored on the electronically readable control signals are stored, which can cooperate with a programmable computer system or cooperate such that the respective method is performed. Therefore, the digital storage medium can be computer readable.
- some embodiments according to the invention include a data carrier having electronically readable control signals capable of interacting with a programmable computer system such that one of the methods described herein is performed.
- embodiments of the present invention may be implemented as a computer program product having a program code, wherein the program code is operable to perform one of the methods when the computer program product runs on a computer.
- the program code can also be stored, for example, on a machine-readable carrier.
- an embodiment of the method according to the invention is thus a computer program which has a program code for performing one of the methods described herein when the computer program runs on a computer.
- a further embodiment of the method according to the invention is thus a data medium (or a digital storage medium or a computer-readable medium) on which the computer program is recorded for performing one of the methods described herein.
- a further embodiment of the method according to the invention is thus a data stream or a sequence of signals, which represent the computer program for performing one of the methods described herein.
- the data stream or the sequence of signals may be configured, for example, to be transferred via a data communication connection, for example via the Internet.
- Another embodiment includes a processing device, such as a computer or programmable logic device, configured or adapted to perform any of the methods described herein.
- a processing device such as a computer or programmable logic device, configured or adapted to perform any of the methods described herein.
- Another embodiment includes a computer on which the computer program is installed to perform one of the methods described herein.
- Another embodiment according to the invention comprises a device or system adapted to transmit a computer program for performing at least one of the methods described herein to a receiver.
- the transmission can be done for example electronically or optically.
- the receiver may be, for example, a computer, a mobile device, a storage device or a similar device.
- the device or system may include a file server for transmitting the computer program to the recipient.
- a programmable logic device eg, a field programmable gate array, an FPGA
- a field programmable gate array may cooperate with a microprocessor to perform one of the methods described herein.
- the methods are performed by any hardware device. This may be a universal hardware such as a computer processor (CPU) or hardware specific to the process, such as an ASIC.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102014220372.4A DE102014220372A1 (de) | 2014-10-08 | 2014-10-08 | Vorrichtung und verfahren zum schneiden von mehreren kodierten videoströmen ohne vorherige dekodierung |
PCT/EP2015/073187 WO2016055543A1 (de) | 2014-10-08 | 2015-10-07 | Vorrichtung und verfahren zum schneiden von mehreren kodierten videoströmen ohne vorherige dekodierung |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3205085A1 true EP3205085A1 (de) | 2017-08-16 |
Family
ID=54330739
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15781610.9A Withdrawn EP3205085A1 (de) | 2014-10-08 | 2015-10-07 | Vorrichtung und verfahren zum schneiden von mehreren kodierten videoströmen ohne vorherige dekodierung |
Country Status (7)
Country | Link |
---|---|
US (1) | US20170213575A1 (de) |
EP (1) | EP3205085A1 (de) |
JP (1) | JP2017535171A (de) |
KR (1) | KR102001549B1 (de) |
CA (1) | CA2963954A1 (de) |
DE (1) | DE102014220372A1 (de) |
WO (1) | WO2016055543A1 (de) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108737853B (zh) * | 2017-04-20 | 2021-07-13 | 腾讯科技(深圳)有限公司 | 一种数据文件的降码处理方法和服务器 |
US10880585B1 (en) * | 2019-06-12 | 2020-12-29 | Amazon Technologies, Inc. | Split-and-stitch media content encoding |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014139581A1 (en) * | 2013-03-15 | 2014-09-18 | Robert Bosch Gmbh | Switching apparatus for switching compressed video streams, conference system with the switching apparatus and process for switching compressed video streams |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07327228A (ja) * | 1994-05-31 | 1995-12-12 | Nippon Hoso Kyokai <Nhk> | ディジタル符号化・伝送システム |
JP4021998B2 (ja) * | 1998-08-07 | 2007-12-12 | 松下電器産業株式会社 | データ伝送制御システム及びデータ伝送制御方法 |
JP4331835B2 (ja) * | 1999-09-22 | 2009-09-16 | パナソニック株式会社 | 画像データ伝送方法 |
TWI260591B (en) * | 2002-10-14 | 2006-08-21 | Samsung Electronics Co Ltd | Information storage medium with structure for multi-angle data, and recording and reproducing apparatus therefor |
JP2004282340A (ja) * | 2003-03-14 | 2004-10-07 | Matsushita Electric Ind Co Ltd | 映像データ処理システム及び方法並びに映像データ処理装置 |
US7477653B2 (en) * | 2004-12-10 | 2009-01-13 | Microsoft Corporation | Accelerated channel change in rate-limited environments |
JP2006246384A (ja) * | 2005-03-07 | 2006-09-14 | Fujitsu Ltd | デコードプログラム、デコード方法およびデコーダ |
US7860162B2 (en) * | 2005-09-29 | 2010-12-28 | Panasonic Corporation | Object tracking method and object tracking apparatus |
US8340098B2 (en) * | 2005-12-07 | 2012-12-25 | General Instrument Corporation | Method and apparatus for delivering compressed video to subscriber terminals |
JP4767729B2 (ja) * | 2006-03-16 | 2011-09-07 | 三菱電機株式会社 | 監視システムおよび映像蓄積配信装置 |
EP1887802A1 (de) * | 2006-08-03 | 2008-02-13 | Nokia Siemens Networks Gmbh & Co. Kg | Verfahren zur Umschaltung zwischen digitalen komprimierten Videoströmen |
JP4856712B2 (ja) * | 2006-09-20 | 2012-01-18 | パナソニック株式会社 | 監視映像蓄積システム |
US8605151B2 (en) * | 2007-09-21 | 2013-12-10 | Utc Fire & Security Americas Corporation, Inc. | Methods and systems for operating a video surveillance system |
JP5401134B2 (ja) * | 2009-03-18 | 2014-01-29 | 株式会社 沖情報システムズ | デコーダ装置 |
DE102011107161A1 (de) * | 2011-07-13 | 2013-01-17 | Pierre-Alain Cotte | Verfahren und Vorrichtungen zum verzögerungsarmen Ein- oder Umschalten auf ein digitales Videosignal |
JP6119363B2 (ja) * | 2013-03-27 | 2017-04-26 | 沖電気工業株式会社 | 通信処理装置、方法及びプログラム、並びに、通信システム |
US9532043B2 (en) * | 2013-08-02 | 2016-12-27 | Blackberry Limited | Wireless transmission of real-time media |
TWI539823B (zh) * | 2014-09-29 | 2016-06-21 | 晶睿通訊股份有限公司 | 攝影畫面切換方法與監控系統 |
-
2014
- 2014-10-08 DE DE102014220372.4A patent/DE102014220372A1/de not_active Withdrawn
-
2015
- 2015-10-07 JP JP2017518832A patent/JP2017535171A/ja active Pending
- 2015-10-07 EP EP15781610.9A patent/EP3205085A1/de not_active Withdrawn
- 2015-10-07 KR KR1020177012418A patent/KR102001549B1/ko active IP Right Grant
- 2015-10-07 WO PCT/EP2015/073187 patent/WO2016055543A1/de active Application Filing
- 2015-10-07 CA CA2963954A patent/CA2963954A1/en not_active Abandoned
-
2017
- 2017-04-07 US US15/482,254 patent/US20170213575A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014139581A1 (en) * | 2013-03-15 | 2014-09-18 | Robert Bosch Gmbh | Switching apparatus for switching compressed video streams, conference system with the switching apparatus and process for switching compressed video streams |
Also Published As
Publication number | Publication date |
---|---|
KR20170066591A (ko) | 2017-06-14 |
DE102014220372A1 (de) | 2016-04-14 |
CA2963954A1 (en) | 2016-04-14 |
JP2017535171A (ja) | 2017-11-24 |
US20170213575A1 (en) | 2017-07-27 |
WO2016055543A1 (de) | 2016-04-14 |
KR102001549B1 (ko) | 2019-07-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE60028942T2 (de) | Videokodierung | |
JP6449852B2 (ja) | 関心領域の符号化のための動き制限タイルセット | |
DE69917971T2 (de) | Verfahren und Vorrichtung zur Verarbeitung von komprimierten Videodatenströmen | |
DE69835211T2 (de) | Umschaltung zwischen komprimierten videobitströmen | |
DE112017003212T5 (de) | Verfahren und System zur Videocodierung mit Kontextdecodierung und Rekonstruktionsumgehung | |
KR20150067157A (ko) | 참조 화상 리스트 변경 정보를 조건부로 시그널링하는 기법 | |
DE102016125379A1 (de) | Bewegungsvektoraufteilung des letzten Frames | |
DE102019103346A1 (de) | Ssim-basierte rate-distortion-optimierung für eine verbesserte wahrnehmbare qualität bei videos | |
DE102008058489A1 (de) | Verfahren zum Codieren einer Folge von digitalisierten Bildern | |
DE60312960T2 (de) | Kodierungsverfahren und Dekodierungsverfahren für bewegliche Bilder | |
US20200320274A1 (en) | Encoder, image processing system, unmanned aerial vehicle and encoding method | |
EP2521357A1 (de) | Verfahren und Vorrichtung zur Filterung von kodierten Bildpartitionen | |
WO2013007395A1 (de) | Verfahren und vorrichtungen zum verzögerungsarmen ein- oder umschalten auf ein digitales videosignal | |
EP2425627B1 (de) | Verfahren zur zeitlichen synchronisierung der intrakodierung von verschiedenen unterbildern bei der erzeugung einer mischbildervideosequenz | |
WO2016055543A1 (de) | Vorrichtung und verfahren zum schneiden von mehreren kodierten videoströmen ohne vorherige dekodierung | |
DE112015001531T5 (de) | Datenkodierung und Dekodierung | |
DE69928494T2 (de) | Videosignalkompression | |
EP3204946A1 (de) | Vorrichtung zum erzeugen eines videoausgangsdatenstroms, videoquelle, videosystem und verfahren zum erzeugen eines videoausgangsdatenstroms bzw. eines videoquellendatenstroms | |
DE102008017290A1 (de) | Verfahren und Vorrichtung zur Bildung eines gemeinsamen Datenstroms insbesondere nach dem ATSC-Standard | |
DE112007001773T5 (de) | Videocodierung | |
DE102009011251A1 (de) | Multiplexverfahren und zugehörige funktionelle Datenstruktur zum Zusammenfassen digitaler Videosignale | |
DE60210757T2 (de) | Vorrichtung zur videokodierung und -aufzeichnung | |
WO2011157399A1 (de) | Verfahren und vorrichtung zum mischen von videoströmen auf der makroblock-ebene | |
DE102017125544B3 (de) | Verarbeitungsverfahren und Verarbeitungssystem für Videodaten | |
EP0821531A2 (de) | Codierung und Decodierung von Trickfilmen |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20170407 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: HAUENSTEIN, THOMAS Inventor name: THIEME, WOLFGANG Inventor name: SALOMAN, CHRISTOPHER |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
17Q | First examination report despatched |
Effective date: 20200407 |
|
18W | Application withdrawn |
Effective date: 20200409 |