CN114363302A - Method for improving streaming media transmission quality by using layering technology - Google Patents
Method for improving streaming media transmission quality by using layering technology Download PDFInfo
- Publication number
- CN114363302A CN114363302A CN202111525333.2A CN202111525333A CN114363302A CN 114363302 A CN114363302 A CN 114363302A CN 202111525333 A CN202111525333 A CN 202111525333A CN 114363302 A CN114363302 A CN 114363302A
- Authority
- CN
- China
- Prior art keywords
- streaming media
- transmission
- data
- client
- quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a stream media transmission quality improving method by using a layering technology, which combines an RTP real-time transmission protocol and utilizes a layering coding transmission strategy to firstly layer and then code, distribute stream media to different transmission channels for transmission according to a certain standard, a client selectively receives data of each stream media channel according to the characteristics of the client, and by means of ingenious design, the layering strategy can achieve the effect of improving the stream media transmission quality, can better solve the problems of data loss, video jitter and the like frequently encountered in network video transmission, and control the occurrence of poor quality of the stream media in the transmission process. Under the condition of better network condition, the client selects more received data to obtain a video image with higher quality, and the method has lower cost and is convenient to popularize and use.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a streaming media transmission quality improving method by utilizing a layering technology.
Background
In the internet era, a great deal of research on streaming media and networks has been carried out by various organizations in recent years, various improvements have been made on the existing transmission strategies, and various methods for controlling network traffic in video transmission have been proposed. For example, in order to distribute video data in real time on the network, various layered multicast strategies are provided, and the transmission strategies greatly improve the efficiency of video data transmission. However, the existing layering strategy generally has the defects of different priority limits and low flexibility among layers, and the invention corrects the problems and provides a method for realizing network flow control by using a layering coding transmission strategy.
Problems with network transmission
Existing networks are generally heterogeneous networks, that is, the networks are composed of subnets with different characteristics, including different bandwidths, different QOS quality guarantees, and different transmission delays, which all adversely affect network transmission of data. Therefore, when streaming media data such as video is transmitted over a network, three problems in network transmission must be solved: data loss/error, delay and transmission delay variation are also problems of network jitter.
Disclosure of Invention
In view of the substantial drawbacks and deficiencies mentioned in the background above, the present invention provides a method for improving streaming media transmission quality by using a layered technology, which can solve the problems pointed out in the background art.
A method for improving transmission quality of stream media by using layered technology combines RTP real-time transmission protocol, uses layered coding transmission strategy, firstly layers and then codes, distributes stream media to different transmission channels for transmission according to a certain standard, client selectively receives data of each channel according to self characteristics, the layered coding strategy includes: quality layering, spatial layering, temporal layering, frequency layering, or a combination thereof, wherein,
the following points are specified for the layered multicast:
1. all groups (layers) use the same multicast IP address, and the groups are distinguished by RTP port numbers;
2. the RTP port numbers are from small to large, and the frame rate is increased in sequence. And assume that the client can get the smallest port number through other ways;
3. because the content of the streaming media changes, the flow rate of the coded streaming media may change, so the streaming media server needs to inform the data flow of each layer in each client system in time through a data packet defined by an RTCP APP streaming media application program;
the method for improving the transmission quality of the streaming media specifically comprises the following steps:
after a client joins in a session, firstly joining in a layer with the minimum port number to receive streaming media data, and then obtaining a video stream with the worst subjective quality by a client list;
after receiving a data message of a data packet defined by an RTCP APP streaming media application program, a client combines and sequences the flow of each layer, and stores the flow in the array;
the client attempts to receive data using the combinations in the above array until a suitable traffic is obtained.
In the above technical solution, when the RTP data packet loss rate is increased in the data receiving process, indicating that the available bandwidth on the network is decreasing, the client tries to receive data through a combination with low data traffic until a suitable traffic is obtained; after receiving streaming media data successfully for a while, the client tries to receive data using a higher-traffic combination until a suitable traffic is obtained.
The method for improving the transmission quality of the streaming media by utilizing the layering technology, provided by the invention, has the advantages that the problems of data loss, video jitter and the like in network video transmission can be better solved by combining an RTP (real-time transport protocol) real-time transmission protocol through ingenious design, and the transmission quality of the streaming media is improved. Under the condition of better network condition, the client selects more received data to obtain a video image with higher quality, and the method has lower cost and is convenient to popularize and use.
Drawings
Fig. 1 is a schematic structural diagram of a layering method of a streaming media transmission quality improving method using a layering technique according to the present invention.
Detailed Description
A specific embodiment of the present invention is described in detail below, but it should be understood that the scope of the present invention is not limited by the specific embodiment.
The RTCP is translated into a Real-time control protocol RTCP, English is Real time control protocol, and the RTCP protocol and the RTP protocol are mutually matched to jointly complete the bearing work of video streams and audio streams. RCTP APP means a packet defined by a streaming media application.
Streaming applications, whether distributed applications or interactive applications are used, are C/S structured applications (even though B/S structures are also generally used in client browsers, streaming media data are processed by using corresponding components), so methods for improving streaming media transmission quality generally fall into two categories: one is a server-based lifting method, wherein the server-based streaming media transmission quality lifting method is a flow regulation method for regulating the code rate of coded output by using a server according to the receiving condition of a client; the method for improving the streaming media transmission quality based on the client selects a stream receiving mode through the client to regulate and control the streaming media data flow on a network.
The invention discloses a method for realizing the control of network flow by utilizing a plurality of layered coding techniques and corresponding transmission control strategies. The strategy of the layering technology is a flow control strategy which distributes streaming media to different transmission channels for transmission according to different standards and selectively receives streaming media data of each channel as a client. There are several implementation methods for the layered coding strategy, including: the quality layering strategy, the space layering strategy, the time layering strategy and the frequency layering strategy can be freely combined.
The technical principle of the quality layering strategy is based on improving the quality of streaming media, and the quality layering and the quantization are performed from a base layer starting from the original data of a streaming media image, and the quantization is performed with finer quantization step sizes, so that several layers of data with different qualities are obtained. The receiving end can obtain clearer and clearer images by gradually adding and receiving and decoding the data streams.
The technical principle of the spatial layering strategy is to divide an original image into a plurality of parts in space, then carry out coding transmission, obtain an image with lower resolution after decoding a base layer, and increase the resolution of the existing image after decoding each enhancement layer.
The technical principle of the time layering strategy is from the perspective of time, and when the streaming media server encodes, images are distributed to different layers according to time, that is, the client can obtain video streams with different frame rates by gradually adding different layers and decoding. The realization method is that the coded video stream is distributed to different layers according to the importance of each frame in decoding, and the client can obtain videos with different qualities by receiving and decoding different layers.
The application scenario of the time layering strategy is as follows: the application with high requirements on image quality but no high requirements on frame rate, and other hierarchical strategy methods are generally applied to the application with high time consistency.
It can be seen from the above layering method that, since the decoding of the streaming media of the enhancement layer requires the code stream data of the base layer or the previous layer, when frame loss occurs in the data stream of the base layer or the lower layer number, the decoding error caused by frame loss may spread to the subsequent decoding process, and the client must add each layer in sequence, and the bandwidth adjustment is not very flexible.
Principle of stratification
The digital video information that we watch is made of a series of pictures with continuous motion. The reason why the images are consecutive is that the motion frequency of motion in the images is far lower than the sampling video of the images, so the difference between two adjacent pictures is smaller.
Meanwhile, the video stream of the RGB streaming media is composed of a series of continuous uncompressed pictures in sequence, no dependency relationship exists between frames, and data of other frames are not required for displaying one frame of data. After extracting partial frames from the RGB video sequence, the video can still be played normally, but the frame rate is reduced, and as long as the extracted frames are not too many, the influence on the subjective quality of the video is not serious.
According to the above two conditions, if we divide the original RGB video sequence collected by the video collection device into several video sequences uniformly according to a certain rule, each video sequence can reflect the content described by the original video sequence with different video quality, if we refer to the original arrangement sequence of the video sequences of the streaming media and then rearrange them, the original video sequence can be obtained, as shown in fig. 1. This is the basis of the idea of the flow control strategy of the layer-first and code-second transmission proposed by the present invention.
(II) method for improving streaming media transmission quality based on layering technology
The method for improving the transmission quality of the streaming media means that a client of the streaming media obtains the most optimized network flow by selecting how to join and leave each layer. For convenient control of the layers, the hierarchical multicast is defined by the following points:
1. all groups (layers) use the same multicast IP address, and the groups are distinguished by RTP port numbers.
2. The RTP port numbers are arranged in the order from small to large, and the frame rate is increased in sequence. And assume that the client can get the smallest port number through other means.
3. Due to the change of the streaming media content, the coded stream flow may change, so the streaming media server needs to notify the data flow of each layer in each client system in time through the RTCP APP data packet.
The format of the Application-dependent data portion of the APP packet is shown in the table below.
(Count of Layers 32 bits: 32bit integer indicating the number of Layers in the session; Port-1-Port-n: 16 bits indicating the number of RTP ports per layer: Flow Rate: 16 bits indicating the number of bytes sent per second.)
After the client joins the session, the layer with the smallest port number is added first, and the streaming media data is received by using the layer with the smallest port number, so that the client obtains the streaming media video with the worst viewing quality. And when the client receives the APP RTCP data message, recombining the flow of each layer, sequencing the flow, and storing the flow in an array. The client uses the recombined traffic in the above array and tries to receive the data until a viewing-effect-appropriate traffic is obtained, where the viewing-effect-appropriate traffic is the best quality data amount the client can receive.
When the RTP data packet loss rate increases during the data receiving process, which indicates a phenomenon that the available bandwidth on the network decreases, the client performs data receiving by trying (generally 3-4 times) to perform a combination of low streaming media data traffic until a traffic with a proper viewing effect is obtained. After receiving the streaming media data with proper viewing effect successfully for a period of time, the client performs data reception by trying (generally 3-4 times) to perform a higher streaming media data flow combination until a proper flow is obtained.
According to the design concept and implementation method of layering first and coding second for improving the transmission quality of the streaming media, the flow control strategy has the following characteristics: the realization is simple, the specific content of the image is not needed to be considered in the system realization process, only the original RGB video stream needs to be processed, and the RGB video stream has simple structure and is easy to operate; the method has no dependency on the coding format, only the transmitted original data is specified in the transmission strategy of the streaming media as the streaming media data stream in the RGB format, the decoded streaming media data stream also needs to be the streaming media data stream in the RGB format same as the original data, and no requirement is made on the corresponding format of the coded streaming media data stream; the method is suitable for real-time application, and the application of the strategy is suitable for a real-time application scene for obtaining the RGB data, such as real-time multicast or real-time point-to-point transmission, because the main operation is to perform corresponding layering on the original uncompressed RGB data stream during streaming media processing.
The invention also provides a self-adaptive streaming media intelligent transmission device which is customized by utilizing the streaming media transmission quality improving method of the layering technology, the device comprises 3 modules, one of the modules is a dynamic link information collecting module, and the module has a probe function and can collect the streaming media transmission quality information of the streaming media transmission link and collect data; meanwhile, the quality of the transmission link is changed in real time, so the dynamic information collection module updates the quality of the transmission link in real time. The second is an analysis module, which has the function of analyzing according to the collected streaming media transmission quality information and calculates the optimal transmission path of the streaming media. And the third is an intelligent routing module which has an intelligent routing function and can reasonably schedule and transmit the streaming media according to the quality of the link, select the most appropriate transmission path for the streaming media and effectively improve the transmission quality of the streaming media.
The above disclosure is only for a few specific embodiments of the present invention, however, the present invention is not limited to the above embodiments, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present invention.
Claims (3)
1. A method for improving transmission quality of stream media by using layered technology is characterized in that, combining RTP real-time transmission protocol, using layered coding transmission strategy, firstly layering and then coding, distributing stream media to different transmission channels for transmission according to a certain standard, client selectively receiving data of each channel according to self characteristics, the layered coding strategy includes: a quality layering strategy, a spatial layering strategy, a temporal layering strategy, a frequency layering strategy, or a combination of these strategies, wherein,
the following points are specified for the layered multicast:
1) all groups/layers use the same multicast IP address, and the groups are distinguished by RTP port numbers;
2) the RTP port numbers are from small to large, and the frame rate is increased in sequence. And assume that the client can get the smallest port number through other ways;
3) because the content of the streaming media changes, the flow rate of the coded streaming media may change, so the streaming media server needs to inform the data flow of each layer in each client system in time through a data packet defined by an RTCP APP streaming media application program;
the method for improving the transmission quality of the streaming media specifically comprises the following steps:
after a client joins in a session, firstly joining in a layer with the minimum port number to receive streaming media data, and then obtaining a video stream with the worst subjective quality by a client list;
after receiving a data message of a data packet defined by an RTCP APP streaming media application program, a client combines and sequences the flow of each layer, and stores the flow in the array;
the client side tries to receive the streaming media data by using the combination in the array until a proper flow is obtained.
2. The method as claimed in claim 1, wherein when the RTP data packet loss rate increases during the data receiving process, indicating a phenomenon that the available bandwidth on the network decreases, the client performs data receiving by trying (generally 3-4 times) a combination with low streaming media data traffic until a traffic with a proper viewing effect is obtained; after receiving the streaming media data with proper viewing effect successfully for a period of time, the client performs data reception by trying (generally 3-4 times) to perform a higher streaming media data flow combination until a proper flow is obtained.
3. The method as claimed in claim 1, wherein the customized adaptive streaming media intelligent transmission device comprises 3 modules, one of which is a dynamic link information collection module, the module having a probe function and being capable of collecting streaming media transmission quality information of a streaming media transmission link and collecting data; meanwhile, the quality of the transmission link is changed in real time, so the dynamic information collection module updates the quality of the transmission link in real time. The second is an analysis module, which has the function of analyzing according to the collected streaming media transmission quality information and calculates the optimal transmission path of the streaming media. And the third is an intelligent routing module which has an intelligent routing function and can reasonably schedule and transmit the streaming media according to the quality of the link, select the most appropriate transmission path for the streaming media and effectively improve the transmission quality of the streaming media.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111525333.2A CN114363302A (en) | 2021-12-14 | 2021-12-14 | Method for improving streaming media transmission quality by using layering technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111525333.2A CN114363302A (en) | 2021-12-14 | 2021-12-14 | Method for improving streaming media transmission quality by using layering technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114363302A true CN114363302A (en) | 2022-04-15 |
Family
ID=81099069
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111525333.2A Pending CN114363302A (en) | 2021-12-14 | 2021-12-14 | Method for improving streaming media transmission quality by using layering technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114363302A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101409630A (en) * | 2007-10-11 | 2009-04-15 | 北京大学 | Method, apparatus and system for sending and receiving stream medium data |
| CN102006221A (en) * | 2010-09-30 | 2011-04-06 | 北京交通大学 | Method for optimizing quality of service of stream media |
| CN102111644A (en) * | 2009-12-24 | 2011-06-29 | 华为终端有限公司 | Method, device and system for controlling media transmission |
| CN108510437A (en) * | 2018-04-04 | 2018-09-07 | 科大讯飞股份有限公司 | A kind of virtual image generation method, device, equipment and readable storage medium storing program for executing |
| CN110812843A (en) * | 2019-10-30 | 2020-02-21 | 腾讯科技（深圳）有限公司 | Interaction method and device based on virtual image and computer storage medium |
-
2021
- 2021-12-14 CN CN202111525333.2A patent/CN114363302A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101409630A (en) * | 2007-10-11 | 2009-04-15 | 北京大学 | Method, apparatus and system for sending and receiving stream medium data |
| CN102111644A (en) * | 2009-12-24 | 2011-06-29 | 华为终端有限公司 | Method, device and system for controlling media transmission |
| CN102006221A (en) * | 2010-09-30 | 2011-04-06 | 北京交通大学 | Method for optimizing quality of service of stream media |
| CN108510437A (en) * | 2018-04-04 | 2018-09-07 | 科大讯飞股份有限公司 | A kind of virtual image generation method, device, equipment and readable storage medium storing program for executing |
| CN110812843A (en) * | 2019-10-30 | 2020-02-21 | 腾讯科技（深圳）有限公司 | Interaction method and device based on virtual image and computer storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 李雪娇: "分层组播安全机制的设计与实现", 中国优秀硕士论文全文数据库, pages: 2 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7898950B2 (en) | Techniques to perform rate matching for multimedia conference calls | |
| US7639882B2 (en) | Moving picture distribution system, moving picture distribution device and method, recording medium, and program | |
| US7984179B1 (en) | Adaptive media transport management for continuous media stream over LAN/WAN environment | |
| US8135040B2 (en) | Accelerated channel change | |
| US8627390B2 (en) | Method and device for providing programs to multiple end user devices | |
| US8209733B2 (en) | Edge device that enables efficient delivery of video to handheld device | |
| CN109150823B (en) | Raw video transmission and reception using scalable frame rate | |
| JP5529033B2 (en) | Method and system for synchronizing terminal output | |
| US6986158B1 (en) | System and method for distributing video information over network | |
| US20150289003A1 (en) | Method and Apparatus for Distributing Media Content Services | |
| US20080100694A1 (en) | Distributed caching for multimedia conference calls | |
| US20080101410A1 (en) | Techniques for managing output bandwidth for a conferencing server | |
| US9578179B2 (en) | Method, apparatus and system for transmitting multimedia data | |
| KR20060115216A (en) | Apparatus and method for transmitting multimedia streaming | |
| US7657651B2 (en) | Resource-efficient media streaming to heterogeneous clients | |
| CN102547375A (en) | Transmission method for quickly previewing H.264 coded picture | |
| CN105635636A (en) | Video conference system and method for realizing transmission control of video image | |
| US20170142029A1 (en) | Method for data rate adaption in online media services, electronic device, and non-transitory computer-readable storage medium | |
| CN101047476B (en) | Method and device for selecting modulation mode | |
| US20040215802A1 (en) | System and method for resource-efficient live media streaming to heterogeneous clients | |
| US20090300687A1 (en) | Edge device establishing and adjusting wireless link parameters in accordance with qos-desired video data rate | |
| KR100563659B1 (en) | Real-time streaming service apparatus | |
| CN114363302A (en) | Method for improving streaming media transmission quality by using layering technology | |
| CN115209189A (en) | Video stream transmission method, system, server and storage medium | |
| JP2010130692A (en) | Method and apparatus for receiving content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |