CN109348265A - 基于hls多码流模式下的直播方法及*** - Google Patents
基于hls多码流模式下的直播方法及*** Download PDFInfo
- Publication number
- CN109348265A CN109348265A CN201811426307.2A CN201811426307A CN109348265A CN 109348265 A CN109348265 A CN 109348265A CN 201811426307 A CN201811426307 A CN 201811426307A CN 109348265 A CN109348265 A CN 109348265A
- Authority
- CN
- China
- Prior art keywords
- time
- code stream
- quality
- played
- hls
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 235000013399 edible fruits Nutrition 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 claims 1
- 230000000694 effects Effects 0.000 description 2
- 230000002045 lasting effect Effects 0.000 description 1
- 238000010899 nucleation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
- H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明公开了一种基于HLS多码流模式下的直播方法及***,在直播过程中,服务器实时提供多种质量级别的媒体流,并对其切片;客户端首先从服务器获取码流表,根据网络类型估算一个码流,配合网络测速的结果选择从中选择一个当前最合适的媒体码流进行传输。当可以播放的时间连续3次大于最长播放片的下载时间,就向上调整一个质量级别,直到最高级别;如果出现单片下载时间超过单片播放时间,即刻调低一个质量级别,直到最低质量级别。本发明克服了网络抖动,充分利用了带宽。
Description
技术领域
本发明涉及直播技术,特别是一种基于HLS多码流模式下的直播方法及***。
背景技术
HLS(全称 HTTP Live Streaming),是由苹果公司提出的基于HTTP的流媒体网络传输协议。利用该协议,客户端可以接收持续的多媒体流来自于一个普通的web服务器。并且支持客户端在不同的网络带宽环境下,播放不同码率、分辨率的视频。
HLS的实现原理是把整个多媒体文件切成一个个小的基于HTTP的资源(MPEG-2Transport Stream格式的文件),生成一个包含元数据的扩展 M3U (M3U8) Playlist 文件,每次只下载列表中的一些资源,客户端根据带宽环境可以选择不同的资源。M3U8是一种播放多媒体列表的文件格式,可以指定一个或多个多媒体资源的位置,并且M3U8 Playlist中可以包含多个子M3U8文件。
在视频分发之前,内容提供者生成多个码率的视频文件,这一定程度上保证了视频的流畅性,但是这会带来一定的问题。
虽然服务器端提供多个码率,但由于客户端上播放的是其中某种码率的视频,在网络带宽满足的情况下,用户无法选择更高清晰度的码率,没法为用户提供更好的播放体验。反之,如果网络质量不好,用户也无法切换到更低码率的视频,从而导致播放卡顿。
发明内容
本发明所要解决的技术问题是,针对现有技术不足,提供一种基于HLS多码流模式下的直播方法及***,克服网络抖动,充分利用带宽。
为解决上述技术问题,本发明所采用的技术方案是:一种基于HLS多码流模式下的直播方法,该方法实现过程包括:服务器实时提供多种质量级别的媒体流,并对其切片;客户端首先从服务器获取媒体流表,根据网络类型估算一个码流,配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输;当可以播放的时间连续N次大于最长播放切片的下载时间,就向上调整一个播放质量级别,直到最高级别;如果出现单个切片下载时间超过单个切片播放时间,则调低一个播放质量级别,直到最低质量级别。
所述可以播放的时间是指:当前正在播放的切片剩余时间叠加缓存中除最后一个切片的播放时间以外的可以播放的时间。
本发明还提供了一种基于HLS多码流模式下的直播***,其包括:
服务器,用于提供多种质量级别的媒体流,并对其切片;
客户端,用于从服务器获取媒体流表,根据网络类型估算一个码流,配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输;
调整单元,用于执行如下操作:当可以播放的时间连续N次大于最长播放切片的下载时间,就向上调整一个播放质量级别,直到最高级别;如果出现单个切片下载时间超过单个切片播放时间,则调低一个播放质量级别,直到最低质量级别。
与现有技术相比,本发明所具有的有益效果为:本发明在播放之前, 参考了网络类型又对真实的网络环境进行测算,结合得出更接近实际环境的观看码率,节约了估算时间和减少了网络消耗,结果也更准确;能应对网络抖动带来的影响,和对可能起始判断不准的情况进行修正,使其在用户不影响观看的情况下无感知的获得最好的观看效果。
具体实施方式
本发明实现了在充分利用当前带宽能支持的最好画质进行直播。在直播过程中,服务器实时提供多种质量级别的媒体流,并对其切片;客户端首先从服务器获取码流表,根据网络类型估算一个码流, 配合网络测速的结果选择从中选择一个当前最合适的媒体码流进行传输。当可以播放的时间连续3次大于最长播放片的下载时间,就向上调整一个质量级别,直到最高级别;如果出现单片下载时间超过单片播放时间,即刻调低一个质量级别,直到最低质量级别。
本发明具体实现步骤如下:
1.获得多码率的 m3u8 文件,同时测算出实际参考带宽;
2.网络类型捕获,估算码流,根据参考带宽,得到实际采用的码流;
3.选择合适的码流进行传输;
4.每传输完成一片,记录当前片的下载时间,计算出最大片的下载时间;
5.获取到当前正在播放的片剩余时间叠加缓存中除最后一片的播放时间以外的可以播放的时间,得到一个剩余播放时间;
6.如果剩余播放时间连续3次超过最大片的下载时间,则提升一个播放质量,直到最高质量;
如果单片下载时间超过自身可以播放的时间,即刻向下降低一个播放质量,直到最低质量。
Claims (4)
1.一种基于HLS多码流模式下的直播方法,其特征在于,该方法实现过程包括:服务器实时提供多种质量级别的媒体流,并对其切片;客户端首先从服务器获取媒体流表,根据网络类型估算一个码流,配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输;当可以播放的时间连续N次大于最长播放切片的下载时间,就向上调整一个播放质量级别,直到最高级别;如果出现单个切片下载时间超过单个切片播放时间,则调低一个播放质量级别,直到最低质量级别。
2.根据权利要求1所述的基于HLS多码流模式下的直播方法,其特征在于,N=3。
3.根据权利要求1所述的基于HLS多码流模式下的直播方法,其特征在于,所述可以播放的时间是指:当前正在播放的切片剩余时间叠加缓存中除最后一个切片的播放时间以外的可以播放的时间。
4.一种基于HLS多码流模式下的直播***,其特征在于,包括:
服务器,用于提供多种质量级别的媒体流,并对其切片;
客户端,用于从服务器获取媒体流表,根据网络类型估算一个码流,配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输;
调整单元,用于执行如下操作:当可以播放的时间连续N次大于最长播放切片的下载时间,就向上调整一个播放质量级别,直到最高级别;如果出现单个切片下载时间超过单个切片播放时间,则调低一个播放质量级别,直到最低质量级别。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811426307.2A CN109348265A (zh) | 2018-11-27 | 2018-11-27 | 基于hls多码流模式下的直播方法及*** |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811426307.2A CN109348265A (zh) | 2018-11-27 | 2018-11-27 | 基于hls多码流模式下的直播方法及*** |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109348265A true CN109348265A (zh) | 2019-02-15 |
Family
ID=65318385
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811426307.2A Pending CN109348265A (zh) | 2018-11-27 | 2018-11-27 | 基于hls多码流模式下的直播方法及*** |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109348265A (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109951727A (zh) * | 2019-03-29 | 2019-06-28 | 深圳市思迪信息技术股份有限公司 | 动态计算视频传输所需码率的方法、装置及计算机设备 |
CN112565833A (zh) * | 2020-11-26 | 2021-03-26 | 的卢技术有限公司 | 一种基于hls的多媒体自适应播放控制方法 |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102333089A (zh) * | 2011-09-26 | 2012-01-25 | 南京邮电大学 | 基于超文本传输协议流化的多码率媒体流自适应控制方法 |
CN102801690A (zh) * | 2011-05-25 | 2012-11-28 | 华为技术有限公司 | 流媒体的处理方法、分发服务器、客户端及*** |
CN104123316A (zh) * | 2013-04-28 | 2014-10-29 | 腾讯科技(深圳)有限公司 | 资源收藏方法、装置和设备 |
CN105323604A (zh) * | 2015-10-29 | 2016-02-10 | 西安交通大学 | 一种QoE驱动的HTTP流媒体点播缓冲区控制方法 |
US20160100173A1 (en) * | 2014-10-03 | 2016-04-07 | International Business Machines Corporation | Enhanced Video Streaming |
CN106688239A (zh) * | 2015-08-25 | 2017-05-17 | 华为技术有限公司 | 视频下载方法、装置及*** |
CN106878828A (zh) * | 2017-02-21 | 2017-06-20 | 微鲸科技有限公司 | 自动切换多媒体码率的方法及装置 |
CN107454075A (zh) * | 2017-07-31 | 2017-12-08 | 苏州蜗牛数字科技股份有限公司 | 一种高清视频点播互动方法及*** |
CN108063955A (zh) * | 2017-12-15 | 2018-05-22 | 重庆邮电大学 | 基于状态机的动态自适应视频传输的码率切换方法 |
CN108124273A (zh) * | 2017-11-17 | 2018-06-05 | 上海连尚网络科技有限公司 | 一种信息获取的方法、设备及介质 |
-
2018
- 2018-11-27 CN CN201811426307.2A patent/CN109348265A/zh active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102801690A (zh) * | 2011-05-25 | 2012-11-28 | 华为技术有限公司 | 流媒体的处理方法、分发服务器、客户端及*** |
CN102333089A (zh) * | 2011-09-26 | 2012-01-25 | 南京邮电大学 | 基于超文本传输协议流化的多码率媒体流自适应控制方法 |
CN104123316A (zh) * | 2013-04-28 | 2014-10-29 | 腾讯科技(深圳)有限公司 | 资源收藏方法、装置和设备 |
US20160100173A1 (en) * | 2014-10-03 | 2016-04-07 | International Business Machines Corporation | Enhanced Video Streaming |
CN106688239A (zh) * | 2015-08-25 | 2017-05-17 | 华为技术有限公司 | 视频下载方法、装置及*** |
CN105323604A (zh) * | 2015-10-29 | 2016-02-10 | 西安交通大学 | 一种QoE驱动的HTTP流媒体点播缓冲区控制方法 |
CN106878828A (zh) * | 2017-02-21 | 2017-06-20 | 微鲸科技有限公司 | 自动切换多媒体码率的方法及装置 |
CN107454075A (zh) * | 2017-07-31 | 2017-12-08 | 苏州蜗牛数字科技股份有限公司 | 一种高清视频点播互动方法及*** |
CN108124273A (zh) * | 2017-11-17 | 2018-06-05 | 上海连尚网络科技有限公司 | 一种信息获取的方法、设备及介质 |
CN108063955A (zh) * | 2017-12-15 | 2018-05-22 | 重庆邮电大学 | 基于状态机的动态自适应视频传输的码率切换方法 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109951727A (zh) * | 2019-03-29 | 2019-06-28 | 深圳市思迪信息技术股份有限公司 | 动态计算视频传输所需码率的方法、装置及计算机设备 |
CN112565833A (zh) * | 2020-11-26 | 2021-03-26 | 的卢技术有限公司 | 一种基于hls的多媒体自适应播放控制方法 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105657578B (zh) | 基于hls协议的直播方法、***及客户端 | |
EP3136732B1 (en) | Converting adaptive bitrate chunks to a streaming format | |
CN109792545B (zh) | 从服务器向客户端装置传送视频内容的方法 | |
KR102086873B1 (ko) | 복수의 트랜스코딩된 컨텐츠 스트림들을 제공하기 위한 방법 및 장치 | |
US10812559B2 (en) | Just-in-time variable adaptive encoding and delivery of media content | |
US10200432B2 (en) | HTTP streaming client adaptation algorithm based on proportional-integral control | |
KR101897959B1 (ko) | 라이브 비디오 인코딩 및 스트리밍에서의 프레임 복제 및 프레임 확장을 위한 시스템 및 방법 | |
CN102333089A (zh) | 基于超文本传输协议流化的多码率媒体流自适应控制方法 | |
EP3318034B1 (en) | Low latency media streaming | |
CN110149560B (zh) | 基于hls协议的播放器优化方法及***、存储介质及终端 | |
CN107864402A (zh) | 直播视频播放方法及装置 | |
WO2018232796A1 (zh) | 一种流媒体文件处理方法及直播*** | |
CN108833350B (zh) | 一种适用于多服务器自适应流媒体***的数据传输方法 | |
CN109348265A (zh) | 基于hls多码流模式下的直播方法及*** | |
WO2018060488A1 (en) | Viewer importance adaptive bit rate delivery | |
US10045053B1 (en) | Fragment insertion for live media streams | |
Rahman et al. | A client side buffer management algorithm to improve QoE | |
CN107205159B (zh) | 网络直播中流媒体的比特率调整方法、装置和存储介质 | |
Kim et al. | Analysis and improvement of MPEG-DASH-based internet live broadcasting Services in Real-world Environments | |
Fernandez et al. | Modular Testbed for KPI Monitoring in Omnidirectional Video Streaming Scenarios | |
EP3107261A1 (en) | System, method and devices for low tatency transmission | |
WO2021167531A1 (en) | Methods and systems for bandwidth estimation | |
EP3462745A1 (en) | Modifying a buffer size | |
EP2811709B1 (en) | Quality of experience measurements in a unicast linear television network | |
Shuai | Dynamic adaptive video streaming with minimal buffer sizes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190215 |
|
RJ01 | Rejection of invention patent application after publication |