CN107104986A - A kind of video on-demand system based on hadoop and Red5 - Google Patents
A kind of video on-demand system based on hadoop and Red5 Download PDFInfo
- Publication number
- CN107104986A CN107104986A CN201710443612.1A CN201710443612A CN107104986A CN 107104986 A CN107104986 A CN 107104986A CN 201710443612 A CN201710443612 A CN 201710443612A CN 107104986 A CN107104986 A CN 107104986A
- Authority
- CN
- China
- Prior art keywords
- video
- red5
- file
- hadoop
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002452 interceptive effect Effects 0.000 claims abstract description 16
- 230000004044 response Effects 0.000 claims abstract description 3
- 238000003860 storage Methods 0.000 claims description 16
- 230000014759 maintenance of location Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims 1
- 239000004744 fabric Substances 0.000 claims 1
- 238000004891 communication Methods 0.000 abstract description 4
- 238000009826 distribution Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention relates to technical field of video processing, more particularly to a kind of video on-demand system based on hadoop and Red5, including red5 streaming media servers and hadoop distributed memory systems；The hadoop distributed memory systems include hdfs file modules, operation module and system module；The red5 streaming media servers include interactive module and Fuse modules；The operation module is used for the request at customer in response end, and the hdfs file modules are used to store video file；The Fuse modules are used to the file mount in hdfs file modules being converted into files in stream media into red5 streaming media servers；The interactive module is used to play out the files in stream media decrypted transport to client；The system module is used to be managed user's group.The present invention solves the communication issue between hadoop cluster and Red5 streaming media server clusters.
Description
【Technical field】
The present invention relates to field of video processing, more particularly to a kind of video on-demand system based on hadoop and Red5.
【Background technology】
Hadoop is a Distributed Computing Platform of increasing income, and realizes a distributed file system, i.e. Hadoop distributions
Formula file system HDFS.Hadoop distributed structure/architecture, engine is handled as far as possible close to storage, to such as by big data
Batch operation is relatively suitable as ETL, because the batch processing result of of this sort operation can directly move towards storage.
Hadoop MapReduce functions, which are realized, smashes individual task, and fragment task (Map) is sent on multiple nodes,
Afterwards again to load (Reduce) in the form of individual data collection in data warehouse.HDFS has high power capacity, height fault-tolerant, high flexible
Advantage, therefore be especially suitable for the storage of great lot video files.
Red 5 is the streaming media server framework of increasing income based on Java EE platforms, and Primary communication agreement has RTMP, HTTP
Deng.Major function includes：Video stream media distribution, the issue of audio streaming media distribution, real time flow medium and recording client stream
Media file etc..
The system architecture that document is developed on the basis of based on hadoop and red, between hadoop and red5
The communication technology is shielded, and causes the problem of Red5 and hadoop distributed file systems can not carry out slitless connection.
【The content of the invention】
In view of the foregoing, it is necessary to a kind of video on-demand system based on hadoop and Red5 is provided, can be caused
Red5 can carry out slitless connection with hadoop distributed file systems.
To achieve the above object, the technical solution adopted by the present invention is：
A kind of video on-demand system based on hadoop and Red5, including red5 streaming media servers and hadoop distributions
Storage system；
The hadoop distributed memory systems include hdfs file modules, operation module and system module；The red5
Streaming media server includes interactive module and Fuse modules；
The operation module is used for the request at customer in response end, right first when client request playing video file
The local directory of red5 streaming media servers whether there is the video file of client request, and hadoop is distributed as in the absence of if
Formula storage system carries out traversal and checks for the video file that client is asked；
The hdfs file modules are used to store video file；
The Fuse modules are used to the file mount in hdfs file modules being converted into red5 streaming media servers
Files in stream media；
The interactive module is used to play out the files in stream media decrypted transport to client；
The system module is used to manage the storage service, access privilege control and ID authentication mechanism of user's group
Reason.
Further, the operation module is additionally operable to receive the file request of client upload, and the client is uploaded
File store into hadoop distributed memory systems,
Further, hadoop distributed storages system is arrived in the file storage that the operation module is additionally operable to upload client
True path is encrypted after uniting successfully and becomes ciphertext address return client.
Further, the hadoop distributed memory systems are worked using multithreading.
Further, the operation module is additionally operable to there is client request in the local directory of red5 streaming media servers
Video file when, control red5 streaming media servers by the video file transfer to client.
Further, the Fuse modules are additionally operable to when it is determined that clients request video is not present in hdfs file modules,
To interactive module send in the absence of the video message, the interactive module, be additionally operable to receive Fuse modules send do not deposit
Client is transmitted the message to after the message of the video
Due to using above-mentioned technical proposal, the invention has the advantages that：
The interactive module based on Red5 streaming media server clusters is provided, interactive module is with being used for the video ciphertext of client
Location is mapped with the video address stored in hadoop cluster.Operation module based on Hadoop is provided, for retrieving, traversal
Hdfs file system, and ciphertext address conversion is carried out to the video file address in hdfs file system.Because ciphertext address is
Address in hadoop cluster, and the spy of the video file of local file system can only be promoted based on Red5 streaming media servers
Property, the Red5 streaming media servers cluster in the present invention will assemble Fuse, long-range hadoop cluster hdfs file system will be entered
Row carry solves hadoop cluster and Red5 streaming media server collection on Red5 streaming media server cluster local file systems
Communication issue between group.
【Brief description of the drawings】
Fig. 1 is the video on-demand system structured flowchart based on hadoop and Red5 in a better embodiment of the invention.
【Embodiment】
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Refer to accompanying drawing, a kind of video on-demand system based on hadoop and Red5, including red5 streaming media servers 10
With hadoop distributed memory systems 20.Hadoop distributed memory systems 20 include hdfs file modules 201, operation module and
System module；The red5 streaming media servers include interactive module 101 and Fuse modules 102.Operation module 201 is used to respond
The request of client, when client request playing video file, be to the local directory of red5 streaming media servers 10 first
The no video file that there is client request, is checked whether as carried out traversal to hadoop distributed memory systems 20 in the absence of if
There is the video file that client is asked.Hdfs file modules 201 are used to store video file；Fuse modules 101 are used for will
File mount in hdfs file modules 201 is converted into files in stream media into red5 streaming media servers 10.Interactive module 102
For files in stream media decrypted transport to be played out to client.System module 203 is for the storage service to user's group, visit
Ask that control of authority and ID authentication mechanism are managed.
Further, operation module 202 is additionally operable to receive the file request of client upload, the file that client is uploaded
Store in hadoop distributed memory systems 20.The file storage that operation module 202 is additionally operable to upload client is arrived
True path is encrypted after the success of hadoop distributed memory systems 20 and becomes ciphertext address return client.Operation module
202 are additionally operable to when the local directory of red5 streaming media servers 10 has the video file of client request, control red5 streams
Media server 10 is by the video file transfer to client.Fuse modules 101 be additionally operable to it is determined that hdfs file modules 201 not
When there is clients request video, the message in the absence of the video is sent to interactive module 102, interactive module 102 is received
Fuse modules 101 transmit the message to client after sending the message in the absence of the video.Hadoop distributed memory systems
20 are worked using multithreading.
Claims (6)
1. a kind of video on-demand system based on hadoop and Red5, it is characterised in that including red5 streaming media servers and
Hadoop distributed memory systems；
The hadoop distributed memory systems include hdfs file modules, operation module and system module；The red5 flows matchmaker
Body server includes interactive module and Fuse modules；
The operation module is used for the request at customer in response end, when client request playing video file, and red5 is flowed first
The local directory of media server whether there is the video file of client request, to hadoop distributed storages if being not present
System carries out traversal and checks for the video file that client is asked；
The hdfs file modules are used to store video file；
The Fuse modules are used to be converted into the file mount in hdfs file modules into red5 streaming media servers to flow matchmaker
Body file；
The interactive module is used to play out the files in stream media decrypted transport to client；
The system module is used to be managed the storage service, access privilege control and ID authentication mechanism of user's group.
2. the video on-demand system according to claim 1 based on hadoop and Red5, it is characterised in that the operation module
It is additionally operable to receive the file request of client upload, hadoop distributed storages system is arrived in the file storage that the client is uploaded
In system,
3. the video on-demand system according to claim 2 based on hadoop and Red5, it is characterised in that the operation module
Be additionally operable to the file storage that uploads client to hadoop distributed memory systems successfully after change is encrypted in true path
Client is returned into ciphertext address.
4. the video on-demand system according to claim 1 based on hadoop and Red5, it is characterised in that the hadoop points
Cloth storage system is worked using multithreading.
5. the video on-demand system according to claim 1 based on hadoop and Red5, it is characterised in that the operation module
It is additionally operable to when the local directory of red5 streaming media servers has the video file of client request, control red5 Streaming Media clothes
Business device is by the video file transfer to client.
6. the video on-demand system according to claim 1 based on hadoop and Red5, it is characterised in that the Fuse modules
It is additionally operable to that when it is determined that clients request video is not present in hdfs file modules, disappearing in the absence of the video is sent to interactive module
Breath, the interactive module is additionally operable to transmit the message to after message of the Fuse modules transmission in the absence of the video is received
Client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710443612.1A CN107104986A (en) | 2017-06-13 | 2017-06-13 | A kind of video on-demand system based on hadoop and Red5 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710443612.1A CN107104986A (en) | 2017-06-13 | 2017-06-13 | A kind of video on-demand system based on hadoop and Red5 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107104986A true CN107104986A (en) | 2017-08-29 |
Family
ID=59660214
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710443612.1A Pending CN107104986A (en) | 2017-06-13 | 2017-06-13 | A kind of video on-demand system based on hadoop and Red5 |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107104986A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109067777A (en) * | 2018-09-14 | 2018-12-21 | 广西犇云科技有限公司 | A kind of mobile terminal video on-demand system based on hadoop |
| CN109167790A (en) * | 2018-09-14 | 2019-01-08 | 广西犇云科技有限公司 | A kind of cross-platform video on-demand system based on hadoop |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102196298A (en) * | 2011-05-19 | 2011-09-21 | 广东星海数字家庭产业技术研究院有限公司 | Distributive VOD (video on demand) system and method |
| CN102510526A (en) * | 2011-10-27 | 2012-06-20 | 上海文广互动电视有限公司 | Stream media service system based on distributed cluster file system |
| CN103747060A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | Distributed monitor system and method based on streaming media service cluster |
| CN105187855A (en) * | 2015-07-14 | 2015-12-23 | 中国科学院信息工程研究所 | Video-on-demand system based on Hadoop and Red5 and method |
| CN207124647U (en) * | 2017-06-13 | 2018-03-20 | 柳州市盛景科技有限公司 | A kind of video on-demand system based on hadoop and Red5 |
-
2017
- 2017-06-13 CN CN201710443612.1A patent/CN107104986A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102196298A (en) * | 2011-05-19 | 2011-09-21 | 广东星海数字家庭产业技术研究院有限公司 | Distributive VOD (video on demand) system and method |
| CN102510526A (en) * | 2011-10-27 | 2012-06-20 | 上海文广互动电视有限公司 | Stream media service system based on distributed cluster file system |
| CN103747060A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | Distributed monitor system and method based on streaming media service cluster |
| CN105187855A (en) * | 2015-07-14 | 2015-12-23 | 中国科学院信息工程研究所 | Video-on-demand system based on Hadoop and Red5 and method |
| CN207124647U (en) * | 2017-06-13 | 2018-03-20 | 柳州市盛景科技有限公司 | A kind of video on-demand system based on hadoop and Red5 |
Non-Patent Citations (1)
| Title |
|---|
| 郭奇: "基于HDFS的流媒体服务器Red5视频文件分发的研究与应用", pages 3 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109067777A (en) * | 2018-09-14 | 2018-12-21 | 广西犇云科技有限公司 | A kind of mobile terminal video on-demand system based on hadoop |
| CN109167790A (en) * | 2018-09-14 | 2019-01-08 | 广西犇云科技有限公司 | A kind of cross-platform video on-demand system based on hadoop |
| CN109067777B (en) * | 2018-09-14 | 2021-09-03 | 广西犇云科技有限公司 | Hadoop-based mobile terminal video-on-demand system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2288085B1 (en) | P2p based method, device and system for playing media | |
| US8358660B2 (en) | Method and system for providing integrated content delivery | |
| CN101534204B (en) | Streaming media information distribution system and method thereof and user end | |
| CN1905455B (en) | Open type multimedia transmission system based on internet and streaming media technique | |
| CN101026631B (en) | CDN structure based IPTV system media payment system | |
| EP1311122A2 (en) | Using NAS appliance to build a non-conventional distributed video server | |
| CN100463516C (en) | An interactive network TV system | |
| CN201491019U (en) | Network video system supporting multiple terminals | |
| CN100574248C (en) | Stream media service system and its implementation based on controllable P 2 P technology | |
| CN103078847B (en) | Method for storing and reading multi-code-rate stream file and relevant device | |
| CN104469391B (en) | A kind of digital TV contents dissemination system and method based on cloud platform | |
| CN103634692A (en) | CDN (content distribution network) and P2P (peer-to-peer) based hybrid stream media video-on-demand system | |
| CN108881942B (en) | Super-fusion normal state recorded broadcast system based on distributed object storage | |
| CN108174230A (en) | Audio and video live broadcast system based on elasticity distribution formula Streaming Media | |
| CN109474684A (en) | A kind of method, apparatus, terminal device and storage medium obtaining live video stream | |
| KR101470111B1 (en) | Edge content delivery apparatus and content delivery network for the internet protocol television system | |
| WO2010043146A1 (en) | Method and device, server cluster for media file storage processing and service processing | |
| CN106059936B (en) | The method and device of cloud system Multicast File | |
| CN109583221A (en) | Dropbox system based on cloudy server architecture | |
| CN107104986A (en) | A kind of video on-demand system based on hadoop and Red5 | |
| Wang et al. | A lightweight edge computing platform integration video services | |
| CN110493245A (en) | A kind of stream medium data dissemination system based on distributed parallel system | |
| CN207124647U (en) | A kind of video on-demand system based on hadoop and Red5 | |
| CN105610823A (en) | Stream media processing method and processing system architecture based on task vectors | |
| CN106210751B (en) | The method and system of internet video live broadcasting data hierarchy transmission |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170829 |