CN1972439A - Wireless video on-demand system, method and AVI file analysis, fluidizing method - Google Patents
Wireless video on-demand system, method and AVI file analysis, fluidizing method Download PDFInfo
- Publication number
- CN1972439A CN1972439A CNA2006101574475A CN200610157447A CN1972439A CN 1972439 A CN1972439 A CN 1972439A CN A2006101574475 A CNA2006101574475 A CN A2006101574475A CN 200610157447 A CN200610157447 A CN 200610157447A CN 1972439 A CN1972439 A CN 1972439A
- Authority
- CN
- China
- Prior art keywords
- client
- server
- video
- streaming media
- rtsp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This invention relates to visual frequency play system and method based on wireless local network, which comprises interface wireless local network flow media servo and at least customer end by use of RTP, RTCP and RTSP agreement communication, wherein, the servo adopts single wire process servo; the customer end adopts PDA with each composed of one task manager through its task manager transfer to fulfill customer end RTP data receive and RTCP report receive and send.
Description
Technical field
The present invention relates to provide the system and method for information service, realized the video on-demand system under the cover wireless isomer LAN environment, and propose the method for the streaming media playing effect under some optimization wireless isomer local area network (LAN) conditions.
Background technology
Along with Computer Multimedia Technology and development of internet technology, the streaming media playing technology has obtained using widely.This technology allows the online multimedia programming of watching of spectators, thereby can realize a series of functions such as video request program, video conference.Be used for the open-source software of video server, the Darwin Stream Server of the Helix Server of RealNetworks company and Apple company, use extensively, stability is higher, performance is outstanding, but size of code is big, complex structure, the structural improvement of uncomfortable cooperation, extensibility is relatively poor relatively; And the LIVE.COMStreaming Media of employing LGPL agreement open source code, support to multiple Streaming Media and video compression format is provided, to the support of RTP/RTCP agreement, have stronger stability, practicality, be packaged into the storehouse, clear in structure is suitable for building on its basis server.LIVE.COM Streaming Media can be used for client equally.
On the other hand, wireless communication technology is at high speed development in recent years.Mobile phone was popularized in several years, and palmtop PC (comprising Pocket PC and Palm) has also been come into huge numbers of families.Pocket PC2003 operating system is not supported DirectX, and multimedia development libraries such as DirectShow, DirectDraw, DirectSound can't use when therefore developing player on PDA; Pocket PC itself provides one to overlap player---the PocketMVP that increases income, and can be used for exploitation.
WLAN (wireless local area network) is compared with the wired network of same level, and bandwidth and message transmission rate are low always, can bring certain limitation when transmitting multimedia flows the data of such high bandwidth requirements.The dominant frequency of Pocket PC all can not be compared with desktop computer with internal memory.
Summary of the invention
The purpose of this invention is to provide a kind of video on-demand system based on the wireless isomer local area network (LAN), this system combines video request program in the stream media technology and radio communication, can allow PDA pass through the wireless network play stream media data, and the system effectiveness height.
For achieving the above object, the present invention is based on the video on-demand system of wireless isomer local area network (LAN), comprise streaming media server and at least one client of inserting WLAN (wireless local area network), streaming media server and each customer end adopted RTP, RTCP and RTSP protocol communication; Wherein, described streaming media server adopts single-threaded concurrent server, it comprises RTSP server and task manager, this task manager connectivity port and responsible each road Media Stream of scheduling in order to monitor the RTSP agreement, after streaming media server is received the program request instruction, the Media Stream of registration institute program request makes task manager call the RTSP server at regular intervals in its task manager, and the media data of this Media Stream is read in buffering area, is packaged into the RTP datagram and sends to client; Described customer end adopted PDA, each client includes a task manager, and each client is finished the reception of this client RTP datagram and the transmitting-receiving of RTCP report by the scheduling of its task manager.
The order method of above-mentioned video on-demand system may further comprise the steps:
Streaming media server is created the example and the initialization of a RTSP server,
Streaming media server is set up the connectivity port of a task manager example in order to monitoring RTSP agreement, and is responsible for each road Media Stream of scheduling;
Client is sent connection request by WLAN (wireless local area network) to streaming media server,
After receiving the client connection request, the newly-built RTSPClientSession object of RTSP server, RTSPClientSession object and described client are carried out the dialogue of RTSP agreement regulation, and from MediaSession and MediaSubsession class object example, obtain the information of stream, call GroupSock class object example the information of the stream that obtained is sent to described client.
Wherein, the RTSP dialogue carried out of RTSPClientSession object and described client comprises at least:
Streaming media server after receiving SETUP instruction,
Set up FramedSource class object example, read in media data to the FramedBuffer buffering area from file,
Set up RTPSink class object example, the media data of FramedBuffer buffering area is carried out the RTP encapsulation and send,
Set up MediaSession and MediaSubSession class object example, descriptive session and Media Stream; And,
After streaming media server is received the PLAY instruction, registration Media Stream to be played in its task manager.
The avi file of above-mentioned video on-demand system is resolved and fluidizing method, may further comprise the steps:
Resolve avi file, be divided into audio stream and video flowing two-way;
Resolve described video flowing, extract frame of video, send to client after being encapsulated as the form of RTP datagram; Simultaneously,
Resolve described audio stream, extract audio block, send to client after being encapsulated as the form of RTP datagram.
Before frame of video is encapsulated as the RTP datagram, also can comprise the step of this frame of video being carried out code conversion, the mode of code conversion adopts at least a in following three kinds of modes: improve compression factor, adopt the better simply coding method of decoding algorithm and reduce video resolution.
The present invention combines video request program in the stream media technology and radio communication, allows PDA can pass through the wireless network play stream media data, has commercial widely, dual-use value.Its streaming media server adopts single-threaded model, control by timer, be responsible for comprising by a thread connecting client, carrying out the RTSP session, the reading flow media file, send all work such as RTP and RTCP bag, thoroughly avoided switching repeatedly between multithreading the defective that needs a large amount of system resources of consumption.
Streaming media server is to adopt LIVE.COM Streaming Media Streaming Media Software Development Library to realize that its clear in structure has stronger stability, practicality, and supports multiple Streaming Media and video compression format.
Before streaming media server is encapsulated as the RTP datagram with frame of video, also frame of video is carried out optimizations such as code conversion, Rate Control, reduce by the data volume of wireless network transmissions and the decoding operand on the PDA, thereby make in WLAN (wireless local area network) bandwidth and message transmission rate low, under the lower situation of PDA dominant frequency and internal memory, on PDA, can restore smooth video pictures.
Description of drawings
Fig. 1 is the framework diagram of the single-threaded models of concurrency that streaming media server adopted among the present invention;
Fig. 2 is the internal structure diagram of RTSP server;
Fig. 3 is the diagram that the RTSPClientSession of client and RTSP server carries out typical R TSP session;
Fig. 4 is the diagram of streaming media server to the processing procedure of AVI format media stream;
Fig. 5 is for the player network terminal is finished audio frequency, video is accepted and the overall architecture diagram of the transmitting-receiving work of RTCP control report.
Embodiment
Present embodiment comes the DST PLAYER on Pocket PC that video-on-demand service is provided by realizing the streaming media server on the cover desktop PC.Target is to finish basic server, and to platform extension, PDA can utilize the asymmetric encoding technology to finish transmission behind video acquisition; Allow simultaneously functions such as Rate Control, code conversion (Transcoding), application layer multicast are added on the server, and finish acting server.The communication protocol based on RTP, RTCP, RTSP is adopted in communication between server and the player; Wherein, come the format information of transport stream medium in the RTSP agreement by the SDP agreement.This overlaps video on-demand system, and to DST PLAYER RealPlayer compatibility, promptly the user can use the RealPlayer on the common IBM PC compatible to communicate by letter with streaming media server.For this reason, server copies the communication protocol between the Real series of products to carry out work.
In the present embodiment video on-demand system, streaming media server is connected with the WLAN (wireless local area network) of customer end adopted 802.11b agreement, and its theoretical bandwidth is 11Mbps, and coverage requirement is less, is confined within several AP.
Streaming media server adopts desktop PC, disposes as follows:
Hardware configuration: Pentium 4 1.8GHz CPU, 128 Mb SDram, IDE hard disk;
Operating system: Windows 2000 or Windows XP;
Server software is developed with Microsoft Visual C++6.0.
Customer end adopted HP iPAQ Pocket PC h2210 palmtop PC, dispose as follows:
Hardware configuration: 400MHz Intel XScale processor, 64Mb internal memory (56Mb main memory), CF 802.11 wireless network cards;
Operating system: Microsoft Pocket PC 2003;
The player of client is developed with Microsoft Embedded Visual C++4.0.
Be example with the fluidisation avi file below, and in conjunction with the accompanying drawings, workflow and the design of introducing streaming media server realize.
Fig. 1 has described the single-threaded model that the streaming media video server is adopted among the present invention, by timer control, is responsible for comprising by a thread connecting client, carrying out the RTSP session, the reading flow media file, send work such as RTP and RTCP bag.Create the example and the initialization of a RTSP server during startup of server, set up a task manager (TaskScheduler) example connectivity port and responsible each road Media Stream of scheduling in order to monitor the RTSP agreement.
Fig. 2 has described the internal structure of RTSP server.When receiving the client connection request, newly-built RTSPClientSession object of RTSP server (RTSPServer) and client are carried out the dialogue of RTSP agreement regulation, and obtain the information of stream from MediaSession and MediaSubsession class object example.Network portion is encapsulated in Groupsock class and the associated class thereof.
The process that Fig. 3 has described client and RTSPClientSession carries out typical R TSP session.Streaming media server is received and is set up FramedSource class object example after the SETUP instruction and be used for reading in media data from file, and FramedBuffer buffering area and RTPSink class object example are used for media data being carried out the RTP encapsulation and sending; Set up MediaSession and MediaSubsession class object example in order to descriptive session and Media Stream.After server is received the PLAY instruction, registration Media Stream to be played in task manager (TaskScheduler), make TaskScheduler call the function of MediaSubsession class at regular intervals, file is read in buffering area, and send the RTP datagram.
Fig. 4 has described the processing procedure of server to AVI format media stream.AVI format audio, video are packaged together, and the two-way flow point are opened by AVIDemux class and AVIProgramStreamParser class by server before the fluidisation.Subsequently, the classes such as AVIAudioStreamFramer, AVIAudioStreamParser of AVIVideoStreamFramer, AVIVideoStreamParser by handling video flowing and processing audio stream are come out the data pick-up of frame of video and audio block again, be sent to VideoRTPSink and AudioRTPSink, send to client after being encapsulated as the form of RTP datagram.
For making server and RealPlayer compatibility, adopt RTP to communicate by letter with RealOnePlayer with RTSP, must observe the communication protocol details of RealNetworks company oneself, but detail content is not open.When server responded at the DESCRIBE instruction of avi file, the information of avi file head (the particularly information of coded system) did not directly send to client, is sent to player but encrypt the back with " OpaqueData " form.Encrypting and decrypting algorithm wherein is covert.The concrete practice of server is: simulation is connected with Real Server by a program, saves as file after the intercepting and capturing " OpaqueData ", uses for streaming media server.
When resolving avi file, adopted the two-stage parsing.At first avi file is resolved to two-way stream, one road audio frequency, one road video; Resolve this two-way stream more respectively, resolve into audio block and frame of video, be packaged into datagram more respectively and send.
During the fluidisation transmission, adopt the RTP encapsulation format of RealNetworks company series of products, to the additional header of 8 bytes of frame of video increase, the position of flag data newspaper in a Frame.
When the F.F. in the realization VCR operation, rewind down, server receives player and connects two instructions---" PAUSE " and " PLAY " that sends continuously by RTSP.After receiving " PAUSE " instruction, server stops the transmission of RTP datagram, stops simultaneously reading Media Stream from file; After receiving " PLAY " instruction, start anew to read Media Stream, and, skip to the response position reading of data again according to frame number and byte number that the position calculation needs that jump to are skipped, read in buffering area, network portion is also restarted encapsulation simultaneously and is sent the RTP datagram.
In order on PDA, to restore smooth video pictures, streaming media server is before being encapsulated as the RTP datagram with frame of video, also frame of video is carried out code conversion, specifically can be in the following ways: can improve compression factor, the bandwidth occupancy when reducing with client communication; Perhaps adopt the better simply coding method of decoding algorithm, alleviate the decoding pressure of client; Perhaps at handheld device, promptly according to handheld device screen resolution features of smaller, the video that original resolution is higher is converted to low-resolution video, to save the network bandwidth and decode resources.
Be example with the AVI formatted file below, and in conjunction with the accompanying drawings, introduce the realization details of player.
The network terminal and the server architecture of player are similar, adopt task manager (TaskScheduler) mechanism to dispatch, and finish the reception of audio frequency, video and the transmitting-receiving work of RTCP control report, as shown in Figure 5.
Player is in that the player of increasing income of Pocket PC self---PocketMVP develops on the basis.
PocketMVP itself has careful modularization encapsulation, and play the AVI formatted file and adopted with lower module: PocketMVP.exe is a main program, calls each module, sets up and plays thread and finish playing function; PlaylistEditor.exe is the program that playlist is set; AVIStream.dll is used for reading AVI stream from the middle level buffering area; Divx.dll is the decoder of Divx; GetFileName.dll is responsible for ejecting dialog box and obtains the user and ask the file or the URL that play; Init.dll is used for initialization; InputMediaBuffering.dll reads the content of Media Stream and deposits buffering area in from file; InputMediaHTTP.dll is by the http protocol file in download and deposit buffering area in; InputMediaRTSP.dll connects streaming media server and accepts the rtp streaming media datagrams by the RTSP agreement, deposits buffering area in; MP12LibCE.dll is the decoder of mp1, mp2; MP3LibCE.dll is the decoder of mp3.
The PocketPC workflow is to utilize TaskScheduler to dispatch, and reads in media data from Source, transfers to Sink after treatment and handles.
Therefore reading media data and deposit buffering area in from file among the PocketPC is an independent engineering, and has generated independent dll file, will rebulid one from the buffering area of network reading of data and replace original dll file.For this reason, use or created following associated class: the MultiFramedRTPSource class, succession is from the RTPSource class, member function networkReadHandler reads the RTP datagram from network, deposit buffering area after correct verification, ordering, the assembling in, obtain a frame of video or audio block through data integrity checking, datagram additional header after handling by member function doGetNextFrame again; The AVIAudioRTPSource class is inherited from the MultiFramedRTPSource class, will deposit buffering area in specific format from the RTP voice data that network is received, main member function is processSpecialHeader; The AVIVideoRTPSource class is inherited from the MultiFramedRTPSource class, will deposit buffering area in specific format from the RTP video data that network is received, main member function is processSpecialHeader; The BufferPacket class, one block buffer is described, the RTP datagram that receives on the network directly is stored in this buffering area, member function fillinData calls the handleRead member function of RTPInterface class and finishes the operation that network read and be saved in buffering area, member function use copies to the data in the buffering area in another buffering area, with ordering, the combination of finishing datagram; The Reordering class, it is the buffering area of the client intermediate level, distribute block buffering area, receive RTP datagram and ordering downwards, assembling, buffer memory, upwards provide one separately, complete, frame of video or audio block through assembling, member function storePacket assembles the RTP datagram of receiving in sequence with the position, be buffered in together, member function getNextCompletedPacket will return frame of video or the audio block that has assembled, if forming the RTP datagram of this frame does not also all arrive, then can wait for a period of time, perhaps return incomplete frame according to the time thresholding.
Claims (6)
1, based on the video on-demand system of wireless isomer local area network (LAN), it is characterized in that: comprise streaming media server and at least one client of inserting WLAN (wireless local area network), streaming media server and each customer end adopted RTP, RTCP and RTSP protocol communication; Wherein,
Described streaming media server adopts single-threaded concurrent server, it comprises RTSP server and task manager, this task manager connectivity port and responsible each road Media Stream of scheduling in order to monitor the RTSP agreement, after streaming media server is received the program request instruction, the Media Stream of registration institute program request in its task manager, make task manager call the RTSP server at regular intervals, the media data of this Media Stream is read in buffering area, is packaged into the RTP datagram and sends to client;
Described customer end adopted PDA, each client includes a task manager, and each client is finished the reception of this client RTP datagram and the transmitting-receiving of RTCP report by the scheduling of its task manager.
2, the video on-demand system based on the wireless isomer local area network (LAN) according to claim 1 is characterized in that: described streaming media server is to adopt LIVE.COM Streaming Media Streaming Media Software Development Library to realize.
3,, it is characterized in that may further comprise the steps based on the order method of the described video on-demand system of claim 1:
Streaming media server is created the example and the initialization of a RTSP server,
Streaming media server is set up the connectivity port of a task manager example in order to monitoring RTSP agreement, and is responsible for each road Media Stream of scheduling;
Client is sent connection request by WLAN (wireless local area network) to streaming media server,
After receiving the client connection request, the newly-built RTSPClientSession object of RTSP server, RTSPClientSession object and described client are carried out the dialogue of RTSP agreement regulation, and from MediaSession and MediaSubsession class object example, obtain the information of stream, call GroupSock class object example the information of the stream that obtained is sent to described client.
4, order method according to claim 3 is characterized in that: the RTSP that described RTSPClientSession object and described client are carried out talks with and comprises at least,
Streaming media server after receiving SETUP instruction,
Set up FramedSource class object example, read in media data to the FramedBuffer buffering area from file,
Set up RTPSink class object example, the media data of FramedBuffer buffering area is carried out the RTP encapsulation and send,
Set up MediaSession and MediaSubSession class object example, descriptive session and Media Stream; And,
After streaming media server is received the PLAY instruction, registration Media Stream to be played in its task manager.
5, resolve and fluidizing method based on the avi file of the described video on-demand system of claim 1, it is characterized in that may further comprise the steps:
Resolve avi file, be divided into audio stream and video flowing two-way;
Resolve described video flowing, extract frame of video, send to client after being encapsulated as the form of RTP datagram; Simultaneously,
Resolve described audio stream, extract audio block, send to client after being encapsulated as the form of RTP datagram.
6, avi file according to claim 5 is resolved and fluidizing method, it is characterized in that: before frame of video is encapsulated as the RTP datagram, also comprise the step of this frame of video being carried out code conversion, the mode of code conversion adopts at least a in following three kinds of modes: improve compression factor, adopt the better simply coding method of decoding algorithm and reduce video resolution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101574475A CN1972439A (en) | 2006-12-08 | 2006-12-08 | Wireless video on-demand system, method and AVI file analysis, fluidizing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101574475A CN1972439A (en) | 2006-12-08 | 2006-12-08 | Wireless video on-demand system, method and AVI file analysis, fluidizing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1972439A true CN1972439A (en) | 2007-05-30 |
Family
ID=38112981
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006101574475A Pending CN1972439A (en) | 2006-12-08 | 2006-12-08 | Wireless video on-demand system, method and AVI file analysis, fluidizing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1972439A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101342543B (en) * | 2008-08-18 | 2010-06-16 | 中冶陕压重工设备有限公司 | Fourteen-rollers strip mill |
| CN101312531B (en) * | 2007-11-02 | 2010-11-17 | 北京创毅视讯科技有限公司 | Stream service transmission method in broadcast system and stream media frame encapsulation device |
| CN103430505A (en) * | 2011-01-14 | 2013-12-04 | 捷讯研究有限公司 | Mobile media content delivery |
| US9680896B2 (en) | 2011-01-14 | 2017-06-13 | Blackberry Limited | Mobile media content delivery |
| CN113504886A (en) * | 2021-05-08 | 2021-10-15 | 辛巴网络科技(南京)有限公司 | Multimedia session framework-based multi-audio aggregation vehicle-mounted multimedia method |
-
2006
- 2006-12-08 CN CNA2006101574475A patent/CN1972439A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101312531B (en) * | 2007-11-02 | 2010-11-17 | 北京创毅视讯科技有限公司 | Stream service transmission method in broadcast system and stream media frame encapsulation device |
| CN101342543B (en) * | 2008-08-18 | 2010-06-16 | 中冶陕压重工设备有限公司 | Fourteen-rollers strip mill |
| CN103430505A (en) * | 2011-01-14 | 2013-12-04 | 捷讯研究有限公司 | Mobile media content delivery |
| US9680896B2 (en) | 2011-01-14 | 2017-06-13 | Blackberry Limited | Mobile media content delivery |
| US10616300B2 (en) | 2011-01-14 | 2020-04-07 | Blackberry Limited | Mobile media content delivery |
| CN113504886A (en) * | 2021-05-08 | 2021-10-15 | 辛巴网络科技(南京)有限公司 | Multimedia session framework-based multi-audio aggregation vehicle-mounted multimedia method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102075728B (en) | The method and system of a kind of shared audio frequency and/or video | |
| CN108769616A (en) | A kind of real-time video based on RTSP agreements is without plug-in unit method for previewing and system | |
| CN101047853B (en) | Server apparatus and video transmission method | |
| CN101198045B (en) | Stream media digital watermarking system | |
| US9172979B2 (en) | Experience or “sentio” codecs, and methods and systems for improving QoE and encoding based on QoE experiences | |
| CN101505365B (en) | Real-time video monitoring system implementing method based on network television set-top box | |
| US20090154556A1 (en) | Adaptive multimedia system for providing multimedia contents and codec to user terminal and method thereof | |
| US20120287231A1 (en) | Media sharing during a video call | |
| US20090322784A1 (en) | System and method for virtual 3d graphics acceleration and streaming multiple different video streams | |
| CN101999234A (en) | Gateway device, method, and program | |
| CN102158553A (en) | Method and device for playing multi-media files for remote desktop | |
| CN101325702A (en) | System for real time embedding visible watermark into flow medium as well as server terminal and client terminal thereof | |
| CN103458087A (en) | Remote mobile phone test experiencing method based on RTMP | |
| CN1972439A (en) | Wireless video on-demand system, method and AVI file analysis, fluidizing method | |
| CN101848367B (en) | File-based video live webcasting method | |
| CN1972441A (en) | Method of stream media storage and service | |
| CN104581234B (en) | A kind of set-top box and the method and system based on set-top box realization media data transcoding | |
| Tzruya et al. | Games@ Large-a new platform for ubiquitous gaming and multimedia | |
| CN102447950A (en) | Method and equipment for video play | |
| CN103188210A (en) | Terminal and method for playing media content of mobile terminal on large screen client | |
| CN103634694A (en) | IP-based streaming media playing method and system | |
| Bailey | Live Video Streaming from Android-Enabled Devices to Web Browsers | |
| Timmerer et al. | Adaptive streaming of vr/360-degree immersive media services with high qoe | |
| CN112073727B (en) | Transcoding method and device, electronic equipment and storage medium | |
| CN100551069C (en) | The method of a kind of television set and broadcast Real format stream media thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20070530 |