CN100452705C - Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method - Google Patents

Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method Download PDF

Info

Publication number
CN100452705C
CN100452705C CNB2006100330581A CN200610033058A CN100452705C CN 100452705 C CN100452705 C CN 100452705C CN B2006100330581 A CNB2006100330581 A CN B2006100330581A CN 200610033058 A CN200610033058 A CN 200610033058A CN 100452705 C CN100452705 C CN 100452705C
Authority
CN
China
Prior art keywords
medium data
stream medium
server
embedded
media
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2006100330581A
Other languages
Chinese (zh)
Other versions
CN1805356A (en
Inventor
冯穗力
叶梧
周卫
吕俊辉
张静
李兆南
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CNB2006100330581A priority Critical patent/CN100452705C/en
Publication of CN1805356A publication Critical patent/CN1805356A/en
Application granted granted Critical
Publication of CN100452705C publication Critical patent/CN100452705C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The present invention relates to an embedded Linux multimedia signal collection processing device and a relative transmission method. The device comprises an embedded server, a plurality of client terminals and a cloud platform, wherein the embedded server is connected with the cloud platform via an RS485 bus; the embedded server and the client terminals carry out interactive control and data transmission via the RTP/RTCP, and use the RSVP to realize QoS resource preparation. The present invention adopts safety strategy to prevent the server from being attacked and ensure the safe control to the server and the safety of flow media in the network transmission. The network self-adaptive strategy of the client terminals leads the device to realize the balance of the bandwidth occupation and the replay acceptability in a limit bandwidth network. The present invention can be applied to the remote monitoring field, and especially, the present invention realizes safe, stable and reliable real-time interactive acoustic-virtual monitoring at unattended areas and remote areas with adverse environment.

Description

A kind of embedded Linux multimedia signal acquisition and processing apparatus and transmission method thereof
Technical field
The invention belongs to the multimedia signal acquisition process field, relate in particular to a kind of embedded Linux multimedia signal acquisition and processing apparatus and transmission method thereof that uses Network Transmission.
Background technology
Along with the develop rapidly of computer technology and Internet technology, embedded system becomes the new lover of IT industry, and the exploitation networked multimedia system will have vast potential for future development under embedded platform.Stream media technology is the product that network and multimedia combine, and its international standard and basic research are becoming the focus of present industrial circle and scientific research institution's close attention.Now typical stream media system has Microsoft Windows Media, RealSystem, Apple QuickTime etc., but the size of these softwares is all more than tens, be not suitable for combining, need the support of high performance PC server, environment for use is required high with embedded system.And there is following limitation in the simple and easy network monitoring system that emerges at present: the fail safe of information can not get guaranteeing, no QoS can not the adaptive network situation regulate encoder bit rate, does not also provide multi-path media synchronous, and the control of camera can not be provided in addition.
Summary of the invention
The object of the present invention is to provide a kind of embedded Linux multimedia signal acquisition and processing apparatus, it has merged multimedia, network flow-medium transmission and three kinds of technology of embedded system, the long-range audio frequency and video real-time monitoring system of the simple and easy deployment of energy realizes that Long-distance Control, network resource reservation based on moving speed, variable bit-rate compression coding, adaptive network Streaming Media transmit, message transmission is maintained secrecy.
Another object of the present invention is to provide the transmission method of above-mentioned embedded Linux multimedia signal acquisition and processing apparatus.
Embedded Linux multimedia signal acquisition and processing apparatus of the present invention comprises: embedded server, several clients and a The Cloud Terrace, and embedded server is connected by the RS485 bus with The Cloud Terrace; Embedded server and client are controlled and transfer of data alternately by RTP/RTCP Real-time Transport Control Protocol (RTP/RTCP), use resource reservation protocol (rsvp) to realize service quality (QoS) resource reservation; Embedded server comprises audio-video collection device, condensing encoder and embedded system, the audio-video collection device is Voice ﹠ Video signal from analog conversion of signals a digital signal, and sending data to condensing encoder, condensing encoder obtains data and sends embedded system to by MPEG4/H.263/H.264 and compressed encoding G.729.
Described client comprises that audio decoder, Video Decoder, stream medium data receive the decision-making device of buffering area, network communication state estimation device and adjustment code check, stream medium data receives buffering area and receives the data of embedded server and send data to audio decoder and Video Decoder, network communication state estimation device receives from stream medium data and obtains the network condition statistical parameter the buffering area and the network communication state parameter after the estimation is sent to the decision-making device of adjusting code check, and the decision-making device control embedded server of adjusting code check changes encoder bit rate.
Between embedded server and the client, use non-connection-oriented UDP (UDP), guarantee the real-time of transmission, reduce the transmission bandwidth that takies in transport layer; Use the RTP/RTCP agreement in application layer, realize the real-time Transmission of Streaming Media.
Client can be moved on different PC simultaneously, log on same embedded server simultaneously, when landing and server controlled, username and password need be provided, and legal users can game server and is received RTP media data packet that server sends and the operating state of using application packet (APP) Control Server of RTCP.
The transmission method of above-mentioned embedded Linux multimedia signal acquisition and processing apparatus is:
The first step: when landing, client software sends the Source Description grouping of RTCP Real-time Transport Control Protocol to embedded server; Embedded server is according to access security rank checking user name and IP address, if the authentication failed embedded server writes down this user name and IP address, identical user name or IP address continuous several times authentication failed can cause this user name or IP address to be recorded into blacklist and the client who uses this user name or IP address is stopped service in short time, just register this user name and IP address to user list and distribute and insert authority if be proved to be successful;
Described Source Description grouping (SDES) has the resource obligate information of user name, password, encrypted public key and the resource reservation protocol (rsvp) of client login.The access security rank of described embedded server is divided into level Four, is respectively no access control, limited subscriber name, restriction IP address, limited subscriber name and IP address.Described access authority is divided into two ranks, is respectively monitoring rank and control hierarchy.
Second step: after the user logins embedded server, the client that embedded server begins in user list sends stream medium data, if this customer requirements server is encrypted the stream medium data that sends to it, then server can be carried out cryptographic operation when carrying out the stream medium data transmission; The stream medium data of client receives the packet of buffering area receiving stream media and handles: for playing the stream medium data grouping that arrived before the time limit, determine its position in stream medium data receives buffering area, rearrange the stream medium data grouping of out of order arrival; Do discard processing for playing the stream medium data grouping that arrives after the time limit; Stream medium data receives regularly statistics network status transmission of buffering area, comprises that stream medium data is grouped into peaking, arrives average and Loss Rate;
The 3rd step: when carrying out transmission of flow media data, embedded server produces the stream medium data grouping of RTP form, and produces media timestamp, and media timestamp writes each stream medium data grouping; During the client playback, audio decoder calculates the global media time and the user sets the privately owned media fine setting time, Video Decoder uses these two times to calculate the privately owned media timestamp, the Video Decoder band the data of privately owned media timestamp reading flow media data buffering area, realizes the broadcast of video and audio sync;
The method of described generation media timestamp is: the time of reading the 64bit embedded system, high 32bit of this embedded system time be with second (S) be the numerical value of unit, low 32bit is to be the numerical value of unit with microsecond (uS), get the 23rd~the 8th 16bit numerical value of the centre of the low 16bit value of second numerical value and microsecond numerical value, merging is got up, become the media timestamp of 32bit, simplified the calculating of media timestamp;
In the 4th step, client is regularly called network communication state estimation device, receives buffering area from stream medium data and reads the network condition statistical parameter, sends the winding time test grouping of RTCP APP then, obtains the winding time parameter; Network communication state estimation device estimation network remaining bandwidth, the average of delay variation, the standard deviation of delay variation and the effective bandwidth of stream medium data; Client is regularly called the decision-making device of adjusting code check, and the compressed encoding quality of adaptive transmission APP control embedded server reaches customer satisfaction system acceptability.
Embedded server of the present invention provides following control interface to client: 1. coding quality control; 2. the frame per second of encoding control; 3. video acquisition form D1/CIF/QCIF switching controls; 4. cradle head control (up and down rotate and convergent-divergent); 5. RSVP QoS resource reservation services interface.Wherein, above-mentioned first three items function is realized by embedded server invocation facility driver, the 4th function sends instruction by the RS485 interface to The Cloud Terrace by embedded server and realizes, the 5th function called RSVP API by embedded server and supported the RSVP demons of storehouse control running background to finish.
The present invention compared with prior art has following advantage and beneficial effect:
(1) condensing encoder of apparatus of the present invention uses MPEG4/H.263/H.264 and compressed encoding G.729 to realize low code check compression, taking bandwidth when having reduced Network Transmission;
(2) embedded server of the present invention adopts the blacklist security strategy, makes server be immune against attacks; Adopt the access security strategy of classification, guarantee that server awards the fail safe of control; Adopt the media stream encryption strategy to guarantee the fail safe of Streaming Media in Network Transmission;
(3) the network self-adapting strategy of client of the present invention guaranteed that the order of data packet transmission arrives and data traffic to the adaptation of ethernet communication situation, make this device when the finite bandwidth network carries out transfer of data, realize the balance of bandwidth occupancy and playback acceptability;
(4) client of the present invention is a benchmark driven in synchronism video playback with the voice playing time, improves the acceptability of Media Stream playback, and the media timestamp producing method of simplification can reduce the amount of calculation of media timestamp, improves synchronous precision;
(5) this device is simple, is easy to dispose, and low in energy consumption, can provide various control interface to realize interactive operation.
Description of drawings
Fig. 1 is the structural representation of embedded Linux multimedia signal acquisition and processing apparatus of the present invention;
Fig. 2 is the structural representation of embedded server of the present invention;
Fig. 3 embedded server of the present invention and client functionality logical construction and data flow schematic diagram;
Fig. 4 client media sync of the present invention method schematic diagram.
Embodiment
In order to understand the present invention better, the present invention is done to describe further below in conjunction with accompanying drawing.
As depicted in figs. 1 and 2, embedded Linux multimedia signal acquisition and processing apparatus of the present invention comprises: embedded server 1, several clients 2 and a The Cloud Terrace, and embedded server 1 is connected by the RS485 bus with The Cloud Terrace; Embedded server 1 and client 2 are controlled and transfer of data alternately by RTP/RTCP, use RSVP to realize the QoS resource reservation; Embedded server 1 comprises audio-video collection device, condensing encoder and embedded system, the audio-video collection device is Voice ﹠ Video signal from analog conversion of signals a digital signal, and sending data to condensing encoder, condensing encoder obtains data and sends embedded system to by MPEG4/H.263/H.264 and compressed encoding G.729.
Client 2 comprises that audio decoder, Video Decoder, stream medium data receive the decision-making device of buffering area, network communication state estimation device and adjustment code check, stream medium data receives buffering area and receives the data of embedded server 1 and send data to audio decoder and Video Decoder, network communication state estimation device receives from stream medium data and obtains the network condition statistical parameter the buffering area and the network communication state parameter after the estimation is sent to the decision-making device of adjusting code check, and the decision-making device control embedded server 1 of adjusting code check changes encoder bit rate.
Between embedded server 1 and the client 2, use non-connection-oriented UDP (UDP), guarantee the real-time of transmission, reduce the transmission bandwidth that takies in transport layer; Use the RTP/RTCP agreement in application layer, realize the real-time Transmission of Streaming Media.
Embedded server 1 provides video inputs mouth, audio input port, cradle head control interface and RJ45 port, to finish signal from analog to the conversion of numeral, the compressed encoding and the Network Transmission of digital signal.Wherein the input of video inputs mouth is the base band composite video signal; What audio input port was imported is audio analog signals; The cradle head control interface is the industrial-controlled general line port that meets RS485, and embedded server 1 is main end, and The Cloud Terrace is from end; Embedded server 1 links to each other with Ethernet by the RJ45 port, the client 2 of far-end operates on the PC compatible that the Windows operation has been installed, initiate to connect to embedded server 1 by RTCP, and can send control information, also can receive the stream medium data of embedded server 1 with the encapsulation of RTP form.Embedded server 1 and client 2 realize the network bandwidth resources reservation all by RSVP and the routing to communicate that resource reservation is provided, and realize the service quality guaranteed qos of network service.
The audio-video collection device is Voice ﹠ Video signal from analog conversion of signals a digital signal.Wherein, sample after the low-pass filtering of audio signal through 8KHz.The analog video signal of input is the base band composite video signal, changes it into meet the ITU-656 form digital video signal by the decoding chip of audio-video collection device.The data acquisition buffering Control Software that operates in the field programmable gate array (FPGA) is responsible for these digital signal tissues, is stored among the RAM, waits for that the compressed encoding software on upper strata reads.
Operation is MPEG4/H.263/H.264 and compressed encoding software G.729 in the condensing encoder.Both all are Coding Compression Algorithm of high compression ratio, and amount of calculation is bigger, are finished by the digital signal processor (DSP) of special use.Wherein, the algorithm software of MPEG4/H.263/H.264 is specially for DSP has carried out optimization Algorithm, so that realize the Real Time Compression coding.Condensing encoder is when work, and for the upper strata, the data read interface and the control interface operational procedure that design according to the main frame Peripheral Interface (HPI) of the special DSP of being are moved, and accept the control of upper layer drivers, and send data according to operational procedure; For lower floor, according to the condensing encoder current working state, control data collector, and reading of data.
The operating system of embedded system, device driver, RSVP API support storehouse, streaming media server program to operate in jointly on the embedded system based on ARM kernel microprocessor, and media stream in real time transmission service is provided.Device driver has been covered the specific operational features of compressing and coding apparatus to the operating system of embedded system, shows as an abstract general character device, and the system call interfaces of data read and Equipment Control is provided to operating system; Operating system unified management various device, the service that provides equipment to read, control to user program; RSVP API supports the storehouse that the application programming interfaces of visit RSVP backstage demons are provided; The RSVP resource reservation function that the streaming media server program is finished is actually by calling the interface function that RSVPAPI supports the storehouse, is finished by RSVP backstage demons.The streaming media server program provides media stream in real time transmission service to Terminal Server Client.
In embedded server of the present invention as shown in Figure 3 and client functionality logical construction and the data flow schematic diagram, streaming media server program 3 is made up of service master control thread 4, RTCP watcher thread 5, RTP data transmission line journey 6, RSVP Message Processing thread 7.Master control thread 4 is responsible for handling and is received from control information (for example control desk management information) of this locality and state and the mutual various data message of managing other threads.Various message and data flow in the streaming media server program 3 comprise: RTCP thread control flows 8, RTP thread control flows 9, RSVP control flows 10, RTP thread and RTCP inter-thread data stream 11.RTP data transmission line journey 6 is responsible for the slave unit driver and is obtained stream medium data, and the stream medium data packing is added RTP packet header, and the RTP data flow 13 that generates is sent to client, and the generation various statistic calls for RTCP watcher thread 5.RTCP watcher thread 5 obtains the RTP statistics by RTP thread and RTCP inter-thread data stream 11, and also periodically generating RTCP stream of packets 12 sends to Terminal Server Client in analysis, and feeds back to service master control thread 4, so that in time adjust the performance of RTP service.RSVP Message Processing thread 7 is responsible for handling RSVP data flow 14, guarantees the quality of service.Client 15 is made up of client master control thread 16, RTCP communication thread 17, estimation device and decision-making device thread 18, RTP Data Receiving thread 19, RSVP Message Processing thread 20 and media play thread 21.Client master control thread 16 is responsible for handling control information (for example control and management information of user's image interface transmission) that receives from this locality and state and the mutual various data message of managing other threads.Various message and data flow in the client 15 comprise: RTCP thread control flows 22, decision-making device control RTCP Thread Messages stream 23, decision-making device control RTCP receive buffering area message flow 24, RSVP thread control messages stream 25, playing media data stream 27 and media player to estimation device message flow 26.RTP Data Receiving thread 19 is responsible for receiving the acquisition stream medium data from network and is inserted its stream medium data reception buffering area.RTCP communication thread 17 receives the control messages of client master control thread 16, requests such as communication request that the realization user lands and publishes and the action of control The Cloud Terrace; In addition, this thread receives the control messages stream of estimation device and decision-making device thread 18, realizes the request of control embedded server coded system.RSVP Message Processing thread 20 is responsible for handling RSVP control data stream 14, guarantees the quality of service.
Server RTCP watcher thread 5 receives that the RTCP communication thread 17 of client 15 sends the SDES of RTCP to streaming media server program 3, streaming media server program 3 receives the packet of the type, level of security according to embedded server, judgement will be verified which information of customer information, for example needs to verify to the username and password checking or to the IP address that the client lands.The access security rank of embedded server is divided into level Four, is respectively no access control, limited subscriber name, restriction IP address, limited subscriber name and IP address.If embedded server is operated in pattern and the authentication failed that needs checking, identical continuous three authentication faileds of user name or IP address can cause this user name or IP address to be recorded into blacklist and it is stopped service in one minute, just register this user name and IP address to user list and distribute and insert authority if be proved to be successful.Insert authority and be divided into two ranks, monitoring rank and control hierarchy, enjoy other client of monitoring level only to receive the multi-way stream medium that embedded server sends, the client of enjoying control hierarchy can also be controlled the action of the audio/video coder and the The Cloud Terrace of embedded server except the multi-way stream medium that can receive the embedded server transmission.
RTP data transmission line journey 6 is responsible for RTP data flow 13 is sent to client, the slave unit driver reads MPEG4/H.263/H.264 data or data G.729, produce the stream medium data grouping of RTP form, and produce media timestamp, media timestamp writes each stream medium data grouping.The method that produces media timestamp is: the time of reading the 64bit embedded system, high 32bit of this embedded system time be with second (S) be the numerical value of unit, low 32bit is to be the numerical value of unit with microsecond (uS), get the 23rd~the 8th 16bit numerical value of the centre of the low 16bit value of second numerical value and microsecond numerical value, merging is got up, become the media timestamp of 32bit, simplified the calculating of media timestamp.Before client sends data, if this client requires embedded server that the stream medium data that sends to it is encrypted, then server is carried out cryptographic operation and is sent these data again before carrying out stream medium data.
The stream medium data of RTP Data Receiving thread 19 receives the packet of buffering area receiving stream media and handles: 1. for playing the stream medium data grouping that arrived before the time limit, the packet header of each stream medium data grouping can comprise the sequence number of bag, after receiving a grouping, in receiving buffering area, stream medium data seeks reference packet earlier, be the oldest current grouping, the sequence number according to reference packet determines the memory location of current group in stream medium data receives buffering area then.Because the sequence number degree of packet numbering is limited, it is the situation of 0 numbering from the saltus step of maximum numbering that stream medium data reception buffering area will be handled packet sequence number, rearranges the stream medium data grouping of out of order arrival; 2. for playing the stream medium data grouping that arrives after the time limit, abandon.In addition, stream medium data receives buffering area and wants regularly statistics network status transmission, comprises that stream medium data is grouped into peaking, arrives average and Loss Rate.
Estimation device and decision-making device thread 18 regularly call network communication state estimation device and read the network condition statistical parameter from stream medium data reception buffering area, send the winding time test grouping of RTCP APP then, obtain the winding time parameter.Network communication state estimation device estimation network remaining bandwidth, the average of delay variation, the standard deviation of delay variation and the effective bandwidth of stream medium data.Afterwards, estimation device and decision-making device thread 18 call the decision-making device of adjusting code check again.The adaptive transmission of the network remaining bandwidth APP application packet that decision-making device calculates according to network communication state estimation device is controlled the compressed encoding quality of embedded server, reaches customer satisfaction system acceptability.When network communication state is relatively poor, acceptability when the following aspects is taken into account media playback and the occupied bandwidth of transmission: 1. reduce the picture coding quality; 2. reduce the frame per second of image compression coding; 3. picture format is switched to CIF or QCIF from D1; If 4. network support, the resource reservation of startup RSVP.If network condition takes a turn for the better gradually, anti-operation is carried out in then above-mentioned several measures.In addition, if receive the decoding error report message that media play thread 21 sends, estimation device and decision-making device thread 18 can carry out a new wheel operation immediately.
Client media sync method schematic diagram of the present invention has as shown in Figure 4 shown the mechanism of using the voice playing time to promote the audio-visual synchronization of time as media playback.Play the audio, video data of same synchronisation source simultaneously, also must guarantee between audio frequency and video synchronously.In addition, because source of media deviation might take place when beating timestamp, require client also must possess the function of synchronous micro-adjusting, to guarantee the impression of client.Because multimedia system is higher to the qos requirement of sound, the people is more responsive to audio frequency continuity comparison video continuity, and the playback rate of audio frequency is constant, so client is a benchmark with the audio decoder time, the broadcast of other medium with the broadcasting speed of audio frequency as a reference.Media play thread 21 calls audio decoder and Video Decoder carries out media playback, and audio decoder can calculate the global media time, and uses the mode of global variable to issue this global media time.Video Decoder uses global media time and privately owned media fine setting time to calculate the privately owned media timestamp, and the Video Decoder band the data of privately owned media timestamp reading flow media data buffering area, realizes the broadcast of video and audio sync; Video Decoder carries out error concealment for the frame that does not have successfully decoding, improves the acceptability of Media Stream playback; And, notify its network self-adapting that carries out new round action to estimation device and decision-making device thread 18 its decoding error message of report.
This device is simple, is easy to dispose, and low in energy consumption, can provide various control interface to realize interactive operation.

Claims (6)

1. transmission method that is used for embedded Linux multimedia signal acquisition and processing apparatus, described device comprises an embedded server, several clients and a The Cloud Terrace, described client comprises that audio decoder, Video Decoder, stream medium data receive the decision-making device of buffering area, network communication state estimation device and adjustment code check, is characterized in that the step of described method is as follows:
The first step: during login, client software sends the Source Description grouping of RTCP Real-time Transport Control Protocol to embedded server; Embedded server is according to access security rank checking user name and IP address, if the authentication failed embedded server writes down this user name and IP address, identical user name or IP address continuous several times authentication failed can cause this user name or IP address to be recorded into blacklist and user name or the IP address that is recorded into blacklist stopped service in short time, just register this user name and IP address to user list and distribute and insert authority if be proved to be successful;
Second step: after the user logins embedded server, the client that embedded server begins in user list sends stream medium data, if this customer requirements server is encrypted the stream medium data that sends to it, then server can be carried out cryptographic operation when carrying out the stream medium data transmission; The stream medium data of client receives the packet of buffering area receiving stream media and handles: for playing the stream medium data grouping that arrived before the time limit, determine its position in stream medium data receives buffering area, rearrange the stream medium data grouping of out of order arrival; Do discard processing for playing the stream medium data grouping that arrives after the time limit; Stream medium data receives regularly statistics network status transmission of buffering area;
The 3rd step: when carrying out transmission of flow media data, embedded server produces the stream medium data grouping of RTP form, and produces media timestamp, and media timestamp writes each stream medium data grouping; During the client playback, audio decoder calculates the global media time and the user sets the privately owned media fine setting time, Video Decoder uses these two times to calculate the privately owned media timestamp, the Video Decoder band the data of privately owned media timestamp reading flow media data buffering area, realizes the broadcast of video and audio sync;
In the 4th step, client is regularly called network communication state estimation device, receives buffering area from stream medium data and reads the network condition statistical parameter, sends the winding time test grouping of RTCP Real-time Transport Control Protocol application packet then, obtains the winding time parameter; Network communication state estimation device estimation network remaining bandwidth, the average of delay variation, the standard deviation of delay variation and the effective bandwidth of stream medium data; Client is regularly called the decision-making device of adjusting code check, and the application packet of adaptive transmission RTCP Real-time Transport Control Protocol is controlled the compressed encoding quality of embedded server.
2. transmission method according to claim 1 is characterized in that the grouping of Source Description in the described first step has the resource obligate information of user name, password, encrypted public key and the RSVP of client login.
3. transmission method according to claim 1 is characterized in that the access security rank of embedded server in the described first step is divided into level Four, is respectively no access control, limited subscriber name, restriction IP address, limited subscriber name and IP address.
4. transmission method according to claim 1 is characterized in that inserting in the described first step authority and is divided into two ranks, is respectively monitoring rank and control hierarchy.
5. transmission method according to claim 1, it is characterized in that the method that produces media timestamp in described the 3rd step is: the time of reading the 64bit embedded system, the high 32bit of this embedded system time is to be the numerical value of unit with the second, low 32bit is to be the numerical value of unit with the microsecond, get with the second the low 16bit value and the 23rd~the 8th the 16bit numerical value of centre that with the microsecond is the numerical value of unit of the numerical value that is unit, merging is got up, and becomes the media timestamp of 32bit.
6. transmission method according to claim 1 is characterized in that described Network Transmission situation is grouped into peaking, arrival average and Loss Rate with stream medium data and characterizes.
CNB2006100330581A 2006-01-20 2006-01-20 Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method Expired - Fee Related CN100452705C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006100330581A CN100452705C (en) 2006-01-20 2006-01-20 Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006100330581A CN100452705C (en) 2006-01-20 2006-01-20 Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method

Publications (2)

Publication Number Publication Date
CN1805356A CN1805356A (en) 2006-07-19
CN100452705C true CN100452705C (en) 2009-01-14

Family

ID=36867218

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006100330581A Expired - Fee Related CN100452705C (en) 2006-01-20 2006-01-20 Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method

Country Status (1)

Country Link
CN (1) CN100452705C (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101729564B (en) * 2009-11-23 2014-12-31 北京中星微电子有限公司 Holder controlling method, system and client
CN102271143A (en) * 2010-06-03 2011-12-07 华平信息技术股份有限公司 Remote pan/tilt/zoom control system based on network transmission technique
CN103945244B (en) * 2013-01-17 2018-05-29 华为技术有限公司 The method and apparatus for controlling video traffic transmission
CN104954888B (en) * 2014-03-24 2018-03-20 中国电信股份有限公司 The method and apparatus for adjusting stream media code stream transmission rate
CN104618690B (en) * 2015-01-29 2018-01-05 广东迅通科技股份有限公司 A kind of method and system of HD video real-time VOD and history playback
CN107819751A (en) * 2017-10-27 2018-03-20 浙江码博士防伪科技有限公司 A kind of safe automated log on management system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1557072A (en) * 2001-09-21 2004-12-22 ���˹���Ѷ��� Data communications method and system using buffer size to calculate transmission rate for congestion control
CN1567293A (en) * 2003-07-07 2005-01-19 莫伟 Flush bonding intelligent multimedia playing system, player and method thereof
WO2005081439A1 (en) * 2004-02-13 2005-09-01 Neocific, Inc. Methods and apparatus for multi-carrier communication systems with adaptive transmission and feedback

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1557072A (en) * 2001-09-21 2004-12-22 ���˹���Ѷ��� Data communications method and system using buffer size to calculate transmission rate for congestion control
CN1567293A (en) * 2003-07-07 2005-01-19 莫伟 Flush bonding intelligent multimedia playing system, player and method thereof
WO2005081439A1 (en) * 2004-02-13 2005-09-01 Neocific, Inc. Methods and apparatus for multi-carrier communication systems with adaptive transmission and feedback

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
嵌入式网络视频监控***的研究. 谢佑军.西南交通大学硕士研究生学位论文. 2005
嵌入式网络视频监控***的研究. 谢佑军.西南交通大学硕士研究生学位论文. 2005 *

Also Published As

Publication number Publication date
CN1805356A (en) 2006-07-19

Similar Documents

Publication Publication Date Title
WO2023024834A9 (en) Game data processing method and apparatus, and storage medium
US7171485B2 (en) Broadband network system configured to transport audio or video at the transport layer, and associated method
US7464172B2 (en) Simultaneous media playout
CN104618690B (en) A kind of method and system of HD video real-time VOD and history playback
US20030074445A1 (en) Broadband network system and associated method
US20100226444A1 (en) System and method for facilitating video quality of live broadcast information over a shared packet based network
US20100226428A1 (en) Encoder and decoder configuration for addressing latency of communications over a packet based network
CN100452705C (en) Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method
US6986158B1 (en) System and method for distributing video information over network
US20030074554A1 (en) Broadband interface unit and associated method
CN103237191A (en) Method for synchronously pushing audios and videos in video conference
CN100499805C (en) Free viewpoint video IP network transmission method based on light field exaggeration
US8356109B2 (en) Network streaming of a video stream over multiple communication channels
Campbell et al. QoS adaptive transports: Delivering scalable media to the desktop
CN108063911B (en) Video conference capacity expansion method
CN107333143A (en) 5G multiple access concurrent transmission control systems and method
CN104320716A (en) A video uplink transmission method based on collaborative multiple terminals
CN109862386A (en) Live data transmission method and device
Yahia et al. When HTTP/2 rescues DASH: Video frame multiplexing
Wang et al. A study of live video streaming system for mobile devices
KR100502186B1 (en) HDTV internet broadcast service system
CN105306970B (en) A kind of control method and device of live streaming media transmission speed
Kuang et al. Hierarchical analysis of RealMedia streaming traffic on an IEEE 802.11 b wireless LAN
CN114470745A (en) Cloud game implementation method, device and system based on SRT
Fortino et al. A methodology centered on modularization of QoS constraints for the development and performance evaluation of multimedia systems

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Assignee: VOTO Communication Co., Ltd.

Assignor: South China University of Technology

Contract record no.: 2011440000274

Denomination of invention: Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method

Granted publication date: 20090114

License type: Exclusive License

Open date: 20060719

Record date: 20110401

C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090114

Termination date: 20140120