CN104618690A - Method and system for real-time on-demand and historical playback of high-definition video - Google Patents
Method and system for real-time on-demand and historical playback of high-definition video Download PDFInfo
- Publication number
- CN104618690A CN104618690A CN201510046242.9A CN201510046242A CN104618690A CN 104618690 A CN104618690 A CN 104618690A CN 201510046242 A CN201510046242 A CN 201510046242A CN 104618690 A CN104618690 A CN 104618690A
- Authority
- CN
- China
- Prior art keywords
- client
- video
- request
- rtsp
- playback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and system for a method and a system for real-time on-demand and historical playback of a high-definition video. The method includes the steps of: receiving a connection request sent by a client through a video server; judging whether a user pool is full, if yes, judging whether the received connection request is based on an SIP protocol or a RTSP protocol, and sending an authentication request to the client; authenticating after receiving the authentication information returned by the client, judging whether the client passes through the authentication, if yes, registering the user, establishing a connection with the client, and then performing video-on-demand or historical playback of the corresponding video point; self-adaptively regulating the frame rate and code rate of the video, or switching from a main code stream to a sub code stream; disconnecting with the client, logging out the user and recycling a user groove. The method can be compatible with the SIP protocol and the RTSP protocol at the same time, and ensures the definition and fluency of the transmission data, thus being capable of being widely applied to the video monitoring field of security field.
Description
Technical field
The present invention relates to technical field of video monitoring, the method and system of particularly a kind of HD video real-time VOD and history playback.
Background technology
For the ease of description of the invention, first provide following explanation of nouns:
SIP: full name Session Initiation Protocol, Session initiation Protocol, for creating, revising and stop comprising the oolhiu interactive user session of the multiple multimedia elements such as video, voice, instant messaging, game on line and virtual reality.
RTSP: full name Real Time Streaming Protocol, real time streaming transport protocol.
RTP: full name Real-time Transport Protocol, RTP.
SDP: full name Session Description Protocol, Session Description Protocol, can provide Multimedia session to describe for objects such as the Multimedia session initialization of conversation informing, session invitation and other form.
Along with the development of science and technology and the daily production of people and living-pattern preservation, safety monitoring maintain public order stable in play a part more and more important.Current video server generally only supports RTSP host-host protocol, and RTSP host-host protocol is higher to network delay tolerance, lower to the requirement of time synchronized, can carry out transmission of video preferably.And the safety precaution video monitoring networking system that current national safety-security area proposes proposes information transmission and the control of being carried out each equipment room in system by Session Initiation Protocol, because in current technology, video server only supports RTSP host-host protocol, the client based on Session Initiation Protocol cannot be supported, cause the client of Session Initiation Protocol cannot realize program request and the playback function of HD video, also strongly limit the range of application of video server conversely, nor be beneficial to and carry out security monitoring better.
Summary of the invention
In order to solve above-mentioned technical problem, the object of this invention is to provide a kind of method of HD video real-time VOD and history playback.Another object of the present invention is to provide the system of a kind of HD video real-time VOD and history playback.
The technical solution adopted for the present invention to solve the technical problems is:
A method for HD video real-time VOD and history playback, comprising:
Step 1, video server receive the connection request that client sends;
Step 2, judge that whether user pond is full, if less than, then judge that the connection request received is based on Session Initiation Protocol or RTSP agreement, and then authentication request is sent to client, on the contrary refusal connection request, disconnect the connection with this client;
Carry out authentication after the authentication information that step 3, reception client return, judge that whether client is by authentication, if, then register this user, connect with client, and then carry out corresponding video request program or history playback operation, otherwise disconnect the connection with this client;
Step 4, according to network quality state, adjust video frame rate, code check adaptively, or be switched to subcode stream from main bit stream;
Step 5, with after client disconnects, nullify this user and reclaim user's groove.
Further, judge that the connection request received is based on Session Initiation Protocol or RTSP agreement described in described step 2, and then send the step of authentication request to client, it is specially:
Judge that the connection request received is based on Session Initiation Protocol or RTSP agreement, if RTSP agreement, then inform the RTSP request type that client video server is supported, and authentication request is sent to client, if otherwise based on Session Initiation Protocol, then direct to client transmission authentication request.
Further, described in described step 3, authentication information comprises user name and logs in password, carries out authentication after the authentication information that described reception client returns, and judge client whether by the step of authentication, it is specially:
After the authentication information that reception client returns, MD5 hash algorithm is adopted to carry out computing to the password that logs in authentication information, and then judge the operation values that obtains with store in file system whether consistent with the MD5 value corresponding to the user name of this authentication information, if, then represent that authentication is passed through, otherwise represent that authentication is not passed through.
Further, carry out the step of corresponding video request program described in described step 3, comprise RTSP client program request step and SIP client program request step, described RTSP client program request step, comprising:
S31, RTSP client send the request obtaining media initialize descriptor;
After S32, video server receive the request of RTSP client, send response message and SDP session information to RTSP client, described SDP session information comprises session connection information and Media Stream passage descriptor;
After S33, RTSP client receive response message and SDP conversation message, to the media stream connection request in SDP conversation message;
S34, video server reply response message, set up session with RTSP client;
S35, RTSP client send request the order request of real-time VOD Media Stream;
After S36, video server receive order request, from shared drive, extract Media Stream in real time and send to client after RTP packing is carried out to it, gathering in real time simultaneously and also in shared drive, write media stream data;
S37, RTSP client are carried out decoding and are play after receiving the media stream data of video server transmission;
Described SIP client program request step, comprising:
S41, SIP client send the request of the first SDP information of carrying, and session connection is set up in request, the medium stream information that described first SDP information comprises the IP address of SIP client, port numbers and asks;
After S42, video server receive the request of SIP client, send response message and the second SDP information to SIP client, described second SDP information comprises the IP address of Media Stream, port numbers and media formats;
After S43, SIP client receive response message and the second SDP information, send the confirmation request of carrying received response message, set up session with video server;
After S44, video server receive the confirmation request, from shared drive, extract Media Stream in real time and send to client after RTP packing is carried out to it, gathering in real time simultaneously and also in shared drive, write media stream data;
S45, SIP client are carried out decoding and are play after receiving the media stream data of video server transmission.
Further, the step of corresponding history playback operation is carried out described in described step 3, comprise the step of RTSP client request playback history video and the step of SIP client request playback history video, the step of described RTSP client request playback history video, comprising:
S51, RTSP client send the request obtaining media initialize descriptor;
After S52, video server receive the request of RTSP client, send response message and SDP session information to RTSP client, described SDP session information comprises session connection information and Media Stream passage descriptor;
After S53, RTSP client receive response message and SDP conversation message, to the media stream connection request in SDP conversation message;
S54, video server reply response message, set up session with RTSP client;
S55, RTSP client send request the playback request of carrying out history playback controls to video server; Described playback controls comprise video pause, broadcasting, put soon, put slowly and at random drag play in one or more;
After S56, video server receive playback request, the Media Stream after reading encapsulation in real time from local hard drive also sends to RTSP client after carrying out RTP packing in conjunction with playback request to Media Stream;
S57, RTSP client are carried out decoding and are play after receiving the Media Stream of video server transmission;
The step of described SIP client request playback history video, comprising:
S61, SIP client send the request of Three S's DP information of carrying, and session connection is set up in request, the medium stream information that described Three S's DP information comprises the IP address of the beginning of playback and end time and SIP client, port numbers and asks;
After S62, video server receive the request of SIP client, send response message and the 4th SDP information to SIP client, described 4th SDP information comprises the IP address of Media Stream, port numbers and media formats;
After S63, SIP client receive response message and the 4th SDP information, send the confirmation request of carrying received response message, set up session with video server;
After S64, video server receive the confirmation request, judge whether the RTSP solicited message of carrying out history playback controls receiving SIP client transmission in real time, if, then real-time from local hard drive, read encapsulation after Media Stream and send to SIP client after RTP packing being carried out to Media Stream in conjunction with RTSP solicited message, otherwise Media Stream after in real time reading encapsulation from local hard drive send to SIP client after RTP packing is carried out to it;
S65, SIP client are carried out decoding and are play after receiving the Media Stream of video server transmission.
The present invention solves another technical scheme that its technical problem adopts:
The system of a kind of HD video real-time VOD and history playback, comprise video server, SIP client and RTSP client, described video server comprises audio-video collection module, audio/video coding module, local memory module and network transmission module, the output of described audio-video collection module is connected with the input of audio/video coding module, the output of described audio/video coding module is connected with the input of local memory module and the first input end of network transmission module respectively, the output of described local memory module is connected with the second input of network transmission module, described network transmission module is connected with SIP client and RTSP client respectively.
Further, described audio-video collection module supports 2 road HDMI HD video input interfaces, 4 road 8BIT HD-SDI video input interfaces, 2 road 16BIT HD-SDI video input interfaces, 1 road MIC audio input interface and 1 road LINE audio input interface, and the best result video of described audio-video collection module support distinguishes that rate is 1080P60.
Further, described audio/video coding module adopts video resolution to be the main bit stream technology of 1080P and video resolution to be the subcode stream technology of CIF, described audio/video coding module supports H264, MEPG4 Video coding and G711, G726, G729 and AAC audio coding, support H264, MEPG4 Video coding, and G711, G726, G729 and AAC audio coding, the audio, video data after coding is delivered to network transmission module by shared drive by described audio/video coding module.
Further, described local memory module comprises local hard drive and/or SD card, and the audio, video data that described local memory module is used for audio/video coding module sends is packaged into the media data of PS form and is stored in local hard drive and/or SD card.
Further, the procotol package form of described network transmission module is RTP bag.
The invention has the beneficial effects as follows: the method for a kind of HD video real-time VOD of the present invention and history playback, comprising: video server receives the connection request that client sends; Judge that whether user pond is full, if less than, then judge that the connection request received is based on Session Initiation Protocol or RTSP agreement, and then authentication request is sent to client, on the contrary refusal connection request, disconnect the connection with this client; Carry out authentication after the authentication information that reception client returns, judge that whether client is by authentication, if so, then registers this user, connects with client, and then carry out corresponding video request program or history playback operation, otherwise disconnect the connection with this client; According to network quality state, adjust video frame rate, code check adaptively, or be switched to subcode stream from main bit stream; After disconnecting with client, nullify this user and reclaim user's groove.This method can the simultaneously large control protocol of compatible RTSP and SIP two, based on Session Initiation Protocol SIP client can with only support that the video server of RTSP agreement carries out HD video program request and playback, media request and the transmission of more polymorphic type client can be realized, and ensure that the definition of transmission data, can assist better and carry out security monitoring.And this method according to the network condition of reality, can be selected suitable video resolution, code check and frame per second, or is switched to subcode stream from main bit stream adaptively, ensure that the fluency of video image.
In addition, this method can realize the transmission of the HD video of 1080P60, substantially increases the definition of existing safety-security area monitor video.
Another beneficial effect of the present invention is: the system of a kind of HD video real-time VOD of the present invention and history playback, comprise video server, SIP client and RTSP client, video server comprises audio-video collection module, audio/video coding module, local memory module and network transmission module, the output of audio-video collection module is connected with the input of audio/video coding module, the output of audio/video coding module is connected with the input of local memory module and the first input end of network transmission module respectively, the local output of memory module is connected with the second input of network transmission module, network transmission module is connected with SIP client and RTSP client respectively.Native system can the simultaneously large control protocol of compatible RTSP and SIP two, make only to support that the video server support of RTSP agreement carries out HD video program request and playback based on the SIP client of Session Initiation Protocol, media request and the transmission of more polymorphic type client can be realized, and ensure that the definition of transmission data, can assist better and carry out security monitoring.
In addition, native system according to the network condition of reality, can be selected suitable video resolution, code check and frame per second, or is switched to subcode stream from main bit stream adaptively, ensures the fluency of video image.And achieve the transmission of HD video of 1080P60, substantially increase the definition of existing safety-security area monitor video.
Accompanying drawing explanation
Below in conjunction with drawings and Examples, the invention will be further described.
Fig. 1 is the flow chart of the method for a kind of HD video real-time VOD of the present invention and history playback;
Fig. 2 is the interactive step flow chart of client and video server in RTSP client program request step in the method for a kind of HD video real-time VOD of the present invention and history playback;
Fig. 3 is the interactive step flow chart of client and video server in SIP client program request step in the method for a kind of HD video real-time VOD of the present invention and history playback;
Fig. 4 is the interactive step flow chart of client and video server in the step of RTSP client request playback history video in the method for a kind of HD video real-time VOD of the present invention and history playback;
Fig. 5 is the interactive step flow chart of client and video server in the step of SIP client request playback history video in the method for a kind of HD video real-time VOD of the present invention and history playback;
Fig. 6 is the structured flowchart of the system of a kind of HD video real-time VOD of the present invention and history playback.
Embodiment
With reference to Fig. 1, the invention provides a kind of method of HD video real-time VOD and history playback, comprising:
Step 1, video server receive the connection request that client sends;
Step 2, judge that whether user pond is full, if less than, then judge that the connection request received is based on Session Initiation Protocol or RTSP agreement, and then authentication request is sent to client, on the contrary refusal connection request, disconnect the connection with this client;
Carry out authentication after the authentication information that step 3, reception client return, judge that whether client is by authentication, if, then register this user, connect with client, and then carry out corresponding video request program or history playback operation, otherwise disconnect the connection with this client;
Step 4, according to network quality state, adjust video frame rate, code check adaptively, or be switched to subcode stream from main bit stream;
Step 5, with after client disconnects, nullify this user and reclaim user's groove.
Preferably, judge that the connection request received is based on Session Initiation Protocol or RTSP agreement in step 2, and then send the step of authentication request to client, it is specially:
Judge that the connection request received is based on Session Initiation Protocol or RTSP agreement, if RTSP agreement, then inform the RTSP request type that client video server is supported, and authentication request is sent to client, if otherwise based on Session Initiation Protocol, then direct to client transmission authentication request.
Preferably, in step 3, authentication information comprises user name and logs in password, carries out authentication after receiving the authentication information that returns of client, and judge client whether by the step of authentication, it is specially:
After the authentication information that reception client returns, MD5 hash algorithm is adopted to carry out computing to the password that logs in authentication information, and then judge the operation values that obtains with store in file system whether consistent with the MD5 value corresponding to the user name of this authentication information, if, then represent that authentication is passed through, otherwise represent that authentication is not passed through.
Preferably, carry out the step of corresponding video request program in step 3, comprise RTSP client program request step and SIP client program request step, RTSP client program request step, comprising:
S31, RTSP client send the request obtaining media initialize descriptor;
After S32, video server receive the request of RTSP client, send response message and SDP session information to RTSP client, SDP session information comprises session connection information and Media Stream passage descriptor; In the present invention, the session connection information of indication comprises session name, link information and media formats;
After S33, RTSP client receive response message and SDP conversation message, to the media stream connection request in SDP conversation message;
S34, video server reply response message, set up session with RTSP client;
S35, RTSP client send request the order request of real-time VOD Media Stream;
After S36, video server receive order request, from shared drive, extract Media Stream in real time and send to client after RTP packing is carried out to it, gathering in real time simultaneously and also in shared drive, write media stream data;
S37, RTSP client are carried out decoding and are play after receiving the media stream data of video server transmission;
SIP client program request step, comprising:
S41, SIP client send the request of the first SDP information of carrying, and session connection is set up in request, the medium stream information that the first SDP information comprises the IP address of SIP client, port numbers and asks;
After S42, video server receive the request of SIP client, send response message and the second SDP information to SIP client, the second SDP information comprises the IP address of Media Stream, port numbers and media formats;
After S43, SIP client receive response message and the second SDP information, send the confirmation request of carrying received response message, set up session with video server;
After S44, video server receive the confirmation request, from shared drive, extract Media Stream in real time and send to client after RTP packing is carried out to it, gathering in real time simultaneously and also in shared drive, write media stream data;
S45, SIP client are carried out decoding and are play after receiving the media stream data of video server transmission.
Preferably, carry out the step of corresponding history playback operation in step 3, comprise the step of RTSP client request playback history video and the step of SIP client request playback history video, the step of RTSP client request playback history video, comprising:
S51, RTSP client send the request obtaining media initialize descriptor;
After S52, video server receive the request of RTSP client, send response message and SDP session information to RTSP client, SDP session information comprises session connection information and Media Stream passage descriptor;
After S53, RTSP client receive response message and SDP conversation message, to the media stream connection request in SDP conversation message;
S54, video server reply response message, set up session with RTSP client;
S55, RTSP client send request the playback request of carrying out history playback controls to video server; Playback controls comprise video pause, broadcasting, put soon, put slowly and at random drag play in one or more;
After S56, video server receive playback request, the Media Stream after reading encapsulation in real time from local hard drive also sends to RTSP client after carrying out RTP packing in conjunction with playback request to Media Stream;
S57, RTSP client are carried out decoding and are play after receiving the Media Stream of video server transmission;
The step of SIP client request playback history video, comprising:
S61, SIP client send the request of Three S's DP information of carrying, and session connection is set up in request, the medium stream information that Three S's DP information comprises the IP address of the beginning of playback and end time and SIP client, port numbers and asks;
After S62, video server receive the request of SIP client, send response message and the 4th SDP information to SIP client, the 4th SDP information comprises the IP address of Media Stream, port numbers and media formats;
After S63, SIP client receive response message and the 4th SDP information, send the confirmation request of carrying received response message, set up session with video server;
After S64, video server receive the confirmation request, judge whether the RTSP solicited message of carrying out history playback controls receiving SIP client transmission in real time, if, then real-time from local hard drive, read encapsulation after Media Stream and send to SIP client after RTP packing being carried out to Media Stream in conjunction with RTSP solicited message, otherwise Media Stream after in real time reading encapsulation from local hard drive send to SIP client after RTP packing is carried out to it;
S65, SIP client are carried out decoding and are play after receiving the Media Stream of video server transmission.
The detailed operation flow process of this method is described below in conjunction with Fig. 1 ~ Fig. 5.
With reference to shown in Fig. 1, the socket port of video server monitors the connection request of client, and when client has logging request, whether first net transmission module detects user pond has vacant slot.Have individual status field to represent slot state in the structure of user slot, sockfd represents that this slot and user transmit socket used, and IP_address represents the IP address of this slot user.When in user pond, slot all takes, video server disconnects the connection with this client.If user has vacant slot in pond, then judge the procotol that this client is used, front 4 letters of the request of method received by judgement, " if RTSP ", be then RTSP agreement, if " SIP " is then Session Initiation Protocol, if not, then disconnect socket to connect.If client is based on RTSP agreement, video server then informs which the RTSP request that client-server supports has, and as " DESCRIBE, SETUP, PLAY, PAUSE, TEARDOWN " etc., then sends authentication request to client and carries out subscription authentication.If client is based on " SIP " agreement, then video server directly sends authentication request to client.The present invention's method for authenticating used is MD5 algorithm, login password corresponding to different user name is stored in file system with MD5 by video server in advance after Hash computing, when user logs in time, system carries out MD5 Hash computing the password that user inputs, and then go and be kept at MD5 value corresponding with this user name in file system and compare, and then determine that whether the password inputted is correct.If authentication is not passed through, then disconnect socket and connect.If authentication is passed through, then in the slot in user pond stored in the socket and IP address with this telex network.Then, server judges that the request of client is real-time VOD or history playback.If real-time VOD, video server directly takes out media stream data from shared drive and carries out RTP packing.If history video playback, video server then searches the history video file that whether there is wanted playback in local memory module, if exist, then this file is passed to video server by shared drive and carries out RTP packing; If do not exist, then send error code to client, and disconnect socket connection, by the slot release in user pond.When client terminal playing video is complete, when disconnecting with server, the data of this user slot in user pond also will empty by server, release slot.
In the step of the step of RTSP client real-time VOD video and request playback history video with the interactive step of video server as shown in Fig. 2 and Fig. 4.When setting up session connection, real-time VOD step S301-S309 is identical with history replay procedure S501-S509, is all that first client sends OPTIONS request, the RTSP request type that inquiry video server is supported.After video server is responded, client sends DESCRIBE request, and request video server provides media session descriptor.Now, Video servers demand client carries out authentication, client sends DESCRIBE request again, the authentication information of user name and login password is carried in this request, video server carries out after authentication verification passes through, SDP session information can be sent to client, describe session name, link information and media formats and channel information.Then, client can be asked for needing the media stream SETUP of request, determines the transmission mode of Media Stream, and after server response success, client just sends PLAY request, request displaying video.And for history media playback process, the playback controls of step S511 also can be continued.The ntp time in the Range prefix carried in being asked by RTSP, the time location of the random drag and drop of video flowing can be set, with crossing Scale prefix, can broadcasting speed be set, Scale=1 is constant speed, Scale=2 is 2 times of acceleration, Scale=0.5 is slow play, and speed is 1/2 of constant speed, by that analogy.Last client sends TEARDOWN request, disconnects with server.In fact, carrying out playback controls also can be that RTSP client controls in client this locality after video server obtains media stream data, and this method emphasis describes RTSP client and video server carries out data interaction thus realizes the process of playback controls.
In the step of the step of SIP client real-time VOD audio frequency and video and request playback history video with the interactive step of video server as shown in Fig. 3 and Fig. 5.When setting up session connection, real-time VOD step S401-S407 is identical with history replay procedure S601-S607, all that first client sends Register registration request to video server, Authorization field is comprised in request, after video server receives request, send 401 responses, and notify the identifying algorithm that client video server is supported.Client sends Register request again, provides authentication information in Authorization field.Video server carries out authentication, after the authentication has been successful, sends 200 OK responses.Then, client sends Invite request, and carry SDP information in this request, session name is play, and the media information of informing the IP address of video server client, port numbers and asking; After video server receives request, reply 200 OK responses, and carry SDP information, in message body, describe the IP address of Media Stream, port numbers and media formats etc.; After SIP client receives video server success response, send ACK request, complete session establishment process.Audio/video flow packed for RTP is just sent to client by video server.For history video playback, client sends INFO by step 609 to server and carries out playback controls, session content in INFO is RTSP solicited message, has Range prefix and Scale prefix in this information, carries out video and drags control fast, at a slow speed, at random.At the end of video playback, video server sends Message conversation message by step S611, and notice client media spreads and puts end.When client needs to disconnect, BYE request can be sent by step 613 in step 409 in Fig. 3 and Fig. 5 to server, after video server responds 200 OK, disconnect and being connected with the socket of client, and reclaim user slot.Same, carrying out playback controls also can be that SIP client controls in client this locality after video server obtains media stream data, and this method emphasis describes SIP client and video server carries out data interaction thus realizes the process of playback controls.
Embodiment two
With reference to Fig. 6, present invention also offers a kind of system of method HD video real-time VOD and history playback for implementing embodiment one, comprise video server, SIP client and RTSP client, video server comprises audio-video collection module, audio/video coding module, local memory module and network transmission module, the output of audio-video collection module is connected with the input of audio/video coding module, the output of audio/video coding module is connected with the input of local memory module and the first input end of network transmission module respectively, the local output of memory module is connected with the second input of network transmission module, network transmission module is connected with SIP client and RTSP client respectively.Each module integration of the video server of the present embodiment is on the high definition processor TMS320DM8168 development board of TI company, be integrated with the C674x Floating-point DSP of ARM Cortex-A8 and 1GHz of 1.2GHz, there is very high processing speed, support the HD video of the 1080p of 60 frames per second.
Preferably, audio-video collection module supports 2 road HDMI HD video input interfaces, 4 road 8BIT HD-SDI video input interfaces, 2 road 16BIT HD-SDI video input interfaces, 1 road MIC audio input interface and 1 road LINE audio input interface, and the best result video of audio-video collection module support distinguishes that rate is 1080P60.Audio-video collection module is used for the audio frequency and video analog signal collected to be converted to digital signal, and after carrying out denoising, provides the video data of yuv format and the voice data of PCM form to audio/video coding module 102.In the present invention, also audio, video data is referred to as media stream data or Media Stream.
Preferably, audio/video coding module adopts dual code stream technology, one road video image exports two independently code streams through video encoder, be respectively the subcode stream technology that main bit stream technology that video resolution is 1080P and video resolution are CIF, audio/video coding module supports H264, MEPG4 Video coding and G711, G726, G729 and AAC audio coding, support H264, MEPG4 Video coding, and G711, G726, G729 and AAC audio coding, the audio, video data after coding is delivered to network transmission module by shared drive by audio/video coding module.Preferred employing main bit stream technology, in video server and client transmissions RTP packet procedures, video server periodically sends RTCP bag to client, client receives rear feedback network packet loss quantity, server can according to packet loss size, adjust video frame rate and the code check of main bit stream adaptively, packet loss is controlled all the time in certain threshold range.If network condition is very bad, only adjust the frame per second of main bit stream and code check when can not deal with problems, net transmission module can automatically switch to subcode stream transmission, ensures the fluency of image.
In the present embodiment, after audio/video coding module receives the audio, video data of audio-video collection module, carry out coding work respectively.Yuv video data encoding is become the code stream of H264 or MEPG4 form by video thread, then the empty buffer queue in the queue of video double buffering is sent to, the buffer piling data in empty queue adds full queue in double buffering queue, buffer data in full queue are sent to local memory module or directly pass to network transmission module by shared drive communication mode, are continued to be returned to empty buffer queue by this buffer after data are removed.PCM data encoding is become the code stream of G711, G726, G729 or ACC form by audio frequency thread, then as video data, delivers to the queue of audio frequency double buffering.
Preferably, local memory module comprises local hard drive and/or SD card, and the audio, video data that local memory module is used for audio/video coding module sends is packaged into the media data of PS form and is stored in local hard drive and/or SD card.When video server starts local hold function, local memory module is packaged into the media data of PS form after obtaining the audio, video data after coding from audio/video coding module, and is saved in local SD card and/or hard disk.When network transmission module needs history media data, then by the media file in SD card or local hard drive stored in shared drive.Network transmission module from shared drive sense data, simultaneously local memory module mutual exclusion by data stored in shared drive, such audio, video data just can constantly import into network transmission module from local memory module.
Preferably, the procotol package form of network transmission module is RTP bag.Network transmission module carries out media delivery and playback controls with SIP client or RTSP client respectively by SIP or RTSP agreement, by the code check of the feedback information adaptive regulating video stream of RTCP or select the subcode stream of low resolution to transmit.
As shown in fig. 1, its specific works method can refer to the description of embodiment one to the specific works flow process of network transmission module, and the operation except audio-video collection that in embodiment one, video server performs, is performed by network transmission module substantially.
More than that better enforcement of the present invention is illustrated, but the invention is not limited to embodiment, those of ordinary skill in the art also can make all equivalent variations or replacement under the prerequisite without prejudice to spirit of the present invention, and these equivalent modification or replacement are all included in the application's claim limited range.
Claims (10)
1. a method for HD video real-time VOD and history playback, is characterized in that, comprising:
Step 1, video server receive the connection request that client sends;
Step 2, judge that whether user pond is full, if less than, then judge that the connection request received is based on Session Initiation Protocol or RTSP agreement, and then authentication request is sent to client, on the contrary refusal connection request, disconnect the connection with this client;
Carry out authentication after the authentication information that step 3, reception client return, judge that whether client is by authentication, if, then register this user, connect with client, and then carry out corresponding video request program or history playback operation, otherwise disconnect the connection with this client;
Step 4, according to network quality state, adjust video frame rate, code check adaptively, or be switched to subcode stream from main bit stream;
Step 5, with after client disconnects, nullify this user and reclaim user's groove.
2. the method for a kind of HD video real-time VOD according to claim 1 and history playback, it is characterized in that, judge described in described step 2 that the connection request received is based on Session Initiation Protocol or RTSP agreement, and then send the step of authentication request to client, it is specially:
Judge that the connection request received is based on Session Initiation Protocol or RTSP agreement, if RTSP agreement, then inform the RTSP request type that client video server is supported, and authentication request is sent to client, if otherwise based on Session Initiation Protocol, then direct to client transmission authentication request.
3. the method for a kind of HD video real-time VOD according to claim 1 and history playback, it is characterized in that, described in described step 3, authentication information comprises user name and logs in password, authentication is carried out after the authentication information that described reception client returns, judge client whether by the step of authentication, it is specially:
After the authentication information that reception client returns, MD5 hash algorithm is adopted to carry out computing to the password that logs in authentication information, and then judge the operation values that obtains with store in file system whether consistent with the MD5 value corresponding to the user name of this authentication information, if, then represent that authentication is passed through, otherwise represent that authentication is not passed through.
4. the method for a kind of HD video real-time VOD according to claim 1 and history playback, it is characterized in that, the step of corresponding video request program is carried out described in described step 3, comprise RTSP client program request step and SIP client program request step, described RTSP client program request step, comprising:
S31, RTSP client send the request obtaining media initialize descriptor;
After S32, video server receive the request of RTSP client, send response message and SDP session information to RTSP client, described SDP session information comprises session connection information and Media Stream passage descriptor;
After S33, RTSP client receive response message and SDP conversation message, to the media stream connection request in SDP conversation message;
S34, video server reply response message, set up session with RTSP client;
S35, RTSP client send request the order request of real-time VOD Media Stream;
After S36, video server receive order request, from shared drive, extract Media Stream in real time and send to client after RTP packing is carried out to it, gathering in real time simultaneously and also in shared drive, write media stream data;
S37, RTSP client are carried out decoding and are play after receiving the media stream data of video server transmission;
Described SIP client program request step, comprising:
S41, SIP client send the request of the first SDP information of carrying, and session connection is set up in request, the medium stream information that described first SDP information comprises the IP address of SIP client, port numbers and asks;
After S42, video server receive the request of SIP client, send response message and the second SDP information to SIP client, described second SDP information comprises the IP address of Media Stream, port numbers and media formats;
After S43, SIP client receive response message and the second SDP information, send the confirmation request of carrying received response message, set up session with video server;
After S44, video server receive the confirmation request, from shared drive, extract Media Stream in real time and send to client after RTP packing is carried out to it, gathering in real time simultaneously and also in shared drive, write media stream data;
S45, SIP client are carried out decoding and are play after receiving the media stream data of video server transmission.
5. the method for a kind of HD video real-time VOD according to claim 1 and history playback, it is characterized in that, the step of corresponding history playback operation is carried out described in described step 3, comprise the step of RTSP client request playback history video and the step of SIP client request playback history video, the step of described RTSP client request playback history video, comprising:
S51, RTSP client send the request obtaining media initialize descriptor;
After S52, video server receive the request of RTSP client, send response message and SDP session information to RTSP client, described SDP session information comprises session connection information and Media Stream passage descriptor;
After S53, RTSP client receive response message and SDP conversation message, to the media stream connection request in SDP conversation message;
S54, video server reply response message, set up session with RTSP client;
S55, RTSP client send request the playback request of carrying out history playback controls to video server; Described playback controls comprise video pause, broadcasting, put soon, put slowly and at random drag play in one or more;
After S56, video server receive playback request, the Media Stream after reading encapsulation in real time from local hard drive also sends to RTSP client after carrying out RTP packing in conjunction with playback request to Media Stream;
S57, RTSP client are carried out decoding and are play after receiving the Media Stream of video server transmission;
The step of described SIP client request playback history video, comprising:
S61, SIP client send the request of Three S's DP information of carrying, and session connection is set up in request, the medium stream information that described Three S's DP information comprises the IP address of the beginning of playback and end time and SIP client, port numbers and asks;
After S62, video server receive the request of SIP client, send response message and the 4th SDP information to SIP client, described 4th SDP information comprises the IP address of Media Stream, port numbers and media formats;
After S63, SIP client receive response message and the 4th SDP information, send the confirmation request of carrying received response message, set up session with video server;
After S64, video server receive the confirmation request, judge whether the RTSP solicited message of carrying out history playback controls receiving SIP client transmission in real time, if, then real-time from local hard drive, read encapsulation after Media Stream and send to SIP client after RTP packing being carried out to Media Stream in conjunction with RTSP solicited message, otherwise Media Stream after in real time reading encapsulation from local hard drive send to SIP client after RTP packing is carried out to it;
S65, SIP client are carried out decoding and are play after receiving the Media Stream of video server transmission.
6. the system of a HD video real-time VOD and history playback, it is characterized in that, comprise video server, SIP client and RTSP client, described video server comprises audio-video collection module, audio/video coding module, local memory module and network transmission module, the output of described audio-video collection module is connected with the input of audio/video coding module, the output of described audio/video coding module is connected with the input of local memory module and the first input end of network transmission module respectively, the output of described local memory module is connected with the second input of network transmission module, described network transmission module is connected with SIP client and RTSP client respectively.
7. the system of a kind of HD video real-time VOD according to claim 6 and history playback, it is characterized in that, described audio-video collection module supports 2 road HDMI HD video input interfaces, 4 road 8BIT HD-SDI video input interfaces, 2 road 16BIT HD-SDI video input interfaces, 1 road MIC audio input interface and 1 road LINE audio input interface, and the best result video of described audio-video collection module support distinguishes that rate is 1080P60.
8. the system of a kind of HD video real-time VOD according to claim 6 and history playback, it is characterized in that, described audio/video coding module adopts video resolution to be the main bit stream technology of 1080P and video resolution to be the subcode stream technology of CIF, described audio/video coding module supports H264, MEPG4 Video coding and G711, G726, G729 and AAC audio coding, support H264, MEPG4 Video coding, and G711, G726, G729 and AAC audio coding, audio, video data after coding is delivered to network transmission module by shared drive by described audio/video coding module.
9. the system of a kind of HD video real-time VOD according to claim 6 and history playback, it is characterized in that, described local memory module comprises local hard drive and/or SD card, and the audio, video data that described local memory module is used for audio/video coding module sends is packaged into the media data of PS form and is stored in local hard drive and/or SD card.
10. the system of a kind of HD video real-time VOD according to claim 6 and history playback, is characterized in that, the procotol package form of described network transmission module is RTP bag.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510046242.9A CN104618690B (en) | 2015-01-29 | 2015-01-29 | A kind of method and system of HD video real-time VOD and history playback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510046242.9A CN104618690B (en) | 2015-01-29 | 2015-01-29 | A kind of method and system of HD video real-time VOD and history playback |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104618690A true CN104618690A (en) | 2015-05-13 |
| CN104618690B CN104618690B (en) | 2018-01-05 |
Family
ID=53152949
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510046242.9A Expired - Fee Related CN104618690B (en) | 2015-01-29 | 2015-01-29 | A kind of method and system of HD video real-time VOD and history playback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104618690B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105306967A (en) * | 2015-10-28 | 2016-02-03 | 天彩电子（深圳）有限公司 | Resource allocation method of Cloud video platform |
| CN105338325A (en) * | 2015-11-24 | 2016-02-17 | 浙江宇视科技有限公司 | Surveillance video transmission method and device |
| US9826260B2 (en) | 2014-10-28 | 2017-11-21 | Sercomm Corporation | Video encoding device and video encoding method |
| CN107396191A (en) * | 2017-07-26 | 2017-11-24 | 太仓苏易信息科技有限公司 | A kind of TV online request system |
| CN108111481A (en) * | 2016-11-25 | 2018-06-01 | 佳能株式会社 | Image providing device and image received device, method, system and storage medium |
| CN108989470A (en) * | 2018-08-31 | 2018-12-11 | 杭州当虹科技股份有限公司 | A kind of method of SDIOverIP multiplexing port data |
| CN110071919A (en) * | 2019-04-22 | 2019-07-30 | 南京邮电大学 | A kind of multimedia transmission method based on embedded streaming media technology |
| CN110753243A (en) * | 2019-11-05 | 2020-02-04 | 深圳市巨潮科技股份有限公司 | Image processing method, image processing server and image processing system |
| CN110933514A (en) * | 2019-12-06 | 2020-03-27 | 广州微算互联信息技术有限公司 | Video quality control method and device and computer equipment |
| CN110955636A (en) * | 2018-10-17 | 2020-04-03 | 郑州期米信息技术有限公司 | Three-dimensional panoramic historical market playback method |
| CN107666593B (en) * | 2017-08-28 | 2020-04-21 | 中国电子科技集团公司第二十八研究所 | Video real-time transmission method under fluctuating network environment |
| CN111107445A (en) * | 2018-10-29 | 2020-05-05 | 浙江宇视科技有限公司 | Media protocol stream optimization method and system |
| CN111479122A (en) * | 2020-04-13 | 2020-07-31 | 海信视像科技股份有限公司 | Video playing method, device, equipment and storage medium |
| CN111617466A (en) * | 2020-05-12 | 2020-09-04 | 咪咕文化科技有限公司 | Method and device for determining coding format and method for realizing cloud game |
| CN111641846A (en) * | 2020-05-19 | 2020-09-08 | 深圳力维智联技术有限公司 | Method, device and system for instant playing of security monitoring video |
| CN111988585A (en) * | 2020-08-17 | 2020-11-24 | 海宇星联(山东)智慧科技有限公司 | Intelligent video transmission protocol suitable for satellite data communication network |
| WO2023071277A1 (en) * | 2021-10-29 | 2023-05-04 | 中国电信股份有限公司 | Video transmission method and system, and related device |
| CN116886953A (en) * | 2023-09-06 | 2023-10-13 | 湖南马栏山视频先进技术研究院有限公司 | Cloud storage video data protection system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1805356A (en) * | 2006-01-20 | 2006-07-19 | 华南理工大学 | Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method |
| US20070121678A1 (en) * | 2005-11-30 | 2007-05-31 | Brooks Paul D | Apparatus and methods for utilizing variable rate program streams in a network |
| CN101674317A (en) * | 2009-10-13 | 2010-03-17 | 尹绍华 | RTSP-based method for accessing a plurality of terminals, streaming media server and system thereof |
| CN101917391A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Method for playing network video and system for playing network video |
-
2015
- 2015-01-29 CN CN201510046242.9A patent/CN104618690B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070121678A1 (en) * | 2005-11-30 | 2007-05-31 | Brooks Paul D | Apparatus and methods for utilizing variable rate program streams in a network |
| CN1805356A (en) * | 2006-01-20 | 2006-07-19 | 华南理工大学 | Embedded Linux multimedia signal acquisition and processing apparatus and its transmission method |
| CN101674317A (en) * | 2009-10-13 | 2010-03-17 | 尹绍华 | RTSP-based method for accessing a plurality of terminals, streaming media server and system thereof |
| CN101917391A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Method for playing network video and system for playing network video |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9826260B2 (en) | 2014-10-28 | 2017-11-21 | Sercomm Corporation | Video encoding device and video encoding method |
| CN105306967A (en) * | 2015-10-28 | 2016-02-03 | 天彩电子（深圳）有限公司 | Resource allocation method of Cloud video platform |
| CN105338325A (en) * | 2015-11-24 | 2016-02-17 | 浙江宇视科技有限公司 | Surveillance video transmission method and device |
| CN105338325B (en) * | 2015-11-24 | 2019-04-12 | 浙江宇视科技有限公司 | A kind of monitor video transmission method and device |
| CN108111481A (en) * | 2016-11-25 | 2018-06-01 | 佳能株式会社 | Image providing device and image received device, method, system and storage medium |
| CN107396191A (en) * | 2017-07-26 | 2017-11-24 | 太仓苏易信息科技有限公司 | A kind of TV online request system |
| CN107666593B (en) * | 2017-08-28 | 2020-04-21 | 中国电子科技集团公司第二十八研究所 | Video real-time transmission method under fluctuating network environment |
| CN108989470A (en) * | 2018-08-31 | 2018-12-11 | 杭州当虹科技股份有限公司 | A kind of method of SDIOverIP multiplexing port data |
| CN110955636A (en) * | 2018-10-17 | 2020-04-03 | 郑州期米信息技术有限公司 | Three-dimensional panoramic historical market playback method |
| CN110955636B (en) * | 2018-10-17 | 2023-05-16 | 郑州期米信息技术有限公司 | Stereoscopic panoramic historical market playback method |
| CN111107445A (en) * | 2018-10-29 | 2020-05-05 | 浙江宇视科技有限公司 | Media protocol stream optimization method and system |
| CN111107445B (en) * | 2018-10-29 | 2023-04-18 | 浙江宇视科技有限公司 | Media protocol stream optimization method and system |
| CN110071919A (en) * | 2019-04-22 | 2019-07-30 | 南京邮电大学 | A kind of multimedia transmission method based on embedded streaming media technology |
| CN110753243A (en) * | 2019-11-05 | 2020-02-04 | 深圳市巨潮科技股份有限公司 | Image processing method, image processing server and image processing system |
| CN110933514A (en) * | 2019-12-06 | 2020-03-27 | 广州微算互联信息技术有限公司 | Video quality control method and device and computer equipment |
| CN111479122A (en) * | 2020-04-13 | 2020-07-31 | 海信视像科技股份有限公司 | Video playing method, device, equipment and storage medium |
| CN111479122B (en) * | 2020-04-13 | 2022-12-06 | 海信视像科技股份有限公司 | Video playing method, device, equipment and storage medium |
| CN111617466A (en) * | 2020-05-12 | 2020-09-04 | 咪咕文化科技有限公司 | Method and device for determining coding format and method for realizing cloud game |
| CN111641846A (en) * | 2020-05-19 | 2020-09-08 | 深圳力维智联技术有限公司 | Method, device and system for instant playing of security monitoring video |
| CN111988585B (en) * | 2020-08-17 | 2022-04-29 | 海宇星联(山东)智慧科技有限公司 | Video transmission method suitable for satellite data communication network |
| CN111988585A (en) * | 2020-08-17 | 2020-11-24 | 海宇星联(山东)智慧科技有限公司 | Intelligent video transmission protocol suitable for satellite data communication network |
| WO2023071277A1 (en) * | 2021-10-29 | 2023-05-04 | 中国电信股份有限公司 | Video transmission method and system, and related device |
| CN116886953A (en) * | 2023-09-06 | 2023-10-13 | 湖南马栏山视频先进技术研究院有限公司 | Cloud storage video data protection system |
| CN116886953B (en) * | 2023-09-06 | 2023-11-24 | 湖南马栏山视频先进技术研究院有限公司 | Cloud storage video data protection system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104618690B (en) | 2018-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104618690A (en) | Method and system for real-time on-demand and historical playback of high-definition video | |
| US10791261B2 (en) | Interactive video conferencing | |
| US10165226B2 (en) | Interactive video conferencing | |
| CN103237191B (en) | The method of synchronized push audio frequency and video in video conference | |
| US20140139735A1 (en) | Online Media Data Conversion Method, Online Video Playing Method and Corresponding Device | |
| EP2919436B1 (en) | Apparatus for processing streaming media service | |
| US10477282B2 (en) | Method and system for monitoring video with single path of video and multiple paths of audio | |
| CN106941629B (en) | Real-time live broadcast method based on SIP + RTP and RTMP protocol intercommunication | |
| US8959240B2 (en) | Method, apparatus and system for rapid acquisition of multicast realtime transport protcol sessions | |
| CN106817628B (en) | Network live broadcast platform | |
| CN104427400A (en) | Streaming media transmission method and system, and streaming media server | |
| US20130060958A1 (en) | Method and apparatus for playing back recorded content in wireless communication system | |
| CN102833585A (en) | System and method for transmitting ubiquitous terminal video | |
| US9705935B2 (en) | Efficient interworking between circuit-switched and packet-switched multimedia services | |
| CN107465679A (en) | A kind of streaming media control method | |
| KR101164746B1 (en) | System and method for compensating consecutive palyback delay of video playback service based on real-time streaming protocol | |
| CN111479122B (en) | Video playing method, device, equipment and storage medium | |
| JP4917497B2 (en) | Video distribution device, distribution video switching method, distribution video switching program, and distribution video switching program recording medium | |
| WO2012041028A1 (en) | Method, correlative equipment and system for bidirectional hybrid fiber-coaxial (hfc) network based video conference | |
| US20070073885A1 (en) | Device and method for handling media server overloading | |
| CN102883129A (en) | Method and terminal for video communication | |
| Brindha et al. | Security Protocol for Multimedia Streaming | |
| WO2024064005A1 (en) | Automatic generation of video content in response to network interruption | |
| CN116156105A (en) | Network camera access method and platform for intelligently accessing multiple protocols | |
| KR100999224B1 (en) | System and method for producing importance rate-based media, and server applied to the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180105 Termination date: 20200129 |