Embodiment
Below in conjunction with accompanying drawing the present invention is described in further detail.
Fig. 1 illustrates the system topological figure that is used to realize video playback according to one aspect of the invention, comprising the network equipment 2 and a plurality of subscriber equipment 1 that is connected via network with it.Wherein, a plurality of subscriber equipmenies 1 and the network equipment 2 are connected via network, and subscriber equipment 1 sends the video access requests to the network equipment 2; The network equipment 2 receives this video access request; Obtain and the corresponding video flowing of this video access request; This video flowing is sent to subscriber equipment 1; Subscriber equipment 1 receives this video flowing, this video flowing is carried out decapsulation handle, and obtains one or more coding unit sequence flows; This coding unit sequence flows of decodes and plays.At this, network includes but not limited to the Internet, wide area network, metropolitan area network, local area network (LAN), VPN network, wireless self-organization network (Ad Hoc network) etc.
In addition; Subscriber equipment 1 can be any electronic product that can implant embedded system and can carry out man-machine interaction through modes such as keyboard, mouse, remote controller, touch-screen or hand-written equipment with the user, for example STB, Web TV, mobile phone, PDA, palmtop PC PPC or panel computer etc.The network equipment 2 includes but not limited to network host, single network server, a plurality of webserver collection or based on the set of computers of cloud computing.Communicating by letter between the network equipment 2 and a plurality of subscriber equipmenies 1 is separate, can be based on the packet data transmission such as ICP/IP protocol, udp protocol etc.
Those skilled in the art will be understood that the above-mentioned network equipment 2, subscriber equipment 1 and the network and the communication mode that connect therebetween are merely for example; Other network equipments existing or that possibly occur from now on, subscriber equipment, network or communication mode are as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Those skilled in the art also will be understood that; The quantity that is merely the disparate networks element that illustrates for simplicity among Fig. 1 maybe be less than the quantity in the real network, but this omission far and away with can not influence to the present invention carry out clear, be disclosed as prerequisite fully.
For for simplicity, be that example is described with a subscriber equipment 1 below.Those skilled in the art will be understood that; The network equipment 2 is can be simultaneously mutual with a plurality of subscriber equipment 1; And, these video flowings are sent to different user equipment 1 according to the video access acquisition request and the corresponding video flowing of these video access requests that receive from different subscriber equipmenies 1; Corresponding number of users equipment 1 receives corresponding video flowing, and these video flowing decapsulations are handled, and obtains a plurality of coding unit sequence flows, and these coding unit sequence flows of decodes and plays.
Fig. 2 is the method flow diagram according to one aspect of the invention, subscriber equipment is shown cooperates the process that is used to realize video playback with the network equipment.Wherein, subscriber equipment 1 is connected with the network equipment 2 via network, and both cooperations realize the process of video playback.
Particularly, in step S1, user and subscriber equipment 1 carry out man-machine interaction, and subscriber equipment 1 obtains user's operation, like program selection, Play Control etc.For example, subscriber equipment 1 can obtain in real time user's selection operation for video icon on subscriber equipment 1 with the interactive device that the user carries out man-machine interaction through any.This interactive device can be keyboard, mouse, remote controller, touch-screen or voice-operated device etc.With the remote controller is example; As the user through the client software on the subscriber equipment 1 or browser software in its user interface; Be the interface that current operating remote controller acts on,, choose this video icon through pushing " affirmation " key through the position at the cursor on the remote controller moving screen to video icon place; Subscriber equipment 1 obtains this user's operation in real time through for example information such as operating remote controller position, video access request.Those skilled in the art will be understood that above-mentioned user's operation and obtain manner thereof are merely for example; Other users existing or that possibly occur from now on operations and obtain manner thereof are as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
In step S2, subscriber equipment 1 sends the video access request to the network equipment 2.Particularly, in step S2, subscriber equipment 1 is hoped the video file of visiting according to the user, for example operates through its user who in step S1, obtains and confirms the pairing video file of this operation, to the corresponding video access request of the network equipment 2 transmissions; Correspondingly, the network equipment 2 is received from the video access request that subscriber equipment 1 sends.For example, subscriber equipment 1 obtains the user and operates pairing video file for " dare-to-die corps ", and the video access request of sending " dare-to-die corps " to the network equipment 2.Corresponding, the network equipment 2 receives the video access request of being somebody's turn to do " dare-to-die corps " that subscriber equipment 1 sends.At this; Subscriber equipment 1 network equipment 2 sends the video access request mode and includes but not limited to; Call the application programming interfaces (API) that the network equipment 2 provides or the communication mode of other agreements through one or many; Like video access request, this video access request is sent to the network equipment 2 based on http, https.At this, the video access request can be based on synchronous blocking model, also can be based on asynchronous unblock model.Those skilled in the art will be understood that above-mentioned transmission video access request mode is merely for example; Other transmission video access request mode existing or that possibly occur from now on are as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
In step S3, subscriber equipment 1 is received from the video flowing based on said video access request that the network equipment 2 sends.Particularly; The network equipment 2 is according to the video access request of in step S2, sending from user's equipment 1 of its reception; Obtain corresponding video flowing, and this video flowing is sent to subscriber equipment 1, for example be sent to subscriber equipment 1 through Data Transport Protocols such as RTSP, HTTP, FTP, P2P; Correspondingly, subscriber equipment 1 receives this video flowing.With the P2P mode is example; Subscriber equipment 1 receives multi-path video stream from the network equipment 2; These multi-path video streams comprise the for example video flowing of separate sources; A plurality of fragment video flowings of a film of separate sources, subscriber equipment 1 carries out ensuing each step to the fragment video flowing of specific video stream or special time more then.At this; Those skilled in the art will be understood that above-mentioned Data Transport Protocol is merely for example; Other Data Transport Protocols existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.At this; The mode that the network equipment 2 obtains video flowing includes but not limited to; Can obtain video flowing with the third party device that the network equipment 2 is communicated by letter from the server of the storage device of the network equipment 2 itself, content supplier, third-party server or other; Wherein, the server of content supplier or third-party server comprise web server and streaming media server.For example; Subscriber equipment 1 is operated according to the user and is confirmed that this user operates corresponding video file; Send the video access request corresponding to the network equipment 2 with this video file; After the network equipment 2 receives this video access request,, obtain and this corresponding video flowing in URL address according to the URL address in this video access request.Those skilled in the art will be understood that the obtain manner of above-mentioned video flowing is merely for example; The obtain manner of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
In step S4,1 pair of said video flowing of subscriber equipment carries out decapsulation to be handled, to obtain one or more coding unit sequence flows.Particularly, in step S4, subscriber equipment 1 is carried out corresponding decapsulation and is used, to obtain one or more coding unit sequence flows according to the encapsulation format of the video flowing of its reception.For example, subscriber equipment 1 is used through calling (calling or far call like this locality) or loading and call corresponding decapsulation, the decapsulation video flowing, thus obtain the one or more coding unit sequence flows (like the sample sequence flows) after this video flowing decapsulation.For example; Suppose to have in the subscriber equipment 1 decapsulation application corresponding to the encapsulation format of video flowing; Subscriber equipment 1 just directly calls and (perhaps loads and call so; If having stored this decapsulation in the subscriber equipment 1 uses) this decapsulation uses, thus this video flowing of decapsulation and obtain the one or more coding unit sequence flows in this video flowing.For another example; Supposing does not have the decapsulation application corresponding to the encapsulation format of video flowing in the subscriber equipment 1; Subscriber equipment 1 obtains this decapsulation application from outside (network or other equipment) so; Load and call this decapsulation and use,, obtain the one or more coding unit sequence flows in this video flowing with this video flowing of decapsulation.And for example; Supposing does not have the decapsulation application corresponding to the encapsulation format of video flowing in the subscriber equipment 1; Subscriber equipment 1 is used from this decapsulation of outside (network or other equipment) far call so, with this video flowing of decapsulation, obtains the one or more coding unit sequence flows in this video flowing.Those skilled in the art will be understood that the above-mentioned several kinds of modes of calling the decapsulation application are merely for example; Other existing or calling of possibly occurring from now on modes that decapsulation uses are as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
In step S5, the said one or more coding unit sequence flows of subscriber equipment 1 decodes and plays.Particularly; In step S5; Subscriber equipment 1 is decoded to the coding unit sequence flows that it obtains after decapsulation in step S4, then according to voice data and/or video data in this coding unit sequence flows of the temporal information synchronous playing in this coding unit sequence flows.For example, subscriber equipment 1 decompresses the coding unit sequence flows of its acquisition, from the temporal information of coding unit sequence flows, obtains the timestamp of voice data and video data, realizes the synchronous playing of voice data and video data then according to this timestamp.Those skilled in the art will be understood that the method for synchronization of above-mentioned voice data and video data is merely for example; The method of synchronization of other voice datas existing or that possibly occur from now on and video data is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.At this, this decodes and plays operation both can be carried out through decoder (chip), also can carry out through decoding software.And; This decodes and plays operation can be accomplished on one or more decoders and/or decoding software; For example, subscriber equipment 1 is directed into a plurality of decoders and/or decoding software with said one or more decoding unit sequence flows, to realize the decodes and plays output of multichannel.Those skilled in the art will be understood that also above-mentioned decodes and plays mode is merely for example, and other decodes and plays modes existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
Preferably, step S2, step S3, step S4 and step S5 are constant work.Particularly, subscriber equipment 1 in step S2, sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; In step S3, be received from the video flowing that the network equipment 2 sends based on said video access request; In step S4, said video flowing is carried out decapsulation handle, to obtain one or more coding unit sequence flows; In step S5, the said coding unit sequence flows of decodes and plays.At this; It will be understood by those skilled in the art that " continuing " is meant that subscriber equipment 1 requires to carry out the transmission of video access request respectively according to mode of operation that set or adjustment in real time at step S2, step S3, step S4 and step S5; Receiver, video stream; Video flowing is carried out decapsulation with acquisition coding unit sequence flows, and decodes and plays coding unit sequence flows, stop in a long time carrying out user's operation until this user through subscriber equipment 1.
Among the step S6, user and subscriber equipment 1 are further mutual.This time user and subscriber equipment 1 will start the work according to step S2, step S3, step S4 and step S5 of new round subscriber equipment 1 and the network equipment 2 alternately.
In a preferred embodiment, this process also comprises step S7 (not shown), and subscriber equipment 1 distributes buffer memory in subscriber equipment 1 in step S7; Subsequently, in step S2, subscriber equipment 1 sends the video access request to the network equipment 2; In step S3, subscriber equipment 1 receives the video flowing based on this video access request that the network equipment 2 sends, and said video flowing is stored in the said buffer memory.Particularly, subscriber equipment 1 distributed a certain size buffer memory in subscriber equipment 1 before sending corresponding video access request to the network equipment 2; Subsequently, subscriber equipment 1 sends the video access request to the network equipment 2, waits for the response of the network equipment 2, receives the video flowing that the network equipment 2 sends then, and this video flowing is stored in the buffer memory.For example; For smooth network shake, subscriber equipment 1 has distributed the buffer memory of 20M therein for video flowing, so that subscriber equipment 1 displaying video is when flowing; Can preserve a certain amount of video flowing in the buffer memory; Send the video access request to the network equipment 2 then, receive the corresponding video flowing that the network equipment 2 sends, the video flowing with a certain amount of (being no more than 20M) is stored in this buffer memory again; And when subscriber equipment 1 reads the video flowing in this buffer memory, receive the further part of this video flowing of the network equipment 2 transmissions.
Preferably, step S7, step S2, step S3, step S4 and step S5 are constant work.Particularly, subscriber equipment 1 in step S7, distributes buffer memory in subscriber equipment 1; In step S2, send the video access request to the network equipment 2, correspondingly, the network equipment 2 receives said video access request; In step S3, subscriber equipment 1 receive the network equipment 2 that send with the corresponding video flowing of said video access request; Next, subscriber equipment 1 in step S4, carries out decapsulation to said video flowing and handles, to obtain one or more coding unit sequence flows; In step S5, the said coding unit sequence flows of decodes and plays.At this; It will be understood by those skilled in the art that " continuing " is meant that subscriber equipment 1 requires to carry out the distribution of buffer memory according to mode of operation that set or adjustment in real time respectively at step S8, step S2, step S3, step S4 and step S5; The transmission of video access request, the reception of video flowing, the decapsulation of video flowing is to obtain the coding unit sequence flows; And the decodes and plays of coding unit sequence flows, stop in a long time carrying out user's operation until this user through subscriber equipment 1.
More preferably be that in step S7, subscriber equipment 1 also according to said buffer memory, is provided with cache-time.Particularly, in step S7, subscriber equipment 1 also is provided with cache-time according to the cache size of being distributed.If the time of the video flowing in the buffer memory, 1 of subscriber equipment was in buffer status less than cache-time; If the time of the video flowing in the buffer memory, 1 of subscriber equipment was in broadcast state greater than cache-time.For example, suppose that cache-time is 3S, if the time of the video flowing in the buffer memory is 5S, then subscriber equipment 1 is in broadcast state; If the time of the video flowing in the buffer memory is 1S, then 1 of subscriber equipment is in buffer status.
In a further advantageous embodiment, this process also comprises step S8 (not shown), in step S8, and the video information request that subscriber equipment 1 sends about the corresponding video flowing of said video access request to the network equipment 2; Correspondingly, subscriber equipment 1 is received from the video information based on said video information request that the network equipment 2 sends; Subscriber equipment 1 is according to said video information configure user equipment 1.Subsequently, in step S3, subscriber equipment 1 is received from the said video flowing that the network equipment 2 sends.Particularly, in step S8, the video information request that subscriber equipment 1 sends about the corresponding video flowing of said video access request to the network equipment 2; Correspondingly, the network equipment 2 is received from the video information request about the corresponding video flowing of said video access request that subscriber equipment 1 sends, and according to said video information request, obtains the video information of said video flowing, sends said video information to subscriber equipment 1; Correspondingly, subscriber equipment 1 is received from the video information based on said video information request that the network equipment 2 sends; Subscriber equipment 1 is according to said video information configure user equipment 1.Subsequently, in step S3, subscriber equipment 1 is received from the said video flowing that the network equipment 2 sends.At this; This video information request both can be sent to the network equipment 2 with video access request (corresponding step S2) " simultaneously "; For example; In some fields of the corresponding packet of video access request, comprise content simultaneously, perhaps send between the video flowing based on this video access request (being step S3) of this video access request (being step S2) and 2 transmissions of the reception network equipment, this video information request is sent to the network equipment 2 at subscriber equipment 1 about the video information request.Correspondingly, the network equipment 2 receives this video information request, and after the video flowing that obtains subscriber equipment 1 request; Further obtain the video information of video flowing, for example, the quantity of video flowing; The information of every road stream, total duration of video flowing, the size of video image etc.Those skilled in the art will be understood that also the send mode of above-mentioned video information request is merely for example; The send mode of other video information requests existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, this video information comprises but is not limited to, in the following at least each: the 1) quantity of video flowing; 2) format information of video flowing; 3) the total duration of the video of video flowing; 4) the video image size of video flowing; 5) the AVC configuration data of video flowing.Wherein, the quantity of video flowing is the quantity corresponding to the video flowing of video access request that the automatic network equipment that receives of subscriber equipment 12 sends; The format information of video flowing comprises the type of video flowing, the descriptor of video flowing etc.; The total duration of the video of video flowing is the complete duration of video flowing; The video image size of video flowing comprises the wide, high of video image; The AVC configuration data of video flowing comprises bit rate mode, quality mode, data length etc.Those skilled in the art will be understood that above-mentioned video information is merely for example, and other video informations existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
More preferably, the format information of video flowing includes but not limited to, in the following at least each: 1) the basic format information of video flowing; 2) the expansion format information of video flowing.Those skilled in the art will be understood that the format information of above-mentioned video flowing is merely for example; The format information of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
More preferably, the basic format information of video flowing includes but not limited to, in the following at least each: the 1) fundamental type of video flowing, for example video, audio frequency; 2) subtype of video flowing, for example H264, AAC etc.; 3) the decoding configuration information of video flowing, for example content of the length of the type of configuration data, configuration data, configuration data etc.Those skilled in the art will be understood that the basic format information of above-mentioned video flowing is merely for example; The basic format information of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
More preferably, the expansion format information of video flowing include but not limited in the following at least each: 1) the audio description information of video flowing, for example sampling bit wide of audio track quantity, audio sample rate, audio frequency etc.; 2) the video presentation information of video flowing, for example picture traverse, picture altitude, video frame rate etc.Those skilled in the art will be understood that the expansion format information of above-mentioned video flowing is merely for example; The expansion format information of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, step S2, step S3, step S4, step S5 and step S8 are constant work.Particularly, subscriber equipment 1 in step S2, sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Next, in step S8, the video information request to the network equipment 2 sends this video flowing correspondingly, receives this video information, and according to this video information configure user equipment 1; In step S3, subscriber equipment 1 receives and the corresponding video flowing of said video access request; Next, subscriber equipment 1 in step S4, carries out decapsulation to said video flowing and handles, to obtain one or more coding unit sequence flows; In step S5, the said coding unit sequence flows of decodes and plays.At this; It will be understood by those skilled in the art that " continuing " is meant that subscriber equipment 1 requires to carry out the transmission of video access request respectively according to mode of operation that set or adjustment in real time at step S2, step S3, step S4, step S5 and step S8; The request of video information receives and carries out the configuration of subscriber equipment 1 according to it; The reception of video flowing; The decapsulation of video flowing is with acquisition coding unit sequence flows, and the decodes and plays of coding unit sequence flows, stops in a long time carrying out user's operation through subscriber equipment 1 until this user.
Preferably, at step S4, subscriber equipment 1 also carries out decapsulation to said video flowing to be handled, to obtain one or more coding unit sequence flows and extend information thereof.Particularly, in step S4, subscriber equipment 1 carries out decapsulation through the video flowing that automatic network equipment 2 is received to be handled, and not only obtains coding unit sequence flows in the video flowing, also obtains the extend information of coding unit sequence flows.At this, this extend information includes but not limited to: the numbering of coding unit, timestamp, data length, reproduction time, whether be key frame, and whether continuous etc. with a last coding unit.Those skilled in the art will be understood that above-mentioned extend information is merely for example, and other extend informations existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
In a preferred embodiment again; This process also comprises step S9 (not shown); Subscriber equipment 1 obtains the statistical information of said video access request, and wherein, statistical information includes but not limited to; In the following at least each: the time that 1) broadcast state, the data in for example not startup, normal play, buffering, tentative, play percentage, the buffer memory can be supported to play etc.; 2) download statistics, for example the byte number, the Http that download of the zero hour, the byte number of downloading altogether, the byte number of uploading altogether, Http downloads number, byte number, the byte number of P2P long pass, P2P that P2P downloads and downloads number, resource number, altogether the Cache request of uploading number, long pass Cache hits altogether that candidate P2P downloads, downloads and continue duration etc. altogether; 3) speed of download, for example current speed of download (5S statistics, 20S statistics), current uploading speed (5S statistics, 20S statistics), one-minute average speed of download, one-minute average uploading speed, historical average speed of download, historical average uploading speed, the speed of download of current 1S, the uploading speed of current 1S etc. recently recently.Those skilled in the art will be understood that above-mentioned statistical information is merely for example, and other statistical informations existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
Especially, step S9 and step S2, step S3, step S4 and step S5 are not sequential workings, but can concurrent working.Particularly, subscriber equipment 1 in step S2, sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Next, in step S3, subscriber equipment 1 be received from that the network equipment 2 sends with the corresponding video flowing of said video access request; Next, subscriber equipment 1 in step S4, carries out decapsulation to said video flowing and handles, to obtain one or more coding unit sequence flows; In step S5, the said coding unit sequence flows of decodes and plays; Therewith the process while, step S9 also in work, obtains the statistical information of said video access request, stops in a long time carrying out user's operation through subscriber equipment 1 until this user.
Preferably, this process also comprises step S10 (not shown), and subscriber equipment 1 cuts out said video access request.Particularly, for example when the user closed video flowing, subscriber equipment 1 cut out and the corresponding video access request of this video flowing, stopped reception, decapsulation and the decodes and plays of this video flowing, and discharged the resource of internal memory that is distributed and the subscriber equipment 1 that takies.For example, the active user is watching film " steal dream space ", the user click on the movie interface stop or during X button, subscriber equipment 1 correspondingly cuts out and " stealing the dream space " corresponding video access request, and discharges relevant system resource.
More preferably, step S2, step S3, step S4, step S5 and step S10 are constant work.Particularly, subscriber equipment 1 in step S2, sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Next, in step S3, subscriber equipment 1 be received from that the network equipment 2 sends with the corresponding video flowing of said video access request; Next, subscriber equipment 1 in step S4, carries out decapsulation to said video flowing and handles, to obtain one or more coding unit sequence flows; In step S5, the said coding unit sequence flows of decodes and plays; In step S10, subscriber equipment 1 cuts out the video access request.At this; It will be understood by those skilled in the art that " continuing " is meant that subscriber equipment 1 requires to carry out the transmission of video access request respectively according to mode of operation that set or adjustment in real time at step S2, step S3, step S4, step S5 and step S10; Obtaining of video flowing, the decapsulation of video flowing is to obtain coding unit sequence flows, the decodes and plays of coding unit sequence flows; And the closing of video access request, stop in a long time carrying out user's operation until this user through subscriber equipment 1.
Fig. 3 is an equipment sketch map according to a further aspect of the present invention, and the subscriber equipment and the network equipment that are used to realize video playback are shown.Wherein, subscriber equipment 1 is connected with the network equipment 2 via network, and both cooperations realize the process of video playback.
Particularly, subscriber equipment 1 comprises dispensing device 11, receiving system 12, de-encapsulating devices 13 and decoding device 14.
Dispensing device 11 is used for sending the video access request to the network equipment 2.Particularly, dispensing device 11 is hoped the video file of visiting according to the user, for example, operates according to the user and to confirm the pairing video file of this operation, to the corresponding video access request of the network equipment 2 transmissions; Correspondingly, the network equipment 2 is received from the video access request of dispensing device 11 transmissions of subscriber equipment 1.For example, subscriber equipment 1 obtains the user and operates pairing video file for " dare-to-die corps ", the video access request that dispensing device 11 sends " dare-to-die corps " to the network equipment 2.Corresponding, the network equipment 2 receives the video access request of being somebody's turn to do " dare-to-die corps " that subscriber equipment 1 sends.At this; Subscriber equipment 1 network equipment 2 sends the video access request mode and includes but not limited to; Call the application programming interfaces (API) that the network equipment 2 provides or the communication mode of other agreements through one or many; Like video access request, this video access request is sent to the network equipment 2 based on http, https.At this, the video access request can be based on synchronous blocking model, also can be based on asynchronous unblock model.Those skilled in the art will be understood that above-mentioned transmission video access request mode is merely for example; Other transmission video access request mode existing or that possibly occur from now on are as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Receiving system 12 is used to be received from the video flowing based on said video access request that the network equipment 2 sends.Particularly; The network equipment 2 is according to the video access request of sending from the dispensing device of user's equipment 1 11 of its reception; Obtain corresponding video flowing, and this video flowing is sent to subscriber equipment 1, for example be sent to subscriber equipment 1 through Data Transport Protocols such as RTSP, HTTP, FTP, P2P; Correspondingly, the receiving system 12 of subscriber equipment 1 receives this video flowing.With the P2P mode is example; Receiving system 12 receives multi-path video stream from the network equipment 2; These multi-path video streams comprise the for example video flowing of separate sources; A plurality of fragment video flowings of a film of separate sources, subscriber equipment 1 carries out ensuing each step to the fragment video flowing of specific video stream or special time more then.At this; Those skilled in the art will be understood that above-mentioned Data Transport Protocol is merely for example; Other Data Transport Protocols existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.At this; The mode that the network equipment 2 obtains video flowing includes but not limited to; Can obtain video flowing with the third party device that the network equipment 2 is communicated by letter from the server of the storage device of the network equipment 2 itself, content supplier, third-party server or other; Wherein, the server of content supplier or third-party server comprise web server and streaming media server.For example; Subscriber equipment 1 is operated according to the user and is confirmed that this user operates corresponding video file; Send the video access request corresponding to the network equipment 2 with this video file; After the network equipment 2 receives this video access request,, obtain and this corresponding video flowing in URL address according to the URL address in this video access request.Those skilled in the art will be understood that the obtain manner of above-mentioned video flowing is merely for example; The obtain manner of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
De-encapsulating devices 13 is used for that said video flowing is carried out decapsulation and handles, to obtain one or more coding unit sequence flows.Particularly, de-encapsulating devices 13 is carried out corresponding decapsulation and is used, to obtain one or more coding unit sequence flows according to the encapsulation format of the video flowing of receiving system 12 receptions.For example, de-encapsulating devices 13 is used through calling (calling or far call like this locality) or loading and call corresponding decapsulation, the decapsulation video flowing, thus obtain the one or more coding unit sequence flows (like the sample sequence flows) after this video flowing decapsulation.For example; Suppose to have in the subscriber equipment 1 decapsulation application corresponding to the encapsulation format of video flowing; De-encapsulating devices 13 just directly calls and (perhaps loads and call so; If having stored this decapsulation in the subscriber equipment 1 uses) this decapsulation uses, thus this video flowing of decapsulation and obtain the one or more coding unit sequence flows in this video flowing.For another example; Supposing does not have the decapsulation application corresponding to the encapsulation format of video flowing in the subscriber equipment 1; De-encapsulating devices 13 obtains this decapsulation application from outside (network or other equipment) so; Load and call this decapsulation and use,, obtain the one or more coding unit sequence flows in this video flowing with this video flowing of decapsulation.And for example; Supposing does not have the decapsulation application corresponding to the encapsulation format of video flowing in the subscriber equipment 1; De-encapsulating devices 13 is used from this decapsulation of outside (network or other equipment) far call so; With this video flowing of decapsulation, obtain the one or more coding unit sequence flows in this video flowing.Those skilled in the art will be understood that the above-mentioned several kinds of modes of calling the decapsulation application are merely for example; Other existing or calling of possibly occurring from now on modes that decapsulation uses are as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Decoding device 14 is used for the said one or more coding unit sequence flows of decodes and plays.Particularly, the coding unit sequence flows that obtains after 14 pairs of de-encapsulating devices 13 decapsulations of decoding device is decoded, then according to voice data and/or video data in this coding unit sequence flows of the temporal information synchronous playing in this coding unit sequence flows.For example; Decoding device 14 decompresses the coding unit sequence flows that de-encapsulating devices 13 obtains; From the temporal information of coding unit sequence flows, obtain the timestamp of voice data and video data, realize the synchronous playing of voice data and video data then according to this timestamp.Those skilled in the art will be understood that the method for synchronization of above-mentioned voice data and video data is merely for example; The method of synchronization of other voice datas existing or that possibly occur from now on and video data is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.At this, this decodes and plays operation both can be carried out through decoder (chip), also can carry out through decoding software.And; This decodes and plays operation can be accomplished on one or more decoders and/or decoding software; For example, subscriber equipment 1 is directed into a plurality of decoders and/or decoding software with said one or more decoding unit sequence flows, to realize the decodes and plays output of multichannel.Those skilled in the art will be understood that also above-mentioned decodes and plays mode is merely for example, and other decodes and plays modes existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
Preferably, dispensing device 11, receiving system 12, de-encapsulating devices 13 and decoding device 14 are constant work.Particularly, dispensing device 11 sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Receiving system 12 is received from the video flowing based on said video access request that the network equipment 2 sends; 13 pairs of said video flowings of de-encapsulating devices carry out decapsulation to be handled, to obtain one or more coding unit sequence flows; The said coding unit sequence flows of decoding device 14 decodes and plays.At this; It will be understood by those skilled in the art that " continuing " is meant that dispensing device 11, receiving system 12, de-encapsulating devices 13 and decoding device 14 require to carry out the transmission of video access request respectively according to mode of operation that set or adjustment in real time; Receiver, video stream; Video flowing is carried out decapsulation with acquisition coding unit sequence flows, and decodes and plays coding unit sequence flows, stop in a long time carrying out user's operation until this user through subscriber equipment 1.
In a preferred embodiment, subscriber equipment 1 also comprises the distributor (not shown), in subscriber equipment 1, distributes buffer memory; Subsequently, dispensing device 11 sends the video access request to the network equipment 2; Receiving system 12 receives the video flowing based on this video access request that the network equipment 2 sends, and said video flowing is stored in the said buffer memory.Particularly, the dispensing device 11 of subscriber equipment 1 is before sending corresponding video access request to the network equipment 2, and distributor distributes a certain size buffer memory earlier in subscriber equipment 1; Subsequently, dispensing device 11 sends the video access request to the network equipment 2, waits for the response of the network equipment 2, and receiving system 12 receives the video flowing that the network equipment 2 sends then, and this video flowing is stored in the buffer memory.For example; For smooth network shake, distributor has distributed the buffer memory of 20M for video flowing in subscriber equipment 1, so that subscriber equipment 1 displaying video is when flowing; Can preserve a certain amount of video flowing in the buffer memory; Dispensing device 11 sends the video access request to the network equipment 2 then, and receiving system 12 receives the corresponding video flowing that the network equipment 2 sends, and the video flowing with a certain amount of (being no more than 20M) is stored in this buffer memory again; And when subscriber equipment 1 read the video flowing in this buffer memory, receiving system 12 received the further part of this video flowing of the network equipment 2 transmissions.
Preferably, distributor, dispensing device 11, receiving system 12, de-encapsulating devices 13 and decoding device 14 are constant work.Particularly, distributor distributes buffer memory in subscriber equipment 1; Dispensing device 11 sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Receiving system 12 receive the network equipments 2 that send with the corresponding video flowing of said video access request; Next, 13 pairs of said video flowings of de-encapsulating devices carry out decapsulation to be handled, to obtain one or more coding unit sequence flows; The said coding unit sequence flows of decoding device 14 decodes and plays.At this; It will be understood by those skilled in the art that " continuing " is meant that distributor, dispensing device 11, receiving system 12, de-encapsulating devices 13 and decoding device 14 require to carry out the distribution of buffer memory according to mode of operation that set or adjustment in real time respectively; The transmission of video access request, the reception of video flowing, the decapsulation of video flowing is to obtain the coding unit sequence flows; And the decodes and plays of coding unit sequence flows, stop in a long time carrying out user's operation until this user through subscriber equipment 1.
More preferably be that distributor also according to said buffer memory, is provided with cache-time.Particularly, distributor also is provided with cache-time according to the cache size of being distributed.If the time of the video flowing in the buffer memory, 1 of subscriber equipment was in buffer status less than cache-time; If the time of the video flowing in the buffer memory, 1 of subscriber equipment was in broadcast state greater than cache-time.For example, suppose that the cache-time of distributor setting is 3S, if the time of the video flowing in the buffer memory is 5S, then subscriber equipment 1 is in broadcast state; If the time of the video flowing in the buffer memory is 1S, then 1 of subscriber equipment is in buffer status.
In a further advantageous embodiment, subscriber equipment 1 also comprises the inking device (not shown), sends the video information request about the video flowing of said video access request correspondence to the network equipment 2; Correspondingly, be received from the video information that the network equipment 2 sends based on said video information request; According to said video information configure user equipment 1.Subsequently, receiving system 12 is received from the said video flowing that the network equipment 2 sends.Particularly, inking device sends the video information request about the video flowing of said video access request correspondence to the network equipment 2; Correspondingly, the network equipment 2 is received from the video information request about the corresponding video flowing of said video access request that subscriber equipment 1 sends, and according to said video information request, obtains the video information of said video flowing, sends said video information to subscriber equipment 1; Correspondingly, inking device is received from the video information based on said video information request that the network equipment 2 sends; According to said video information configure user equipment 1.Subsequently, receiving system 12 is received from the said video flowing that the network equipment 2 sends.At this; This video information request both can be sent to the network equipment 2 with video access request (corresponding dispensing device 11) " simultaneously "; For example; In some fields of the corresponding packet of video access request, comprise content simultaneously, perhaps send between the video flowing based on this video access request of this video access request and 2 transmissions of the receiving system 12 reception network equipments that inking device is sent to the network equipment 2 with this video information request at dispensing device 11 about the video information request.Correspondingly, the network equipment 2 receives this video information request, and after the video flowing that obtains subscriber equipment 1 request; Further obtain the video information of video flowing, for example, the quantity of video flowing; The information of every road stream, total duration of video flowing, the size of video image etc.Those skilled in the art will be understood that also the send mode of above-mentioned video information request is merely for example; The send mode of other video information requests existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, this video information comprises but is not limited to, in the following at least each: the 1) quantity of video flowing; 2) format information of video flowing; 3) the total duration of the video of video flowing; 4) the video image size of video flowing; 5) the AVC configuration data of video flowing.Wherein, the quantity of video flowing is the quantity corresponding to the video flowing of video access request that the automatic network equipment that receives of subscriber equipment 12 sends; The format information of video flowing comprises the type of video flowing, the descriptor of video flowing etc.; The total duration of the video of video flowing is the complete duration of video flowing; The video image size of video flowing comprises the wide, high of video image; The AVC configuration data of video flowing comprises bit rate mode, quality mode, data length etc.Those skilled in the art will be understood that above-mentioned video information is merely for example, and other video informations existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
More preferably, the format information of video flowing includes but not limited to, in the following at least each: 1) the basic format information of video flowing; 2) the expansion format information of video flowing.Those skilled in the art will be understood that the format information of above-mentioned video flowing is merely for example; The format information of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
More preferably, the basic format information of video flowing includes but not limited to, in the following at least each: the 1) fundamental type of video flowing, for example video, audio frequency; 2) subtype of video flowing, for example H264, AAC etc.; 3) the decoding configuration information of video flowing, for example content of the length of the type of configuration data, configuration data, configuration data etc.Those skilled in the art will be understood that the basic format information of above-mentioned video flowing is merely for example; The basic format information of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
More preferably, the expansion format information of video flowing include but not limited in the following at least each: 1) the audio description information of video flowing, for example sampling bit wide of audio track quantity, audio sample rate, audio frequency etc.; 2) the video presentation information of video flowing, for example picture traverse, picture altitude, video frame rate etc.Those skilled in the art will be understood that the expansion format information of above-mentioned video flowing is merely for example; The expansion format information of other video flowings existing or that possibly occur from now on is as applicable to the present invention; Also should be included in the protection range of the present invention, and be contained in this with way of reference at this.
Preferably, dispensing device 11, receiving system 12, de-encapsulating devices 13, decoding device 14 and inking device are constant work.Particularly, dispensing device 11 sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Next, inking device correspondingly, receives this video information to the video information request that the network equipment 2 sends this video flowing, and according to this video information configure user equipment 1; Receiving system 12 receives and the corresponding video flowing of said video access request; Next, 13 pairs of said video flowings of de-encapsulating devices carry out decapsulation to be handled, to obtain one or more coding unit sequence flows; The said coding unit sequence flows of decoding device 14 decodes and plays.At this; It will be understood by those skilled in the art that " continuing " is meant that dispensing device 11, receiving system 12, de-encapsulating devices 13, decoding device 14 and inking device require to carry out the transmission of video access request respectively according to mode of operation that set or adjustment in real time; The request of video information receives and carries out the configuration of subscriber equipment 1 according to it; The reception of video flowing; The decapsulation of video flowing is with acquisition coding unit sequence flows, and the decodes and plays of coding unit sequence flows, stops in a long time carrying out user's operation through subscriber equipment 1 until this user.
Preferably, de-encapsulating devices 13 also carries out decapsulation to said video flowing to be handled, to obtain one or more coding unit sequence flows and extend information thereof.Particularly, de-encapsulating devices 13 carries out decapsulation through the video flowing that receiving system 12 automatic network equipment 2 are received to be handled, and not only obtains coding unit sequence flows in the video flowing, also obtains the extend information of coding unit sequence flows.At this, this extend information includes but not limited to: the numbering of coding unit, timestamp, data length, reproduction time, whether be key frame, and whether continuous etc. with a last coding unit.Those skilled in the art will be understood that above-mentioned extend information is merely for example, and other extend informations existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
In a preferred embodiment again; Subscriber equipment 1 also comprises the deriving means (not shown); Obtain the statistical information of said video access request, wherein, statistical information includes but not limited to; In the following at least each: the time that 1) broadcast state, the data in for example not startup, normal play, buffering, tentative, play percentage, the buffer memory can be supported to play etc.; 2) download statistics, for example the byte number, the Http that download of the zero hour, the byte number of downloading altogether, the byte number of uploading altogether, Http downloads number, byte number, the byte number of P2P long pass, P2P that P2P downloads and downloads number, resource number, altogether the Cache request of uploading number, long pass Cache hits altogether that candidate P2P downloads, downloads and continue duration etc. altogether; 3) speed of download, for example current speed of download (5S statistics, 20S statistics), current uploading speed (5S statistics, 20S statistics), one-minute average speed of download, one-minute average uploading speed, historical average speed of download, historical average uploading speed, the speed of download of current 1S, the uploading speed of current 1S etc. recently recently.Those skilled in the art will be understood that above-mentioned statistical information is merely for example, and other statistical informations existing or that possibly occur from now on also should be included in the protection range of the present invention, and be contained in this at this with way of reference as applicable to the present invention.
Especially, deriving means and dispensing device 11, receiving system 12, de-encapsulating devices 13 and decoding device 14 are not sequential workings, but can concurrent working.Particularly, dispensing device 11 sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Next, receiving system 12 be received from that the network equipment 2 sends with the corresponding video flowing of said video access request; Subsequently, 13 pairs of said video flowings of de-encapsulating devices carry out decapsulation to be handled, to obtain one or more coding unit sequence flows; The said coding unit sequence flows of decoding device 14 decodes and plays; Therewith the process while, deriving means also in work, obtains the statistical information of said video access request, stops in a long time carrying out user's operation through subscriber equipment 1 until this user.
Preferably, subscriber equipment 1 also comprises the shutoff device (not shown), closes said video access request.Particularly, for example, when the user closed video flowing, shutoff device cut out and the corresponding video access request of this video flowing, stopped reception, decapsulation and the decodes and plays of this video flowing, and discharged the resource of internal memory that is distributed and the subscriber equipment 1 that takies.For example, the active user is watching film " steal dream space ", the user click on the movie interface stop or during X button, shutoff device correspondingly cuts out and " stealing the dream space " corresponding video access request, and discharges relevant system resource.
More preferably, dispensing device 11, receiving system 12, de-encapsulating devices 13, decoding device 14 and shutoff device are constant work.Particularly, dispensing device 11 sends the video access request to the network equipment 2, and correspondingly, the network equipment 2 receives said video access request; Next, receiving system 12 be received from that the network equipment 2 sends with the corresponding video flowing of said video access request; Subsequently, 13 pairs of said video flowings of de-encapsulating devices carry out decapsulation to be handled, to obtain one or more coding unit sequence flows; The said coding unit sequence flows of decoding device 14 decodes and plays; Shutoff device cuts out the video access request.At this; It will be understood by those skilled in the art that " continuing " is meant that dispensing device 11, receiving system 12, de-encapsulating devices 13, decoding device 14 and shutoff device require to carry out the transmission of video access request respectively according to mode of operation that set or adjustment in real time; Obtaining of video flowing; The decapsulation of video flowing is to obtain the coding unit sequence flows; The decodes and plays of coding unit sequence flows, and the closing of video access request stop to carry out user's operation through subscriber equipment 1 until this user in a long time.
To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned example embodiment, and under the situation that does not deviate from spirit of the present invention or essential characteristic, can realize the present invention with other concrete form.Therefore; No matter from which point; All should regard embodiment as exemplary; And be nonrestrictive, scope of the present invention is limited accompanying claims rather than above-mentioned explanation, therefore is intended to the implication of the equivalents that drops on claim and all changes in the scope are included in the present invention.Should any Reference numeral in the claim be regarded as limit related claim.In addition, obviously other unit or step do not got rid of in " comprising " speech, and odd number is not got rid of plural number.A plurality of unit of stating in the device claim or device also can be realized through software or hardware by a unit or device.The first, the second word such as grade is used for representing title, and does not represent any specific order.