CN106254907A - A kind of live video synthetic method and device - Google Patents
A kind of live video synthetic method and device Download PDFInfo
- Publication number
- CN106254907A CN106254907A CN201610692945.3A CN201610692945A CN106254907A CN 106254907 A CN106254907 A CN 106254907A CN 201610692945 A CN201610692945 A CN 201610692945A CN 106254907 A CN106254907 A CN 106254907A
- Authority
- CN
- China
- Prior art keywords
- instruction set
- stream
- video flowing
- instruction
- audio stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010189 synthetic method Methods 0.000 title claims abstract description 14
- 238000000034 method Methods 0.000 claims abstract description 36
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 19
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 17
- 230000006835 compression Effects 0.000 claims description 26
- 238000007906 compression Methods 0.000 claims description 26
- 238000012545 processing Methods 0.000 claims description 10
- 238000012360 testing method Methods 0.000 claims description 4
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 abstract description 7
- 230000008569 process Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000015654 memory Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25875—Management of end-user data involving end-user authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the present invention provides a kind of live video synthetic method and device, relates to Streaming Media field.Described method includes: receive audio stream, picture stream and instruction set that first user terminal sends；According to instruction set, audio stream and picture stream are synthesized video flowing；Receiving the solicited message that the second user terminal sends, described solicited message includes the identification number of video flowing to be asked；By the video stream corresponding with the identification number of described video flowing to be asked to the second user terminal.Described method is by receiving audio stream, picture stream and instruction set respectively, and according to instruction set, audio stream and picture stream are synthesized video flowing, server is made to need not do substantial amounts of preposition work, effectively reduce the resource consumption of server, and for the video of transmission directly use camera collection, transmit the network transmission bandwidth that the video flowing of described synthesis consumed and also reduce.Further, the flow consumption of user terminal significantly reduces, and power consumption is significantly reduced.
Description
Technical field
The present invention relates to Streaming Media field, in particular to a kind of live video synthetic method and device.
Background technology
Traditional net cast generally use shooting first-class video capture device to carry out the collection of live content, this for
The application scenarios that Online class, on-line meeting etc. only need the video stream frame rate of playing pictures stream relatively low is the most suitable.
Additionally, in traditional net cast technology, in order to adapt to plurality of application scenes, server must do substantial amounts of preposition
Work, such as pre-treatment, coding, transcoding etc., this is very big to the consumption of server resource, and the most traditional video flowing is not only passing
During defeated, the network bandwidth is taken high, and user terminal consumes when playing flow and power consumption are the biggest.
Summary of the invention
In view of this, the purpose of the embodiment of the present invention is to provide a kind of live video synthetic method and device, to solve
The problems referred to above.
To achieve these goals, the technical scheme that the embodiment of the present invention uses is as follows:
First aspect, embodiments provides a kind of live video synthetic method, and described method includes: receive first
Audio stream, picture stream and the instruction set that user terminal sends；According to described instruction set, by described audio stream and described picture stream
Synthesize video flowing；Receiving the solicited message that the second user terminal sends, described solicited message includes the mark of video flowing to be asked
Knowledge number；By the video stream corresponding with the identification number of described video flowing to be asked to described second user terminal.
Second aspect, embodiments provides a kind of live video synthesizer, and described device includes: first receives
Module, for receiving audio stream, picture stream and the instruction set that first user terminal sends；Processing module, for according to described
Instruction set, synthesizes video flowing by described audio stream and described picture stream；Second receiver module, for receiving the second user terminal
The solicited message sent, described solicited message includes the identification number of video flowing to be asked；Sending module, for asking with described waiting
Ask the video stream that the identification number of video flowing is corresponding to described second user terminal.
Compared with prior art, a kind of live video synthetic method of embodiment of the present invention offer and device, by respectively
Receive audio stream, picture stream and instruction set, and according to described instruction set, audio stream and picture stream synthesized video flowing so that
Server need not do substantial amounts of preposition work, effectively reduces the resource consumption of server, and direct relative to transmission
For the video of camera collection, transmit the network transmission bandwidth that the video flowing of described synthesis consumed and also reduce.Further
, the flow consumption of user terminal significantly reduces, and power consumption is significantly reduced.
Other features and advantages of the present invention will illustrate in description subsequently, and, partly become from description
It is clear that or understand by implementing the embodiment of the present invention.The purpose of the present invention and other advantages can be by saying of being write
Structure specifically noted in bright book, claims and accompanying drawing realizes and obtains.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by embodiment required use attached
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, and it is right to be therefore not construed as
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to according to this
A little accompanying drawings obtain other relevant accompanying drawings.
Fig. 1 is first user terminal, the second user terminal and the showing that server interacts that the embodiment of the present invention provides
It is intended to.
Fig. 2 is the structural representation of the server that the embodiment of the present invention provides.
Fig. 3 is the flow chart of a kind of live video synthetic method that first embodiment of the invention provides.
Fig. 4 is a kind of stream in detail of step S620 in a kind of live video synthetic method that first embodiment of the invention provides
Cheng Tu.
Fig. 5 is the another kind of detailed of step S620 in a kind of live video synthetic method that first embodiment of the invention provides
Flow chart.
Fig. 6 is the structured flowchart of a kind of live video synthesizer that second embodiment of the invention provides.
Fig. 7 is a kind of detailed of processing module 720 in a kind of live video synthesizer that second embodiment of the invention provides
Fine texture block diagram.
Fig. 8 is the another kind of processing module 720 in a kind of live video synthesizer that second embodiment of the invention provides
Detailed block diagram.
Detailed description of the invention
Below in conjunction with accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Ground describes, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole embodiments.Generally exist
Can arrange and design with various different configurations with the assembly of the embodiment of the present invention that illustrates described in accompanying drawing herein.Cause
This, be not intended to limit claimed invention to the detailed description of the embodiments of the invention provided in the accompanying drawings below
Scope, but it is merely representative of the selected embodiment of the present invention.Based on embodiments of the invention, those skilled in the art are not doing
The every other embodiment obtained on the premise of going out creative work, broadly falls into the scope of protection of the invention.
It should also be noted that similar label and letter represent similar terms, therefore, the most a certain Xiang Yi in following accompanying drawing
Individual accompanying drawing is defined, then need not it be defined further and explains in accompanying drawing subsequently.Meanwhile, the present invention's
In description, term " first ", " second " etc. are only used for distinguishing and describe, and it is not intended that indicate or hint relative importance.
Fig. 1 shows first user terminal the 100, second user terminal 200 and server 300 that the embodiment of the present invention provides
The schematic diagram interacted.One or more first user terminals 100 can be respectively by network 400 and described server 300
It is communicatively coupled, to carry out data communication or mutual.One or more second user terminals 200 can pass through network respectively
400 are communicatively coupled with described server 300, to carry out data communication or mutual.Described server 300 can be network clothes
Business device, database server etc..Described first user terminal 100 and the second user terminal 200 can be PC
(personal computer, PC), panel computer, smart mobile phone, personal digital assistant (personal digital
Assistant, PDA) etc..
In the embodiment of the present invention, build-in services end in described server 300, described first user terminal 100 and
Two user terminals 200 are respectively mounted client, and described service end and described client observe a set of data protocol, this client jointly
End can be third-party application software, and such as browser or video player, user can be logged in not by the page of browser
With account number corresponding to application, it is thus achieved that different services, such as uploaded videos or watch the live or video of program request.
As in figure 2 it is shown, be the structural representation of server 300.Described server 300 includes memorizer 301, processor
302 and mixed-media network modules mixed-media 303.
Memorizer 301 can be used for storing software program and module, such as the live video synthesis side in the embodiment of the present invention
Method and programmed instruction/module corresponding to device, processor 302 by operation be stored in the software program in memorizer 301 and
Module, thus perform the application of various function and data process, i.e. realize the live video synthetic method in the embodiment of the present invention.
Memorizer 301 can include high speed random access memory, may also include nonvolatile memory, as one or more magnetic storage fills
Put, flash memory or other non-volatile solid state memories.Further, the software program in above-mentioned memorizer 301 and module
May also include that operating system 321 and service module 322.Wherein operating system 321, can be such as LINUX, UNIX,
WINDOWS, it can include various for managing system task (such as memory management, storage device control, power management etc.)
Component software and/or driving, and can communication mutual with various hardware or component software, thus provide the operation of other component softwares
Environment.On the basis of service module 322 operates in operating system 321, and by the network service of operating system 321 monitor from
The request of network, completes corresponding data according to request and processes, and return result to client.It is to say, service mould
Block 322 is for providing network service to client.
Mixed-media network modules mixed-media 303 is used for receiving and sending network signal.Above-mentioned network signal can include wireless signal or have
Line signal.
Being appreciated that the structure shown in Fig. 2 is only signal, server 300 may also include more more than shown in Fig. 2 or more
Few assembly, or there is the configuration different from shown in Fig. 2.Each assembly shown in Fig. 2 can use hardware, software or its group
Close and realize.It addition, the server in the embodiment of the present invention can also include the server of multiple concrete difference in functionality.
Fig. 3 shows the flow chart of a kind of live video synthetic method that first embodiment of the invention provides, and refers to figure
3, what the present embodiment described is the handling process of server, and described method includes:
Step S610, server receives audio stream, picture stream and the instruction set that first user terminal sends；
Wherein, audio stream can be the voice data under various application scenarios, such as speaker in Online class or on-line meeting
The speech data of people, the form of described audio stream can be BitSpeek.
Picture stream can be the image data under various application scenarios, as needed the courseware of projection in Online class or online can
View needs the lantern slide etc. shown.
Instruction set can be Simple Network Management Protocol instruction, and each instruction in described instruction set all carries time mark
Sign.
Preferably, before step S610, described method also includes:
Server receives the authentication information that first user terminal sends, and verifies described authentication information,
It is proved to be successful backward first user terminal to return for representing the first confirmation letter that described first user terminal identity is proved to be successful
Breath.
Described authentication information can have a variety of, the such as user name of first user terminal, cell-phone number, mailbox, close
Code etc., it is to be understood that be not limited to described embodiment.Preferably, described authentication information is that first user is whole
The user name of end and password.
Step S620, described audio stream and described picture stream, according to described instruction set, are synthesized video by described server
Stream；
Wherein, described video flowing is to there being unique identification number identifying described video flowing.
As a kind of specific embodiment, referring to Fig. 4, step S620 may include that
Step S621, described server judges the finger whether having the time tag carrying current time in described instruction set
Order.
Step S622, if it has, described server then perform described in carry the instruction of time tag of current time, working as
Photo current in described picture stream is synthesized by the front moment with described audio stream, until each instruction in described instruction set is all
It is finished, forms video flowing
As another kind of specific embodiment, referring to Fig. 5, step S620 may include that
Step S623, described audio stream is compressed by described server, it is thus achieved that the audio stream after compression.
Wherein, the embodiment of audio compression is had multiple, such as: waveform coding, parameter coding and multiple technologies phase
The coding form merged mutually.
Waveform coding is that time-domain signal is directly transformed to digital code, tries hard to make reconstruction audio volume control keep former audio frequency
The waveform shape of signal.The ultimate principle of described waveform coding is to sample analogue audio frequency by certain speed on a timeline,
Then by amplitude sample layered quantization, and represent with code.Conventional waveform coding have pulse code modulation, delta modulation, from
Adapt to transmission coding, sub-band coding etc..
Parameter coding is that in frequency domain or other orthogonal transform domains, audio signal is extracted characteristic parameter, and is converted into
Digital code is transmitted.Specifically, described parameter coding is by the extraction of audio signal characteristic parameter and coding, trying hard to
Reconstructed audio signals is made to have the highest accuracy.The compression ratio of described parameter coding is big, and amount of calculation is the biggest.The most linear
Predictive coding and various modified model thereof broadly fall into parameter coding.
Hybrid coding is coding form waveform coding and parameter coding combined, overcome original waveform coding and
The weakness of parameter coding, tries hard to keep high-quality and the low rate of parameter coding of waveform coding, obtains high-quality synthesized voice
Frequently signal.The basis of described hybrid coding is linear predictive coding, conventional hybrid coding have pulse excitation linear predictive coding,
Planning pulse excitation linear predictive coding, codebook excited linear predictive coding etc..
Step S624, described server judges the finger whether having the time tag carrying current time in described instruction set
Order.
Step S625, if it has, described server then perform described in carry the instruction of time tag of current time, by institute
The photo current stated in picture stream is compressed, it is thus achieved that the picture after compression, and at current time by the picture after described compression
Synthesize with the audio stream after described compression, until each instruction in described instruction set is all finished, form video flowing.
Further, the identification number that described video flowing is corresponding with described video flowing can be mated and store by server, with
After the most live end, user still can watch described video flowing by the way of program request.
Preferably, after step S620, described method also includes:
Described server according to described audio stream, generates subtitle item, each described subtitle item include time interval with
And captioned test；
The described time interval that described server includes according to subtitle item each described, by each described subtitle item
Synthesize with described video flowing, it is thus achieved that the video flowing after renewal.
Step S630, described server receives the solicited message that the second user terminal sends, and described solicited message includes treating
The identification number of request video flowing；
Step S640, described server by the video stream corresponding with the identification number of described video flowing to be asked to described
Second user terminal.
If the detailed description of the invention of step S620 is as shown in Figure 4, the most described video flowing includes audio stream and picture stream,
After second user terminal receives described video flowing, play described audio frequency by the client synchronization installed on the second user terminal
Stream and picture stream.
If the detailed description of the invention of step S620 as it is shown in figure 5, described video flowing include compression after audio stream
With compression after picture stream, after the second user terminal receives described video flowing, by the second user terminal install client
Hold to compression after audio stream with compression after picture stream be decoded respectively, concrete decoding process with coding time employing pressure
Contracting coded system is corresponding, finally by the audio stream after the client synchronization broadcast decoder installed on the second user terminal and picture
Stream.
The live video synthetic method that the embodiment of the present invention provides, by receiving audio stream, picture stream and instruction respectively
Collection, and audio stream and picture stream are synthesized video flowing according to described instruction set so that server need not to do substantial amounts of preposition
Work, effectively reduces the resource consumption of server, and for transmission is directly with the video of camera collection, passes
The network transmission bandwidth that the video flowing of defeated described synthesis is consumed also reduces.Further, the flow of user terminal consumes substantially
Reducing, power consumption is significantly reduced.Further, the video flowing of synthesis adds captions, forms the video flowing of band captions, in order to
When user gets the video flowing of described band captions by the second user terminal, it is possible to by word apparent get audio frequency
Content, Consumer's Experience promotes further.
Refer to Fig. 6, be the structured flowchart of a kind of live video synthesizer 700 that second embodiment of the invention provides.
Described live video synthesizer 700 includes the first receiver module 710, processing module the 720, second receiver module 730, sends mould
Block 740.
Described first receiver module 710, for receiving audio stream, picture stream and the instruction that first user terminal sends
Collection；
Wherein, described instruction set is Simple Network Management Protocol instruction set, and each instruction in described instruction set is all carried
There is time tag.
Described processing module 720, for according to described instruction set, synthesizing video by described audio stream and described picture stream
Stream；
Wherein, described video flowing is to there being unique identification number identifying described video flowing.
As a kind of specific embodiment, refer to Fig. 7, described processing module 720 can include judge module 721 with
And synthesis module 722.
Described judge module 721, for judging the finger whether having the time tag carrying current time in described instruction set
Order；
Described synthesis module 722, for when the finger of the time tag carrying current time described in existence in described instruction set
When making, described in execution, carry the instruction of the time tag of current time, at current time by the photo current in described picture stream
Synthesize with described audio stream, until each instruction in described instruction set is all finished, form video flowing.
As a kind of specific embodiment, refer to Fig. 8, described processing module 720 can include compression module 723,
Judge module 724 and synthesis module 725.
Described compression module 723, for being compressed described audio stream, it is thus achieved that the audio stream after compression；
Described judge module 724, for judging the finger whether having the time tag carrying current time in described instruction set
Order；
Described synthesis module 725, carries currently described in existing in described judge module judges described instruction set
During the instruction of the time tag in moment, carry the instruction of the time tag of current time described in execution, by described picture stream
Photo current is compressed, it is thus achieved that the picture after compression, and after current time is by the picture after described compression and described compression
Audio stream synthesis, until described instruction set in each instruction be all finished, formation video flowing.
Described second receiver module 730, for receiving the solicited message that the second user terminal sends, described request packet
Include the identification number of video flowing to be asked；
Described sending module 740, is used for the video stream corresponding with the identification number of described video flowing to be asked to institute
State the second user terminal.
Preferably, described live video synthesizer 700 also includes:
Captioning module 750, for according to described audio stream, generates subtitle item, and each described subtitle item includes the time
Interval and captioned test；The described time interval included according to subtitle item each described, by each described subtitle item
Synthesize with described video flowing, it is thus achieved that the video flowing after renewal.
It is understood that the video flowing after described renewal may be used in the order program service after live end.
Authentication module 760, for receiving the authentication information that first user terminal sends, to described authentication
Information is verified, is proved to be successful backward first user terminal and returns for representing that described first user terminal identity is proved to be successful
The first confirmation.
Described authentication information can have a variety of, the such as user name of first user terminal, cell-phone number, mailbox, close
Code etc., it is to be understood that be not limited to described embodiment.Preferably, described authentication information is that first user is whole
The user name of end and password.
The most each module can be by software code realization, and now, above-mentioned each module can be stored in depositing of server 300
In reservoir 301.The most each module is equally realized by hardware such as IC chip.
The live video synthesizer that the embodiment of the present invention is provided, it realizes principle and the technique effect of generation and aforementioned
Embodiment of the method is identical, for briefly describing, and the not mentioned part of device embodiment part, refer in preceding method embodiment corresponding
Content.
In several embodiments provided herein, it should be understood that disclosed apparatus and method, it is also possible to pass through
Other mode realizes.Device embodiment described above is only schematically, such as, and the flow chart in accompanying drawing and block diagram
Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product,
Function and operation.In this, each square frame in flow chart or block diagram can represent a module, program segment or the one of code
Part, a part for described module, program segment or code comprises holding of one or more logic function for realizing regulation
Row instruction.It should also be noted that at some as in the implementation replaced, the function marked in square frame can also be to be different from
The order marked in accompanying drawing occurs.Such as, two continuous print square frames can essentially perform substantially in parallel, and they are the most also
Can perform in the opposite order, this is depending on involved function.It is also noted that every in block diagram and/or flow chart
The combination of the square frame in individual square frame and block diagram and/or flow chart, can be with function or the special base of action performing regulation
System in hardware realizes, or can realize with the combination of specialized hardware with computer instruction.
It addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation
Point, it is also possible to it is modules individualism, it is also possible to two or more modules are integrated to form an independent part.
If described function is using the form realization of software function module and as independent production marketing or use, permissible
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is the most in other words
The part contributing prior art or the part of this technical scheme can embody with the form of software product, this meter
Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual
People's computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.
And aforesaid storage medium includes: USB flash disk, portable hard drive, read only memory (ROM, Read-Only Memory), random access memory are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.Need
Illustrate, in this article, the relational terms of such as first and second or the like be used merely to by an entity or operation with
Another entity or operating space separate, and there is any this reality between not necessarily requiring or imply these entities or operating
The relation on border or order.And, term " includes ", " comprising " or its any other variant are intended to the bag of nonexcludability
Contain, so that include that the process of a series of key element, method, article or equipment not only include those key elements, but also include
Other key elements being not expressly set out, or also include the key element intrinsic for this process, method, article or equipment.
In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that including described key element
Process, method, article or equipment in there is also other identical element.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.All within the spirit and principles in the present invention, that is made any repaiies
Change, equivalent, improvement etc., should be included within the scope of the present invention.It should also be noted that similar label and letter exist
Figure below represents similar terms, therefore, the most a certain Xiang Yi accompanying drawing is defined, is then not required in accompanying drawing subsequently
It is defined further and explains.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and any
Those familiar with the art, in the technical scope that the invention discloses, can readily occur in change or replace, should contain
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with scope of the claims.
It should be noted that in this article, the relational terms of such as first and second or the like is used merely to a reality
Body or operation separate with another entity or operating space, and deposit between not necessarily requiring or imply these entities or operating
Relation or order in any this reality.And, term " includes ", " comprising " or its any other variant are intended to
Comprising of nonexcludability, so that include that the process of a series of key element, method, article or equipment not only include that those are wanted
Element, but also include other key elements being not expressly set out, or also include for this process, method, article or equipment
Intrinsic key element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that
Including process, method, article or the equipment of described key element there is also other identical element.
Claims (10)
1. a live video synthetic method, it is characterised in that described method includes:
Receive audio stream, picture stream and instruction set that first user terminal sends；
According to described instruction set, described audio stream and described picture stream are synthesized video flowing；
Receiving the solicited message that the second user terminal sends, described solicited message includes the identification number of video flowing to be asked；
By the video stream corresponding with the identification number of described video flowing to be asked to described second user terminal.
Method the most according to claim 1, it is characterised in that each instruction in described instruction set all carries time mark
Sign, described according to described instruction set, described audio stream and described picture stream are synthesized video flowing, including:
Judge the instruction whether having the time tag carrying current time in described instruction set；
If it has, carry the instruction of the time tag of current time described in then performing, at current time by described picture stream
Photo current synthesizes with described audio stream；
Until each instruction in described instruction set is all finished, form video flowing.
Method the most according to claim 2, it is characterised in that judge whether carry in described instruction set currently described
Before the instruction of the time tag in moment, described method includes:
Described audio stream is compressed, it is thus achieved that the audio stream after compression；
Described at current time, the photo current in described picture stream and described audio stream are synthesized, including:
Photo current in described picture stream is compressed, it is thus achieved that the picture after compression；
At current time by the audio stream synthesis after the picture after described compression and described compression.
Method the most according to claim 1, it is characterised in that described according to described instruction set, by described audio stream with
After described picture stream synthesizes video flowing, described method also includes:
According to described audio stream, generating subtitle item, each described subtitle item includes time interval and captioned test；
The described time interval included according to subtitle item each described, closes each described subtitle item with described video flowing
Become, it is thus achieved that the video flowing after renewal.
Method the most according to claim 1, it is characterised in that described instruction set is Simple Network Management Protocol instruction set.
6. a live video synthesizer, it is characterised in that described device includes:
First receiver module, for receiving audio stream, picture stream and the instruction set that first user terminal sends；
Processing module, for according to described instruction set, synthesizing video flowing by described audio stream and described picture stream；
Second receiver module, for receiving the solicited message that the second user terminal sends, described solicited message includes treating that request regards
The identification number of frequency stream；
Sending module, for by the video stream corresponding with the identification number of described video flowing to be asked to described second user eventually
End.
Device the most according to claim 6, it is characterised in that each instruction in described instruction set all carries time mark
Signing, described processing module includes judge module and synthesis module,
Described judge module, for judging the instruction whether having the time tag carrying current time in described instruction set；
Described synthesis module, for, during when the instruction of the time tag carrying current time described in existing in described instruction set, holding
The instruction of the time tag of current time is carried, at current time by the photo current in described picture stream and described sound described in row
Frequency stream synthesis, until each instruction in described instruction set is all finished, forms video flowing.
Device the most according to claim 7, it is characterised in that described processing module also includes compression module, described compression
Module, is used for before the described instruction judging whether to have in described instruction set the time tag carrying current time, by described
Audio stream is compressed, it is thus achieved that the audio stream after compression；
Described synthesis module, specifically for when the instruction of the time tag carrying current time described in existence in described instruction set
Time, carry the instruction of the time tag of current time described in execution, the photo current in described picture stream be compressed, it is thus achieved that
Picture after compression, and at current time by the audio stream synthesis after the picture after described compression and described compression, until described
Each instruction in instruction set is all finished, and forms video flowing.
Device the most according to claim 6, it is characterised in that described device also includes:
Captioning module, for according to described audio stream, generates subtitle item, each described subtitle item include time interval and
Captioned test；The described time interval included according to subtitle item each described, regards each described subtitle item with described
Frequency stream synthesis, it is thus achieved that the video flowing after renewal.
Device the most according to claim 6, it is characterised in that described instruction set is Simple Network Management Protocol instruction set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610692945.3A CN106254907B (en) | 2016-08-20 | 2016-08-20 | Live video synthesis method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610692945.3A CN106254907B (en) | 2016-08-20 | 2016-08-20 | Live video synthesis method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106254907A true CN106254907A (en) | 2016-12-21 |
| CN106254907B CN106254907B (en) | 2020-01-21 |
Family
ID=57592794
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610692945.3A Active CN106254907B (en) | 2016-08-20 | 2016-08-20 | Live video synthesis method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106254907B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108271034A (en) * | 2017-01-03 | 2018-07-10 | 李庆成 | The processing method of network direct broadcasting system and network direct broadcasting data |
| CN108337559A (en) * | 2018-02-06 | 2018-07-27 | 杭州政信金服互联网科技有限公司 | A kind of live streaming word methods of exhibiting and system |
| CN109005470A (en) * | 2018-08-27 | 2018-12-14 | 佛山龙眼传媒科技有限公司 | A kind of method, system and the device of online synthesis subtitle |
| CN109089129A (en) * | 2018-09-05 | 2018-12-25 | 南京爱布谷网络科技有限公司 | The steady more video binding live broadcast systems of one kind and its method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020013851A1 (en) * | 2000-06-20 | 2002-01-31 | Crandall Evan Stephen | Simultaneous recording of multiple information streams |
| CN1549989A (en) * | 2001-07-09 | 2004-11-24 | �����ɷ� | Apparatus and method for conditioning digital image data fordisplay of the image represented thereby |
| CN102625129A (en) * | 2012-03-31 | 2012-08-01 | 福州一点通广告装饰有限公司 | Method for realizing remote reality three-dimensional virtual imitated scene interaction |
| CN105744293A (en) * | 2016-03-16 | 2016-07-06 | 北京小米移动软件有限公司 | Video live broadcast method and device |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
-
2016
- 2016-08-20 CN CN201610692945.3A patent/CN106254907B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020013851A1 (en) * | 2000-06-20 | 2002-01-31 | Crandall Evan Stephen | Simultaneous recording of multiple information streams |
| CN1549989A (en) * | 2001-07-09 | 2004-11-24 | �����ɷ� | Apparatus and method for conditioning digital image data fordisplay of the image represented thereby |
| CN102625129A (en) * | 2012-03-31 | 2012-08-01 | 福州一点通广告装饰有限公司 | Method for realizing remote reality three-dimensional virtual imitated scene interaction |
| CN105744293A (en) * | 2016-03-16 | 2016-07-06 | 北京小米移动软件有限公司 | Video live broadcast method and device |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108271034A (en) * | 2017-01-03 | 2018-07-10 | 李庆成 | The processing method of network direct broadcasting system and network direct broadcasting data |
| CN108337559A (en) * | 2018-02-06 | 2018-07-27 | 杭州政信金服互联网科技有限公司 | A kind of live streaming word methods of exhibiting and system |
| CN109005470A (en) * | 2018-08-27 | 2018-12-14 | 佛山龙眼传媒科技有限公司 | A kind of method, system and the device of online synthesis subtitle |
| CN109005470B (en) * | 2018-08-27 | 2020-11-10 | 佛山龙眼传媒科技有限公司 | Method, system and device for synthesizing subtitles on line |
| CN109089129A (en) * | 2018-09-05 | 2018-12-25 | 南京爱布谷网络科技有限公司 | The steady more video binding live broadcast systems of one kind and its method |
| CN109089129B (en) * | 2018-09-05 | 2020-09-22 | 南京爱布谷网络科技有限公司 | Stable multi-video binding live broadcasting system and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106254907B (en) | 2020-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106303658B (en) | Exchange method and device applied to net cast | |
| RU2699406C2 (en) | Information processing device and information processing method | |
| CN106254907A (en) | A kind of live video synthetic method and device | |
| CN105612743A (en) | Audio video playback synchronization for encoded media | |
| CN105659324B (en) | Cooperation audio session proves | |
| CN106463148B (en) | Information processing unit and information processing method | |
| CN103268763A (en) | Wireless media system based on synchronous audio extraction and real-time transmission | |
| CN106131550A (en) | Play the method and device of multimedia file | |
| CN106464970A (en) | Image playback device, display device, and transmission device | |
| CN110505498A (en) | Processing, playback method, device and the computer-readable medium of video | |
| WO2014067269A1 (en) | Sent message playing method, system and related device | |
| CN106910491A (en) | Karaoke OK system | |
| CN109496295A (en) | Multimedia content generation method, device and equipment/terminal/server | |
| CN110415678A (en) | Customized voice broadcast client, server, system and method | |
| CN110460889A (en) | A kind of video throws screen method, apparatus, system and storage medium | |
| CN104184980A (en) | Data processing method and electronic device | |
| CN109874024A (en) | A kind of barrage processing method, system and storage medium based on dynamic video poster | |
| CN104991950A (en) | Picture generating method, display method and corresponding devices | |
| US20130151972A1 (en) | Media processing comparison system and techniques | |
| CN103428441A (en) | Course recording method and course recording device used for on-line teaching | |
| CN106792219B (en) | It is a kind of that the method and device reviewed is broadcast live | |
| CN111869225B (en) | Information processing apparatus, information processing method, and non-transitory computer readable storage medium | |
| CN112151048A (en) | Method for generating and processing audio-visual image data | |
| CN111837401B (en) | Information processing apparatus, information processing method, and computer readable medium | |
| EP4345814A1 (en) | Video-generation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 610000, Sichuan, Chengdu, China (Sichuan) free trade zone, Chengdu hi tech Zone, Tianfu Road North, No. 9, building 3, building 1, 8, No. 1480 Applicant after: Chengdu Internet sharing Polytron Technologies Inc Address before: 610000, No. 8, building 3, No. 10, No. 5, No. 9, No. 1480, Tianfu Road, Chengdu high tech Zone, Sichuan, China Applicant before: Chengdu Internet Sharing Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |