CN107801080A - A kind of audio and video synchronization method, device and equipment - Google Patents
A kind of audio and video synchronization method, device and equipment Download PDFInfo
- Publication number
- CN107801080A CN107801080A CN201711106765.3A CN201711106765A CN107801080A CN 107801080 A CN107801080 A CN 107801080A CN 201711106765 A CN201711106765 A CN 201711106765A CN 107801080 A CN107801080 A CN 107801080A
- Authority
- CN
- China
- Prior art keywords
- audio
- frame
- video
- buffer
- timestamp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A kind of audio and video synchronization method includes：Buffer voice data and video data to be synchronized respectively by audio buffer and screen buffer；Calculate the time difference of the timestamp and the timestamp of currently playing frame of video of currently playing audio frame；According to the time difference, adjust the audio buffer and send speed and/or mode into audio decoder.So as to effectively solve the problems, such as video pictures mosaic, interim card or flower screen, and the broadcast format of video flowing need not be changed, more agree with the application scenarios of 1 tunnel voice-frequency-multichannel video in NVR equipment.
Description
Technical field
The invention belongs to audio frequency and video process field, more particularly to a kind of audio and video synchronization method, device and equipment.
Background technology
In field of video monitoring, (English full name is Network Video Recorder to NVR, and Chinese full name is network video
Frequency monitors) usually require to receive the real-time audio and video code stream transmitted from each IPC (IP Camera) ends, pass through display
And audio output interface exports video pictures and audio in real time.
Because the data of audio frame are generally smaller, more it is not readily susceptible to postpone shadow caused by network transmission and decoding
Ring.In NVR equipment, audio/video decoding chip can be typically configured, the data of frame of video and audio frame are generally by chip hard decoder
Complete, audio frame can be also adjusted to be decoded by software because chip decoding layer plaid matching formula species supports the problem of insufficient, and it is counted
Small according to measuring, it decodes caused delay and can solved by software view.Therefore, common audio-visual synchronization scheme is typically with sound
Frequency frame time stamp is reference, adjusts the broadcasting speed of frame of video, or also includes the method for abandoning frame of video, if beyond synchronous
If scope is permitted, some schemes can stop the broadcasting of audio frame, so as to realize audio-visual synchronization.
But when being played out using the timestamp of audio frame as the reference time, the opening and closing of audio can influence the interim card of picture,
The backward frame of video of video flowing would generally have dependence to forward video frame, if abandoning frame of video in synchronization, may cause
There is mosaic, interim card and flower screen in picture.
The content of the invention
In view of this, the embodiments of the invention provide audio and video synchronization method, device and equipment, to solve in the prior art
When being played out using the timestamp of audio frame as the reference time, the opening and closing of audio can influence the interim card of picture, if when synchronous
Frame of video is abandoned, picture may be caused the problem of mosaic, interim card and flower screen occur.
The first aspect of the embodiment of the present invention provides a kind of audio and video synchronization method, the audio and video synchronization method bag
Include：
Buffer voice data and video data to be synchronized respectively by audio buffer and screen buffer；
Calculate the time difference of the timestamp and the timestamp of currently playing frame of video of currently playing audio frame；
According to the time difference, adjust the audio buffer and send speed and/or mode into audio decoder.
It is described according to the time difference with reference in a first aspect, in the first possible implementation of first aspect, adjust
The whole audio buffer, which sends the step of speed and/or mode into audio decoder, to be included：
If currently playing audio frame is advanced and the absolute value of the time difference is more than predetermined time threshold, prolong
Long current audio frame leaves the time of buffering area；
If currently playing audio frame is backward and the absolute value of the time difference is more than predetermined time threshold, make
Present frame leaves buffering area but is not sent into audio decoder.
With reference in a first aspect, may be described to calculate currently playing audio in implementation at second of first aspect
The step of time difference of the timestamp of frame and the timestamp of currently playing frame of video, includes：
Obtain the timestamp A of the newest audio frame for leaving audio buffer, and the newest video for leaving screen buffer
The timestamp V of frame；
According to remaining audio playing duration Ta in audio decoder, calculate currently in the timestamp Pa=for the audio frame broadcast
A-Ta；
According to the timestamp Pv=V of currently playing frame of video, calculate the timestamp of currently playing audio frame with it is current
The time difference Td=Pa-Pv of the timestamp of the frame of video of broadcasting.
With reference in a first aspect, in the third possible implementation of first aspect, methods described also includes：
Detect the audio frame number that the audio buffer is buffered, and the frame of video that the screen buffer is buffered
Number；
If the video frame number of buffering is more than the first predetermined buffer threshold, video frame queue enters broadcast state；
If the audio frame number of buffering enters broadcast state also greater than the first predetermined buffer threshold, audio frame queue；
If the video frame number of buffering is less than the second predetermined buffer threshold, video frame queue enters pause and plays shape
State, while audio frame queue sound intermediate frequency frame data go out team but are not sent into decoder.
Second of possible realization side of the first possible implementation, first aspect with reference to first aspect, first aspect
The possible implementation of the third of formula or first aspect, in the 4th kind of possible implementation of first aspect, methods described is also
Including：
The audio buffer is left by the audio frame of audio buffer described in predetermined timer driver at equal intervals,
And/or the frame of video of screen buffer leaves the screen buffer.
The second aspect of the embodiment of the present invention provides a kind of audio-visual synchronization device, the audio-visual synchronization device bag
Include：
Buffer cell, for buffering voice data and video to be synchronized respectively by audio buffer and screen buffer
Data；
Time difference computing unit, for the timestamp for calculating currently playing audio frame and currently playing frame of video
The time difference of timestamp；
Adjustment unit, for according to the time difference, adjusting the audio buffer and sending into audio decoder
Speed and/or mode.
With reference to second aspect, in the first possible implementation of second aspect, the adjustment unit includes：
Extend subelement, make a reservation for if the absolute value of advanced for currently playing audio frame and described time difference is more than
Time threshold, then extend current audio frame and leave time of buffering area；
Subelement is abandoned, is made a reservation for if the absolute value of backward for currently playing audio frame and described time difference is more than
Time threshold, then present frame is left buffering area but be not sent into audio decoder.
With reference to second aspect, in second of possible implementation of second aspect, the time difference computing unit bag
Include：
Very first time stamp obtains subelement, for obtaining the timestamp A of the newest audio frame for leaving audio buffer, and
The timestamp V of the newest frame of video for leaving screen buffer；
Second timestamp obtains subelement, for according to remaining audio playing duration Ta in audio decoder, calculating and working as
The preceding timestamp Pa=A-Ta in the audio frame broadcast；
Computation subunit, for the timestamp Pv=V according to currently playing frame of video, calculate currently playing audio frame
Timestamp and the timestamp of currently playing frame of video time difference Td=Pa-Pv.
The third aspect of the embodiment of the present invention provides a kind of audio-visual synchronization equipment, including memory, processor and
It is stored in the computer program that can be run in the memory and on the processor, computer described in the computing device
Realized during program as described in any one of first aspect the step of audio and video synchronization method.
The fourth aspect of the embodiment of the present invention provides a kind of computer-readable recording medium, the computer-readable storage
Media storage has computer program, realizes that the sound as described in any one of first aspect regards when the computer program is executed by processor
The step of frequency synchronous method.
Existing beneficial effect is the embodiment of the present invention compared with prior art：By setting audio frame buffer zone and video
Frame buffer zone buffers the audio, video data for broadcasting, and according to the timestamp of currently playing audio frame and frame of video when
Between difference, the speed and/or mode in the audio buffer are adjusted, so that the audio frame entered in decoder can be with
With video frame synchronization, so as to effectively solve the problems, such as video pictures mosaic, interim card or flower screen, and need not change
Video stream format, it can effectively save system resource overhead.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
In the required accompanying drawing used be briefly described, it should be apparent that, drawings in the following description be only the present invention some
Embodiment, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these
Accompanying drawing obtains other accompanying drawings.
Fig. 1 is a kind of implementation process schematic diagram of audio and video synchronization method provided in an embodiment of the present invention；
Fig. 2 is that a kind of implementation process of the audio/video frames way to play for time of audio frequency and video buffering area provided in an embodiment of the present invention is shown
It is intended to；
Fig. 3 is a kind of implementation process schematic diagram of time difference computational methods provided in an embodiment of the present invention；
Fig. 4 is a kind of realization stream that the audio frame sending method is adjusted according to time difference provided in an embodiment of the present invention
Journey schematic diagram；
Fig. 5 is a kind of schematic diagram of audio-visual synchronization device provided in an embodiment of the present invention；
Fig. 6 is the schematic diagram of audio-visual synchronization equipment provided in an embodiment of the present invention.
Embodiment
In describing below, in order to illustrate rather than in order to limit, it is proposed that such as tool of particular system structure, technology etc
Body details, thoroughly to understand the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention can also be realized in the other embodiments of details.In other situations, omit to well-known system, device, electricity
Road and the detailed description of method, in case unnecessary details hinders description of the invention.
In order to illustrate technical solutions according to the invention, illustrated below by specific embodiment.
A kind of implementation process schematic diagram of the audio and video synchronization method provided as shown in Figure 1 for the embodiment of the present application, it is described in detail
It is as follows：
In step S101, voice data and video to be synchronized are buffered respectively by audio buffer and screen buffer
Data；
Specifically, the application before audio decoder and Video Decoder, can set respectively audio buffer and
Screen buffer, audio frame to be played is buffered by audio buffer, video to be played is buffered by screen buffer
Frame, before audio frame and frame of video enter decoder, enter line access by unit of frame.
Simultaneously record queue sound intermediate frequency can be calculated by audio frame queue by setting audio frame queue and video frame queue
The interval of timestamps of frame, can set the frame period that goes out of acquiescence, and calculated by video frame queue and record frame of video when
Between stab interval.Group time that goes out of audio/video frames can be adjusted by way of dynamic control, can be entered by timer
After row audio/video frames synchronous regime calculates, dynamic judges whether audio/video frames need team and be sent to corresponding audio/video decoding
In device.
The audio/video frames queue (including audio frame queue and video frame queue) is used for record buffer in the buffering area
The audio frame and frame of video relevant information, including such as audio frame or frame of video the position in queue, and dynamic
Control audio frame and frame of video, judge whether audio/video frames need team, i.e., whether need to leave buffering area.
The application and release operation in the application audio buffer and the space of screen buffer (i.e. audio frequency and video buffering area), with
The associative operation of audio/video frames queue can be carried out independently, i.e. audio/video frames queue only need to be performed audio/video frames queue output rate control
System.
The application can carry out the effective peace for ensuring buffering in the following manner by buffering area and the design of queue
Quan Xing, including：
1. the processing frame number of audio frequency and video buffering area buffering is less than the frame number that audio frequency and video buffering section can accommodate, so as to really
Protecting queue can normally be performed, and avoid frame of video or audio frame effect of flood normal play；
2. when audio frequency and video buffering area (audio buffer and screen buffer) because abnormal factorses need to destroy whole buffering
During data in area, audio/video frames queue (audio frame queue and video frame queue) do it is synchronous destroy operation, it is invalid to avoid operating
Data occur it is abnormal；
3. the audio/video frames in audio frequency and video queue (audio frame queue and video frame queue) go out team, i.e. audio frequency and video are from buffering area
When being sent to decoder, when transmitting data to decoder, the step of being verified to data can be increased, if finding data invalid,
Current old data are then abandoned, obtain newest data.
In addition, as the application, preferably a kind of embodiment, the application can use the timer of predetermined time interval
To trigger and drive the buffering of audio/video frames and decoding.According to the timer, arrived at the time of set by each timer
When, the team that goes out that driving audio frequency and video line up to perform audio/video frames judges.
For example 5ms timer at equal intervals can be used.The gap length of timer and presentation of video frames time precision phase
Close, if the minimum value of current video frame frame period is 40ms, audio frame frame period minimum value is 23ms, then using 5ms timings
Device can effectively meet the driving required precision of frame of video and audio frame.
By the audio buffer and screen buffer, buffer protection can be formed to the audio frequency and video of broadcasting, avoid because
For network delay it is excessive caused by video cardton phenomenon, as Fig. 2 be the embodiment of the present application provide a kind of audio frequency and video buffering area
The implementation process of audio/video frames way to play for time, details are as follows：
In step s 201, the audio frame number that the audio buffer is buffered, and screen buffer institute are detected
The video frame number of buffering；
Detect the audio buffer and audio frame that screen buffer is buffered or frame of video number, so that it is determined that working as
The change of preceding broadcast state.
It is N_max that the maximum frame number that audio frequency and video buffering area is buffered, which can be preset, and audio frequency and video queue is according to advanced elder generation
The mode gone out records video frame information, can the storage address including the frame of video buffered in buffering area, frame sign, timestamp
Information etc..Audio frequency and video queue includes " pause plays " state and " broadcasting " state two states.
Under " pause plays " state, audio frequency and video queue only has the operation that audio/video frames information enters audio frequency and video queue,
Under " broadcasting " state, audio/video frames information has into audio frequency and video queue and left the operation of audio frequency and video queue.
In step S202, if the video frame number of buffering is more than the first predetermined buffer threshold, video frame queue enters
Enter broadcast state；
In step S203, if the audio frame number of buffering is also greater than the first predetermined buffer threshold, audio frame queue
Into broadcast state.
In step S204, if the video frame number of buffering is less than the second predetermined buffer threshold, video frame queue enters
Enter and suspend broadcast state, while audio frame queue sound intermediate frequency frame data go out team but are not sent into decoder.
Wherein, first buffer threshold is more than the second buffer threshold.
In step s 102, the timestamp and the timestamp of currently playing frame of video of currently playing audio frame are calculated
Time difference；
The timestamp of currently playing audio frame, the timestamp of the audio frame of team can be currently gone out by audio frame queue,
Determined with reference to the playing duration of the audio in audio decoder, the timestamp of the currently playing frame of video can basis
Video frame queue directly determines, specifically can with as shown in figure 3, including：
In step S301, the timestamp A of the newest audio frame for leaving audio buffer is obtained, and newest leaves video
The timestamp V of the frame of video of buffering area；
The current newest timestamp V for leaving screen buffer can be directly read by audio frequency and video queue, and currently most
The new timestamp A for leaving audio buffer.
In step s 302, according to remaining audio playing duration Ta in audio decoder, calculate currently in the audio broadcast
The timestamp Pa=A-Ta of frame；
According to the audio duration not decoded in decoder and audio duration to be played is decoded, it may be determined that decoder
In audio frame duration Ta to be played, according to the timestamp A of the newest audio frame for leaving audio buffer, and in decoder
Audio frame duration Ta to be played, you can obtain being currently Pa=A-Ta in the timestamp of the audio frame of broadcasting.
In step S303, according to the timestamp Pv=V of currently playing frame of video, currently playing audio frame is calculated
The time difference Td=Pa-Pv of timestamp and the timestamp of currently playing frame of video.
When calculating the net synchronization capability of audio/video frames queue, counted using the timestamp for the audio/video frames for currently having gone out team
Calculate, a wherein frame of video substantially picture, it goes out the timestamp of picture that the timestamp of team can represent to be currently played；
Wherein audio frame is substantially one section of continuous sampled voice data, it is necessary to according to the audio frame to be decoded in audio decoder
Surplus and at the time of decoded voice data to be played and calculate present video actual play, i.e., in queue it is newest go out team
The timestamp of audio frame subtracts the time margin of decoder sound intermediate frequency.
By the timestamp of currently playing audio frame, difference is sought with the timestamp of currently playing frame of video, obtains the time
Difference.When the time difference be on the occasion of when, then it represents that audio frame is faster than presentation of video frames, when the time difference is negative value
When, then it represents that audio frame is slower than presentation of video frames.
In step s 103, according to the time difference, adjust the audio buffer and send into audio decoder
Speed and/or mode.
It can set corresponding time threshold according to the tolerance of audio frame and the time difference of frame of video, pass through and compare
As a result, the queue output rate of the time interval, i.e. audio frame of the audio frame queue in the audio frequency and video buffering area is adjusted, specifically can be with
As shown in figure 4, including：
In step S401, if currently playing audio frame is advanced and the absolute value of the time difference be more than it is predetermined
Time threshold, then extend the time that current audio frame leaves buffering area, can be when secondary when by timer driver at equal intervals
Under timer, make audio frame not dequeued, i.e., audio frame is without departing from buffering area；
In step S402, if currently playing audio frame is backward and the absolute value of the time difference be more than it is predetermined
Time threshold, then present frame is left buffering area but be not sent into audio decoder., can be with when by timer driver at equal intervals
In the case where working as time timer, the audio frame of the head of the queue of audio frame queue is gone out team but be not sent into decoder, that is, leave audio frame buffering
Area but it is not sent into audio decoder.
When can make it that audio frame is advanced, by way of delay, the broadcasting speed of audio frame is reduced；When audio frame falls behind
When, by abandoning current audio frame, so that the timestamp that audio frame enters decoder with frame of video matches, realize that sound regards
Frequency is synchronous.
If currently playing audio frame and the time difference of frame of video are within a predetermined range, it may not be necessary to described in adjustment
Audio frame queue goes out group time.
By setting audio frame buffer zone and video frame buffers buffer audio, video data for broadcasting, and according to working as
The time difference of the audio frame of preceding broadcasting and the timestamp of frame of video, speed and/or mode in the audio buffer are adjusted,
So that the audio frame entered in decoder can with video frame synchronization, so as to effectively solve video pictures Marseille
Gram, interim card or the problem of flower screen, and the broadcast format of video flowing need not be changed, more agree with 1 tunnel voice-frequency-multichannel in NVR equipment
The application scenarios of video.
It should be understood that the size of the sequence number of each step is not meant to the priority of execution sequence, each process in above-described embodiment
Execution sequence should determine that the implementation process without tackling the embodiment of the present invention forms any limit with its function and internal logic
It is fixed.
Fig. 5 is a kind of structural representation for audio-visual synchronization device that the embodiment of the present application provides, and details are as follows：
Herein described audio-visual synchronization device, including：
Buffer cell 501, for by audio buffer and screen buffer buffer respectively voice data to be synchronized and
Video data；
Time difference computing unit 502, for the timestamp for calculating currently playing audio frame and currently playing video
The time difference of the timestamp of frame；
Adjustment unit 503, for according to the time difference, adjusting the audio buffer and sending into audio decoder
Speed and/or mode.
Preferably, the adjustment unit includes：
Extend subelement, make a reservation for if the absolute value of advanced for currently playing audio frame and described time difference is more than
Time threshold, then extend current audio frame and leave time of buffering area；
Subelement is abandoned, is made a reservation for if the absolute value of backward for currently playing audio frame and described time difference is more than
Time threshold, then present frame is left buffering area but be not sent into audio decoder.
Preferably, the time difference computing unit includes：
Very first time stamp obtains subelement, for obtaining the timestamp A of the newest audio frame for leaving audio buffer, and
The timestamp V of the newest frame of video for leaving screen buffer；
Second timestamp obtains subelement, for according to remaining audio playing duration Ta in audio decoder, calculating and working as
The preceding timestamp Pa=A-Ta in the audio frame broadcast；
Computation subunit, for the timestamp Pv=V according to currently playing frame of video, calculate currently playing audio frame
Timestamp and the timestamp of currently playing frame of video time difference Td=Pa-Pv.
Audio-visual synchronization device described in Fig. 5, it is corresponding with the audio and video synchronization method described in Fig. 1, it is not repeated repeat herein.
Fig. 6 is the schematic diagram for the audio-visual synchronization equipment that one embodiment of the invention provides.As shown in fig. 6, the embodiment
Audio-visual synchronization equipment 6 includes：Processor 60, memory 61 and it is stored in the memory 61 and can be in the processor
The computer program 62 run on 60, such as audio-visual synchronization program.When the processor 60 performs the computer program 62
Realize the step in above-mentioned each audio and video synchronization method embodiment, such as the step 101 shown in Fig. 1 is to 103.It is or described
Processor 60 realizes the function of each module/unit in above-mentioned each device embodiment, such as Fig. 5 when performing the computer program 62
The function of shown module 501 to 503.
Exemplary, the computer program 62 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 61, and are performed by the processor 60, to complete the present invention.Described one
Individual or multiple module/units can be the series of computation machine programmed instruction section that can complete specific function, and the instruction segment is used for
Implementation procedure of the computer program 62 in the audio-visual synchronization equipment 6 is described.For example, the computer program 62 can
To be divided into buffer cell, time difference computing unit and adjustment unit, each unit concrete function is as follows：
Buffer cell, for buffering voice data and video to be synchronized respectively by audio buffer and screen buffer
Data；
Time difference computing unit, for the timestamp for calculating currently playing audio frame and currently playing frame of video
The time difference of timestamp；
Adjustment unit, for according to the time difference, adjusting the audio buffer and sending into audio decoder
Speed and/or mode.
The audio-visual synchronization equipment 6 can be the meter such as desktop PC, notebook, palm PC and cloud server
Calculate equipment.The audio-visual synchronization equipment may include, but be not limited only to, processor 60, memory 61.Those skilled in the art can
To understand, Fig. 6 is only the example of audio-visual synchronization equipment 6, does not form the restriction to audio-visual synchronization equipment 6, can wrap
Include than illustrating more or less parts, either combine some parts or different parts, such as the audio-visual synchronization is set
It is standby to include input-output equipment, network access equipment, bus etc..
Alleged processor 60 can be CPU (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other PLDs, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng.
The memory 61 can be the internal storage unit of the audio-visual synchronization equipment 6, such as audio-visual synchronization is set
Standby 6 hard disk or internal memory.The memory 61 can also be the External memory equipment of the audio-visual synchronization equipment 6, such as institute
State the plug-in type hard disk being equipped with audio-visual synchronization equipment 6, intelligent memory card (Smart Media Card, SMC), secure digital
(Secure Digital, SD) blocks, flash card (Flash Card) etc..Further, the memory 61 can also both include
The internal storage unit of the audio-visual synchronization equipment 6 also includes External memory equipment.The memory 61 is described for storing
Other programs and data needed for computer program and the audio-visual synchronization equipment.The memory 61 can be also used for temporarily
When store the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work(
Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device are divided into different functional units or module, more than completion
The all or part of function of description.Each functional unit, module in embodiment can be integrated in a processing unit, also may be used
To be that unit is individually physically present, can also two or more units it is integrated in a unit, it is above-mentioned integrated
Unit can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.In addition, each function list
Member, the specific name of module are not limited to the protection domain of the application also only to facilitate mutually distinguish.Said system
The specific work process of middle unit, module, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and is not described in detail or remembers in some embodiment
The part of load, it may refer to the associated description of other embodiments.
Those of ordinary skill in the art are it is to be appreciated that the list of each example described with reference to the embodiments described herein
Member and algorithm steps, it can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
Performed with hardware or software mode, application-specific and design constraint depending on technical scheme.Professional and technical personnel
Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed
The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed device/terminal device and method, can be with
Realize by another way.For example, device described above/terminal device embodiment is only schematical, for example, institute
The division of module or unit is stated, only a kind of division of logic function, there can be other dividing mode when actually realizing, such as
Multiple units or component can combine or be desirably integrated into another system, or some features can be ignored, or not perform.Separately
A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be by some interfaces, device
Or INDIRECT COUPLING or the communication connection of unit, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated module/unit realized in the form of SFU software functional unit and as independent production marketing or
In use, it can be stored in a computer read/write memory medium.Based on such understanding, the present invention realizes above-mentioned implementation
All or part of flow in example method, by computer program the hardware of correlation can also be instructed to complete, described meter
Calculation machine program can be stored in a computer-readable recording medium, and the computer program can be achieved when being executed by processor
The step of stating each embodiment of the method..Wherein, the computer program includes computer program code, the computer program
Code can be source code form, object identification code form, executable file or some intermediate forms etc..Computer-readable Jie
Matter can include：Can carry any entity or device of the computer program code, recording medium, USB flash disk, mobile hard disk,
Magnetic disc, CD, computer storage, read-only storage (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It is it should be noted that described
The content that computer-readable medium includes can carry out appropriate increasing according to legislation in jurisdiction and the requirement of patent practice
Subtract, such as in some jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and
Telecommunication signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to foregoing reality
Example is applied the present invention is described in detail, it will be understood by those within the art that：It still can be to foregoing each
Technical scheme described in embodiment is modified, or carries out equivalent substitution to which part technical characteristic；And these are changed
Or replace, the essence of appropriate technical solution is departed from the spirit and scope of various embodiments of the present invention technical scheme, all should
Within protection scope of the present invention.
Claims (10)
1. a kind of audio and video synchronization method, it is characterised in that the audio and video synchronization method includes：
Buffer voice data and video data to be synchronized respectively by audio buffer and screen buffer；
Calculate the time difference of the timestamp and the timestamp of currently playing frame of video of currently playing audio frame；
According to the time difference, adjust the audio buffer and send speed and/or mode into audio decoder.
2. audio and video synchronization method according to claim 1, it is characterised in that described according to the time difference, adjustment
The audio buffer, which sends the step of speed and/or mode into audio decoder, to be included：
If currently playing audio frame is advanced and the absolute value of the time difference is more than predetermined time threshold, extends and work as
Preceding audio frame leaves the time of buffering area；
If currently playing audio frame is backward and the absolute value of the time difference is more than predetermined time threshold, make current
Frame leaves buffering area but is not sent into audio decoder.
3. audio and video synchronization method according to claim 1, it is characterised in that the currently playing audio frame of the calculating
The step of time difference of timestamp and the timestamp of currently playing frame of video, includes：
Obtain the timestamp A of the newest audio frame for leaving audio buffer, and the newest frame of video for leaving screen buffer
Timestamp V；
According to remaining audio playing duration Ta in audio decoder, calculate currently in the timestamp Pa=A- for the audio frame broadcast
Ta；
According to the timestamp Pv=V of currently playing frame of video, calculate the timestamp of currently playing audio frame with it is currently playing
Frame of video timestamp time difference Td=Pa-Pv.
4. audio and video synchronization method according to claim 1, it is characterised in that methods described also includes：
Detect the audio frame number that the audio buffer is buffered, and the video frame number that the screen buffer is buffered；
If the video frame number of buffering is more than the first predetermined buffer threshold, video frame queue enters broadcast state；
If the audio frame number of buffering enters broadcast state also greater than the first predetermined buffer threshold, audio frame queue；
If the video frame number of buffering is less than the second predetermined buffer threshold, video frame queue enters pause broadcast state, together
When audio frame queue sound intermediate frequency frame data go out team but be not sent into decoder.
5. according to the audio and video synchronization method described in claim any one of 1-4, it is characterised in that methods described also includes：
The audio buffer is left by the audio frame of audio buffer described in predetermined timer driver at equal intervals, and/or
The frame of video of screen buffer leaves the screen buffer.
6. a kind of audio-visual synchronization device, it is characterised in that the audio-visual synchronization device includes：
Buffer cell, for buffering voice data and video counts to be synchronized respectively by audio buffer and screen buffer
According to；
Time difference computing unit, for calculating timestamp and the time of currently playing frame of video of currently playing audio frame
The time difference of stamp；
Adjustment unit, for according to the time difference, adjusting the audio buffer and sending the speed into audio decoder
And/or mode.
7. audio-visual synchronization device according to claim 6, it is characterised in that the adjustment unit includes：
Extend subelement, if the absolute value of advanced for currently playing audio frame and described time difference is more than predetermined
Between threshold value, then extend current audio frame and leave time of buffering area；
Subelement is abandoned, if the absolute value of backward for currently playing audio frame and described time difference is more than predetermined
Between threshold value, then present frame is left buffering area but be not sent into audio decoder.
8. audio and video synchronization method according to claim 6, it is characterised in that the time difference computing unit includes：
Very first time stamp obtains subelement, for obtaining the timestamp A of the newest audio frame for leaving audio buffer, and it is newest
Leave the timestamp V of the frame of video of screen buffer；
Second timestamp obtains subelement, for currently being existed according to remaining audio playing duration Ta in audio decoder, calculating
The timestamp Pa=A-Ta for the audio frame broadcast；
Computation subunit, for the timestamp Pv=V according to currently playing frame of video, calculate currently playing audio frame when
Between stamp and the timestamp of currently playing frame of video time difference Td=Pa-Pv.
9. a kind of audio-visual synchronization equipment, including memory, processor and it is stored in the memory and can be at the place
The computer program run on reason device, it is characterised in that realize that right such as will described in the computing device during computer program
The step of seeking any one of 1 to 5 audio and video synchronization method.
10. a kind of computer-readable recording medium, the computer-readable recording medium storage has computer program, and its feature exists
In the step of realization audio and video synchronization method as described in any one of claim 1 to 5 when the computer program is executed by processor
Suddenly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711106765.3A CN107801080A (en) | 2017-11-10 | 2017-11-10 | A kind of audio and video synchronization method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711106765.3A CN107801080A (en) | 2017-11-10 | 2017-11-10 | A kind of audio and video synchronization method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107801080A true CN107801080A (en) | 2018-03-13 |
Family
ID=61534845
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711106765.3A Pending CN107801080A (en) | 2017-11-10 | 2017-11-10 | A kind of audio and video synchronization method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107801080A (en) |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108495164A (en) * | 2018-04-09 | 2018-09-04 | 珠海全志科技股份有限公司 | Audio-visual synchronization processing method and processing device, computer installation and storage medium |
| CN108616768A (en) * | 2018-05-02 | 2018-10-02 | 腾讯科技（上海）有限公司 | Synchronous broadcast method, device, storage location and the electronic device of multimedia resource |
| CN108769768A (en) * | 2018-05-29 | 2018-11-06 | 四川长虹网络科技有限责任公司 | DVB captioning synchronization method and system |
| CN109167890A (en) * | 2018-08-22 | 2019-01-08 | 青岛海信电器股份有限公司 | A kind of sound draws synchronous method and device and display equipment |
| CN109168059A (en) * | 2018-10-17 | 2019-01-08 | 上海赛连信息科技有限公司 | A kind of labial synchronization method playing audio & video respectively on different devices |
| CN109348247A (en) * | 2018-11-23 | 2019-02-15 | 广州酷狗计算机科技有限公司 | Determine the method, apparatus and storage medium of audio and video playing timestamp |
| CN110072137A (en) * | 2019-04-26 | 2019-07-30 | 湖南琴岛网络传媒科技有限公司 | A kind of data transmission method and transmitting device of net cast |
| CN110177294A (en) * | 2019-06-11 | 2019-08-27 | 亦非云互联网技术（上海）有限公司 | Player audio and video synchronization method and system, storage medium and terminal |
| CN110225385A (en) * | 2019-06-19 | 2019-09-10 | 鼎桥通信技术有限公司 | A kind of audio-visual synchronization method of adjustment and device |
| CN110493164A (en) * | 2018-05-15 | 2019-11-22 | 视联动力信息技术股份有限公司 | A kind for the treatment of method and apparatus of media packet |
| CN110519627A (en) * | 2018-05-21 | 2019-11-29 | 视联动力信息技术股份有限公司 | A kind of synchronous method and device of audio data |
| CN111277885A (en) * | 2020-03-09 | 2020-06-12 | 北京三体云时代科技有限公司 | Audio and video synchronization method and device, server and computer readable storage medium |
| CN111372138A (en) * | 2018-12-26 | 2020-07-03 | 杭州登虹科技有限公司 | Live broadcast low-delay technical scheme of player end |
| CN111464256A (en) * | 2020-04-14 | 2020-07-28 | 北京百度网讯科技有限公司 | Time stamp correction method and device, electronic equipment and storage medium |
| CN111654736A (en) * | 2020-06-10 | 2020-09-11 | 北京百度网讯科技有限公司 | Method and device for determining audio and video synchronization error, electronic equipment and storage medium |
| CN111669645A (en) * | 2020-06-12 | 2020-09-15 | 腾讯科技（深圳）有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN111726669A (en) * | 2019-03-18 | 2020-09-29 | 浙江宇视科技有限公司 | Distributed decoding equipment and audio and video synchronization method thereof |
| CN111757158A (en) * | 2020-06-29 | 2020-10-09 | 北京百度网讯科技有限公司 | Audio and video synchronous playing method, device, equipment and storage medium |
| CN112004133A (en) * | 2020-09-04 | 2020-11-27 | 成都极米科技股份有限公司 | Sound and picture synchronization method and device, projection equipment and readable storage medium |
| CN112511885A (en) * | 2020-11-20 | 2021-03-16 | 深圳乐播科技有限公司 | Audio and video synchronization method and device and storage medium |
| CN112995720A (en) * | 2019-12-16 | 2021-06-18 | 成都鼎桥通信技术有限公司 | Audio and video synchronization method and device |
| CN113079421A (en) * | 2020-01-03 | 2021-07-06 | 阿里巴巴集团控股有限公司 | Information processing method, device, equipment and storage medium |
| CN113596550A (en) * | 2021-08-31 | 2021-11-02 | 安徽创变信息科技有限公司 | Audio and video synchronization control method and device |
| CN114095771A (en) * | 2021-09-06 | 2022-02-25 | 贵阳语玩科技有限公司 | Audio and video synchronization method, storage medium and electronic equipment |
| CN114268830A (en) * | 2021-12-06 | 2022-04-01 | 咪咕文化科技有限公司 | Cloud director synchronization method, device, equipment and storage medium |
| CN114520907A (en) * | 2020-11-20 | 2022-05-20 | 湖北微模式科技发展有限公司 | Method and device for detecting whether audio stream and video stream are synchronous |
| CN114866830A (en) * | 2022-03-30 | 2022-08-05 | 中国经济信息社有限公司 | Audio and video synchronization method and device and computer readable storage medium |
| CN114974321A (en) * | 2021-02-27 | 2022-08-30 | 华为技术有限公司 | Audio playing method, equipment and system |
| CN115174980A (en) * | 2022-06-21 | 2022-10-11 | 浪潮卓数大数据产业发展有限公司 | Audio and video synchronization method, device, equipment and medium based on security queue |
| CN115474082A (en) * | 2022-10-13 | 2022-12-13 | 闪耀现实(无锡)科技有限公司 | Method and apparatus for playing media data, system, vehicle, device and medium |
| CN115484483A (en) * | 2022-08-26 | 2022-12-16 | 广东万通信息科技有限公司 | Streaming media audio and video synchronization method, terminal equipment, control device and medium |
| CN115720278A (en) * | 2022-11-03 | 2023-02-28 | 深圳创维－Rgb电子有限公司 | Synchronous processing method of sound and picture and related device |
| CN115866309A (en) * | 2022-11-29 | 2023-03-28 | 广州后为科技有限公司 | Audio and video caching method and device supporting multi-channel video synchronization |
| CN116958331A (en) * | 2023-09-20 | 2023-10-27 | 四川蜀天信息技术有限公司 | Sound and picture synchronization adjusting method and device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101207822A (en) * | 2006-12-22 | 2008-06-25 | 上海晨兴电子科技有限公司 | Method for synchronization of audio frequency and video frequency of stream media terminal |
| CN102404650A (en) * | 2011-11-30 | 2012-04-04 | 江苏奇异点网络有限公司 | Method for synchronously controlling audio and video of online video |
| CN102802075A (en) * | 2012-08-24 | 2012-11-28 | 乐视网信息技术（北京）股份有限公司 | Online play buffering system and method |
| CN102868939A (en) * | 2012-09-10 | 2013-01-09 | 杭州电子科技大学 | Method for synchronizing audio/video data in real-time video monitoring system |
| CN103338386A (en) * | 2013-07-10 | 2013-10-02 | 航天恒星科技有限公司 | Audio and video synchronization method based on simplified timestamps |
-
2017
- 2017-11-10 CN CN201711106765.3A patent/CN107801080A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101207822A (en) * | 2006-12-22 | 2008-06-25 | 上海晨兴电子科技有限公司 | Method for synchronization of audio frequency and video frequency of stream media terminal |
| CN102404650A (en) * | 2011-11-30 | 2012-04-04 | 江苏奇异点网络有限公司 | Method for synchronously controlling audio and video of online video |
| CN102802075A (en) * | 2012-08-24 | 2012-11-28 | 乐视网信息技术（北京）股份有限公司 | Online play buffering system and method |
| CN102868939A (en) * | 2012-09-10 | 2013-01-09 | 杭州电子科技大学 | Method for synchronizing audio/video data in real-time video monitoring system |
| CN103338386A (en) * | 2013-07-10 | 2013-10-02 | 航天恒星科技有限公司 | Audio and video synchronization method based on simplified timestamps |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108495164B (en) * | 2018-04-09 | 2021-01-29 | 珠海全志科技股份有限公司 | Audio and video synchronization processing method and device, computer device and storage medium |
| CN108495164A (en) * | 2018-04-09 | 2018-09-04 | 珠海全志科技股份有限公司 | Audio-visual synchronization processing method and processing device, computer installation and storage medium |
| CN108616768A (en) * | 2018-05-02 | 2018-10-02 | 腾讯科技（上海）有限公司 | Synchronous broadcast method, device, storage location and the electronic device of multimedia resource |
| CN108616768B (en) * | 2018-05-02 | 2021-10-15 | 腾讯科技（上海）有限公司 | Synchronous playing method and device of multimedia resources, storage position and electronic device |
| CN110493164A (en) * | 2018-05-15 | 2019-11-22 | 视联动力信息技术股份有限公司 | A kind for the treatment of method and apparatus of media packet |
| CN110519627B (en) * | 2018-05-21 | 2021-05-14 | 视联动力信息技术股份有限公司 | Audio data synchronization method and device |
| CN110519627A (en) * | 2018-05-21 | 2019-11-29 | 视联动力信息技术股份有限公司 | A kind of synchronous method and device of audio data |
| CN108769768A (en) * | 2018-05-29 | 2018-11-06 | 四川长虹网络科技有限责任公司 | DVB captioning synchronization method and system |
| WO2020038344A1 (en) * | 2018-08-22 | 2020-02-27 | 青岛海信电器股份有限公司 | Method and device for audio and video synchronization, and display apparatus |
| CN109167890A (en) * | 2018-08-22 | 2019-01-08 | 青岛海信电器股份有限公司 | A kind of sound draws synchronous method and device and display equipment |
| CN109167890B (en) * | 2018-08-22 | 2021-03-05 | 海信视像科技股份有限公司 | Sound and picture synchronization method and device and display equipment |
| CN109168059A (en) * | 2018-10-17 | 2019-01-08 | 上海赛连信息科技有限公司 | A kind of labial synchronization method playing audio & video respectively on different devices |
| CN113286184A (en) * | 2018-10-17 | 2021-08-20 | 上海赛连信息科技有限公司 | Lip sound synchronization method for respectively playing audio and video on different devices |
| CN113286184B (en) * | 2018-10-17 | 2024-01-30 | 上海赛连信息科技有限公司 | Lip synchronization method for respectively playing audio and video on different devices |
| CN109168059B (en) * | 2018-10-17 | 2021-06-18 | 上海赛连信息科技有限公司 | Lip sound synchronization method for respectively playing audio and video on different devices |
| CN109348247A (en) * | 2018-11-23 | 2019-02-15 | 广州酷狗计算机科技有限公司 | Determine the method, apparatus and storage medium of audio and video playing timestamp |
| CN111372138A (en) * | 2018-12-26 | 2020-07-03 | 杭州登虹科技有限公司 | Live broadcast low-delay technical scheme of player end |
| CN111726669B (en) * | 2019-03-18 | 2022-12-23 | 浙江宇视科技有限公司 | Distributed decoding equipment and audio and video synchronization method thereof |
| CN111726669A (en) * | 2019-03-18 | 2020-09-29 | 浙江宇视科技有限公司 | Distributed decoding equipment and audio and video synchronization method thereof |
| CN110072137A (en) * | 2019-04-26 | 2019-07-30 | 湖南琴岛网络传媒科技有限公司 | A kind of data transmission method and transmitting device of net cast |
| CN110072137B (en) * | 2019-04-26 | 2021-06-08 | 湖南琴岛网络传媒科技有限公司 | Data transmission method and device for live video |
| CN110177294A (en) * | 2019-06-11 | 2019-08-27 | 亦非云互联网技术（上海）有限公司 | Player audio and video synchronization method and system, storage medium and terminal |
| CN110225385A (en) * | 2019-06-19 | 2019-09-10 | 鼎桥通信技术有限公司 | A kind of audio-visual synchronization method of adjustment and device |
| CN112995720B (en) * | 2019-12-16 | 2022-11-18 | 成都鼎桥通信技术有限公司 | Audio and video synchronization method and device |
| CN112995720A (en) * | 2019-12-16 | 2021-06-18 | 成都鼎桥通信技术有限公司 | Audio and video synchronization method and device |
| CN113079421B (en) * | 2020-01-03 | 2023-10-24 | 阿里巴巴集团控股有限公司 | Information processing method, device, equipment and storage medium |
| CN113079421A (en) * | 2020-01-03 | 2021-07-06 | 阿里巴巴集团控股有限公司 | Information processing method, device, equipment and storage medium |
| CN111277885A (en) * | 2020-03-09 | 2020-06-12 | 北京三体云时代科技有限公司 | Audio and video synchronization method and device, server and computer readable storage medium |
| CN111464256A (en) * | 2020-04-14 | 2020-07-28 | 北京百度网讯科技有限公司 | Time stamp correction method and device, electronic equipment and storage medium |
| CN111654736A (en) * | 2020-06-10 | 2020-09-11 | 北京百度网讯科技有限公司 | Method and device for determining audio and video synchronization error, electronic equipment and storage medium |
| CN111669645B (en) * | 2020-06-12 | 2021-09-07 | 腾讯科技（深圳）有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN111669645A (en) * | 2020-06-12 | 2020-09-15 | 腾讯科技（深圳）有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN111757158A (en) * | 2020-06-29 | 2020-10-09 | 北京百度网讯科技有限公司 | Audio and video synchronous playing method, device, equipment and storage medium |
| CN112004133A (en) * | 2020-09-04 | 2020-11-27 | 成都极米科技股份有限公司 | Sound and picture synchronization method and device, projection equipment and readable storage medium |
| CN114520907A (en) * | 2020-11-20 | 2022-05-20 | 湖北微模式科技发展有限公司 | Method and device for detecting whether audio stream and video stream are synchronous |
| CN112511885A (en) * | 2020-11-20 | 2021-03-16 | 深圳乐播科技有限公司 | Audio and video synchronization method and device and storage medium |
| CN114974321A (en) * | 2021-02-27 | 2022-08-30 | 华为技术有限公司 | Audio playing method, equipment and system |
| CN114974321B (en) * | 2021-02-27 | 2023-11-03 | 华为技术有限公司 | Audio playing method, equipment and system |
| CN113596550B (en) * | 2021-08-31 | 2024-05-24 | 小帧科技(深圳)有限公司 | Audio and video synchronous control method and device |
| CN113596550A (en) * | 2021-08-31 | 2021-11-02 | 安徽创变信息科技有限公司 | Audio and video synchronization control method and device |
| CN114095771B (en) * | 2021-09-06 | 2024-04-02 | 贵阳语玩科技有限公司 | Audio and video synchronization method, storage medium and electronic equipment |
| CN114095771A (en) * | 2021-09-06 | 2022-02-25 | 贵阳语玩科技有限公司 | Audio and video synchronization method, storage medium and electronic equipment |
| CN114268830B (en) * | 2021-12-06 | 2024-05-24 | 咪咕文化科技有限公司 | Cloud guide synchronization method, device, equipment and storage medium |
| CN114268830A (en) * | 2021-12-06 | 2022-04-01 | 咪咕文化科技有限公司 | Cloud director synchronization method, device, equipment and storage medium |
| CN114866830A (en) * | 2022-03-30 | 2022-08-05 | 中国经济信息社有限公司 | Audio and video synchronization method and device and computer readable storage medium |
| CN115174980A (en) * | 2022-06-21 | 2022-10-11 | 浪潮卓数大数据产业发展有限公司 | Audio and video synchronization method, device, equipment and medium based on security queue |
| CN115484483A (en) * | 2022-08-26 | 2022-12-16 | 广东万通信息科技有限公司 | Streaming media audio and video synchronization method, terminal equipment, control device and medium |
| CN115474082A (en) * | 2022-10-13 | 2022-12-13 | 闪耀现实(无锡)科技有限公司 | Method and apparatus for playing media data, system, vehicle, device and medium |
| CN115720278A (en) * | 2022-11-03 | 2023-02-28 | 深圳创维－Rgb电子有限公司 | Synchronous processing method of sound and picture and related device |
| CN115866309B (en) * | 2022-11-29 | 2023-09-22 | 广州后为科技有限公司 | Audio and video caching method and device supporting multipath video synchronization |
| CN115866309A (en) * | 2022-11-29 | 2023-03-28 | 广州后为科技有限公司 | Audio and video caching method and device supporting multi-channel video synchronization |
| CN116958331A (en) * | 2023-09-20 | 2023-10-27 | 四川蜀天信息技术有限公司 | Sound and picture synchronization adjusting method and device and electronic equipment |
| CN116958331B (en) * | 2023-09-20 | 2024-01-19 | 四川蜀天信息技术有限公司 | Sound and picture synchronization adjusting method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107801080A (en) | A kind of audio and video synchronization method, device and equipment | |
| US8762580B2 (en) | Common event-based multidevice media playback | |
| US9338208B2 (en) | Common event-based multidevice media playback | |
| CN111246178B (en) | Video processing method and device, storage medium and electronic device | |
| CN108495164B (en) | Audio and video synchronization processing method and device, computer device and storage medium | |
| CN110581973B (en) | Data playback method and device, terminal equipment and storage medium | |
| US10856018B2 (en) | Clock synchronization techniques including modification of sample rate conversion | |
| EP2955930B1 (en) | Method and device for estimating temporary storage status | |
| CN112154669B (en) | Correlation of video stream frame timestamps based on system clock | |
| CN106533399B (en) | Circuit and method for modifying clock signal and device for executing time-sensitive task | |
| WO2017166587A1 (en) | Method and device for audio/video data processing and vehicle-mounted terminal | |
| CN107277594A (en) | A kind of video and audio and barrage synchronous method and device | |
| CN107040549A (en) | A kind of TCP packet splicings processing method, server and system | |
| EP2920953A1 (en) | Common event-based multidevice media playback | |
| CN107566889A (en) | Audio stream flow rate error processing method, device, computer installation and computer-readable recording medium | |
| US10708033B2 (en) | Network time correction method and apparatus | |
| CN104113778B (en) | A kind of method for decoding video stream and device | |
| CN108289232B (en) | Control method of playing device, terminal device and storage medium | |
| CN108401190A (en) | A kind of method and apparatus for being marked in real time to video frame | |
| WO2024099194A1 (en) | Voice processing method and apparatus, electronic device, and storage medium | |
| CN106533598B (en) | Circuit and method for estimating occurrence time difference between events, and computer-readable storage medium | |
| WO2023078232A1 (en) | Transmission method and apparatus | |
| WO2016183955A1 (en) | Speech synchronization method and device | |
| US20180042036A1 (en) | Dejittering system | |
| CN110177294A (en) | Player audio and video synchronization method and system, storage medium and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180313 |