WO2018045682A1 - Method and device for testing audio and picture synchronization - Google Patents

Method and device for testing audio and picture synchronization Download PDF

Info

Publication number
WO2018045682A1
WO2018045682A1 PCT/CN2016/112984 CN2016112984W WO2018045682A1 WO 2018045682 A1 WO2018045682 A1 WO 2018045682A1 CN 2016112984 W CN2016112984 W CN 2016112984W WO 2018045682 A1 WO2018045682 A1 WO 2018045682A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
frame number
audio
current
frame
Prior art date
Application number
PCT/CN2016/112984
Other languages
French (fr)
Chinese (zh)
Inventor
刘桂芳
平安
Original Assignee
深圳Tcl数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl数字技术有限公司 filed Critical 深圳Tcl数字技术有限公司
Publication of WO2018045682A1 publication Critical patent/WO2018045682A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation
    • H04N7/52—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched

Definitions

  • the invention relates to the technical field of audio and video testing, and in particular to a method and device for synchronizing audio and video.
  • the common way to test audio and video synchronization is to watch TV on the tester and compare whether the lips of the characters in the video picture and the sounds heard are synchronized. Due to the individual differences of the testers, there will be an error of about 200ms, and many enthusiasts can not tolerate the error of 200ms and cause complaints. Therefore, it is necessary to objectively test whether the video and audio of the video are synchronized.
  • the existing method of objectively synchronizing the sound and picture can only be the standard test signal of the black and white field, but can not test the video actually viewed by the user, and the test of the standard test signal cannot accurately represent the actual viewing of the user. Whether the audio and video of the video is synchronized, the detection process is not simple enough.
  • the invention provides a sound and picture synchronization test method and device, aiming at solving the technical problem that the existing sound picture synchronous test method is not objective, accurate and simple.
  • the present invention provides a method for synchronizing audio and video, and the method for synchronizing audio and video includes:
  • the audio signal is determined as a check point from no-to-sometime corresponding playback time, and the first frame number corresponding to each checkpoint is obtained from the video after adding the frame number.
  • the terminal plays the video with the frame number added
  • the audio signal is detected from the Nth time to the Nth time
  • the second frame number corresponding to the current video picture is acquired, and the Nth check point corresponding to the playback time is sorted according to the playback time.
  • the first frame number, the currently obtained second frame number, and the preset first threshold value determine whether the current audio and video is synchronized; wherein the values of N are 1, 2, 3, .
  • the step of determining whether the current audio and video is synchronized according to the first frame number corresponding to the Nth check point arranged in ascending order according to the playing time, the currently acquired second frame number, and the preset first threshold value includes: :
  • the audio signal is determined as a check point from no-to-sometime corresponding playback time, and each check point is obtained from the video after adding the frame number.
  • the steps of the first frame numbering include:
  • the intensity of the audio signal is detected in real time
  • the video frame corresponding to the current checkpoint is parsed from the video after the frame number is added to obtain the frame number, and the obtained frame number is used as the first frame number corresponding to the current checkpoint.
  • the audio and video synchronization test method further includes:
  • the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
  • the step of acquiring the second frame number corresponding to the current video picture when the audio signal is detected from the Nth to the Nth time includes:
  • the intensity of the audio signal is detected in real time when the terminal plays the video with the frame number added;
  • the current video frame is captured by the preset camera
  • the captured video frame is subjected to image processing to acquire a frame number on the video screen, and the obtained frame number is used as a second frame number corresponding to the current video screen.
  • the present invention further provides an audio and video synchronization testing device, where the audio and video synchronization testing device includes:
  • a video processing module configured to sequentially add a frame number in each frame of the video
  • a checkpoint determining module configured to determine, when the audio data of the video is read by the audio decoder, a playback time of the audio signal from no to sometimes corresponding to a checkpoint, and obtain each checkpoint from the video after adding the frame number Corresponding first frame numbers;
  • the synchronization test module is configured to: when the terminal plays the video with the added frame number, when the Nth detected the audio signal from the end to the time, obtain the second frame number corresponding to the current video frame, and arrange the data according to the playback time in ascending order.
  • the first frame number corresponding to the N checkpoints, the currently obtained second frame number, and the preset first threshold value determine whether the current audio and video is synchronized; wherein the values of N are 1, 2, 3, .
  • the synchronization test module includes a determination unit, and the determination unit is configured to:
  • the checkpoint determining module comprises:
  • a detecting unit configured to detect the intensity of the audio signal in real time when the audio data of the video is read by the audio decoder
  • a determining unit configured to determine a play time corresponding to the current audio signal as a check point when detecting that the strength of the audio signal changes from zero to a preset second threshold
  • an obtaining unit configured to parse the video frame corresponding to the current checkpoint from the video after adding the frame number to obtain a frame number, and use the obtained frame number as the first frame number corresponding to the current checkpoint.
  • the video processing module is specifically configured to:
  • the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
  • the synchronization test module includes a detection unit, and the detection unit includes:
  • the detecting subunit is configured to detect the intensity of the audio signal in real time when the terminal plays the video with the frame number added;
  • a capture subunit configured to capture a current video frame by using a preset camera when detecting that the intensity of the audio signal changes from zero to a preset third threshold
  • the acquiring sub-unit is configured to perform image processing on the captured video picture to obtain a frame number on the video picture, and use the obtained frame number as a second frame number corresponding to the current video picture.
  • the method and device for synchronizing sound and picture proposed by the present invention sequentially add frame numbers in each frame of the video, and then read the audio data of the video through the audio decoder to determine the checkpoint of the audio signal from no time to time. And acquiring the first frame number corresponding to each checkpoint from the video after adding the frame encoding; when playing the video with the added frame number on the terminal, when the audio signal is detected from the Nth to the Nth time, the current video image is acquired. Corresponding second frame number, and determining whether the current audio and video is synchronized according to the first frame number corresponding to the Nth check point, the currently acquired second frame number, and the preset first threshold according to the playback time. .
  • the video used in the test may be any video actually viewed by the user, and when there is a re-sound at the same sound pause, the difference between the frame number that should be played at this time and the frame number currently being played is compared, thereby realizing the actual user. Watch the video for an objective, accurate, and simple audio and video synchronization test.
  • FIG. 1 is a schematic flow chart of a first embodiment of a sound and picture synchronization test method according to the present invention
  • FIG. 2 is a schematic diagram of a refinement process of step S20 in FIG. 1;
  • FIG. 3 is a schematic diagram of a refinement process for obtaining a second frame number corresponding to a current video picture in a third embodiment of the audio and video synchronization test method according to the present invention
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of an audio and video synchronization test apparatus according to the present invention
  • FIG. 5 is a schematic diagram of a refinement function module of the checkpoint determining module in FIG. 4;
  • FIG. 6 is a schematic diagram of a refinement function module of a synchronization test module in a third embodiment of the audio and video synchronization test apparatus of the present invention.
  • the present invention provides a sound and picture synchronization test method. As shown in FIG. 1 , a flow chart of a first embodiment of the sound and picture synchronization test method of the present invention is shown.
  • the sound and picture synchronization test method includes:
  • a video that is any video that the user actually watches. It can be a complete long video or a small video captured from a complete long video. .
  • the audio signal is determined as a check point from no-to-sometime corresponding playback time, and the first corresponding to each checkpoint is obtained from the video after adding the frame number.
  • step S20 includes:
  • the video includes image data (ie, video frame data) and audio data, and the data is stored in the same data packet.
  • image data ie, video frame data
  • audio data When the image needs to be read, the image data in the data packet is parsed, and when the audio data needs to be read, When parsing the audio data in the packet.
  • the audio data of the video segment (which may also refer to the video after adding the frame number) is read by the audio decoder, the audio signal corresponding to each playing time of the audio data (consistent with the playing time of the video segment) may be obtained. .
  • the playback time corresponding to the audio signal is determined as a checkpoint, and the video frame corresponding to the current checkpoint is parsed from the video after adding the frame number to obtain the frame number in the video frame, and the obtained frame number is The first frame number corresponding to the current checkpoint (ie, the current play time).
  • the first frame number is a frame number of a video frame corresponding to each checkpoint in the video;
  • the second threshold is a preset audio signal strength value, and the audio signal indicating that the intensity value exceeds the second threshold belongs to The audio signal of the sound.
  • the terminal may be a television set, or a hardware device such as a mobile phone that can play video and needs to process image display and audio play of the video.
  • the second frame number is a type of frame number used to distinguish the first frame number, and represents a frame number acquired when the video is played through the terminal.
  • the values of N are 1, 2, 3, ... in order.
  • the video during the test is the TS (Transport) obtained after the live digital signal actually received by the TV is processed.
  • the real-time audio signal and the video frame data can be obtained.
  • the audio signal is detected from scratch, that is, the intensity of the audio signal changes from zero to a preset third threshold, the current video is acquired on the one hand.
  • the second frame number of the video frame to which the picture belongs and on the other hand, according to the order in which the audio signal is detected from the end, that is, the Nth time, the Nth check point and the play time are sorted in ascending order.
  • the first frame number corresponding to the checkpoint ie, the playback time at which the sound is re-sounded at the Nth sound pause in the synchronous playback of the audio and video
  • the threshold determines whether the current audio and video are synchronized.
  • the third threshold is also an audio signal strength value set in advance, and the value may be the same as or different from the second threshold.
  • the preset first threshold is the time difference value and the value is 500 ms
  • the absolute difference between the first frame number and the second frame number is The value is
  • 36
  • the sound and picture synchronization test method proposed by the invention adds the frame number sequentially in each frame of the video, and then reads the audio data of the video through the audio decoder to determine the checkpoint of the audio signal from no time to time, and from Adding a frame-encoded video to obtain a first frame number corresponding to each checkpoint; when playing a video with a frame number added on the terminal, when the audio signal is detected from the Nth time to the Nth time, the current video picture is acquired.
  • the second frame number is determined according to the first frame number corresponding to the Nth check point arranged in ascending order, the currently acquired second frame number, and the preset first threshold value, and whether the current audio and video is synchronized.
  • the video used in the test may be any video actually viewed by the user, and when there is a re-sound at the same sound pause, the difference between the frame number that should be played at this time and the frame number currently being played is compared, thereby realizing the actual user. Watch the video for an objective, accurate, and simple audio and video synchronization test.
  • the second embodiment of the sound and picture synchronization test method of the present invention is proposed based on the first embodiment of the above-described sound and picture synchronization test method.
  • the Nth check point corresponding to the play time is arranged in ascending order.
  • a frame number, a currently obtained second frame number, a preset first threshold, and a step of determining whether the current audio clip is synchronized includes:
  • the first threshold is a threshold set for an absolute difference of frame numbers. Assume that the first frame number currently obtained is 950, the second frame number is 986, and the first threshold value is 30, and the absolute difference of the frame number is
  • 36, which is greater than the preset first threshold value 30, It is thus possible to determine that the current picture is out of sync. Further, the played video can be synchronized with the sound and picture according to the absolute difference of the frame number.
  • the sound and picture synchronization test method proposed by the present invention calculates the absolute difference between the first frame number and the second frame number, and compares the calculated absolute difference with the preset first threshold value to determine the current sound. Whether the painting is synchronized, the judgment process is simple and fast, and the judgment result is accurate.
  • the third embodiment of the sound and picture synchronization test method of the present invention is proposed based on the second embodiment of the sound and picture synchronization test method.
  • the sound and picture synchronization test method further includes:
  • the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
  • the frame number 1 can be displayed at a specified position (such as the lower right corner) of the video frame corresponding to the first frame of the video, and the same position of the video frame corresponding to the second frame of the video.
  • Can display frame number 2 and so on.
  • the step of acquiring the second frame number corresponding to the current video picture includes:
  • the serial port connection with the terminal can be used to obtain the real-time audio signal intensity from the audio processing device (such as a speaker) of the terminal, and can also capture the sound during video playback through a device such as a microphone, thereby obtaining real-time audio.
  • the strength of the signal can be used to obtain the real-time audio signal intensity from the audio processing device (such as a speaker) of the terminal, and can also capture the sound during video playback through a device such as a microphone, thereby obtaining real-time audio. The strength of the signal.
  • the preset video camera is used to align the video picture of the video, and when the audio signal is detected from scratch, the intensity of the audio signal changes from zero to over the preset.
  • the control camera captures the current video frame.
  • the frame number on the video picture is extracted by using image processing technology, and the extracted frame number is the second frame number corresponding to the current video picture.
  • the control frame number is displayed at a specified position of the corresponding video picture when the terminal plays the video, so that the tester can intuitively view the respective test points (ie, the audio signal from none to the time) corresponding to the video picture.
  • the frame number is obtained, and the frame number can be captured by a preset camera to obtain the second frame number required for the test.
  • the present invention also provides a sound and picture synchronization testing device. As shown in FIG. 4, a schematic diagram of a functional module of the first embodiment of the audio and video synchronization testing device of the present invention is shown.
  • the audio and video synchronization testing device includes:
  • the video processing module 100 is configured to sequentially add a frame number in each frame of the video;
  • a video that is any video that the user actually watches. It can be a complete long video or a small video captured from a complete long video. .
  • the video processing module 100 may number 1- 30000 is sequentially added to each frame of the video according to the order of the video frames, that is, the first frame of the video is numbered 1, the second frame is numbered 2, the 800th frame is numbered 800, and so on.
  • the added frame number can be stored in the video frame data corresponding to each frame.
  • the checkpoint determining module 200 is configured to determine, when the audio data of the video is read by the audio decoder, a playback time of the audio signal from no to sometimes corresponding to a checkpoint, and obtain each check from the video after adding the frame number. Point each corresponding first frame number;
  • the checkpoint determining module 200 includes:
  • the detecting unit 201 is configured to detect the intensity of the audio signal in real time when the audio data of the video is read by the audio decoder;
  • the determining unit 202 is configured to determine, when the intensity of the audio signal is changed from zero to exceed a preset second threshold, a play time corresponding to the current audio signal as a checkpoint;
  • the obtaining unit 203 is configured to parse the video frame corresponding to the current checkpoint from the video after adding the frame number to obtain the frame number, and use the obtained frame number as the first frame number corresponding to the current checkpoint.
  • the video includes image data (ie, video frame data) and audio data, and the data is stored in the same data packet.
  • image data ie, video frame data
  • audio data When the image needs to be read, the image data in the data packet is parsed, and when the audio data needs to be read, When parsing the audio data in the packet.
  • the audio data of the video segment (which may also refer to the video after adding the frame number) is read by the audio decoder, the audio signal corresponding to each playing time of the audio data (consistent with the playing time of the video segment) may be obtained. .
  • the detecting unit 201 detects the intensity of the audio signal in the reading process in real time, and the determining unit 202 detects that the audio signal is from nothing, that is, the intensity of the audio signal changes from zero to a higher value, and the value is greater than
  • the playback time corresponding to the audio signal is determined as a checkpoint
  • the obtaining unit 203 parses the video frame corresponding to the current checkpoint from the video after adding the frame number to obtain the video frame.
  • Frame number, the obtained frame number is the current check point (that is, the current play time), and the corresponding first frame number.
  • the first frame number is a frame number of a video frame corresponding to each checkpoint in the video;
  • the second threshold is a preset audio signal strength value, and the audio signal indicating that the intensity value exceeds the second threshold belongs to The audio signal of the sound.
  • the synchronization test module 300 is configured to: when the terminal plays the video with the frame number added, when the audio signal is detected from the Nth time to the Nth time, the second frame number corresponding to the current video picture is obtained, and is arranged in ascending order according to the playing time.
  • the first frame number corresponding to the Nth checkpoint, the currently acquired second frame number, and the preset first threshold value determine whether the current audio and video is synchronized.
  • the terminal may be a television set, or a hardware device such as a mobile phone that can play video and needs to process image display and audio play of the video.
  • the second frame number is a type of frame number used to distinguish the first frame number, and represents a frame number acquired when the video is played through the terminal.
  • the values of N are 1, 2, 3, ... in order.
  • the video at the time of the test is a TS video file obtained by processing the live digital signal actually received by the television.
  • the video after adding the frame number is played on the television.
  • the synchronous test module 300 can be connected to the television through the serial cable to obtain the required data.
  • the synchronization test module 300 can obtain the real-time audio signal and the video frame data.
  • the aspect obtains the second frame number of the video frame to which the current video picture belongs, and on the other hand, according to the order in which the audio signal is detected from scratch, that is, the Nth time, the check point determined before the acquisition and the play time are arranged in ascending order.
  • the first frame number corresponding to the Nth checkpoint ie, the playback time at which the sound is re-sound at the Nth sound pause in the synchronous playback of the audio and video
  • the first threshold is set to determine whether the current audio and video are synchronized.
  • the third threshold is also an audio signal strength value set in advance, and the value may be the same as or different from the second threshold.
  • the synchronization test module 300 can determine that the current audio and video are not synchronized. Further, the played video can be synchronously corrected according to the calculated time difference.
  • the audio-visual synchronization test device proposed by the present invention sequentially adds a frame number in each frame of the video, and then reads the audio data of the video through the audio decoder to determine the checkpoint of the audio signal from no time to time, and from Adding a frame-encoded video to obtain a first frame number corresponding to each checkpoint; when playing a video with a frame number added on the terminal, when the audio signal is detected from the Nth time to the Nth time, the current video picture is acquired.
  • the second frame number is determined according to the first frame number corresponding to the Nth check point arranged in ascending order, the currently acquired second frame number, and the preset first threshold value, and whether the current audio and video is synchronized.
  • the video used in the test may be any video actually viewed by the user, and when there is a re-sound at the same sound pause, the difference between the frame number that should be played at this time and the frame number currently being played is compared, thereby realizing the actual user. Watch the video for an objective, accurate, and simple audio and video synchronization test.
  • the second embodiment of the sound and picture synchronization test apparatus of the present invention is proposed based on the first embodiment of the audio and video synchronization test apparatus.
  • the synchronization test module 300 includes a determination unit 301, and the determination unit 301 uses to:
  • the first threshold is a threshold set for an absolute difference of frame numbers. Assume that the first frame number currently obtained is 950, the second frame number is 986, and the first threshold value is 30, and the absolute difference of the frame number is
  • 36, which is greater than the preset first threshold value 30, Therefore, the judging unit 301 can judge that the current sound and picture are not synchronized. Further, the played video can be synchronized with the sound and picture according to the absolute difference of the frame number.
  • the audio-visual synchronization testing device of the present invention calculates the absolute difference between the first frame number and the second frame number, and compares the calculated absolute difference with the preset first threshold value to determine the current sound. Whether the painting is synchronized, the judgment process is simple and fast, and the judgment result is accurate.
  • the third embodiment of the sound and picture synchronization testing device of the present invention is proposed based on the second embodiment of the audio and video synchronization testing device.
  • the video processing module 100 is specifically configured to:
  • the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
  • the frame number 1 can be displayed at a specified position (such as the lower right corner) of the video frame corresponding to the first frame of the video, and the same position of the video frame corresponding to the second frame of the video.
  • Can display frame number 2 and so on.
  • the synchronization test module 300 further includes a detection unit 302, and the detection unit 302 includes:
  • the detecting subunit is configured to detect the intensity of the audio signal in real time when the terminal plays the video with the frame number added;
  • the serial port connection with the terminal can be used to obtain the real-time audio signal strength from the audio processing device (such as a speaker) of the terminal, and can also capture the sound during video playback through a device such as a microphone, thereby enabling the detection subunit. Get the strength of the real-time audio signal.
  • a capture subunit configured to capture a current video frame by using a preset camera when detecting that the intensity of the audio signal changes from zero to a preset third threshold
  • the preset video camera is used to align the video picture of the video, and when the audio signal is detected from scratch, the intensity of the audio signal changes from zero to over the preset.
  • the capture subunit controls the camera to capture the current video frame.
  • the acquiring sub-unit is configured to perform image processing on the captured video picture to obtain a frame number on the video picture, and use the obtained frame number as a second frame number corresponding to the current video picture.
  • the acquisition sub-unit After the current video picture is obtained by the camera, the acquisition sub-unit extracts the frame number on the video picture by using image processing technology, and the extracted frame number is the second frame number corresponding to the current video picture.
  • the sound and picture synchronization testing device proposed by the invention displays the control frame number in a designated position of the corresponding video picture when the terminal plays the video, so that the tester can intuitively view the respective test points (ie, the audio signal from none to the time) corresponding to the video picture.
  • the frame number is obtained, and the frame number can be captured by a preset camera to obtain the second frame number required for the test.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Disclosed in the present invention is a method for testing audio and picture synchronization, comprising: sequentially adding a serial frame number to each frame of a video; when the audio data of the video is read by means of an audio decoder, determining when an audio signal is played and using this moment as a check point, and acquiring, from the video with added serial frame numbers, a first serial frame number corresponding to each check point; while a terminal is playing the video with added serial frame numbers, when it is detected for the Nth time that an audio signal is played, acquiring a second serial frame number corresponding to the current video picture, and according to the first serial frame number corresponding to the Nth check point arranged in an ascending order on the basis of the playing time moment, the second serial frame number currently acquired and a preset first threshold, determining whether the current audio and picture are synchronous; the value of N being 1, 2, 3… in turn. Further disclosed in the present invention is a device for testing audio and picture synchronization. The present invention realizes objective, accurate and simple audio and picture synchronization testing on the video that a user actually views.

Description

音画同步测试方法及装置  Audio and video synchronization test method and device
技术领域Technical field
本发明涉及音视频测试技术领域，尤其涉及一种音画同步测试方法及装置。The invention relates to the technical field of audio and video testing, and in particular to a method and device for synchronizing audio and video.
背景技术Background technique
由于电视机等多媒体设备处理视频信号所花费的时间多于处理音频信号的时间，特别是在视频画面需要进行画质运动补偿时，所要花费的时间会更多。在研发过程中，需要测试视频的音画是否同步，也即，将音频信号存入缓存，测试计量出音画在播放上的差异。Since multimedia devices such as televisions spend more time processing video signals than processing audio signals, especially when video pictures require image quality motion compensation, it takes more time. In the development process, it is necessary to test whether the audio of the video is synchronized, that is, the audio signal is stored in the buffer, and the test measures the difference in the playback of the audio and video.
目前常见的测试音画同步的方式，是由测试人员观看电视，并对比视频画面中人物的唇动和听到的声音是否同步。由于测试人员的个体差异，会有200ms左右的误差，而很多发烧友却不能忍受这200ms的误差而引发投诉，因而，需要对视频的音画是否同步进行客观的测试。At present, the common way to test audio and video synchronization is to watch TV on the tester and compare whether the lips of the characters in the video picture and the sounds heard are synchronized. Due to the individual differences of the testers, there will be an error of about 200ms, and many enthusiasts can not tolerate the error of 200ms and cause complaints. Therefore, it is necessary to objectively test whether the video and audio of the video are synchronized.
然而，已有的对音画进行客观同步测试的方式，只能是黑白场的标准测试信号，而不能对用户实际观看的视频进行测试，且对标准测试信号的测试不能准确地代表用户实际观看的视频的音画是否同步，其检测流程也不够简捷。However, the existing method of objectively synchronizing the sound and picture can only be the standard test signal of the black and white field, but can not test the video actually viewed by the user, and the test of the standard test signal cannot accurately represent the actual viewing of the user. Whether the audio and video of the video is synchronized, the detection process is not simple enough.
发明内容Summary of the invention
本发明提供一种音画同步测试方法及装置，旨在解决现有音画同步测试方式不够客观、准确、简捷的技术问题。The invention provides a sound and picture synchronization test method and device, aiming at solving the technical problem that the existing sound picture synchronous test method is not objective, accurate and simple.
为实现上述目的，本发明提供一种音画同步测试方法，所述音画同步测试方法包括：To achieve the above object, the present invention provides a method for synchronizing audio and video, and the method for synchronizing audio and video includes:
在视频的每一帧中依序添加帧编号；Add frame numbers sequentially in each frame of the video;
通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号；When the audio data of the video is read by the audio decoder, the audio signal is determined as a check point from no-to-sometime corresponding playback time, and the first frame number corresponding to each checkpoint is obtained from the video after adding the frame number. ;
在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步；其中，N的取值依次为1、2、3…。When the terminal plays the video with the frame number added, when the audio signal is detected from the Nth time to the Nth time, the second frame number corresponding to the current video picture is acquired, and the Nth check point corresponding to the playback time is sorted according to the playback time. The first frame number, the currently obtained second frame number, and the preset first threshold value determine whether the current audio and video is synchronized; wherein the values of N are 1, 2, 3, .
优选地，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：Preferably, the step of determining whether the current audio and video is synchronized according to the first frame number corresponding to the Nth check point arranged in ascending order according to the playing time, the currently acquired second frame number, and the preset first threshold value includes: :
若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
优选地，所述通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号的步骤包括：Preferably, when the audio data of the video is read by the audio decoder, the audio signal is determined as a check point from no-to-sometime corresponding playback time, and each check point is obtained from the video after adding the frame number. The steps of the first frame numbering include:
通过音频解码器读取所述视频的音频数据时，实时侦测音频信号的强度；When the audio data of the video is read by the audio decoder, the intensity of the audio signal is detected in real time;
当侦测到音频信号的强度从零变为超过预设的第二阈值时，将当前音频信号对应的播放时刻确定为检查点；When it is detected that the intensity of the audio signal changes from zero to a preset second threshold, determining a play time corresponding to the current audio signal as a checkpoint;
从添加帧编号后的视频中解析当前检查点对应的视频帧以获取帧编号，并将获得的帧编号作为当前检查点对应的第一帧编号。The video frame corresponding to the current checkpoint is parsed from the video after the frame number is added to obtain the frame number, and the obtained frame number is used as the first frame number corresponding to the current checkpoint.
优选地，所述音画同步测试方法还包括：Preferably, the audio and video synchronization test method further includes:
在视频的每一帧中依序添加帧编号时，控制实现帧编号在终端播放视频时显示在相应视频画面的指定位置。When the frame number is sequentially added in each frame of the video, the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
优选地，所述在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号的步骤包括：Preferably, when the terminal plays the video with the added frame number, the step of acquiring the second frame number corresponding to the current video picture when the audio signal is detected from the Nth to the Nth time includes:
在终端播放添加帧编号后的视频时，实时侦测音频信号的强度；The intensity of the audio signal is detected in real time when the terminal plays the video with the frame number added;
当侦测到音频信号的强度从零变为超过预设的第三阈值时，通过预置的摄像头捕获当前的视频画面；When the intensity of the audio signal is detected to change from zero to a preset third threshold, the current video frame is captured by the preset camera;
对捕获到的视频画面进行图像处理，以获取所述视频画面上的帧编号，并将获取到的帧编号作为当前视频画面对应的第二帧编号。The captured video frame is subjected to image processing to acquire a frame number on the video screen, and the obtained frame number is used as a second frame number corresponding to the current video screen.
为实现上述目的，本发明还提供一种音画同步测试装置，所述音画同步测试装置包括：In order to achieve the above object, the present invention further provides an audio and video synchronization testing device, where the audio and video synchronization testing device includes:
视频处理模块，用于在视频的每一帧中依序添加帧编号；a video processing module, configured to sequentially add a frame number in each frame of the video;
检查点确定模块，用于通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号；a checkpoint determining module, configured to determine, when the audio data of the video is read by the audio decoder, a playback time of the audio signal from no to sometimes corresponding to a checkpoint, and obtain each checkpoint from the video after adding the frame number Corresponding first frame numbers;
同步测试模块，用于在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步；其中，N的取值依次为1、2、3…。The synchronization test module is configured to: when the terminal plays the video with the added frame number, when the Nth detected the audio signal from the end to the time, obtain the second frame number corresponding to the current video frame, and arrange the data according to the playback time in ascending order. The first frame number corresponding to the N checkpoints, the currently obtained second frame number, and the preset first threshold value determine whether the current audio and video is synchronized; wherein the values of N are 1, 2, 3, .
优选地，所述同步测试模块包括判断单元，所述判断单元用于：Preferably, the synchronization test module includes a determination unit, and the determination unit is configured to:
若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
优选地，所述检查点确定模块包括：Preferably, the checkpoint determining module comprises:
侦测单元，用于通过音频解码器读取所述视频的音频数据时，实时侦测音频信号的强度；a detecting unit, configured to detect the intensity of the audio signal in real time when the audio data of the video is read by the audio decoder;
确定单元，用于当侦测到音频信号的强度从零变为超过预设的第二阈值时，将当前音频信号对应的播放时刻确定为检查点；a determining unit, configured to determine a play time corresponding to the current audio signal as a check point when detecting that the strength of the audio signal changes from zero to a preset second threshold;
获取单元，用于从添加帧编号后的视频中解析当前检查点对应的视频帧以获取帧编号，并将获得的帧编号作为当前检查点对应的第一帧编号。And an obtaining unit, configured to parse the video frame corresponding to the current checkpoint from the video after adding the frame number to obtain a frame number, and use the obtained frame number as the first frame number corresponding to the current checkpoint.
优选地，所述视频处理模块具体用于：Preferably, the video processing module is specifically configured to:
在视频的每一帧中依序添加帧编号时，控制实现帧编号在终端播放视频时显示在相应视频画面的指定位置。When the frame number is sequentially added in each frame of the video, the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
优选地，所述同步测试模块包括检测单元，所述检测单元包括：Preferably, the synchronization test module includes a detection unit, and the detection unit includes:
侦测子单元，用于在终端播放添加帧编号后的视频时，实时侦测音频信号的强度；The detecting subunit is configured to detect the intensity of the audio signal in real time when the terminal plays the video with the frame number added;
捕获子单元，用于当侦测到音频信号的强度从零变为超过预设的第三阈值时，通过预置的摄像头捕获当前的视频画面；a capture subunit, configured to capture a current video frame by using a preset camera when detecting that the intensity of the audio signal changes from zero to a preset third threshold;
获取子单元，用于对捕获到的视频画面进行图像处理，以获取所述视频画面上的帧编号，并将获取到的帧编号作为当前视频画面对应的第二帧编号。The acquiring sub-unit is configured to perform image processing on the captured video picture to obtain a frame number on the video picture, and use the obtained frame number as a second frame number corresponding to the current video picture.
本发明提出的音画同步测试方法及装置，在视频的每一帧中依序添加帧编号，然后通过音频解码器读取视频的音频数据，以确定出音频信号从无到有时的检查点，并从添加帧编码后的视频中获取各个检查点各自对应的第一帧编号；在终端上播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步。测试时所用的视频可以是用户实际观看的任意视频，且在同一声音停顿处重新有声音时，通过比较此时本该播放的帧编号与当前实际播放的帧编号的差异，从而实现对用户实际观看的视频进行客观、准确、简捷的音画同步测试。The method and device for synchronizing sound and picture proposed by the present invention sequentially add frame numbers in each frame of the video, and then read the audio data of the video through the audio decoder to determine the checkpoint of the audio signal from no time to time. And acquiring the first frame number corresponding to each checkpoint from the video after adding the frame encoding; when playing the video with the added frame number on the terminal, when the audio signal is detected from the Nth to the Nth time, the current video image is acquired. Corresponding second frame number, and determining whether the current audio and video is synchronized according to the first frame number corresponding to the Nth check point, the currently acquired second frame number, and the preset first threshold according to the playback time. . The video used in the test may be any video actually viewed by the user, and when there is a re-sound at the same sound pause, the difference between the frame number that should be played at this time and the frame number currently being played is compared, thereby realizing the actual user. Watch the video for an objective, accurate, and simple audio and video synchronization test.
附图说明DRAWINGS
图1为本发明音画同步测试方法第一实施例的流程示意图；1 is a schematic flow chart of a first embodiment of a sound and picture synchronization test method according to the present invention;
图2为图1中步骤S20的细化流程示意图；2 is a schematic diagram of a refinement process of step S20 in FIG. 1;
图3为本发明音画同步测试方法第三实施例中获取当前视频画面对应的第二帧编号的细化流程示意图；3 is a schematic diagram of a refinement process for obtaining a second frame number corresponding to a current video picture in a third embodiment of the audio and video synchronization test method according to the present invention;
图4为本发明音画同步测试装置第一实施例的功能模块示意图；4 is a schematic diagram of functional modules of a first embodiment of an audio and video synchronization test apparatus according to the present invention;
图5为图4中检查点确定模块的细化功能模块示意图；5 is a schematic diagram of a refinement function module of the checkpoint determining module in FIG. 4;
图6为本发明音画同步测试装置第三实施例中同步测试模块的细化功能模块示意图。6 is a schematic diagram of a refinement function module of a synchronization test module in a third embodiment of the audio and video synchronization test apparatus of the present invention.
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.
具体实施方式detailed description
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
本发明提供一种音画同步测试方法，如图1所示，示出了本发明音画同步测试方法第一实施例的流程示意图，所述音画同步测试方法包括：The present invention provides a sound and picture synchronization test method. As shown in FIG. 1 , a flow chart of a first embodiment of the sound and picture synchronization test method of the present invention is shown. The sound and picture synchronization test method includes:
S10、在视频的每一帧中依序添加帧编号；S10. Add a frame number sequentially in each frame of the video.
在进行视频的音画同步测试时，首先需要选取一段视频，该段视频是用户实际观看的任意视频，可以是一个完整的长视频，也可以是从一个完整的长视频中截取的一小段视频。采用现有的视频处理技术，可在选取的视频的每一帧中依序添加帧编号。例如，假设待测试的是一个10分钟的视频，其帧率为50fps，则该视频的总帧数为50×10×60=30000，在添加帧编号时，可将编号1-30000根据视频帧的先后顺序依次添加到该视频的每一帧中，即该视频的第一帧的编号为1，第二帧的编号为2，第800帧的编号为800，以此类推。添加的帧编号可存储在每一帧对应的视频帧数据中。When performing video and audio synchronization test, you first need to select a video that is any video that the user actually watches. It can be a complete long video or a small video captured from a complete long video. . With existing video processing techniques, frame numbers can be added sequentially in each frame of the selected video. For example, if the video to be tested is a 10-minute video with a frame rate of 50 fps, the total number of frames of the video is 50×10×60=30000. When the frame number is added, the number is 1-30000 according to the video frame. The sequence is sequentially added to each frame of the video, that is, the first frame of the video is numbered 1, the second frame is numbered 2, the 800th frame is numbered 800, and so on. The added frame number can be stored in the video frame data corresponding to each frame.
S20、通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号；S20. When the audio data of the video is read by the audio decoder, the audio signal is determined as a check point from no-to-sometime corresponding playback time, and the first corresponding to each checkpoint is obtained from the video after adding the frame number. Frame number
进一步地，参照图2，上述步骤S20包括：Further, referring to FIG. 2, the above step S20 includes:
S21、通过音频解码器读取所述视频的音频数据时，实时侦测音频信号的强度；S21: When the audio data of the video is read by the audio decoder, detecting the strength of the audio signal in real time;
S22、当侦测到音频信号的强度从零变为超过预设的第二阈值时，将当前音频信号对应的播放时刻确定为检查点；S22. When detecting that the strength of the audio signal changes from zero to a preset second threshold, determining a play time corresponding to the current audio signal as a checkpoint;
S23、从添加帧编号后的视频中解析当前检查点对应的视频帧以获取帧编号，并将获得的帧编号作为当前检查点对应的第一帧编号。S23. Parse the video frame corresponding to the current checkpoint from the video with the added frame number to obtain the frame number, and use the obtained frame number as the first frame number corresponding to the current checkpoint.
所述视频包括图像数据（即视频帧数据）和音频数据，这些数据存储在同一个数据包里，当需要读取图像时，解析该数据包中的图像数据即可，当需要读取音频数据时，解析该数据包中的音频数据即可。通过音频解码器读取该段视频（也可指添加帧编号后的视频）的音频数据时，可获取到该音频数据的每一播放时刻（与该段视频的播放时刻一致）对应的音频信号。实时侦测该读取过程中音频信号的强度，并在检测到音频信号从无到有，即音频信号的强度从零变为到一个较高的值，且该值大于预设的第二阈值时，将此时音频信号对应的播放时刻确定为检查点，并从添加帧编号后的视频中解析当前检查点对应的视频帧，以获取该视频帧中的帧编号，获得的帧编号即为当前检查点（即当前播放时刻）对应的第一帧编号。The video includes image data (ie, video frame data) and audio data, and the data is stored in the same data packet. When the image needs to be read, the image data in the data packet is parsed, and when the audio data needs to be read, When parsing the audio data in the packet. When the audio data of the video segment (which may also refer to the video after adding the frame number) is read by the audio decoder, the audio signal corresponding to each playing time of the audio data (consistent with the playing time of the video segment) may be obtained. . Real-time detection of the intensity of the audio signal during the reading process, and detecting that the audio signal is from nothing, that is, the intensity of the audio signal changes from zero to a higher value, and the value is greater than a preset second threshold The playback time corresponding to the audio signal is determined as a checkpoint, and the video frame corresponding to the current checkpoint is parsed from the video after adding the frame number to obtain the frame number in the video frame, and the obtained frame number is The first frame number corresponding to the current checkpoint (ie, the current play time).
其中，第一帧编号为各个检查点在视频中对应的视频帧的帧编号；所述第二阈值是预先设置的一个音频信号强度值，用于表示强度值超过第二阈值的音频信号属于有声音的音频信号。The first frame number is a frame number of a video frame corresponding to each checkpoint in the video; the second threshold is a preset audio signal strength value, and the audio signal indicating that the intensity value exceeds the second threshold belongs to The audio signal of the sound.
S30、在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步。S30. When the terminal plays the video with the added frame number, when the audio signal is detected from the Nth time, the second frame number corresponding to the current video picture is acquired, and the Nth check point is sorted in ascending order according to the playing time. The corresponding first frame number, the currently acquired second frame number, and the preset first threshold value determine whether the current audio and video is synchronized.
所述终端可以为电视机，也可以为手机等能够播放视频且需要对视频的图像显示和音频播放进行处理的硬件设备。所述第二帧编号是用来区分于第一帧编号的一类帧编号，表示在通过终端播放视频时获取到的帧编号。N的取值依次为1、2、3…。The terminal may be a television set, or a hardware device such as a mobile phone that can play video and needs to process image display and audio play of the video. The second frame number is a type of frame number used to distinguish the first frame number, and represents a frame number acquired when the video is played through the terminal. The values of N are 1, 2, 3, ... in order.
以电视机为例，则测试时的视频为电视机实际接收的直播数字信号经处理后得到的TS（Transport Stream，传输流或节目流）视频文件。在进行音画同步测试时，可通过串口线与电视机连接以获取所需数据，并在电视机上播放添加帧编号后的视频。在播放过程中，可获取到实时的音频信号和视频帧数据，当检测到音频信号从无到有，即音频信号的强度从零变为超过预设的第三阈值时，一方面获取当前视频画面所属视频帧的第二帧编号，另一方面根据该次检测到音频信号从无到有的次序，即第N次，获取之前确定出的检查点中、播放时刻按升序排列的第N个检查点（即音画同步播放中第N次声音停顿处重新有声音的播放时刻）对应的第一帧编号，然后根据当前获取到的第一帧编号、第二帧编号、预设的第一阈值，判断当前的音画是否同步。其中，所述第三阈值也是预先设置的一个音频信号强度值，其取值可以与所述第二阈值相同，也可以不同。Taking a TV as an example, the video during the test is the TS (Transport) obtained after the live digital signal actually received by the TV is processed. Stream, transport stream or program stream) video files. When performing audio and video synchronization test, you can connect to the TV through the serial cable to get the required data, and play the video with the frame number added on the TV. During the playing process, the real-time audio signal and the video frame data can be obtained. When the audio signal is detected from scratch, that is, the intensity of the audio signal changes from zero to a preset third threshold, the current video is acquired on the one hand. The second frame number of the video frame to which the picture belongs, and on the other hand, according to the order in which the audio signal is detected from the end, that is, the Nth time, the Nth check point and the play time are sorted in ascending order. The first frame number corresponding to the checkpoint (ie, the playback time at which the sound is re-sounded at the Nth sound pause in the synchronous playback of the audio and video), and then according to the currently acquired first frame number, the second frame number, and the preset first The threshold determines whether the current audio and video are synchronized. The third threshold is also an audio signal strength value set in advance, and the value may be the same as or different from the second threshold.
例如，假设当前获取到的第一帧编号为950、第二帧编号为986，预设的第一阈值为时间差值且取值为500ms，则第一帧编号与第二帧编号的绝对差值为|950－986|=36，计算得到当前视频画面在当前播放场景下与在音画同步播放场景下相差的时间差值为（36/50）×1000=720ms，由于计算得到的时间差值大于第一阈值500ms，则可判断出当前的音画不同步。进一步地，还可根据计算得到的时间差值对播放的视频进行音画同步校正。For example, if the first frame number currently obtained is 950, the second frame number is 986, and the preset first threshold is the time difference value and the value is 500 ms, the absolute difference between the first frame number and the second frame number is The value is |950-986|=36, and the time difference between the current video scene and the synchronized scene in the audio and video playback is calculated as (36/50)×1000=720ms, due to the calculated time difference. If the value is greater than the first threshold of 500 ms, it can be determined that the current audio and video are not synchronized. Further, the played video can be synchronously corrected according to the calculated time difference.
本发明提出的音画同步测试方法，在视频的每一帧中依序添加帧编号，然后通过音频解码器读取视频的音频数据，以确定出音频信号从无到有时的检查点，并从添加帧编码后的视频中获取各个检查点各自对应的第一帧编号；在终端上播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步。测试时所用的视频可以是用户实际观看的任意视频，且在同一声音停顿处重新有声音时，通过比较此时本该播放的帧编号与当前实际播放的帧编号的差异，从而实现对用户实际观看的视频进行客观、准确、简捷的音画同步测试。The sound and picture synchronization test method proposed by the invention adds the frame number sequentially in each frame of the video, and then reads the audio data of the video through the audio decoder to determine the checkpoint of the audio signal from no time to time, and from Adding a frame-encoded video to obtain a first frame number corresponding to each checkpoint; when playing a video with a frame number added on the terminal, when the audio signal is detected from the Nth time to the Nth time, the current video picture is acquired. The second frame number is determined according to the first frame number corresponding to the Nth check point arranged in ascending order, the currently acquired second frame number, and the preset first threshold value, and whether the current audio and video is synchronized. The video used in the test may be any video actually viewed by the user, and when there is a re-sound at the same sound pause, the difference between the frame number that should be played at this time and the frame number currently being played is compared, thereby realizing the actual user. Watch the video for an objective, accurate, and simple audio and video synchronization test.
进一步地，基于上述音画同步测试方法第一实施例提出本发明音画同步测试方法第二实施例，在本实施例中，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：Further, the second embodiment of the sound and picture synchronization test method of the present invention is proposed based on the first embodiment of the above-described sound and picture synchronization test method. In this embodiment, the Nth check point corresponding to the play time is arranged in ascending order. A frame number, a currently obtained second frame number, a preset first threshold, and a step of determining whether the current audio clip is synchronized includes:
若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
本实施例中，所述第一阈值是为帧编号的绝对差值设置的一个阈值。假设当前获取到的第一帧编号为950、第二帧编号为986，第一阈值为30，则帧编号的绝对差值为|950－986|=36，大于预设的第一阈值30，因而可确定当前的音画不同步。进一步地，还可根据帧编号的绝对差值对播放的视频进行音画同步校正。In this embodiment, the first threshold is a threshold set for an absolute difference of frame numbers. Assume that the first frame number currently obtained is 950, the second frame number is 986, and the first threshold value is 30, and the absolute difference of the frame number is |950-986|=36, which is greater than the preset first threshold value 30, It is thus possible to determine that the current picture is out of sync. Further, the played video can be synchronized with the sound and picture according to the absolute difference of the frame number.
本发明提出的音画同步测试方法，通过计算第一帧编号与第二帧编号的绝对差值，并比较计算得到的绝对差值与预设的第一阈值的大小关系，从而判断当前的音画是否同步，判断过程简单、快速，且判断结果准确。The sound and picture synchronization test method proposed by the present invention calculates the absolute difference between the first frame number and the second frame number, and compares the calculated absolute difference with the preset first threshold value to determine the current sound. Whether the painting is synchronized, the judgment process is simple and fast, and the judgment result is accurate.
进一步地，基于上述音画同步测试方法第二实施例提出本发明音画同步测试方法第三实施例，在本实施例中，所述音画同步测试方法还包括：Further, the third embodiment of the sound and picture synchronization test method of the present invention is proposed based on the second embodiment of the sound and picture synchronization test method. In the embodiment, the sound and picture synchronization test method further includes:
在视频的每一帧中依序添加帧编号时，控制实现帧编号在终端播放视频时显示在相应视频画面的指定位置。When the frame number is sequentially added in each frame of the video, the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
例如，在终端上播放该视频时，在该视频的第一帧对应的视频画面的指定位置（如右下角）处能够显示帧编号1，在该视频的第二帧对应的视频画面的相同位置处能够显示帧编号2，以此类推。For example, when the video is played on the terminal, the frame number 1 can be displayed at a specified position (such as the lower right corner) of the video frame corresponding to the first frame of the video, and the same position of the video frame corresponding to the second frame of the video. Can display frame number 2, and so on.
进一步地，参照图3，所述在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号的步骤包括：Further, referring to FIG. 3, when the video after adding the frame number is played by the terminal, when the audio signal is detected from the Nth time to the Nth time, the step of acquiring the second frame number corresponding to the current video picture includes:
S31、在终端播放添加帧编号后的视频时，实时侦测音频信号的强度；S31, detecting the strength of the audio signal in real time when the terminal plays the video with the frame number added;
可通过与终端进行串口连接，从而从终端的音频处理装置（如扬声器）获取到视频播放时实时的音频信号的强度，也可通过麦克风等装置捕获视频播放时的声音，从而获取到实时的音频信号的强度。The serial port connection with the terminal can be used to obtain the real-time audio signal intensity from the audio processing device (such as a speaker) of the terminal, and can also capture the sound during video playback through a device such as a microphone, thereby obtaining real-time audio. The strength of the signal.
S32、当侦测到音频信号的强度从零变为超过预设的第三阈值时，通过预置的摄像头捕获当前的视频画面；S32. When detecting that the strength of the audio signal changes from zero to a preset third threshold, capturing a current video frame by using a preset camera;
在终端上播放添加帧编号后的视频时，使用预置的摄像头对准该视频的视频画面，且当侦测到音频信号从无到有，即音频信号的强度从零变为超过预设的第三阈值时，控制摄像头捕获当前的视频画面。When the video with the added frame number is played on the terminal, the preset video camera is used to align the video picture of the video, and when the audio signal is detected from scratch, the intensity of the audio signal changes from zero to over the preset. At the third threshold, the control camera captures the current video frame.
S33、对捕获到的视频画面进行图像处理，以获取所述视频画面上的帧编号，并将获取到的帧编号作为当前视频画面对应的第二帧编号。S33. Perform image processing on the captured video frame to obtain a frame number on the video screen, and use the obtained frame number as a second frame number corresponding to the current video frame.
通过摄像头得到当前的视频画面后，利用图像处理技术提取出该视频画面上的帧编号，提取出的帧编号即为当前视频画面对应的第二帧编号。After the current video picture is obtained by the camera, the frame number on the video picture is extracted by using image processing technology, and the extracted frame number is the second frame number corresponding to the current video picture.
本发明提出的音画同步测试方法，控制帧编号在终端播放视频时显示在相应视频画面的指定位置，使得测试者能够直观查看到各个测试点（即音频信号从无到有时）对应视频画面的帧编号，且能够通过预置的摄像头捕获得到该帧编号，从而获得测试需要的第二帧编号。According to the audio and video synchronization test method proposed by the present invention, the control frame number is displayed at a specified position of the corresponding video picture when the terminal plays the video, so that the tester can intuitively view the respective test points (ie, the audio signal from none to the time) corresponding to the video picture. The frame number is obtained, and the frame number can be captured by a preset camera to obtain the second frame number required for the test.
本发明还提供一种音画同步测试装置，如图4所示，示出了本发明音画同步测试装置第一实施例的功能模块示意图，所述音画同步测试装置包括：The present invention also provides a sound and picture synchronization testing device. As shown in FIG. 4, a schematic diagram of a functional module of the first embodiment of the audio and video synchronization testing device of the present invention is shown. The audio and video synchronization testing device includes:
视频处理模块100，用于在视频的每一帧中依序添加帧编号；The video processing module 100 is configured to sequentially add a frame number in each frame of the video;
在进行视频的音画同步测试时，首先需要选取一段视频，该段视频是用户实际观看的任意视频，可以是一个完整的长视频，也可以是从一个完整的长视频中截取的一小段视频。采用现有的视频处理技术，可在选取的视频的每一帧中依序添加帧编号。例如，假设待测试的是一个10分钟的视频，其帧率为50fps，则该视频的总帧数为50×10×60=30000，在添加帧编号时，视频处理模块100可将编号1-30000根据视频帧的先后顺序依次添加到该视频的每一帧中，即该视频的第一帧的编号为1，第二帧的编号为2，第800帧的编号为800，以此类推。添加的帧编号可存储在每一帧对应的视频帧数据中。When performing video and audio synchronization test, you first need to select a video that is any video that the user actually watches. It can be a complete long video or a small video captured from a complete long video. . With existing video processing techniques, frame numbers can be added sequentially in each frame of the selected video. For example, if the video to be tested is a 10-minute video with a frame rate of 50 fps, the total number of frames of the video is 50×10×60=30000. When the frame number is added, the video processing module 100 may number 1- 30000 is sequentially added to each frame of the video according to the order of the video frames, that is, the first frame of the video is numbered 1, the second frame is numbered 2, the 800th frame is numbered 800, and so on. The added frame number can be stored in the video frame data corresponding to each frame.
检查点确定模块200，用于通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号；The checkpoint determining module 200 is configured to determine, when the audio data of the video is read by the audio decoder, a playback time of the audio signal from no to sometimes corresponding to a checkpoint, and obtain each check from the video after adding the frame number. Point each corresponding first frame number;
进一步地，参照图5，所述检查点确定模块200包括：Further, referring to FIG. 5, the checkpoint determining module 200 includes:
侦测单元201，用于通过音频解码器读取所述视频的音频数据时，实时侦测音频信号的强度；The detecting unit 201 is configured to detect the intensity of the audio signal in real time when the audio data of the video is read by the audio decoder;
确定单元202，用于当侦测到音频信号的强度从零变为超过预设的第二阈值时，将当前音频信号对应的播放时刻确定为检查点；The determining unit 202 is configured to determine, when the intensity of the audio signal is changed from zero to exceed a preset second threshold, a play time corresponding to the current audio signal as a checkpoint;
获取单元203，用于从添加帧编号后的视频中解析当前检查点对应的视频帧以获取帧编号，并将获得的帧编号作为当前检查点对应的第一帧编号。The obtaining unit 203 is configured to parse the video frame corresponding to the current checkpoint from the video after adding the frame number to obtain the frame number, and use the obtained frame number as the first frame number corresponding to the current checkpoint.
所述视频包括图像数据（即视频帧数据）和音频数据，这些数据存储在同一个数据包里，当需要读取图像时，解析该数据包中的图像数据即可，当需要读取音频数据时，解析该数据包中的音频数据即可。通过音频解码器读取该段视频（也可指添加帧编号后的视频）的音频数据时，可获取到该音频数据的每一播放时刻（与该段视频的播放时刻一致）对应的音频信号。侦测单元201实时侦测该读取过程中音频信号的强度，确定单元202在检测到音频信号从无到有，即音频信号的强度从零变为到一个较高的值，且该值大于预设的第二阈值时，将此时音频信号对应的播放时刻确定为检查点，且获取单元203从添加帧编号后的视频中解析当前检查点对应的视频帧，以获取该视频帧中的帧编号，获得的帧编号即为当前检查点（即当前播放时刻），对应的第一帧编号。The video includes image data (ie, video frame data) and audio data, and the data is stored in the same data packet. When the image needs to be read, the image data in the data packet is parsed, and when the audio data needs to be read, When parsing the audio data in the packet. When the audio data of the video segment (which may also refer to the video after adding the frame number) is read by the audio decoder, the audio signal corresponding to each playing time of the audio data (consistent with the playing time of the video segment) may be obtained. . The detecting unit 201 detects the intensity of the audio signal in the reading process in real time, and the determining unit 202 detects that the audio signal is from nothing, that is, the intensity of the audio signal changes from zero to a higher value, and the value is greater than When the preset second threshold is used, the playback time corresponding to the audio signal is determined as a checkpoint, and the obtaining unit 203 parses the video frame corresponding to the current checkpoint from the video after adding the frame number to obtain the video frame. Frame number, the obtained frame number is the current check point (that is, the current play time), and the corresponding first frame number.
其中，第一帧编号为各个检查点在视频中对应的视频帧的帧编号；所述第二阈值是预先设置的一个音频信号强度值，用于表示强度值超过第二阈值的音频信号属于有声音的音频信号。The first frame number is a frame number of a video frame corresponding to each checkpoint in the video; the second threshold is a preset audio signal strength value, and the audio signal indicating that the intensity value exceeds the second threshold belongs to The audio signal of the sound.
同步测试模块300，用于在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步。The synchronization test module 300 is configured to: when the terminal plays the video with the frame number added, when the audio signal is detected from the Nth time to the Nth time, the second frame number corresponding to the current video picture is obtained, and is arranged in ascending order according to the playing time. The first frame number corresponding to the Nth checkpoint, the currently acquired second frame number, and the preset first threshold value determine whether the current audio and video is synchronized.
所述终端可以为电视机，也可以为手机等能够播放视频且需要对视频的图像显示和音频播放进行处理的硬件设备。所述第二帧编号是用来区分于第一帧编号的一类帧编号，表示在通过终端播放视频时获取到的帧编号。N的取值依次为1、2、3…。The terminal may be a television set, or a hardware device such as a mobile phone that can play video and needs to process image display and audio play of the video. The second frame number is a type of frame number used to distinguish the first frame number, and represents a frame number acquired when the video is played through the terminal. The values of N are 1, 2, 3, ... in order.
以电视机为例，则测试时的视频为电视机实际接收的直播数字信号经处理后得到的TS视频文件。在进行音画同步测试时，在电视机上播放添加帧编号后的视频，同时，同步测试模块300可通过串口线与电视机连接以获取所需数据。在播放过程中，同步测试模块300可获取到实时的音频信号和视频帧数据，当检测到音频信号从无到有，即音频信号的强度从零变为超过预设的第三阈值时，一方面获取当前视频画面所属视频帧的第二帧编号，另一方面根据该次检测到音频信号从无到有的次序，即第N次，获取之前确定出的检查点中、播放时刻按升序排列的第N个检查点（即音画同步播放中第N次声音停顿处重新有声音的播放时刻）对应的第一帧编号，然后根据当前获取到的第一帧编号、第二帧编号、预设的第一阈值，判断当前的音画是否同步。其中，所述第三阈值也是预先设置的一个音频信号强度值，其取值可以与所述第二阈值相同，也可以不同。Taking a television as an example, the video at the time of the test is a TS video file obtained by processing the live digital signal actually received by the television. During the audio and video synchronization test, the video after adding the frame number is played on the television. At the same time, the synchronous test module 300 can be connected to the television through the serial cable to obtain the required data. During the playing process, the synchronization test module 300 can obtain the real-time audio signal and the video frame data. When the audio signal is detected from scratch, that is, the intensity of the audio signal changes from zero to a preset third threshold, The aspect obtains the second frame number of the video frame to which the current video picture belongs, and on the other hand, according to the order in which the audio signal is detected from scratch, that is, the Nth time, the check point determined before the acquisition and the play time are arranged in ascending order. The first frame number corresponding to the Nth checkpoint (ie, the playback time at which the sound is re-sound at the Nth sound pause in the synchronous playback of the audio and video), and then according to the currently acquired first frame number, second frame number, and pre- The first threshold is set to determine whether the current audio and video are synchronized. The third threshold is also an audio signal strength value set in advance, and the value may be the same as or different from the second threshold.
例如，假设当前获取到的第一帧编号为950、第二帧编号为986，预设的第一阈值为时间差值且取值为500ms，则第一帧编号与第二帧编号的绝对差值为|950－986|=36，计算得到当前视频画面在当前播放场景下与在音画同步播放场景下相差的时间差值为（36/50）×1000=720ms，由于计算得到的时间差值大于第一阈值500ms，则同步测试模块300可判断出当前的音画不同步。进一步地，还可根据计算得到的时间差值对播放的视频进行音画同步校正。For example, if the first frame number currently obtained is 950, the second frame number is 986, and the preset first threshold is the time difference value and the value is 500 ms, the absolute difference between the first frame number and the second frame number is The value is |950-986|=36, and the time difference between the current video scene and the synchronized scene in the audio and video playback is calculated as (36/50)×1000=720ms, due to the calculated time difference. If the value is greater than the first threshold of 500 ms, the synchronization test module 300 can determine that the current audio and video are not synchronized. Further, the played video can be synchronously corrected according to the calculated time difference.
本发明提出的音画同步测试装置，在视频的每一帧中依序添加帧编号，然后通过音频解码器读取视频的音频数据，以确定出音频信号从无到有时的检查点，并从添加帧编码后的视频中获取各个检查点各自对应的第一帧编号；在终端上播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步。测试时所用的视频可以是用户实际观看的任意视频，且在同一声音停顿处重新有声音时，通过比较此时本该播放的帧编号与当前实际播放的帧编号的差异，从而实现对用户实际观看的视频进行客观、准确、简捷的音画同步测试。The audio-visual synchronization test device proposed by the present invention sequentially adds a frame number in each frame of the video, and then reads the audio data of the video through the audio decoder to determine the checkpoint of the audio signal from no time to time, and from Adding a frame-encoded video to obtain a first frame number corresponding to each checkpoint; when playing a video with a frame number added on the terminal, when the audio signal is detected from the Nth time to the Nth time, the current video picture is acquired. The second frame number is determined according to the first frame number corresponding to the Nth check point arranged in ascending order, the currently acquired second frame number, and the preset first threshold value, and whether the current audio and video is synchronized. The video used in the test may be any video actually viewed by the user, and when there is a re-sound at the same sound pause, the difference between the frame number that should be played at this time and the frame number currently being played is compared, thereby realizing the actual user. Watch the video for an objective, accurate, and simple audio and video synchronization test.
进一步地，基于上述音画同步测试装置第一实施例提出本发明音画同步测试装置第二实施例，在本实施例中，所述同步测试模块300包括判断单元301，所述判断单元301用于：Further, the second embodiment of the sound and picture synchronization test apparatus of the present invention is proposed based on the first embodiment of the audio and video synchronization test apparatus. In the embodiment, the synchronization test module 300 includes a determination unit 301, and the determination unit 301 uses to:
若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
本实施例中，所述第一阈值是为帧编号的绝对差值设置的一个阈值。假设当前获取到的第一帧编号为950、第二帧编号为986，第一阈值为30，则帧编号的绝对差值为|950－986|=36，大于预设的第一阈值30，因而判断单元301可判断出当前的音画不同步。进一步地，还可根据帧编号的绝对差值对播放的视频进行音画同步校正。In this embodiment, the first threshold is a threshold set for an absolute difference of frame numbers. Assume that the first frame number currently obtained is 950, the second frame number is 986, and the first threshold value is 30, and the absolute difference of the frame number is |950-986|=36, which is greater than the preset first threshold value 30, Therefore, the judging unit 301 can judge that the current sound and picture are not synchronized. Further, the played video can be synchronized with the sound and picture according to the absolute difference of the frame number.
本发明提出的音画同步测试装置，通过计算第一帧编号与第二帧编号的绝对差值，并比较计算得到的绝对差值与预设的第一阈值的大小关系，从而判断当前的音画是否同步，判断过程简单、快速，且判断结果准确。The audio-visual synchronization testing device of the present invention calculates the absolute difference between the first frame number and the second frame number, and compares the calculated absolute difference with the preset first threshold value to determine the current sound. Whether the painting is synchronized, the judgment process is simple and fast, and the judgment result is accurate.
进一步地，基于上述音画同步测试装置第二实施例提出本发明音画同步测试装置第三实施例，在本实施例中，所述视频处理模块100具体用于：Further, the third embodiment of the sound and picture synchronization testing device of the present invention is proposed based on the second embodiment of the audio and video synchronization testing device. In this embodiment, the video processing module 100 is specifically configured to:
在视频的每一帧中依序添加帧编号时，控制实现帧编号在终端播放视频时显示在相应视频画面的指定位置。When the frame number is sequentially added in each frame of the video, the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
例如，在终端上播放该视频时，在该视频的第一帧对应的视频画面的指定位置（如右下角）处能够显示帧编号1，在该视频的第二帧对应的视频画面的相同位置处能够显示帧编号2，以此类推。For example, when the video is played on the terminal, the frame number 1 can be displayed at a specified position (such as the lower right corner) of the video frame corresponding to the first frame of the video, and the same position of the video frame corresponding to the second frame of the video. Can display frame number 2, and so on.
进一步地，参照图6，所述同步测试模块300还包括检测单元302，所述检测单元302包括：Further, referring to FIG. 6, the synchronization test module 300 further includes a detection unit 302, and the detection unit 302 includes:
侦测子单元，用于在终端播放添加帧编号后的视频时，实时侦测音频信号的强度；The detecting subunit is configured to detect the intensity of the audio signal in real time when the terminal plays the video with the frame number added;
可通过与终端进行串口连接，从而从终端的音频处理装置（如扬声器）获取到视频播放时实时的音频信号的强度，也可通过麦克风等装置捕获视频播放时的声音，从而使侦测子单元获取到实时的音频信号的强度。The serial port connection with the terminal can be used to obtain the real-time audio signal strength from the audio processing device (such as a speaker) of the terminal, and can also capture the sound during video playback through a device such as a microphone, thereby enabling the detection subunit. Get the strength of the real-time audio signal.
捕获子单元，用于当侦测到音频信号的强度从零变为超过预设的第三阈值时，通过预置的摄像头捕获当前的视频画面；a capture subunit, configured to capture a current video frame by using a preset camera when detecting that the intensity of the audio signal changes from zero to a preset third threshold;
在终端上播放添加帧编号后的视频时，使用预置的摄像头对准该视频的视频画面，且当侦测到音频信号从无到有，即音频信号的强度从零变为超过预设的第三阈值时，捕获子单元控制摄像头捕获当前的视频画面。When the video with the added frame number is played on the terminal, the preset video camera is used to align the video picture of the video, and when the audio signal is detected from scratch, the intensity of the audio signal changes from zero to over the preset. At the third threshold, the capture subunit controls the camera to capture the current video frame.
获取子单元，用于对捕获到的视频画面进行图像处理，以获取所述视频画面上的帧编号，并将获取到的帧编号作为当前视频画面对应的第二帧编号。The acquiring sub-unit is configured to perform image processing on the captured video picture to obtain a frame number on the video picture, and use the obtained frame number as a second frame number corresponding to the current video picture.
通过摄像头得到当前的视频画面后，获取子单元利用图像处理技术提取出该视频画面上的帧编号，提取出的帧编号即为当前视频画面对应的第二帧编号。After the current video picture is obtained by the camera, the acquisition sub-unit extracts the frame number on the video picture by using image processing technology, and the extracted frame number is the second frame number corresponding to the current video picture.
本发明提出的音画同步测试装置，控制帧编号在终端播放视频时显示在相应视频画面的指定位置，使得测试者能够直观查看到各个测试点（即音频信号从无到有时）对应视频画面的帧编号，且能够通过预置的摄像头捕获得到该帧编号，从而获得测试需要的第二帧编号。The sound and picture synchronization testing device proposed by the invention displays the control frame number in a designated position of the corresponding video picture when the terminal plays the video, so that the tester can intuitively view the respective test points (ie, the audio signal from none to the time) corresponding to the video picture. The frame number is obtained, and the frame number can be captured by a preset camera to obtain the second frame number required for the test.
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims (20)

  1. 一种音画同步测试方法，其特征在于，所述音画同步测试方法包括： A sound and picture synchronization test method, characterized in that the sound and picture synchronization test method comprises:
    根据视频帧的先后顺序依次在视频的每一帧中依序添加帧编号；Adding frame numbers sequentially in each frame of the video according to the order of the video frames;
    通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号；When the audio data of the video is read by the audio decoder, the audio signal is determined as a check point from no-to-sometime corresponding playback time, and the first frame number corresponding to each checkpoint is obtained from the video after adding the frame number. ;
    在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步；其中，N的取值依次为1、2、3…。When the terminal plays the video with the frame number added, when the audio signal is detected from the Nth time to the Nth time, the second frame number corresponding to the current video picture is acquired, and the Nth check point corresponding to the playback time is sorted according to the playback time. The first frame number, the currently obtained second frame number, and the preset first threshold value determine whether the current audio and video is synchronized; wherein the values of N are 1, 2, 3, .
  2. 如权利要求1所述的音画同步测试方法，其特征在于，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：The audio-video synchronization test method according to claim 1, wherein the first frame number corresponding to the Nth checkpoint arranged in ascending order according to the play time, the currently acquired second frame number, and the preset The first threshold, the step of determining whether the current audio and video is synchronized includes:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  3. 如权利要求1所述的音画同步测试方法，其特征在于，所述通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号的步骤包括：The audio-video synchronization test method according to claim 1, wherein when the audio data of the video is read by the audio decoder, the audio signal is determined as a checkpoint from no-to-sometime corresponding playback time, and The steps of obtaining the first frame number corresponding to each checkpoint from the video after adding the frame number include:
    通过音频解码器读取所述视频的音频数据时，实时侦测音频信号的强度；When the audio data of the video is read by the audio decoder, the intensity of the audio signal is detected in real time;
    当侦测到音频信号的强度从零变为超过预设的第二阈值时，将当前音频信号对应的播放时刻确定为检查点；When it is detected that the intensity of the audio signal changes from zero to a preset second threshold, determining a play time corresponding to the current audio signal as a checkpoint;
    从添加帧编号后的视频中解析当前检查点对应的视频帧以获取帧编号，并将获得的帧编号作为当前检查点对应的第一帧编号。The video frame corresponding to the current checkpoint is parsed from the video after the frame number is added to obtain the frame number, and the obtained frame number is used as the first frame number corresponding to the current checkpoint.
  4. 如权利要求3所述的音画同步测试方法，其特征在于，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：The audio-video synchronization test method according to claim 3, wherein the first frame number corresponding to the Nth check point arranged in ascending order according to the play time, the currently acquired second frame number, and the preset The first threshold, the step of determining whether the current audio and video is synchronized includes:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  5. 如权利要求3所述的音画同步测试方法，其特征在于，所述音画同步测试方法还包括：The audio and video synchronization test method according to claim 3, wherein the audio and video synchronization test method further comprises:
    在视频的每一帧中依序添加帧编号时，控制实现帧编号在终端播放视频时显示在相应视频画面的指定位置。When the frame number is sequentially added in each frame of the video, the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
  6. 如权利要求5所述的音画同步测试方法，其特征在于，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：The audio-video synchronization test method according to claim 5, wherein the first frame number corresponding to the Nth check point arranged in ascending order according to the play time, the currently acquired second frame number, and the preset The first threshold, the step of determining whether the current audio and video is synchronized includes:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  7. 如权利要求5所述的音画同步测试方法，其特征在于，所述在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号的步骤包括：The audio-video synchronization test method according to claim 5, wherein when the terminal plays the video with the added frame number, when the audio signal is detected from the Nth time to the Nth time, the corresponding video picture is acquired. The steps of the two frame numbering include:
    在终端播放添加帧编号后的视频时，实时侦测音频信号的强度；The intensity of the audio signal is detected in real time when the terminal plays the video with the frame number added;
    当侦测到音频信号的强度从零变为超过预设的第三阈值时，通过预置的摄像头捕获当前的视频画面；When the intensity of the audio signal is detected to change from zero to a preset third threshold, the current video frame is captured by the preset camera;
    对捕获到的视频画面进行图像处理，以获取所述视频画面上的帧编号，并将获取到的帧编号作为当前视频画面对应的第二帧编号。The captured video frame is subjected to image processing to acquire a frame number on the video screen, and the obtained frame number is used as a second frame number corresponding to the current video screen.
  8. 一种音画同步测试方法，其特征在于，所述音画同步测试方法包括：A sound and picture synchronization test method, characterized in that the sound and picture synchronization test method comprises:
    在视频的每一帧中依序添加帧编号；Add frame numbers sequentially in each frame of the video;
    通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号；When the audio data of the video is read by the audio decoder, the audio signal is determined as a check point from no-to-sometime corresponding playback time, and the first frame number corresponding to each checkpoint is obtained from the video after adding the frame number. ;
    在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步；其中，N的取值依次为1、2、3…。When the terminal plays the video with the frame number added, when the audio signal is detected from the Nth time to the Nth time, the second frame number corresponding to the current video picture is acquired, and the Nth check point corresponding to the playback time is sorted according to the playback time. The first frame number, the currently obtained second frame number, and the preset first threshold value determine whether the current audio and video is synchronized; wherein the values of N are 1, 2, 3, .
  9. 如权利要求8所述的音画同步测试方法，其特征在于，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：The audio-video synchronization test method according to claim 8, wherein the first frame number corresponding to the Nth checkpoint arranged in ascending order according to the play time, the currently acquired second frame number, and the preset The first threshold, the step of determining whether the current audio and video is synchronized includes:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  10. 如权利要求8所述的音画同步测试方法，其特征在于，所述通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号的步骤包括：The audio-video synchronization test method according to claim 8, wherein when the audio data of the video is read by the audio decoder, the audio signal is determined as a checkpoint from no-to-sometime corresponding playback time, and The steps of obtaining the first frame number corresponding to each checkpoint from the video after adding the frame number include:
    通过音频解码器读取所述视频的音频数据时，实时侦测音频信号的强度；When the audio data of the video is read by the audio decoder, the intensity of the audio signal is detected in real time;
    当侦测到音频信号的强度从零变为超过预设的第二阈值时，将当前音频信号对应的播放时刻确定为检查点；When it is detected that the intensity of the audio signal changes from zero to a preset second threshold, determining a play time corresponding to the current audio signal as a checkpoint;
    从添加帧编号后的视频中解析当前检查点对应的视频帧以获取帧编号，并将获得的帧编号作为当前检查点对应的第一帧编号。The video frame corresponding to the current checkpoint is parsed from the video after the frame number is added to obtain the frame number, and the obtained frame number is used as the first frame number corresponding to the current checkpoint.
  11. 如权利要求10所述的音画同步测试方法，其特征在于，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：The audio-video synchronization test method according to claim 10, wherein the first frame number corresponding to the Nth checkpoint arranged in ascending order according to the play time, the currently acquired second frame number, and the preset The first threshold, the step of determining whether the current audio and video is synchronized includes:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  12. 如权利要求10所述的音画同步测试方法，其特征在于，所述音画同步测试方法还包括：The audio and video synchronization test method of claim 10, wherein the audio and video synchronization test method further comprises:
    在视频的每一帧中依序添加帧编号时，控制实现帧编号在终端播放视频时显示在相应视频画面的指定位置。When the frame number is sequentially added in each frame of the video, the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
  13. 如权利要求12所述的音画同步测试方法，其特征在于，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：The audio-video synchronization test method according to claim 12, wherein the first frame number corresponding to the Nth checkpoint arranged in ascending order according to the play time, the currently acquired second frame number, and the preset The first threshold, the step of determining whether the current audio and video is synchronized includes:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  14. 如权利要求12所述的音画同步测试方法，其特征在于，所述在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号的步骤包括：The audio-video synchronization test method according to claim 12, wherein when the terminal plays the video with the frame number added, when the audio signal is detected from the Nth time to the Nth time, the corresponding video picture is acquired. The steps of the two frame numbering include:
    在终端播放添加帧编号后的视频时，实时侦测音频信号的强度；The intensity of the audio signal is detected in real time when the terminal plays the video with the frame number added;
    当侦测到音频信号的强度从零变为超过预设的第三阈值时，通过预置的摄像头捕获当前的视频画面；When the intensity of the audio signal is detected to change from zero to a preset third threshold, the current video frame is captured by the preset camera;
    对捕获到的视频画面进行图像处理，以获取所述视频画面上的帧编号，并将获取到的帧编号作为当前视频画面对应的第二帧编号。The captured video frame is subjected to image processing to acquire a frame number on the video screen, and the obtained frame number is used as a second frame number corresponding to the current video screen.
  15. 如权利要求14所述的音画同步测试方法，其特征在于，所述根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步的步骤包括：The audio-video synchronization test method according to claim 14, wherein the first frame number corresponding to the Nth checkpoint arranged in ascending order according to the play time, the currently acquired second frame number, and the preset The first threshold, the step of determining whether the current audio and video is synchronized includes:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  16. 一种音画同步测试装置，其特征在于，所述音画同步测试装置包括：A sound and picture synchronization testing device, characterized in that the sound and picture synchronization testing device comprises:
    视频处理模块，用于在视频的每一帧中依序添加帧编号；a video processing module, configured to sequentially add a frame number in each frame of the video;
    检查点确定模块，用于通过音频解码器读取所述视频的音频数据时，将音频信号从无到有时对应的播放时刻确定为检查点，并从添加帧编号后的视频中获取各个检查点各自对应的第一帧编号；a checkpoint determining module, configured to determine, when the audio data of the video is read by the audio decoder, a playback time of the audio signal from no to sometimes corresponding to a checkpoint, and obtain each checkpoint from the video after adding the frame number Corresponding first frame numbers;
    同步测试模块，用于在终端播放添加帧编号后的视频时，当第N次检测到音频信号从无到有时，获取当前视频画面对应的第二帧编号，并根据播放时刻按升序排列的第N个检查点对应的第一帧编号、当前获取到的第二帧编号、预设的第一阈值，判断当前的音画是否同步；其中，N的取值依次为1、2、3…。The synchronization test module is configured to: when the terminal plays the video with the added frame number, when the Nth detected the audio signal from the end to the time, obtain the second frame number corresponding to the current video frame, and arrange the data according to the playback time in ascending order. The first frame number corresponding to the N checkpoints, the currently obtained second frame number, and the preset first threshold value determine whether the current audio and video is synchronized; wherein the values of N are 1, 2, 3, .
  17. 如权利要求16所述的音画同步测试装置，其特征在于，所述同步测试模块包括判断单元，所述判断单元用于：The audio and video synchronization test apparatus according to claim 16, wherein the synchronization test module comprises a determination unit, and the determination unit is configured to:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  18. 如权利要求16所述的音画同步测试装置，其特征在于，所述检查点确定模块包括：The audio-visual synchronization testing device according to claim 16, wherein the checkpoint determining module comprises:
    侦测单元，用于通过音频解码器读取所述视频的音频数据时，实时侦测音频信号的强度；a detecting unit, configured to detect the intensity of the audio signal in real time when the audio data of the video is read by the audio decoder;
    确定单元，用于当侦测到音频信号的强度从零变为超过预设的第二阈值时，将当前音频信号对应的播放时刻确定为检查点；a determining unit, configured to determine a play time corresponding to the current audio signal as a check point when detecting that the strength of the audio signal changes from zero to a preset second threshold;
    获取单元，用于从添加帧编号后的视频中解析当前检查点对应的视频帧以获取帧编号，并将获得的帧编号作为当前检查点对应的第一帧编号。And an obtaining unit, configured to parse the video frame corresponding to the current checkpoint from the video after adding the frame number to obtain a frame number, and use the obtained frame number as the first frame number corresponding to the current checkpoint.
  19. 如权利要求18所述的音画同步测试装置，其特征在于，所述同步测试模块包括判断单元，所述判断单元用于：The audio-video synchronization test apparatus according to claim 18, wherein the synchronization test module comprises a determination unit, and the determination unit is configured to:
    若当前对应的第N个检查点的第一帧编号和当前获取到的第二帧编号的绝对差值，大于或等于所述第一阈值，则确定当前的音画不同步，否则，确定当前的音画同步。If the absolute difference between the first frame number of the currently corresponding Nth checkpoint and the currently acquired second frame number is greater than or equal to the first threshold, determining that the current audio and video is not synchronized; otherwise, determining the current The sound and picture are synchronized.
  20. 如权利要求19所述的音画同步测试装置，其特征在于，所述视频处理模块具体用于：The audio and video synchronization testing device according to claim 19, wherein the video processing module is specifically configured to:
    在视频的每一帧中依序添加帧编号时，控制实现帧编号在终端播放视频时显示在相应视频画面的指定位置。When the frame number is sequentially added in each frame of the video, the control implementation frame number is displayed at a specified position of the corresponding video screen when the terminal plays the video.
PCT/CN2016/112984 2016-09-07 2016-12-29 Method and device for testing audio and picture synchronization WO2018045682A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610808577.4A CN106358039B (en) 2016-09-07 2016-09-07 Sound draws synchronous detecting method and device
CN201610808577.4 2016-09-07

Publications (1)

Publication Number Publication Date
WO2018045682A1 true WO2018045682A1 (en) 2018-03-15

Family

ID=57859367

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/112984 WO2018045682A1 (en) 2016-09-07 2016-12-29 Method and device for testing audio and picture synchronization

Country Status (2)

Country Link
CN (1) CN106358039B (en)
WO (1) WO2018045682A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114007064A (en) * 2021-11-01 2022-02-01 腾讯科技（深圳）有限公司 Special effect synchronous evaluation method, device, equipment, storage medium and program product

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106375820B (en) * 2016-08-30 2018-07-06 京东方科技集团股份有限公司 The method and apparatus synchronized to audio and video frequency signal
CN107613357B (en) * 2017-09-13 2020-05-19 广州酷狗计算机科技有限公司 Sound and picture synchronous optimization method and device and readable storage medium
CN110446103B (en) * 2018-05-04 2021-08-31 腾讯科技（深圳）有限公司 Audio and video testing method and device and storage medium
CN112929654B (en) * 2021-03-16 2022-03-29 腾讯音乐娱乐科技（深圳）有限公司 Method, device and equipment for detecting sound and picture synchronization and storage medium
CN113207009B (en) * 2021-05-11 2022-11-29 中国工商银行股份有限公司 Method, device and system for testing audio-video interaction system with out-of-step sound and picture
CN114666636B (en) * 2022-03-01 2024-06-14 阿里巴巴（中国）有限公司 Audio and video synchronization detection method and computer readable storage medium
CN116128453B (en) * 2023-02-18 2024-05-03 广州市点易资讯科技有限公司 Online course inspection method, system, equipment and medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101150729A (en) * 2006-09-22 2008-03-26 康佳集团股份有限公司 Audio and video synchronization playing method
WO2007116205A9 (en) * 2006-04-10 2009-04-09 Tektronix Int Sales Gmbh Method and apparatus for measuring audio/video sync delay
CN101742357A (en) * 2009-12-29 2010-06-16 北京牡丹电子集团有限责任公司 Method for measuring audio/video synchronous error of digital television device
CN103051921A (en) * 2013-01-05 2013-04-17 北京中科大洋科技发展股份有限公司 Method for precisely detecting video and audio synchronous errors of video and audio processing system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100499037B1 (en) * 2003-07-01 2005-07-01 엘지전자 주식회사 Method and apparatus of dtv lip-sync test
CN100496133C (en) * 2004-12-13 2009-06-03 武汉大学 Method for testing audio and video frequency out of step of audio and video frequency coding-decoding system
JP2007312192A (en) * 2006-05-19 2007-11-29 Oki Electric Ind Co Ltd Lip-sync evaluation apparatus and lip-sync adjustment apparatus
CN105898505B (en) * 2016-04-27 2019-02-19 北京小米移动软件有限公司 The method, apparatus and system of audio-visual synchronization are tested in video instant communication

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007116205A9 (en) * 2006-04-10 2009-04-09 Tektronix Int Sales Gmbh Method and apparatus for measuring audio/video sync delay
CN101150729A (en) * 2006-09-22 2008-03-26 康佳集团股份有限公司 Audio and video synchronization playing method
CN101742357A (en) * 2009-12-29 2010-06-16 北京牡丹电子集团有限责任公司 Method for measuring audio/video synchronous error of digital television device
CN103051921A (en) * 2013-01-05 2013-04-17 北京中科大洋科技发展股份有限公司 Method for precisely detecting video and audio synchronous errors of video and audio processing system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CHEN, ZHIYING ET AL.: "Research and Implementation on the Synchronization of Real-Time Audio and Video Transmission", JOURNAL OF HUAQIAO UNIVERSITY (NATURAL SCIENCE), vol. 32, no. 4, 31 July 2011 (2011-07-31), pages 390 - 391 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114007064A (en) * 2021-11-01 2022-02-01 腾讯科技（深圳）有限公司 Special effect synchronous evaluation method, device, equipment, storage medium and program product
CN114007064B (en) * 2021-11-01 2023-03-21 腾讯科技（深圳）有限公司 Special effect synchronous evaluation method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN106358039A (en) 2017-01-25
CN106358039B (en) 2019-02-01

Similar Documents

Publication Publication Date Title
WO2018045682A1 (en) Method and device for testing audio and picture synchronization
WO2017177524A1 (en) Audio and video playing synchronization method and device
WO2017005066A1 (en) Method and apparatus for recording audio and video synchronization timestamp
WO2016091011A1 (en) Subtitle switching method and device
WO2015142016A1 (en) Method for controlling content playback and content playback apparatus for executing same
WO2018032680A1 (en) Method and system for playing audio and video
WO2018028124A1 (en) Television set and signal source switching method thereof
WO2017164640A1 (en) System and method for editing video contents automatically technical field
WO2018192253A1 (en) Video signal transmission method and apparatus
WO2018023926A1 (en) Interaction method and system for television and mobile terminal
WO2018166224A1 (en) Target tracking display method and apparatus for panoramic video, and storage medium
WO2014187158A1 (en) Method, server, and terminal for controlling cloud sharing of terminal data
WO2017020649A1 (en) Audio/video playback control method and device thereof
WO2017063368A1 (en) Method and device for intercutting video advertisement
WO2018103187A1 (en) Monitor image formation method and system for monitoring device
WO2017045441A1 (en) Smart television-based audio playback method and apparatus
WO2017041537A1 (en) Video frame rate adjustment method and apparatus
WO2017206368A1 (en) High-dynamic range picture switching method and apparatus
WO2018090446A1 (en) Method and device for debugging and installing projector
WO2022025423A1 (en) Video quality assessing method and apparatus
WO2016101252A1 (en) Channel information display method and apparatus for intelligent television
WO2016029502A1 (en) Signal source switching method and device
WO2016095244A1 (en) Method and device for adjusting video window in video conference
WO2016090991A1 (en) Method and apparatus for downloading streaming media data
WO2017113600A1 (en) Video playing method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16915616

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02.08.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16915616

Country of ref document: EP

Kind code of ref document: A1