WO2020042090A1 - 一种图像显示方法、装置及图像处理设备 - Google Patents

一种图像显示方法、装置及图像处理设备 Download PDF

Info

Publication number
WO2020042090A1
WO2020042090A1 PCT/CN2018/103294 CN2018103294W WO2020042090A1 WO 2020042090 A1 WO2020042090 A1 WO 2020042090A1 CN 2018103294 W CN2018103294 W CN 2018103294W WO 2020042090 A1 WO2020042090 A1 WO 2020042090A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
synchronization signal
acquisition
time point
image data
Prior art date
Application number
PCT/CN2018/103294
Other languages
English (en)
French (fr)
Inventor
尹圣宝
赵宇鹏
秦东
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201880037421.8A priority Critical patent/CN110870301B/zh
Priority to PCT/CN2018/103294 priority patent/WO2020042090A1/zh
Publication of WO2020042090A1 publication Critical patent/WO2020042090A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/04—Synchronising
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/04—Synchronising
    • H04N5/06—Generation of synchronising signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to the field of image processing technology, and in particular, to an image display method, device, and image processing device.
  • Drones are unmanned aircrafts controlled by radio remote control equipment and self-provided program control devices. Drones were originally designed for use in wars. With the development of the information age, more advanced information processing and communication technologies have been adopted. Used in drones, the types of drones are increasing. Therefore, the current drones can be applied in many fields such as aerial photography, miniature selfies, wildlife observation, news reporting, power inspection, film and television shooting, and many other fields.
  • a general image system includes an image acquisition module and an image display module.
  • the image acquisition module is responsible for collecting image data
  • the image display module is responsible for displaying image data. Because the display system scheduling is implemented by software control, in practical applications, it is difficult to achieve synchronization between the image acquisition module and the image display module, which results in the out-of-sync phenomenon of the acquired and displayed images.
  • Embodiments of the present invention provide an image display method, device, and image processing device, which can accurately synchronize an image acquisition device and an image display device.
  • an embodiment of the present invention provides an image display method in an image processing system.
  • the image processing system includes an acquisition device and a display device, the acquisition device is connected to the display device, and the acquisition device is used to acquire image data, including:
  • Receiving, by the display device, the acquisition synchronization signal, and the acquisition synchronization signal corresponds to image data collected by the acquisition device;
  • the display device generates a display synchronization signal based on the acquisition synchronization signal to display image data.
  • an embodiment of the present invention further provides an image display device.
  • the image display device is configured in an image processing system.
  • the image processing system further includes a capture device, and the capture device is connected to the image display device.
  • the acquisition device is used to acquire image data, and the image display device includes:
  • a receiving unit configured to receive the acquisition synchronization signal, where the acquisition synchronization signal corresponds to image data collected by the acquisition device;
  • a processing unit configured to generate a display synchronization signal based on the acquisition synchronization signal to display image data.
  • an embodiment of the present invention provides an image processing device.
  • the image processing device includes an acquisition device and a display device.
  • the acquisition device is connected to the display device.
  • the acquisition device is used to acquire image data.
  • the display device includes a display processor and a display screen.
  • the display processor includes a frame synchronization controller and a display controller.
  • the frame synchronization controller is configured to:
  • a display synchronization signal is generated based on the acquisition synchronization signal to display image data.
  • an embodiment of the present invention provides a computer storage medium.
  • the computer storage medium stores computer program instructions, and when the computer program instructions are executed, they are used to implement the image display method in the image processing system.
  • the image display method in the embodiment of the present invention may be applied to an image processing system including a capture device and a display device.
  • the capture device is connected to the display device in the image processing system, and the capture device is mainly used to capture image data.
  • the display device receives the acquisition synchronization signal sent by the acquisition device, the display device generates a display synchronization signal based on the acquisition synchronization signal, so as to display image data according to the display synchronization signal, and generates a display of the display device by using the acquisition synchronization signal of the acquisition device.
  • the synchronization signal can avoid the step loss between the image captured by the acquisition device and the image displayed by the display device, and achieve accurate synchronization.
  • FIG. 1 is a result diagram of an image processing system provided by an embodiment of the present invention
  • FIG. 2 is a flowchart of an image display method according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a method for determining a time point when triggering image display is provided according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a method for determining an initial time point according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of a method for generating a display synchronization signal based on acquiring a synchronization signal according to an embodiment of the present invention
  • 6a is a schematic diagram of a method for finding and collecting a synchronization signal according to an embodiment of the present invention
  • 6b is a schematic diagram of another method for finding and collecting a synchronization signal according to an embodiment of the present invention.
  • FIG. 7 is a flowchart of another method for acquiring a synchronization signal and generating a display synchronization signal according to an embodiment of the present invention
  • FIG. 8 is a schematic structural diagram of an image display device according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a result of an image processing device provided by an embodiment of the present invention.
  • An embodiment of the present invention provides an image display method for an image processing system, and the image processing system may be configured in an image processing device such as a drone, an aerial photography aircraft, and a camera that needs to collect and display images.
  • the image processing system may include an acquisition device and a display device.
  • the acquisition device is connected to the display device.
  • the acquisition device is used to trigger the acquisition of image data when the acquisition synchronization signal is detected.
  • the display device is used to display the image data.
  • the image data displayed by the device is processed image data collected by the acquisition device.
  • the acquisition device corresponds to an acquisition synchronization signal for each frame of the image, that is, each acquisition of image data is accompanied by an acquisition synchronization signal, and the acquisition synchronization signal is the same as the image data.
  • the acquisition synchronization signal described herein may be generated by the acquisition device, or may also be generated by a control device (such as a control chip) related to the acquisition device.
  • the acquisition device may include an image acquisition module and an image signal processing module, and the image acquisition module is connected to the image signal processing module.
  • the image acquisition module may be an image acquisition device configured with an image sensor, such as a camera.
  • the image data collected by the image acquisition module is the original image, and its format is RAW.
  • RAW images record some raw data when the image acquisition module collects image data.
  • the image acquisition mode is a camera
  • the raw information of the camera sensor is recorded in the RAW format original image, and the ISO setting, shutter speed, aperture value, white balance, etc. of the image data captured by the camera are also recorded.
  • the image acquisition module sends the collected original image to the image signal processing module.
  • the image signal processing module processes the original image.
  • the processing process includes, but is not limited to, black level correction, lens distortion correction, RAW domain noise reduction processing, and RAW domain conversion.
  • the image data processed by the image signal processing module is the image data to be displayed by the display device.
  • the image signal processing module stores the processed image in a memory of the image display device.
  • the display device when it displays the image data, it first generates a display synchronization signal, and then displays the image data based on the indication of the display synchronization signal.
  • the display device may include a display processor and a display screen, and the display processor may further include a frame synchronization controller and a display controller.
  • the frame synchronization controller is mainly used to generate a display synchronization signal and send the display synchronization signal to the display controller;
  • the display controller controls the display device to display image data based on the display synchronization signal.
  • the display device displaying the image data based on the indication of the display synchronization signal may refer to: after the frame synchronization controller generates the display synchronization signal, the display synchronization signal is passed to the display controller, and the display controller receives the display synchronization signal After that, the processed image data collected by the acquisition device is acquired from the memory of the image processing device, and the image data here is sent to the display screen so that the display screen can display the image data display screen. The display image data is completed.
  • the image processing system shown in FIG. 1 includes an acquisition device and a display device.
  • the acquisition device includes an image acquisition module, an image processing module, and a display device.
  • the display processor includes a display processor and a display screen.
  • the display processor includes a frame synchronization controller and a display controller.
  • the image acquisition module of the acquisition device is connected to the display processor of the display device.
  • the image acquisition module of the acquisition device and the display processor of the display device may be connected by a hard wire. In other embodiments, the image acquisition module and the display processor may be connected by other means.
  • the image acquisition module of the acquisition device is used to acquire image data; the image processing module of the acquisition device is used to process the image data collected by the image acquisition module, and send the processed image data to the image processing The device's memory.
  • a corresponding acquisition synchronization signal is generated.
  • the acquisition synchronization signal may be sent to the display device through the acquisition device, so that the display device displays the image data based on the acquisition synchronization signal, which can ensure the acquisition.
  • the device captures the image and the display device displays the image in synchronization.
  • the acquisition synchronization signal generated in the acquisition device may be generated according to the acquisition frequency of the acquisition device. Assuming that the acquisition frequency of the acquisition device is 30 FPS, the acquisition device generates an acquisition synchronization signal every 1/30 second. In another embodiment, the acquisition synchronization signal generated by the acquisition device may also be generated according to the acquisition speed of the acquisition device. In practical applications, an appropriate method may be selected to generate the acquisition synchronization signal according to different application scenarios. In the embodiment of the present invention, Not specifically limited.
  • the display processor of the display device shown in FIG. 1 is connected to the image acquisition module of the acquisition device, so that the acquisition device can transmit the acquisition synchronization signal to the display processor, and the frame synchronization controller in the display processor A display synchronization signal is generated according to the acquired synchronization signal, and then the generated display synchronization signal is transmitted to a display controller, so that the display controller controls the display screen to display image data.
  • FIG. 2 is an image display method according to an embodiment of the present invention.
  • the image display method can be applied to the image processing system shown in FIG. 1.
  • the image processing system can be configured in any image acquisition and display system. In image processing equipment, such as drones, aerial vehicles and cameras.
  • the image display method shown in FIG. 2 will be specifically described below with reference to the architecture diagram of the image display system shown in FIG. 1.
  • the image display method described in FIG. 2 is applied in a case where the acquisition frequency of the acquisition device and the display frame rate of the display device are different.
  • the display device receives the acquisition synchronization signal sent by the acquisition device in S201.
  • the acquisition synchronization signal herein may be generated by the acquisition device or generated by a control device (such as a control chip) related to the acquisition device.
  • the acquisition synchronization signal received by the display device may be transmitted through a hard wire connected to the acquisition device, or may be transmitted by other means.
  • the display device After the display device receives the acquisition synchronization signal, it generates a display synchronization signal based on the acquisition synchronization signal in S202 to display image data.
  • the display synchronization signal is used to instruct the display device to display image data.
  • the display device generates the display synchronization signal for displaying the image data based on the acquisition synchronization signal. It can be understood that: to ensure the display device and the acquisition device achieve accurate synchronization, the display device must Based on the acquisition synchronization signal of the acquisition device, it is determined when the display synchronization signal is generated to display the image data.
  • the acquisition device in FIG. 1 may first send an acquisition reference synchronization signal to the display device.
  • the display device After receiving the acquisition reference synchronization signal, the display device generates a display reference synchronization signal for triggering the start of image display.
  • the acquisition reference synchronization signal is used to indicate when the acquisition device starts to collect the first frame of image data
  • the display reference synchronization signal is used to indicate when the display device starts to display the first frame of image data.
  • the collection reference synchronization signal is used to indicate when the collection device starts to work
  • the display reference synchronization signal is used to indicate when the display device starts to work.
  • the display device may generate a display reference synchronization signal for triggering the image display to start: the display device may use the acquisition reference synchronization signal according to the acquisition reference synchronization signal.
  • image data processing delay determining a time point when triggering image display is triggered; and the display device generates the display reference synchronization signal at the determined time point.
  • the image data processing delay may refer to the time between the acquisition of the original image data by the acquisition device and the processing of the original image data to obtain the image data that can be used for display.
  • the image data processing delay can be set according to the time required for the image processing module in the acquisition device to process the original image data collected by the image acquisition module. For example, if the time required for the image processing module to process the original image data is 5 seconds, the image processing delay can be set to 5 seconds, or the image processing delay can be set to be greater than 5 seconds, such as 8 seconds. Understandably, setting a larger image processing delay can ensure that during the image data processing process, if the original image processing error or the original image is damaged, the original image data will be re-acquired and processed in a timely manner without affecting.
  • the display device normally displays image data.
  • the display device determines the display reference synchronization signal according to the acquisition reference synchronization signal and the image processing delay, which effectively solves the problem of the time consuming of the image data from the acquisition device to the display device, and further ensures that the acquisition device and the display device achieve accurate synchronization.
  • the display device may determine the time point when triggering the image display according to the acquisition reference synchronization signal and the image processing delay by: determining the time point when the acquisition device generates the acquisition reference synchronization signal; The time point of collecting the reference synchronization signal is delayed backward by the time length indicated by the image data delay, and the time point obtained after the delay is determined as the time point when the display device triggers to start image display.
  • FIG. 3 it is a schematic diagram of determining a time point when triggering image display is provided according to an embodiment of the present invention. In FIG. 3, assuming that the time point t represents the time point when the acquisition device generates the acquisition reference synchronization signal, and the image processing delay is set to 5 seconds, then the time point t + 5 represents the time point when the display device triggers to start image display.
  • the implementation manner that the S202 generates the display synchronization signal based on the acquisition synchronization signal may be: according to the time point when the display device originally generates the display synchronization signal and the time when the synchronization signal is collected, at the time when the display synchronization signal was originally generated Look for the acquisition synchronization signal within a preset time range, and generate a display synchronization signal at the time point when the acquisition synchronization signal is found. In this way, as soon as the acquisition device acquires image data, the display device can display the newly acquired The image data enables accurate synchronization between the acquisition device and the display device.
  • the step S202 of generating a display synchronization signal based on the acquisition synchronization signal includes: determining, by the display device, an initial time point for displaying image data based on a display frame rate; and the display device according to the initial time point and the Collecting a synchronization signal generates a display synchronization signal.
  • the display frame rate refers to the number of frames displayed per second on the display screen. For example, 30FPS refers to displaying 30 frames of image data per second, and 60FPS refers to displaying 60 frames of image data per second.
  • the initial time point refers to a time point when the display device should originally generate a display synchronization signal and display an image.
  • the determining the initial time point of the display image data based on the display frame rate may include: the display device determines a refresh time interval of the display image data according to the display frame rate; and the display device generates a display reference based on The time point and refresh interval of the synchronization signal determine the initial time point.
  • the time point when the display reference synchronization signal is generated refers to the time point when the display device starts to display the first frame of image data.
  • the display frame rate refers to the number of frames of image data displayed per second.
  • the time interval between each frame of image data can be calculated by 1 / frame rate.
  • the display frame rate is 30FPS, which means that 30 frames of image data are displayed in one second.
  • the initial time point of any one frame of image data can be determined. For example, assuming that the time point when the display device generates the reference synchronization signal is 0.02 seconds and the display frame rate of the display device is 30 FPS, the refresh time interval of the display device to display the image data is calculated to be 0.033 seconds.
  • the manner in which the display device determines the initial time point based on the time point at which the display reference synchronization signal is generated and the refresh time interval may be: first determine that the image data to be displayed is the frame data Based on the current frame of image data, the time difference between the time point when the current image data was originally displayed and the time point when the reference synchronization signal is generated is finally determined. Finally, the time difference is added to the time point when the reference synchronization signal is generated. The time point is the time point at which the current image data was originally displayed, that is, the initial time point.
  • a simple example, as shown in Figure 4, is a method for determining the initial time point.
  • the display frame rate of the display device is 60 FPS
  • the refresh interval for the display device to display image data is 0.0167 seconds.
  • FIG. 5 a flowchart of a method for generating a display synchronization signal according to an initial time point and acquiring a synchronization signal according to an embodiment of the present invention is shown.
  • the display device first searches for the acquisition synchronization signal according to the initial time point in S501.
  • the display device can display one frame of data.
  • the time point when the acquisition device generates the synchronization signal and the time when the display device generates the synchronization signal should be the same, or the time difference between the two. The value is within a preset small time range.
  • the initial time point is the time point when the display device originally generates the display synchronization signal, and the acquisition synchronization signal is searched for according to the initial time point, so that the display can adjust the time point when the display synchronization signal was originally generated according to the acquisition synchronization signal, and realize Accurate synchronization of acquisition device and display device.
  • the implementation manner of the display device searching for and acquiring the synchronization signal according to the initial time point in S501 may be: using the initial time point as a reference time point, at a time indicated by the configured frame synchronization time window Look for acquisition synchronization signals within range.
  • the frame synchronization time window may be pre-configured by the display device.
  • the time range indicated by the frame synchronization time window refers to the initial time point as the reference time point and the window length of the frame synchronization window as the maximum time length for which the synchronization signal can be found. A certain time range before or after the reference time point.
  • the window length of the frame synchronization time window should be shorter than the refresh time interval of the image display of the display device.
  • the refresh interval of the display image data is 0.033 seconds
  • the window length of the frame synchronization window should be between 0 and 0.033 seconds, for example, it can be 0.01 seconds.
  • FIG. 6a a schematic diagram of searching for and acquiring a synchronization signal according to an embodiment of the present invention is provided.
  • the display frame rate is 60 FPS
  • the window length of the frame synchronization window is set to less than 0.0167.
  • the time range indicated by the frame synchronization window can be any time period between a and b, a indicates that the frame synchronization window is forward.
  • the display device if the acquisition synchronization signal is found in S502, the time point when the acquisition synchronization signal is found is determined as the target time point, and the display device generates the display synchronization signal at the target time point in S503.
  • S503 can be understood as The display device adjusts the time point at which the image of the current frame should be displayed according to the acquisition synchronization signal of the acquisition device, thereby achieving synchronization between the acquisition device and the display device.
  • FIG. 7 is a schematic diagram of a display device generating a display synchronization signal according to an acquisition synchronization signal according to an embodiment of the present invention.
  • the image processing delay is 0.01 second
  • the time point at which the display device generates the display reference synchronization signal is 0.01 second
  • the acquisition frequency of the acquisition device is 30 FPS
  • the display frame rate of the display device is 60 FPS
  • frame synchronization is assumed.
  • the display device uses the initial time point as a reference time point and The acquisition synchronization signal is searched for within the time range indicated by the synchronization time window. Assuming that the acquisition synchronization signal is found at point A, point A is determined as the target time point, and the display device generates a display synchronization signal at point A.
  • the display device if the display device does not find the acquisition synchronization signal, the display device generates a display synchronization signal at an initial time point.
  • the display device did not find the acquisition synchronization signal within the time range indicated by the frame synchronization window, indicating that the time points between the time when the acquisition device acquires the image and the image displayed by the display device are quite different. In this case, it can be considered that the acquisition device and the display The device is difficult to get synchronized.
  • the display device may not adjust the time point of generating the display synchronization signal according to the acquisition device.
  • the image display method provided by the embodiment of the present invention as shown in FIG. 2 is mainly applied when the acquisition frequency of the acquisition device and the display frame rate of the display device are different, that is, when the acquisition frequency and the display frame rate are different,
  • the display device according to the embodiment of the present invention uses the acquisition device's acquisition synchronization signal as a basis to adjust the time point at which the display device generates the display synchronization signal to achieve the acquisition device at which point in time When it comes to image data, at what point in time does the display device display the image data.
  • the display device adjusts the time point of generating the display synchronization signal according to the acquisition synchronization signal. If the display frame rate is greater than the acquisition frequency, the time point at which the display synchronization signal is generated is determined as a postponed initial time point. A certain time point; if the display frame rate is less than the acquisition frame rate, the time point at which the display synchronization signal is generated is not determined to be a certain time point earlier than the initial time point. In one embodiment, if the acquisition frequency of the acquisition device and the display frame rate of the display device are the same, the display device may not make any adjustment to the time point at which the display synchronization signal is generated, that is, the display device generates the display synchronization signal at the initial time point. To display image data.
  • the display device may display the image data in an implementation manner: when the display device is generating the display synchronization signal, reading and searching the memory corresponding to the acquisition synchronization signal and collected by the acquisition device from the memory. Image data, and display the image data.
  • an embodiment of the present invention further provides an image display device as shown in FIG. 8, the image display device is configured in an image processing system, and the image processing system further The device comprises a collecting device, and the collecting device is connected with the display device.
  • the acquisition device is used to acquire image data.
  • the image display device includes a receiving unit 801 and a processing unit 802:
  • the receiving unit 801 is configured to receive a collection synchronization signal, and the collection synchronization signal and the image data collected by the collection device correspond to each other;
  • the processing unit 802 is configured to generate a display synchronization signal based on the acquired synchronization signal to display image data.
  • the acquisition device is further configured to send the acquisition reference synchronization signal to the image display device
  • the processing unit 802 of the image display device is further configured to generate a display reference synchronization signal for triggering the start of image display.
  • the implementation manner of the processing unit 802 for generating a display reference synchronization signal that triggers image display is: determining a time point when the trigger starts image display according to the acquisition reference synchronization signal and image data processing delay. ; Generating the display reference synchronization signal at the determined time point.
  • the implementation manner of the processing unit 802 for generating the display synchronization signal based on the acquisition synchronization signal is: determining an initial time point of the display image data based on the display frame rate; and generating the display time signal based on the initial time point and the acquisition synchronization signal.
  • the synchronization signal is displayed.
  • determining an initial time point of the display image data based on the display frame rate includes: determining a refresh time interval of the display image data according to the display frame rate; and based on the time point at which the display reference synchronization signal is generated and the The refresh interval determines the initial point in time.
  • generating a display synchronization signal according to the initial time point and the acquisition synchronization signal includes: searching for the acquisition synchronization signal according to the initial time point; if the acquisition synchronization signal is found, the search is performed on the acquisition synchronization signal.
  • a time point at which the synchronization signal is collected is determined as a target time point; a display synchronization signal is generated at the target time point to display image data.
  • the processing unit 802 is further configured to generate a display synchronization signal at the initial time point to display image data if the acquisition synchronization signal is not found according to the initial time point.
  • searching for the acquisition synchronization signal according to the initial time point includes: using the initial time point as a reference time point, searching for the acquisition synchronization signal within a time range indicated by the configured frame synchronization time window.
  • the processing unit is configured to generate a new display synchronization height based on the acquisition synchronization signal, and an embodiment of displaying the image data is: reading from the memory and acquiring the acquisition synchronization signal corresponding to the acquisition synchronization signal And display the image data.
  • the processing unit 802 After the receiving unit 801 receives the acquisition synchronization signal sent by the acquisition device, the processing unit 802 generates a display synchronization signal based on the acquisition synchronization signal to display image data, which can prevent the acquisition device from collecting the image and the display device from displaying the image. There is a step loss between the two to achieve precise synchronization.
  • FIG. 9 is a schematic block diagram of a structure of an image processing device according to an embodiment of the present invention.
  • the image processing device shown in FIG. 9 may include a collection device 901, a display device 902, and a memory 903.
  • the display device 902 and the memory 903 are connected through a bus 904.
  • the display device 902 may include a display processor 9021 and a display screen 9022.
  • the display processor 9021 includes a frame synchronization controller 9021a and a display controller 9021b.
  • the memory 903 is used to store a program. Instruction and image data.
  • the memory 903 may include a volatile memory, such as a random-access memory (RAM); the memory 903 may also include a non-volatile memory, such as a flash memory (flash memory, solid-state drive (SSD), etc.); the memory 903 may also be a double-rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR); the memory 903 may also include a combination of the above-mentioned types of memories.
  • RAM random-access memory
  • DDR double-rate synchronous dynamic random access memory
  • the display processor 9021 may be a central processing unit CPU.
  • the display processor 9021 may further include a hardware chip.
  • the above hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or the like.
  • the PLD may be a field-programmable gate array (FPGA), a generic array logic (GAL), or the like.
  • the display processor 9021 may also be a combination of the above structures.
  • the memory 903 is configured to store a computer program.
  • the computer program includes program instructions.
  • the display processor 9021 includes a frame synchronization controller 9021a and a display controller 9021b.
  • the frame synchronization controller 9021a is configured to execute the memory 903.
  • the stored program instructions are used to implement the steps of the corresponding method in the foregoing embodiments.
  • the display controller 9021b is configured to read the image data corresponding to the acquired acquisition synchronization signal from the memory 903 when the frame synchronization controller 9021a generates a display synchronization signal; the display screen 9022 is used to display an image data.
  • the frame synchronization controller 9021a is configured to execute when calling the program instruction: receiving the acquisition synchronization signal; and generating a display synchronization signal based on the acquisition synchronization signal to display image data.
  • the frame synchronization controller 9021a is configured to call the program instruction and further execute: after receiving the image acquisition frame reference synchronization signal, generating a display reference synchronization signal.
  • the frame synchronization controller 9021a is configured to call the program instruction to execute and generate a display reference synchronization signal in a specific manner: determining to generate the display according to the acquisition reference synchronization signal and image data processing delay. A time point of the reference synchronization signal; and generating the display reference synchronization signal at the time point of the display reference synchronization signal.
  • the frame synchronization controller 9021a is configured to call the program instruction to execute a specific manner of generating a display synchronization signal based on the acquisition synchronization signal: determining an initial time point of displaying image data based on a display frame rate; The initial time point and the acquisition synchronization signal generate a display synchronization signal.
  • the specific manner of determining the initial time point of the display image data based on the display frame rate is: determining the refresh time interval of the display image data according to the display frame rate; and based on the time of generating the image display frame reference synchronization signal The point and the refresh time interval determine an initial time point.
  • the specific manner of generating a display synchronization signal according to the initial time point and the acquisition synchronization signal is: finding the acquisition synchronization signal according to the initial time point; if the acquisition synchronization signal is found, The time point at which the synchronization signal is collected is determined as a target time point; a display synchronization signal is generated at the target time point to display image data.
  • the specific manner of searching for the acquisition synchronization signal according to the initial time point is: using the initial time point as a reference time point to search for the acquisition synchronization signal within the time range indicated by the frame synchronization time window.
  • the frame synchronization controller 9021a is configured to execute when the program instruction is called: if no acquisition synchronization signal is found, a display synchronization signal is generated at an initial time point.
  • the program can be stored in a computer-readable storage medium.
  • the program When executed, the processes of the embodiments of the methods described above may be included.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种图像处理***中的图像显示方法、装置及图像处理设备，所述图像处理***包括采集装置和显示装置，采集装置和显示装置相连，采集装置用于采集图像数据。其中，所述图像显示方法包括：显示装置接收采集同步信号（S201），并根据接收到的采集同步信号产生用于指示显示装置显示图像数据的显示同步信号，以便于显示装置显示图像数据（S202）。采用所述方法，可以避免采集装置采集图像与显示装置显示图像两者之间存在丢步的情况，达到精确的同步。

Description

一种图像显示方法、装置及图像处理设备 技术领域
本发明涉及图像处理技术领域，尤其涉及一种图像显示方法、装置及图像处理设备。
背景技术
无人机是利用无线电遥控设备和自备的程序控制装置操纵的不载人飞机，无人机最初被设计用于战争中，随着信息时代的发展，更多先进的信息处理与通信技术被应用在无人机中，使得无人机的种类不断增多。因此，目前的无人机可以应用在航拍、微型自拍、观察野生动物、新闻报道、电力巡检、影视拍摄等诸多领域。
其中，在航拍、微型自拍等领域应用时，要实现采集和显示图像数据，因此在无人机上需要配置有图像显示***。一般的图像***包括图像采集模块和图像显示模块，图像采集模块负责采集图像数据，图像显示模块负责显示图像数据。由于显示***调度由软件控制实现，在实际应用中，很难实现图像采集模块和图像显示模块的同步，如此导致采集到的图像和显示的图像出现失步的现象。
发明内容
本发明实施例提供一种图像显示方法、装置及图像处理设备，可使得图像采集装置和图像显示装置精确同步。
一方面，本发明实施例提供了一种图像处理***中的图像显示方法，图像处理***包括采集装置和显示装置，采集装置和显示装置相连，采集装置用于采集图像数据，包括：
所述显示装置接收所述采集同步信号，所述采集同步信号与所述采集装置采集到的图像数据相互对应；
所述显示装置基于所述采集同步信号产生显示同步信号，以显示图像数据。
另一方面，本发明实施例还提供了一种图像显示装置，所述图像显示装置配置于图像处理***中，所述图像处理***还包括采集装置，所述采集装置和所述图像显示装置相连，所述采集装置用于采集图像数据，所述图像显示装置包括：
接收单元，用于接收所述采集同步信号，所述采集同步信号与所述采集装置采集到的图像数据相互对应；
处理单元，用于基于所述采集同步信号产生显示同步信号以显示图像数据。
再一方面，本发明实施例提供了一种图像处理设备，所述图像处理设备包括采集装置和显示装置，所述采集装置和所述显示装置相连，所述采集装置用于采集图像数据，所述显示装置包括显示处理器和显示屏，所述显示处理器包括帧同步控制器和显示控制器，所述帧同步控制器用于：
接收所述采集同步信号，所述采集同步信号与所述采集装置采集到的图像数据相互对应；
基于所述采集同步信号产生显示同步信号，以显示图像数据。再一方面，本发明实施例提供一种计算机存储介质，该计算机存储介质存储有计算机程序指令，该计算机程序指令被执行时用于实现上述的图像处理***中的图像显示方法。
本发明实施例中的图像显示方法可以应用在包括有采集装置和显示装置的图像处理***中，在图像处理***中采集装置与显示装置相连接，采集装置主要用于采集图像数据。显示装置在接收到采集装置发送采集同步信号的情况下，基于采集同步信号产生显示同步信号，以便于根据该显示同步信号来显示图像数据，通过以采集装置的采集同步信号来产生显示装置的显示同步信号，可以避免采集装置采集图像与显示装置显示图像两者之间存在丢步的情况，达到精确的同步。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述 中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种图像处理***的结果图；
图2是本发明实施例提供的一种图像显示方法的流程图；
图3是本发明实施例提供的一种关于触发开始进行图像显示的时间点的确定的方法示意图；
图4是本发明实施例提供的一种关于初始时间点的确定方法示意图；
图5是本发明实施例提供的一种基于采集同步信号产生显示同步信号的方法流程图；
图6a是本发明实施例提供的一种关于查找采集同步信号的方法示意图；
图6b是本发明实施例提供的另一种关于查找采集同步信号的方法示意图；
图7是本发明实施例提供的另一种采集同步信号产生显示同步信号的方法流程图；
图8是本发明实施例提供的一种图像显示装置的结构示意图；
图9是本发明实施例提供的一种图像处理设备的结果示意图。
具体实施方式
本发明实施例针对图像处理***提出一种图像显示方法，所述图像处理***可以配置于无人机、航拍飞行器、相机等需要对图像进行采集并显示的图像处理设备中。在一个实施例中，图像处理***可包括采集装置和显示装置，采集装置与显示装置相连接，采集装置用于在检测到采集同步信号时触发采集图像数据，显示装置用于显示图像数据，显示装置显示的图像数据是采集装置采集到的经过处理后的图像数据。
在一个实施例中，采集装置在图像采集时，针对每一帧图像会对应一个采集同步信号，也即每采集到一个图像数据就会伴随产生一个采集同步信号，采集同步信号与图像数据是一一对应的，此处所述的采集同步信号可以是所述采集装置产生，或者也可以是与所述采集装置相关的控制装置(例如控制芯片)产生的。采集装置可包括图像采集模块和图像信号处理模块，图像采集模块与 图像信号处理模块相连接。在一个实施例中，图像采集模块可以是配置有图像传感器的图像采集设备，比如摄像头。图像采集模块采集到的图像数据为原始图像，其格式为RAW。RAW图像中记录了图像采集模块在采集图像数据时一些原始数据。例如，若图像采集模为相机，RAW格式的原始图像中记录了相机传感器的原始信息，还记录了相机拍摄图像数据时的ISO设置、快门速度、光圈值、白平衡等。图像采集模块将采集到的原始图像发送至图像信号处理模块，图像信号处理模块对原始图像进行处理，处理过程包括但不限于黑电平矫正、镜头畸变矫正、RAW域降噪处理、RAW域转RGB域以及颜色补偿等，图像信号处理模块处理后的图像数据即为显示装置将要显示的图像数据。在一个实施例中，图像信号处理模块将处理后的图像存储在图像显示设备的内存中。
在一个实施例中，显示装置在显示图像数据时，首先要产生显示同步信号，然后基于显示同步信号的指示来显示图像数据。显示装置可包括显示处理器和显示屏，显示处理器又可包括帧同步控制器和显示控制器，帧同步控制器主要用于产生显示同步信号，并将该显示同步信号发送给显示控制器；显示控制器基于该显示同步信号控制显示装置显示图像数据。在一个实施例中，显示装置基于显示同步信号的指示来显示图像数据可指：帧同步控制器产生显示同步信号后，将显示同步信号传递给显示控制器，显示控制器在接收到显示同步信号之后，从图像处理设备的内存中获取采集装置采集到的经过处理后的图像数据，再将此处的图像数据发送给显示屏，以便于显示屏将图像数据显示屏上进行显示，至此显示装置完成了显示图像数据。
参见图1，为本发明实施例提供的一种图像处理***的结构图，如图1所示的图像处理***中包括采集装置和显示装置，采集装置包括图像采集模块和图像处理模块，显示装置包括显示处理器和显示屏，显示处理器包括帧同步控制器和显示控制器，采集装置的图像采集模块和显示装置的显示处理器相连接。在一个实施例中，采集装置的图像采集模块和显示装置的显示处理器之间可通过硬线连接，在其他实施例中，图像采集模块和显示处理器之间也可以通过其他方式进行连接。
在一个实施例中，采集装置的图像采集模块用于采集图像数据；采集装置 的图像处理模块，用于将图像采集模块采集到的图像数据进行处理，并将处理后的图像数据发送至图像处理设备的内存中进行存储。再一个实施例中，在产生图像数据时，对应会伴随产生采集同步信号，可通过采集装置将该采集同步信号发送至显示装置，以使得显示装置基于采集同步信号来显示图像数据，可保证采集装置采集图像和显示装置显示图像达到同步。
在一个实施例中，采集装置中产生的采集同步信号可以是依据采集装置的采集频率产生的，假设采集装置的采集频率为30FPS，那么采集装置就是每隔1/30秒产生一个采集同步信号。再一个实施例中，采集装置产生的采集同步信号也可以是依据采集装置的采集速度产生的，在实际应用中可以根据不同应用场景，选择合适的方式产生采集同步信号，在本发明实施例中不做具体限定。
在一个实施例中，图1所示的显示装置的显示处理器与采集装置的图像采集模块相连接，可以使得采集装置将采集同步信号传输到显示处理器，显示处理器中的帧同步控制器根据该采集同步信号产生显示同步信号，然后将产生的显示同步信号传输给显示控制器，以便于显示控制器控制显示屏显示图像数据。
请参见图2，为本发明实施例提供的一种图像显示方法，该图像显示方法可以应用在如图1所示的图像处理***中，图像处理***可以配置在任何需要进行图像采集和显示的图像处理设备中，比如无人机、航拍飞行器以及相机等等。下面将结合图1所示的图像显示***的架构图，对图2所示的图像显示方法进行具体的描述。在一个实施例中，图2所述的图像显示方法应用在采集装置的采集频率和显示装置的显示帧率不相同的情况下。
在图2所示的图像显示方法中，显示装置在S201中接收采集装置发送的采集同步信号。此处的采集同步信号可以是采集装置产生的或者是与所述采集装置相关的控制装置(例如控制芯片)产生的。在一个实施例中，显示装置接收到的采集同步信号可以是通过与采集装置相连的硬线传输过来的，也可以是通过其他方式传输过来的。
显示装置接收到采集同步信号之后，在S202中基于所述采集同步信号产生显示同步信号，以显示图像数据。显示同步信号是用于指示显示装置显示图像数据的，显示装置基于采集同步信号来产生用于显示图像数据的显示同步信 号可以理解为：为了保证显示装置和采集装置达到精准同步，显示装置要以采集装置的采集同步信号为基础，来确定何时产生显示同步信号以显示图像数据。
在一个实施例中，图1中的采集装置在向显示装置发送采集同步信号之前，可以先发送一个采集基准同步信号给显示装置。显示装置在接收到采集基准同步信号后，产生用于触发开始进行图像显示的显示基准同步信号。采集基准同步信号是用于指示采集装置在何时开始进行第一帧图像数据的采集，显示基准同步信号是用于指示显示装置在何时开始进行第一帧图像数据的显示。也可以理解为，采集基准同步信号是用来指示采集装置何时开始工作，显示基准同步信号是用来指示显示装置何时开始工作。
在一个实施例中，显示装置在接收到采集装置发送的采集基准同步信号之后，产生用于触发开始进行图像显示的显示基准同步信号的方式可以为：所述显示装置根据所述采集基准同步信号和图像数据处理时延，确定触发开始进行图像显示的时间点；所述显示装置在确定的所述时间点产生所述显示基准同步信号。图像数据处理时延，可以指从采集装置采集到原始图像数据到对该原始图像数据进行处理得到可用于显示的图像数据之间的时长。
在一个实施例中，图像数据处理时延，可以根据采集装置中图像处理模块对图像采集模块采集到的原始图像数据进行处理所需的时间来设定的。比如，图像处理模块对原始图像数据处理所需的时间为5秒，则可设置图像处理时延为5秒，或者也可以设置图像处理时延大于5秒比如8秒。可以理解的，将图像处理时延设置的较大一些可以保证在图像数据处理过程中，如果出现原始图像处理出错或者原始图像损坏等特殊情况时，及时重新获取原始图像数据并处理，而不影响显示装置正常显示图像数据。显示装置根据采集基准同步信号和图像处理时延来确定显示基准同步信号，有效的解决了图像数据从采集装置到显示装置中间耗时问题，进一步保证了采集装置和显示装置达到精准同步。
在一个实施例中，所述显示装置根据采集基准同步信号和图像处理时延，确定触发开始进行图像显示的时间点的方式可以为：确定采集装置产生采集基准同步信号的时间点；然后将产生采集基准同步信号的时间点向后延迟图像数据时延所指示的时间长度，将延迟后得到的时间点确定为显示装置触发开始进 行图像显示的时间点。例如，如图3所示，为本发明实施例提供的一种确定触发开始进行图像显示的时间点的示意图。在图3中，假设时间点t表示采集装置产生采集基准同步信号的时间点，图像处理时延设置为5秒，则t+5时间点表示显示装置触发开始进行图像显示的时间点。
在一个实施例中，所述S202基于所述采集同步信号产生显示同步信号的实现方式可以是：根据显示装置原本产生显示同步信号的时间点和采集同步信号，在原本产生显示同步信号的时间点前后预设时间范围内查找采集同步信号，在查找到采集同步信号的时间点处产生显示同步信号，这样一来便实现了采集装置一采集到图像数据，则显示装置就能显示刚采集到的图像数据，使得采集装置和显示装置达到精准同步。
在一个实施例中，所述S202基于采集同步信号产生显示同步信号，包括：所述显示装置基于显示帧率确定显示图像数据的初始时间点；所述显示装置根据所述初始时间点和所述采集同步信号产生显示同步信号。显示帧率是指显示屏每秒显示帧数，比如30FPS指每秒显示30帧图像数据，60FPS指每秒显示60帧图像数据。初始时间点是指显示装置原本应该产生显示同步信号并显示图像的时间点。
在一个实施例中，所述基于显示帧率确定显示图像数据的初始时间点可包括：所述显示装置根据所述显示帧率确定显示图像数据的刷新时间间隔；所述显示装置基于产生显示基准同步信号的时间点和刷新时间间隔确定初始时间点。产生显示基准同步信号的时间点是指显示装置开始显示第一帧图像数据的时间点。显示帧率是指每秒显示图像数据的帧数，则各帧图像数据之间显示的时间间隔可通过1/帧率计算得到，比如显示帧率为30FPS，表示一秒显示了30帧图像数据，则每两帧图像数据显示的时间间隔也即显示图像数据的刷新时间间隔为1/30＝0.033秒，也就是显示装置每隔0.033秒显示一帧图像数据。进一步的，根据每两帧图像数据显示的时间间隔，如果在已知开始显示图像数据的时间点的情况下，便可以确定任何一帧图像数据的初始时间点。比如，假设显示装置产生基准同步信号的时间点在0.02秒，显示装置的显示帧率为30FPS，则计算得到显示装置显示图像数据的刷新时间间隔为0.033秒，如此便可确定显示装置显示第二帧图像数据的时间点为0.02+0.033＝0.053秒。
在一个实施例中，所述显示装置基于所述产生显示基准同步信号的时间点和所述刷新时间间隔确定初始时间点的方式可以为：首先确定当前要显示的图像数据是第几帧图像数据，根据当前是第几帧图像数据可以确定原本显示当前图像数据的时间点与产生显示基准同步信号的时间点之间的时间差，最后在产生基准同步信号的时间点基础上加上时间差，得到的时间点便是原本显示当前图像数据的时间点，也即初始时间点。
一个简单的例子，如图4所示为一种确定初始时间点的方法，假设显示装置的显示帧率为60FPS，则显示装置显示图像数据的刷新时间间隔为0.0167秒，假设当前要显示的图像数据为第3帧图像数据，则原本显示第3帧图像数据与产生基准同步信号的时间点之间的时间差为2*0.0167＝0.034秒；再假设显示装置产生基准同步信号的时间点为0.1秒处，基于上述假设，则显示装置可确定显示第3帧图像数据的初始时间点为0.1+0.034＝0.134秒。
参考图5，为本发明实施例提供的一种根据初始时间点和采集同步信号产生显示同步信号的方法流程图。如图5所示的根据初始时间点和采集同步信号产生显示同步信号的方法中，显示装置首先在S501中根据初始时间点查找采集同步信号。为了保证采集装置每采集到一帧数据，显示装置就可以显示一帧数据，应该确保采集装置产生采集同步信号的时间点和显示装置产生显示同步信号的时间点相同，或者两者时间点的差值在预设很小的时间范围内。在S501中，初始时间点即为显示装置原本产生显示同步信号的时间点，根据初始时间点查找采集同步信号，以便于显示根据采集同步信号对原本产生显示同步信号的时间点进行调整，与实现采集装置和显示装置的精准同步。
在一个实施例中，S501中所述显示装置根据所述初始时间点查找采集同步信号的实现方式可以为：以所述初始时间点为参考时间点，在配置的帧同步时间窗口所指示的时间范围内查找采集同步信号。帧同步时间窗口可以是显示装置预先配置的，帧同步时间窗口所指示的时间范围是指以初始时间点为参考时间点，以帧同步窗口的窗口长度为最大可查找采集同步信号的时间长度，在参考时间点之前或者之后一定的时间范围。为了避免各帧图像数据之间产生影响，帧同步时间窗口的窗口长度应该小于显示装置图像显示的刷新时间间隔。举例来说，比如显示装置的显示帧率为30FPS，则显示图像数据的刷新时间间 隔为0.033秒，帧同步窗口的窗口长度应该在包括0-0.033秒之间，比如可以为0.01秒。
举例来说，参见图6a为本发明实施例提供一种查找采集同步信号的示意图。在图6a中假设显示帧率为60FPS，设置帧同步窗口的窗口长度为小于0.0167，帧同步窗口所指示的时间范围为可为a到b之间任意一个时间段，a表示帧同步窗口向前移动的可移动到的最小时间点，b点帧同步窗口向后移动的可移动到的最大时间点。如果帧同步窗口的窗口长度过长比如0.0167秒，当帧同步窗口移动到d点和c点时，则会出现如图6b所示的情况，造成各个帧之间互相影响。
在一个实施例中，在S502中如果查找到采集同步信号，将查找到采集同步信号的时间点确定为目标时间点，并且在S503中显示装置在目标时间点产生显示同步信号，S503可理解为显示装置根据采集装置的采集同步信号调整了当前帧的图像原本应该显示的时间点，从而实现采集装置和显示装置同步。
举例来说，参考图7为本发明实施例提供的一种显示装置根据采集同步信号产生显示同步信号的示意图。在图7中，假设图像处理时延为0.01秒，显示装置产生显示基准同步信号的时间点为0.01秒，假设采集装置的采集频率为30FPS，显示装置的显示帧率为60FPS，再假设帧同步窗口的窗口长度为0.02秒。根据显示帧率和产生显示基准同步信号的时间点可确定第二帧数据的初始时间点为0.01+0.0167＝0.0267秒时间点处，进一步的，显示装置以初始时间点为参考时间点，在帧同步时间窗口所指示的时间范围内查找采集同步信号，假设在A点查找到采集同步信号，则将A点确定为目标时间点，显示装置在A点产生显示同步信号。
再一个实施例中，如果显示装置未查找到采集同步信号，则显示装置在初始时间点产生显示同步信号。显示装置在帧同步窗口所指示的时间范围内未查找到采集同步信号，表明采集装置采集到图像和显示装置显示图像两者的时间点相差较大，在这种情况可以认为是采集装置和显示装置很难得到同步的。显示装置可不依据采集装置他调整其产生显示同步信号的时间点。
如图2所示的本发明实施例提供的图像显示方法主要应用在采集装置的采集频率和显示装置的显示帧率不相同的情况下，也就是说在采集频率和显示 帧率不相同时，为了保证采集装置采集图像和显示装置显示图像达到同步，本发明实施例显示装置以采集装置的采集同步信号作为依据，调整显示装置产生显示同步信号的时间点，以实现采集装置在哪个时间点采集到图像数据，显示装置则在哪个时间点显示图像数据。采用图2所示的图像显示方法，显示装置依据采集同步信号调整产生显示同步信号的时间点，如果显示帧率大于采集频率，则将产生显示同步信号的时间点确定为初始时间点推后的某一个时间点；如果显示帧率小于采集帧率，则将产生显示同步信号的时间点未定为初始时间点提前的某一个时间点。在一个实施例中，如果采集装置的采集频率和显示装置的显示帧率相同，则显示装置可不对产生显示同步信号的时间点做任何调整，也就是显示装置在初始时间点产生显示同步信号，以显示图像数据。
在一个实施例中，显示装置显示图像数据的实现方式可以为：当显示装置在产生显示同步信号时，从存储器中读取查找到的由所述采集装置采集的与所述采集同步信号对应的图像数据，并显示所述图像数据。
基于上述方法实施例的描述，在一个实施例中，本发明实施例还提供了一种如图8所示的图像显示装置，该图像显示装置配置于图像处理***中，所述图像处理***还包括采集装置，采集装置与显示装置相连接。采集装置是用于采集图像数据的，图像显示装置包括接收单元801和处理单元802：
接收单元801，用于接收采集同步信号，采集同步信号与所述采集装置采集到的图像数据相互对应；
处理单元802，用于基于采集同步信号产生显示同步信号，以显示图像数据。
在一个实施例中，采集装置还用于将采集基准同步信号发送给图像显示装置，图像显示装置的处理单元802，还用于产生用于触发开始进行图像显示的显示基准同步信号。在一个实施例中，处理单元802用于产生触发开始进行图像显示的显示基准同步信号的实施方式为：根据所述采集基准同步信号和图像数据处理时延，确定触发开始进行图像显示的时间点；在确定的所述时间点产生所述显示基准同步信号。
在一个实施例中，处理单元802用于基于采集同步信号产生显示同步信号的实施方式为：基于显示帧率确定显示图像数据的初始时间点；根据所述初始 时间点和所述采集同步信号产生显示同步信号。在一个实施例中，基于显示帧率确定显示图像数据的初始时间点，包括：根据所述显示帧率确定显示图像数据的刷新时间间隔；基于所述产生显示基准同步信号的时间点和所述刷新时间间隔确定初始时间点。
在一个实施例中，根据所述初始时间点和所述采集同步信号产生显示同步信号，包括：根据所述初始时间点查找采集同步信号；如果查找到所述采集同步信号，将查找到所述采集同步信号的时间点确定为目标时间点；在所述目标时间点产生显示同步信号，以显示图像数据。在一个实施例中，处理单元802还用于，若根据初始时间点未查找到采集同步信号，则在初始时间点产生显示同步信号，以显示图像数据。
在一个实施例中，根据初始时间点查找采集同步信号，包括：以所述初始时间点为参考时间点，在配置的帧同步时间窗口所指示的时间范围内查找采集同步信号。在一个实施例中，处理单元用于基于采集同步信号产生显示同步新高，以显示图像数据的实施方式为：从存储器中读取查找到的由所述采集装置采集的与所述采集同步信号对应的图像数据，并显示所述图像数据。
在本发明实施例中，在接收单元801接收到采集装置发送的采集同步信号之后，处理单元802基于采集同步信号产生显示同步信号，以显示图像数据，可以避免采集装置采集图像与显示装置显示图像两者之间存在丢步的情况，达到精确的同步。
请参见图9，是本发明实施例提供的一种图像处理设备的结构示意性框图，如图9所示的图像处理设备可包括：采集装置901、显示装置902和存储器903，采集装置901、显示装置902和存储器903通过总线904相连接，显示装置902可包括显示处理器9021和显示屏9022，显示处理器9021包括帧同步控制器9021a和显示控制器9021b，所述存储器903用于存储程序指令和图像数据。
所述存储器903可以包括易失性存储器(volatile memory)，如随机存取存储器(random-access memory，RAM)；存储器903也可以包括非易失性存储器(non-volatile memory)，如快闪存储器(flashmemory)，固态硬盘(solid-state drive，SSD)等；存储器903也可以是双倍速率同步动态随机存储器(Double  Data Rate SDRAM，DDR)；存储器903还可以包括上述种类的存储器的组合。
所述显示处理器9021可以是中央处理器CPU。所述显示处理器9021还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit，ASIC)，可编程逻辑器件(programmable logic device，PLD)等。该PLD可以是现场可编程逻辑门阵列(field-programmable gate array，FPGA)，通用阵列逻辑(generic array logic，GAL)等。所述显示处理器9021也可以为上述结构的组合。
本发明实施例中，所述存储器903用于存储计算机程序，所述计算机程序包括程序指令，显示处理器9021包括帧同步控制器9021a和显示控制器9021b，帧同步控制器9021a用于执行存储器903存储的程序指令，用来实现上述实施例中的相应方法的步骤。在一个实施例中，显示控制器9021b，用于在帧同步控制器9021a产生显示同步信号时，从存储器903中读取查找到的采集同步信号对应的图像数据；显示屏9022，用于显示图像数据。
在一个实施例中，所述帧同步控制器9021a被配置用于调用所述程序指令时执行：接收所述采集同步信号；基于所述采集同步信号产生显示同步信号，以显示图像数据。
在一个实施例中，帧同步控制器9021a被配置用于调用所述程序指令时还执行：在接收到所述图像采集帧基准同步信号后，产生显示基准同步信号。
在一个实施例中，帧同步控制器9021a被配置用于调用所述程序指令执行产生显示基准同步信号的具体方式为：根据所述采集基准同步信号和图像数据处理时延，确定产生所述显示基准同步信号的时间点；在所述显示基准同步信号的时间点产生所述显示基准同步信号。
在一个实施例中，帧同步控制器9021a被配置用于调用所述程序指令执行基于所述采集同步信号产生显示同步信号的具体方式为：基于显示帧率确定显示图像数据的初始时间点；根据所述初始时间点和所述采集同步信号产生显示同步信号。在一个实施例中，基于显示帧率确定显示图像数据的初始时间点的具体方式为：根据所述显示帧率确定显示图像数据的刷新时间间隔；基于所述产生图像显示帧基准同步信号的时间点和所述刷新时间间隔确定初始时间点。
在一个实施例中，根据所述初始时间点和所述采集同步信号产生显示同步 信号的具体方式为：根据所述初始时间点查找采集同步信号；如果查找到所述采集同步信号，将查找到所述采集同步信号的时间点确定为目标时间点；在所述目标时间点产生显示同步信号，以显示图像数据。
在一个实施例中，根据初始时间点查找采集同步信号的具体方式为：以所述初始时间点为参考时间点，在帧同步时间窗口所指示的时间范围内查找采集同步信号。在一个实施例中，帧同步控制器9021a被配置用于调用所述程序指令时还执行：如果没有查找到采集同步信号，在初始时间点产生显示同步信号。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的程序可存储于一计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(RandomAccess Memory，RAM)等。
以上所揭露的仅为本发明部分实施例而已，当然不能以此来限定本发明之权利范围，因此依本发明权利要求所作的等同变化，仍属本发明所涵盖的范围。

Claims (21)

  1. 一种图像处理***中的图像显示方法，其特征在于，所述图像处理***包括采集装置和显示装置，所述采集装置和所述显示装置相连，所述采集装置用于采集图像数据，所述方法包括：
    所述显示装置接收所述采集同步信号，所述采集同步信号与所述采集装置采集到的图像数据相互对应；
    所述显示装置基于所述采集同步信号产生显示同步信号，以显示图像数据。
  2. 如权利要求1所述的方法，其特征在于，所述采集装置将用于触发开始进行图像采集的采集基准同步信号发送给所述显示装置，所述方法还包括：
    所述显示装置在接收到所述采集基准同步信号后，产生用于触发开始进行图像显示的显示基准同步信号。
  3. 如权利要求2所述的方法，其特征在于，所述显示装置产生用于触发开始进行图像显示的显示基准同步信号，包括：
    所述显示装置根据所述采集基准同步信号和图像数据处理时延，确定触发开始进行图像显示的时间点；
    所述显示装置在确定的所述时间点产生所述显示基准同步信号。
  4. 如权利要求2所述的方法，其特征在于，所述基于所述采集同步信号产生显示同步信号，包括：
    所述显示装置基于显示帧率确定显示图像数据的初始时间点；
    所述显示装置根据所述初始时间点和所述采集同步信号产生显示同步信号。
  5. 如权利要求4所述的方法，其特征在于，所述显示装置基于显示帧率确定显示图像数据的初始时间点，包括：
    所述显示装置根据所述显示帧率确定显示图像数据的刷新时间间隔；
    所述显示装置基于所述产生显示基准同步信号的时间点和所述刷新时间间隔确定初始时间点。
  6. 如权利要求4所述的方法，其特征在于，所述显示装置根据所述初始时间点和所述采集同步信号产生显示同步信号，包括：
    所述显示装置根据所述初始时间点查找采集同步信号；
    如果查找到所述采集同步信号，所述显示装置将查找到所述采集同步信号的时间点确定为目标时间点；
    所述显示装置在所述目标时间点产生显示同步信号，以显示图像数据。
  7. 如权利要求6所述的方法，其特征在于，所述显示装置根据所述初始时间点查找采集同步信号，包括：
    所述显示装置以所述初始时间点为参考时间点，在配置的帧同步时间窗口所指示的时间范围内查找采集同步信号。
  8. 如权利要求4-7所述的方法，其特征在于，在确定所述采集装置的采集频率和所述显示装置的显示帧率不相同时，所述显示装置执行所述基于显示帧率确定显示图像数据的初始时间点的步骤。
  9. 如权利要求6所述的方法，其特征在于，所述方法还包括：
    如果没有查找到所述采集同步信号，所述显示装置在所述初始时间点产生显示同步信号。
  10. 如权利要求1所述的方法，其特征在于，所述显示装置基于所述采集同步信号产生显示同步信号，以显示图像数据，包括：
    所述显示装置在产生所述显示同步信号时，从存储器中读取查找到的由所述采集装置采集的与所述采集同步信号对应的图像数据，并显示所述图像数据。
  11. 一种图像显示装置，其特征在于，所述图像显示装置配置于图像处理***中，所述图像处理***还包括采集装置，所述采集装置和所述图像显示装置相连，所述采集装置用于采集图像数据，所述图像显示装置包括：
    接收单元，用于接收所述采集同步信号，所述采集同步信号与所述采集装置采集到的图像数据相互对应；
    处理单元，用于基于所述采集同步信号产生显示同步信号，以显示图像数据。
  12. 一种图像处理设备，其特征在于，所述图像处理设备包括采集装置和显示装置，所述采集装置和所述显示装置相连，所述采集装置用于采集图像数据，所述显示装置包括显示处理器和显示屏，所述显示处理器包括帧同步控制器和显示控制器，所述帧同步控制器用于：
    接收所述采集同步信号，所述采集同步信号与所述采集装置采集到的图像数据相互对应；
    基于所述采集同步信号产生显示同步信号，以显示图像数据。
  13. 如权利要求12所述的图像处理设备，其特征在于，所述采集装置将产生的采集基准同步信号发送给所述显示装置，所述帧同步控制器还用于：
    在接收到所述图像采集帧基准同步信号后，产生显示基准同步信号。
  14. 如权利要求13所述的图像处理设备，其特征在于，所述帧同步控制器用于产生显示基准同步信号的具体方式为：
    根据所述采集基准同步信号和图像数据处理时延，确定产生所述显示基准同步信号的时间点；
    在所述显示基准同步信号的时间点产生所述显示基准同步信号。
  15. 如权利要求13所述的图像处理设备，其特征在于，所述帧同步控制器用于基于所述采集同步信号产生显示同步信号的具体方式为：
    基于显示帧率确定显示图像数据的初始时间点；
    根据所述初始时间点和所述采集同步信号产生显示同步信号。
  16. 如权利要求15所述的图像处理设备，其特征在于，所述基于显示帧率确定显示图像数据的初始时间点的具体方式为：
    根据所述显示帧率确定显示图像数据的刷新时间间隔；
    基于所述产生图像显示帧基准同步信号的时间点和所述刷新时间间隔确定初始时间点。
  17. 如权利要求15所述的图像处理设备，其特征在于，所述根据所述初始时间点和所述采集同步信号产生显示同步信号的具体方式为：
    根据所述初始时间点查找采集同步信号；
    如果查找到所述采集同步信号，将查找到所述采集同步信号的时间点确定为目标时间点；
    在所述目标时间点产生显示同步信号，以显示图像数据。
  18. 如权利要求17所述的图像处理设备，其特征在于，所述根据所述初始时间点查找采集同步信号的具体方式为：
    以所述初始时间点为参考时间点，在帧同步时间窗口所指示的时间范围内查找采集同步信号。
  19. 如权利要求15-17所述的图像处理设备，其特征在于，在确定所述采集装置的采集频率和所述显示装置的显示帧率不相同时，所述帧同步控制器基于显示帧率确定显示图像数据的初始时间点。
  20. 如权利要求12所述的图像处理设备，其特征在于，帧同步控制器还用于：
    如果没有查找到采集同步信号，在所述初始时间点产生显示同步信号。
  21. 如权利要求12所述的图像处理设备，其特征在，所述显示控制器，用于在所述帧同步控制器产生显示同步信号时，从存储器中读取查找到的所述采集同步信号对应的图像数据；所述显示屏，用于显示所述图像数据。
PCT/CN2018/103294 2018-08-30 2018-08-30 一种图像显示方法、装置及图像处理设备 WO2020042090A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880037421.8A CN110870301B (zh) 2018-08-30 2018-08-30 一种图像显示方法、装置及图像处理设备
PCT/CN2018/103294 WO2020042090A1 (zh) 2018-08-30 2018-08-30 一种图像显示方法、装置及图像处理设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/103294 WO2020042090A1 (zh) 2018-08-30 2018-08-30 一种图像显示方法、装置及图像处理设备

Publications (1)

Publication Number Publication Date
WO2020042090A1 true WO2020042090A1 (zh) 2020-03-05

Family

ID=69642656

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/103294 WO2020042090A1 (zh) 2018-08-30 2018-08-30 一种图像显示方法、装置及图像处理设备

Country Status (2)

Country Link
CN (1) CN110870301B (zh)
WO (1) WO2020042090A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021159338A1 (zh) * 2020-02-12 2021-08-19 深圳元戎启行科技有限公司 图像采集方法、装置、控制装置、计算机设备、可读存储介质、图像采集设备和远程驾驶***

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102060234A (zh) * 2010-10-26 2011-05-18 常州超媒体与感知技术研究所有限公司 轮胎吊车行进轨迹视频纠偏装置及方法
CN103402060A (zh) * 2013-08-14 2013-11-20 中国科学院长春光学精密机械与物理研究所 Dmd灰度景象播放器与图像采集***的同步方法
CN104869360A (zh) * 2015-05-19 2015-08-26 华为技术有限公司 视频采集和显示同步方法和装置
CN106683034A (zh) * 2016-12-29 2017-05-17 上海拆名晃信息科技有限公司 一种用于虚拟现实的异步时间卷曲计算方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102956188A (zh) * 2012-12-11 2013-03-06 四川虹欧显示器件有限公司 一种驱动等离子显示设备的方法和装置
KR20150122395A (ko) * 2014-04-23 2015-11-02 삼성전기주식회사 백라이트 장치 및 이의 제어 방법
CN105450382A (zh) * 2014-05-26 2016-03-30 华为技术有限公司 用于媒体播放的时钟同步方法及设备
WO2016151936A1 (ja) * 2015-03-26 2016-09-29 三菱電機株式会社 映像情報再生システム及び映像情報再生装置
CN106210443B (zh) * 2016-08-31 2019-05-24 广东省广告集团股份有限公司 网络控制显示内容同步的方法
CN107613357B (zh) * 2017-09-13 2020-05-19 广州酷狗计算机科技有限公司 声画同步优化方法、装置及可读存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102060234A (zh) * 2010-10-26 2011-05-18 常州超媒体与感知技术研究所有限公司 轮胎吊车行进轨迹视频纠偏装置及方法
CN103402060A (zh) * 2013-08-14 2013-11-20 中国科学院长春光学精密机械与物理研究所 Dmd灰度景象播放器与图像采集***的同步方法
CN104869360A (zh) * 2015-05-19 2015-08-26 华为技术有限公司 视频采集和显示同步方法和装置
CN106683034A (zh) * 2016-12-29 2017-05-17 上海拆名晃信息科技有限公司 一种用于虚拟现实的异步时间卷曲计算方法

Also Published As

Publication number Publication date
CN110870301A (zh) 2020-03-06
CN110870301B (zh) 2021-04-02

Similar Documents

Publication Publication Date Title
EP2963909A1 (en) Electronic apparatus
US20220053126A1 (en) Photographing apparatus, unmanned aerial vehicle, control terminal and method for photographing
US20070013807A1 (en) Digital camera
US10609265B2 (en) Methods and apparatus for synchronizing camera flash and sensor blanking
JP5843525B2 (ja) 撮像装置及びその制御方法
US8531537B2 (en) Imaging apparatus for processing still picture signals and live view signals output from an image sensor
US11120272B2 (en) Imaging apparatus, electronic device, and method of transmitting image data
WO2020042090A1 (zh) 一种图像显示方法、装置及图像处理设备
CN107181894B (zh) 拍摄装置
JP2013110754A (ja) カメラ装置、及びその撮影方法とプログラム
JP6728010B2 (ja) 撮像装置及び撮像装置の制御方法
US11356603B2 (en) Image capturing apparatus and control method therefor
CN113329170B (zh) 图像抖动校正方法、装置、计算机设备和可读存储介质
JP7087187B2 (ja) ぶれ補正装置、撮像装置、監視システム、及びプログラム
US20130083963A1 (en) Electronic camera
JPWO2006022305A1 (ja) 撮像装置
US10863100B2 (en) Control apparatus, communication apparatus, control method, and storage medium
JP6351255B2 (ja) 撮像装置及び撮像方法、プログラム、記憶媒体
US9282306B2 (en) Imaging device, information processing device, and non-transitory computer readable medium storing program
US10044963B2 (en) Imaging apparatus
JP2015104003A (ja) 画像表示方法、イメージセンサ及び撮像装置
JP6620615B2 (ja) 撮影装置
US11711619B2 (en) Controlling exposure based on inverse gamma characteristic
JP7110007B2 (ja) 画像処理装置、撮像装置、画像処理装置の制御方法、プログラムおよび記憶媒体
US10728464B2 (en) Imaging apparatus including auto exposure correction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18932100

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18932100

Country of ref document: EP

Kind code of ref document: A1