WO2022087824A1

WO2022087824A1 - Endoscope photographing system and image data transmission apparatus therefor

Info

Publication number: WO2022087824A1
Application number: PCT/CN2020/123995
Authority: WO
Inventors: 徐涛; 魏开云
Original assignee: 深圳迈瑞生物医疗电子股份有限公司
Priority date: 2020-10-27
Filing date: 2020-10-27
Publication date: 2022-05-05
Also published as: CN116507262A

Abstract

An endoscope photographing system and an image data transmission apparatus therefor. Image data transmission is implemented by means of a first data processing device (20), an optical fiber transmission assembly (30), and a second data processing device (40). The first data processing device (20) is at least used to convert image data based on a first data communication protocol and output by an image sensor (10) into data based on a second data communication protocol, the optical fiber transmission assembly (30) transmits said data to the second data processing device (40), and then the second data processing device (40) converts the obtained image data into image data based on a third data communication protocol and outputs same to an image processing portion (500) for processing.

Description

内窥镜摄像***及其影像数据传输装置Endoscope camera system and its image data transmission device

技术领域technical field

本发明涉及一种内窥镜摄像***及其影像数据传输装置。The invention relates to an endoscope camera system and an image data transmission device thereof.

背景技术Background technique

近年来，内窥镜摄像***越来越被广泛地应用于外科手术和诊断检查中；内窥镜摄像***能够将人体内部的影像提供给医生，医生通过影像可以稳定正确地进行手术或进行检查。In recent years, endoscopic camera systems have been more and more widely used in surgical operations and diagnostic inspections; endoscopic camera systems can provide images of the inside of the human body to doctors, and doctors can perform operations or inspections stably and correctly through the images. .

内窥镜摄像***的分辨率经历了高清（HD）、全高清（FHD）再到超高清（UHD）的发展历程，或者说，经历了1K、2K 再到4K的发展历程。在分辨率不断提升的同时，也有许多技术问题待解决。The resolution of the endoscopic camera system has gone through the development process of high definition (HD), full high definition (FHD) and then ultra high definition (UHD), or in other words, it has gone through the development process of 1K, 2K and then 4K. While the resolution continues to improve, there are also many technical issues to be resolved.

例如随着内窥镜摄像***分辨率的不断提高，其进行影像数据采集的传感器，所采集的数据量也不断增大；所采集的数据需要通过传输线缆组件传输到内窥镜摄像***的主机进行处理，为了保证实时性和显示效率，这需要传输线缆组件能够高速地传输大量数据，并且抗干扰能力要好。For example, with the continuous improvement of the resolution of the endoscope camera system, the amount of data collected by the sensors that collect image data is also increasing; the collected data needs to be transmitted to the endoscope camera system through the transmission cable assembly. The host performs processing. In order to ensure real-time performance and display efficiency, the transmission cable assembly needs to be able to transmit a large amount of data at high speed and have better anti-interference ability.

目前内窥镜摄像***中图像数据从传感器传输到图像处理主机，一般是通过多通道的双绞线来实现，这有许多缺点，例如整体线缆过粗，抗干扰能力偏差，并且通常无法满足大分辨率的图像数据的实时传输。At present, the transmission of image data from the sensor to the image processing host in the endoscope camera system is generally realized through multi-channel twisted-pair cables. Real-time transmission of large-resolution image data.

技术问题technical problem

技术解决方案technical solutions

一种用于内窥镜摄像***的影像数据传输装置，所述影像数据传输装置用于与所述内窥镜摄像***中的影像处理部连接，以向所述影像处理部传输影像数据；包括：An image data transmission device for an endoscope camera system, the image data transmission device is used for connecting with an image processing unit in the endoscope camera system to transmit image data to the image processing unit; comprising :

至少第一影像传感器和第二影像传感器，所述第一影像传感器和第二影像传感器都用于生成影像数据，所述第一影像传感器和第二影像传感器通过各自的数据输出通道输出基于第一数据通信协议的影像数据；at least a first image sensor and a second image sensor, the first image sensor and the second image sensor are both used for generating image data, the first image sensor and the second image sensor output data based on the first image sensor through respective data output channels Image data of data communication protocol;

第一数据处理器件，所述第一数据处理器件与所述第一影像传感器、第二影像传感器的数据输出通道都通信连接；所述第一数据处理器件包括至少第一组数据输出端和第二组数据输出端；所述第一数据处理器件用于将所述第一影像传感器所输出的影像数据转换成基于第二数据通信协议的第一组影像数据，并通过所述第一组数据输出端输出，以及将所述第二影像传感器所输出的影像数据转换成基于第二数据通信协议的第二组影像数据，并通过所述第二组数据输出端输出；所述第二数据通信协议与所述第一数据通信协议不同；A first data processing device, the first data processing device is communicatively connected with the data output channels of the first image sensor and the second image sensor; the first data processing device includes at least a first group of data output ends and a second Two sets of data output terminals; the first data processing device is used to convert the image data output by the first image sensor into a first set of image data based on a second data communication protocol, and pass the first set of data The output terminal outputs, and converts the image data output by the second image sensor into a second group of image data based on a second data communication protocol, and outputs through the second group of data output terminals; the second data communication the protocol is different from the first data communication protocol;

光纤传输组件，包括电光转换器，光电转换器，以及至少第一光纤传输通道和第二光纤传输通道；所述电光转换器用于将由所述第一数据处理器件输出的第一组影像数据由电信号转换为光信号，并通过所述第一光纤传输通道传输给所述光电转换器，所述光电转换器再将所接收的第一组影像数据由光信号转换为电信号并输出；所述电光转换器还用于将由所述第一数据处理器件输出的第二组影像数据由电信号转换为光信号，并通过所述第二光纤传输通道传输给所述光电转换器，所述光电转换器再将所接收的第二组影像数据由光信号转换为电信号并输出；The optical fiber transmission assembly includes an electrical-to-optical converter, an optical-to-electrical converter, and at least a first optical fiber transmission channel and a second optical fiber transmission channel; The signal is converted into an optical signal, and transmitted to the photoelectric converter through the first optical fiber transmission channel, and the photoelectric converter converts the received first group of image data from optical signals into electrical signals and outputs them; The electro-optical converter is also used to convert the second group of image data output by the first data processing device from electrical signals into optical signals, and transmit them to the photoelectric converter through the second optical fiber transmission channel, and the photoelectric conversion The device then converts the received second group of image data from optical signals into electrical signals and outputs them;

第二数据处理器件，包括至少第一组数据输入端和第二组数据输入端；所述第二数据处理器件用于通过所述第一组数据输入端接收由所述光电转换器输出的第一组影像数据，并将该第一组影像数据转换成基于第三数据通信协议的影像数据以输出；以及，所述第二数据处理器件还用于通过所述第二组数据输入端接收由所述光电转换器输出的第二组影像数据，并将该第二组影像数据转换成基于第三数据通信协议的影像数据以输出。A second data processing device includes at least a first group of data input terminals and a second group of data input terminals; the second data processing device is configured to receive the first data output from the photoelectric converter through the first group of data input terminals a set of image data, and convert the first set of image data into image data based on a third data communication protocol for output; and the second data processing device is further configured to receive through the second set of data input terminals The photoelectric converter outputs the second group of image data, and converts the second group of image data into image data based on a third data communication protocol for output.

在一实施例中，所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用V-by-One信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用V-by-One信号传输接口标准，所述第二数据通信协议为基于V-by-One信号传输接口标准的协议；In one embodiment, the first group of data output terminals and the second group of data output terminals of the first data processing device adopt the V-by-One signal transmission interface standard, and the first group of data output terminals of the second data processing device The input end and the second group of data input ends adopt the V-by-One signal transmission interface standard, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard;

或者，所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用FPD-LINK信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用FPD-LINK信号传输接口标准，所述第二数据通信协议为基于FPD-LINK信号传输接口标准的协议。Alternatively, the first group of data output ends and the second group of data output ends of the first data processing device use the FPD-LINK signal transmission interface standard, and the first group of data input ends and the second group of data input ends of the second data processing device The data input end adopts the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.

在一实施例中，所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用FPD-LINK III信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用FPD-LINK III信号传输接口标准，所述第二数据通信协议为基于FPD-LINK III信号传输接口标准的协议；In one embodiment, the first group of data output terminals and the second group of data output terminals of the first data processing device use the FPD-LINK III signal transmission interface standard, and the first group of data input terminals of the second data processing device The terminal and the second group of data input terminals adopt the FPD-LINK III signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard;

或者，所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用FPD-LINK IV信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用FPD-LINK IV信号传输接口标准，所述第二数据通信协议为基于FPD-LINK IV信号传输接口标准的协议。Alternatively, the first group of data output ends and the second group of data output ends of the first data processing device use the FPD-LINK IV signal transmission interface standard, and the first group of data input ends and the second group of data input ends of the second data processing device. The group data input end adopts the FPD-LINK IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.

在一实施例中，所述第三数据通信协议与所述第一数据通信协议相同，或者所述第三数据通信协议与所述第一数据通信协议不同。In one embodiment, the third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.

在一实施例中，所述第一影像传感器和第二影像传感器的数据输出通道为MIPI CSI接口，所述第一数据通信协议为MIPI CSI协议。In one embodiment, the data output channels of the first image sensor and the second image sensor are MIPI CSI interfaces, and the first data communication protocol is MIPI CSI protocol.

在一实施例中，所述第二数据通信协议满足：基于所述第二数据通信协议的影像数据具备由所述电光转换器将影像数据由电信号转换为光信号所要求的信号振幅。In one embodiment, the second data communication protocol satisfies that the image data based on the second data communication protocol has a signal amplitude required by the electro-optical converter to convert the image data from an electrical signal to an optical signal.

在一实施例中，所述第一光纤传输通道包括第一光纤，所述第二光纤传输通道包括第二光纤； In one embodiment, the first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber;

所述电光转换器包括至少第一输入端、第二输入端、第一输出端和第二输出端；所述光电转换器包括至少第一输入端、第二输入端、第一输出端和第二输出端；所述电光转换器的第一输出端通过所述第一光纤与所述光电转换器的第一输入端相连；所述电光转换器的第二输出端通过所述第二光纤与所述光电转换器的第二输入端相连；The electro-optical converter includes at least a first input end, a second input end, a first output end and a second output end; the photoelectric converter includes at least a first input end, a second input end, a first output end and a second output end. Two output ends; the first output end of the electro-optical converter is connected to the first input end of the photoelectric converter through the first optical fiber; the second output end of the electro-optical converter is connected to the second optical fiber through the second optical fiber. the second input end of the photoelectric converter is connected;

所述电光转换器通过其第一输入端接收由所述第一数据处理器件输出的第一组影像数据，并将该第一组影像数据由电信号转换为光信号；所述电光转换器通过其第一输出端将被转换为光信号的第一组影像数据输出，并通过所述第一光纤传输；所述光电转换器通过其第一输入端接收由所述第一光纤传输过来的被转换为光信号的第一组影像数据，并将该第一组影像数据由光信号转换为电信号，以通过其第一输出端输出；The electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals into optical signals; the electro-optical converter passes Its first output end outputs the first group of image data converted into optical signals, and transmits it through the first optical fiber; the photoelectric converter receives through its first input end the image data transmitted by the first optical fiber. converting the first group of image data into optical signals, and converting the first group of image data from optical signals into electrical signals for outputting through the first output end;

所述电光转换器通过其第二输入端接收由所述第一数据处理器件输出的第二组影像数据，并将该第二组影像数据由电信号转换为光信号；所述电光转换器通过其第二输出端将被转换为光信号的第二组影像数据输出，并通过所述第二光纤传输；所述光电转换器通过其第二输入端接收由所述第二光纤传输过来的被转换为光信号的第二组影像数据，并将该第二组影像数据由光信号转换为电信号，以通过其第二输出端输出。The electro-optical converter receives the second group of image data output by the first data processing device through its second input end, and converts the second group of image data from electrical signals into optical signals; the electro-optical converter passes Its second output end outputs the second group of image data converted into optical signals, and transmits it through the second optical fiber; the photoelectric converter receives the image data transmitted by the second optical fiber through its second input end. Converting the second group of image data into the optical signal, and converting the second group of image data from the optical signal into the electrical signal, so as to be output through its second output terminal.

在一实施例中，所述电光转换器包括第一电光转换器和第二电光转换器；所述光电转换器包括第一光电转换器和第一光电转换器；所述第一光纤传输通道包括第一光纤，所述第二光纤传输通道包括第二光纤；In one embodiment, the electrical-to-optical converter includes a first electrical-to-optical converter and a second electrical-to-optical converter; the opto-electrical converter includes a first electrical-to-optical converter and a first electrical-to-optical converter; the first optical fiber transmission channel includes a first optical fiber, the second optical fiber transmission channel includes a second optical fiber;

所述第一电光转换器包括第一输入端和第一输出端；所述第二电光转换器包括第二输入端和第二输出端；所述第一光电转换器包括第一输入端和第一输出端；所述第二光电转换器包括第二输入端和第二输出端；所述第一电光转换器的第一输出端通过所述第一光纤与所述第一光电转换器的第一输入端相连；所述第二电光转换器的第二输出端通过所述第二光纤与所述第二光电转换器的第二输入端相连；The first electro-optical converter includes a first input end and a first output end; the second electro-optical converter includes a second input end and a second output end; the first photoelectric converter includes a first input end and a second output end; an output end; the second photoelectric converter includes a second input end and a second output end; the first output end of the first photoelectric converter passes through the first optical fiber and the first output end of the first photoelectric converter an input end is connected; the second output end of the second electro-optical converter is connected with the second input end of the second electro-optical converter through the second optical fiber;

所述第一电光转换器通过其第一输入端接收由所述第一数据处理器件输出的第一组影像数据，并将该第一组影像数据由电信号转换为光信号；所述第一电光转换器通过其第一输出端将被转换为光信号的第一组影像数据输出，并通过所述第一光纤传输；所述第一光电转换器通过其第一输入端接收由所述第一光纤传输过来的被转换为光信号的第一组影像数据，并将该第一组影像数据由光信号转换为电信号，以通过其第一输出端输出；The first electro-optical converter receives the first group of image data output by the first data processing device through its first input end, and converts the first group of image data from electrical signals into optical signals; the first The electro-optical converter outputs the first group of image data converted into optical signals through its first output end, and transmits it through the first optical fiber; the first electro-optical converter receives through its first input end A first group of image data converted into optical signals transmitted by an optical fiber, and the first group of image data is converted from optical signals into electrical signals to be output through its first output end;

所述第二电光转换器通过其第二输入端接收由所述第一数据处理器件输出的第二组影像数据，并将该第二组影像数据由电信号转换为光信号；所述第二电光转换器通过其第二输出端将被转换为光信号的第二组影像数据输出，并通过所述第二光纤传输；所述第二光电转换器通过其第二输入端接收由所述第二光纤传输过来的被转换为光信号的第二组影像数据，并将该第二组影像数据由光信号转换为电信号，以通过其第二输出端输出。The second electro-optical converter receives the second group of image data output by the first data processing device through its second input end, and converts the second group of image data from electrical signals into optical signals; the second The electro-optical converter outputs the second group of image data converted into optical signals through its second output end, and transmits it through the second optical fiber; the second photoelectric converter receives through its second input end The second group of image data transmitted from the two optical fibers is converted into an optical signal, and the second group of image data is converted from an optical signal into an electrical signal to be output through its second output end.

影像传感器，所述影像传感器用于生成并输出基于第一数据通信协议的影像数据；an image sensor for generating and outputting image data based on the first data communication protocol;

第一数据处理器件，所述第一数据处理器件至少用于将所述影像传感器所输出的影像数据转换成基于第二数据通信协议的影像数据并输出；所述第二数据通信协议与所述第一数据通信协议不同；A first data processing device, the first data processing device is at least used for converting the image data output by the image sensor into image data based on a second data communication protocol and outputting; the second data communication protocol and the The first data communication protocol is different;

光纤传输组件，用于将由所述第一数据处理器件输出的影像数据由电信号转换为光信号进行传输后，再将所述转换为光信号的影像数据由光信号转换为电信号并输出；an optical fiber transmission component for converting the image data output by the first data processing device from an electrical signal into an optical signal for transmission, and then converting the image data converted into an optical signal from an optical signal into an electrical signal and outputting;

第二数据处理器件，用于接收从所述光纤传输组件传输过来的所述影像数据，并将该影像数据转换成基于第三数据通信协议的影像数据以输出；a second data processing device, configured to receive the image data transmitted from the optical fiber transmission component, and convert the image data into image data based on a third data communication protocol for output;

其中：in:

所述第一数据处理器件和所述第二数据处理器件之间采用V-by-One信号传输接口标准，所述第二数据通信协议为基于V-by-One信号传输接口标准的协议；A V-by-One signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard;

或者，所述第一数据处理器件和所述第二数据处理器件之间采用FPD-LINK信号传输接口标准，所述第二数据通信协议为基于FPD-LINK信号传输接口标准的协议。Alternatively, the FPD-LINK signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.

在一实施例中，所述第一数据处理器件和所述第二数据处理器件之间采用FPD-LINK III信号传输接口标准，所述第二数据通信协议为基于FPD-LINK III信号传输接口标准的协议；In one embodiment, the FPD-LINK III signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is based on the FPD-LINK III signal transmission interface standard agreement;

或者，所述第一数据处理器件和所述第二数据处理器件之间采用FPD-LINK IV信号传输接口标准，所述第二数据通信协议为基于FPD-LINK IV信号传输接口标准的协议。Alternatively, the FPD-LINK IV signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.

在一实施例中，所述第一数据通信协议为MIPI CSI协议。In one embodiment, the first data communication protocol is MIPI CSI protocol.

在一实施例中，所述第二数据通信协议满足：基于所述第二数据通信协议的影像数据具备由所述光纤传输组件将影像数据由电信号转换为光信号所要求的信号振幅。In one embodiment, the second data communication protocol satisfies that the image data based on the second data communication protocol has a signal amplitude required by the optical fiber transmission component to convert the image data from electrical signals to optical signals.

在一实施例中，所述光纤传输组件包括电光转换器、光纤传输通道和光电转换器；In one embodiment, the optical fiber transmission assembly includes an electrical-to-optical converter, a fiber-optic transmission channel, and an optical-to-electrical converter;

所述电光转换器接收由所述第一数据处理器件输出的影像数据，并将该影像数据由电信号转换为光信号，以输出给所述光纤传输通道；The electro-optical converter receives the image data output by the first data processing device, and converts the image data from an electrical signal into an optical signal, so as to output to the optical fiber transmission channel;

所述光纤传输通道用于传输被转换为光信号的所述影像数据；所述光纤传输通道包括光纤；The optical fiber transmission channel is used to transmit the image data converted into an optical signal; the optical fiber transmission channel includes an optical fiber;

所述光电转换器接收由所述光纤传输通道传输过来的被转换为光信号的所述影像数据，并将该影像数据由光信号转换为电信号后输出。The photoelectric converter receives the image data transmitted from the optical fiber transmission channel and is converted into an optical signal, converts the image data from the optical signal into an electrical signal, and outputs the image data.

一种内窥镜摄像***，包括：An endoscope camera system, comprising:

光源部；light source part;

光源控制部，用于控制所述光源部提供成像所需的光；a light source control unit for controlling the light source unit to provide light required for imaging;

内窥镜，包括能够***到生物体内部的***部；an endoscope, including an insertion portion capable of being inserted into a living body;

摄像部，所述摄像部包括上述任意一项所述的影像数据传输装置；an imaging unit, the imaging unit includes the video data transmission device described in any one of the above;

影像处理部，用于接收并处理由所述内窥镜数据传输装置所输出的影像数据，以生成用于显示影像的数据；an image processing unit for receiving and processing image data output by the endoscope data transmission device to generate data for displaying images;

显示器，用于对所述用于显示影像的数据进行显示。A display for displaying the data for displaying the image.

在一实施例中，所述影像处理部包括FPGA或CPU。In one embodiment, the image processing unit includes an FPGA or a CPU.

附图说明Description of drawings

图1为一种实施例的影像数据传输装置的结构示意图；FIG. 1 is a schematic structural diagram of an image data transmission apparatus according to an embodiment;

图2为一种实施例的影像数据传输装置的结构示意图；FIG. 2 is a schematic structural diagram of an image data transmission apparatus according to an embodiment;

图3为一种实施例的影像数据传输装置的结构示意图；FIG. 3 is a schematic structural diagram of an image data transmission apparatus according to an embodiment;

图4为一种实施例的影像数据传输装置的结构示意图；4 is a schematic structural diagram of an image data transmission apparatus according to an embodiment;

图5为一种实施例的影像数据传输装置的结构示意图；FIG. 5 is a schematic structural diagram of an image data transmission apparatus according to an embodiment;

图6为一种实施例的影像数据传输装置的结构示意图；6 is a schematic structural diagram of an image data transmission apparatus according to an embodiment;

图7为一种实施例的内窥镜摄像***的结构示意图；7 is a schematic structural diagram of an endoscope camera system according to an embodiment;

图8为一种实施例的内窥镜摄像***的结构示意图；8 is a schematic structural diagram of an endoscopic camera system according to an embodiment;

图9为一种实施例的内窥镜摄像***的结构示意图；9 is a schematic structural diagram of an endoscope camera system according to an embodiment;

图10为一种实施例的内窥镜摄像***的结构示意图；10 is a schematic structural diagram of an endoscope camera system according to an embodiment;

图11为一种实施例的内窥镜摄像***的结构示意图；11 is a schematic structural diagram of an endoscope camera system according to an embodiment;

图12为一种实施例的内窥镜摄像***的结构示意图；12 is a schematic structural diagram of an endoscope camera system according to an embodiment;

图13为一种实施例的内窥镜摄像***的结构示意图；13 is a schematic structural diagram of an endoscopic camera system according to an embodiment;

图14为一种实施例的内窥镜摄像***的结构示意图；14 is a schematic structural diagram of an endoscope camera system according to an embodiment;

图15为一种实施例的内窥镜摄像***的结构示意图；15 is a schematic structural diagram of an endoscopic camera system according to an embodiment;

图16为一种实施例的内窥镜摄像***的结构示意图；16 is a schematic structural diagram of an endoscopic camera system according to an embodiment;

图17为一种实施例的内窥镜摄像***的结构示意图。FIG. 17 is a schematic structural diagram of an endoscopic imaging system according to an embodiment.

本发明的实施方式Embodiments of the present invention

下面通过具体实施方式结合附图对本发明作进一步详细说明。其中不同实施方式中类似元件采用了相关联的类似的元件标号。在以下的实施方式中，很多细节描述是为了使得本申请能被更好的理解。然而，本领域技术人员可以毫不费力的认识到，其中部分特征在不同情况下是可以省略的，或者可以由其他元件、材料、方法所替代。在某些情况下，本申请相关的一些操作并没有在说明书中显示或者描述，这是为了避免本申请的核心部分被过多的描述所淹没，而对于本领域技术人员而言，详细描述这些相关操作并不是必要的，他们根据说明书中的描述以及本领域的一般技术知识即可完整了解相关操作。The present invention will be further described in detail below through specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments have used associated similar element numbers. In the following embodiments, many details are described so that the present application can be better understood. However, those skilled in the art will readily recognize that some of the features may be omitted under different circumstances, or may be replaced by other elements, materials, and methods. In some cases, some operations related to the present application are not shown or described in the specification, in order to avoid the core part of the present application from being overwhelmed by excessive description, and for those skilled in the art, these are described in detail. The relevant operations are not necessary, and they can fully understand the relevant operations according to the descriptions in the specification and general technical knowledge in the field.

另外，说明书中所描述的特点、操作或者特征可以以任意适当的方式结合形成各种实施方式。同时，方法描述中的各步骤或者动作也可以按照本领域技术人员所能显而易见的方式进行顺序调换或调整。因此，说明书和附图中的各种顺序只是为了清楚描述某一个实施例，并不意味着是必须的顺序，除非另有说明其中某个顺序是必须遵循的。Additionally, the features, acts, or characteristics described in the specification may be combined in any suitable manner to form various embodiments. At the same time, the steps or actions in the method description can also be exchanged or adjusted in order in a manner obvious to those skilled in the art. Therefore, the various sequences in the specification and drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a necessary order unless otherwise stated, a certain order must be followed.

本文中为部件所编序号本身，例如“第一”、“第二”等，仅用于区分所描述的对象，不具有任何顺序或技术含义。而本申请所说“连接”、“联接”，如无特别说明，均包括直接和间接连接（联接）。The serial numbers themselves, such as "first", "second", etc., for the components herein are only used to distinguish the described objects, and do not have any order or technical meaning. The "connection" and "connection" mentioned in this application, unless otherwise specified, include both direct and indirect connections (connections).

如上所述，目前内窥镜摄像***的图像数据采集和传输方案，其性能无法满足实时摄像的高清甚至4K的要求。As mentioned above, the current image data acquisition and transmission scheme of the endoscopic camera system cannot meet the high-definition or even 4K requirements of real-time camera.

首先，目前4K式的影像传感器一般采用sub-LVDS接口的影像传感器，而无法选用性能更好的MIPI CSI接口的影像传感器。这是因为内窥镜摄像***的图像采集部分（摄像头/摄像手柄）会受到尺寸和功耗的约束，而性能更好的MIPI CSI接口的影像传感器，其通常具有4个数据通道，这使得单个通道的速率较高，通常超过了1.5Gbps，而sub-LVDS接口的影像传感器通常具有8-10个数据通道，因此在数量相同的情况下，sub-LVDS接口的影像传感器的单个通道的速率可以大大降低，例如不到1 Gbps。因此，目前内窥镜摄像***在图像采集方面无法直接选择诸如MIPI CSI接口的影像传感器。First of all, the current 4K-type image sensor generally adopts the image sensor of the sub-LVDS interface, and the image sensor of the MIPI CSI interface with better performance cannot be selected. This is because the image acquisition part (camera/camera handle) of the endoscope camera system is constrained by size and power consumption, while the image sensor of the MIPI CSI interface with better performance usually has 4 data channels, which makes a single The rate of the channel is higher, usually exceeding 1.5Gbps, and the image sensor of the sub-LVDS interface usually has 8-10 data channels, so in the case of the same number, the rate of a single channel of the image sensor of the sub-LVDS interface can be Much lower, like less than 1 Gbps. Therefore, the current endoscopic camera system cannot directly choose such as MIPI in image acquisition. Image sensor with CSI interface.

其次，对于4K式的影像传感器，其所采集和待传输的数据量非常大，为了保证实时性，需要高速地将影像传感器所采集的图像数据传输给图像处理主机，但目前的像多通道的双绞线来实现的图像数据传输，无法满足这种高速的实时传输，并且抗干扰能力偏差，线缆也比较粗。Secondly, for the 4K image sensor, the amount of data collected and to be transmitted is very large. In order to ensure real-time performance, it is necessary to transmit the image data collected by the image sensor to the image processing host at high speed. The image data transmission realized by twisted pair cable cannot meet this high-speed real-time transmission, and the anti-interference ability is deviated, and the cable is relatively thick.

考虑到大分辨率典型像4K式的内窥镜摄像***，目前还存在诸多技术问题待解决，申请人对这些技术问题中的一个或多个进行了研究，并提出了一些解决方案，下面具体说明。Considering that a typical 4K-style endoscope camera system with large resolutions still has many technical problems to be solved, the applicant has studied one or more of these technical problems, and proposed some solutions. The details are as follows. illustrate.

一些实施例中提供了一种影像数据传输装置，本发明中的影像数据传输装置可以应用于诸如内窥镜摄像***等场合和产品中。本发明的影像数据传输装置可以与内窥镜摄像***中的影像处理部，例如图像处理主机连接，向影像处理部传输影像数据，并且其向影像处理部所传输的影像数据可以供影像处理部处理并生成用于显示影像的数据。影像数据传输装置可以包括一个或多个影像传感器，下面分情况进行说明。Some embodiments provide an image data transmission device, and the image data transmission device in the present invention can be applied to occasions and products such as an endoscope camera system. The image data transmission device of the present invention can be connected to an image processing unit in an endoscope camera system, such as an image processing host, to transmit image data to the image processing unit, and the image data transmitted to the image processing unit can be used by the image processing unit Process and generate data for displaying imagery. The image data transmission device may include one or more image sensors, which will be described in the following cases.

请参照图1，一些实施例中的影像数据传输装置包括影像传感器10、第一数据处理器件20、光纤传输组件30和第二数据处理器件40，下面具体说明。Referring to FIG. 1 , an image data transmission apparatus in some embodiments includes an image sensor 10 , a first data processing device 20 , an optical fiber transmission assembly 30 and a second data processing device 40 , which will be described in detail below.

影像传感器10用于生成并输出基于第一数据通信协议的影像数据。一些实施例中，影像传感器10包括至少两个数据输出通道例如10a和10b，所述影像传感器通过其所述至少两个数据输出通道例如10a和10b输出影像数据。影像传感器10可以生成按照作为移动设备用CPU的AP（Application Processor，应用处理器）所能处理的规格的影像数据。The image sensor 10 is used to generate and output image data based on the first data communication protocol. In some embodiments, the image sensor 10 includes at least two data output channels, such as 10a and 10b, through which the image sensor outputs image data. The image sensor 10 can generate an AP (Application Processor, application processor) can process the image data of the specifications.

第一数据处理器件20与影像传感器10的数据输出通道通信连接；第一数据处理器件20至少用于将影像传感器10所输出的影像数据转换成基于第二数据通信协议的影像数据并输出；第二数据通信协议与第一数据通信协议不同。The first data processing device 20 is connected in communication with the data output channel of the image sensor 10; the first data processing device 20 is at least used to convert the image data output by the image sensor 10 into image data based on the second data communication protocol and output; The second data communication protocol is different from the first data communication protocol.

光纤传输组件30用于将由第一数据处理器件20输出的影像数据由电信号转换为光信号进行传输后，再将该影像数据由光信号转换为电信号并输出。光纤传输组件30只是作为一个透传通道，不涉及协议打包和解包工作。The optical fiber transmission assembly 30 is used for converting the image data output by the first data processing device 20 from electrical signals into optical signals for transmission, and then converting the image data from optical signals into electrical signals and outputting the image data. The optical fiber transmission component 30 is only used as a transparent transmission channel, and does not involve the work of protocol packing and unpacking.

请参照图2，一些实施例中，光纤传输组件30可以包括电光转换器32、光纤传输通道39a和光电转换器36。电光转换器32接收由第一数据处理器件20输出的影像数据，并将该影像数据由电信号转换为光信号，以输出给光纤传输通道39a；光纤传输通道39a用于传输被转换为光信号的影像数据，一些例子中，光纤传输通道39a包括光纤；光电转换器36接收由光纤传输通道39a传输过来的被转换为光信号的影像数据，并将该影像数据由光信号转换为电信号后输出。Referring to FIG. 2 , in some embodiments, the optical fiber transmission assembly 30 may include an electrical-to-optical converter 32 , a fiber-optic transmission channel 39 a and an optical-to-electrical converter 36 . The electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from electrical signals into optical signals for output to the optical fiber transmission channel 39a; the optical fiber transmission channel 39a is used to transmit the converted optical signals In some examples, the optical fiber transmission channel 39a includes an optical fiber; the photoelectric converter 36 receives the image data transmitted by the optical fiber transmission channel 39a and is converted into an optical signal, and converts the image data from the optical signal into an electrical signal. output.

第二数据处理器件40用于接收从光纤传输组件30传输过来的影像数据，并将该影像数据转换成基于第三数据通信协议的影像数据以输出。The second data processing device 40 is used for receiving the image data transmitted from the optical fiber transmission component 30, and converting the image data into image data based on the third data communication protocol for output.

可以看到，第一数据处理器件20、光纤传输组件30和第二数据处理器件40配合，将影像传感器10生成的影像数据进行传输，例如传输给影像处理部等，影像处理部可以是FPGA或其他的CPU处理平台。光纤传输组件30主要是进行电光转换，再通过光纤传输光信号，之后再进行光电转换；第一数据处理器件20和第二数据处理器件40则配合，形成对片方案。第一数据处理器件20和第二数据处理器件 40在产品设计时，包括采用对片方案的两个芯片，这两个芯片通常为外购，两者之间采用专有的数据通信协议进行数据传输，即第二数据通信协议可以为专有数据通信协议，该专有数据通信协议为芯片供应商提供。It can be seen that the first data processing device 20, the optical fiber transmission assembly 30 and the second data processing device 40 cooperate to transmit the image data generated by the image sensor 10, for example, to the image processing unit, which can be an FPGA or Other CPU processing platforms. The optical fiber transmission component 30 mainly performs electro-optical conversion, transmits optical signals through optical fibers, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution. During product design, the first data processing device 20 and the second data processing device 40 include two chips using a chip-to-chip solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used between the two for data communication. The transmission, ie the second data communication protocol, may be a proprietary data communication protocol provided by the chip supplier.

在一实施例中，影像传感器10可以生成MIPI（Mobile Industry Processor Interface，移动行业处理器接口）规格的影像数据，例如影像传感器的数据输出通道为MIPI CSI 接口，所述第一数据通信协议为MIPI CSI协议。具体的，影像传感器的数据输出通道可以为MIPI CSI-2接口。MIPI是2003年由英国ARM、芬兰诺基亚Nokia、意法半导体 ST 和美国德州仪器TI等公司成立的一个联盟，目的是把手机内部的接口如摄像头、显示屏接口、射频/基带接口等标准化，从而减少手机设计的复杂程度和增加设计灵活性。MIPI联盟下面有不同的工作组，分别定义了一系列的手机内部接口标准，比如摄像头接口CSI （Camera Serial Interface）、显示接口DSI（Display Serial Interface）、射频接口DigRF、麦克风/喇叭接口SLIMbus等。终端市场要求具有更低功耗、更高数据传输率和更小的PCB占位空间，现在使用的几种基于标准的串行差分接口当中，MIPI接口适合用于在功率敏感同时又要求高性能的设备领域中。具体地，如上所述，CSI是由MIPI联盟下摄像工作组指定的接口标准；CSI-2是MIPI CSI第二版，主要由应用层、协议层、物理层组成，通常支持4通道数据传输，单线传输速度高达1Gb/s，也有支持8通道数据传输。除地线外，MIPI CSI-2接口一般会有1对I2C通信引脚，1对MIPI差分时钟引脚和1~4对MIPI差分数据信号引脚。In one embodiment, the image sensor 10 can generate image data of MIPI (Mobile Industry Processor Interface, Mobile Industry Processor Interface) specification, for example, the data output channel of the image sensor is MIPI CSI interface, and the first data communication protocol is MIPI CSI protocol. Specifically, the data output channel of the image sensor can be MIPI CSI-2 interface. MIPI is an alliance established in 2003 by companies such as ARM in the UK, Nokia in Finland, STMicroelectronics ST, and Texas Instruments TI in the United States. Reduce mobile phone design complexity and increase design flexibility. There are different working groups under the MIPI Alliance, which define a series of mobile phone internal interface standards, such as camera interface CSI (Camera Serial Interface), display interface DSI (Display Serial Interface), radio frequency interface DigRF, microphone/speaker interface SLIMbus, etc. End markets require lower power consumption, higher data rates, and a smaller PCB footprint. Among the several standards-based serial differential interfaces in use today, the MIPI interface is suitable for power-sensitive and high-performance applications. in the field of equipment. Specifically, as mentioned above, CSI is an interface standard specified by the camera working group under the MIPI Alliance; CSI-2 is the second version of MIPI CSI, which is mainly composed of an application layer, a protocol layer, and a physical layer, and usually supports 4-channel data transmission. The single-wire transmission speed is up to 1Gb/s, and it also supports 8-channel data transmission. In addition to the ground wire, the MIPI CSI-2 interface generally has 1 pair of I2C communication pins, 1 pair of MIPI differential clock pins and 1~4 pairs of MIPI differential data signal pins.

通常的，内窥镜摄像***的摄像头为手持式的，医生在对病人进行手术时，手持摄像头，以调整观察部位和控制参数。由于影像传感器传输的数据量大，因此传输功率大，同时也产生较大的热量。摄像头需要设计为低功耗、发热少等特点。而MIPI接口的影像传感器则具有低功耗的特点，正好满足摄像头的设计要求。Usually, the camera of the endoscope camera system is hand-held, and the doctor holds the camera to adjust the observation part and control parameters when performing surgery on the patient. Due to the large amount of data transmitted by the image sensor, the transmission power is large, and it also generates a large amount of heat. Cameras need to be designed with features such as low power consumption and low heat generation. The image sensor of the MIPI interface has the characteristics of low power consumption, which just meets the design requirements of the camera.

因此，为了降低相关器件的功耗，本实施例采用具有较低功耗的MIPI CSI接口的影像传感器。然而，由于光纤传输组件将影像数据由电信号转换为光信号时，对影像数据的信号摆幅有要求。例如，光纤传输组件将数据由电信号转换为光信号，通常要求数据的信号摆幅下限为200mv，而MIPI CSI数据的信号摆幅通常小于200mv，再加上传输过程中的损耗，无法支持光纤传输组件将其由电信号转换为光信号。因此，在本实施例中，所述第二数据通信协议满足：基于所述第二数据通信协议的影像数据具备由所述光纤传输组件将影像数据由电信号转换为光信号所要求的信号振幅。Therefore, in order to reduce the power consumption of related devices, this embodiment adopts an image sensor with a MIPI CSI interface with lower power consumption. However, when the optical fiber transmission component converts the image data from an electrical signal to an optical signal, the signal swing of the image data is required. For example, optical fiber transmission components convert data from electrical signals to optical signals. Usually, the lower limit of the signal swing of data is 200mv, while the signal swing of MIPI CSI data is usually less than 200mv. In addition to the loss during transmission, it cannot support optical fibers. The transmission component converts the electrical signal into an optical signal. Therefore, in this embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has a signal amplitude required by the optical fiber transmission component to convert the image data from electrical signals to optical signals .

在一实施例中，当影像传感器为8通道MIPI接口时，影像传感器通过8通道MIPI接口输出影像数据到第一数据处理器件，第一数据处理器件对获取到的影像数据进行处理后，转换成一路影像数据并输出。对应的，光纤传输组件将该路影像数据由电信号转换成光信号，并通过一路光纤进行传输。In one embodiment, when the image sensor is an 8-channel MIPI interface, the image sensor outputs image data to the first data processing device through the 8-channel MIPI interface, and the first data processing device processes the acquired image data and converts it into All the way image data and output. Correspondingly, the optical fiber transmission component converts the channel of image data from electrical signals into optical signals, and transmits them through a channel of optical fiber.

在另一实施例中，当影像传感器为8通道MIPI接口时，影像传感器通过8通道MIPI接口输出影像数据到第一数据处理器件，第一数据处理器件对获取到的影像数据进行处理后，转换成两路影像数据并输出。对应的，光纤传输组件将该两路影像数据由电信号转换成光信号，并分别通过两路光纤进行传输。In another embodiment, when the image sensor has an 8-channel MIPI interface, the image sensor outputs the image data to the first data processing device through the 8-channel MIPI interface, and the first data processing device processes the acquired image data, and converts the acquired image data. into two channels of image data and output. Correspondingly, the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through the two channels of optical fibers.

一些实施例中，第三数据通信协议与第一数据通信协议相同。例如当影像传感器10输出的为MIPI规格的影像数据时，第二数据处理器件40转换成的影像数据也为MIPI规格的影像数据。一些实施例中，第三数据通信协议与第一数据通信协议不同，只要基于第三数据通信协议的数据能够被影像处理部识别处理好可。In some embodiments, the third data communication protocol is the same as the first data communication protocol. For example, when the image data output by the image sensor 10 is the image data of the MIPI standard, the image data converted by the second data processing device 40 is also the image data of the MIPI standard. In some embodiments, the third data communication protocol is different from the first data communication protocol, as long as the data based on the third data communication protocol can be recognized and processed by the image processing unit.

在一实施例中，经过第一数据处理器件处理的影像数据，其输出的影像数据的通道数量比其输入的影像数据的通道数量少。In one embodiment, for the image data processed by the first data processing device, the number of channels of the output image data is less than the number of channels of the input image data.

影像传感器10的一个数据输出通道可以对应影像传感器10的一个管脚，也可以对应影像传感器10的多个管脚（例如2个）。由于影像传感器生成的影像数据较大，较难通过一个数据输出通道进行输出，因此，通常会将生成的影像数据通过多个数据输出通道进行输出，以降低每个输出通道的速率；同时，降低每个输出通道的速率后，也可以较大范围地适配下一级处理单元（例如第一数据处理器件20）的数据处理能力和功耗要求。One data output channel of the image sensor 10 may correspond to one pin of the image sensor 10 , or may correspond to multiple pins (eg, two) of the image sensor 10 . Since the image data generated by the image sensor is relatively large and it is difficult to output through one data output channel, the generated image data is usually output through multiple data output channels to reduce the rate of each output channel; After the rate of each output channel, the data processing capability and power consumption requirements of the next-level processing unit (eg, the first data processing device 20 ) can also be adapted to a large extent.

一些例子中，第一数据处理器件20和第二数据处理器件40之间采用V-by-One信号传输接口标准，第二数据通信协议为基于V-by-One信号传输接口标准的协议。V-by-One是由日本赛恩电子公司（THine Electronics）开发的一种信号传输接口标准，能够用于高清数字图像信号传输，由1到8组配对信号组成；具体地，V-by-One采用8B/10B编码，与其它高速串列如PCI Express、USB 3.0能够更好地兼容；而将8Bit数据转换为10Bit数据可以有效的解决直流平衡。V-by-One既解决了配线时滞问题，还大大降低了EMI干扰，又提高了每组信号的最大传输速度（例如达3.75Gbps），并且传输线数量大幅减少，节省PCB空间。例如一款分辨率不低于3840X2160的超高清UHD显示屏，若采用LVDS协议标准，其数据线会高达48对；若采用V-by-On协议标准，其数据线仅需8对。In some examples, the V-by-One signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard. V-by-One is developed by Japan Sion Electronics Corporation (THine A signal transmission interface standard developed by Electronics), which can be used for high-definition digital image signal transmission, consisting of 1 to 8 groups of paired signals; Express, USB 3.0 can be better compatible; and converting 8Bit data to 10Bit data can effectively solve the DC balance. V-by-One not only solves the problem of wiring time lag, but also greatly reduces EMI interference, and improves the maximum transmission speed of each group of signals (for example, up to 3.75Gbps), and the number of transmission lines is greatly reduced, saving PCB space. For example, an ultra-high-definition UHD display with a resolution of not lower than 3840X2160, if the LVDS protocol standard is used, its data lines will be up to 48 pairs; if the V-by-On protocol standard is used, its data lines only need 8 pairs.

一些例子中，第一数据处理器件20和第二数据处理器件40之间采用FPD-LINK信号传输接口标准，第二数据通信协议为基于FPD-LINK信号传输接口标准的协议。进一步，第一数据处理器件20和第二数据处理器件40之间采用FPD-LINK III/IV信号传输接口标准，第二数据通信协议为基于FPD-LINK III/IV信号传输接口标准的协议。FPD-Link III是在FPD-Link II的基础上进行的迭代，FPD-Link III的主要功能是嵌入在相同的差的双向通信信道对。FPD-Link的III相比II，更进一步通过消除控制通道电缆减少了电缆成本，如I2C和CAN总线。FPD-Link III相比II，其停止使用LVDS技术和只使用CML的序列化高速信号。这使得它可以轻松地在电缆大于10m长的传输线上数据传输速率支持大于3 Gbit/s。FPD-Link III使用CML的好处是利用同轴电缆驱动能力，另外由于同轴电缆在控制阻抗和噪音上能够做得非常好，因此可以减少对差分信号，能够更好地容忍阻抗不连续和噪音的需求干扰。FPD-LINK III的特点是支持通过单个差分链路实现高速视频数据传输和双向控制通信的全双工控制，通过单个差分对整合视频数据和控制可减少互连线尺寸和重量，同时还消除了偏差问题并简化了***设计。FPD-LINK III一般被用于汽车应用的接口，能进行点对点视频传输。FPD-LINK IV相比于FPD-LINK III，提高了单通道的数据传输速率。In some examples, the FPD-LINK signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Further, the FPD-LINK III/IV signal transmission interface standard is adopted between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is based on FPD-LINK III/IV signal transmission interface standard protocol. FPD-Link III is an iteration based on FPD-Link II, FPD-Link The main function of III is to embed in the same poor bidirectional communication channel pair. Compared to the II, FPD-Link III goes a step further and reduces cable costs by eliminating control channel cables, such as I2C and CAN buses. Compared to II, FPD-Link III stops using LVDS technology and only uses CML for serializing high-speed signals. This makes it easy to support data transfer rates greater than 3 on transmission lines with cables longer than 10m Gbit/s. The advantage of using CML for FPD-Link III is to take advantage of the coaxial cable drive capability. In addition, because the coaxial cable can do a very good job in controlling impedance and noise, it can reduce differential signals and can better tolerate impedance discontinuities and noise. demand interference. FPD-LINK III features full-duplex control that supports high-speed video data transmission and bidirectional control communication over a single differential link. Consolidating video data and control over a single differential pair reduces interconnect size and weight, while also eliminating skew issues and Simplified system design. FPD-LINK III is generally used as an interface for automotive applications, enabling point-to-point video transmission. Compared with FPD-LINK III, FPD-LINK IV improves the data transfer rate of a single channel.

请参照图3，一些实施例中的影像数据传输装置包括多个影像传感器，例如第一影像传感器11和第二影像传感器12，所述影像数据传输装置还包括第一数据处理器件20、光纤传输组件30和第二数据处理器件40，下面具体说明。需要说明的是，图中显示的是影像数据传输装置包括两个影像传感器的例子，但这并不是用于仅限影像传感器的数目只能是两个，实际情况中，可以根据需求配置N个影像传感器，N可以是2，也可以是大于2的整数。Referring to FIG. 3 , the image data transmission device in some embodiments includes a plurality of image sensors, such as a first image sensor 11 and a second image sensor 12 , the image data transmission device further includes a first data processing device 20 , an optical fiber transmission device The component 30 and the second data processing device 40 will be described in detail below. It should be noted that the figure shows an example in which the image data transmission device includes two image sensors, but this is not limited to only two image sensors. In practice, N can be configured according to requirements. For the image sensor, N can be 2 or an integer greater than 2.

第一影像传感器11和第二影像传感器12都用于生成影像数据；第一影像传感器11和第二影像传感器12都包括至少两个数据输出通道例如10a和10b，第一影像传感器11和第二影像传感器12通过各自所述至少两个数据输出通道输出基于第一数据通信协议影像数据。例如第一影像传感器11通过其至少两个数据输出通道例如10a和10b输出并影像数据，第一影像传感器12通过其至少两个数据输出通道例如10a和10b输出影像数据。Both the first image sensor 11 and the second image sensor 12 are used to generate image data; both the first image sensor 11 and the second image sensor 12 include at least two data output channels such as 10a and 10b, the first image sensor 11 and the second image sensor 12 The image sensor 12 outputs image data based on the first data communication protocol through each of the at least two data output channels. For example, the first image sensor 11 outputs image data through its at least two data output channels such as 10a and 10b, and the first image sensor 12 outputs image data through its at least two data output channels such as 10a and 10b.

第一影像传感器11和第二影像传感器12可以生成按照作为移动设备用CPU的AP（Application Processor，应用处理器）所能处理的规格生成的影像数据。例如第一影像传感器11和第二影像传感器12可以生成MIPI（Mobile Industry Processor Interface，移动行业处理器接口）规格的影像数据，相应地，影像传感器的数据输出通道可以为MIPI CSI-2接口。The first image sensor 11 and the second image sensor 12 can generate image data generated according to a specification that can be processed by an AP (Application Processor), which is a CPU for a mobile device. For example, the first image sensor 11 and the second image sensor 12 may generate MIPI (Mobile Industry Processor Interface, Mobile Industry Processor Interface) specification image data, and correspondingly, the data output channel of the image sensor may be a MIPI CSI-2 interface.

第一数据处理器件20与第一影像传感器11、第二影像传感器12的数据输出通道通信连接。第一数据处理器件20包括至少第一组数据输出端20a和第二组数据输出端20b；第一数据处理器件20用于将第一影像传感器11所输出的影像数据转换成基于第二数据通信协议的第一组影像数据，并通过第一组数据输出端20a输出，以及将第二影像传感器12所输出的影像数据转换成基于第二数据通信协议的第二组影像数据，并通过第二组数据输出端20b输出。在一实施例中，第二数据通信协议与第一数据通信协议不同。The first data processing device 20 is connected in communication with the data output channels of the first image sensor 11 and the second image sensor 12 . The first data processing device 20 includes at least a first group of data output terminals 20a and a second group of data output terminals 20b; the first data processing device 20 is used for converting the image data output by the first image sensor 11 into a communication based on the second data The first set of image data of the protocol is output through the first set of data output terminal 20a, and the image data output by the second image sensor 12 is converted into the second set of image data based on the second data communication protocol, and passed through the second set of image data. The group data output terminal 20b outputs. In one embodiment, the second data communication protocol is different from the first data communication protocol.

请参照图4，光纤传输组件30包括电光转换器31、光电转换器35、以及至少第一光纤传输通道39b和第二光纤传输通道39c。电光转换器31用于将由第一数据处理器件20输出的第一组影像数据由电信号转换为光信号，并通过第一光纤传输通道39b传输给光电转换器35，光电转换器35再将所接收的第一组影像数据由光信号转换为电信号并输出；电光转换器31还用于将由第一数据处理器件20输出的第二组影像数据由电信号转换为光信号，并通过第二光纤传输通道39c传输给光电转换器35，光电转换器35再将所接收的第二组影像数据由光信号转换为电信号并输出。可以看到，第一光纤传输通道39b和第二光纤传输通道39c是两路独立的信号传输通道，下面具体说明。Referring to FIG. 4 , the optical fiber transmission assembly 30 includes an electrical-to-optical converter 31, an optical-to-electrical converter 35, and at least a first optical fiber transmission channel 39b and a second optical fiber transmission channel 39c. The electro-optical converter 31 is used to convert the first group of image data output by the first data processing device 20 from electrical signals into optical signals, and transmit them to the optical-to-electrical converter 35 through the first optical fiber transmission channel 39b, and the optical-to-electrical converter 35 then converts the data into optical signals. The received first set of image data is converted from optical signals into electrical signals and output; the electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from electrical signals into optical signals, and through the second set of image data. The optical fiber transmission channel 39c transmits it to the photoelectric converter 35, and the photoelectric converter 35 converts the received second set of image data from optical signals into electrical signals and outputs them. It can be seen that the first optical fiber transmission channel 39b and the second optical fiber transmission channel 39c are two independent signal transmission channels, which will be described in detail below.

请参照图5，一些实施例中，第一光纤传输通道39b包括第一光纤39bg，第二光纤传输通道39c包括第二光纤39cg。具体地，电光转换器32包括至少第一输入端32a、第二输入端32b、第一输出端32c和第二输出端32d；光电转换器36包括至少第一输入端36a、第二输入端36b、第一输出端36c和第二输出端36d；电光转换器32的第一输出端32c通过第一光纤39bg与光电转换器36的第一输入端36a相连；电光转换器32的第二输出端32b通过第二光纤39cg与光电转换器36的第二输入端36b相连。电光转换器32的第一输入端32a、第二输入端32b则分别与第一数据处理器件20的第一组数据输出端20a、第二组数据输出端20b相连。Referring to FIG. 5, in some embodiments, the first optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c and a second output end 32d; the photoelectric converter 36 includes at least a first input end 36a and a second input end 36b , the first output end 36c and the second output end 36d; the first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the photoelectric converter 36 through the first optical fiber 39bg; the second output end of the electro-optical converter 32 32b is connected to the second input end 36b of the photoelectric converter 36 through a second optical fiber 39cg. The first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the first data processing device 20 .

因此，电光转换器32通过其第一输入端32a接收由第一数据处理器件20输出的第一组影像数据，并将该第一组影像数据由电信号转换为光信号；电光转换器32通过其第一输出端32c将被转换为光信号的第一组影像数据输出，并通过第一光纤39bg传输；光电转换器36通过其第一输入端36a接收由第一光纤39bg传输过来的被转换为光信号的第一组影像数据，并将该第一组影像数据由光信号转换为电信号，以通过其第一输出端36c输出。类似地，电光转换器32通过其第二输入端32b接收由第一数据处理器件20输出的第二组影像数据，并将该第二组影像数据由电信号转换为光信号；电光转换器32通过其第二输出端32b将被转换为光信号的第二组影像数据输出，并通过第二光纤39cg传输；光电转换器36通过其第二输入端36b接收由第二光纤39cg传输过来的被转换为光信号的第二组影像数据，并将该第二组影像数据由光信号转换为电信号，以通过其第二输出端36d输出。Therefore, the electro-optical converter 32 receives the first set of image data output by the first data processing device 20 through its first input end 32a, and converts the first set of image data from electrical signals into optical signals; the electro-optical converter 32 passes Its first output end 32c outputs the first group of image data converted into optical signals and transmits it through the first optical fiber 39bg; the photoelectric converter 36 receives the converted image data transmitted by the first optical fiber 39bg through its first input end 36a It is the first group of image data of the optical signal, and the first group of image data is converted from the optical signal into an electrical signal to be output through the first output end 36c. Similarly, the electro-optical converter 32 receives the second set of image data output by the first data processing device 20 through its second input terminal 32b, and converts the second set of image data from electrical signals into optical signals; the electro-optical converter 32 The second set of image data converted into optical signals is output through its second output end 32b, and transmitted through the second optical fiber 39cg; Converting the second group of image data into optical signals, and converting the second group of image data from optical signals into electrical signals to be output through the second output terminal 36d.

请参照图6，一些实施例中，电光转换器31包括第一电光转换器33和第二电光转换器34；光电转换器35包括第一光电转换器37和第一光电转换器38；第一光纤传输通道39b包括第一光纤39bg，第二光纤传输通道39c包括第二光纤39cg。具体地，第一电光转换器33包括第一输入端33a和第一输出端33b；第二电光转换器34包括第二输入端34a和第二输出端34b；第一光电转换器37包括第一输入端37a和第一输出端37b；第二光电转换器38包括第二输入端38a和第二输出端38b；第一电光转换器33的第一输出端33b通过第一光纤39bg与第一光电转换器37的第一输入端37a相连；第二电光转换器34的第二输出端34a通过第二光纤39cg与第二光电转换器38的第二输入端38a相连。第一电光转换器33的第一输入端33a与第一数据处理器件20的第一组数据输出端20a相连，第二电光转换器34的第二输入端34a与第一数据处理器件20的第二组数据输出端20b相连。6, in some embodiments, the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34; The optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first photoelectric converter 37 includes a first The input end 37a and the first output end 37b; the second photoelectric converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 communicates with the first photoelectric The first input end 37a of the converter 37 is connected; the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second photoelectric converter 38 through the second optical fiber 39cg. The first input end 33a of the first electro-optical converter 33 is connected to the first group of data output ends 20a of the first data processing device 20 , and the second input end 34a of the second electro-optical converter 34 is connected to the first group of data output ends 20a of the first data processing device 20 . Two sets of data output terminals 20b are connected.

因此，第一电光转换器33通过其第一输入端33a接收由第一数据处理器件20输出的第一组影像数据，并将该第一组影像数据由电信号转换为光信号；第一电光转换器33通过其第一输出端33b将被转换为光信号的第一组影像数据输出，并通过第一光纤39bg传输；第一光电转换器37通过其第一输入端37a接收由第一光纤39bg传输过来的被转换为光信号的第一组影像数据，并将该第一组影像数据由光信号转换为电信号，以通过其第一输出端37b输出。类似地，第二电光转换器34通过其第二输入端34a接收由第一数据处理器件20输出的第二组影像数据，并将该第二组影像数据由电信号转换为光信号；第二电光转换器34通过其第二输出端34b将被转换为光信号的第二组影像数据输出，并通过第二光纤39cg传输；第二光电转换器38通过其第二输入端38a接收由第二光纤39cg传输过来的被转换为光信号的第二组影像数据，并将该第二组影像数据由光信号转换为电信号，以通过其第二输出端38b输出。Therefore, the first electro-optical converter 33 receives the first set of image data output by the first data processing device 20 through its first input end 33a, and converts the first set of image data from electrical signals into optical signals; The converter 33 outputs the first set of image data converted into optical signals through its first output end 33b, and transmits it through the first optical fiber 39bg; 39bg transmits the first group of image data converted into optical signals, and converts the first group of image data from optical signals into electrical signals for output through its first output terminal 37b. Similarly, the second electro-optical converter 34 receives the second set of image data output by the first data processing device 20 through its second input terminal 34a, and converts the second set of image data from electrical signals into optical signals; The electro-optical converter 34 outputs the second group of image data converted into optical signals through its second output end 34b, and transmits it through the second optical fiber 39cg; The optical fiber 39cg transmits the second set of image data converted into optical signals, and converts the second set of image data from optical signals into electrical signals for output through its second output end 38b.

以上是光纤传输组件30的一些说明。The above are some descriptions of the fiber optic transmission assembly 30 .

第二数据处理器件40包括至少第一组数据输入端40a和第二组数据输入端40b；第二数据处理器件40用于通过其第一组数据输入端40a接收由光电转换器20输出的第一组影像数据，并将该第一组影像数据转换成基于第三数据通信协议的影像数据以输出；以及，第二数据处理器件40还用于通过其第二组数据输入端40b接收由所述光电转换器输出的第二组影像数据，并将该第二组影像数据转换成基于第三数据通信协议的影像数据以输出。The second data processing device 40 includes at least a first group of data input terminals 40a and a second group of data input terminals 40b; the second data processing device 40 is configured to receive the first data input terminal 40a output by the photoelectric converter 20 through its first group of data input terminals 40a a set of image data, and convert the first set of image data into image data based on the third data communication protocol for output; and, the second data processing device 40 is further configured to receive through its second set of data input terminals 40b The second group of image data output by the photoelectric converter is converted into image data based on the third data communication protocol for output.

可以看到，第一数据处理器件20、光纤传输组件30和第二数据处理器件40配合，将影像传感器例如第一影像传感器11和第二影像传感器12生成的影像数据进行传输，例如传输给影像处理部等，影像处理部可以是FPGA或其他的CPU处理平台。光纤传输组件30主要是进行电光转换，再通过光纤传输信号，之后再进行光电转换；第一数据处理器件20和第二数据处理器件40则配合，形成对片方案。第一数据处理器件20和第二数据处理器件 40在产品设计时，包括采用对片方案的两个芯片，这两个芯片通常为外购，两者之间采用专有的数据通信协议进行数据传输，即第二数据通信协议可以为专有数据通信协议，该专有数据通信协议为芯片供应商提供。It can be seen that the first data processing device 20, the optical fiber transmission assembly 30 and the second data processing device 40 cooperate to transmit the image data generated by the image sensor such as the first image sensor 11 and the second image sensor 12, for example, to the image The processing unit, etc., the image processing unit can be an FPGA or other CPU processing platform. The optical fiber transmission assembly 30 mainly performs electro-optical conversion, transmits signals through optical fibers, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution. During product design, the first data processing device 20 and the second data processing device 40 include two chips using a chip-to-chip solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used between the two for data communication. The transmission, ie the second data communication protocol, may be a proprietary data communication protocol provided by the chip supplier.

一些例子中，第一数据处理器件20和第二数据处理器件40之间采用V-by-One信号传输接口标准，第二数据通信协议为基于V-by-One信号传输接口标准的协议。In some examples, the V-by-One signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard.

一些例子中，第一数据处理器件20和第二数据处理器件40之间采用FPD-LINK信号传输接口标准，第二数据通信协议为基于FPD-LINK信号传输接口标准的协议。进一步，第一数据处理器件20和第二数据处理器件40之间采用FPD-LINK III/IV信号传输接口标准，第二数据通信协议为基于FPD-LINK III/IV信号传输接口标准的协议。In some examples, the FPD-LINK signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Further, the FPD-LINK III/IV signal transmission interface standard is adopted between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is based on FPD-LINK III/IV signal transmission interface standard protocol.

以上是本发明影像数据传输装置的一些说明，本发明中的影像数据传输装置可以应用于诸如内窥镜摄像***等场合和产品中，下面不妨以应用于内窥摄像场合为例进行说明。The above are some descriptions of the image data transmission device of the present invention. The image data transmission device of the present invention can be applied to occasions and products such as an endoscopic camera system. The following may be used as an example for an endoscopic camera application.

请参照图7、图8和图9，一些实施例中的内窥镜摄像***包括光源部100、光源控制部200、内窥镜300、摄像部320、内窥镜数据传输装置400、影像处理部500和显示器600，下面具体说明。Referring to FIGS. 7 , 8 and 9 , an endoscopic camera system in some embodiments includes a light source unit 100 , a light source control unit 200 , an endoscope 300 , a camera unit 320 , an endoscope data transmission device 400 , and an image processing unit. The unit 500 and the display 600 will be described in detail below.

光源部100用于向待观察部位提供照明光源。光源部100可以提供普通光成像所需的光，还可以提供特殊光成像所需的光。例如，光源部100向待观察部位提供的照明光源，可以是基于宽波段光线进行的普通光照明以及基于窄波段光线进行的特殊光照明，内窥镜***在普通光照模式下生成彩色图像，在特殊光照模式下先生成具有血管增强效应的单色图像，再根据该单色图像的灰度值生成彩色图像——可以理解地，这种由单色图像例如灰度图像生成的彩色图像为伪彩图像，也即此时特殊光图像为伪彩图像。The light source part 100 is used to provide an illumination light source to the part to be observed. The light source part 100 can provide the light required for ordinary light imaging, and can also provide light required for special light imaging. For example, the illumination light source provided by the light source unit 100 to the part to be observed may be general light illumination based on broad-band light and special light illumination based on narrow-band light. In the special lighting mode, a monochrome image with blood vessel enhancement effect is generated first, and then a color image is generated according to the grayscale value of the monochrome image - understandably, this color image generated from a monochrome image such as a grayscale image is false The color image, that is, the special light image is a pseudo-color image at this time.

一些实施例中，光源部100可以包括第一光源110和第二光源120。普通光照模式下，第一光源110可分时提供不同波长范围的多个单色光，例如，第一光源110可以是半导体光源或LED光源，提供的单色光可以是蓝光、绿光、红光等。在其他实施例中，第一光源110还可以提供所述多个单色光的组合光，或者是宽光谱的白光光源。所述单色光的波长范围大致为400nm至700nm。特殊光照模式下，第二光源120提供窄带光。例如，第二光源120可为发出窄带蓝激光的激光器，峰值波长取390nm-460nm范围内至少任意1个值的蓝色光。在其他实施例中，第二光源120也可以是LED光源或激光LED，发出的窄带光可以是窄带绿激光等。In some embodiments, the light source part 100 may include a first light source 110 and a second light source 120 . In the normal lighting mode, the first light source 110 can provide multiple monochromatic lights with different wavelength ranges in time division. For example, the first light source 110 can be a semiconductor light source or an LED light source, and the provided monochromatic light can be blue light, green light, red light Light etc. In other embodiments, the first light source 110 may also provide the combined light of the plurality of monochromatic lights, or be a white light source with a broad spectrum. The wavelength range of the monochromatic light is approximately 400 nm to 700 nm. In the special lighting mode, the second light source 120 provides narrow-band light. For example, the second light source 120 may be a laser that emits a narrow-band blue laser, and the peak wavelength takes at least any one value of blue light in the range of 390nm-460nm. In other embodiments, the second light source 120 may also be an LED light source or a laser LED, and the narrow-band light emitted may be a narrow-band green laser or the like.

一些实施例中，光源部100可进一步包括二向色镜130，在光源控制部200的控制下，第一光源110和第二光源120分时工作；即，第一光源110开启时，第二光源120关闭。反之亦然。该二向色镜130设置在多个单色光和窄带光的传输光路上，且多个单色光的光路和窄带光的光路经二向色镜130后合成为同一光路。例如，多个单色光可透射二向色镜130，窄带光可被二向色镜130反射，从而两者的光路合成为同一光路；反之亦然。在二向色镜130后的光路上，窄带光和多个单色光则分时沿合成的同一光路，向内窥镜300的方向传输。In some embodiments, the light source part 100 may further include a dichroic mirror 130. Under the control of the light source control part 200, the first light source 110 and the second light source 120 work in a time-sharing manner; that is, when the first light source 110 is turned on, the second light source The light source 120 is turned off. vice versa. The dichroic mirror 130 is disposed on the transmission light paths of a plurality of monochromatic lights and narrow-band lights, and the light paths of the plurality of monochromatic lights and narrow-band lights are combined into the same light path after passing through the dichroic mirror 130 . For example, a plurality of monochromatic lights can be transmitted through the dichroic mirror 130, and the narrow-band light can be reflected by the dichroic mirror 130, so that the optical paths of the two can be combined into the same optical path; and vice versa. On the optical path behind the dichroic mirror 130 , the narrow-band light and a plurality of monochromatic lights are transmitted in the direction of the endoscope 300 along the same combined optical path in time division.

在一些实施例中，光源部100还包括设置在二向色镜130和内窥镜300的光源导入口的耦合镜140。该耦合镜140可使自二向色镜130传输来的光线聚焦，从而更好地导入到内窥镜300内，尽可能降低光线损失，提高***的整体照明质量。二向色镜130的光路合成作用和耦合镜140的聚焦作用，均能将光线更好地导入到内窥镜300内。同时，二向色镜130的使用可使光源部100整体结构更紧凑、光线传播路径更短。In some embodiments, the light source part 100 further includes a coupling mirror 140 disposed at the light source introduction port of the dichroic mirror 130 and the endoscope 300 . The coupling mirror 140 can focus the light transmitted from the dichroic mirror 130, so as to better guide the light into the endoscope 300, reduce light loss as much as possible, and improve the overall lighting quality of the system. Both the light path synthesis function of the dichroic mirror 130 and the focusing function of the coupling mirror 140 can better guide the light into the endoscope 300 . At the same time, the use of the dichroic mirror 130 can make the overall structure of the light source part 100 more compact and the light propagation path shorter.

以上是对光源部100的一些说明。光源控制部200用于控制光源部100，例如控制光源部100提供普通光成像所需的光，和控制光源部100提供特殊光成像所需的光。The above is some description of the light source unit 100 . The light source control part 200 is used to control the light source part 100 , for example, to control the light source part 100 to provide the light required for ordinary light imaging, and to control the light source part 100 to provide the light required for special light imaging.

内窥镜300用于传输光信号。一些实施例中，内窥镜300可以包括***部310。一些实施例中，***部310能够***到生物体内部，例如***部310为一部分的镜体主体，可由操作者***到生物体内部。***部310能够将光源部100产生的光线传输到待观察部位的导入部（可为导光光纤）。The endoscope 300 is used to transmit optical signals. In some embodiments, endoscope 300 may include insertion portion 310 . In some embodiments, the insertion part 310 can be inserted into the living body, for example, the scope body of which the insertion part 310 is a part can be inserted into the living body by the operator. The insertion part 310 can transmit the light generated by the light source part 100 to the introduction part (which can be a light guide fiber) of the part to be observed.

摄像部320包括至少一个用于生成影像数据的传感器。例如一些例子中，摄像部320可以包括影像传感器10。再例如一些例子中，摄像部320可以包括第一影像传感器11和第二影像传感器12。再例如一些例子中，摄像部320可以包括N个用于生成影像数据的传感器，N可以是大于2的整数。The imaging unit 320 includes at least one sensor for generating image data. For example, in some cases, the imaging unit 320 may include the image sensor 10 . In another example, the camera unit 320 may include the first image sensor 11 and the second image sensor 12 . In another example, the imaging unit 320 may include N sensors for generating image data, and N may be an integer greater than 2.

请参照图10，为摄像部320包括影像传感器10的例子。一些例子中，影像传感器10用于生成基于第一数据通信协议的影像数据。具体地，影像传感器10可以包括至少两个数据输出通道例如10a和10b，所述影像传感器通过其所述至少两个数据输出通道例如10a和10b输出影像数据。一些例子中，影像传感器10可以生成按照作为移动设备用CPU的AP（Application Processor，应用处理器）所能处理的规格的影像数据。例如影像传感器10可以生成MIPI规格的影像数据，相应地，影像传感器的数据输出通道可以为MIPI CSI-2接口。Please refer to FIG. 10 , which is an example in which the imaging unit 320 includes the image sensor 10 . In some examples, the image sensor 10 is used to generate image data based on the first data communication protocol. Specifically, the image sensor 10 may include at least two data output channels such as 10a and 10b, and the image sensor outputs image data through the at least two data output channels such as 10a and 10b. In some examples, the image sensor 10 can generate image data according to a specification that can be processed by an AP (Application Processor), which is a CPU for a mobile device. For example, the image sensor 10 can generate image data of MIPI standard, and correspondingly, the data output channel of the image sensor can be MIPI CSI-2 interface.

请参照图11，为摄像部320包括第一影像传感器11和第二影像传感器12的例子。一些例子中，第一影像传感器11和第二影像传感器12都用于生成影像数据，第一影像传感器11和第二影像传感器12都包括至少两个数据输出通道例如10a和10b，第一影像传感器11和第二影像传感器12通过各自所述至少两个数据输出通道输出基于第一数据通信协议的影像数据。例如第一影像传感器11通过其至少两个数据输出通道例如10a和10b输出影像数据，第一影像传感器12通过其至少两个数据输出通道例如10a和10b输出影像数据。一些例子中，第一影像传感器11和第二影像传感器12可以生成按照作为移动设备用CPU的AP（Application Processor，应用处理器）所能处理的规格的影像数据。例如第一影像传感器11和第二影像传感器12可以生成MIPI规格的影像数据，相应地，影像传感器的数据输出通道可以为MIPI CSI-2接口。Please refer to FIG. 11 , which is an example in which the imaging unit 320 includes the first image sensor 11 and the second image sensor 12 . In some examples, both the first image sensor 11 and the second image sensor 12 are used to generate image data, and both the first image sensor 11 and the second image sensor 12 include at least two data output channels such as 10a and 10b. 11 and the second image sensor 12 output image data based on the first data communication protocol through the at least two data output channels respectively. For example, the first image sensor 11 outputs image data through its at least two data output channels such as 10a and 10b, and the first image sensor 12 outputs image data through its at least two data output channels such as 10a and 10b. In some examples, the first image sensor 11 and the second image sensor 12 may generate an AP (Application Processor, application processor) can process the image data of the specifications. For example, the first image sensor 11 and the second image sensor 12 can generate image data of MIPI standard, and correspondingly, the data output channel of the image sensor can be the MIPI CSI-2 interface.

一些例子中，摄像部320一端与内窥镜数据传输装置400连接，从而为影像处理部500提供影像数据，摄像部320一端可以卡接到内窥镜，而光源部100为内窥镜300提供光源，摄像部320则可以获取内窥镜的光学信号。下面对内窥镜数据传输装置400进行说明。In some examples, one end of the camera unit 320 is connected to the endoscope data transmission device 400 to provide image data for the image processing unit 500 , one end of the camera unit 320 can be clipped to the endoscope, and the light source unit 100 provides the endoscope 300 with image data. the light source, and the imaging unit 320 can acquire the optical signal of the endoscope. Next, the endoscope data transmission device 400 will be described.

内窥镜数据传输装置400用于将由摄像部320所产生的影像数据传输给后面的影像处理部500进行处理。内窥镜数据传输装置400的实现方式有多种，下面具体说明。The endoscope data transmission device 400 is used to transmit the image data generated by the imaging unit 320 to the following image processing unit 500 for processing. There are various implementations of the endoscope data transmission apparatus 400, which will be described in detail below.

不妨以摄像部320包括影像传感器10的例子，说明这种实施例中内窥镜数据传输装置400的结构和功能。请参照图12，这种情况下，内窥镜数据传输装置400可以包括第一数据处理器件20、光纤传输组件30和第二数据处理器件40。The structure and function of the endoscope data transmission device 400 in this embodiment may be described by taking an example in which the imaging unit 320 includes the image sensor 10 . Referring to FIG. 12 , in this case, the endoscope data transmission device 400 may include a first data processing device 20 , an optical fiber transmission assembly 30 and a second data processing device 40 .

光纤传输组件30用于将由第一数据处理器件20输出的影像数据由电信号转换为光信号进行传输后，再将该影像数据由光信号转换为电信号并输出。The optical fiber transmission assembly 30 is used for converting the image data output by the first data processing device 20 from electrical signals into optical signals for transmission, and then converting the image data from optical signals into electrical signals and outputting the image data.

请参照图13，一些实施例中，光纤传输组件30可以包括电光转换器32、光纤传输通道39a和光电转换器36。电光转换器32接收由第一数据处理器件20输出的影像数据，并将该影像数据由电信号转换为光信号，以输出给光纤传输通道39a；光纤传输通道39a用于传输被转换为光信号的影像数据，一些例子中，光纤传输通道39a包括光纤；光电转换器36接收由光纤传输通道39a传输过来的被转换为光信号的影像数据，并将该影像数据由光信号转换为电信号后输出。Referring to FIG. 13 , in some embodiments, the optical fiber transmission assembly 30 may include an electrical-to-optical converter 32 , a fiber-optic transmission channel 39 a and an optical-to-electrical converter 36 . The electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from electrical signals into optical signals for output to the optical fiber transmission channel 39a; the optical fiber transmission channel 39a is used to transmit the converted optical signals In some examples, the optical fiber transmission channel 39a includes an optical fiber; the photoelectric converter 36 receives the image data transmitted by the optical fiber transmission channel 39a and is converted into an optical signal, and converts the image data from the optical signal into an electrical signal. output.

可以看到，第一数据处理器件20、光纤传输组件30和第二数据处理器件40配合，将影像传感器10生成的影像数据进行传输，例如传输给影像处理部等，影像处理部可以是FPGA或其他的CPU处理平台。光纤传输组件30主要是进行电光转换，再通过光纤传输信号，之后再进行光电转换；第一数据处理器件20和第二数据处理器件40则配合，形成对片方案。第一数据处理器件20和第二数据处理器件 40在产品设计时，包括采用对片方案的两个芯片，这两个芯片通常为外购，两者之间采用专有的数据通信协议进行数据传输，即第二数据通信协议可以为专有数据通信协议，该专有数据通信协议为芯片供应商提供。It can be seen that the first data processing device 20, the optical fiber transmission assembly 30 and the second data processing device 40 cooperate to transmit the image data generated by the image sensor 10, for example, to the image processing unit, which can be an FPGA or Other CPU processing platforms. The optical fiber transmission assembly 30 mainly performs electro-optical conversion, transmits signals through optical fibers, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution. During product design, the first data processing device 20 and the second data processing device 40 include two chips using a chip-to-chip solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used between the two for data communication. The transmission, ie the second data communication protocol, may be a proprietary data communication protocol provided by the chip supplier.

不妨再以摄像部320包括第一影像传感器11和第二影像传感器12的例子，说明这种实施例中内窥镜数据传输装置400的结构和功能。请参照图14，这种情况下，内窥镜数据传输装置400可以包括第一数据处理器件20、光纤传输组件30和第二数据处理器件40。The structure and function of the endoscope data transmission device 400 in this embodiment may be described again by taking the example that the imaging unit 320 includes the first image sensor 11 and the second image sensor 12 . Referring to FIG. 14 , in this case, the endoscope data transmission device 400 may include a first data processing device 20 , an optical fiber transmission assembly 30 and a second data processing device 40 .

第一数据处理器件20与第一影像传感器11、第二影像传感器12的数据输出通道都通信连接。第一数据处理器件20包括至少第一组数据输出端20a和第二组数据输出端20b；第一数据处理器件20用于将第一影像传感器11所输出的影像数据转换成基于第二数据通信协议的第一组影像数据，并通过第一组数据输出端20a输出，以及将第二影像传感器12所输出的影像数据转换成基于第二数据通信协议的第二组影像数据，并通过第二组数据输出端20b输出。The first data processing device 20 is connected in communication with the data output channels of the first image sensor 11 and the second image sensor 12 . The first data processing device 20 includes at least a first group of data output terminals 20a and a second group of data output terminals 20b; the first data processing device 20 is used for converting the image data output by the first image sensor 11 into a communication based on the second data The first set of image data of the protocol is output through the first set of data output terminal 20a, and the image data output by the second image sensor 12 is converted into the second set of image data based on the second data communication protocol, and passed through the second set of image data. The group data output terminal 20b outputs.

需要说明的是，第一组数据输出端20a和第二组数据输出端20b具体可以是一个输出端，也可以是多个输出端。对应的，第一组影像数据和第二组影像数据具体可以是一路影像数据，也可以是多路影像数据。It should be noted that, the first group of data output ends 20a and the second group of data output ends 20b may specifically be one output end, or may be multiple output ends. Correspondingly, the first group of image data and the second group of image data may specifically be one channel of image data, or may be multiple channels of image data.

请参照图15，光纤传输组件30包括电光转换器31、光电转换器35、以及至少第一光纤传输通道39b和第二光纤传输通道39c。电光转换器31用于将由第一数据处理器件20输出的第一组影像数据由电信号转换为光信号，并通过第一光纤传输通道39b传输给光电转换器35，光电转换器35再将所接收的第一组影像数据由光信号转换为电信号并输出；电光转换器31还用于将由第一数据处理器件20输出的第二组影像数据由电信号转换为光信号，并通过第二光纤传输通道39c传输给光电转换器35，光电转换器35再将所接收的第二组影像数据由光信号转换为电信号并输出。可以看到，第一光纤传输通道39b和第二光纤传输通道39c是两路独立的信号传输通道，下面具体说明。Referring to FIG. 15, the optical fiber transmission assembly 30 includes an electrical-to-optical converter 31, an optical-to-electrical converter 35, and at least a first optical fiber transmission channel 39b and a second optical fiber transmission channel 39c. The electro-optical converter 31 is used to convert the first group of image data output by the first data processing device 20 from electrical signals into optical signals, and transmit them to the optical-to-electrical converter 35 through the first optical fiber transmission channel 39b, and the optical-to-electrical converter 35 then converts the data into optical signals. The received first set of image data is converted from optical signals into electrical signals and output; the electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from electrical signals into optical signals, and through the second set of image data. The optical fiber transmission channel 39c transmits it to the photoelectric converter 35, and the photoelectric converter 35 converts the received second set of image data from optical signals into electrical signals and outputs them. It can be seen that the first optical fiber transmission channel 39b and the second optical fiber transmission channel 39c are two independent signal transmission channels, which will be described in detail below.

在一实施例中，当第一影像传感器和第二影像传感器为8通道MIPI接口时，第一影像传感器和第二影像传感器通过8通道MIPI接口输出影像数据到第一数据处理器件。第一数据处理器件对获取到的第一影像传感器的影像数据进行处理后，转换成一路影像数据（第一组影像数据）并输出。对应的，光纤传输组件将该路影像数据由电信号转换成光信号，并通过一路光纤进行传输。第一数据处理器件对获取到的第二影像传感器的影像数据进行处理后，转换成一路影像数据（第二组影像数据）并输出。对应的，光纤传输组件将该路影像数据由电信号转换成光信号，并通过一路光纤进行传输。In one embodiment, when the first image sensor and the second image sensor have an 8-channel MIPI interface, the first image sensor and the second image sensor output image data to the first data processing device through the 8-channel MIPI interface. After processing the acquired image data of the first image sensor, the first data processing device converts it into one channel of image data (a first group of image data) and outputs it. Correspondingly, the optical fiber transmission component converts the channel of image data from electrical signals into optical signals, and transmits them through a channel of optical fiber. After the first data processing device processes the acquired image data of the second image sensor, it is converted into one channel of image data (a second group of image data) and output. Correspondingly, the optical fiber transmission component converts the channel of image data from electrical signals into optical signals, and transmits them through a channel of optical fiber.

在另一实施例中，当第一影像传感器和第二影像传感器为8通道MIPI接口时，影像传感器通过8通道MIPI接口输出影像数据到第一数据处理器件。第一数据处理器件对获取到的第一影像传感器的影像数据进行处理后，转换成两路影像数据（第一组影像数据）并输出。对应的，光纤传输组件将该两路影像数据由电信号转换成光信号，并分别通过两路光纤进行传输。第一数据处理器件对获取到第二影像传感器的影像数据进行处理后，转换成两路影像数据（第二组影像数据）并输出。对应的，光纤传输组件将该两路影像数据由电信号转换成光信号，并分别通过两路光纤进行传输。In another embodiment, when the first image sensor and the second image sensor are 8-channel MIPI interfaces, the image sensor outputs image data to the first data processing device through the 8-channel MIPI interface. After the first data processing device processes the acquired image data of the first image sensor, it is converted into two channels of image data (a first group of image data) and output. Correspondingly, the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through the two channels of optical fibers. After the first data processing device processes the image data obtained from the second image sensor, it is converted into two channels of image data (a second group of image data) and output. Correspondingly, the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through the two channels of optical fibers.

通常的，当影像传感器为多个时，第一数据处理器件分别将每个影像传感器的影像数据转换成一组对应的影像数据。Generally, when there are multiple image sensors, the first data processing device respectively converts the image data of each image sensor into a set of corresponding image data.

请参照图16，一些实施例中，电光转换器31包括电光转换器32，光电转换器35包括光电转换器36；第一光纤传输通道39b包括第一光纤39bg，第二光纤传输通道39c包括第二光纤39cg。具体地，电光转换器32包括至少第一输入端32a、第二输入端32b、第一输出端32c和第二输出端32d；光电转换器36包括至少第一输入端36a、第二输入端36b、第一输出端36c和第二输出端36d；电光转换器32的第一输出端32c通过第一光纤39bg与光电转换器36的第一输入端36a相连；电光转换器32的第二输出端32b通过第二光纤39cg与光电转换器36的第二输入端36b相连。电光转换器32的第一输入端32a、第二输入端32b则分别与第一数据处理器件20的第一组数据输出端20a、第二组数据输出端20b相连。Referring to FIG. 16, in some embodiments, the electro-optical converter 31 includes an electro-optical converter 32; Two fibers 39cg. Specifically, the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c and a second output end 32d; the photoelectric converter 36 includes at least a first input end 36a and a second input end 36b , the first output end 36c and the second output end 36d; the first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the photoelectric converter 36 through the first optical fiber 39bg; the second output end of the electro-optical converter 32 32b is connected to the second input end 36b of the photoelectric converter 36 through a second optical fiber 39cg. The first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the first data processing device 20 .

请参照图17，一些实施例中，电光转换器31包括第一电光转换器33和第二电光转换器34；光电转换器35包括第一光电转换器37和第一光电转换器38；第一光纤传输通道39b包括第一光纤39bg，第二光纤传输通道39c包括第二光纤39cg。具体地，第一电光转换器33包括第一输入端33a和第一输出端33b；第二电光转换器34包括第二输入端34a和第二输出端34b；第一光电转换器37包括第一输入端37a和第一输出端37b；第二光电转换器38包括第二输入端38a和第二输出端38b；第一电光转换器33的第一输出端33b通过第一光纤39bg与第一光电转换器37的第一输入端37a相连；第二电光转换器34的第二输出端34a通过第二光纤39cg与第二光电转换器38的第二输入端38a相连。第一电光转换器33的第一输入端33a与第一数据处理器件20的第一组数据输出端20a相连，第二电光转换器34的第二输入端34a与第一数据处理器件20的第二组数据输出端20b相连。Referring to FIG. 17, in some embodiments, the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34; The optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg. Specifically, the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first photoelectric converter 37 includes a first The input end 37a and the first output end 37b; the second photoelectric converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 communicates with the first photoelectric The first input end 37a of the converter 37 is connected; the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second photoelectric converter 38 through the second optical fiber 39cg. The first input end 33a of the first electro-optical converter 33 is connected to the first group of data output ends 20a of the first data processing device 20 , and the second input end 34a of the second electro-optical converter 34 is connected to the first group of data output ends 20a of the first data processing device 20 . Two sets of data output terminals 20b are connected.

在一实施例中，第一组数据输入端40a的数量与第一组数据输出端20a的数量相同，第二组数据输入端40b与第二组数据输出端20b的数量相同。In one embodiment, the number of the first group of data input terminals 40a is the same as the number of the first group of data output terminals 20a, and the number of the second group of data input terminals 40b and the second group of data output terminals 20b is the same.

以上是内窥镜数据传输装置400的一些说明。在其他实施例中，摄像部320还可以包括3个以上的影像传感器，其影像数据的传输原理可参见2个影像传感器（第一影像传感器11和第二影像传感器12）。The above are some descriptions of the endoscopic data transmission device 400 . In other embodiments, the camera unit 320 may further include more than three image sensors, and the transmission principle of the image data may refer to the two image sensors (the first image sensor 11 and the second image sensor 12 ).

影像处理部500可以作为内窥镜摄像***的图像处理主机，影像处理部500用于接收并处理由所述内窥镜数据传输装置400所输出的影像数据，以生成用于显示影像的数据。一些实施例中，影像处理部500包括FPGA或CPU。The image processing unit 500 can serve as an image processing host of the endoscope imaging system, and the image processing unit 500 is configured to receive and process the image data output by the endoscope data transmission device 400 to generate data for displaying images. In some embodiments, the image processing unit 500 includes an FPGA or a CPU.

显示器600则用于对所述用于显示影像的数据进行显示。The display 600 is used for displaying the data for displaying the image.

以上就是本发明一些实施例中内窥镜摄像***的说明。本领域技术人员应当理解的是，图7至图17仅是内窥镜摄像***的示例，并不构成内窥镜摄像***的限定，内窥镜摄像***可以包括比图7至图17所示更多或更少的部件，或者组合某些部件，或者不同的部件，例如内窥镜摄像***还可以包括扩张器、烟雾控制装置、输入输出设备、网络接入设备等。另外，图7-17与图1-6相同标号的部件，可以是相同的，具体介绍可参见图1-6对应实施例中的描述。The above is the description of the endoscopic camera system in some embodiments of the present invention. It should be understood by those skilled in the art that FIGS. 7 to 17 are only examples of the endoscopic imaging system, and do not constitute a limitation of the endoscopic imaging system. The endoscopic imaging system may include more than those shown in FIGS. More or fewer components, or a combination of certain components, or different components, eg, an endoscopic camera system may also include dilators, smoke control devices, input and output devices, network access devices, and the like. In addition, the components with the same numbers in FIGS. 7-17 and 1-6 may be the same, and for details, please refer to the descriptions in the corresponding embodiments of FIGS. 1-6 .

本文参照了各种示范实施例进行说明。然而，本领域的技术人员将认识到，在不脱离本文范围的情况下，可以对示范性实施例做出改变和修正。例如，各种操作步骤以及用于执行操作步骤的组件，可以根据特定的应用或考虑与***的操作相关联的任何数量的成本函数以不同的方式实现（例如一个或多个步骤可以被删除、修改或结合到其他步骤中）。Descriptions are made herein with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, the various operational steps, and the components used to perform the operational steps, may be implemented in different ways depending on the particular application or considering any number of cost functions associated with the operation of the system (eg one or more steps may be deleted, modified or incorporated into other steps).

虽然在各种实施例中已经示出了本文的原理，但是许多特别适用于特定环境和操作要求的结构、布置、比例、元件、材料和部件的修改可以在不脱离本披露的原则和范围内使用。以上修改和其他改变或修正将被包含在本文的范围之内。Although the principles herein have been shown in various embodiments, many modifications may be made in structure, arrangement, proportions, elements, materials and components as are particularly suited to particular environmental and operating requirements without departing from the principles and scope of the present disclosure use. The above modifications and other changes or corrections are intended to be included within the scope of this document.

前述具体说明已参照各种实施例进行了描述。然而，本领域技术人员将认识到，可以在不脱离本披露的范围的情况下进行各种修正和改变。因此，对于本披露的考虑将是说明性的而非限制性的意义上的，并且所有这些修改都将被包含在其范围内。同样，有关于各种实施例的优点、其他优点和问题的解决方案已如上所述。然而，益处、优点、问题的解决方案以及任何能产生这些的要素，或使其变得更明确的解决方案都不应被解释为关键的、必需的或必要的。本文中所用的术语“包括”和其任何其他变体，皆属于非排他性包含，这样包括要素列表的过程、方法、文章或设备不仅包括这些要素，还包括未明确列出的或不属于该过程、方法、***、文章或设备的其他要素。此外，本文中所使用的术语“耦合”和其任何其他变体都是指物理连接、电连接、磁连接、光连接、通信连接、功能连接和/或任何其他连接。The foregoing Detailed Description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of the present disclosure. Accordingly, this disclosure is to be considered in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within its scope. Likewise, the advantages, other advantages, and solutions to problems of the various embodiments have been described above. However, the benefits, advantages, solutions to the problems, and any elements that give rise to them, or make them more explicit, should not be construed as critical, necessary, or essential. As used herein, the term "comprising" and any other variations thereof are non-exclusive inclusion, such that a process, method, article or device including a list of elements includes not only those elements, but also not expressly listed or included in the process , method, system, article or other elements of a device. Furthermore, as used herein, the term "coupled" and any other variations thereof refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections, and/or any other connection.

具有本领域技术的人将认识到，在不脱离本发明的基本原理的情况下，可以对上述实施例的细节进行许多改变。因此，本发明的范围应仅由权利要求确定。Those skilled in the art will recognize that many changes may be made to the details of the above-described embodiments without departing from the underlying principles of the invention. Accordingly, the scope of the invention should be determined only by the claims.

Claims

一种用于内窥镜摄像***的影像数据传输装置，所述影像数据传输装置用于与所述内窥镜摄像***中的影像处理部连接，以向所述影像处理部传输影像数据；其特征在于，包括：An image data transmission device for an endoscope camera system, the image data transmission device is used for connecting with an image processing unit in the endoscope camera system to transmit image data to the image processing unit; Features include:

至少第一影像传感器和第二影像传感器，所述第一影像传感器和第二影像传感器都用于生成影像数据，所述第一影像传感器和第二影像传感器通过各自的数据输出通道输出基于第一数据通信协议的影像数据；at least a first image sensor and a second image sensor, the first image sensor and the second image sensor are both used for generating image data, the first image sensor and the second image sensor output data based on the first image sensor through respective data output channels Image data of data communication protocol;

第一数据处理器件，所述第一数据处理器件与所述第一影像传感器、第二影像传感器的数据输出通道都通信连接；所述第一数据处理器件包括至少第一组数据输出端和第二组数据输出端；所述第一数据处理器件用于将所述第一影像传感器所输出的影像数据转换成基于第二数据通信协议的第一组影像数据，并通过所述第一组数据输出端输出，以及将所述第二影像传感器所输出的影像数据转换成基于第二数据通信协议的第二组影像数据，并通过所述第二组数据输出端输出；所述第二数据通信协议与所述第一数据通信协议不同；A first data processing device, the first data processing device is communicatively connected with the data output channels of the first image sensor and the second image sensor; the first data processing device includes at least a first group of data output ends and a second Two sets of data output terminals; the first data processing device is used to convert the image data output by the first image sensor into a first set of image data based on a second data communication protocol, and pass the first set of data The output terminal outputs, and converts the image data output by the second image sensor into a second group of image data based on a second data communication protocol, and outputs through the second group of data output terminals; the second data communication the protocol is different from the first data communication protocol;

光纤传输组件，包括电光转换器，光电转换器，以及至少第一光纤传输通道和第二光纤传输通道；所述电光转换器用于将由所述第一数据处理器件输出的第一组影像数据由电信号转换为光信号，并通过所述第一光纤传输通道传输给所述光电转换器，所述光电转换器再将所接收的第一组影像数据由光信号转换为电信号并输出；所述电光转换器还用于将由所述第一数据处理器件输出的第二组影像数据由电信号转换为光信号，并通过所述第二光纤传输通道传输给所述光电转换器，所述光电转换器再将所接收的第二组影像数据由光信号转换为电信号并输出；The optical fiber transmission assembly includes an electrical-to-optical converter, an optical-to-electrical converter, and at least a first optical fiber transmission channel and a second optical fiber transmission channel; The signal is converted into an optical signal, and transmitted to the photoelectric converter through the first optical fiber transmission channel, and the photoelectric converter converts the received first group of image data from optical signals into electrical signals and outputs them; The electro-optical converter is also used to convert the second group of image data output by the first data processing device from electrical signals into optical signals, and transmit them to the photoelectric converter through the second optical fiber transmission channel, and the photoelectric conversion The device then converts the received second group of image data from optical signals into electrical signals and outputs them;

第二数据处理器件，包括至少第一组数据输入端和第二组数据输入端；所述第二数据处理器件用于通过所述第一组数据输入端接收由所述光电转换器输出的第一组影像数据，并将该第一组影像数据转换成基于第三数据通信协议的影像数据以输出；以及，所述第二数据处理器件还用于通过所述第二组数据输入端接收由所述光电转换器输出的第二组影像数据，并将该第二组影像数据转换成基于第三数据通信协议的影像数据以输出。A second data processing device includes at least a first group of data input terminals and a second group of data input terminals; the second data processing device is configured to receive the first data output from the photoelectric converter through the first group of data input terminals a set of image data, and convert the first set of image data into image data based on a third data communication protocol for output; and the second data processing device is further configured to receive through the second set of data input terminals The photoelectric converter outputs the second group of image data, and converts the second group of image data into image data based on a third data communication protocol for output.
如权利要求1所述的影像数据传输装置，其特征在于，The image data transmission device of claim 1, wherein:

所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用V-by-One信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用V-by-One信号传输接口标准，所述第二数据通信协议为基于V-by-One信号传输接口标准的协议；The first group of data output terminals and the second group of data output terminals of the first data processing device adopt the V-by-One signal transmission interface standard, and the first group of data input terminals and the second group of data input terminals of the second data processing device. The data input end adopts the V-by-One signal transmission interface standard, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard;

或者，所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用FPD-LINK信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用FPD-LINK信号传输接口标准，所述第二数据通信协议为基于FPD-LINK信号传输接口标准的协议。Alternatively, the first group of data output ends and the second group of data output ends of the first data processing device use the FPD-LINK signal transmission interface standard, and the first group of data input ends and the second group of data input ends of the second data processing device The data input end adopts the FPD-LINK signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.
如权利要求2所述的影像数据传输装置，其特征在于：The image data transmission device of claim 2, wherein:

所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用FPD-LINK III信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用FPD-LINK III信号传输接口标准，所述第二数据通信协议为基于FPD-LINK III信号传输接口标准的协议；The first group of data output terminals and the second group of data output terminals of the first data processing device adopt the FPD-LINK III signal transmission interface standard, and the first group of data input terminals and the second group of data input terminals of the second data processing device. The input end adopts the FPD-LINK III signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard;

或者，所述第一数据处理器件的第一组数据输出端和第二组数据输出端采用FPD-LINK IV信号传输接口标准，所述第二数据处理器件的第一组数据输入端和第二组数据输入端采用FPD-LINK IV信号传输接口标准，所述第二数据通信协议为基于FPD-LINK IV信号传输接口标准的协议。Alternatively, the first group of data output ends and the second group of data output ends of the first data processing device use the FPD-LINK IV signal transmission interface standard, and the first group of data input ends and the second group of data input ends of the second data processing device. The group data input end adopts the FPD-LINK IV signal transmission interface standard, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.
如权利要求1所述的影像数据传输装置，其中，所述第三数据通信协议与所述第一数据通信协议相同，或者所述第三数据通信协议与所述第一数据通信协议不同。The image data transmission device according to claim 1, wherein the third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.
如权利要求1至4中任一项所述的影像数据传输装置，其特征在于，所述第一影像传感器和第二影像传感器的数据输出通道为MIPI CSI接口，所述第一数据通信协议为MIPI CSI协议。The image data transmission device according to any one of claims 1 to 4, wherein the data output channels of the first image sensor and the second image sensor are MIPI CSI interfaces, and the first data communication protocol is MIPI CSI protocol.
如权利要求5所述的影像数据传输装置，其特征在于，所述第二数据通信协议满足：基于所述第二数据通信协议的影像数据具备由所述电光转换器将影像数据由电信号转换为光信号所要求的信号振幅。6. The video data transmission device according to claim 5, wherein the second data communication protocol satisfies: the video data based on the second data communication protocol has the ability to convert the video data into electrical signals by the electro-optical converter The required signal amplitude for the optical signal.
如权利要求1所述的影像数据传输装置，其特征在于，所述第一光纤传输通道包括第一光纤，所述第二光纤传输通道包括第二光纤； The image data transmission device of claim 1, wherein the first optical fiber transmission channel comprises a first optical fiber, and the second optical fiber transmission channel comprises a second optical fiber;

所述电光转换器包括至少第一输入端、第二输入端、第一输出端和第二输出端；所述光电转换器包括至少第一输入端、第二输入端、第一输出端和第二输出端；所述电光转换器的第一输出端通过所述第一光纤与所述光电转换器的第一输入端相连；所述电光转换器的第二输出端通过所述第二光纤与所述光电转换器的第二输入端相连；The electro-optical converter includes at least a first input end, a second input end, a first output end and a second output end; the photoelectric converter includes at least a first input end, a second input end, a first output end and a second output end. Two output ends; the first output end of the electro-optical converter is connected to the first input end of the photoelectric converter through the first optical fiber; the second output end of the electro-optical converter is connected to the second optical fiber through the second optical fiber. the second input end of the photoelectric converter is connected;

所述电光转换器通过其第一输入端接收由所述第一数据处理器件输出的第一组影像数据，并将该第一组影像数据由电信号转换为光信号；所述电光转换器通过其第一输出端将被转换为光信号的第一组影像数据输出，并通过所述第一光纤传输；所述光电转换器通过其第一输入端接收由所述第一光纤传输过来的被转换为光信号的第一组影像数据，并将该第一组影像数据由光信号转换为电信号，以通过其第一输出端输出；The electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals into optical signals; the electro-optical converter passes Its first output end outputs the first group of image data converted into optical signals, and transmits it through the first optical fiber; the photoelectric converter receives through its first input end the image data transmitted by the first optical fiber. converting the first group of image data into optical signals, and converting the first group of image data from optical signals into electrical signals for outputting through the first output end;

所述电光转换器通过其第二输入端接收由所述第一数据处理器件输出的第二组影像数据，并将该第二组影像数据由电信号转换为光信号；所述电光转换器通过其第二输出端将被转换为光信号的第二组影像数据输出，并通过所述第二光纤传输；所述光电转换器通过其第二输入端接收由所述第二光纤传输过来的被转换为光信号的第二组影像数据，并将该第二组影像数据由光信号转换为电信号，以通过其第二输出端输出。The electro-optical converter receives the second group of image data output by the first data processing device through its second input end, and converts the second group of image data from electrical signals into optical signals; the electro-optical converter passes Its second output end outputs the second group of image data converted into optical signals, and transmits it through the second optical fiber; the photoelectric converter receives the image data transmitted by the second optical fiber through its second input end. Converting the second group of image data into the optical signal, and converting the second group of image data from the optical signal into the electrical signal, so as to be output through its second output terminal.
如权利要求1所述的影像数据传输装置，其特征在于，所述电光转换器包括第一电光转换器和第二电光转换器；所述光电转换器包括第一光电转换器和第一光电转换器；所述第一光纤传输通道包括第一光纤，所述第二光纤传输通道包括第二光纤；The image data transmission device according to claim 1, wherein the electro-optical converter comprises a first electro-optical converter and a second electro-optical converter; the photoelectric converter comprises a first electro-optical converter and a first electro-optical converter The first optical fiber transmission channel includes a first optical fiber, and the second optical fiber transmission channel includes a second optical fiber;

所述第一电光转换器包括第一输入端和第一输出端；所述第二电光转换器包括第二输入端和第二输出端；所述第一光电转换器包括第一输入端和第一输出端；所述第二光电转换器包括第二输入端和第二输出端；所述第一电光转换器的第一输出端通过所述第一光纤与所述第一光电转换器的第一输入端相连；所述第二电光转换器的第二输出端通过所述第二光纤与所述第二光电转换器的第二输入端相连；The first electro-optical converter includes a first input end and a first output end; the second electro-optical converter includes a second input end and a second output end; the first photoelectric converter includes a first input end and a second output end; an output end; the second photoelectric converter includes a second input end and a second output end; the first output end of the first photoelectric converter passes through the first optical fiber and the first output end of the first photoelectric converter an input end is connected; the second output end of the second electro-optical converter is connected with the second input end of the second electro-optical converter through the second optical fiber;

所述第一电光转换器通过其第一输入端接收由所述第一数据处理器件输出的第一组影像数据，并将该第一组影像数据由电信号转换为光信号；所述第一电光转换器通过其第一输出端将被转换为光信号的第一组影像数据输出，并通过所述第一光纤传输；所述第一光电转换器通过其第一输入端接收由所述第一光纤传输过来的被转换为光信号的第一组影像数据，并将该第一组影像数据由光信号转换为电信号，以通过其第一输出端输出；The first electro-optical converter receives the first group of image data output by the first data processing device through its first input end, and converts the first group of image data from electrical signals into optical signals; the first The electro-optical converter outputs the first group of image data converted into optical signals through its first output end, and transmits it through the first optical fiber; the first electro-optical converter receives through its first input end A first group of image data converted into optical signals transmitted by an optical fiber, and the first group of image data is converted from optical signals into electrical signals to be output through its first output end;

所述第二电光转换器通过其第二输入端接收由所述第一数据处理器件输出的第二组影像数据，并将该第二组影像数据由电信号转换为光信号；所述第二电光转换器通过其第二输出端将被转换为光信号的第二组影像数据输出，并通过所述第二光纤传输；所述第二光电转换器通过其第二输入端接收由所述第二光纤传输过来的被转换为光信号的第二组影像数据，并将该第二组影像数据由光信号转换为电信号，以通过其第二输出端输出。The second electro-optical converter receives the second group of image data output by the first data processing device through its second input end, and converts the second group of image data from electrical signals into optical signals; the second The electro-optical converter outputs the second group of image data converted into optical signals through its second output end, and transmits it through the second optical fiber; the second photoelectric converter receives through its second input end The second group of image data transmitted from the two optical fibers is converted into an optical signal, and the second group of image data is converted from an optical signal into an electrical signal to be output through its second output end.
一种用于内窥镜摄像***的影像数据传输装置，所述影像数据传输装置用于与所述内窥镜摄像***中的影像处理部连接，以向所述影像处理部传输影像数据；其特征在于，包括：An image data transmission device for an endoscope camera system, the image data transmission device is used for connecting with an image processing unit in the endoscope camera system to transmit image data to the image processing unit; Features include:

影像传感器，所述影像传感器用于生成并输出基于第一数据通信协议的影像数据；an image sensor for generating and outputting image data based on the first data communication protocol;

第一数据处理器件，所述第一数据处理器件至少用于将所述影像传感器所输出的影像数据转换成基于第二数据通信协议的影像数据并输出；所述第二数据通信协议与所述第一数据通信协议不同；A first data processing device, the first data processing device is at least used for converting the image data output by the image sensor into image data based on a second data communication protocol and outputting; the second data communication protocol and the The first data communication protocol is different;

光纤传输组件，用于将由所述第一数据处理器件输出的影像数据由电信号转换为光信号进行传输后，再将所述转换为光信号的影像数据由光信号转换为电信号并输出；an optical fiber transmission component for converting the image data output by the first data processing device from an electrical signal into an optical signal for transmission, and then converting the image data converted into an optical signal from an optical signal into an electrical signal and outputting;

第二数据处理器件，用于接收从所述光纤传输组件传输过来的所述影像数据，并将该影像数据转换成基于第三数据通信协议的影像数据以输出；a second data processing device, configured to receive the image data transmitted from the optical fiber transmission component, and convert the image data into image data based on a third data communication protocol for output;

其中：in:

所述第一数据处理器件和所述第二数据处理器件之间采用V-by-One信号传输接口标准，所述第二数据通信协议为基于V-by-One信号传输接口标准的协议；A V-by-One signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard;

或者，所述第一数据处理器件和所述第二数据处理器件之间采用FPD-LINK信号传输接口标准，所述第二数据通信协议为基于FPD-LINK信号传输接口标准的协议。Alternatively, the FPD-LINK signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.
如权利要求9所述的影像数据传输装置，其特征在于：The image data transmission device of claim 9, wherein:

所述第一数据处理器件和所述第二数据处理器件之间采用FPD-LINK III信号传输接口标准，所述第二数据通信协议为基于FPD-LINK III信号传输接口标准的协议；The FPD-LINK III signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard;

或者，所述第一数据处理器件和所述第二数据处理器件之间采用FPD-LINK IV信号传输接口标准，所述第二数据通信协议为基于FPD-LINK IV信号传输接口标准的协议。Alternatively, the FPD-LINK IV signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.
如权利要求9所述的影像数据传输装置，其特征在于，所述第三数据通信协议与所述第一数据通信协议相同，或者所述第三数据通信协议与所述第一数据通信协议不同。9. The image data transmission device according to claim 9, wherein the third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol .
如权利要求9至11中任一项所述的影像数据传输装置，其特征在于，所述第一数据通信协议为MIPI CSI协议。The image data transmission device according to any one of claims 9 to 11, wherein the first data communication protocol is MIPI CSI protocol.
如权利要求12所述的影像数据传输装置，其特征在于，所述第二数据通信协议满足：基于所述第二数据通信协议的影像数据具备由所述光纤传输组件将影像数据由电信号转换为光信号所要求的信号振幅。13. The image data transmission device according to claim 12, wherein the second data communication protocol satisfies: the image data based on the second data communication protocol has the ability to convert the image data from electrical signals by the optical fiber transmission component The required signal amplitude for the optical signal.
如权利要求9所述的影像数据传输装置，其特征在于，所述光纤传输组件包括电光转换器、光纤传输通道和光电转换器；The image data transmission device according to claim 9, wherein the optical fiber transmission component comprises an electro-optical converter, an optical fiber transmission channel and an optical-electrical converter;

所述电光转换器接收由所述第一数据处理器件输出的影像数据，并将该影像数据由电信号转换为光信号，以输出给所述光纤传输通道；The electro-optical converter receives the image data output by the first data processing device, and converts the image data from an electrical signal into an optical signal, so as to output to the optical fiber transmission channel;

所述光纤传输通道用于传输被转换为光信号的所述影像数据；所述光纤传输通道包括光纤；The optical fiber transmission channel is used to transmit the image data converted into an optical signal; the optical fiber transmission channel includes an optical fiber;

所述光电转换器接收由所述光纤传输通道传输过来的被转换为光信号的所述影像数据，并将该影像数据由光信号转换为电信号后输出。The photoelectric converter receives the image data transmitted from the optical fiber transmission channel and is converted into an optical signal, converts the image data from the optical signal into an electrical signal, and outputs the image data.
一种内窥镜摄像***，其特征在于，包括：An endoscope camera system, characterized in that it includes:

光源部；light source part;

光源控制部，用于控制所述光源部提供成像所需的光；a light source control unit for controlling the light source unit to provide light required for imaging;

内窥镜，包括能够***到生物体内部的***部；an endoscope, including an insertion portion capable of being inserted into a living body;

摄像部，所述摄像部包括如权利要求1-14任意一项所述的影像数据传输装置；an imaging unit, the imaging unit comprising the image data transmission device according to any one of claims 1-14;

影像处理部，用于接收并处理由所述内窥镜数据传输装置所输出的影像数据，以生成用于显示影像的数据；an image processing unit for receiving and processing image data output by the endoscope data transmission device to generate data for displaying images;

显示器，用于对所述用于显示影像的数据进行显示。A display for displaying the data for displaying the image.
如权利要求15所述的内窥镜摄像***，其特征在于，所述影像处理部包括FPGA或CPU。The endoscopic imaging system according to claim 15, wherein the image processing unit includes an FPGA or a CPU.