WO2022087824A1 - Système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant - Google Patents

Système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant Download PDF

Info

Publication number
WO2022087824A1
WO2022087824A1 PCT/CN2020/123995 CN2020123995W WO2022087824A1 WO 2022087824 A1 WO2022087824 A1 WO 2022087824A1 CN 2020123995 W CN2020123995 W CN 2020123995W WO 2022087824 A1 WO2022087824 A1 WO 2022087824A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
image data
optical
group
output
Prior art date
Application number
PCT/CN2020/123995
Other languages
English (en)
Chinese (zh)
Inventor
徐涛
魏开云
Original Assignee
深圳迈瑞生物医疗电子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳迈瑞生物医疗电子股份有限公司 filed Critical 深圳迈瑞生物医疗电子股份有限公司
Priority to CN202080106698.9A priority Critical patent/CN116507262A/zh
Priority to PCT/CN2020/123995 priority patent/WO2022087824A1/fr
Publication of WO2022087824A1 publication Critical patent/WO2022087824A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion

Definitions

  • the invention relates to an endoscope camera system and an image data transmission device thereof.
  • endoscopic camera systems have been more and more widely used in surgical operations and diagnostic inspections; endoscopic camera systems can provide images of the inside of the human body to doctors, and doctors can perform operations or inspections stably and correctly through the images. .
  • the resolution of the endoscopic camera system has gone through the development process of high definition (HD), full high definition (FHD) and then ultra high definition (UHD), or in other words, it has gone through the development process of 1K, 2K and then 4K. While the resolution continues to improve, there are also many technical issues to be resolved.
  • HD high definition
  • FHD full high definition
  • UHD ultra high definition
  • the amount of data collected by the sensors that collect image data is also increasing; the collected data needs to be transmitted to the endoscope camera system through the transmission cable assembly.
  • the host performs processing.
  • the transmission cable assembly needs to be able to transmit a large amount of data at high speed and have better anti-interference ability.
  • the transmission of image data from the sensor to the image processing host in the endoscope camera system is generally realized through multi-channel twisted-pair cables. Real-time transmission of large-resolution image data.
  • An image data transmission device for an endoscope camera system is used for connecting with an image processing unit in the endoscope camera system to transmit image data to the image processing unit; comprising :
  • the first image sensor and the second image sensor are both used for generating image data, the first image sensor and the second image sensor output data based on the first image sensor through respective data output channels Image data of data communication protocol;
  • a first data processing device is communicatively connected with the data output channels of the first image sensor and the second image sensor; the first data processing device includes at least a first group of data output ends and a second Two sets of data output terminals; the first data processing device is used to convert the image data output by the first image sensor into a first set of image data based on a second data communication protocol, and pass the first set of data The output terminal outputs, and converts the image data output by the second image sensor into a second group of image data based on a second data communication protocol, and outputs through the second group of data output terminals; the second data communication the protocol is different from the first data communication protocol;
  • the optical fiber transmission assembly includes an electrical-to-optical converter, an optical-to-electrical converter, and at least a first optical fiber transmission channel and a second optical fiber transmission channel;
  • the signal is converted into an optical signal, and transmitted to the photoelectric converter through the first optical fiber transmission channel, and the photoelectric converter converts the received first group of image data from optical signals into electrical signals and outputs them;
  • the electro-optical converter is also used to convert the second group of image data output by the first data processing device from electrical signals into optical signals, and transmit them to the photoelectric converter through the second optical fiber transmission channel, and the photoelectric conversion The device then converts the received second group of image data from optical signals into electrical signals and outputs them;
  • a second data processing device includes at least a first group of data input terminals and a second group of data input terminals; the second data processing device is configured to receive the first data output from the photoelectric converter through the first group of data input terminals a set of image data, and convert the first set of image data into image data based on a third data communication protocol for output; and the second data processing device is further configured to receive through the second set of data input terminals The photoelectric converter outputs the second group of image data, and converts the second group of image data into image data based on a third data communication protocol for output.
  • the first group of data output terminals and the second group of data output terminals of the first data processing device adopt the V-by-One signal transmission interface standard
  • the first group of data output terminals of the second data processing device The input end and the second group of data input ends adopt the V-by-One signal transmission interface standard
  • the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard
  • the first group of data output ends and the second group of data output ends of the first data processing device use the FPD-LINK signal transmission interface standard
  • the first group of data input ends and the second group of data input ends of the second data processing device The data input end adopts the FPD-LINK signal transmission interface standard
  • the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.
  • the first group of data output terminals and the second group of data output terminals of the first data processing device use the FPD-LINK III signal transmission interface standard
  • the first group of data input terminals of the second data processing device The terminal and the second group of data input terminals adopt the FPD-LINK III signal transmission interface standard
  • the second data communication protocol is a protocol based on the FPD-LINK III signal transmission interface standard
  • the first group of data output ends and the second group of data output ends of the first data processing device use the FPD-LINK IV signal transmission interface standard
  • the first group of data input ends and the second group of data input ends of the second data processing device adopts the FPD-LINK IV signal transmission interface standard
  • the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.
  • the third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.
  • the data output channels of the first image sensor and the second image sensor are MIPI CSI interfaces
  • the first data communication protocol is MIPI CSI protocol
  • the second data communication protocol satisfies that the image data based on the second data communication protocol has a signal amplitude required by the electro-optical converter to convert the image data from an electrical signal to an optical signal.
  • the first optical fiber transmission channel includes a first optical fiber
  • the second optical fiber transmission channel includes a second optical fiber
  • the electro-optical converter includes at least a first input end, a second input end, a first output end and a second output end;
  • the photoelectric converter includes at least a first input end, a second input end, a first output end and a second output end. Two output ends; the first output end of the electro-optical converter is connected to the first input end of the photoelectric converter through the first optical fiber; the second output end of the electro-optical converter is connected to the second optical fiber through the second optical fiber. the second input end of the photoelectric converter is connected;
  • the electro-optical converter receives the first set of image data output by the first data processing device through its first input end, and converts the first set of image data from electrical signals into optical signals; the electro-optical converter passes Its first output end outputs the first group of image data converted into optical signals, and transmits it through the first optical fiber; the photoelectric converter receives through its first input end the image data transmitted by the first optical fiber. converting the first group of image data into optical signals, and converting the first group of image data from optical signals into electrical signals for outputting through the first output end;
  • the electro-optical converter receives the second group of image data output by the first data processing device through its second input end, and converts the second group of image data from electrical signals into optical signals; the electro-optical converter passes Its second output end outputs the second group of image data converted into optical signals, and transmits it through the second optical fiber; the photoelectric converter receives the image data transmitted by the second optical fiber through its second input end. Converting the second group of image data into the optical signal, and converting the second group of image data from the optical signal into the electrical signal, so as to be output through its second output terminal.
  • the electrical-to-optical converter includes a first electrical-to-optical converter and a second electrical-to-optical converter;
  • the opto-electrical converter includes a first electrical-to-optical converter and a first electrical-to-optical converter;
  • the first optical fiber transmission channel includes a first optical fiber, the second optical fiber transmission channel includes a second optical fiber;
  • the first electro-optical converter includes a first input end and a first output end; the second electro-optical converter includes a second input end and a second output end; the first photoelectric converter includes a first input end and a second output end; an output end; the second photoelectric converter includes a second input end and a second output end; the first output end of the first photoelectric converter passes through the first optical fiber and the first output end of the first photoelectric converter an input end is connected; the second output end of the second electro-optical converter is connected with the second input end of the second electro-optical converter through the second optical fiber;
  • the first electro-optical converter receives the first group of image data output by the first data processing device through its first input end, and converts the first group of image data from electrical signals into optical signals; the first The electro-optical converter outputs the first group of image data converted into optical signals through its first output end, and transmits it through the first optical fiber; the first electro-optical converter receives through its first input end A first group of image data converted into optical signals transmitted by an optical fiber, and the first group of image data is converted from optical signals into electrical signals to be output through its first output end;
  • the second electro-optical converter receives the second group of image data output by the first data processing device through its second input end, and converts the second group of image data from electrical signals into optical signals; the second The electro-optical converter outputs the second group of image data converted into optical signals through its second output end, and transmits it through the second optical fiber; the second photoelectric converter receives through its second input end The second group of image data transmitted from the two optical fibers is converted into an optical signal, and the second group of image data is converted from an optical signal into an electrical signal to be output through its second output end.
  • An image data transmission device for an endoscope camera system is used for connecting with an image processing unit in the endoscope camera system to transmit image data to the image processing unit; comprising :
  • an image sensor for generating and outputting image data based on the first data communication protocol
  • a first data processing device the first data processing device is at least used for converting the image data output by the image sensor into image data based on a second data communication protocol and outputting; the second data communication protocol and the The first data communication protocol is different;
  • an optical fiber transmission component for converting the image data output by the first data processing device from an electrical signal into an optical signal for transmission, and then converting the image data converted into an optical signal from an optical signal into an electrical signal and outputting;
  • a second data processing device configured to receive the image data transmitted from the optical fiber transmission component, and convert the image data into image data based on a third data communication protocol for output;
  • a V-by-One signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard;
  • the FPD-LINK signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.
  • the FPD-LINK III signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is based on the FPD-LINK III signal transmission interface standard agreement;
  • the FPD-LINK IV signal transmission interface standard is adopted between the first data processing device and the second data processing device, and the second data communication protocol is a protocol based on the FPD-LINK IV signal transmission interface standard.
  • the third data communication protocol is the same as the first data communication protocol, or the third data communication protocol is different from the first data communication protocol.
  • the first data communication protocol is MIPI CSI protocol.
  • the second data communication protocol satisfies that the image data based on the second data communication protocol has a signal amplitude required by the optical fiber transmission component to convert the image data from electrical signals to optical signals.
  • the optical fiber transmission assembly includes an electrical-to-optical converter, a fiber-optic transmission channel, and an optical-to-electrical converter;
  • the electro-optical converter receives the image data output by the first data processing device, and converts the image data from an electrical signal into an optical signal, so as to output to the optical fiber transmission channel;
  • the optical fiber transmission channel is used to transmit the image data converted into an optical signal;
  • the optical fiber transmission channel includes an optical fiber;
  • the photoelectric converter receives the image data transmitted from the optical fiber transmission channel and is converted into an optical signal, converts the image data from the optical signal into an electrical signal, and outputs the image data.
  • An endoscope camera system comprising:
  • a light source control unit for controlling the light source unit to provide light required for imaging
  • an endoscope including an insertion portion capable of being inserted into a living body
  • the imaging unit includes the video data transmission device described in any one of the above;
  • an image processing unit for receiving and processing image data output by the endoscope data transmission device to generate data for displaying images
  • a display for displaying the data for displaying the image is a display for displaying the data for displaying the image.
  • the image processing unit includes an FPGA or a CPU.
  • FIG. 1 is a schematic structural diagram of an image data transmission apparatus according to an embodiment
  • FIG. 2 is a schematic structural diagram of an image data transmission apparatus according to an embodiment
  • FIG. 3 is a schematic structural diagram of an image data transmission apparatus according to an embodiment
  • FIG. 4 is a schematic structural diagram of an image data transmission apparatus according to an embodiment
  • FIG. 5 is a schematic structural diagram of an image data transmission apparatus according to an embodiment
  • FIG. 6 is a schematic structural diagram of an image data transmission apparatus according to an embodiment
  • FIG. 7 is a schematic structural diagram of an endoscope camera system according to an embodiment
  • FIG. 8 is a schematic structural diagram of an endoscopic camera system according to an embodiment
  • FIG. 9 is a schematic structural diagram of an endoscope camera system according to an embodiment
  • FIG. 10 is a schematic structural diagram of an endoscope camera system according to an embodiment
  • FIG. 11 is a schematic structural diagram of an endoscope camera system according to an embodiment
  • FIG. 12 is a schematic structural diagram of an endoscope camera system according to an embodiment
  • FIG. 13 is a schematic structural diagram of an endoscopic camera system according to an embodiment
  • FIG. 14 is a schematic structural diagram of an endoscope camera system according to an embodiment
  • 15 is a schematic structural diagram of an endoscopic camera system according to an embodiment
  • 16 is a schematic structural diagram of an endoscopic camera system according to an embodiment
  • FIG. 17 is a schematic structural diagram of an endoscopic imaging system according to an embodiment.
  • connection and “connection” mentioned in this application, unless otherwise specified, include both direct and indirect connections (connections).
  • the current image data acquisition and transmission scheme of the endoscopic camera system cannot meet the high-definition or even 4K requirements of real-time camera.
  • the current 4K-type image sensor generally adopts the image sensor of the sub-LVDS interface, and the image sensor of the MIPI CSI interface with better performance cannot be selected.
  • the image acquisition part (camera/camera handle) of the endoscope camera system is constrained by size and power consumption, while the image sensor of the MIPI CSI interface with better performance usually has 4 data channels, which makes a single The rate of the channel is higher, usually exceeding 1.5Gbps, and the image sensor of the sub-LVDS interface usually has 8-10 data channels, so in the case of the same number, the rate of a single channel of the image sensor of the sub-LVDS interface can be Much lower, like less than 1 Gbps. Therefore, the current endoscopic camera system cannot directly choose such as MIPI in image acquisition. Image sensor with CSI interface.
  • the amount of data collected and to be transmitted is very large.
  • the image data transmission realized by twisted pair cable cannot meet this high-speed real-time transmission, and the anti-interference ability is deviated, and the cable is relatively thick.
  • Some embodiments provide an image data transmission device, and the image data transmission device in the present invention can be applied to occasions and products such as an endoscope camera system.
  • the image data transmission device of the present invention can be connected to an image processing unit in an endoscope camera system, such as an image processing host, to transmit image data to the image processing unit, and the image data transmitted to the image processing unit can be used by the image processing unit Process and generate data for displaying imagery.
  • the image data transmission device may include one or more image sensors, which will be described in the following cases.
  • an image data transmission apparatus in some embodiments includes an image sensor 10 , a first data processing device 20 , an optical fiber transmission assembly 30 and a second data processing device 40 , which will be described in detail below.
  • the image sensor 10 is used to generate and output image data based on the first data communication protocol.
  • the image sensor 10 includes at least two data output channels, such as 10a and 10b, through which the image sensor outputs image data.
  • the image sensor 10 can generate an AP (Application Processor, application processor) can process the image data of the specifications.
  • AP Application Processor, application processor
  • the first data processing device 20 is connected in communication with the data output channel of the image sensor 10; the first data processing device 20 is at least used to convert the image data output by the image sensor 10 into image data based on the second data communication protocol and output;
  • the second data communication protocol is different from the first data communication protocol.
  • the optical fiber transmission assembly 30 is used for converting the image data output by the first data processing device 20 from electrical signals into optical signals for transmission, and then converting the image data from optical signals into electrical signals and outputting the image data.
  • the optical fiber transmission component 30 is only used as a transparent transmission channel, and does not involve the work of protocol packing and unpacking.
  • the optical fiber transmission assembly 30 may include an electrical-to-optical converter 32 , a fiber-optic transmission channel 39 a and an optical-to-electrical converter 36 .
  • the electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from electrical signals into optical signals for output to the optical fiber transmission channel 39a; the optical fiber transmission channel 39a is used to transmit the converted optical signals
  • the optical fiber transmission channel 39a includes an optical fiber; the photoelectric converter 36 receives the image data transmitted by the optical fiber transmission channel 39a and is converted into an optical signal, and converts the image data from the optical signal into an electrical signal. output.
  • the second data processing device 40 is used for receiving the image data transmitted from the optical fiber transmission component 30, and converting the image data into image data based on the third data communication protocol for output.
  • the first data processing device 20, the optical fiber transmission assembly 30 and the second data processing device 40 cooperate to transmit the image data generated by the image sensor 10, for example, to the image processing unit, which can be an FPGA or Other CPU processing platforms.
  • the optical fiber transmission component 30 mainly performs electro-optical conversion, transmits optical signals through optical fibers, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution.
  • the first data processing device 20 and the second data processing device 40 include two chips using a chip-to-chip solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used between the two for data communication.
  • the transmission, ie the second data communication protocol may be a proprietary data communication protocol provided by the chip supplier.
  • the image sensor 10 can generate image data of MIPI (Mobile Industry Processor Interface, Mobile Industry Processor Interface) specification, for example, the data output channel of the image sensor is MIPI CSI interface, and the first data communication protocol is MIPI CSI protocol. Specifically, the data output channel of the image sensor can be MIPI CSI-2 interface.
  • MIPI is an alliance established in 2003 by companies such as ARM in the UK, Nokia in Finland, STMicroelectronics ST, and Texas Instruments TI in the United States. Reduce mobile phone design complexity and increase design flexibility.
  • MIPI Alliance defines a series of mobile phone internal interface standards, such as camera interface CSI (Camera Serial Interface), display interface DSI (Display Serial Interface), radio frequency interface DigRF, microphone/speaker interface SLIMbus, etc. End markets require lower power consumption, higher data rates, and a smaller PCB footprint.
  • CSI is an interface standard specified by the camera working group under the MIPI Alliance
  • CSI-2 is the second version of MIPI CSI, which is mainly composed of an application layer, a protocol layer, and a physical layer, and usually supports 4-channel data transmission.
  • the single-wire transmission speed is up to 1Gb/s, and it also supports 8-channel data transmission.
  • the MIPI CSI-2 interface generally has 1 pair of I2C communication pins, 1 pair of MIPI differential clock pins and 1 ⁇ 4 pairs of MIPI differential data signal pins.
  • the camera of the endoscope camera system is hand-held, and the doctor holds the camera to adjust the observation part and control parameters when performing surgery on the patient. Due to the large amount of data transmitted by the image sensor, the transmission power is large, and it also generates a large amount of heat. Cameras need to be designed with features such as low power consumption and low heat generation.
  • the image sensor of the MIPI interface has the characteristics of low power consumption, which just meets the design requirements of the camera.
  • this embodiment adopts an image sensor with a MIPI CSI interface with lower power consumption.
  • the optical fiber transmission component converts the image data from an electrical signal to an optical signal
  • the signal swing of the image data is required.
  • optical fiber transmission components convert data from electrical signals to optical signals.
  • the lower limit of the signal swing of data is 200mv
  • the signal swing of MIPI CSI data is usually less than 200mv.
  • the transmission component converts the electrical signal into an optical signal. Therefore, in this embodiment, the second data communication protocol satisfies: the image data based on the second data communication protocol has a signal amplitude required by the optical fiber transmission component to convert the image data from electrical signals to optical signals .
  • the image sensor when the image sensor is an 8-channel MIPI interface, the image sensor outputs image data to the first data processing device through the 8-channel MIPI interface, and the first data processing device processes the acquired image data and converts it into All the way image data and output.
  • the optical fiber transmission component converts the channel of image data from electrical signals into optical signals, and transmits them through a channel of optical fiber.
  • the image sensor when the image sensor has an 8-channel MIPI interface, the image sensor outputs the image data to the first data processing device through the 8-channel MIPI interface, and the first data processing device processes the acquired image data, and converts the acquired image data. into two channels of image data and output.
  • the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through the two channels of optical fibers.
  • the third data communication protocol is the same as the first data communication protocol.
  • the image data converted by the second data processing device 40 is also the image data of the MIPI standard.
  • the third data communication protocol is different from the first data communication protocol, as long as the data based on the third data communication protocol can be recognized and processed by the image processing unit.
  • the number of channels of the output image data is less than the number of channels of the input image data.
  • One data output channel of the image sensor 10 may correspond to one pin of the image sensor 10 , or may correspond to multiple pins (eg, two) of the image sensor 10 . Since the image data generated by the image sensor is relatively large and it is difficult to output through one data output channel, the generated image data is usually output through multiple data output channels to reduce the rate of each output channel; After the rate of each output channel, the data processing capability and power consumption requirements of the next-level processing unit (eg, the first data processing device 20 ) can also be adapted to a large extent.
  • the next-level processing unit eg, the first data processing device 20
  • the V-by-One signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard.
  • V-by-One is developed by Japan Sion Electronics Corporation (THine A signal transmission interface standard developed by Electronics), which can be used for high-definition digital image signal transmission, consisting of 1 to 8 groups of paired signals; Express, USB 3.0 can be better compatible; and converting 8Bit data to 10Bit data can effectively solve the DC balance.
  • V-by-One not only solves the problem of wiring time lag, but also greatly reduces EMI interference, and improves the maximum transmission speed of each group of signals (for example, up to 3.75Gbps), and the number of transmission lines is greatly reduced, saving PCB space.
  • an ultra-high-definition UHD display with a resolution of not lower than 3840X2160 if the LVDS protocol standard is used, its data lines will be up to 48 pairs; if the V-by-On protocol standard is used, its data lines only need 8 pairs.
  • the FPD-LINK signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard.
  • the FPD-LINK III/IV signal transmission interface standard is adopted between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is based on FPD-LINK III/IV signal transmission interface standard protocol.
  • FPD-Link III is an iteration based on FPD-Link II, FPD-Link The main function of III is to embed in the same poor bidirectional communication channel pair. Compared to the II, FPD-Link III goes a step further and reduces cable costs by eliminating control channel cables, such as I2C and CAN buses.
  • FPD-Link III stops using LVDS technology and only uses CML for serializing high-speed signals. This makes it easy to support data transfer rates greater than 3 on transmission lines with cables longer than 10m Gbit/s.
  • the advantage of using CML for FPD-Link III is to take advantage of the coaxial cable drive capability.
  • the coaxial cable can do a very good job in controlling impedance and noise, it can reduce differential signals and can better tolerate impedance discontinuities and noise. demand interference.
  • FPD-LINK III features full-duplex control that supports high-speed video data transmission and bidirectional control communication over a single differential link. Consolidating video data and control over a single differential pair reduces interconnect size and weight, while also eliminating skew issues and Simplified system design.
  • FPD-LINK III is generally used as an interface for automotive applications, enabling point-to-point video transmission.
  • FPD-LINK IV improves the data transfer rate of a single channel.
  • the image data transmission device in some embodiments includes a plurality of image sensors, such as a first image sensor 11 and a second image sensor 12 , the image data transmission device further includes a first data processing device 20 , an optical fiber transmission device
  • the component 30 and the second data processing device 40 will be described in detail below. It should be noted that the figure shows an example in which the image data transmission device includes two image sensors, but this is not limited to only two image sensors.
  • N can be configured according to requirements. For the image sensor, N can be 2 or an integer greater than 2.
  • Both the first image sensor 11 and the second image sensor 12 are used to generate image data; both the first image sensor 11 and the second image sensor 12 include at least two data output channels such as 10a and 10b, the first image sensor 11 and the second image sensor 12
  • the image sensor 12 outputs image data based on the first data communication protocol through each of the at least two data output channels.
  • the first image sensor 11 outputs image data through its at least two data output channels such as 10a and 10b
  • the first image sensor 12 outputs image data through its at least two data output channels such as 10a and 10b.
  • the first image sensor 11 and the second image sensor 12 can generate image data generated according to a specification that can be processed by an AP (Application Processor), which is a CPU for a mobile device.
  • AP Application Processor
  • the first image sensor 11 and the second image sensor 12 may generate MIPI (Mobile Industry Processor Interface, Mobile Industry Processor Interface) specification image data, and correspondingly, the data output channel of the image sensor may be a MIPI CSI-2 interface.
  • MIPI Mobile Industry Processor Interface, Mobile Industry Processor Interface
  • the first data processing device 20 is connected in communication with the data output channels of the first image sensor 11 and the second image sensor 12 .
  • the first data processing device 20 includes at least a first group of data output terminals 20a and a second group of data output terminals 20b; the first data processing device 20 is used for converting the image data output by the first image sensor 11 into a communication based on the second data
  • the first set of image data of the protocol is output through the first set of data output terminal 20a, and the image data output by the second image sensor 12 is converted into the second set of image data based on the second data communication protocol, and passed through the second set of image data.
  • the group data output terminal 20b outputs.
  • the second data communication protocol is different from the first data communication protocol.
  • the optical fiber transmission assembly 30 includes an electrical-to-optical converter 31, an optical-to-electrical converter 35, and at least a first optical fiber transmission channel 39b and a second optical fiber transmission channel 39c.
  • the electro-optical converter 31 is used to convert the first group of image data output by the first data processing device 20 from electrical signals into optical signals, and transmit them to the optical-to-electrical converter 35 through the first optical fiber transmission channel 39b, and the optical-to-electrical converter 35 then converts the data into optical signals.
  • the received first set of image data is converted from optical signals into electrical signals and output; the electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from electrical signals into optical signals, and through the second set of image data.
  • the optical fiber transmission channel 39c transmits it to the photoelectric converter 35, and the photoelectric converter 35 converts the received second set of image data from optical signals into electrical signals and outputs them. It can be seen that the first optical fiber transmission channel 39b and the second optical fiber transmission channel 39c are two independent signal transmission channels, which will be described in detail below.
  • the first optical fiber transmission channel 39b includes a first optical fiber 39bg
  • the second optical fiber transmission channel 39c includes a second optical fiber 39cg
  • the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c and a second output end 32d
  • the photoelectric converter 36 includes at least a first input end 36a and a second input end 36b , the first output end 36c and the second output end 36d
  • the first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the photoelectric converter 36 through the first optical fiber 39bg
  • the second output end of the electro-optical converter 32 32b is connected to the second input end 36b of the photoelectric converter 36 through a second optical fiber 39cg.
  • the first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the
  • the electro-optical converter 32 receives the first set of image data output by the first data processing device 20 through its first input end 32a, and converts the first set of image data from electrical signals into optical signals; the electro-optical converter 32 passes Its first output end 32c outputs the first group of image data converted into optical signals and transmits it through the first optical fiber 39bg; the photoelectric converter 36 receives the converted image data transmitted by the first optical fiber 39bg through its first input end 36a It is the first group of image data of the optical signal, and the first group of image data is converted from the optical signal into an electrical signal to be output through the first output end 36c.
  • the electro-optical converter 32 receives the second set of image data output by the first data processing device 20 through its second input terminal 32b, and converts the second set of image data from electrical signals into optical signals; the electro-optical converter 32 The second set of image data converted into optical signals is output through its second output end 32b, and transmitted through the second optical fiber 39cg; Converting the second group of image data into optical signals, and converting the second group of image data from optical signals into electrical signals to be output through the second output terminal 36d.
  • the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34;
  • the optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg.
  • the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first photoelectric converter 37 includes a first The input end 37a and the first output end 37b; the second photoelectric converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 communicates with the first photoelectric The first input end 37a of the converter 37 is connected; the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second photoelectric converter 38 through the second optical fiber 39cg.
  • the first input end 33a of the first electro-optical converter 33 is connected to the first group of data output ends 20a of the first data processing device 20
  • the second input end 34a of the second electro-optical converter 34 is connected to the first group of data output ends 20a of the first data processing device 20 .
  • Two sets of data output terminals 20b are connected.
  • the first electro-optical converter 33 receives the first set of image data output by the first data processing device 20 through its first input end 33a, and converts the first set of image data from electrical signals into optical signals;
  • the converter 33 outputs the first set of image data converted into optical signals through its first output end 33b, and transmits it through the first optical fiber 39bg;
  • 39bg transmits the first group of image data converted into optical signals, and converts the first group of image data from optical signals into electrical signals for output through its first output terminal 37b.
  • the second electro-optical converter 34 receives the second set of image data output by the first data processing device 20 through its second input terminal 34a, and converts the second set of image data from electrical signals into optical signals;
  • the electro-optical converter 34 outputs the second group of image data converted into optical signals through its second output end 34b, and transmits it through the second optical fiber 39cg;
  • the optical fiber 39cg transmits the second set of image data converted into optical signals, and converts the second set of image data from optical signals into electrical signals for output through its second output end 38b.
  • the second data processing device 40 includes at least a first group of data input terminals 40a and a second group of data input terminals 40b; the second data processing device 40 is configured to receive the first data input terminal 40a output by the photoelectric converter 20 through its first group of data input terminals 40a a set of image data, and convert the first set of image data into image data based on the third data communication protocol for output; and, the second data processing device 40 is further configured to receive through its second set of data input terminals 40b The second group of image data output by the photoelectric converter is converted into image data based on the third data communication protocol for output.
  • the third data communication protocol is the same as the first data communication protocol.
  • the image data converted by the second data processing device 40 is also the image data of the MIPI standard.
  • the third data communication protocol is different from the first data communication protocol, as long as the data based on the third data communication protocol can be recognized and processed by the image processing unit.
  • the first data processing device 20, the optical fiber transmission assembly 30 and the second data processing device 40 cooperate to transmit the image data generated by the image sensor such as the first image sensor 11 and the second image sensor 12, for example, to the image The processing unit, etc.
  • the image processing unit can be an FPGA or other CPU processing platform.
  • the optical fiber transmission assembly 30 mainly performs electro-optical conversion, transmits signals through optical fibers, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution.
  • the first data processing device 20 and the second data processing device 40 include two chips using a chip-to-chip solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used between the two for data communication.
  • the transmission, ie the second data communication protocol may be a proprietary data communication protocol provided by the chip supplier.
  • the V-by-One signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard.
  • the FPD-LINK signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Further, the FPD-LINK III/IV signal transmission interface standard is adopted between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is based on FPD-LINK III/IV signal transmission interface standard protocol.
  • the above are some descriptions of the image data transmission device of the present invention.
  • the image data transmission device of the present invention can be applied to occasions and products such as an endoscopic camera system.
  • the following may be used as an example for an endoscopic camera application.
  • an endoscopic camera system in some embodiments includes a light source unit 100 , a light source control unit 200 , an endoscope 300 , a camera unit 320 , an endoscope data transmission device 400 , and an image processing unit.
  • the unit 500 and the display 600 will be described in detail below.
  • the light source part 100 is used to provide an illumination light source to the part to be observed.
  • the light source part 100 can provide the light required for ordinary light imaging, and can also provide light required for special light imaging.
  • the illumination light source provided by the light source unit 100 to the part to be observed may be general light illumination based on broad-band light and special light illumination based on narrow-band light.
  • a monochrome image with blood vessel enhancement effect is generated first, and then a color image is generated according to the grayscale value of the monochrome image - understandably, this color image generated from a monochrome image such as a grayscale image is false
  • the color image, that is, the special light image is a pseudo-color image at this time.
  • the light source part 100 may include a first light source 110 and a second light source 120 .
  • the first light source 110 can provide multiple monochromatic lights with different wavelength ranges in time division.
  • the first light source 110 can be a semiconductor light source or an LED light source, and the provided monochromatic light can be blue light, green light, red light Light etc.
  • the first light source 110 may also provide the combined light of the plurality of monochromatic lights, or be a white light source with a broad spectrum.
  • the wavelength range of the monochromatic light is approximately 400 nm to 700 nm.
  • the second light source 120 provides narrow-band light.
  • the second light source 120 may be a laser that emits a narrow-band blue laser, and the peak wavelength takes at least any one value of blue light in the range of 390nm-460nm.
  • the second light source 120 may also be an LED light source or a laser LED, and the narrow-band light emitted may be a narrow-band green laser or the like.
  • the light source part 100 may further include a dichroic mirror 130.
  • the first light source 110 and the second light source 120 work in a time-sharing manner; that is, when the first light source 110 is turned on, the second light source The light source 120 is turned off. vice versa.
  • the dichroic mirror 130 is disposed on the transmission light paths of a plurality of monochromatic lights and narrow-band lights, and the light paths of the plurality of monochromatic lights and narrow-band lights are combined into the same light path after passing through the dichroic mirror 130 .
  • a plurality of monochromatic lights can be transmitted through the dichroic mirror 130, and the narrow-band light can be reflected by the dichroic mirror 130, so that the optical paths of the two can be combined into the same optical path; and vice versa.
  • the narrow-band light and a plurality of monochromatic lights are transmitted in the direction of the endoscope 300 along the same combined optical path in time division.
  • the light source part 100 further includes a coupling mirror 140 disposed at the light source introduction port of the dichroic mirror 130 and the endoscope 300 .
  • the coupling mirror 140 can focus the light transmitted from the dichroic mirror 130, so as to better guide the light into the endoscope 300, reduce light loss as much as possible, and improve the overall lighting quality of the system. Both the light path synthesis function of the dichroic mirror 130 and the focusing function of the coupling mirror 140 can better guide the light into the endoscope 300 .
  • the use of the dichroic mirror 130 can make the overall structure of the light source part 100 more compact and the light propagation path shorter.
  • the above is some description of the light source unit 100 .
  • the light source control part 200 is used to control the light source part 100 , for example, to control the light source part 100 to provide the light required for ordinary light imaging, and to control the light source part 100 to provide the light required for special light imaging.
  • the endoscope 300 is used to transmit optical signals.
  • endoscope 300 may include insertion portion 310 .
  • the insertion part 310 can be inserted into the living body, for example, the scope body of which the insertion part 310 is a part can be inserted into the living body by the operator.
  • the insertion part 310 can transmit the light generated by the light source part 100 to the introduction part (which can be a light guide fiber) of the part to be observed.
  • the imaging unit 320 includes at least one sensor for generating image data.
  • the imaging unit 320 may include the image sensor 10 .
  • the camera unit 320 may include the first image sensor 11 and the second image sensor 12 .
  • the imaging unit 320 may include N sensors for generating image data, and N may be an integer greater than 2.
  • the imaging unit 320 includes the image sensor 10 .
  • the image sensor 10 is used to generate image data based on the first data communication protocol.
  • the image sensor 10 may include at least two data output channels such as 10a and 10b, and the image sensor outputs image data through the at least two data output channels such as 10a and 10b.
  • the image sensor 10 can generate image data according to a specification that can be processed by an AP (Application Processor), which is a CPU for a mobile device.
  • AP Application Processor
  • the image sensor 10 can generate image data of MIPI standard, and correspondingly, the data output channel of the image sensor can be MIPI CSI-2 interface.
  • both the first image sensor 11 and the second image sensor 12 are used to generate image data
  • both the first image sensor 11 and the second image sensor 12 include at least two data output channels such as 10a and 10b.
  • 11 and the second image sensor 12 output image data based on the first data communication protocol through the at least two data output channels respectively.
  • the first image sensor 11 outputs image data through its at least two data output channels such as 10a and 10b
  • the first image sensor 12 outputs image data through its at least two data output channels such as 10a and 10b.
  • the first image sensor 11 and the second image sensor 12 may generate an AP (Application Processor, application processor) can process the image data of the specifications.
  • AP Application Processor, application processor
  • the first image sensor 11 and the second image sensor 12 can generate image data of MIPI standard, and correspondingly, the data output channel of the image sensor can be the MIPI CSI-2 interface.
  • one end of the camera unit 320 is connected to the endoscope data transmission device 400 to provide image data for the image processing unit 500 , one end of the camera unit 320 can be clipped to the endoscope, and the light source unit 100 provides the endoscope 300 with image data. the light source, and the imaging unit 320 can acquire the optical signal of the endoscope.
  • the endoscope data transmission device 400 will be described.
  • the endoscope data transmission device 400 is used to transmit the image data generated by the imaging unit 320 to the following image processing unit 500 for processing. There are various implementations of the endoscope data transmission apparatus 400, which will be described in detail below.
  • the endoscope data transmission device 400 may include a first data processing device 20 , an optical fiber transmission assembly 30 and a second data processing device 40 .
  • the first data processing device 20 is connected in communication with the data output channel of the image sensor 10; the first data processing device 20 is at least used to convert the image data output by the image sensor 10 into image data based on the second data communication protocol and output;
  • the second data communication protocol is different from the first data communication protocol.
  • the optical fiber transmission assembly 30 is used for converting the image data output by the first data processing device 20 from electrical signals into optical signals for transmission, and then converting the image data from optical signals into electrical signals and outputting the image data.
  • the optical fiber transmission assembly 30 may include an electrical-to-optical converter 32 , a fiber-optic transmission channel 39 a and an optical-to-electrical converter 36 .
  • the electro-optical converter 32 receives the image data output by the first data processing device 20, and converts the image data from electrical signals into optical signals for output to the optical fiber transmission channel 39a; the optical fiber transmission channel 39a is used to transmit the converted optical signals
  • the optical fiber transmission channel 39a includes an optical fiber; the photoelectric converter 36 receives the image data transmitted by the optical fiber transmission channel 39a and is converted into an optical signal, and converts the image data from the optical signal into an electrical signal. output.
  • the second data processing device 40 is used for receiving the image data transmitted from the optical fiber transmission component 30, and converting the image data into image data based on the third data communication protocol for output.
  • the first data processing device 20, the optical fiber transmission assembly 30 and the second data processing device 40 cooperate to transmit the image data generated by the image sensor 10, for example, to the image processing unit, which can be an FPGA or Other CPU processing platforms.
  • the optical fiber transmission assembly 30 mainly performs electro-optical conversion, transmits signals through optical fibers, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution.
  • the first data processing device 20 and the second data processing device 40 include two chips using a chip-to-chip solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used between the two for data communication.
  • the transmission, ie the second data communication protocol may be a proprietary data communication protocol provided by the chip supplier.
  • the V-by-One signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard.
  • the FPD-LINK signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Further, the FPD-LINK III/IV signal transmission interface standard is adopted between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is based on FPD-LINK III/IV signal transmission interface standard protocol.
  • the endoscope data transmission device 400 may include a first data processing device 20 , an optical fiber transmission assembly 30 and a second data processing device 40 .
  • the first data processing device 20 is connected in communication with the data output channels of the first image sensor 11 and the second image sensor 12 .
  • the first data processing device 20 includes at least a first group of data output terminals 20a and a second group of data output terminals 20b; the first data processing device 20 is used for converting the image data output by the first image sensor 11 into a communication based on the second data
  • the first set of image data of the protocol is output through the first set of data output terminal 20a, and the image data output by the second image sensor 12 is converted into the second set of image data based on the second data communication protocol, and passed through the second set of image data.
  • the group data output terminal 20b outputs.
  • first group of data output ends 20a and the second group of data output ends 20b may specifically be one output end, or may be multiple output ends.
  • first group of image data and the second group of image data may specifically be one channel of image data, or may be multiple channels of image data.
  • the optical fiber transmission assembly 30 includes an electrical-to-optical converter 31, an optical-to-electrical converter 35, and at least a first optical fiber transmission channel 39b and a second optical fiber transmission channel 39c.
  • the electro-optical converter 31 is used to convert the first group of image data output by the first data processing device 20 from electrical signals into optical signals, and transmit them to the optical-to-electrical converter 35 through the first optical fiber transmission channel 39b, and the optical-to-electrical converter 35 then converts the data into optical signals.
  • the received first set of image data is converted from optical signals into electrical signals and output; the electro-optical converter 31 is also used to convert the second set of image data output by the first data processing device 20 from electrical signals into optical signals, and through the second set of image data.
  • the optical fiber transmission channel 39c transmits it to the photoelectric converter 35, and the photoelectric converter 35 converts the received second set of image data from optical signals into electrical signals and outputs them. It can be seen that the first optical fiber transmission channel 39b and the second optical fiber transmission channel 39c are two independent signal transmission channels, which will be described in detail below.
  • the first image sensor and the second image sensor when the first image sensor and the second image sensor have an 8-channel MIPI interface, the first image sensor and the second image sensor output image data to the first data processing device through the 8-channel MIPI interface.
  • the first data processing device After processing the acquired image data of the first image sensor, the first data processing device converts it into one channel of image data (a first group of image data) and outputs it.
  • the optical fiber transmission component converts the channel of image data from electrical signals into optical signals, and transmits them through a channel of optical fiber.
  • the first data processing device processes the acquired image data of the second image sensor, it is converted into one channel of image data (a second group of image data) and output.
  • the optical fiber transmission component converts the channel of image data from electrical signals into optical signals, and transmits them through a channel of optical fiber.
  • the image sensor when the first image sensor and the second image sensor are 8-channel MIPI interfaces, the image sensor outputs image data to the first data processing device through the 8-channel MIPI interface.
  • the first data processing device processes the acquired image data of the first image sensor, it is converted into two channels of image data (a first group of image data) and output.
  • the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through the two channels of optical fibers.
  • the first data processing device processes the image data obtained from the second image sensor, it is converted into two channels of image data (a second group of image data) and output.
  • the optical fiber transmission component converts the two channels of image data from electrical signals into optical signals, and transmits them respectively through the two channels of optical fibers.
  • the first data processing device when there are multiple image sensors, the first data processing device respectively converts the image data of each image sensor into a set of corresponding image data.
  • the electro-optical converter 31 includes an electro-optical converter 32; Two fibers 39cg.
  • the electro-optical converter 32 includes at least a first input end 32a, a second input end 32b, a first output end 32c and a second output end 32d;
  • the photoelectric converter 36 includes at least a first input end 36a and a second input end 36b , the first output end 36c and the second output end 36d;
  • the first output end 32c of the electro-optical converter 32 is connected to the first input end 36a of the photoelectric converter 36 through the first optical fiber 39bg;
  • the second output end of the electro-optical converter 32 32b is connected to the second input end 36b of the photoelectric converter 36 through a second optical fiber 39cg.
  • the first input end 32a and the second input end 32b of the electro-optical converter 32 are respectively connected to the first group of data output ends 20a and the second group of data output ends 20b of the first data processing device 20 .
  • the electro-optical converter 32 receives the first set of image data output by the first data processing device 20 through its first input end 32a, and converts the first set of image data from electrical signals into optical signals; the electro-optical converter 32 passes Its first output end 32c outputs the first group of image data converted into optical signals and transmits it through the first optical fiber 39bg; the photoelectric converter 36 receives the converted image data transmitted by the first optical fiber 39bg through its first input end 36a It is the first group of image data of the optical signal, and the first group of image data is converted from the optical signal into an electrical signal to be output through the first output end 36c.
  • the electro-optical converter 32 receives the second set of image data output by the first data processing device 20 through its second input terminal 32b, and converts the second set of image data from electrical signals into optical signals; the electro-optical converter 32 The second set of image data converted into optical signals is output through its second output end 32b, and transmitted through the second optical fiber 39cg; Converting the second group of image data into optical signals, and converting the second group of image data from optical signals into electrical signals to be output through the second output terminal 36d.
  • the electro-optical converter 31 includes a first electro-optical converter 33 and a second electro-optical converter 34;
  • the optical fiber transmission channel 39b includes a first optical fiber 39bg, and the second optical fiber transmission channel 39c includes a second optical fiber 39cg.
  • the first electro-optical converter 33 includes a first input end 33a and a first output end 33b; the second electro-optical converter 34 includes a second input end 34a and a second output end 34b; the first photoelectric converter 37 includes a first The input end 37a and the first output end 37b; the second photoelectric converter 38 includes a second input end 38a and a second output end 38b; the first output end 33b of the first electro-optical converter 33 communicates with the first photoelectric The first input end 37a of the converter 37 is connected; the second output end 34a of the second electro-optical converter 34 is connected to the second input end 38a of the second photoelectric converter 38 through the second optical fiber 39cg.
  • the first input end 33a of the first electro-optical converter 33 is connected to the first group of data output ends 20a of the first data processing device 20
  • the second input end 34a of the second electro-optical converter 34 is connected to the first group of data output ends 20a of the first data processing device 20 .
  • Two sets of data output terminals 20b are connected.
  • the first electro-optical converter 33 receives the first set of image data output by the first data processing device 20 through its first input end 33a, and converts the first set of image data from electrical signals into optical signals;
  • the converter 33 outputs the first set of image data converted into optical signals through its first output end 33b, and transmits it through the first optical fiber 39bg;
  • 39bg transmits the first group of image data converted into optical signals, and converts the first group of image data from optical signals into electrical signals for output through its first output terminal 37b.
  • the second electro-optical converter 34 receives the second set of image data output by the first data processing device 20 through its second input terminal 34a, and converts the second set of image data from electrical signals into optical signals;
  • the electro-optical converter 34 outputs the second group of image data converted into optical signals through its second output end 34b, and transmits it through the second optical fiber 39cg;
  • the optical fiber 39cg transmits the second set of image data converted into optical signals, and converts the second set of image data from optical signals into electrical signals for output through its second output end 38b.
  • the second data processing device 40 includes at least a first group of data input terminals 40a and a second group of data input terminals 40b; the second data processing device 40 is configured to receive the first data input terminal 40a output by the photoelectric converter 20 through its first group of data input terminals 40a a set of image data, and convert the first set of image data into image data based on the third data communication protocol for output; and, the second data processing device 40 is further configured to receive through its second set of data input terminals 40b The second group of image data output by the photoelectric converter is converted into image data based on the third data communication protocol for output.
  • the third data communication protocol is the same as the first data communication protocol.
  • the image data converted by the second data processing device 40 is also the image data of the MIPI standard.
  • the third data communication protocol is different from the first data communication protocol, as long as the data based on the third data communication protocol can be recognized and processed by the image processing unit.
  • the number of the first group of data input terminals 40a is the same as the number of the first group of data output terminals 20a, and the number of the second group of data input terminals 40b and the second group of data output terminals 20b is the same.
  • the first data processing device 20, the optical fiber transmission assembly 30 and the second data processing device 40 cooperate to transmit the image data generated by the image sensor such as the first image sensor 11 and the second image sensor 12, for example, to the image The processing unit, etc.
  • the image processing unit can be an FPGA or other CPU processing platform.
  • the optical fiber transmission assembly 30 mainly performs electro-optical conversion, transmits signals through optical fibers, and then performs photoelectric conversion; the first data processing device 20 and the second data processing device 40 cooperate to form a chip-to-chip solution.
  • the first data processing device 20 and the second data processing device 40 include two chips using a chip-to-chip solution. These two chips are usually purchased from outside, and a proprietary data communication protocol is used between the two for data communication.
  • the transmission, ie the second data communication protocol may be a proprietary data communication protocol provided by the chip supplier.
  • the V-by-One signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the V-by-One signal transmission interface standard.
  • the FPD-LINK signal transmission interface standard is used between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is a protocol based on the FPD-LINK signal transmission interface standard. Further, the FPD-LINK III/IV signal transmission interface standard is adopted between the first data processing device 20 and the second data processing device 40, and the second data communication protocol is based on FPD-LINK III/IV signal transmission interface standard protocol.
  • the camera unit 320 may further include more than three image sensors, and the transmission principle of the image data may refer to the two image sensors (the first image sensor 11 and the second image sensor 12 ).
  • the image processing unit 500 can serve as an image processing host of the endoscope imaging system, and the image processing unit 500 is configured to receive and process the image data output by the endoscope data transmission device 400 to generate data for displaying images.
  • the image processing unit 500 includes an FPGA or a CPU.
  • the display 600 is used for displaying the data for displaying the image.
  • FIGS. 7 to 17 are only examples of the endoscopic imaging system, and do not constitute a limitation of the endoscopic imaging system.
  • the endoscopic imaging system may include more than those shown in FIGS. More or fewer components, or a combination of certain components, or different components, eg, an endoscopic camera system may also include dilators, smoke control devices, input and output devices, network access devices, and the like.
  • the components with the same numbers in FIGS. 7-17 and 1-6 may be the same, and for details, please refer to the descriptions in the corresponding embodiments of FIGS. 1-6 .
  • the term “comprising” and any other variations thereof are non-exclusive inclusion, such that a process, method, article or device including a list of elements includes not only those elements, but also not expressly listed or included in the process , method, system, article or other elements of a device.
  • the term “coupled” and any other variations thereof refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections, and/or any other connection.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Endoscopes (AREA)

Abstract

La présente invention concerne un système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant. La transmission de données d'image est mise en œuvre au moyen d'un premier dispositif de traitement des données (20), d'un ensemble de transmission par fibre optique (30) et d'un second dispositif de traitement des données (40). Le premier dispositif de traitement de données (20) est au moins utilisé pour convertir des données d'image sur la base d'un premier protocole de communication de données et délivrées par un capteur d'image (10) en données basées sur un deuxième protocole de communication de données, l'ensemble de transmission par fibre optique (30) transmet lesdites données au second dispositif de traitement des données (40), puis le second dispositif de traitement des données (40) convertit les données d'image obtenues en données d'image sur la base d'un troisième protocole de communication de données et les délivre à une partie de traitement des images (500) pour traitement.
PCT/CN2020/123995 2020-10-27 2020-10-27 Système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant WO2022087824A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080106698.9A CN116507262A (zh) 2020-10-27 2020-10-27 内窥镜摄像***及其影像数据传输装置
PCT/CN2020/123995 WO2022087824A1 (fr) 2020-10-27 2020-10-27 Système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/123995 WO2022087824A1 (fr) 2020-10-27 2020-10-27 Système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant

Publications (1)

Publication Number Publication Date
WO2022087824A1 true WO2022087824A1 (fr) 2022-05-05

Family

ID=81383442

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/123995 WO2022087824A1 (fr) 2020-10-27 2020-10-27 Système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant

Country Status (2)

Country Link
CN (1) CN116507262A (fr)
WO (1) WO2022087824A1 (fr)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120016202A1 (en) * 2010-07-15 2012-01-19 Eckart Baum Endoscopic Instrument
CN106264430A (zh) * 2015-06-25 2017-01-04 因德斯马特有限公司 内窥镜设备及内窥镜设备的影像处理方法
CN209695161U (zh) * 2018-12-14 2019-11-29 深圳市博盛医疗科技有限公司 一种电子内窥镜高速视频信号传输与隔离装置
CN110769207A (zh) * 2019-11-19 2020-02-07 深圳开立生物医疗科技股份有限公司 一种电子内窥镜信号传输方法、装置和设备及***
CN210075242U (zh) * 2019-07-25 2020-02-14 重庆金山医疗技术研究院有限公司 一种光通信结构及电子内窥镜***
CN211155658U (zh) * 2019-10-09 2020-08-04 南京速瑞医疗科技有限公司 软式3d电子内窥镜***
CN111526320A (zh) * 2020-04-18 2020-08-11 华南理工大学 基于fpga的超高清视频的远距离传输***
CN111568345A (zh) * 2019-02-19 2020-08-25 广东美泰泓科技有限公司 适用于电子内窥镜的信号转换装置、电子内窥镜及***

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120016202A1 (en) * 2010-07-15 2012-01-19 Eckart Baum Endoscopic Instrument
CN106264430A (zh) * 2015-06-25 2017-01-04 因德斯马特有限公司 内窥镜设备及内窥镜设备的影像处理方法
CN209695161U (zh) * 2018-12-14 2019-11-29 深圳市博盛医疗科技有限公司 一种电子内窥镜高速视频信号传输与隔离装置
CN111568345A (zh) * 2019-02-19 2020-08-25 广东美泰泓科技有限公司 适用于电子内窥镜的信号转换装置、电子内窥镜及***
CN210075242U (zh) * 2019-07-25 2020-02-14 重庆金山医疗技术研究院有限公司 一种光通信结构及电子内窥镜***
CN211155658U (zh) * 2019-10-09 2020-08-04 南京速瑞医疗科技有限公司 软式3d电子内窥镜***
CN110769207A (zh) * 2019-11-19 2020-02-07 深圳开立生物医疗科技股份有限公司 一种电子内窥镜信号传输方法、装置和设备及***
CN111526320A (zh) * 2020-04-18 2020-08-11 华南理工大学 基于fpga的超高清视频的远距离传输***

Also Published As

Publication number Publication date
CN116507262A (zh) 2023-07-28

Similar Documents

Publication Publication Date Title
KR100652355B1 (ko) 광전송을 위한 송수신기를 내장한 커넥터 및 케이블
US8690759B2 (en) Endoscopic instrument
JP2006115516A (ja) ディジタルディスプレイ用の光ファイバ接続システム
WO2021036932A1 (fr) Connecteur d'endoscope, corps d'endoscope, source de lumière froide d'endoscope et système d'endoscope
CN114513254B (zh) 一种可动态改变传输方向的高速光电传输***及线缆
US11627290B2 (en) Signal communication over an optical link
TW201711479A (zh) 多媒體訊號傳輸裝置及方法
CN109994281A (zh) 一种能兼容多接口的aoc线缆
WO2022087824A1 (fr) Système photographique d'endoscope et un appareil de transmission de données d'image s'y rapportant
CN115334277B (zh) 一种电子内窥镜、电子内窥镜视频传输***及方法
KR20090043847A (ko) 멀티미디어 데이터 송신기
CN105118409A (zh) 基于fpga的v-by-one编解码***及方法
US6880078B2 (en) Xaui extender card
WO2022087823A1 (fr) Système de photographie d'endoscope et appareil de transmission de données d'image associé
CN209748717U (zh) 4k超高清视频***
CN219372491U (zh) 基于fpga的信号传输结构及内窥镜***
CN210041838U (zh) 一种可分离式多功能连接器的hdmi光纤传输装置
CN217116260U (zh) 光纤传输***
CN217116261U (zh) 光纤矩阵器
CN216057292U (zh) 用于hdmi2.1向下兼容的测试***
WO2014012273A1 (fr) Réseau local employant un réseautage pof, et commutateur optique et convertisseur optique pour celui-ci
CN217116262U (zh) 光纤传输***
CN217721314U (zh) 一种aoc线缆、cxp转光盒子及光转cxp盒子
CN212278347U (zh) 视频传输卡和视频处理设备
WO2021040047A1 (fr) Émetteur, récepteur et système de communication

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20958989

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202080106698.9

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20958989

Country of ref document: EP

Kind code of ref document: A1