CN115334277A

CN115334277A - Electronic endoscope, electronic endoscope video transmission system and method

Info

Publication number: CN115334277A
Application number: CN202210759621.2A
Authority: CN
Inventors: 王迎智; 高倩; 周毅
Original assignee: Jixian Artificial Intelligence Co Ltd
Current assignee: Jixian Artificial Intelligence Co Ltd
Priority date: 2022-06-30
Filing date: 2022-06-30
Publication date: 2022-11-11
Anticipated expiration: 2042-06-30
Also published as: CN115334277B

Abstract

The invention discloses an electronic endoscope, an electronic endoscope video transmission system and a method, comprising the following steps: a lens end and a handle end; the lens end is connected with the handle end through an IIC bus, and the handle end is connected with an external terminal through a CAN bus; the camera lens end comprises an image sensor and a serial unit, wherein the image sensor is used for collecting video data and transmitting the video data to the serial unit; the handle end comprises an IIC buffer, a CAN transceiver and a light emitter, the IIC buffer is in communication connection with the lens end and used for conversion between a single-ended IIC signal and a differential CAN signal, the CAN transceiver is in communication with an external terminal, and the light emitter receives video data sent by the serial unit, converts an electric signal of the video data into an optical signal and transmits the optical signal to the external terminal. The reliability of long-distance transmission between the electronic endoscope and the image processing host is improved, the interface is simplified, and the compatibility of the electronic endoscope and the image processing host is improved.

Description

Electronic endoscope, electronic endoscope video transmission system and method

Technical Field

The invention relates to the technical field of endoscope video acquisition, in particular to an electronic endoscope, an electronic endoscope video transmission system and an electronic endoscope video transmission method.

Background

The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.

An endoscope image system generally comprises an endoscope, an image processing host, a light source host, a display and the like, as shown in fig. 1, wherein the endoscope enters a human body through a natural orifice or a minimally invasive incision of the human body, collects images of corresponding organs and transmits the images to the image processing host; the image processing host machine processes the video image input by the endoscope and outputs the video image to the display; the display is used for displaying the image output by the image processing host; the light source mainly provides a light source for the endoscope.

The endoscope has expanded functions in hardware, such as a nonvolatile memory EEPROM for storing endoscope information, keys for customizing functions on a handle, and the like, in addition to an image sensor. The information of all hardware on the endoscope is interacted with the image processing host computer through a signal line. The signal line interface is defined as shown in fig. 2.

However, the above-described scheme has the following problems: the definition of the interactive interface causes that the endoscope and the image processing host have to correspond one to one and cannot be compatible. The number of interface signal lines is large, signals are easy to interfere, and EMC performance of the system is reduced. The resolution of the existing electronic endoscope is low.

Disclosure of Invention

In order to solve the above problems, the present invention provides an electronic endoscope, an electronic endoscope video transmission system and a method thereof, which improve the reliability of long-distance transmission between the electronic endoscope and the image processing host, simplify the interface, and improve the compatibility between the electronic endoscope and the image processing host.

In order to achieve the purpose, the invention adopts the following technical scheme:

in a first aspect, the present invention provides an electronic endoscope comprising: a lens end and a handle end; the lens end is connected with the handle end through an IIC bus, and the handle end is connected with an external terminal through a CAN bus;

the lens end comprises an image sensor and a serial unit, wherein the image sensor is used for collecting video data and transmitting the video data to the serial unit;

the handle end comprises an IIC buffer, a CAN transceiver and a light emitter, the IIC buffer is in communication connection with the lens end and used for converting a single-ended IIC signal and a differential CAN signal, the CAN transceiver is in communication with an external terminal, and the light emitter receives video data sent by the serial unit, converts an electric signal of the video data into an optical signal and transmits the optical signal to the external terminal.

As an alternative implementation mode, the physical layer of the video output interface of the CMOS image sensor is DPHY1.2, and transmission is carried out through a CSI-2 protocol.

In an alternative embodiment, the serial unit is connected with the handle end through a differential impedance twisted pair, and the handle end is internally connected with an external terminal through a single-mode optical fiber to transmit optical signals.

As an alternative embodiment, when the EN/MODE pin of the IIC buffer is at a high level, the operating MODE is a master MODE, and the slave device accesses to multiple IIC buses.

As an alternative embodiment, the serial unit strings 4-way video data into 1-way high-speed video data.

In a second aspect, the present invention provides an electronic endoscope video transmission system comprising: the electronic endoscope, the image processing end and the video receiving end of the first aspect; the handle end of the electronic endoscope is connected with the image processing end through a CAN bus; the image processing end comprises an optical receiver, a deserializing unit and a processor, wherein the optical receiver receives an optical signal and converts the optical signal into an electric signal, and the deserializing unit deserializes the electric signal and transmits the electric signal to the video receiving end.

As an alternative embodiment, the image processing terminal comprises a CAN transceiver and an IIC buffer, and after receiving the CAN signal sent by the handle terminal, the CAN transceiver converts the CAN signal into a single-ended IIC signal through the IIC buffer and then is connected with the processor.

In an alternative embodiment, the image processing terminal further comprises an IIC isolator, and the converted single-ended IIC signal is electrically isolated by the IIC isolator and then connected with the processor.

As an alternative embodiment, the EN/MODE pin of the IIC buffer is suspended at the image processing end and set to the slave MODE.

In a third aspect, the present invention provides an electronic endoscope video transmission method, including:

the image sensor collects video data, transmits the video data to the serial unit, and sends the video data to the light emitter through the serial unit;

the optical transmitter converts the electrical signal of the video data into an optical signal and transmits the optical signal to the image processing end;

after the image processing end receives the optical signal and converts the optical signal into an electric signal, the electric signal is deserialized, and the deserialized video data is transmitted to a video receiving end.

Compared with the prior art, the invention has the beneficial effects that:

the invention provides an electronic endoscope, an electronic endoscope video transmission system and a method, the resolution of the electronic endoscope reaches 4K, the resolution of the electronic endoscope is improved, single-ended IIC signals are converted into differential CAN signals for communication, EMI is reduced, common mode interference signals on a bus are inhibited, EMC requirements CAN be better met, the reliability of long-distance transmission between the electronic endoscope and an image processing host computer end is improved, an interface is simplified, and the compatibility of the electronic endoscope and the image processing host computer is improved.

Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the invention and together with the description serve to explain the invention and not to limit the invention.

FIG. 1 is a schematic diagram of a conventional endoscopic imaging system;

FIG. 2 is a schematic diagram of a conventional endoscope and image processing host interface

Fig. 3 is a block diagram of an electronic endoscope provided in embodiment 1 of the present invention;

FIG. 4 is a block diagram of the main mode of the IIC buffer provided in embodiment 1 of the present invention;

fig. 5 is a schematic diagram of an image processing end provided in embodiment 2 of the present invention;

FIG. 6 is a block diagram of the slave mode of the IIC buffer provided in embodiment 2 of the present invention.

Detailed Description

The invention is further described with reference to the following figures and examples.

It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the invention. As used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and it should be understood that the terms "comprises" and "comprising", and any variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiments and features of the embodiments of the invention may be combined with each other without conflict.

Example 1

As shown in fig. 3, the present embodiment provides an electronic endoscope including: a lens end and a handle end; the lens end is connected with the handle end through an IIC bus, and the handle end is connected with an external terminal through a CAN bus;

the handle end comprises an IIC buffer, a CAN transceiver and a light emitter, the IIC buffer is in communication connection with the lens end and used for conversion between a single-ended IIC signal and a differential CAN signal, the CAN transceiver is in communication with an external terminal, and the light emitter receives video data sent by the serial unit, converts an electric signal of the video data into an optical signal and transmits the optical signal to the external terminal.

In this embodiment, the image sensor is a CMOS image sensor, the optical format of the image sensor is 1/2.49", the total number of 8.77M pixels (4024 × 2180), and the CFA is a 4-pixel bayer format, and can be switched between high illumination, high resolution, low illumination, and large pixels.

The packaging size of the CMOS image sensor is 7.074mm 4.621mm, the diagonal size is 8.400mm, the diameter of the circuit board is 9.2mm, and the requirement that the diameter of the front end of the electronic endoscope is not more than 10mm can be met.

The physical layer of a video output interface of the CMOS image sensor is DPHY1.2, 4 paths of data lane are required for transmission through a CSI-2 protocol, and the total bandwidth is 10Gbps.

In this embodiment, the serial unit is of a model number SL85019, and uses 4 channels of video data as 1 channel of high-speed video data in series, and the farthest transmission distance is 1m.

SL85019 is BGA encapsulation, and the size is 5mm × 5mm, and serial circuit board width is 9mm, and image sensor circuit board and serial circuit board satisfy the requirement that electronic endoscope front end diameter is not more than 10mm through the welding equipment.

In this embodiment, the serial unit is connected to the handle end through a differential impedance twisted pair, and the high-speed video data output by the serial unit is transmitted to the handle end through the differential impedance twisted pair;

in an alternative embodiment, the differential impedance twisted pair is 100 Ω.

In the present embodiment, inside the handle end, a high-speed video data electrical signal is converted into an optical signal by a light Transmitter Optical Subassembly (TOSA), and transmitted to an external terminal, such as an image processing end, through a single-mode optical fiber.

The stable transmission distance of the optical signal output by the optical transmitter is more than 100m, so that the requirement on the distance between the electronic endoscope and an external terminal is met; meanwhile, the optical signal can not be coupled with the interference noise in the environment, and the EMC requirement can be better met.

In this embodiment, the CMOS image sensor, the serial unit and the light emitter at the lens end of the electronic endoscope all need to be configured with internal registers to ensure that they operate in a certain state.

In this embodiment, the handle end further includes a storage module for storing factory information of the electronic endoscope and specific data during the operation;

as an alternative embodiment, the storage module adopts AT24C02 which is 256kbit EEPROM; the external terminal reads and writes the designated address of the internal memory unit of the AT24C02 through the IIC bus.

The handle end also comprises keys with specific functions, such as photographing, brightness adjustment and the like; the working state of the electronic endoscope can be determined by detecting the state of the key.

In this embodiment, the lens end and the handle end communicate with each other through an IIC bus, and the handle end and the external terminal communicate with each other through a CAN bus, so as to monitor the initialization configuration and the operating state of the electronic endoscope by the external terminal.

The IIC bus comprises a clock and data and is a single-ended signal, radiation can be formed in the long-distance transmission process, electromagnetic noise in the environment is easily coupled, and stability of data transmission is affected. Therefore, the single-ended IIC signal is converted into the differential CAN signal through the IIC buffer and the CAN transceiver, the EMI CAN be reduced in CAN bus transmission, common-mode interference signals on the bus CAN be restrained, the EMC requirement CAN be better met, and the reliability of the transmission process is improved.

As an alternative embodiment, as shown in fig. 4, the IIC buffer uses an LT3960 chip of ADI, LT3960 is a high-speed transceiver, and transmits an IIC signal of a single main mode in a harsh environment through a CAN physical layer, and the maximum supported IIC rate is 400kbps; the EN/MODE pin of the far end LT3960 is connected with high level and is set as a master MODE, and the EN/MODE pin can be connected with a plurality of slave devices of IIC buses.

Example 2

The present embodiment provides an electronic endoscope video transmission system, including: the electronic endoscope, the image processing end and the video receiving end of embodiment 1; the handle end of the electronic endoscope is connected with the image processing end through a CAN bus; the image processing end comprises an optical receiver, a deserializing unit and a processor, wherein the optical receiver receives an optical signal and converts the optical signal into an electric signal, and the deserializing unit deserializes the electric signal and transmits the electric signal to the video receiving end.

As shown in fig. 5, an optical receiver (ROSA module) receives an optical signal transmitted by an optical fiber and converts the optical signal into a high-speed serial electrical signal; the electric signal is deserialized into an MIPI signal by a deserializing unit (SL 85019), and the MIPI signal is electrically isolated by a high-speed digital isolation module so as to meet the requirement that the application part of the electronic endoscope is of a BF or CF type;

the isolated electric signals are input into the processor through the PHY interface, are converted into an HDMI or SDI format through the FPGA internal image processing, and are transmitted to the video receiving end.

In this embodiment, the image processing end also includes a CAN transceiver, an IIC buffer, and an IIC isolator, and after receiving the CAN signal sent by the handle end, the CAN transceiver converts the CAN signal into a single-ended IIC signal through the IIC buffer, and is electrically isolated by the IIC isolator and then connected to the processor, thereby implementing IIC bus communication. As shown in FIG. 6, the EN/MODE pin of the IIC buffer (LT 3960) is floating and set to slave MODE.

Example 3

The embodiment provides an electronic endoscope video transmission method, which comprises the following steps:

after the image processing end receives the optical signal and converts the optical signal into the electric signal, the electric signal is deserialized, and the deserialized video data is transmitted to the video receiving end.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, it is not intended to limit the scope of the invention, and it should be understood by those skilled in the art that various modifications and variations can be made without inventive changes in the technical solutions of the present invention.

Claims

1. An electronic endoscope, comprising: a lens end and a handle end; the lens end is connected with the handle end through an IIC bus, and the handle end is connected with an external terminal through a CAN bus;

2. The electronic endoscope of claim 1, wherein the video output interface physical layer of the CMOS image sensor is DPHY1.2, transmitted over the CSI-2 protocol.

3. The electronic endoscope of claim 1, wherein said serial unit is connected to the handle end by a differential impedance twisted pair, and the interior of the handle end is connected to an external terminal by a single mode optical fiber for transmitting optical signals.

4. The electronic endoscope of claim 1, wherein when the EN/MODE pin of the IIC buffer is high, the operation MODE is a master MODE, and the slave device accesses a plurality of IIC buses.

5. The electronic endoscope of claim 1 wherein said serial unit serializes 4 lanes of video data into 1 lane of high speed video data.

6. An electronic endoscopic video transmission system, comprising: the electronic endoscope, image processing end, and video receiving end of any one of claims 1-5; the handle end of the electronic endoscope is connected with the image processing end through a CAN bus; the image processing end comprises an optical receiver, a deserializing unit and a processor, wherein the optical receiver receives an optical signal and converts the optical signal into a rear electric signal, and the deserializing unit deserializes the electric signal and transmits the electric signal to the video receiving end.

7. The electronic endoscope video transmission system of claim 6 wherein said image processing terminal comprises a CAN transceiver and an IIC buffer, wherein the CAN transceiver receives CAN signals transmitted from the handle terminal, and the CAN transceiver converts the CAN signals to single-ended IIC signals via the IIC buffer and connects to the processor.

8. The electronic endoscopic video transmission system of claim 7 wherein said image processing side further comprises an IIC isolator, wherein said converted single ended IIC signal is electrically isolated by said IIC isolator and coupled to said processor.

9. The electronic endoscope video transmission system according to claim 7, wherein an EN/MODE pin of the IIC buffer is suspended and set to a slave MODE at the image processing side.

10. An electronic endoscope video transmission method, comprising: