CN115967784A

CN115967784A - Image transmission processing system and method based on MIPI CSI-PHY protocol

Info

Publication number: CN115967784A
Application number: CN202111194035.XA
Authority: CN
Inventors: 刘弘
Original assignee: BYD Co Ltd; BYD Precision Manufacturing Co Ltd
Current assignee: BYD Co Ltd; BYD Precision Manufacturing Co Ltd
Priority date: 2021-10-13
Filing date: 2021-10-13
Publication date: 2023-04-14

Abstract

The application discloses an image transmission processing system and a processing method based on MIPI CSI-PHY protocol, which comprises the following steps: the device comprises N low-pixel cameras connected through communication interfaces, and first receiving equipment connected with the N low-pixel cameras through the same group of CSI interfaces, wherein N is 2 or 3. The method comprises the steps of utilizing a C-PHY protocol which is higher in transmission rate and not restricted by an independent synchronous clock to redistribute MIPI CSI interface channels, adopting a mode that a plurality of low-pixel cameras share a group of MIPI CSI interfaces, simultaneously matching with updating of a first receiving equipment framework, conducting processing such as segmentation on image data collected by the low-pixel cameras in the first receiving equipment, achieving sharing of channels for signal transmission of the low-pixel cameras, and improving channel utilization rate. Meanwhile, a plurality of groups of MIPI CSI interfaces are connected to one high-pixel camera, so that the high-frame-rate image acquisition function of the high-pixel camera is realized.

Description

Image transmission processing system and method based on MIPI CSI-PHY protocol

Technical Field

The present disclosure relates generally to the field of communications technologies, and in particular, to an image transmission processing system and processing method based on an MIPI CSI C-PHY protocol.

Background

With the increasing demand of society for consumer electronics products such as mobile phones and the like and the increasing capability of manufacturers, the functions of mobile phone cameras are more and more powerful. The main parameters of the camera include aperture, angle of view, zoom, pixels, resolution, etc. Among them, the number of pixels is the largest bright point which is mainly made by each large manufacturer. According to the current market situation, a single camera reaches more than 1 hundred million pixels at most. The improvement of the image acquisition capability undoubtedly brings challenges to the transmission of image data.

A Mobile Industry Processor Interface (MIPI) is an open standard and specification established by the MIPI alliance for a Mobile application Processor, and is used for standardizing an Interface inside a Mobile device into a standard internal Interface. The standard internal Interface includes a Camera Serial Interface (CSI). The MIPI CSI is a generic transport interface for mobile consumer electronics cameras. In protocols published at present in MIPI, 2 types of camera-based physical layer protocols are commonly used, one is a D-PHY protocol which has been the most popular one, and the other is a C-PHY protocol, and on the premise that the requirement on the data transmission rate is higher and higher at present, the C-PHY with higher transmission rate is gradually the first choice. However, even with the updating capability of the C-PHY transmission speed, the increase speed of the camera pixels cannot be kept up to, and the latest version of the C-PHY standard still cannot enable the camera with 1 hundred million pixels to achieve image acquisition at the conventional frame rate.

Disclosure of Invention

In view of the above-mentioned drawbacks and deficiencies of the prior art, it is desirable to provide an image transmission processing system and method based on the MIPI CSI C-PHY protocol.

In a first aspect, an image transmission processing system based on an MIPI CSI C-PHY protocol is provided, including: the system comprises N low-pixel cameras and a first receiving device; the N low-pixel cameras are connected with a first receiving device through the same group of MIPI CSI interfaces with the C-PHY protocol; n is 2 or 3.

Further, the system further comprises: at least one high pixel camera and a second receiving device; and one high-pixel camera is connected with the second receiving equipment by at least adopting two groups of MIPI CSI interfaces with C-PHY protocols.

In a second aspect, an image transmission processing method based on an MIPI CSI C-PHY protocol is provided, which includes:

acquiring image data acquired by N low-pixel cameras, wherein N is 2 or 3;

transmitting image data acquired by the N low-pixel cameras to first receiving equipment by using the same group of MIPI CSI interfaces with a C-PHY protocol;

the first receiving equipment processes the image data collected by the N low-pixel cameras and transmits the image data to the upper layer to form an image.

Further, the method also comprises the following steps:

acquiring image data acquired by each high-pixel camera;

transmitting the image data collected by each high-pixel camera to second receiving equipment by utilizing at least two groups of MIPI CSI interfaces with C-PHY protocols;

and the second receiving equipment processes the image data transmitted by at least two groups of MIPI CSI interfaces with the C-PHY protocol and transmits the image data to the upper layer to form an image.

In a third aspect, a mobile terminal device is provided, which includes:

one or more processors;

a memory for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the MIPI CSI C-PHY protocol based image transmission processing method described above.

In a fourth aspect, a computer-readable storage medium storing a computer program for executing the above-described MIPI CSI C-PHY protocol-based image transmission processing method by a processor is provided.

The technical scheme provided by the embodiment of the application can have the following beneficial effects:

based on the condition that MIPI channel resources which can be provided by current receiving equipment (CPU) are limited, in some embodiments of the application, a C-PHY protocol which is higher in transmission rate and not constrained by an independent synchronous clock is used for redistributing MIPI CSI interface channels, a mode that a plurality of low-pixel cameras share a group of MIPI CSI interfaces with the C-PHY protocol is adopted, meanwhile, updating of a CPU chip framework is matched, image data collected by the low-pixel cameras in the CPU chip are divided, and the like, channel sharing of signal transmission of the low-pixel cameras can be achieved, and the utilization rate of overall transmission of the channels is improved.

Further, based on the technical problem that the transmission capacity of 1 set of MIPI interfaces of the existing high-pixel camera is not enough, according to some embodiments of the present application, multiple sets of MIPI CSI interfaces with C-PHY protocols are connected to one high-pixel camera, and the CPU chip architecture is updated, so that image data collected by the high-pixel camera is mashup in the CPU chip, and the arrangement of images and other processing for protecting data stability are performed, so that the high-frame-rate image collection function of the high-pixel camera is realized, and the camera effect of products such as mobile phones is improved.

Drawings

Other features, objects and advantages of the present application will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:

fig. 1 is a diagram illustrating an architecture of transmission processing of images collected by a camera of a conventional mobile phone or other products;

fig. 2 is a diagram of an image transmission processing system in which three low-pixel cameras share a set of MIPI CSI interfaces with a C-PHY protocol according to an embodiment of the present application;

fig. 3 is a diagram of an image transmission processing system in which a high-pixel camera shares two sets of MIPI CSI interfaces with C-PHY protocol according to an embodiment of the present application;

fig. 4 is an exemplary flowchart of an image transmission method in which a plurality of low-pixel cameras based on an MIPI CSI C-PHY protocol share a set of MIPI CSI interfaces according to an embodiment of the present application;

fig. 5 is an exemplary flowchart of an image transmission processing method provided in an embodiment of the present application, where a high-pixel camera based on an MIPI CSI C-PHY protocol shares multiple groups of MIPI CSI interfaces;

fig. 6 is an image data stream of a high-pixel camera sharing two sets of MIPI CSI interfaces according to an embodiment of the present application;

fig. 7 is a flowchart of an application layer process for re-stitching images in which a high-pixel camera shares two sets of MIPI CSI interfaces according to an embodiment of the present application;

fig. 8 (a) is a transmission processing architecture diagram of an image acquired by a conventional camera; fig. 8 (b) is a diagram of an image transmission system based on the MIPI CSI C-PHY protocol according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of a mobile terminal device according to an embodiment of the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It should be noted that, for convenience of description, only the portions related to the present invention are shown in the drawings.

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.

Fig. 1 shows a structure for transmitting and processing a captured image of a camera of a mobile phone or the like. Because current designs are such that a set of MIPI interfaces can only transmit the collected data of one camera, some functional low-pixel cameras (depth TOF, depth of field, macro cameras, etc.) may only utilize one or a partial pair of their MIPI interface data lines, or only utilize a fraction of the data line channel transmission capacity or even lower. The specific calculation is as follows:

assuming that the number of pixels of the macro camera used is 200W, the amount of data transmitted in Raw10 RGB format at 30Hz is:

2*10 ⁶ Pixels×30Hz×10bit＝6*10 ⁸ bps (1)

the transmission capability of the current D-PHY 1.0 with the lowest rate is 4Gbps, then the channel utilization rate is:

6*10 ⁸ /4*10 ⁹ ＝15％ (2)

therefore, in the prior art, a group of MIPI interfaces only transmit the collected data of one low-pixel camera, and the utilization rate of the channel is very low.

In order to solve the problem, the present application provides an image transmission processing system based on the MIPI CSI-C-PHY protocol, which uses a group of MIPI CSI interfaces with the C-PHY protocol shared by a plurality of low-pixel cameras, and specifically includes: the system comprises N low-pixel cameras and a first receiving device; the N low-pixel cameras are connected with a first receiving device through the same group of MIPI CSI interfaces with a C-PHY protocol; n is 2 or 3.

Specifically, a hardware architecture of a plurality of low-pixel cameras (the number of the low-pixel cameras is not more than the maximum MIPI support data pair number) is modified to a certain extent, communication interfaces such as I2C or 1 single Bus (Wire Bus) with a smaller number of lines are added among the low-pixel cameras for connection, and the low-pixel cameras are connected with first receiving equipment through the same group of MIPI CSI interfaces with the C-PHY protocol. The C-PHY is a physical layer protocol of MIPI used for reality and cameras, and the interpretation is used for a display and camera signal transmission channel with limited bandwidth.

Specifically, a first camera sensor and a first encoder are arranged in each low-pixel camera; the first receiving apparatus includes a first LP receiver, a first HS receiver, a splitter, N first decoders, and a first image processing unit;

each first camera sensor is used for collecting camera parameters of the first camera sensor and transmitting the collected camera parameters to one low-pixel camera; the first encoder of the low-pixel camera is used for encoding camera parameters acquired by the N first camera sensors and transmitting the encoded camera parameters to a first LP receiver in first receiving equipment in an LP mode in an image data transmission gap;

each first camera sensor is used for collecting image data in an HS mode and transmitting the collected image data to a first HS receiver through the same group of MIPI CSI interfaces with a C-PHY protocol;

the divider is used for carrying out grouping division on the image data received by the first HS receiver according to the coded camera parameters received by the first LP receiver to obtain N groups of image data;

each first decoder is used for decoding each group of image data and transmitting the decoded image data to a first image processing unit;

the first image processing unit is used for processing the decoded image data and transmitting the processed image data to the upper layer to form an image.

As shown in fig. 2, three low pixel cameras, cameras 1, 2, 3, respectively, are used; the cameras 2 and 3 transmit the acquired camera parameters (such as working state, pixels, acquisition frequency and the like) to the camera 1 connected with the MIPI Pair 0 in real time. In this combination, the camera 1 serves as a temporary host, arranges and encodes camera parameters of the three cameras, and transmits the encoded camera parameter information to a first LP receiver (low power consumption receiver) in a first receiving device (CPU) through Lane0 Data0 at an image Data transmission gap by MIPI LP Mode (low power consumption Mode). Lane is a signal group, is a complete MIPI transmission interface and comprises a plurality of signal lanes (wherein D-PHY is 1Lane clock at most and 4Lane data, and C-PHY is 3Lane data). Lane is a signal group, representing either a differential signal pair (D-PHY) or a three-phase signal group (C-PHY).

When the image is transmitted (MIPI HS Mode, high-speed Mode), the image Data collected by the three cameras are transmitted to a first HS receiver in the CPU according to respective MIPI Data Lane with well distributed Data volume; for example, the image data acquired by the camera 1 is transmitted to the first HS receiver through the CSI0 Lane0, the image data acquired by the camera 2 is transmitted to the first HS receiver through the CSI0 Lane1, and the image data acquired by the camera 3 is transmitted to the first HS receiver through the CSI0 Lane 2. A Splitter in the CPU performs packet splitting (Splitter) on image data received by a first HS receiver according to coded camera parameters received by a first LP receiver, and performs operations such as clock recovery and data equalization processing in sequence to obtain three groups of image data related to clock and data, then transmits the three groups of image data to respective independent first decoders for decryption, decoding, deserialization and serial-to-parallel conversion, and performs conventional processing such as demapping through a 7-bit to 16-bit binary demapper, then transmits the processed image data to a first image processing unit (GPU) for processing, and the GPU transmits the processed image data to an upper layer to form an image. Specifically, the upper layer may be a display or a memory.

By utilizing the technical scheme, the utilization rate of the MIPI interface can be effectively improved. For example, 1300 ten thousand pixels of super wide-angle lens, 200 ten thousand depth-of-field lens and 200 ten thousand telephoto lens which are mainstream at present are respectively used for transmitting the acquired images by utilizing Lane0, lane1 and Lane2 of MIPI CSI 0C-PHY, and the transmission amount can be estimated by previous calculation, so that the transmission amount still has great surplus.

On the other hand, in the prior art, some high-pixel cameras (rear main cameras and the like) may not have enough transmission capacity for 1 set of MIPI interfaces at all. Taking a main camera-1.08 hundred million pixels of the current flagship mobile phone product as an example, the data volume is calculated:

1.08*10 ⁸ Pixels×30Hz×10bit＝3.24*10 ¹⁰ bps (3)

the transmission capability of the C-PHY 1.2 with the highest speed at present is 20.13Gbps, then the channel utilization rate is:

3.24*10 ¹⁰ /2.13*10 ¹⁰ ≈147％ (4)

a group of MIPI interfaces are not enough at all, so that the current mobile phone carrying a 1 hundred million pixel camera only supports 10Hz image acquisition, and the camera shooting function is far from being realized.

Therefore, in order to solve the technical problem that the transmission amount of the high-pixel camera adopting 1 set of MIPI interfaces is insufficient, the image transmission processing system based on the MIPI CSI C-PHY protocol further includes:

at least one high pixel camera and a second receiving device; and one high-pixel camera is connected with the second receiving equipment by at least adopting two groups of MIPI CSI interfaces with C-PHY protocols.

Specifically, a second camera sensor and a second encoder are arranged in each high-pixel camera; the second receiving device includes a second LP receiver, a second HS receiver, a mashup, a second decoder, and a second image processing unit;

the second camera sensor is used for collecting camera parameters of the second camera sensor, the second encoder is used for encoding the camera parameters collected by the second camera sensor, and the encoded camera parameter information is respectively transmitted to the second LP receiver through two groups of MIPI CSI interfaces with C-PHY protocols in an LP mode;

the second camera sensor is used for collecting image data information and transmitting the collected image data information to a second HS receiver through two groups of MIPI CSI interfaces with C-PHY protocols in an HS mode;

the mashup device is used for mashup image data information transmitted by two groups of MIPI CSI interfaces with C-PHY protocols and received by the second HS receiver according to the coded camera parameter information received by the second LP receiver and transmitting the mashup image data information to a second decoder;

the second decoder is used for decoding the image data information of the mashup and transmitting the decoded image data information to the second image processing unit;

and the second image unit is used for processing the decoded image data information and transmitting the processed image data to an upper layer to form an image.

Specifically, as shown in fig. 3, two sets of MIPI CSI interfaces with a C-PHY protocol are connected to one high-pixel camera, and each set of MIPI CSI interfaces is responsible for the transmission of an image acquired by one half of the high-pixel camera. The real-time parameters of the LP Mode data are transmitted through the CSI0 Lane0 (or the CSI 1Lane 0 also transmits the same data at the same time) to a second LP receiver camera in a second receiving device (CPU).

In image transmission (MIPI HS Mode), 2-set MIPI CSI interfaces transmit the respectively responsible part of the Data to a second HS receiver in the CPU over a Data Pair. The second LP receiver of the CPU recognizes image data (frame number, resolution, etc.) based on the camera parameter information transmitted in the previous LP mode, while the second HS receiver performs operations such as rearranging, mashuping (merge), clock recovery, data equalization, etc. on 2 sets of MIPI CSI interface image data. And then, the image data after the mashup is transmitted to a second decoder for conventional processing such as decryption, decoding, deserializing, demapping and the like, the processed image data is transmitted to a second image processing unit (GPU), and the GPU is transmitted to an upper layer to form an image.

By the way that one high-pixel camera shares two groups of MIPICSI interfaces with the C-PHY protocol, the data amount is calculated by taking 1.08 hundred million pixels, 30Hz and Raw10 RGB cameras as examples:

1.08*10 ⁸ Pixels×30Hz×10bit＝3.24*10 ¹⁰ bps (5)

3.24*10 ¹⁰ /(2.13*10 ¹⁰ ×2)≈73％ (6)

calculating the highest collection frame number under the transmission quantity as:

2.13*10 ¹⁰ ×2/(1.08*10 ⁸ Pixels×10bit)≈39.4Hz (7)

this frame rate fully enables full resolution photographing and photography.

It should be noted that the image transmission processing system based on the MIPI CSI-C-PHY protocol provided in the embodiment of the present application substantially includes two technical solutions, that is, a plurality of low-pixel cameras share a set of image transmission processing architecture with a MIPI CSI interface of the C-PHY protocol, and a high-pixel camera shares a plurality of sets of image transmission processing architecture with a MIPI CSI interface of the C-PHY protocol; the two technical schemes can independently form a complete technical scheme by any technical scheme, namely, the image transmission processing system of the MIPI CSI-PHY protocol can only comprise an image transmission processing framework in which one high-pixel camera shares a plurality of groups of MIPI CSI interfaces with the C-PHY protocol. Certainly, the two technical solutions may also form a complete technical solution in a combined manner, and the combining order of the two technical solutions is not strictly limited, for example, in the image transmission processing system based on the MIPI CSI-C-PHY protocol of the present application, the image transmission processing system may include an image transmission processing architecture in which one high-pixel camera shares a plurality of sets of MIPI CSI interfaces with the C-PHY protocol, and then include an image transmission processing architecture in which a plurality of low-pixel cameras share a set of MIPI CSI interfaces with the C-PHY protocol.

Fig. 4 shows an image transmission processing method based on the MIPI CSI C-PHY protocol according to an embodiment of the present application, including:

s101: acquiring image data acquired by N low-pixel cameras, wherein N is 2 or 3;

s102: transmitting image data acquired by the N low-pixel cameras to first receiving equipment by using the same group of MIPI CSI interfaces with the C-PHY protocol;

s103: the first receiving equipment processes the image data collected by the N low-pixel cameras and transmits the image data to the upper layer to form an image.

Specifically, the settings inside the low-pixel camera and the first receiving device and the processing flow of the image data acquired by the camera are described in the above corresponding system structure, which is not described in detail herein.

Fig. 5 is an exemplary flowchart of another preferred implementation of the image transmission processing method based on the MIPI CSI C-PHY protocol according to an embodiment of the present application, and further includes:

s201: acquiring image data acquired by each high-pixel camera;

s202: transmitting the image data collected by each high-pixel camera to second receiving equipment by utilizing at least two groups of MIPI CSI interfaces with C-PHY protocols;

s203: and the second receiving equipment processes the image data transmitted by at least two groups of MIPI CSI interfaces with the C-PHY protocol and transmits the image data to the upper layer to form an image.

Specifically, step S203 specifically includes: respectively adding preset characteristic points before and after image data transmitted by each group of MIPI CSI interfaces with C-PHY protocols; and determining whether the image data is effectively aligned and spliced or not according to the repetition degree of preset characteristic points of the image data transmitted by each group of MIPI CSI interfaces with the C-PHY protocol at the spliced position. And when the repetition degree of the preset characteristic points of the image data transmitted by each group of MIPI CSI interfaces with the C-PHY protocol at the splicing position exceeds 95%, the effective alignment splicing is carried out.

As shown in fig. 6, an embodiment of the present application provides an image data stream for a high-pixel camera sharing two sets of MIPI CSI interfaces, including:

the high-pixel camera collects image data, after coding processing and data segmentation are carried out, the image data are transmitted through respective MIPI CSI interfaces, in order to guarantee the splicing and identifying effects of the images, the high-pixel camera does not simply transmit 1/2 of the image data through each channel in the application, but preset feature points (such as 16-column redundant Dummy pixel data) are added in front of and behind effective data, 16 columns of pixels located at the splicing positions of the images are 16 columns of effective data of the other half of the images to be spliced together, therefore, when the images are spliced, the splicing positions can be accurately found through identifying the repeated data of the opposite side and the images, and the data can be effectively aligned. In the splicing position, it is only required to ensure that 16 columns of Dummy pixel data of two images transmitted from two sets of MIPI CSI interfaces keep repeating by more than 95%, that is, the two images can be effectively aligned and spliced. And the Dummy data at the non-splicing position is used for spacing and clock alignment with the data of the non-current frame.

As shown in fig. 7, an embodiment of the present application provides an image data processing method for a high-pixel camera to share two sets of MIPI CSI interfaces, including:

the second decoder transmits the image data after mashup to the second decoder for conventional processing such as decryption, decoding, deserializing, demapping and the like, the obtained data processed by the two groups of MIPI CSI interfaces reaches the GPU, the GPU reads the data and then reads the feature points (such as reading Dummy data and using other feature code marks) to find an aligned splicing position, the data at the splicing position are different inevitably due to different transmission environments (characteristics of physical channels and the like), and the GPU compares and extracts the read feature point data to extract appropriate parameters for compensation of brightness, micro distortion and the like. For example, the software algorithm for the image is used for comparing and calculating the image data with the adjacent data, abnormal data (caused by misarrangement, transmission damage and the like) is screened out for modification and correction (for example, the image data is modified into data conforming to the change rule of the adjacent pixel data), and the abrupt feeling of the image is reduced, so that the synthesized image has no obvious splicing trace.

It should be noted that while the operations of the method of the present invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Rather, the steps depicted in the flowcharts may change order of execution. For example, in the image transmission processing method based on the MIPI CSI C-PHY protocol according to the present application, steps S201 to S203 may be performed first, and then steps S101 to S103 may be performed.

Fig. 8 (a) is a diagram illustrating an architecture of transmission processing of an image acquired by a conventional camera; fig. 8 (b) is an exemplary example of a structure diagram of an image transmission system based on the MIPI CSI C-PHY protocol provided in the present application. As can be seen from fig. 8, compared with the existing design, the image transmission system based on the MIPI CSI C-PHY protocol provided by the embodiment of the present application only uses 3 sets of MIPI CSI interfaces, and saves 1 set, which saves the resource amount of the CPU, and also makes a reservation for possibly further improving the function of the camera (adding a camera with other functions, or continuously adding pixels of the camera), and what is more important is that the present application improves the image capturing capability of the main camera, can provide images and videos with higher frame number, and provides a material basis for realizing high image quality functions (HDR, etc.). The HDR is a High-Dynamic Range image (HDR), which can provide more Dynamic Range and image details than a normal image, and a final HDR image is synthesized according to LDRs (Low-Dynamic Range images) with different exposure times and by using the LDR image with the best details corresponding to each exposure time, which can better reflect the visual effect in a real environment.

Fig. 9 shows a schematic structural diagram of a mobile terminal device provided according to an embodiment of the present application.

As shown in fig. 9, as another aspect, the present application also provides a mobile terminal device 300 including one or more Central Processing Units (CPUs) 301 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 302 or a program loaded from a storage section 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data necessary for the operation of the system 300 are also stored. The CPU 301, ROM 302, and RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.

The following components are connected to the I/O interface 305: an input portion 306 including a keyboard, a mouse, and the like; an output section 307 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 308 including a hard disk and the like; and a communication section 309 including a network interface card such as a LAN card, a modem, or the like. The communication section 309 performs communication processing via a network such as the internet. A drive 310 is also connected to the I/O interface 305 as needed. A removable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 310 as necessary, so that a computer program read out therefrom is mounted into the storage section 308 as necessary.

In particular, the processes described above with reference to fig. 4-5 may be implemented as computer software programs, according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program containing program code for performing a page generation method. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 309, and/or installed from the removable medium 311.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

As yet another aspect, the present application also provides a computer-readable storage medium, which may be the computer-readable storage medium included in the apparatus in the above embodiments; or it may be a separate computer readable storage medium not incorporated into the device. The computer readable storage medium stores one or more programs for use by one or more processors in performing the page generation methods described herein.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units or modules described in the embodiments of the present application may be implemented by software or hardware. The described units or modules may also be provided in a processor, for example, each of the described units may be a software program provided in a computer or a mobile intelligent device, or may be a separately configured hardware device. Wherein the designation of such a unit or module does not in some way constitute a limitation on the unit or module itself.

The foregoing description is only exemplary of the preferred embodiments of the application and is illustrative of the principles of the technology employed. It will be appreciated by a person skilled in the art that the scope of the invention according to the present application is not limited to the specific combination of the above-mentioned features, but also covers other embodiments where any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.

Claims

1. The image transmission processing system based on the MIPI CSI C-PHY protocol is characterized by comprising the following components: the system comprises N low-pixel cameras and a first receiving device; the N low-pixel cameras are connected with a first receiving device through the same group of MIPICSI interfaces with C-PHY protocols; n is 2 or 3.

2. The MIPI CSI C-PHY protocol-based image transmission processing system of claim 1, wherein a first camera sensor and a first encoder are disposed within each of the low pixel cameras; the first receiving apparatus includes a first LP receiver, a first HS receiver, a splitter, N first decoders, and a first image processing unit;

each first camera sensor is used for collecting camera parameters of the first camera sensor and transmitting the collected camera parameters to one low-pixel camera; the first encoder of the low-pixel camera is used for encoding camera parameters acquired by the N first camera sensors and transmitting the encoded camera parameters to a first LP receiver in first receiving equipment in an LP mode at an image data transmission gap;

3. An image transmission processing system based on MIPI CSI-PHY protocol according to any of claims 1-2, characterized by further comprising: at least one high pixel camera and a second receiving device; and one high-pixel camera is connected with the second receiving equipment by at least adopting two groups of MIPICSI interfaces with C-PHY protocols.

4. The MIPI CSI C-PHY protocol-based image transmission processing system of claim 3, wherein a second camera sensor and a second encoder are provided within each of the high-pixel cameras; the second receiving device includes a second LP receiver, a second HS receiver, a mashup, a second decoder, and a second image processing unit;

the second camera sensor is used for collecting camera parameters of the second camera sensor, the second encoder is used for encoding the camera parameters collected by the second camera sensor, and the encoded camera parameter information is respectively transmitted to a second LP receiver through at least two groups of MIPICSI interfaces with C-PHY protocols in an LP mode;

the second camera sensor is used for collecting image data information and transmitting the collected image data information to a second HS receiver through two groups of MIPICSI interfaces with C-PHY protocols under an HS mode;

the mashup device is used for mashup of the image data information transmitted by the MIPICSI interfaces with the C-PHY protocol and received by the second HS receiver according to the coded camera parameter information received by the second LP receiver and transmitting the mashup image data information to the second decoder;

5. The image transmission processing method based on the MIPI CSI C-PHY protocol is characterized by comprising the following steps of:

acquiring image data acquired by N low-pixel cameras, wherein N is 2 or 3;

6. The MIPI CSI C-PHY protocol-based image transmission processing method of claim 5, further comprising:

acquiring image data acquired by each high-pixel camera;

7. The MIPI CSI C-PHY-protocol-based image transmission processing method as claimed in claim 6, wherein the second receiving device processes at least two sets of image data transmitted by the MIPICSI interface with the C-PHY protocol and transmits the image data to the upper layer to form an image specifically comprises:

respectively adding preset characteristic points before and after image data transmitted by each group of MIPI CSI interfaces with C-PHY protocols;

and determining whether the image data is effectively aligned and spliced or not according to the repetition degree of preset characteristic points of the image data transmitted by each group of MIPI CSI interfaces with the C-PHY protocol at the spliced position.

8. The MIPI CSI-PHY-protocol-based image transmission processing method of claim 7, wherein when the repetition degree of the preset feature point of the image data transmitted by each group of MIPI CSI interfaces with the C-PHY protocol at the splicing position exceeds 95%, the image transmission processing method is effective alignment splicing.

9. A mobile terminal device, characterized in that the mobile terminal device comprises:

one or more processors;

a memory for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the MIPI CSI C-PHY protocol-based image transmission processing method of any one of claims 5-8.

10. A computer-readable storage medium storing a computer program, wherein the program, when executed by a processor, implements the MIPI CSI C-PHY protocol-based image transmission processing method according to any one of claims 5 to 8.