WO2020215182A1

WO2020215182A1 - Image data processing method, transmission method, transmission apparatus and data interface switching apparatus

Info

Publication number: WO2020215182A1
Application number: PCT/CN2019/083701
Authority: WO
Inventors: 吴泽亮; 黄帅凯; 谢骞
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2019-04-22
Filing date: 2019-04-22
Publication date: 2020-10-29
Also published as: CN111713097A

Abstract

An image data processing method, a transmission method, a transmission apparatus, and a data interface switching apparatus: first, acquiring an image data packet (S101); determining whether a data packet processing signal is acquired (S102); if a data packet processing signal is acquired, changing the original data format of the image data packet to a target data format according to the data packet processing signal (S103), thereby changing the format of the image data packet according to needs, and then selecting processing, parsing, and transmission modes according to the adjusted format.

Description

图像数据处理方法、传输方法、传输装置及数据接口转换装置Image data processing method, transmission method, transmission device and data interface conversion device

技术领域Technical field

本申请涉及数据处理、传输和转换技术领域，尤其涉及一种图像数据处理方法、一种数据接口转换装置、以及一种图像数据传输方法和图像数据传输装置。This application relates to the technical field of data processing, transmission and conversion, and in particular to an image data processing method, a data interface conversion device, and an image data transmission method and image data transmission device.

背景技术Background technique

随着半导体技术的发展，图像传感器技术发展速度日新月异，使得图像传感器所含像素数量的提升达到5M、8M乃至更大尺寸以提高图像质量。With the development of semiconductor technology, the speed of the development of image sensor technology is changing with each passing day, making the number of pixels contained in the image sensor increase to 5M, 8M and even larger sizes to improve image quality.

与此同时，各种图像数据处理和传输技术也得到了快速的发展，比如，摄像机串行接口(Camera Serial Interface,CSI)是由移动行业处理器接口(Mobile Industry Processor Interface,MIPI)联盟下Camera工作组指定的接口标准，面向图像传感器应用领域。MIPI协议CSI-2图像传感器(下文中统一简称为MIPI图像传感器)传出来的数据，可通过图像信号处理器(Image Signal Processing，ISP)进行处理，可以实现自动对焦、高动态范围、保存原始数据等功能。At the same time, various image data processing and transmission technologies have also been rapidly developed. For example, the camera serial interface (Camera Serial Interface, CSI) is developed by the Mobile Industry Processor Interface (MIPI) alliance under the Camera The interface standards specified by the working group are oriented towards image sensor applications. The data from the MIPI protocol CSI-2 image sensor (hereinafter referred to as MIPI image sensor) can be processed by the image signal processor (Image Signal Processing, ISP), which can realize auto focus, high dynamic range, and save the original data And other functions.

举例而言，比较典型的应用场景，图像数据从MIPI图像传感器传出来后，会依次经过DPHY(MIPI协议中的一项，表示源同步、高速、低功耗、适用于移动应用领域的物理层),CSI控制器，接口转换电路后再进入ISP中。For example, in a typical application scenario, after the image data is transmitted from the MIPI image sensor, it will pass through the DPHY (one of the MIPI protocol, indicating source synchronization, high speed, low power consumption, and physical layer suitable for mobile applications. ), CSI controller, interface conversion circuit before entering ISP.

其中，所述的接口转换电路可以用于解决CSI控制器的输出接口与ISP的输入接口不匹配的问题，需要有电路承担接口转换的角色。Wherein, the interface conversion circuit can be used to solve the problem that the output interface of the CSI controller does not match the input interface of the ISP, and a circuit is required to assume the role of interface conversion.

但是，在实际传输数据过程中，由于MIPI协议CSI-2接口图像传感器对接时，高速接口电路无法针对不同的应用场景将基于CSI-2协议的数据包以不同的方式解析、传输给后级，对数据的处理及解析方式不够灵活，进而影响了后级的数据处理和分析，而给用户及***总体性能带来非常大的不便。However, in the actual data transmission process, due to the MIPI protocol CSI-2 interface image sensor docking, the high-speed interface circuit cannot parse and transmit the data packets based on the CSI-2 protocol to the subsequent stage in different ways for different application scenarios. The data processing and analysis methods are not flexible enough, which affects the subsequent data processing and analysis, and brings great inconvenience to users and the overall performance of the system.

综上所述，不难理解，现有的图像数据处理和传输过程中，由于图像数据包的格式决定了其传输、解析和处理方式，而造成在后级对图像数据进行处理和解析时的不便，影响了工作性能且不利于数据的传输和纠错等过程。In summary, it is not difficult to understand that in the existing image data processing and transmission process, because the format of the image data packet determines its transmission, analysis and processing methods, it causes problems when processing and analyzing the image data in the subsequent stages. The inconvenience affects the work performance and is not conducive to the process of data transmission and error correction.

发明内容Summary of the invention

基于此，本申请提供了一种图像数据处理方法、传输方法、传输装置及数据接口转换装置，旨在解决现有的图像数据处理和传输过程中，由于图像数据包的格式决定了其传输、解析和处理方式，而造成在后级对图像数据进行处理和解析时的不便，影响了工作性能且不利于数据的传输和纠错等技术问题。Based on this, this application provides an image data processing method, a transmission method, a transmission device, and a data interface conversion device, aiming to solve the problem in the existing image data processing and transmission process because the format of the image data packet determines its transmission, Analysis and processing methods, causing inconvenience in processing and parsing image data at a later stage, affecting work performance and not conducive to technical issues such as data transmission and error correction.

第一方面，本申请提供了一种图像数据处理方法，包括：In the first aspect, this application provides an image data processing method, including:

获取图像数据包；Get image data package;

判断是否获取到数据包处理信号；Determine whether the data packet processing signal is obtained;

若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，以将所述图像数据包按所述目标数据格式所属的传输通道进行传输。If the data packet processing signal is obtained, the original data format of the image data packet is changed to the target data format according to the data packet processing signal, so as to transmit the image data packet according to the transmission channel to which the target data format belongs.

第二方面，本申请提供了一种数据接口转换装置，所述数据接口转换装置包括存储器和处理器；In a second aspect, this application provides a data interface conversion device, the data interface conversion device including a memory and a processor;

所述存储器用于存储计算机程序；The memory is used to store computer programs;

所述处理器，用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：The processor is configured to execute the computer program, and when executing the computer program, implement the following steps:

获取图像数据包；Get image data package;

第三方面，本申请提供了一种图像数据传输方法，包括：In the third aspect, this application provides an image data transmission method, including:

CSI控制器发送图像数据包；The CSI controller sends image data packets;

数据接口转换装置从所述CSI控制器获取图像数据包；The data interface conversion device obtains an image data packet from the CSI controller;

数据接口转换装置判断是否获取到数据包处理信号；The data interface conversion device judges whether a data packet processing signal is acquired;

若获取到数据包处理信号，数据接口转换装置根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式；If the data packet processing signal is obtained, the data interface conversion device changes the original data format of the image data packet to the target data format according to the data packet processing signal;

数据接口转换装置将所述图像数据包按所述目标数据格式所属的传输通道传输给图像数据处理装置。The data interface conversion device transmits the image data packet to the image data processing device according to the transmission channel to which the target data format belongs.

第四方面，本申请还提供了一种图像数据传输装置，包括CSI控制器、数据接口转换装置和图像数据处理装置；In a fourth aspect, this application also provides an image data transmission device, including a CSI controller, a data interface conversion device, and an image data processing device;

所述CSI控制器发送图像数据包；The CSI controller sends an image data packet;

所述数据接口转换装置包括存储器和处理器；The data interface conversion device includes a memory and a processor;

从所述CSI控制器获取图像数据包；Obtaining image data packets from the CSI controller;

若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式；If a data packet processing signal is obtained, changing the original data format of the image data packet to the target data format according to the data packet processing signal;

将所述图像数据包按所述目标数据格式所属的传输通道传输给所述图像数据处理装置。The image data packet is transmitted to the image data processing device according to the transmission channel to which the target data format belongs.

本申请实施例提供了一种，图像数据处理方法、传输方法、传输装置及数据接口转换装置，首先获取图像数据包，判断是否获取到数据包处理信号，若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，以将所述图像数据包按所述目标数据格式所属的传输通道进行传输，通过上述方式，本申请能够根据需要而改变图像数据包的格式，再根据调整后的格式选择处理、解析和传输方式，而不再受限于图像数据包的原格式，方便后级的解析和处理工作，提高工作效率、降低***能耗，也方便对数据进行可调整的传输和纠错等。The embodiment of the application provides an image data processing method, a transmission method, a transmission device, and a data interface conversion device. The image data packet is first acquired, and it is determined whether the data packet processing signal is acquired. If the data packet processing signal is acquired, according to all The data packet processing signal changes the original data format of the image data packet to the target data format, so as to transmit the image data packet according to the transmission channel to which the target data format belongs. Through the above method, the present application can be used as needed. Change the format of the image data packet, and then select the processing, analysis and transmission method according to the adjusted format, instead of being limited to the original format of the image data packet, which facilitates the subsequent analysis and processing work, improves work efficiency, and reduces system performance It also facilitates adjustable transmission and error correction of data.

应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本申请。It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the application.

附图说明Description of the drawings

为了更清楚地说明本申请实施例技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present application. Ordinary technicians can obtain other drawings based on these drawings without creative work.

图1是本申请一实施例提供的一种图像数据处理方法的流程示意图；FIG. 1 is a schematic flowchart of an image data processing method provided by an embodiment of the present application;

图2是本申请一实施例提供的多路选择器的工作流程示意图；FIG. 2 is a schematic diagram of the work flow of the multiplexer provided by an embodiment of the present application;

图3是本申请一实施例提供的CSI-2协议的长包结构示意图；3 is a schematic diagram of the long packet structure of the CSI-2 protocol provided by an embodiment of the present application;

图4是本申请一实施例提供的图像数据传输的***框图；Fig. 4 is a block diagram of a system for image data transmission provided by an embodiment of the present application;

图5是本申请一实施例提供的ISP输入接口的关键信号示意图；FIG. 5 is a schematic diagram of key signals of an ISP input interface provided by an embodiment of the present application;

图6是本申请一实施例提供的传输有效像素数据包时，ISP输入接口上data呈现的形式示意图；6 is a schematic diagram of the form of data presented on the ISP input interface when transmitting valid pixel data packets according to an embodiment of the present application;

图7是本申请一实施例提供的传输边带数据包时，ISP输入接口上data呈现的形式示意图；FIG. 7 is a schematic diagram showing the form of data on the ISP input interface when transmitting sideband data packets according to an embodiment of the present application;

图8是图2中确认选择目标输出信号的一具体实施例方法流程示意图；8 is a schematic flowchart of a specific embodiment method for confirming the selected target output signal in FIG. 2;

图9是图2中确认选择目标输出信号的另一具体实施例方法流程示意图；9 is a schematic flowchart of another specific embodiment method for confirming the selected target output signal in FIG. 2;

图10是图2中确认选择目标输出信号的又一具体实施例方法流程示意图；FIG. 10 is a schematic flowchart of another specific embodiment method for confirming the selected target output signal in FIG. 2; FIG.

图11是本申请一实施例提供的一种数据接口转换装置的功能模块框图；FIG. 11 is a block diagram of functional modules of a data interface conversion device provided by an embodiment of the present application;

图12是本申请一实施例提供的一种图像数据传输方法的流程示意图；FIG. 12 is a schematic flowchart of an image data transmission method provided by an embodiment of the present application;

图13是本申请一实施例提供的多路选择器的工作流程示意图；FIG. 13 is a schematic diagram of the work flow of a multiplexer provided by an embodiment of the present application;

图14是图13中数据接口转换装置确认选择目标输出信号的一具体实施例方法流程示意图；FIG. 14 is a schematic flowchart of a specific embodiment method of the data interface conversion device in FIG. 13 confirming the selected target output signal;

图15是图13中数据接口转换装置确认选择目标输出信号的另一具体实施例方法流程示意图；15 is a schematic flowchart of another specific embodiment method of the data interface conversion device in FIG. 13 confirming the selected target output signal;

图16是图13中数据接口转换装置确认选择目标输出信号的又一具体实施例方法流程示意图；16 is a schematic flowchart of another specific embodiment method of the data interface conversion device in FIG. 13 confirming the selected target output signal;

图17是本申请一实施例提供的一种图像数据传输装置的功能模块框图。FIG. 17 is a block diagram of functional modules of an image data transmission device provided by an embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

附图中所示的流程图仅是示例说明，不是必须包括所有的内容和操作/步骤，也不是必须按所描述的顺序执行。例如，有的操作/步骤还可以分解、组合或部分合并，因此实际执行的顺序有可能根据实际情况改变。The flowchart shown in the drawings is merely an illustration, and does not necessarily include all contents and operations/steps, nor does it have to be executed in the described order. For example, some operations/steps can also be decomposed, combined or partially combined, so the actual execution order may be changed according to actual conditions.

下面结合附图，对本申请的一些实施方式作详细说明。在不冲突的情况下，下述的实施例及实施例中的特征可以相互组合。Hereinafter, some embodiments of the application will be described in detail with reference to the drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

请参阅图1，图1是本申请一实施例提供的一种图像数据处理方法的流程示意图，所述图像数据处理方法可以应用在终端设备中，用于图像处理和传输等过程。其中终端设备包括手机、平板、笔记本电脑和无人机等。进一步而言，无人机可以为旋翼型无人机，例如四旋翼无人机、六旋翼无人机、八旋翼无人机，也可以是固定翼无人机，且该无人机上带有摄像设备。Please refer to FIG. 1. FIG. 1 is a schematic flowchart of an image data processing method according to an embodiment of the present application. The image data processing method can be applied to a terminal device for image processing and transmission. Among them, terminal equipment includes mobile phones, tablets, laptops and drones. Furthermore, the UAV can be a rotary-wing UAV, such as a quadrotor UAV, a hexarotor UAV, an eight-rotor UAV, or a fixed-wing UAV, and the UAV has Camera equipment.

如图1所示，本实施例图像数据处理方法可以包括但不限于步骤S101至步骤S103和S103’。As shown in Fig. 1, the image data processing method of this embodiment may include but is not limited to steps S101 to S103 and S103'.

S101，获取图像数据包。S101: Acquire an image data packet.

需要说明的是，本实施例的图像数据包对应的图片，可以为通过终端设备拍摄的原始图片，或用户在终端设备的图形库选择的一张或多张图片。It should be noted that the picture corresponding to the image data package in this embodiment may be an original picture taken by the terminal device, or one or more pictures selected by the user in the graphic library of the terminal device.

S102，判断是否获取到数据包处理信号。S102: Determine whether a data packet processing signal is acquired.

其中，本申请可以根据实际情况而判断是否需要产生数据包处理信号，该数据包处理信号可以为硬件电路信号、也可以为软件控制信号。Among them, the present application may determine whether a data packet processing signal needs to be generated according to actual conditions, and the data packet processing signal may be a hardware circuit signal or a software control signal.

S103，若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，以将所述图像数据包按所述目标数据格式所属的传输通道进行传输。S103: If a data packet processing signal is obtained, change the original data format of the image data packet to the target data format according to the data packet processing signal, so as to perform the image data packet according to the transmission channel to which the target data format belongs transmission.

对应地，S103’，若未获取到数据包处理信号，则可以不改变当前获取到的图像数据包的格式，并继续等待是否获取到数据包处理信号。Correspondingly, in S103', if the data packet processing signal is not acquired, the format of the currently acquired image data packet may not be changed, and the data packet processing signal may continue to be waited for.

值得详细说明的是，本申请的其中一实施例中，所述步骤S103中根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，可以包括至少两种情况：It is worth explaining in detail that in one of the embodiments of the present application, in step S103, the original data format of the image data packet is changed to the target data format according to the data packet processing signal, which may include at least two cases:

情况一，根据所述数据包处理信号将所述图像数据包从有效像素数据包的原数据格式改变到边带数据包的目标数据格式；Case 1: Changing the image data packet from the original data format of the effective pixel data packet to the target data format of the sideband data packet according to the data packet processing signal;

和/或情况二，根据所述数据包处理信号将所述图像数据包从边带数据包的原数据格式改变到有效像素数据包的目标数据格式。And/or case two, changing the image data packet from the original data format of the sideband data packet to the target data format of the effective pixel data packet according to the data packet processing signal.

需要举例说明的是，本申请图像数据包可以采用CSI-2协议传输，其图像数据包可以分长包(long packet)和短包(short packet)两种，本申请主要针对长包(long packet)解析和处理。比如，本申请所述CSI-2协议可以用1个长包来传输1行的数据，这1行的数据可以是图像1行的有效像素数据，也可以是1行边带数据(非像素数据)，边带数据可以是VOPB(Vertical Optical Black)数据和EMBED数据等。It needs to be illustrated that the image data packets of this application can be transmitted using the CSI-2 protocol. The image data packets of this application can be divided into two types: long packets and short packets. This application mainly focuses on long packets. ) Analysis and processing. For example, the CSI-2 protocol described in this application can use one long packet to transmit one line of data. The one line of data can be the effective pixel data of one line of the image or one line of sideband data (non-pixel data). ), the sideband data can be VOPB (Vertical Optical Black) data, EMBED data, etc.

值得一提的是，为了使本申请更容易被理解，本实施例仍以CSI-2协议传输图像数据包为例进行详细说明。It is worth mentioning that, in order to make this application easier to understand, this embodiment still uses the CSI-2 protocol to transmit image data packets as an example for detailed description.

在本申请中，CSI-2协议典型的长包结构如图3所示，由包头(PACKET HEADER)、包尾(PACKET FOOTER)和数据(PACKET DATA)这3部分构成。In this application, the typical long packet structure of the CSI-2 protocol is shown in Figure 3, which is composed of three parts: the packet header (PACKET HEADER), the packet tail (PACKET FOOTER) and the data (PACKET DATA).

其中，PACKET HEADER内存储重要的信息Data Type，Data Type表征该行数据的数据类型。即，传输不同颜色格式的有效像素数据、以及传输不同类型的边带数据(sideband)时，Data Type的值是不同的，以此来区分不同行的内容。Among them, the PACKET HEADER stores important information Data Type, which represents the data type of the row of data. That is, when transmitting effective pixel data of different color formats and transmitting different types of sideband data (sideband), the value of Data Type is different to distinguish the content of different rows.

其中，本申请PACKET DATA是由一个个字节(即B ₁,B ₂…B _n-1,B _n)依次排列组成。在传输不同Data Type的长包时，PACKET DATA内的组包方式有所区别，例如传输RAW8格式的有效像素数据和传输RAW10格式的有效像素数据时，每个像素数据与B ₁,B ₂…B _n-1,B _n的映射关系是有区别的。 Among them, the PACKET DATA of this application is composed of bytes (that is, B ₁ , B ₂ ... B _n-1 , B _n ) arranged in sequence. When transmitting long packets of different Data Types, the grouping methods in PACKET DATA are different. For example, when transmitting effective pixel data in RAW8 format and transmitting effective pixel data in RAW10 format, each pixel data is related to B ₁ , B ₂ … The mapping relationship between B _n-1 and B _n is different.

为便于理解，本实施例以传输RAW8格式为例进行阐述，但所描述的解析方式对RGB(每个像素的红/绿/蓝强度,以记录图像)、YUV(亮度-色度模型)以及其他RAW格式等其他颜色同样适用。其中，当传输RAW8格式时，长包PACKET DATA内每个字节依次代表一个像素(pixel)数据，即B ₁代表第1个像素P ₁，B ₂代表第1个像素P ₂…B _n代表第n个像素P _n。 For ease of understanding, this embodiment uses the transmission of the RAW8 format as an example for illustration, but the described analysis method uses RGB (red/green/blue intensity of each pixel to record images), YUV (luminance-chroma model), and Other colors such as other RAW formats are also applicable. Among them, when transmitting the RAW8 format, each byte in the long packet PACKET DATA sequentially represents a pixel (pixel) data, that is, B ₁ represents the first pixel P ₁ , and B ₂ represents the first pixel P ₂ … B _n represents The nth pixel P _n .

此外，对应地，本申请ISP应对不同Data Type的长包时的处理方式、ISP输入接口的格式、以及图像传感器输出的VOPB这种Data Type数据的数据特征这3部分内容工作原理说明如下。In addition, correspondingly, the working principles of the three parts of the ISP of this application when dealing with long packets of different Data Types, the format of the ISP input interface, and the data characteristics of the VOPB Data Type data output by the image sensor are explained as follows.

第一部分，本申请ISP应对不同Data Type的长包时处理方式，ISP可以将长包分为以下2大类：有效像素数据包和边带数据包，而边带数据包包括VOPB 数据包、EMBED数据包等。对这2大类的长包，ISP内部可以采用不同的处理方式，并采用不同的数据处理通路。The first part of this application is how the ISP deals with long packets of different Data Types. The ISP can divide long packets into the following two categories: effective pixel data packets and sideband data packets, while sideband data packets include VOPB data packets and EMBED Data packets, etc. For these two types of long packets, ISP can use different processing methods and use different data processing channels.

第二部分，对这2大类的长包，在ISP输入接口的格式也可以不同。比如，识别、解析MIPI图像传感器传输过来的长包属于哪一类长包、并且以对应的格式输出给ISP输入接口，可以采用图4所示中的接口转换电路实现。具体而言，本申请在ISP输入接口上，如图5所示，可以有4个关键的信号:dvld,type,data,dvpc。The second part, for these two types of long packets, the format of the ISP input interface can also be different. For example, to identify and analyze which type of long packet the long packet transmitted from the MIPI image sensor belongs to, and output it to the ISP input interface in the corresponding format, it can be implemented by using the interface conversion circuit shown in FIG. 4. Specifically, in this application, on the ISP input interface, as shown in FIG. 5, there may be 4 key signals: dvld, type, data, and dvpc.

具体而言，如图5所示，dvld信号的作用包括：在dvld为高电平的周期，表示此时ISP输入接口上的数据是有效的，ISP会通过type,data,dvpc这三个信号去获取数据。Specifically, as shown in Figure 5, the role of the dvld signal includes: in the period when dvld is high, it means that the data on the ISP input interface is valid at this time, and the ISP will pass the three signals type, data, and dvpc Go get the data.

type信号的作用包括：将PACKET HEADER内的Data Type这个信息传输给ISP。在传输2大类的长包时，dvld和type这2个信号所发挥的作用并无区别。The function of the type signal includes: transmitting the Data Type information in the PACKET HEADER to the ISP. When transmitting two types of long packets, there is no difference in the roles played by the two signals dvld and type.

但，与dvld和type信号不同，dvpc和data在传输2大类的长包时，所发挥的作用是存在区别的。However, unlike dvld and type signals, dvpc and data play different roles when transmitting two types of long packets.

其中，对于dvpc，当传输有效像素数据包时，dvpc表征当前data内包含的像素个数；而当传输边带数据包时，dvpc表征当前data内包含的字节个数。Among them, for dvpc, when transmitting an effective pixel data packet, dvpc represents the number of pixels contained in the current data; and when transmitting a sideband data packet, dvpc represents the number of bytes contained in the current data.

对于data(以64bit为例),当传输有效像素数据包时，以传输RAW8数据为例，data呈现的形式如图6所示，RAW8(m),RAW8(m+1),RAW8(m+2),RAW8(m+3)…分别是长包内的第m个像素值，第m+1个像素值，第m+2个像素值，第m+3个像素值……。而当传输边带数据包时，data呈现的形式如图7所示，B _m[7:0],B _m+1[7:0],B _m+2[7:0]…分别是长包内的第m个字节，第m+1个字节，第m+2个字节……。其中，B _m[7:0],B _m+1[7:0],B _m+2[7:0]…在原始、未经解析的长包内的排布顺序见图3。 For data (taking 64bit as an example), when transmitting valid pixel data packets, take the transmission of RAW8 data as an example. The form of data is shown in Figure 6, RAW8(m), RAW8(m+1), RAW8(m+ 2), RAW8(m+3)...respectively, the m-th pixel value, the m+1-th pixel value, the m+2th pixel value, the m+3th pixel value in the long packet... When the sideband data packet is transmitted, the form of data is shown in Figure 7. B _m [7:0], B _m+1 [7:0], B _m+2 [7:0]... are long respectively The mth byte, m+1th byte, m+2th byte in the packet... Among them, B _m [7:0], B _m+1 [7:0], B _m+2 [7:0]...The arrangement sequence in the original, unresolved long package is shown in Figure 3.

第三部分，MIPI图像传感器输出的VOPB数据包这种Data Type数据的数据特征时，MIPI图像传感器上可以预留一些完全没有曝光的像素，通过读取这些像素值的大小，可以实时得到optical black level的值，ISP可以利用这些值对图像数据进行校正。其中，本实施例完全没有曝光的像素值即为所述VOPB数据包。The third part, when the VOPB data packet output by the MIPI image sensor is the data feature of the Data Type data, some pixels that are not exposed at all can be reserved on the MIPI image sensor. By reading the size of these pixel values, the optical black can be obtained in real time. The value of level, ISP can use these values to correct the image data. Among them, the pixel value that is not exposed at all in this embodiment is the VOPB data packet.

需要说明的是，VOPB数据包属于边带数据包的一种，而VOPB数据包的Data Type与有效像素数据是不同的，但由于都是像素值，两者的PACKET DATA的组包方式又可以是相同的。It should be noted that the VOPB data packet is a type of sideband data packet, and the Data Type of the VOPB data packet is different from the effective pixel data, but since they are both pixel values, the PACKET DATA grouping method of the two can be used. Are the same.

如前所述，本实施例2大类的长包在ISP输入接口的格式是不同的，ISP内部对2大类的长包也会采用不同的处理方式，并采用不同的数据处理通路。VOPB数据包虽然属于边带数据包的一种，但由于VOPB数据包PACKET DATA的组包方式与有效像素数据包又是相同的，所以如果经过图4模式的接口转换电路后，VOPB数据包能够以与有效像素数据相同的格式呈现在ISP输入接口上，会方便后续ISP处理。As mentioned above, the format of the ISP input interface for the 2 types of long packets in this embodiment is different, and the ISP also uses different processing methods for the 2 types of long packets and uses different data processing paths. Although VOPB data packets belong to a type of sideband data packets, since the grouping method of VOPB data packets PACKET DATA is the same as the effective pixel data packets, if the interface conversion circuit in the mode of Figure 4 is passed, the VOPB data packets can Presented on the ISP input interface in the same format as the effective pixel data will facilitate subsequent ISP processing.

同理，本申请在传输有效像素数据的长包时，当ISP发现接收到的有效像素数据包的数据有误时，为了定位错误发生的环节，但由于可能发生在数据流中的任意一个环节，所以图1模式的接口转换电路需要将长包内的原始字节数据以与边带数据包相同的格式呈现在ISP输入接口上，在ISP内部走边带数据包的处理通路，将数据写到DDR(Double Data Rate)后进行分析和问题定位。In the same way, in this application, when transmitting a long packet of effective pixel data, when the ISP finds that the data of the received effective pixel data packet is incorrect, in order to locate the link where the error occurred, but because it may occur in any link in the data stream Therefore, the interface conversion circuit in the mode of Figure 1 needs to present the original byte data in the long packet on the ISP input interface in the same format as the sideband data packet, and take the processing path of the sideband data packet inside the ISP, and write the data to After DDR (Double Data Rate), analyze and locate the problem.

需要重点说明的是，本实施例针对需要将VOPB数据包以与有效像素数据相同的格式呈现在ISP输入接口上而方便后续ISP处理、以及需要将长包内的原始字节数据以与边带数据包相同的格式呈现在ISP输入接口上而进行数据错误的分析定位这两种特殊情况，所述步骤S103中根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，具体可以包括：采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。It is important to note that this embodiment is aimed at the need to present the VOPB data packet in the same format as the effective pixel data on the ISP input interface to facilitate subsequent ISP processing, and the need to combine the original byte data in the long packet with the sideband The same format of the data packet is presented on the ISP input interface for data error analysis and positioning. In step S103, the original data format of the image data packet is changed to the target data format according to the data packet processing signal. , It may specifically include: acquiring the data type information of the image data packet using a multiplexer, and acquiring the data packet processing signal, so as to change or maintain the image according to the data type information and the data packet processing signal The original data format of the packet.

进一步而言，如图2所示，本实施例所述采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，可以包括步骤S201至步骤S203。Furthermore, as shown in FIG. 2, the use of a multiplexer to obtain the data type information of the image data packet and obtain the data packet processing signal in this embodiment may include steps S201 to S203.

S201，采用多路选择器获取所述图像数据包的数据类型信息作为第一输入信号。S201: Use a multiplexer to obtain data type information of the image data packet as a first input signal.

S202，采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号。S202: Use a multiplexer to obtain the target type information in the data packet processing signal as a second input signal, and use a multiplexer to obtain the enable selection information in the data packet processing signal as a third input signal.

S203，根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号。S203: Confirm selection of the first input signal or the second input signal as a target output signal according to the third input signal.

相对应地，针对上述具体应用例CSI-2协议传输的特殊情况，如图8所示，本申请所述S203根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，包括步骤S2031和S2032：Correspondingly, for the special case of CSI-2 protocol transmission in the above specific application example, as shown in FIG. 8, the S203 of this application confirms the selection of the first input signal or the second input according to the third input signal. As the target output signal, the signal includes steps S2031 and S2032:

S2031，若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号为边带数据包类型，所述目标类型信息对应的第二输入信号为有效像素数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；S2031: If the image data packet is a VOPB data packet, the first input signal corresponding to the data type information is a sideband data packet type, and the second input signal corresponding to the target type information is a valid pixel data packet type, so The third input signal corresponding to the enable selection information is a high-level signal or a low-level signal;

S2032，根据所述第三输入信号的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。S2032: According to the high-level signal or the low-level signal of the third input signal, select the VOPB data packet as the first input signal as the target output signal, so that the data type information of the VOPB data packet is sideband The data packet type, or the VOPB data packet is selected as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type.

需要对应说明的是，所述将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后包括两种情况如下：It should be noted that the VOPB data packet is selected as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet type, or the VOPB data packet is The second input signal is selected as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type, and the following two situations are included as follows:

情况一，将边带数据包类型的所述VOPB数据包采用边带数据处理模块进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；Case 1: The VOPB data packet of the sideband data packet type is processed by a sideband data processing module to transmit the VOPB data packet according to the sideband data packet, wherein the dvpc signal in the VOPB data packet Characterized by the number of bytes contained in the data signal in the VOPB data packet;

或情况二，将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。Or case two, the VOPB data packet of the effective pixel data packet type is processed by an effective pixel data processing module, so that the VOPB data packet is transmitted according to the effective pixel data packet.

需要对应说明的是，所述S2032中将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，还包括：将所述第二输入信号对应的目标类型信息替换所述第一输入信号对应的数据类型信息；将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。It should be correspondingly explained that, in the S2032, selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type, and further includes: The target type information corresponding to the second input signal replaces the data type information corresponding to the first input signal; the replaced data type information is configured to the original frame position corresponding to the first input signal in the VOPB data packet, and The data type information after the replacement is configured into a valid pixel data packet format.

进一步而言，所述将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后包括：将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。Further, the data type information after the replacement is configured to the original frame position of the first input signal in the VOPB data packet, and the data type information after the replacement is configured as the effective pixel data packet. The format later includes: replacing the dvpc signal in the updated VOPB data packet with the number of pixels included in the data signal in the updated VOPB data packet.

如上所述，需要重点说明的是，本实施例针对需要将长包内的原始字节数据以与边带数据包相同的格式呈现在ISP输入接口上而进行数据错误的分析定位的特殊情况，如图9所示，所述步骤S203根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，对应包括步骤S2031’和S2032’。As mentioned above, it is important to note that this embodiment is aimed at the special case where the original byte data in the long packet needs to be presented on the ISP input interface in the same format as the sideband data packet for data error analysis and positioning. As shown in FIG. 9, the step S203 confirms the selection of the first input signal or the second input signal as the target output signal according to the third input signal, and correspondingly includes steps S2031' and S2032'.

S2031’，若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号为有效像素数据包类型，所述目标类型信息对应的第二输入信号为边带数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号。S2031', if the image data packet is a valid pixel data packet, the first input signal corresponding to the data type information is a valid pixel data packet type, and the second input signal corresponding to the target type information is a sideband data packet type , The third input signal corresponding to the enable selection information is a high-level signal or a low-level signal.

S2032’，根据所述第三输入信号的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型。S2032', according to the high-level signal or the low-level signal of the third input signal, select the effective pixel data packet as the first input signal as the target output signal, so that the data type information of the effective pixel data packet It is an effective pixel data packet type, or, the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type.

相应地，本实施例所述S2032’中将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后包括下述两种情况：Correspondingly, in S2032' of this embodiment, the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel data packet type, or The effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is a sideband data packet type, and then the following two cases are included:

情况一，将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；Case 1: The effective pixel data packet of the effective pixel data packet type is processed by an effective pixel data processing module, so as to transmit the effective pixel data packet according to the effective pixel data packet, wherein the effective pixel data packet is The dvpc signal is characterized by the number of pixels included in the data signal in the effective pixel data packet;

或情况二，将边带数据包类型的所述有效像素数据包采用边带数据处理模块进行处理，以将所述有效像素数据包按照边带数据包进行传输。Or case 2, the effective pixel data packet of the sideband data packet type is processed by a sideband data processing module, so that the effective pixel data packet is transmitted according to the sideband data packet.

进一步而言，所述S2032’中将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，还包括：将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。Further, in the S2032', the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, and further includes: The target type information corresponding to the second input signal is configured in the effective pixel data packet, and is configured in a sideband data packet format.

同理，相对应于CSI协议传输的情况，所述将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后包括相应的处理方式：将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。Similarly, corresponding to the situation of CSI protocol transmission, the target type information corresponding to the second input signal is configured into the effective pixel data packet, and configured into the format of the sideband data packet, and then includes the corresponding Processing method: updating the dvpc signal in the valid pixel data packet after the configuration update is characterized as the number of bytes of the data signal in the updated valid pixel data packet.

作为本申请的一个优选实施例，如图10所示，本申请所述S203中根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，还可以包括步骤S2031”至步骤S2033”：As a preferred embodiment of the present application, as shown in FIG. 10, the first input signal or the second input signal is selected as the target output signal according to the third input signal confirmation in S203 of the present application. Including step S2031" to step S2033":

S2031”，判断所述目标输出信号对应的数据包类型，其中，所述第一输入信号和第二输入信号所指示的数据包类型互不相同。S2031": Determine the data packet type corresponding to the target output signal, wherein the data packet types indicated by the first input signal and the second input signal are different from each other.

S2032”，若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输。S2032", if the data packet type corresponding to the target output signal is the effective pixel data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the effective pixel data packet transmission channel.

具体而言，本实施例所述若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输，包括：将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块进行处理，再通过有效像素数据包的传输通道进行传输。Specifically, in this embodiment, if the data packet type corresponding to the target output signal is the effective pixel data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the effective pixel data packet Channel transmission includes: sending image data packets of the effective pixel data packet type or sideband data packet type to the effective pixel data processing module for processing, and then transmitting through the effective pixel data packet transmission channel.

S2033”，若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。S2033": If the data packet type corresponding to the target output signal is a sideband data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the sideband data packet transmission channel.

具体而言，本实施例所述若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输，包括：将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块进行处理，再通过边带数据包的传输通道进行传输。Specifically, in this embodiment, if the data packet type corresponding to the target output signal is a sideband data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the sideband data packet Channel transmission includes: sending image data packets of the effective pixel data packet type or sideband data packet type to the sideband data processing module for processing, and then transmit through the sideband data packet transmission channel.

需要特别说明的是，本申请所述采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号，具体可以包括：通过寄存器组产生所述第二输入信号和所述第三输入信号。It should be particularly noted that, as described in this application, the multiplexer is used to obtain the target type information in the data packet processing signal as the second input signal, and the multiplexer is used to obtain the enable in the data packet processing signal. Selecting information as the third input signal may specifically include: generating the second input signal and the third input signal through a register set.

通过上述方式，本申请实施例能够根据需要而改变图像数据包的格式，再根据调整后的格式选择处理、解析和传输方式，而不再受限于图像数据包的原格式，方便后级的解析和处理工作，提高工作效率、降低***能耗，也方便对数据进行可调整的传输和纠错等。Through the above method, the embodiment of the present application can change the format of the image data packet as needed, and then select the processing, analysis, and transmission mode according to the adjusted format, and is no longer limited to the original format of the image data packet, which is convenient for subsequent stage Analyze and process work, improve work efficiency, reduce system energy consumption, and facilitate adjustable transmission and error correction of data.

请结合上述实施例参阅图11，本申请提供一种数据接口转换装置，所述数据接口转换装置可以包括存储器11和处理器12。Please refer to FIG. 11 in conjunction with the foregoing embodiments. The present application provides a data interface conversion device. The data interface conversion device may include a memory 11 and a processor 12.

在本实施例中，所述存储器11用于存储计算机程序，所述处理器12，用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：获取图像数据包；判断是否获取到数据包处理信号；若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，以将所述图像数据包按所述目标数据格式所属的传输通道进行传输。In this embodiment, the memory 11 is used to store a computer program, and the processor 12 is used to execute the computer program and, when executing the computer program, implement the following steps: obtain an image data packet; determine whether to obtain To the data packet processing signal; if the data packet processing signal is obtained, the original data format of the image data packet is changed to the target data format according to the data packet processing signal, so that the image data packet belongs to the target data format Transmission channel for transmission.

进一步而言，本实施例所述处理器12在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现：Furthermore, when the processor 12 in this embodiment realizes changing the original data format of the image data packet to the target data format according to the data packet processing signal, it is used to realize:

根据所述数据包处理信号将所述图像数据包从有效像素数据包的原数据格式改变到边带数据包的目标数据格式；Changing the image data packet from the original data format of the effective pixel data packet to the target data format of the sideband data packet according to the data packet processing signal;

和/或，根据所述数据包处理信号将所述图像数据包从边带数据包的原数据格式改变到有效像素数据包的目标数据格式。And/or, changing the image data packet from the original data format of the sideband data packet to the target data format of the effective pixel data packet according to the data packet processing signal.

需要举例说明的是，本申请图像数据包可以采用CSI-2协议传输，其图像数据包可以分长包和短包两种，本申请主要针对长包解析和处理。比如，本申请所述CSI-2协议可以用1个长包来传输1行的数据，这1行的数据可以是图像1行的有效像素数据，也可以是1行边带数据，边带数据可以是VOPB数据和EMBED数据等。It needs to be illustrated that the image data packets of this application can be transmitted using the CSI-2 protocol, and the image data packets of this application can be divided into long packets and short packets. This application mainly focuses on the analysis and processing of long packets. For example, the CSI-2 protocol described in this application can use one long packet to transmit one line of data. The one line of data can be the effective pixel data of one line of the image, or it can be one line of sideband data. It can be VOPB data, EMBED data, etc.

其中，PACKET HEADER内存储重要的信息Data Type，Data Type表征该行数据的数据类型。即，传输不同颜色格式的有效像素数据、以及传输不同类型的边带数据时，Data Type的值是不同的，以此来区分不同行的内容。Among them, the PACKET HEADER stores important information Data Type, which represents the data type of the row of data. That is, when transmitting effective pixel data of different color formats and transmitting different types of sideband data, the value of Data Type is different, so as to distinguish the content of different rows.

为便于理解，本实施例以传输RAW8格式为例进行阐述，但所描述的解析方式对RGB、YUV以及其他RAW格式等其他颜色同样适用。其中，当传输RAW8格式时，长包PACKET DATA内每个字节依次代表一个像素(pixel)数据，即B ₁代表第1个像素P ₁，B ₂代表第1个像素P ₂…B _n代表第n个像素P _n。 For ease of understanding, this embodiment takes the transmission of the RAW8 format as an example for illustration, but the described analysis method is also applicable to other colors such as RGB, YUV, and other RAW formats. Among them, when transmitting the RAW8 format, each byte in the long packet PACKET DATA sequentially represents a pixel (pixel) data, that is, B ₁ represents the first pixel P ₁ , and B ₂ represents the first pixel P ₂ … B _n represents The nth pixel P _n .

第一部分，本申请ISP应对不同Data Type的长包时处理方式，ISP可以将长包分为以下2大类：有效像素数据包和边带数据包，而边带数据包包括VOPB数据包、EMBED数据包等。对这2大类的长包，ISP内部可以采用不同的处理方式，并采用不同的数据处理通路。The first part of this application is how the ISP deals with long packets of different Data Types. The ISP can divide the long packets into the following two categories: effective pixel data packets and sideband data packets, while sideband data packets include VOPB data packets and EMBED Data packets, etc. For these two types of long packets, ISP can use different processing methods and use different data processing channels.

对于data(以64bit为例),当传输有效像素数据包时，以传输RAW8数据为例，data呈现的形式如图6所示，RAW8(m),RAW8(m+1),RAW8(m+2),RAW8(m+3)…分别是长包内的第m个像素值，第m+1个像素值，第m+2个像素值，第m+3个像素值……。而当传输边带数据包时，data呈现的形式如图7所示， B _m[7:0],B _m+1[7:0],B _m+2[7:0]…分别是长包内的第m个字节，第m+1个字节，第m+2个字节……。其中，B _m[7:0],B _m+1[7:0],B _m+2[7:0]…在原始、未经解析的长包内的排布顺序见图3。 For data (taking 64bit as an example), when transmitting valid pixel data packets, take the transmission of RAW8 data as an example. The form of data is shown in Figure 6, RAW8(m), RAW8(m+1), RAW8(m+ 2), RAW8(m+3)...respectively, the m-th pixel value, the m+1-th pixel value, the m+2th pixel value, the m+3th pixel value in the long packet... When the sideband data packet is transmitted, the form of data is shown in Figure 7. B _m [7:0], B _m+1 [7:0], B _m+2 [7:0]... are long respectively The mth byte, m+1th byte, m+2th byte in the packet... Among them, B _m [7:0], B _m+1 [7:0], B _m+2 [7:0]...The arrangement sequence in the original, unresolved long package is shown in Figure 3.

同理，本申请在传输有效像素数据的长包时，当ISP发现接收到的有效像素数据包的数据有误时，为了定位错误发生的环节，但由于可能发生在数据流中的任意一个环节，所以图1模式的接口转换电路需要将长包内的原始字节数据以与边带数据包相同的格式呈现在ISP输入接口上，在ISP内部走边带数据包的处理通路，将数据写到DDR后进行分析和问题定位。In the same way, in this application, when transmitting a long packet of effective pixel data, when the ISP finds that the data of the received effective pixel data packet is incorrect, in order to locate the link where the error occurred, but because it may occur in any link in the data stream Therefore, the interface conversion circuit in the mode of Figure 1 needs to present the original byte data in the long packet on the ISP input interface in the same format as the sideband data packet, and take the processing path of the sideband data packet inside the ISP, and write the data to Analyze and locate the problem after DDR.

需要重点说明的是，本实施例针对需要将VOPB数据包以与有效像素数据相同的格式呈现在ISP输入接口上而方便后续ISP处理、以及需要将长包内的原始字节数据以与边带数据包相同的格式呈现在ISP输入接口上而进行数据错误的分析定位这两种特殊情况，本实施例所述处理器12在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现：采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。It is important to note that this embodiment is aimed at the need to present the VOPB data packet in the same format as the effective pixel data on the ISP input interface to facilitate subsequent ISP processing, and the need to combine the original byte data in the long packet with the sideband The same format of the data packet is presented on the ISP input interface for data error analysis and positioning. The processor 12 in this embodiment is implementing the process of changing the original data of the image data packet according to the data packet processing signal. When the format reaches the target data format, it is used to achieve: use a multiplexer to obtain the data type information of the image data packet and obtain the data packet processing signal to process the signal according to the data type information and the data packet Change or maintain the original data format of the image data packet.

进一步而言，本实施例所述处理器12在实现采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号时，用于实现：采用多路选择器获取所述图像数据包的数据类型信息作为第一输入信号；采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号；根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号。Furthermore, when the processor 12 in this embodiment implements the use of a multiplexer to obtain the data type information of the image data packet and obtains the data packet processing signal, it is used to implement: The data type information of the image data packet is used as the first input signal; the multiplexer is used to obtain the target type information in the data packet processing signal as the second input signal, and the multiplexer is used to obtain the data packet processing The enable selection information in the signal is used as a third input signal; the first input signal or the second input signal is confirmed to be selected as the target output signal according to the third input signal.

举例而言，本实施例所述处理器12在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号为边带数据包类型，所述目标类型信息对应的第二输入信号为有效像素数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；根据所述第三输入信号的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。For example, when the processor 12 in this embodiment realizes that the first input signal or the second input signal is selected as the target output signal is confirmed according to the third input signal, it is used to realize: if the image The data packet is a VOPB data packet, the first input signal corresponding to the data type information is a sideband data packet type, the second input signal corresponding to the target type information is a valid pixel data packet type, and the enable selection information corresponds to The third input signal is a high-level signal or a low-level signal; according to the high-level signal or the low-level signal of the third input signal, the VOPB data packet is selected as the first input signal as the target output signal , Making the data type information of the VOPB data packet a sideband data packet type, or selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is a valid pixel Packet type.

进一步而言，本实施例所述处理器12在实现将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后用于实现：将边带数据包类型的所述VOPB数据包采用边带数据处理模块进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；或，将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。Furthermore, the processor 12 in this embodiment is implementing the selection of the VOPB data packet as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet type, or, The VOPB data packet is selected as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type, and then used to implement: the sideband data packet type of the VOPB data The packet is processed by a sideband data processing module to transmit the VOPB data packet as a sideband data packet, wherein the dvpc signal in the VOPB data packet is characterized as the word contained in the data signal in the VOPB data packet Number of sections; or, the VOPB data packet of the effective pixel data packet type is processed by an effective pixel data processing module, so that the VOPB data packet is transmitted according to the effective pixel data packet.

进一步的处理过程中，本实施例所述处理器12在实现将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型时，用于实现：将所述第二输入信号对应的目标类型信息替换所述第一输入信号对应的数据类型信息；将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。In further processing, when the processor 12 of this embodiment selects the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type. , Used to implement: replace the target type information corresponding to the second input signal with the data type information corresponding to the first input signal; configure the replaced data type information in the VOPB data packet to the original first Input the frame position corresponding to the signal, and configure the replaced data type information into a valid pixel data packet format.

需要说明的是，本实施例所述处理器12在实现将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后用于实现：将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。It should be noted that the processor 12 in this embodiment implements the configuration of the replaced data type information to the original frame position of the first input signal in the VOPB data packet, and the replacement of the data The type information is configured into the format of a valid pixel data packet, and then used to implement: the replacement of the dvpc signal in the updated VOPB data packet is characterized as the number of pixels in the data signal in the updated VOPB data packet.

在另一个优选实施例中，本申请所述处理器12在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号为有效像素数据包类型，所述目标类型信息对应的第二输入信号为边带数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；根据所述第三输入信号的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型。In another preferred embodiment, when the processor 12 of the present application confirms the selection of the first input signal or the second input signal as the target output signal according to the third input signal, it is used to realize: The image data packet is a valid pixel data packet, the first input signal corresponding to the data type information is a valid pixel data packet type, the second input signal corresponding to the target type information is a sideband data packet type, and the use The third input signal corresponding to the information can be selected as a high-level signal or a low-level signal; according to the high-level signal or the low-level signal of the third input signal, the effective pixel data packet is selected as the first input Signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel data packet type, or the effective pixel data packet is selected as the second input signal as the target output signal, so that the effective pixel data The data type information of the packet is the sideband data packet type.

其中，所述处理器12在实现将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后用于实现：将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；或，将边带数据包类型的所述有效像素数据包采用边带数据处理模块进行处理，以将所述有效像素数据包按照边带数据包进行传输。Wherein, the processor 12 realizes that the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel data packet type, or the The effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, which is then used to realize: change the effective pixel data of the effective pixel data packet type The packet is processed by the effective pixel data processing module to transmit the effective pixel data packet in accordance with the effective pixel data packet, wherein the dvpc signal in the effective pixel data packet is characterized by the data signal in the effective pixel data packet The number of pixels included; or, the effective pixel data packet of the sideband data packet type is processed by a sideband data processing module, so that the effective pixel data packet is transmitted according to the sideband data packet.

进一步而言，所述处理器12在实现将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型时，用于实现：将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。Further, when the processor 12 realizes that the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, Realization: configuring the target type information corresponding to the second input signal into the effective pixel data packet and configuring it into a sideband data packet format.

需要说明的是，本实施例所述处理器12在实现将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后用于实现：将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。It should be noted that the processor 12 in this embodiment implements the configuration of the target type information corresponding to the second input signal into the effective pixel data packet, and configures it in the format of the sideband data packet, and then uses it for Implementation: the update of the dvpc signal in the effective pixel data packet after the configuration update is characterized as the number of bytes of the data signal in the updated effective pixel data packet.

作为本申请的另一个优选实施例，所述处理器12在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：判断所述目标输出信号对应的数据包类型，其中，所述第一输入信号和第二输入信号所指示的数据包类型互不相同；若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输；若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。As another preferred embodiment of the present application, when the processor 12 realizes the confirmation that the first input signal or the second input signal is selected as the target output signal according to the third input signal, it is used to realize: The data packet type corresponding to the target output signal, wherein the data packet types indicated by the first input signal and the second input signal are different from each other; if the data packet type corresponding to the target output signal is an effective pixel data packet Type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the transmission channel of the effective pixel data packet; if the data packet type corresponding to the target output signal is the sideband data packet type, the effective pixel The image data packet of the data packet type or the sideband data packet type is transmitted through the transmission channel of the sideband data packet.

值得一提的是，本实施例所述处理器12在实现若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输时，用于实现：将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块进行处理，再通过有效像素数据包的传输通道进行传输。It is worth mentioning that the processor 12 in this embodiment realizes that if the data packet type corresponding to the target output signal is the effective pixel data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is When transmitting through the transmission channel of the effective pixel data packet, it is used to realize: the image data packet of the effective pixel data packet type or the sideband data packet type is sent to the effective pixel data processing module for processing, and then the effective pixel data packet is transmitted Channel for transmission.

如前所述，本实施例所述处理器12在实现若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输时，用于实现：将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块进行处理，再通过边带数据包的传输通道进行传输。As mentioned above, the processor 12 of this embodiment is implementing that if the data packet type corresponding to the target output signal is the sideband data packet type, it passes the image data packet of the effective pixel data packet type or the sideband data packet type. When the transmission channel of the sideband data packet is transmitted, it is used to realize: send the image data packet of the effective pixel data packet type or the sideband data packet type to the sideband data processing module for processing, and then pass the sideband data packet transmission channel To transfer.

需要说明的是，本实施例所述处理器12在实现采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号时，用于实现：通过寄存器组产生所述第二输入信号和所述第三输入信号。It should be noted that the processor 12 in this embodiment uses a multiplexer to obtain the target type information in the data packet processing signal as the second input signal, and uses a multiplexer to obtain the data packet processing signal. When the enable selection information in the signal is used as the third input signal, it is used to realize: generating the second input signal and the third input signal through a register group.

请结合上述实施例参阅图12，本申请提供一种图像数据传输方法，其具体可以包括步骤S121至步骤S125。Please refer to FIG. 12 in conjunction with the foregoing embodiment. This application provides an image data transmission method, which specifically may include step S121 to step S125.

S121，CSI控制器发送图像数据包。S121: The CSI controller sends the image data packet.

在本实施例中，CSI控制器可以允许从MIPI CSI-2摄像机传感器采集原始图像，其接收器和发送器可在FPGA中实现，无需外部DPHY桥接器，而且可以允许快速选择顶层参数，还可为大多数较低层次的参数化实现自动化等。In this embodiment, the CSI controller can allow the acquisition of raw images from MIPI CSI-2 camera sensors, and its receiver and transmitter can be implemented in FPGA without the need for an external DPHY bridge, and it can allow rapid selection of top-level parameters. Automate most of the lower-level parameterization, etc.

S122，数据接口转换装置从所述CSI控制器获取图像数据包。S122: The data interface conversion apparatus obtains an image data packet from the CSI controller.

本实施例图像数据包可以是对真实世界的图像上每一点光的强弱和频谱颜色的表示，且可以把图像信息转换成数据信息，将图像分解为很多小区域像素，并用一个数值来表示它的灰度，对于彩色图像则可以用红、绿、蓝三原色分量表示。The image data package of this embodiment can represent the intensity and spectrum color of each point of light on the real world image, and can convert image information into data information, decompose the image into many small area pixels, and use a numerical value to represent Its grayscale can be represented by the three primary color components of red, green and blue for color images.

S123，数据接口转换装置判断是否获取到数据包处理信号。S123: The data interface conversion device judges whether a data packet processing signal is acquired.

值得一提的是，本实施例的数据包处理信号可以自行触发，比如在发现数据异常或者需要特殊处理时，当然，也可以根据设置而周期或随机地产生所述数据包处理信号。It is worth mentioning that the data packet processing signal in this embodiment can be triggered by itself. For example, when data is abnormal or special processing is required, of course, the data packet processing signal can also be generated periodically or randomly according to settings.

S124，若获取到数据包处理信号，数据接口转换装置根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式。S124: If the data packet processing signal is obtained, the data interface conversion device changes the original data format of the image data packet to the target data format according to the data packet processing signal.

需要特别说明的是，本实施例的“改变”，可以是维持原格式或修改原格式两种方式，等效地，所述原数据格式和所述目标数据格式可以相同或者不同。It should be particularly noted that the "change" in this embodiment may be two ways of maintaining the original format or modifying the original format. Equivalently, the original data format and the target data format may be the same or different.

此外，若未获取到数据包处理信号，则可以不改变当前获取到的图像数据包的格式，并继续等待是否获取到数据包处理信号。In addition, if the data packet processing signal is not acquired, the format of the currently acquired image data packet may not be changed, and the data packet processing signal may continue to be waited for.

S125，数据接口转换装置将所述图像数据包按所述目标数据格式所属的传输通道传输给图像数据处理装置。S125: The data interface conversion device transmits the image data packet to the image data processing device according to the transmission channel to which the target data format belongs.

举例而言，本实施例所述S124中数据接口转换装置根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，可以包括如下两种处理方式：For example, the data interface conversion device in S124 in this embodiment changes the original data format of the image data packet to the target data format according to the data packet processing signal, which may include the following two processing methods:

处理方式一，数据接口转换装置根据所述数据包处理信号将所述图像数据包从有效像素数据包的原数据格式改变到边带数据包的目标数据格式；Processing method 1: The data interface conversion device changes the image data packet from the original data format of the effective pixel data packet to the target data format of the sideband data packet according to the data packet processing signal;

和/或处理方式二，数据接口转换装置根据所述数据包处理信号将所述图像数据包从边带数据包的原数据格式改变到有效像素数据包的目标数据格式。And/or processing mode two, the data interface conversion device changes the image data packet from the original data format of the sideband data packet to the target data format of the effective pixel data packet according to the data packet processing signal.

具体而言，本实施例所述S124中数据接口转换装置根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，可以包括：数据接口转换装置采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。Specifically, the data interface conversion device in S124 of this embodiment changes the original data format of the image data packet to the target data format according to the data packet processing signal, which may include: the data interface conversion device uses a multiplexer to obtain The data type information of the image data packet is obtained, and the data packet processing signal is obtained to change or maintain the original data format of the image data packet according to the data type information and the data packet processing signal.

第一部分，本申请ISP应对不同Data Type的长包时处理方式，ISP可以将长包分为以下2大类：有效像素数据包和边带数据包，而边带数据包包括VOPB数据包、EMBED数据包等。对这2大类的长包，ISP内部可以采用不同的处理方式，并采用不同的数据处理通路。The first part of this application is how the ISP deals with long packets of different Data Types. The ISP can divide the long packets into the following two categories: effective pixel data packets and sideband data packets, while sideband data packets include VOPB data packets and EMBED Data packets, etc. For these two types of long packets, the ISP can use different processing methods and use different data processing channels.

需要重点说明的是，本实施例针对需要将VOPB数据包以与有效像素数据相同的格式呈现在ISP输入接口上而方便后续ISP处理、以及需要将长包内的原始字节数据以与边带数据包相同的格式呈现在ISP输入接口上而进行数据错误的分析定位这两种特殊情况，请参阅图13，本实施例所述数据接口转换装置采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，具体可以包括步骤S131至步骤S133。It is important to note that this embodiment is aimed at the need to present the VOPB data packet in the same format as the effective pixel data on the ISP input interface to facilitate subsequent ISP processing, and the need to combine the original byte data in the long packet with the sideband The same format of the data packet is presented on the ISP input interface to analyze and locate the two special cases of data error. Please refer to FIG. 13. The data interface conversion device of this embodiment uses a multiplexer to obtain the image data packet. The data type information and obtaining the data packet processing signal may specifically include step S131 to step S133.

S131，数据接口转换装置采用多路选择器获取所述图像数据包的数据类型信息作为第一输入信号。S131: The data interface conversion apparatus uses a multiplexer to obtain the data type information of the image data packet as a first input signal.

S132，数据接口转换装置采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号。S132. The data interface conversion apparatus uses a multiplexer to obtain the target type information in the data packet processing signal as the second input signal, and uses the multiplexer to obtain the enable selection information in the data packet processing signal as the second input signal. Three input signals.

S133，数据接口转换装置根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号。S133: The data interface conversion device confirms to select the first input signal or the second input signal as a target output signal according to the third input signal.

值得一提的是，请参阅图14，本实施例所述S133中数据接口转换装置根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，可以包括步骤S1331和S1332。It is worth mentioning that, referring to Figure 14, the data interface conversion device in S133 of this embodiment confirms that the first input signal or the second input signal is selected as the target output signal according to the third input signal. Including steps S1331 and S1332.

S1331，若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号为边带数据包类型，所述目标类型信息对应的第二输入信号为有效像素数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号。S1331: If the image data packet is a VOPB data packet, the first input signal corresponding to the data type information is a sideband data packet type, and the second input signal corresponding to the target type information is a valid pixel data packet type, so The third input signal corresponding to the enable selection information is a high-level signal or a low-level signal.

S1332，数据接口转换装置根据所述第三输入信号的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。S1332: The data interface conversion device selects the VOPB data packet as the first input signal as the target output signal according to the high-level signal or the low-level signal of the third input signal, so that the data type of the VOPB data packet is The information is a sideband data packet type, or the VOPB data packet is selected as the second input signal as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type.

其中，本申请所述将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后包括两种处理方式：In this application, the VOPB data packet is selected as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet type, or the VOPB data packet is selected as The second input signal is used as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type, and then two processing methods are included:

处理方式一，数据接口转换装置将边带数据包类型的所述VOPB数据包采用边带数据处理模块进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；Processing method one: the data interface conversion device processes the VOPB data packet of the sideband data packet type by using a sideband data processing module to transmit the VOPB data packet as a sideband data packet, wherein the VOPB data The dvpc signal in the packet is characterized as the number of bytes contained in the data signal in the VOPB data packet;

或处理方式二，数据接口转换装置将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。Or processing method two, the data interface conversion device processes the VOPB data packets of the effective pixel data packet type by using an effective pixel data processing module to transmit the VOPB data packets according to the effective pixel data packets.

进一步而言，本实施例所述将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，包括：数据接口转换装置将所述第二输入信号对应的目标类型信息替换所述第一输入信号对应的数据类型信息；数据接口转换装置将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。Furthermore, in this embodiment, selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type, includes: the data interface conversion device converts The target type information corresponding to the second input signal replaces the data type information corresponding to the first input signal; the data interface conversion device configures the replaced data type information into the original first input signal in the VOPB data packet Corresponding frame position, and configure the replaced data type information into a valid pixel data packet format.

接着，本申请所述将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后包括：数据接口转换装置将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。Next, according to this application, the replaced data type information is configured to the original frame position of the first input signal in the VOPB data packet, and the replaced data type information is configured as the effective pixel data packet. The format later includes: the data interface conversion device updates the dvpc signal in the updated VOPB data packet to characterize the number of pixels in the data signal in the updated VOPB data packet.

请参阅图15，本申请所述S133根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，还可以包括步骤S1331’和 S1332’。Referring to FIG. 15, the S133 of the present application confirms the selection of the first input signal or the second input signal as the target output signal according to the third input signal, which may further include steps S1331' and S1332'.

S1331’，若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号为有效像素数据包类型，所述目标类型信息对应的第二输入信号为边带数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号。S1331', if the image data packet is a valid pixel data packet, the first input signal corresponding to the data type information is a valid pixel data packet type, and the second input signal corresponding to the target type information is a sideband data packet type , The third input signal corresponding to the enable selection information is a high-level signal or a low-level signal.

S1332’，数据接口转换装置根据所述第三输入信号的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型。S1332', the data interface conversion device selects the effective pixel data packet as the first input signal as the target output signal according to the high-level signal or the low-level signal of the third input signal, so that the effective pixel data packet The data type information of is the effective pixel data packet type, or the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type.

需要说明的是，本实施例所述S1332’将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后包括两种处理方式：It should be noted that in S1332' of this embodiment, the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel data packet type, or, The effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, and then two processing methods are included:

处理方式一，数据接口转换装置将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；Processing method one: The data interface conversion device processes the effective pixel data packet of the effective pixel data packet type by using an effective pixel data processing module to transmit the effective pixel data packet according to the effective pixel data packet, wherein the The dvpc signal in the effective pixel data packet is characterized as the number of pixels included in the data signal in the effective pixel data packet;

或处理方式二，数据接口转换装置将边带数据包类型的所述有效像素数据包采用边带数据处理模块进行处理，以将所述有效像素数据包按照边带数据包进行传输。Or processing method two, the data interface conversion device processes the effective pixel data packet of the sideband data packet type by using a sideband data processing module, so as to transmit the effective pixel data packet according to the sideband data packet.

进一步而言，本实施例所述将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，包括：数据接口转换装置将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。Furthermore, in this embodiment, the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, including: data interface conversion The device configures the target type information corresponding to the second input signal into the effective pixel data packet, and configures it into a sideband data packet format.

相应地，本实施例所述将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后包括：数据接口转换装置将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。Correspondingly, in this embodiment, the target type information corresponding to the second input signal is configured into the effective pixel data packet and configured into a sideband data packet format, and then includes: the data interface conversion device updates the configuration The update of the dvpc signal in the subsequent effective pixel data packet is characterized by the number of bytes of the data signal in the updated effective pixel data packet.

请参阅图16，作为另一种优选实施例，所述S133中根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，还可以包括步骤S1331”至步骤S1333”。Referring to FIG. 16, as another preferred embodiment, the S133 confirms the selection of the first input signal or the second input signal as the target output signal according to the third input signal, which may also include step S1331" Go to step S1333".

S1331”，数据接口转换装置判断所述目标输出信号对应的数据包类型，其中，所述第一输入信号和第二输入信号所指示的数据包类型互不相同；S1331", the data interface conversion device determines the data packet type corresponding to the target output signal, wherein the data packet types indicated by the first input signal and the second input signal are different from each other;

S1332”，若所述目标输出信号对应的数据包类型为有效像素数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输；S1332", if the data packet type corresponding to the target output signal is the effective pixel data packet type, the data interface conversion device transmits the image data packet of the effective pixel data packet type or the sideband data packet type through the effective pixel data packet transmission channel transmission;

S1333”，若所述目标输出信号对应的数据包类型为边带数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。S1333", if the data packet type corresponding to the target output signal is a sideband data packet type, the data interface conversion device transmits the image data packet of the effective pixel data packet type or the sideband data packet type through the sideband data packet transmission channel transmission.

值得一提的是，本实施例所述S1332”若所述目标输出信号对应的数据包类型为有效像素数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输，包括：数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块进行处理，再通过有效像素数据包的传输通道进行传输。It is worth mentioning that in S1332 of this embodiment, if the data packet type corresponding to the target output signal is the effective pixel data packet type, the data interface conversion device converts the image data of the effective pixel data packet type or the sideband data packet type The packet is transmitted through the transmission channel of the effective pixel data packet, including: the data interface conversion device sends the image data packet of the effective pixel data packet type or the sideband data packet type to the effective pixel data processing module for processing, and then passes the effective pixel data packet Transmission channel for transmission.

对应地，本实施例所述S1333”若所述目标输出信号对应的数据包类型为边带数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输，包括：数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块进行处理，再通过边带数据包的传输通道进行传输。Correspondingly, in S1333 of this embodiment, if the data packet type corresponding to the target output signal is the sideband data packet type, the data interface conversion device passes the image data packet of the effective pixel data packet type or the sideband data packet type through the sideband. The transmission channel with data packets for transmission includes: the data interface conversion device sends the image data packets of the effective pixel data packet type or the sideband data packet type to the sideband data processing module for processing, and then passes through the sideband data packet transmission channel To transfer.

在本实施例中，所述采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号，包括：数据接口转换装置通过寄存器组产生所述第二输入信号和所述第三输入信号。In this embodiment, the multiplexer is used to obtain the target type information in the data packet processing signal as the second input signal, and the multiplexer is used to obtain the enable selection information in the data packet processing signal As the third input signal, the data interface conversion device generates the second input signal and the third input signal through a register set.

请结合上述实施例参阅图17，本申请提供一种图像数据传输装置，其可以包括CSI控制器171、数据接口转换装置172和图像数据处理装置173。Please refer to FIG. 17 in conjunction with the foregoing embodiments. The present application provides an image data transmission device, which may include a CSI controller 171, a data interface conversion device 172, and an image data processing device 173.

需要首先说明的是，本实施例所述CSI控制器171发送图像数据包；It should be noted that the CSI controller 171 in this embodiment sends image data packets;

所述数据接口转换装置172包括存储器(图未示)和处理器1724；The data interface conversion device 172 includes a memory (not shown) and a processor 1724;

所述处理器1724，用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：The processor 1724 is configured to execute the computer program and, when executing the computer program, implement the following steps:

从所述CSI控制器171获取图像数据包；Acquiring an image data packet from the CSI controller 171;

将所述图像数据包按所述目标数据格式所属的传输通道传输给所述图像数据处理装置173。The image data packet is transmitted to the image data processing device 173 according to the transmission channel to which the target data format belongs.

具体而言，本实施例所述处理器1724在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现两种情况：Specifically, the processor 1724 in this embodiment is used to implement two situations when the original data format of the image data packet is changed to the target data format according to the data packet processing signal:

进一步而言，本实施例所述处理器1724在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现：采用多路选择器1721获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。Furthermore, when the processor 1724 of this embodiment realizes changing the original data format of the image data packet to the target data format according to the data packet processing signal, it is used to realize: adopting the multiplexer 1721 to obtain the Acquiring the data type information of the image data packet and acquiring the data packet processing signal to change or maintain the original data format of the image data packet according to the data type information and the data packet processing signal.

其中，所述处理器1724在实现采用多路选择器1721获取所述图像数据包的数据类型信息、并获取所述数据包处理信号时，用于实现：采用多路选择器1721获取所述图像数据包的数据类型信息作为第一输入信号Data Type；采用多路选择器1721获取所述数据包处理信号中的目标类型信息作为第二输入信号Map-Type，并采用多路选择器1721获取所述数据包处理信号中的使能选择信息作为第三输入信号map-en；根据所述第三输入信号map-en确认选择所述第一输入信号Data Type或所述第二输入信号Map-Type作为目标输出信号 Final-Type。Wherein, the processor 1724 is used to obtain the data type information of the image data packet by using the multiplexer 1721 and obtain the data packet processing signal, and is used to implement: the multiplexer 1721 is used to obtain the image The data type information of the data packet is used as the first input signal Data Type; the multiplexer 1721 is used to obtain the target type information in the data packet processing signal as the second input signal Map-Type, and the multiplexer 1721 is used to obtain the data type. The enable selection information in the data packet processing signal is used as the third input signal map-en; according to the third input signal map-en, the selection of the first input signal Data Type or the second input signal Map-Type is confirmed As the target output signal Final-Type.

第二部分，对这2大类的长包，在ISP输入接口的格式也可以不同。比如，识别、解析MIPI图像传感器传输过来的长包属于哪一类长包、并且以对应的格式输出给ISP输入接口，可以采用图4所示中的接口转换电路实现。具体而言，本申请在ISP输入接口上，如图5所示，可以有4个关键的信号:dvld,type,data,dvpc。The second part, for these two types of long packets, the format of the ISP input interface can also be different. For example, to identify and analyze which type of long packet the long packet transmitted from the MIPI image sensor belongs to, and output it to the ISP input interface in the corresponding format, the interface conversion circuit shown in Figure 4 can be used. Specifically, in this application, on the ISP input interface, as shown in FIG. 5, there may be 4 key signals: dvld, type, data, and dvpc.

需要重点说明的是，本实施例针对需要将VOPB数据包以与有效像素数据相同的格式呈现在ISP输入接口上而方便后续ISP处理、以及需要将长包内的原始字节数据以与边带数据包相同的格式呈现在ISP输入接口上而进行数据错误的分析定位这两种特殊情况，本实施例所述处理器1724在实现根据所述第三输入信号map-en确认选择所述第一输入信号Data Type或所述第二输入信号Map-Type作为目标输出信号Final-Type时，用于实现：若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号Data Type为边带数据包类型，所述目标类型信息对应的第二输入信号Map-Type为有效像素数据包类型，所述使能选择信息对应的第三输入信号map-en为高电平信号或低电平信号；根据所述第三输入信号map-en的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号Data Type作为目标输出信号Final-Type，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号Map-Type作为目标输出信号Final-Type，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。It is important to note that this embodiment is aimed at the need to present the VOPB data packet in the same format as the effective pixel data on the ISP input interface to facilitate subsequent ISP processing, and the need to combine the original byte data in the long packet with the sideband The same format of the data packet is presented on the ISP input interface to analyze and locate the two special cases of data error. The processor 1724 of this embodiment is implementing the confirmation selection of the first according to the third input signal map-en. When the input signal Data Type or the second input signal Map-Type is used as the target output signal Final-Type, it is used to realize: if the image data packet is a VOPB data packet, the first input signal Data corresponding to the data type information Type is a sideband data packet type, the second input signal Map-Type corresponding to the target type information is a valid pixel data packet type, and the third input signal map-en corresponding to the enable selection information is a high-level signal or Low-level signal; according to the high-level signal or low-level signal of the third input signal map-en, the VOPB data packet is selected as the first input signal Data Type as the target output signal Final-Type, so that all The data type information of the VOPB data packet is a sideband data packet type, or the VOPB data packet is selected as the second input signal Map-Type as the target output signal Final-Type, so that the data type information of the VOPB data packet It is the effective pixel data packet type.

在本实施例中，所述处理器1724在实现将所述VOPB数据包选择为第一输入信号Data Type作为目标输出信号Final-Type，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号Map-Type作为目标输出信号Final-Type，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后用于实现：将边带数据包类型的所述VOPB数据包采用边带数据处理模块1722进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；或，将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块1723进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。In this embodiment, the processor 1724 selects the VOPB data packet as the first input signal Data Type as the target output signal Final-Type, so that the data type information of the VOPB data packet is a sideband data packet. Type, or, the VOPB data packet is selected as the second input signal Map-Type as the target output signal Final-Type, so that the data type information of the VOPB data packet is the effective pixel data packet type, and then used to implement: The VOPB data packet of the sideband data packet type is processed by the sideband data processing module 1722 to transmit the VOPB data packet according to the sideband data packet, wherein the dvpc signal in the VOPB data packet is characterized by The number of bytes contained in the data signal in the VOPB data packet; or, the effective pixel data packet type of the VOPB data packet is processed by the effective pixel data processing module 1723, so as to convert the VOPB data packet according to the effective pixel data The packet is transmitted.

相应地，本实施例所述处理器1724在实现将所述VOPB数据包选择为第二输入信号Map-Type作为目标输出信号Final-Type，使得所述VOPB数据包的数据类型信息为有效像素数据包类型时，用于实现：将所述第二输入信号Map-Type对应的目标类型信息替换所述第一输入信号Data Type对应的数据类型信息；将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号Data Type对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。Correspondingly, the processor 1724 of this embodiment selects the VOPB data packet as the second input signal Map-Type as the target output signal Final-Type, so that the data type information of the VOPB data packet is valid pixel data. When the packet type is used, it is used to implement: replace the target type information corresponding to the second input signal Map-Type with the data type information corresponding to the first input signal DataType; configure the replaced data type information in the VOPB The original frame position corresponding to the first input signal Data Type in the data packet, and the replaced data type information is configured into the format of a valid pixel data packet.

在本实施例中，所述处理器1724在实现将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号Data Type对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后用于实现：将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。In this embodiment, the processor 1724 realizes that the replaced data type information is configured to the frame position corresponding to the original first input signal Data Type in the VOPB data packet, and the replaced data The type information is configured into the format of a valid pixel data packet, and then used to implement: the replacement of the dvpc signal in the updated VOPB data packet is characterized as the number of pixels in the data signal in the updated VOPB data packet.

需要说明的是，本实施例所述处理器1724在实现根据所述第三输入信号map-en确认选择所述第一输入信号Data Type或所述第二输入信号Map-Type作为目标输出信号Final-Type时，用于实现：若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号Data Type为有效像素数据包类型，所述目标类型信息对应的第二输入信号Map-Type为边带数据包类型，所述使能选择信息对应的第三输入信号map-en为高电平信号或低电平信号；根据所述第三输入信号map-en的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号Data Type作为目标输出信号Final-Type，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号Map-Type作为目标输出信号Final-Type，使得所述有效像素数据包的数据类型信息为边带数据包类型。It should be noted that the processor 1724 in this embodiment confirms the selection of the first input signal Data Type or the second input signal Map-Type as the target output signal Final according to the third input signal map-en. -Type, used to realize: if the image data packet is a valid pixel data packet, the first input signal Data Type corresponding to the data type information is the valid pixel data packet type, and the second input corresponding to the target type information The signal Map-Type is a sideband data packet type, and the third input signal map-en corresponding to the enable selection information is a high-level signal or a low-level signal; according to the high-level signal of the third input signal map-en A flat signal or a low-level signal, the effective pixel data packet is selected as the first input signal Data Type as the target output signal Final-Type, so that the data type information of the effective pixel data packet is the effective pixel data packet type, or Selecting the effective pixel data packet as the second input signal Map-Type as the target output signal Final-Type, so that the data type information of the effective pixel data packet is the sideband data packet type.

针对上述情况，本实施例所述处理器1724在实现将所述有效像素数据包选择为第一输入信号Data Type作为目标输出信号Final-Type，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号Map-Type作为目标输出信号Final-Type，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后用于实现：将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块1723进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；或，将边带数据包类型的所述有效像素数据包采用边带数据处理模块1722进行处理，以将所述有效像素数据包按照边带数据包进行传输。In view of the above situation, the processor 1724 of this embodiment selects the effective pixel data packet as the first input signal Data Type as the target output signal Final-Type, so that the data type information of the effective pixel data packet is valid. The pixel data packet type, or the effective pixel data packet is selected as the second input signal Map-Type as the target output signal Final-Type, so that the data type information of the effective pixel data packet is the sideband data packet type, and then Used to implement: the effective pixel data packet of the effective pixel data packet type is processed by the effective pixel data processing module 1723, so as to transmit the effective pixel data packet according to the effective pixel data packet, wherein the effective pixel data The dvpc signal in the packet is characterized by the number of pixels contained in the data signal in the effective pixel data packet; or, the effective pixel data packet of the sideband data packet type is processed by the sideband data processing module 1722 to convert The effective pixel data packet is transmitted according to the sideband data packet.

进一步而言，所述处理器1724在实现将所述有效像素数据包选择为第二输入信号Map-Type作为目标输出信号Final-Type，使得所述有效像素数据包的数据类型信息为边带数据包类型时，用于实现：将所述第二输入信号Map-Type对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。Further, when the processor 1724 realizes that the effective pixel data packet is selected as the second input signal Map-Type as the target output signal Final-Type, the data type information of the effective pixel data packet is sideband data. When the packet type is used, it is used to implement: configure the target type information corresponding to the second input signal Map-Type into the effective pixel data packet, and configure it into a sideband data packet format.

具体而言，本实施例所述处理器1724在实现将所述第二输入信号Map-Type对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后用于实现：将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。Specifically, the processor 1724 in this embodiment configures the target type information corresponding to the second input signal Map-Type into the effective pixel data packet and configures it in the format of the sideband data packet, and then It is used to realize: the update of the dvpc signal in the effective pixel data packet after the configuration update is characterized as the number of bytes of the data signal in the updated effective pixel data packet.

作为本申请的一个优选实施例，所述处理器1724在实现根据所述第三输入信号map-en确认选择所述第一输入信号Data Type或所述第二输入信号Map-Type作为目标输出信号Final-Type时，用于实现：判断所述目标输出信号Final-Type对应的数据包类型，其中，所述第一输入信号Data Type和第二输入信号Map-Type所指示的数据包类型互不相同；若所述目标输出信号Final-Type对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输；若所述目标输出信号Final-Type对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。As a preferred embodiment of the present application, the processor 1724 confirms the selection of the first input signal Data Type or the second input signal Map-Type as the target output signal according to the third input signal map-en. In the case of Final-Type, it is used to realize: determine the data packet type corresponding to the target output signal Final-Type, where the data packet types indicated by the first input signal Data Type and the second input signal Map-Type are different from each other Same; if the data packet type corresponding to the target output signal Final-Type is an effective pixel data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the transmission channel of the effective pixel data packet; If the data packet type corresponding to the target output signal Final-Type is a sideband data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the sideband data packet transmission channel.

需要说明的是，本实施例所述处理器1724在实现若所述目标输出信号Final-Type对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输时，用于实现：将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块1723进行处理，再通过有效像素数据包的传输通道进行传输。It should be noted that the processor 1724 in this embodiment is implementing that if the data packet type corresponding to the target output signal Final-Type is the effective pixel data packet type, the image of the effective pixel data packet type or sideband data packet type When the data packet is transmitted through the transmission channel of the effective pixel data packet, it is used to realize: send the image data packet of the effective pixel data packet type or the sideband data packet type to the effective pixel data processing module 1723 for processing, and then pass the effective pixel data The transmission channel of the packet is transmitted.

值得一提的是，所述处理器1724在实现若所述目标输出信号Final-Type 对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输时，用于实现：将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块1722进行处理，再通过边带数据包的传输通道进行传输。It is worth mentioning that, when the processor 1724 realizes that if the data packet type corresponding to the target output signal Final-Type is a sideband data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is When transmitting through the transmission channel of the sideband data packet, it is used to realize: send the image data packet of the effective pixel data packet type or the sideband data packet type to the sideband data processing module 1722 for processing, and then pass the sideband data packet Transmission channel for transmission.

如图17所示，所述处理器1724在实现采用多路选择器1721获取所述数据包处理信号中的目标类型信息作为第二输入信号Map-Type，并采用多路选择器1721获取所述数据包处理信号中的使能选择信息作为第三输入信号map-en时，用于实现：通过寄存器组174产生所述第二输入信号Map-Type和所述第三输入信号map-en。As shown in FIG. 17, the processor 1724 uses a multiplexer 1721 to obtain the target type information in the packet processing signal as the second input signal Map-Type, and uses a multiplexer 1721 to obtain the When the enable selection information in the data packet processing signal is used as the third input signal map-en, it is used to realize that the second input signal Map-Type and the third input signal map-en are generated through the register group 174.

在本实施例中，所述图像数据处理装置173可以为ISP模块或其他处理模块，所述边带数据包包括VOPB数据包和EMBED数据包，所述有效像素数据包的颜色格式包括RAW8格式、RAW10格式或其他格式。In this embodiment, the image data processing device 173 may be an ISP module or other processing modules, the sideband data packet includes VOPB data packet and EMBED data packet, and the color format of the effective pixel data packet includes RAW8 format, RAW10 format or other formats.

在其中一个应用例中，所述处理器1724将所述有效像素数据包通过边带数据包的传输通道传输给所述图像数据处理装置173后，所述图像数据处理装置173获取所述有效像素数据包的原始字节数据，以在所述有效像素数据包发生错误时，对错误的有效像素数据进行定位。In one of the application examples, after the processor 1724 transmits the effective pixel data packet to the image data processing device 173 through the sideband data packet transmission channel, the image data processing device 173 obtains the effective pixel data packet. The original byte data of the data packet is used to locate the wrong effective pixel data when an error occurs in the effective pixel data packet.

在其他实施例中图像数据传输装置还可以包括图4所示的MIPI图像传感器、DPHY等。进一步而言，所述DPHY可以替换成CPHY等其他类型的PHY，此外，有效像素数据包和边带数据包在数据接口转换装置172的输出接口上呈现的具体格式可以采用其他格式，同理，所述图像数据处理装置173输入接口的关键信号可以采用其他方式。容易理解的是，边带数据包的类型不仅限于VOPB数据、EMBED数据，还可以为所有其他的边带数据类型。In other embodiments, the image data transmission device may further include the MIPI image sensor, DPHY, etc. shown in FIG. 4. Furthermore, the DPHY can be replaced with other types of PHYs such as CPHY. In addition, the specific format of the effective pixel data packet and the sideband data packet displayed on the output interface of the data interface conversion device 172 can adopt other formats. Similarly, The key signal of the input interface of the image data processing device 173 may adopt other methods. It is easy to understand that the types of sideband data packets are not limited to VOPB data and EMBED data, but can also be all other sideband data types.

值得一提的是，本申请的实施例中还提供一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序中包括程序指令，所述处理器1724执行所述程序指令，实现上述实施例提供的图像数据处理方法、图像数据传输方法的步骤。It is worth mentioning that the embodiments of the present application also provide a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program includes program instructions, and the processor 1724 executes all The program instructions implement the steps of the image data processing method and image data transmission method provided in the above embodiments.

其中，所述计算机可读存储介质可以是前述任一实施例所述的内部的存储器，例如硬盘或内存。所述计算机可读存储介质也可以是外部的存储设备，例如配备的插接式硬盘，智能存储卡(Smart Media Card，SMC)，安全数字(Secure Digital，SD)卡，闪存卡(Flash Card)等。Wherein, the computer-readable storage medium may be the internal memory described in any of the foregoing embodiments, such as a hard disk or a memory. The computer-readable storage medium may also be an external storage device, such as an equipped plug-in hard disk, a smart memory card (Smart Media Card, SMC), a Secure Digital (SD) card, and a flash memory card (Flash Card). Wait.

为便于理解，下面将结合其中一实施例进行详细说明。For ease of understanding, a detailed description will be given below in conjunction with one of the embodiments.

继续参阅图17所示，对于数据接口转换装置172来说，有2个主要的输入信号来源：CSI控制器171和寄存器组174。Continuing to refer to FIG. 17, for the data interface conversion device 172, there are two main input signal sources: the CSI controller 171 and the register group 174.

其中，来自CSI控制器171的有2个主要的信号：Data Type和Packet Data。Data Type表示当前CSI控制器171传输过来的包(packet)的数据类型，Packet Data是当前CSI控制器171传输过来的包(packet)的具体数据内容。Among them, there are two main signals from the CSI controller 171: Data Type and Packet Data. Data Type represents the data type of the packet (packet) transmitted by the current CSI controller 171, and Packet Data is the specific data content of the packet (packet) transmitted by the current CSI controller 171.

其中，来自寄存器组174的有2个主要的信号：Map-Type和map_en。Map-Type和map_en均作用于数据接口转换装置172内部的多路选择器1721。多路选择器1721的输入信号还有Data Type。Among them, there are two main signals from the register group 174: Map-Type and map_en. Both Map-Type and map_en act on the multiplexer 1721 inside the data interface conversion device 172. The input signal of the multiplexer 1721 also has Data Type.

多路选择器1721的工作模式包括：当配置map_en为0时，Final-Type为Data Type；当配置map_en为1时，Final-Type为Map-Type。Final-Type会输入到处理器1724中，处理器1724会判断Final-Type的类型。如果Final-Type属于边带数据类型，则将CSI控制器171传输过来的Packet Data分配给边带数据处理模块1722，此时data按照图7的格式输出，dvpc表征当前data内包含的字节个数。如果Final-Type属于有效像素数据类型，则将CSI控制器171传输过来的Packet Data分配给有效像素数据处理模块1723，此时data按照图6的格式输出，dvpc表征当前data内包含的像素个数。The working mode of the multiplexer 1721 includes: when the configuration map_en is 0, the Final-Type is Data Type; when the configuration map_en is 1, the Final-Type is the Map-Type. The Final-Type will be input to the processor 1724, and the processor 1724 will determine the type of Final-Type. If the Final-Type belongs to the sideband data type, the Packet Data transmitted by the CSI controller 171 is allocated to the sideband data processing module 1722. At this time, the data is output according to the format of Figure 7, and dvpc represents the number of bytes contained in the current data. number. If the Final-Type belongs to the effective pixel data type, the Packet Data transmitted from the CSI controller 171 is allocated to the effective pixel data processing module 1723. At this time, the data is output according to the format of Figure 6, and dvpc represents the number of pixels contained in the current data. .

需要说明的是，VOPB数据包是边带数据包的一种，利用上述工作模式，可以实现对VOPB数据包的灵活解析，具体可以包括以下2种情形。It should be noted that the VOPB data packet is a type of sideband data packet. Using the above working mode, flexible analysis of the VOPB data packet can be realized, which can specifically include the following two situations.

情形一，如果想要以与有效像素数据相同的格式将VOPB数据呈现在ISP输入接口，则在图17中，将map_en配置为1，将Mape Type配置为与该VOPB数据属于同一帧的有效像素的颜色格式，以RAW8为例，此时Final-Type为RAW8。Final-Type会输入到处理器1724中，处理器1724判断RAW8属于有效像素数据类型,因此将CSI控制器171传输过来的Packet Data分配给有效像素数据处理模块1723，此时data按照图6的格式输出，dvpc表征当前data内包含的像素个数。Case 1: If you want to present the VOPB data on the ISP input interface in the same format as the effective pixel data, in Figure 17, set map_en to 1, and set MapType to the effective pixels belonging to the same frame as the VOPB data For the color format of RAW8, for example, the Final-Type is RAW8. The Final-Type will be input to the processor 1724. The processor 1724 judges that RAW8 belongs to the valid pixel data type. Therefore, the Packet Data transmitted from the CSI controller 171 is allocated to the valid pixel data processing module 1723. At this time, the data is in the format of Figure 6 Output, dvpc represents the number of pixels contained in the current data.

情形二，如果想要以边带数据的格式将VOPB数据呈现在ISP输入接口，则在图17中，将map_en配置为0，此时Final-Type为VOPB。Final-Type会输入到处理器1724中，处理器1724判断VOPB属于边带数据类型,因此将CSI控制器171传输过来的Packet Data分配给边带数据处理模块1722，此时data 按照图7的格式输出，dvpc表征当前data内包含的字节个数。Case 2: If you want to present the VOPB data on the ISP input interface in the format of sideband data, in Figure 17, the map_en is configured as 0, and the Final-Type is VOPB at this time. The Final-Type will be input to the processor 1724. The processor 1724 judges that the VOPB belongs to the sideband data type. Therefore, the Packet Data transmitted from the CSI controller 171 is allocated to the sideband data processing module 1722. At this time, the data is in the format of Figure 7 Output, dvpc represents the number of bytes contained in the current data.

同理，利用上述方案，也可以实现对有效像素数据包(此处以RAW8为例)的灵活解析，具体分以下2种方式。In the same way, by using the above scheme, it is also possible to realize flexible analysis of valid pixel data packets (here, RAW8 is taken as an example), which can be specifically divided into the following two methods.

方式一，如果想要以有效像素数据的格式将有效像素数据呈现在ISP(即图像数据处理装置173)输入接口，则在图17中，将map_en配置为0，此时Final-Type为RAW8。Final-Type会输入到处理器1724中，处理器1724判断RAW8属于有效像素数据类型,因此将CSI控制器171传输过来的Packet Data分配给有效像素数据处理模块1723，此时data按照图6的格式输出，dvpc表征当前data内包含的像素个数。Method 1: If you want to present the effective pixel data in the ISP (ie image data processing device 173) input interface in the format of effective pixel data, then in FIG. 17, map_en is configured as 0, and the Final-Type is RAW8 at this time. The Final-Type will be input to the processor 1724. The processor 1724 judges that RAW8 belongs to the valid pixel data type. Therefore, the Packet Data transmitted from the CSI controller 171 is allocated to the valid pixel data processing module 1723. At this time, the data is in the format of Figure 6 Output, dvpc represents the number of pixels contained in the current data.

方式二，如果想要以边带数据的格式将有效像素数据呈现在ISP输入接口，则在图17中，将map_en配置为1，将Mape Type配置为某一种边带数据包的Data Type。Final-Type会输入到处理器1724中，处理器1724判断Final-Type属于边带数据类型,因此将CSI控制器171传输过来的Packet Data分配给边带数据处理模块1722，此时data按照图7的格式输出，dvpc表征当前data内包含的字节个数。Method 2: If you want to present the effective pixel data on the ISP input interface in the format of sideband data, in Figure 17, set map_en to 1, and set Map Type to a Data Type of a sideband data packet. The Final-Type will be input to the processor 1724. The processor 1724 judges that the Final-Type belongs to the sideband data type. Therefore, the Packet Data transmitted from the CSI controller 171 is allocated to the sideband data processing module 1722. At this time, the data is as shown in Figure 7. Dvpc represents the number of bytes contained in the current data.

本申请能够对有效像素数据包和边带数据包进行灵活解析处理，且在进行灵活解析后能够以最适当的格式将长包数据传送给后级ISP，可以让ISP花费更小的计算代价来处理长包数据，同时，能够将有效像素数据包以与边带数据包相同的格式将数据传送给后级ISP，使得ISP能够获取长包内的原始字节数据，能够在发生错误时更方便地对问题进行定位。This application can flexibly analyze and process effective pixel data packets and sideband data packets, and can transmit long packet data to the subsequent ISP in the most appropriate format after flexible analysis, which allows the ISP to spend a smaller computational cost. Processing long packet data, and at the same time, the effective pixel data packet can be transmitted to the subsequent ISP in the same format as the sideband data packet, so that the ISP can obtain the original byte data in the long packet, which can be more convenient when errors occur Locate the problem carefully.

以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以权利要求的保护范围为准。The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Anyone familiar with the technical field can easily think of various equivalents within the technical scope disclosed in this application. Modifications or replacements, these modifications or replacements shall be covered within the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims

一种图像数据处理方法，其特征在于，包括：An image data processing method, characterized in that it comprises:

获取图像数据包；Get image data package;

判断是否获取到数据包处理信号；Determine whether the data packet processing signal is obtained;

若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，以将所述图像数据包按所述目标数据格式所属的传输通道进行传输。If the data packet processing signal is obtained, the original data format of the image data packet is changed to the target data format according to the data packet processing signal, so as to transmit the image data packet according to the transmission channel to which the target data format belongs.
根据权利要求1所述的方法，其特征在于，所述根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，包括：The method of claim 1, wherein the changing the original data format of the image data packet to the target data format according to the data packet processing signal comprises:

根据所述数据包处理信号将所述图像数据包从有效像素数据包的原数据格式改变到边带数据包的目标数据格式；Changing the image data packet from the original data format of the effective pixel data packet to the target data format of the sideband data packet according to the data packet processing signal;

和/或，根据所述数据包处理信号将所述图像数据包从边带数据包的原数据格式改变到有效像素数据包的目标数据格式。And/or, changing the image data packet from the original data format of the sideband data packet to the target data format of the effective pixel data packet according to the data packet processing signal.
根据权利要求1所述的方法，其特征在于，所述根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，包括：The method of claim 1, wherein the changing the original data format of the image data packet to the target data format according to the data packet processing signal comprises:

采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。Use a multiplexer to obtain the data type information of the image data packet and obtain the data packet processing signal to change or maintain the original data of the image data packet according to the data type information and the data packet processing signal format.
根据权利要求3所述的方法，其特征在于，所述采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，包括：4. The method according to claim 3, wherein said using a multiplexer to obtain data type information of said image data packet and obtain said data packet processing signal comprises:

采用多路选择器获取所述图像数据包的数据类型信息作为第一输入信号；Using a multiplexer to obtain the data type information of the image data packet as the first input signal;

采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号；Using a multiplexer to obtain the target type information in the data packet processing signal as a second input signal, and using a multiplexer to obtain the enable selection information in the data packet processing signal as a third input signal;

根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号。Confirm selection of the first input signal or the second input signal as the target output signal according to the third input signal.
根据权利要求4所述的方法，其特征在于，所述根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，包括：The method according to claim 4, wherein the confirming selection of the first input signal or the second input signal as the target output signal according to the third input signal comprises:

若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号为边带数据包类型，所述目标类型信息对应的第二输入信号为有效像素数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a VOPB data packet, the first input signal corresponding to the data type information is a sideband data packet type, and the second input signal corresponding to the target type information is a valid pixel data packet type, and the use The third input signal corresponding to the information can be selected as a high-level signal or a low-level signal;

根据所述第三输入信号的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。According to the high-level signal or the low-level signal of the third input signal, the VOPB data packet is selected as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet Type, or, selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type.
根据权利要求5所述的方法，其特征在于，所述将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后包括：The method according to claim 5, wherein the selecting the VOPB data packet as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet type, or , Selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type, and then includes:

将边带数据包类型的所述VOPB数据包采用边带数据处理模块进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；The VOPB data packet of the sideband data packet type is processed by a sideband data processing module to transmit the VOPB data packet according to the sideband data packet, wherein the dvpc signal in the VOPB data packet is represented by State the number of bytes contained in the data signal in the VOPB data packet;

或，将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。Or, the VOPB data packet of the effective pixel data packet type is processed by an effective pixel data processing module, so that the VOPB data packet is transmitted according to the effective pixel data packet.
根据权利要求5所述的方法，其特征在于，所述将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，包括：The method according to claim 5, wherein the selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type, including :

将所述第二输入信号对应的目标类型信息替换所述第一输入信号对应的数据类型信息；Replacing the target type information corresponding to the second input signal with the data type information corresponding to the first input signal;

将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。The replaced data type information is configured to the original frame position corresponding to the first input signal in the VOPB data packet, and the replaced data type information is configured into a valid pixel data packet format.
根据权利要求7所述的方法，其特征在于，所述将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后包括：8. The method according to claim 7, wherein the data type information after replacement is configured to the frame position of the original first input signal in the VOPB data packet, and the replaced data The type information is configured into the format of a valid pixel data packet, and then includes:

将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。The update of the dvpc signal in the VOPB data packet after replacement is characterized as the number of pixels of the data signal in the updated VOPB data packet.
根据权利要求4所述的方法，其特征在于，所述根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，包括：The method of claim 4, wherein the confirming selection of the first input signal or the second input signal as the target output signal according to the third input signal comprises:

若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号为有效像素数据包类型，所述目标类型信息对应的第二输入信号为边带数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a valid pixel data packet, the first input signal corresponding to the data type information is a valid pixel data packet type, and the second input signal corresponding to the target type information is a sideband data packet type, and The third input signal corresponding to the enabling selection information is a high-level signal or a low-level signal;

根据所述第三输入信号的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型。According to the high-level signal or the low-level signal of the third input signal, the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel The data packet type, or the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type.
根据权利要求9所述的方法，其特征在于，所述将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后包括：9. The method according to claim 9, wherein the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel data packet type Or, selecting the effective pixel data packet as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, and then includes:

将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；The effective pixel data packet of the effective pixel data packet type is processed by the effective pixel data processing module to transmit the effective pixel data packet according to the effective pixel data packet, wherein the dvpc signal in the effective pixel data packet Characterized by the number of pixels included in the data signal in the effective pixel data packet;

或，将边带数据包类型的所述有效像素数据包采用边带数据处理模块进行处理，以将所述有效像素数据包按照边带数据包进行传输。Or, the effective pixel data packet of the sideband data packet type is processed by a sideband data processing module, so as to transmit the effective pixel data packet according to the sideband data packet.
根据权利要求10所述的方法，其特征在于，所述将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，包括：The method according to claim 10, wherein the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is a sideband data packet type ,include:

将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。The target type information corresponding to the second input signal is configured into the effective pixel data packet, and configured into a sideband data packet format.
根据权利要求11所述的方法，其特征在于，所述将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后包括：The method according to claim 11, wherein the configuring the target type information corresponding to the second input signal into the effective pixel data packet and configuring it in a sideband data packet format, and then comprising:

将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。The update of the dvpc signal in the effective pixel data packet after the configuration is updated is characterized as the number of bytes of the data signal in the updated effective pixel data packet.
根据权利要求4所述的方法，其特征在于，所述根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，包括：The method according to claim 4, wherein the confirming selection of the first input signal or the second input signal as the target output signal according to the third input signal comprises:

判断所述目标输出信号对应的数据包类型，其中，所述第一输入信号和第二输入信号所指示的数据包类型互不相同；Determining a data packet type corresponding to the target output signal, wherein the data packet types indicated by the first input signal and the second input signal are different from each other;

若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输；If the data packet type corresponding to the target output signal is an effective pixel data packet type, transmitting the image data packet of the effective pixel data packet type or the sideband data packet type through the transmission channel of the effective pixel data packet;

若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。If the data packet type corresponding to the target output signal is a sideband data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the sideband data packet transmission channel.
根据权利要求13所述的方法，其特征在于，所述若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输，包括：The method according to claim 13, wherein if the data packet type corresponding to the target output signal is an effective pixel data packet type, pass the image data packet of the effective pixel data packet type or the sideband data packet type through The transmission channel of the effective pixel data packet is transmitted, including:

将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块进行处理，再通过有效像素数据包的传输通道进行传输。The image data packet of the effective pixel data packet type or the sideband data packet type is sent to the effective pixel data processing module for processing, and then transmitted through the transmission channel of the effective pixel data packet.
根据权利要求13所述的方法，其特征在于，所述若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输，包括：The method according to claim 13, wherein if the data packet type corresponding to the target output signal is a sideband data packet type, pass the image data packet of the effective pixel data packet type or the sideband data packet type through The transmission channel of the sideband data packet is transmitted, including:

将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块进行处理，再通过边带数据包的传输通道进行传输。The image data packet of the effective pixel data packet type or the sideband data packet type is sent to the sideband data processing module for processing, and then transmitted through the transmission channel of the sideband data packet.
根据权利要求4、13、14或15任一项所述的方法，其特征在于，所述采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号，包括：The method according to any one of claims 4, 13, 14 or 15, wherein the multiplexer is used to obtain the target type information in the packet processing signal as the second input signal, and multiple The way selector acquiring the enable selection information in the data packet processing signal as the third input signal includes:

通过寄存器组产生所述第二输入信号和所述第三输入信号。The second input signal and the third input signal are generated through a register set.
一种数据接口转换装置，其特征在于，所述数据接口转换装置包括存储器和处理器；A data interface conversion device, characterized in that the data interface conversion device includes a memory and a processor;

所述存储器用于存储计算机程序；The memory is used to store computer programs;

所述处理器，用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：The processor is configured to execute the computer program, and when executing the computer program, implement the following steps:

获取图像数据包；Get image data package;

判断是否获取到数据包处理信号；Determine whether the data packet processing signal is obtained;

若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，以将所述图像数据包按所述目标数据格式所属的传输通道进行传输。If the data packet processing signal is obtained, the original data format of the image data packet is changed to the target data format according to the data packet processing signal, so as to transmit the image data packet according to the transmission channel to which the target data format belongs.
根据权利要求17所述的装置，其特征在于，所述处理器在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现：The apparatus according to claim 17, wherein the processor is configured to implement: when the original data format of the image data packet is changed to the target data format according to the data packet processing signal, the processor is configured to:

根据所述数据包处理信号将所述图像数据包从有效像素数据包的原数据格式改变到边带数据包的目标数据格式；Changing the image data packet from the original data format of the effective pixel data packet to the target data format of the sideband data packet according to the data packet processing signal;

和/或，根据所述数据包处理信号将所述图像数据包从边带数据包的原数据格式改变到有效像素数据包的目标数据格式。And/or, changing the image data packet from the original data format of the sideband data packet to the target data format of the effective pixel data packet according to the data packet processing signal.
根据权利要求18所述的装置，其特征在于，所述处理器在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现：The apparatus according to claim 18, wherein the processor is configured to implement: when the original data format of the image data packet is changed to the target data format according to the data packet processing signal, the processor is configured to:

采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。Use a multiplexer to obtain the data type information of the image data packet and obtain the data packet processing signal to change or maintain the original data of the image data packet according to the data type information and the data packet processing signal format.
根据权利要求19所述的装置，其特征在于，所述处理器在实现采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号时，用于实现：The apparatus according to claim 19, wherein the processor is configured to use a multiplexer to obtain the data type information of the image data packet and obtain the data packet processing signal to implement:

采用多路选择器获取所述图像数据包的数据类型信息作为第一输入信号；Using a multiplexer to obtain the data type information of the image data packet as the first input signal;

采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号；Using a multiplexer to obtain the target type information in the data packet processing signal as a second input signal, and using a multiplexer to obtain the enable selection information in the data packet processing signal as a third input signal;

根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号。Confirm selection of the first input signal or the second input signal as the target output signal according to the third input signal.
根据权利要求20所述的装置，其特征在于，所述处理器在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：22. The device according to claim 20, wherein the processor is configured to implement confirmation that the first input signal or the second input signal is selected as the target output signal according to the third input signal. :

若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号为边带数据包类型，所述目标类型信息对应的第二输入信号为有效像素数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a VOPB data packet, the first input signal corresponding to the data type information is a sideband data packet type, and the second input signal corresponding to the target type information is a valid pixel data packet type, and the use The third input signal corresponding to the information can be selected as a high-level signal or a low-level signal;

根据所述第三输入信号的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。According to the high-level signal or the low-level signal of the third input signal, the VOPB data packet is selected as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet Type, or, selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type.
根据权利要求21所述的装置，其特征在于，所述处理器在实现将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后用于实现：The device according to claim 21, wherein the processor is implementing the selection of the VOPB data packet as the first input signal as the target output signal, so that the data type information of the VOPB data packet is sideband data The packet type, or, the VOPB data packet is selected as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type, which is then used to implement:

将边带数据包类型的所述VOPB数据包采用边带数据处理模块进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；The VOPB data packet of the sideband data packet type is processed by a sideband data processing module to transmit the VOPB data packet according to the sideband data packet, wherein the dvpc signal in the VOPB data packet is represented by State the number of bytes contained in the data signal in the VOPB data packet;

或，将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。Or, the VOPB data packet of the effective pixel data packet type is processed by an effective pixel data processing module, so that the VOPB data packet is transmitted according to the effective pixel data packet.
根据权利要求22所述的装置，其特征在于，所述处理器在实现将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型时，用于实现：The device according to claim 22, wherein the processor is implementing the selection of the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is effective pixel data When the package type is used to achieve:

将所述第二输入信号对应的目标类型信息替换所述第一输入信号对应的数据类型信息；Replacing the target type information corresponding to the second input signal with the data type information corresponding to the first input signal;

将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。The replaced data type information is configured to the original frame position corresponding to the first input signal in the VOPB data packet, and the replaced data type information is configured into a valid pixel data packet format.
根据权利要求23所述的装置，其特征在于，所述处理器在实现将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后用于实现：The device according to claim 23, wherein the processor configures the replaced data type information to the original frame position of the first input signal in the VOPB data packet, and the The replaced data type information is configured into the format of a valid pixel data packet, which is then used to achieve:

将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。The update of the dvpc signal in the VOPB data packet after replacement is characterized as the number of pixels of the data signal in the updated VOPB data packet.
根据权利要求20所述的装置，其特征在于，所述处理器在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：22. The device according to claim 20, wherein the processor is configured to implement confirmation that the first input signal or the second input signal is selected as the target output signal according to the third input signal. :

若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号为有效像素数据包类型，所述目标类型信息对应的第二输入信号为边带数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a valid pixel data packet, the first input signal corresponding to the data type information is a valid pixel data packet type, and the second input signal corresponding to the target type information is a sideband data packet type, and The third input signal corresponding to the enabling selection information is a high-level signal or a low-level signal;

根据所述第三输入信号的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型。According to the high-level signal or the low-level signal of the third input signal, the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel The data packet type, or the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type.
根据权利要求25所述的装置，其特征在于，所述处理器在实现将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后用于实现：The device according to claim 25, wherein the processor implements the selection of the valid pixel data packet as the first input signal as the target output signal, so that the data type information of the valid pixel data packet is valid Pixel data packet type, or, the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, and then used to implement:

将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；The effective pixel data packet of the effective pixel data packet type is processed by the effective pixel data processing module to transmit the effective pixel data packet according to the effective pixel data packet, wherein the dvpc signal in the effective pixel data packet Characterized by the number of pixels included in the data signal in the effective pixel data packet;

或，将边带数据包类型的所述有效像素数据包采用边带数据处理模块进行处理，以将所述有效像素数据包按照边带数据包进行传输。Or, the effective pixel data packet of the sideband data packet type is processed by a sideband data processing module, so as to transmit the effective pixel data packet according to the sideband data packet.
根据权利要求26所述的装置，其特征在于，所述处理器在实现将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型时，用于实现：The device according to claim 26, wherein the processor implements the selection of the effective pixel data packet as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is edge With data packet type, it is used to realize:

将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。The target type information corresponding to the second input signal is configured into the effective pixel data packet, and configured into a sideband data packet format.
根据权利要求27所述的装置，其特征在于，所述处理器在实现将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后用于实现：The device according to claim 27, wherein the processor is configured to configure the target type information corresponding to the second input signal into the effective pixel data packet, and configure it in a sideband data packet format , And then used to achieve:

将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。The update of the dvpc signal in the effective pixel data packet after the configuration is updated is characterized as the number of bytes of the data signal in the updated effective pixel data packet.
根据权利要求20所述的装置，其特征在于，所述处理器在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：22. The device according to claim 20, wherein the processor is configured to implement confirmation that the first input signal or the second input signal is selected as the target output signal according to the third input signal. :

判断所述目标输出信号对应的数据包类型，其中，所述第一输入信号和第二输入信号所指示的数据包类型互不相同；Determining a data packet type corresponding to the target output signal, wherein the data packet types indicated by the first input signal and the second input signal are different from each other;

若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输；If the data packet type corresponding to the target output signal is an effective pixel data packet type, transmitting the image data packet of the effective pixel data packet type or the sideband data packet type through the transmission channel of the effective pixel data packet;

若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。If the data packet type corresponding to the target output signal is a sideband data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the sideband data packet transmission channel.
根据权利要求29所述的装置，其特征在于，所述处理器在实现若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输时，用于实现：The device according to claim 29, wherein the processor realizes that if the data packet type corresponding to the target output signal is an effective pixel data packet type, the effective pixel data packet type or the sideband data packet type is When the image data packet is transmitted through the transmission channel of the effective pixel data packet, it is used to realize:

将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块进行处理，再通过有效像素数据包的传输通道进行传输。The image data packet of the effective pixel data packet type or the sideband data packet type is sent to the effective pixel data processing module for processing, and then transmitted through the transmission channel of the effective pixel data packet.
根据权利要求29所述的装置，其特征在于，所述处理器在实现若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输时，用于实现：The device according to claim 29, wherein the processor realizes that if the data packet type corresponding to the target output signal is a sideband data packet type, the effective pixel data packet type or the sideband data packet type When the image data packet is transmitted through the transmission channel of the sideband data packet, it is used to realize:

将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块进行处理，再通过边带数据包的传输通道进行传输。The image data packet of the effective pixel data packet type or the sideband data packet type is sent to the sideband data processing module for processing, and then transmitted through the transmission channel of the sideband data packet.
根据权利要求20、29、30或31任一项所述的装置，其特征在于，所述处理器在实现采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号时，用于实现：The device according to any one of claims 20, 29, 30 or 31, wherein the processor uses a multiplexer to obtain the target type information in the data packet processing signal as the second input signal. , And when a multiplexer is used to obtain the enable selection information in the data packet processing signal as the third input signal, it is used to achieve:

通过寄存器组产生所述第二输入信号和所述第三输入信号。The second input signal and the third input signal are generated through a register set.
一种图像数据传输方法，其特征在于，包括：An image data transmission method, characterized in that it comprises:

CSI控制器发送图像数据包；The CSI controller sends image data packets;

数据接口转换装置从所述CSI控制器获取图像数据包；The data interface conversion device obtains an image data packet from the CSI controller;

数据接口转换装置判断是否获取到数据包处理信号；The data interface conversion device judges whether a data packet processing signal is acquired;

若获取到数据包处理信号，数据接口转换装置根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式；If the data packet processing signal is acquired, the data interface conversion device changes the original data format of the image data packet to the target data format according to the data packet processing signal;

数据接口转换装置将所述图像数据包按所述目标数据格式所属的传输通道传输给图像数据处理装置。The data interface conversion device transmits the image data packet to the image data processing device according to the transmission channel to which the target data format belongs.
根据权利要求33所述的方法，其特征在于，所述数据接口转换装置根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，包括：The method according to claim 33, wherein the data interface conversion device changes the original data format of the image data packet to the target data format according to the data packet processing signal, comprising:

数据接口转换装置根据所述数据包处理信号将所述图像数据包从有效像素数据包的原数据格式改变到边带数据包的目标数据格式；The data interface conversion device changes the image data packet from the original data format of the effective pixel data packet to the target data format of the sideband data packet according to the data packet processing signal;

和/或，数据接口转换装置根据所述数据包处理信号将所述图像数据包从边带数据包的原数据格式改变到有效像素数据包的目标数据格式。And/or, the data interface conversion device changes the image data packet from the original data format of the sideband data packet to the target data format of the effective pixel data packet according to the data packet processing signal.
根据权利要求34所述的方法，其特征在于，所述数据接口转换装置根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式，包括：The method according to claim 34, wherein the data interface conversion device changes the original data format of the image data packet to the target data format according to the data packet processing signal, comprising:

数据接口转换装置采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。The data interface conversion device uses a multiplexer to obtain the data type information of the image data packet and obtains the data packet processing signal to change or maintain the image data according to the data type information and the data packet processing signal The original data format of the packet.
根据权利要求35所述的方法，其特征在于，所述数据接口转换装置采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，包括：The method according to claim 35, wherein said data interface conversion device uses a multiplexer to obtain data type information of said image data packet and obtain said data packet processing signal, comprising:

数据接口转换装置采用多路选择器获取所述图像数据包的数据类型信息作为第一输入信号；The data interface conversion device uses a multiplexer to obtain the data type information of the image data packet as the first input signal;

数据接口转换装置采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号；The data interface conversion device uses a multiplexer to obtain the target type information in the data packet processing signal as the second input signal, and uses a multiplexer to obtain the enable selection information in the data packet processing signal as the third input signal;

数据接口转换装置根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号。The data interface conversion device confirms selection of the first input signal or the second input signal as a target output signal according to the third input signal.
根据权利要求36所述的方法，其特征在于，所述数据接口转换装置根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，包括：35. The method of claim 36, wherein the data interface conversion device confirms to select the first input signal or the second input signal as the target output signal according to the third input signal, comprising:

若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号为边带数据包类型，所述目标类型信息对应的第二输入信号为有效像素数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a VOPB data packet, the first input signal corresponding to the data type information is a sideband data packet type, and the second input signal corresponding to the target type information is a valid pixel data packet type, and the use The third input signal corresponding to the information can be selected as a high-level signal or a low-level signal;

数据接口转换装置根据所述第三输入信号的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。The data interface conversion device selects the VOPB data packet as the first input signal as the target output signal according to the high-level signal or the low-level signal of the third input signal, so that the data type information of the VOPB data packet is The sideband data packet type, or the VOPB data packet is selected as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type.
根据权利要求37所述的方法，其特征在于，所述将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后包括：The method according to claim 37, wherein the selecting the VOPB data packet as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet type, or , Selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type, and then includes:

数据接口转换装置将边带数据包类型的所述VOPB数据包采用边带数据处理模块进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；The data interface conversion device processes the VOPB data packet of the sideband data packet type using a sideband data processing module to transmit the VOPB data packet according to the sideband data packet, wherein the dvpc in the VOPB data packet The signal is represented by the number of bytes included in the data signal in the VOPB data packet;

或，数据接口转换装置将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。Or, the data interface conversion device processes the VOPB data packet of the effective pixel data packet type using an effective pixel data processing module, so as to transmit the VOPB data packet according to the effective pixel data packet.
根据权利要求38所述的方法，其特征在于，所述将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，包括：The method according to claim 38, wherein the selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is a valid pixel data packet type, including :

数据接口转换装置将所述第二输入信号对应的目标类型信息替换所述第一输入信号对应的数据类型信息；The data interface conversion device replaces the target type information corresponding to the second input signal with the data type information corresponding to the first input signal;

数据接口转换装置将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。The data interface conversion device configures the replaced data type information to the original frame position of the first input signal in the VOPB data packet, and configures the replaced data type information into a valid pixel data packet format.
根据权利要求39所述的方法，其特征在于，所述将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后包括：The method according to claim 39, wherein the data type information after the replacement is configured to the original frame position of the first input signal in the VOPB data packet, and the data after the replacement is The type information is configured into the format of a valid pixel data packet, and then includes:

数据接口转换装置将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。The data interface conversion device updates the dvpc signal in the updated VOPB data packet to characterize the number of pixels contained in the data signal in the updated VOPB data packet.
根据权利要求36所述的方法，其特征在于，所述根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，包括：The method of claim 36, wherein the confirming selection of the first input signal or the second input signal as the target output signal according to the third input signal comprises:

若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号为有效像素数据包类型，所述目标类型信息对应的第二输入信号为边带数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a valid pixel data packet, the first input signal corresponding to the data type information is a valid pixel data packet type, and the second input signal corresponding to the target type information is a sideband data packet type, and The third input signal corresponding to the enabling selection information is a high-level signal or a low-level signal;

数据接口转换装置根据所述第三输入信号的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型。The data interface conversion device selects the effective pixel data packet as the first input signal as the target output signal according to the high-level signal or the low-level signal of the third input signal, so that the data type of the effective pixel data packet is The information is an effective pixel data packet type, or the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type.
根据权利要求41所述的方法，其特征在于，所述将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后包括：The method according to claim 41, wherein the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel data packet type Or, selecting the effective pixel data packet as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, and then includes:

数据接口转换装置将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；The data interface conversion device processes the effective pixel data packet of the effective pixel data packet type by using the effective pixel data processing module to transmit the effective pixel data packet according to the effective pixel data packet, wherein the effective pixel data packet The dvpc signal in is characterized as the number of pixels included in the data signal in the effective pixel data packet;

或，数据接口转换装置将边带数据包类型的所述有效像素数据包采用边带数据处理模块进行处理，以将所述有效像素数据包按照边带数据包进行传输。Or, the data interface conversion device uses a sideband data processing module to process the effective pixel data packet of the sideband data packet type, so as to transmit the effective pixel data packet according to the sideband data packet.
根据权利要求42所述的方法，其特征在于，所述将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，包括：The method according to claim 42, wherein the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is a sideband data packet type ,include:

数据接口转换装置将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。The data interface conversion device configures the target type information corresponding to the second input signal into the effective pixel data packet, and configures it into a sideband data packet format.
根据权利要求43所述的方法，其特征在于，所述将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后包括：The method according to claim 43, wherein the configuring the target type information corresponding to the second input signal into the effective pixel data packet and configuring it in a sideband data packet format, and then comprising:

数据接口转换装置将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。The data interface conversion device updates the dvpc signal in the effective pixel data packet after the configuration update and characterizes it as the number of bytes of the data signal in the updated effective pixel data packet.
根据权利要求36所述的方法，其特征在于，所述根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号，包括：The method of claim 36, wherein the confirming selection of the first input signal or the second input signal as the target output signal according to the third input signal comprises:

数据接口转换装置判断所述目标输出信号对应的数据包类型，其中，所述第一输入信号和第二输入信号所指示的数据包类型互不相同；The data interface conversion device determines the data packet type corresponding to the target output signal, wherein the data packet types indicated by the first input signal and the second input signal are different from each other;

若所述目标输出信号对应的数据包类型为有效像素数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输；If the data packet type corresponding to the target output signal is an effective pixel data packet type, the data interface conversion device transmits the image data packet of the effective pixel data packet type or the sideband data packet type through the transmission channel of the effective pixel data packet;

若所述目标输出信号对应的数据包类型为边带数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。If the data packet type corresponding to the target output signal is a sideband data packet type, the data interface conversion device transmits the image data packet of the effective pixel data packet type or the sideband data packet type through the sideband data packet transmission channel.
根据权利要求45所述的方法，其特征在于，所述若所述目标输出信号对应的数据包类型为有效像素数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输，包括：The method according to claim 45, wherein if the data packet type corresponding to the target output signal is an effective pixel data packet type, the data interface conversion device converts the effective pixel data packet type or the sideband data packet type The image data packet is transmitted through the transmission channel of the effective pixel data packet, including:

数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块进行处理，再通过有效像素数据包的传输通道进行传输。The data interface conversion device sends the image data packet of the effective pixel data packet type or the sideband data packet type to the effective pixel data processing module for processing, and then transmits it through the transmission channel of the effective pixel data packet.
根据权利要求45所述的方法，其特征在于，所述若所述目标输出信号对应的数据包类型为边带数据包类型，数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输，包括：The method according to claim 45, wherein if the data packet type corresponding to the target output signal is a sideband data packet type, the data interface conversion device converts the valid pixel data packet type or the sideband data packet type The image data packet is transmitted through the transmission channel of the sideband data packet, including:

数据接口转换装置将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块进行处理，再通过边带数据包的传输通道进行传输。The data interface conversion device sends the image data packet of the effective pixel data packet type or the sideband data packet type to the sideband data processing module for processing, and then transmits it through the transmission channel of the sideband data packet.
根据权利要求36、45、46或47任一项所述的方法，其特征在于，所述采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号，包括：The method according to any one of claims 36, 45, 46 or 47, wherein the multiplexer is used to obtain the target type information in the data packet processing signal as the second input signal, and multiple The way selector acquiring the enable selection information in the data packet processing signal as the third input signal includes:

数据接口转换装置通过寄存器组产生所述第二输入信号和所述第三输入信号。The data interface conversion device generates the second input signal and the third input signal through a register set.
一种图像数据传输装置，其特征在于，包括CSI控制器、数据接口转换装置和图像数据处理装置；An image data transmission device, characterized by comprising a CSI controller, a data interface conversion device, and an image data processing device;

所述CSI控制器发送图像数据包；The CSI controller sends an image data packet;

所述数据接口转换装置包括存储器和处理器；The data interface conversion device includes a memory and a processor;

所述存储器用于存储计算机程序；The memory is used to store computer programs;

所述处理器，用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：The processor is configured to execute the computer program, and when executing the computer program, implement the following steps:

从所述CSI控制器获取图像数据包；Obtaining image data packets from the CSI controller;

判断是否获取到数据包处理信号；Determine whether the data packet processing signal is obtained;

若获取到数据包处理信号，根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式；If a data packet processing signal is obtained, changing the original data format of the image data packet to the target data format according to the data packet processing signal;

将所述图像数据包按所述目标数据格式所属的传输通道传输给所述图像数据处理装置。The image data packet is transmitted to the image data processing device according to the transmission channel to which the target data format belongs.
根据权利要求49所述的装置，其特征在于，所述处理器在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现：The apparatus according to claim 49, wherein the processor is configured to implement: when the original data format of the image data packet is changed to the target data format according to the data packet processing signal, the processor is configured to:

根据所述数据包处理信号将所述图像数据包从有效像素数据包的原数据格式改变到边带数据包的目标数据格式；Changing the image data packet from the original data format of the effective pixel data packet to the target data format of the sideband data packet according to the data packet processing signal;

和/或，根据所述数据包处理信号将所述图像数据包从边带数据包的原数据格式改变到有效像素数据包的目标数据格式。And/or, changing the image data packet from the original data format of the sideband data packet to the target data format of the effective pixel data packet according to the data packet processing signal.
根据权利要求50所述的装置，其特征在于，所述处理器在实现根据所述数据包处理信号改变所述图像数据包的原数据格式到目标数据格式时，用于实现：The apparatus according to claim 50, wherein the processor is configured to implement: when the original data format of the image data packet is changed to the target data format according to the data packet processing signal, the processor is configured to:

采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号，以根据所述数据类型信息和所述数据包处理信号改变或维持所述图像数据包的原数据格式。Use a multiplexer to obtain the data type information of the image data packet and obtain the data packet processing signal to change or maintain the original data of the image data packet according to the data type information and the data packet processing signal format.
根据权利要求51所述的装置，其特征在于，所述处理器在实现采用多路选择器获取所述图像数据包的数据类型信息、并获取所述数据包处理信号时，用于实现：The device according to claim 51, wherein the processor is configured to use a multiplexer to obtain the data type information of the image data packet and obtain the data packet processing signal to implement:

采用多路选择器获取所述图像数据包的数据类型信息作为第一输入信号；Using a multiplexer to obtain the data type information of the image data packet as the first input signal;

采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号；Using a multiplexer to obtain the target type information in the data packet processing signal as a second input signal, and using a multiplexer to obtain the enable selection information in the data packet processing signal as a third input signal;

根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号。Confirm selection of the first input signal or the second input signal as the target output signal according to the third input signal.
根据权利要求52所述的装置，其特征在于，所述处理器在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：The device according to claim 52, wherein the processor is configured to implement confirmation that the first input signal or the second input signal is selected as the target output signal according to the third input signal. :

若所述图像数据包为VOPB数据包，所述数据类型信息对应的第一输入信号为边带数据包类型，所述目标类型信息对应的第二输入信号为有效像素数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a VOPB data packet, the first input signal corresponding to the data type information is a sideband data packet type, and the second input signal corresponding to the target type information is a valid pixel data packet type, and the use The third input signal corresponding to the information can be selected as a high-level signal or a low-level signal;

根据所述第三输入信号的高电平信号或低电平信号，将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型。According to the high-level signal or the low-level signal of the third input signal, the VOPB data packet is selected as the first input signal as the target output signal, so that the data type information of the VOPB data packet is a sideband data packet Type, or, selecting the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type.
根据权利要求53所述的装置，其特征在于，所述处理器在实现将所述VOPB数据包选择为第一输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为边带数据包类型，或，将所述VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型，之后用于实现：The apparatus according to claim 53, wherein the processor is implementing the selection of the VOPB data packet as the first input signal as the target output signal, so that the data type information of the VOPB data packet is sideband data The packet type, or, the VOPB data packet is selected as the second input signal as the target output signal, so that the data type information of the VOPB data packet is the effective pixel data packet type, which is then used to implement:

将边带数据包类型的所述VOPB数据包采用边带数据处理模块进行处理，以将所述VOPB数据包按照边带数据包进行传输，其中，所述VOPB数据包中的dvpc信号表征为所述VOPB数据包中data信号所包含的字节个数；The VOPB data packet of the sideband data packet type is processed by a sideband data processing module to transmit the VOPB data packet according to the sideband data packet, wherein the dvpc signal in the VOPB data packet is represented by State the number of bytes contained in the data signal in the VOPB data packet;

或，将有效像素数据包类型的所述VOPB数据包采用有效像素数据处理模块进行处理，以将所述VOPB数据包按照有效像素数据包进行传输。Or, the VOPB data packet of the effective pixel data packet type is processed by an effective pixel data processing module, so that the VOPB data packet is transmitted according to the effective pixel data packet.
根据权利要求54所述的装置，其特征在于，所述处理器在实现将所述 VOPB数据包选择为第二输入信号作为目标输出信号，使得所述VOPB数据包的数据类型信息为有效像素数据包类型时，用于实现：The device according to claim 54, wherein the processor is implementing the selection of the VOPB data packet as the second input signal as the target output signal, so that the data type information of the VOPB data packet is valid pixel data When the package type is used to achieve:

将所述第二输入信号对应的目标类型信息替换所述第一输入信号对应的数据类型信息；Replacing the target type information corresponding to the second input signal with the data type information corresponding to the first input signal;

将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式。The replaced data type information is configured to the original frame position corresponding to the first input signal in the VOPB data packet, and the replaced data type information is configured into a valid pixel data packet format.
根据权利要求55所述的装置，其特征在于，所述处理器在实现将替换后的数据类型信息配置到所述VOPB数据包中原来所述第一输入信号对应的帧位置，并将所述替换后的数据类型信息配置成有效像素数据包的格式，之后用于实现：The device according to claim 55, wherein the processor configures the replaced data type information to the original frame position of the first input signal in the VOPB data packet, and the The replaced data type information is configured into the format of a valid pixel data packet, which is then used to achieve:

将替换更新后的VOPB数据包中的dvpc信号更新表征为所述更新后的VOPB数据包中data信号所具有的像素个数。The update of the dvpc signal in the VOPB data packet after replacement is characterized as the number of pixels of the data signal in the updated VOPB data packet.
根据权利要求52所述的装置，其特征在于，所述处理器在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：The device according to claim 52, wherein the processor is configured to implement confirmation that the first input signal or the second input signal is selected as the target output signal according to the third input signal. :

若所述图像数据包为有效像素数据包，所述数据类型信息对应的第一输入信号为有效像素数据包类型，所述目标类型信息对应的第二输入信号为边带数据包类型，所述使能选择信息对应的第三输入信号为高电平信号或低电平信号；If the image data packet is a valid pixel data packet, the first input signal corresponding to the data type information is a valid pixel data packet type, and the second input signal corresponding to the target type information is a sideband data packet type, and The third input signal corresponding to the enabling selection information is a high-level signal or a low-level signal;

根据所述第三输入信号的高电平信号或低电平信号，将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型。According to the high-level signal or the low-level signal of the third input signal, the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is the effective pixel The data packet type, or the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type.
根据权利要求57所述的装置，其特征在于，所述处理器在实现将所述有效像素数据包选择为第一输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为有效像素数据包类型，或，将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型，之后用于实现：The device according to claim 57, wherein the processor realizes that the effective pixel data packet is selected as the first input signal as the target output signal, so that the data type information of the effective pixel data packet is valid Pixel data packet type, or, the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is the sideband data packet type, and then used to implement:

将有效像素数据包类型的所述有效像素数据包采用有效像素数据处理模块进行处理，以将所述有效像素数据包按照有效像素数据包进行传输，其中，所述有效像素数据包中的dvpc信号表征为所述有效像素数据包中data信号所包含的像素个数；The effective pixel data packet of the effective pixel data packet type is processed by the effective pixel data processing module to transmit the effective pixel data packet according to the effective pixel data packet, wherein the dvpc signal in the effective pixel data packet Characterized by the number of pixels included in the data signal in the effective pixel data packet;

或，将边带数据包类型的所述有效像素数据包采用边带数据处理模块进行处理，以将所述有效像素数据包按照边带数据包进行传输。Or, the effective pixel data packet of the sideband data packet type is processed by a sideband data processing module, so as to transmit the effective pixel data packet according to the sideband data packet.
根据权利要求58所述的装置，其特征在于，所述处理器在实现将所述有效像素数据包选择为第二输入信号作为目标输出信号，使得所述有效像素数据包的数据类型信息为边带数据包类型时，用于实现：The device according to claim 58, wherein the processor realizes that the effective pixel data packet is selected as the second input signal as the target output signal, so that the data type information of the effective pixel data packet is edge With data packet type, it is used to realize:

将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式。The target type information corresponding to the second input signal is configured into the effective pixel data packet, and configured into a sideband data packet format.
根据权利要求59所述的装置，其特征在于，所述处理器在实现将所述第二输入信号对应的目标类型信息配置到所述有效像素数据包中，并配置成边带数据包的格式，之后用于实现：The device according to claim 59, wherein the processor is configured to configure the target type information corresponding to the second input signal into the effective pixel data packet, and configure it in a sideband data packet format , And then used to achieve:

将配置更新后的有效像素数据包中的dvpc信号更新表征为所述更新后的有效像素数据包中data信号所具有的字节个数。The update of the dvpc signal in the effective pixel data packet after the configuration is updated is characterized as the number of bytes of the data signal in the updated effective pixel data packet.
根据权利要求52所述的装置，其特征在于，所述处理器在实现根据所述第三输入信号确认选择所述第一输入信号或所述第二输入信号作为目标输出信号时，用于实现：The device according to claim 52, wherein the processor is configured to implement confirmation that the first input signal or the second input signal is selected as the target output signal according to the third input signal. :

判断所述目标输出信号对应的数据包类型，其中，所述第一输入信号和第二输入信号所指示的数据包类型互不相同；Determining a data packet type corresponding to the target output signal, wherein the data packet types indicated by the first input signal and the second input signal are different from each other;

若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输；If the data packet type corresponding to the target output signal is an effective pixel data packet type, transmitting the image data packet of the effective pixel data packet type or the sideband data packet type through the transmission channel of the effective pixel data packet;

若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输。If the data packet type corresponding to the target output signal is a sideband data packet type, the image data packet of the effective pixel data packet type or the sideband data packet type is transmitted through the sideband data packet transmission channel.
根据权利要求61所述的装置，其特征在于，所述处理器在实现若所述目标输出信号对应的数据包类型为有效像素数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过有效像素数据包的传输通道进行传输时，用于实现：The device according to claim 61, wherein the processor realizes that if the data packet type corresponding to the target output signal is an effective pixel data packet type, the effective pixel data packet type or the sideband data packet type When the image data packet is transmitted through the transmission channel of the effective pixel data packet, it is used to realize:

将有效像素数据包类型或边带数据包类型的图像数据包发送给有效像素数据处理模块进行处理，再通过有效像素数据包的传输通道进行传输。The image data packets of the effective pixel data packet type or sideband data packet type are sent to the effective pixel data processing module for processing, and then transmitted through the effective pixel data packet transmission channel.
根据权利要求61所述的装置，其特征在于，所述处理器在实现若所述目标输出信号对应的数据包类型为边带数据包类型，将有效像素数据包类型或边带数据包类型的图像数据包通过边带数据包的传输通道进行传输时，用于实现：The device according to claim 61, wherein the processor realizes that if the data packet type corresponding to the target output signal is a sideband data packet type, the effective pixel data packet type or the sideband data packet type When the image data packet is transmitted through the transmission channel of the sideband data packet, it is used to realize:

将有效像素数据包类型或边带数据包类型的图像数据包发送给边带数据处理模块进行处理，再通过边带数据包的传输通道进行传输。The image data packet of the effective pixel data packet type or the sideband data packet type is sent to the sideband data processing module for processing, and then transmitted through the transmission channel of the sideband data packet.
根据权利要求52、61、62或63任一项所述的装置，其特征在于，所述处理器在实现采用多路选择器获取所述数据包处理信号中的目标类型信息作为第二输入信号，并采用多路选择器获取所述数据包处理信号中的使能选择信息作为第三输入信号时，用于实现：The device according to any one of claims 52, 61, 62 or 63, wherein the processor uses a multiplexer to obtain the target type information in the data packet processing signal as the second input signal. , And when a multiplexer is used to obtain the enable selection information in the data packet processing signal as the third input signal, it is used to achieve:

通过寄存器组产生所述第二输入信号和所述第三输入信号。The second input signal and the third input signal are generated through a register set.
根据权利要求49所述的装置，其特征在于，所述图像数据处理装置为ISP模块。The device according to claim 49, wherein the image data processing device is an ISP module.
根据权利要求50所述的装置，其特征在于，所述边带数据包包括VOPB数据包和EMBED数据包。The apparatus according to claim 50, wherein the sideband data packets include VOPB data packets and EMBED data packets.
根据权利要求50所述的装置，其特征在于，所述有效像素数据包的颜色格式包括RAW8格式和RAW10格式。The device according to claim 50, wherein the color format of the effective pixel data packet includes RAW8 format and RAW10 format.
根据权利要求60或63所述的装置，其特征在于，所述处理器将所述有效像素数据包通过边带数据包的传输通道传输给所述图像数据处理装置后，所述图像数据处理装置获取所述有效像素数据包的原始字节数据，以在所述有效像素数据包发生错误时，对错误的有效像素数据进行定位。The device according to claim 60 or 63, wherein after the processor transmits the effective pixel data packet to the image data processing device through a sideband data packet transmission channel, the image data processing device Obtain the original byte data of the effective pixel data packet, so as to locate the wrong effective pixel data when an error occurs in the effective pixel data packet.