CN109640045B - Chip and image processing method - Google Patents
Chip and image processing method Download PDFInfo
- Publication number
- CN109640045B CN109640045B CN201811564570.8A CN201811564570A CN109640045B CN 109640045 B CN109640045 B CN 109640045B CN 201811564570 A CN201811564570 A CN 201811564570A CN 109640045 B CN109640045 B CN 109640045B
- Authority
- CN
- China
- Prior art keywords
- data
- image
- width
- preset
- chip
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the invention relates to the technical field of chips, and provides a chip and an image processing method, wherein the chip comprises a microcontroller, and a data receiving end and an image processing module which are electrically connected with the microcontroller; a data receiving end receives original image data acquired by an image acquisition device; the method comprises the following steps that a microcontroller divides original image data into at least two parts of data according to a preset rule, wherein the two adjacent parts of data comprise repeated data; the image processing module carries out time-sharing processing on at least two parts of data under the control of the microcontroller to obtain an image corresponding to each part of data, and cuts out all the images corresponding to the repeated data in the time-sharing processing process to obtain a target image. The embodiment of the invention realizes the image processing by adopting the hardware resource of the time-sharing multiplexing chip in a time-sharing processing mode, can effectively reduce the overhead of line cache in the chip and saves the cost.
Description
Technical Field
The embodiment of the invention relates to the technical field of chips, in particular to a chip and an image processing method.
Background
With the development of monitoring technology, the resolution of video images is developing towards larger resolution. For large-resolution non-real-time image processing, the traditional method is to keep the maximum resolution which can be processed by a chip unchanged, and adjust the frame rate by changing the frequency, so as to save power consumption. However, the maximum resolution that the chip can process is related to the size of the line cache inside the chip, and obviously, the conventional method needs more line cache overhead, and the larger the downlink cache is at the same process level, the larger the chip area is, and further the chip cost is increased. Therefore, how to save the cost as much as possible on the basis of ensuring the image quality is a technical problem to be solved urgently by researchers.
Disclosure of Invention
The embodiment of the invention aims to provide a chip and an image processing method, which are used for reducing the overhead of line cache in the chip on the basis of ensuring the image quality.
In order to achieve the above purpose, the embodiment of the present invention adopts the following technical solutions:
in a first aspect, an embodiment of the present invention provides a chip, where the chip includes a microcontroller, and a data receiving end and an image processing module that are electrically connected to the microcontroller; the data receiving end is used for receiving the original image data acquired by the image acquisition device; the microcontroller is used for dividing the original image data into at least two parts of data according to a preset rule, wherein the two adjacent parts of data comprise repeated data; the image processing module is used for performing time-sharing processing on the at least two parts of data under the control of the microcontroller to obtain an image corresponding to each part of data, and cutting out all the images corresponding to the repeated data in the time-sharing processing process to obtain a target image.
In a second aspect, an embodiment of the present invention further provides an image processing method, which is applied to the chip described above, where the chip includes a microcontroller, and a data receiving end and an image processing module that are electrically connected to the microcontroller; the image processing method comprises the following steps: the data receiving end receives original image data collected by the image collecting device; the microcontroller divides the original image data into at least two parts of data according to a preset rule, wherein the two adjacent parts of data comprise repeated data; the image processing module performs time-sharing processing on the at least two parts of data under the control of the microcontroller to obtain an image corresponding to each part of data, and cuts out all images corresponding to the repeated data in the time-sharing processing process to obtain a target image.
Compared with the prior art, the chip and the image processing method provided by the embodiment of the invention comprise the following steps that firstly, original image data collected by an image collecting device is received through a data receiving end; then, the microcontroller divides the original image data into at least two parts of data according to a preset rule, and meanwhile, the two adjacent parts of data contain repeated data; then, the image processing module performs time-sharing processing on at least two parts of data to obtain an image corresponding to each part of data, and cuts out images corresponding to all the repeated data in the time-sharing processing process, so that a final target image is obtained. The embodiment of the invention realizes image processing by time-sharing processing mode and time-sharing multiplexing of hardware resources of the chip, can effectively reduce the overhead of line cache in the chip, saves cost, and simultaneously cuts out images corresponding to all repeated data in the image splicing process, thereby ensuring the smooth transition of the spliced image and effectively ensuring the image quality.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 shows a schematic structural diagram of a chip provided in an embodiment of the present invention.
Fig. 2 shows a schematic diagram of three screens provided by the embodiment of the present invention.
Fig. 3 shows a flowchart of an image processing method provided by an embodiment of the present invention.
Fig. 4 is a schematic diagram illustrating another structure of a chip according to an embodiment of the present invention.
Icon: 100. 200-chip; 10-an image acquisition device; 110-a data receiving end; 120-a microcontroller; 130-an image processing module; 140-memory.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present invention, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
First embodiment
Referring to fig. 1, fig. 1 is a schematic diagram illustrating a chip 100 according to an embodiment of the invention. The chip 100 may be a chip having an image processing capability, for example, a monitor chip, an image processing chip, or the like. The chip 100 is electrically connected to the image capturing device 10, the chip 100 includes a data receiving terminal 110, a microcontroller 120, an image processing module 130 and a memory 140, the data receiving terminal 110 is electrically connected to the image capturing device 10, the microcontroller 120 is electrically connected to both the data receiving terminal 110 and the image processing module 130, the data receiving terminal 110 is electrically connected to both the image processing module 130 and the memory 140, and the image processing module 130 is electrically connected to the memory 140.
In the present embodiment, the data receiving end 110 is electrically connected to the image capturing device 10 for receiving raw image data captured by the image capturing device 10, and the image capturing device 10 may be a camera, an image sensor, or the like. The raw image data is high resolution non-real time data acquired by the image acquisition device 10.
In this embodiment, the microcontroller 120 is configured to divide the original image data into at least two portions of data according to a preset rule, where two adjacent portions of data include repeated data. The preset rule includes a preset data processing width and a preset repeating data width, the preset repeating data width may be represented by padding num, and the data width of the repeating data is twice of the preset repeating data, that is, the data width of the repeating data may be represented by padding num × 2. The microcontroller 120 is further configured to divide the original image data into at least two portions of data according to a preset data processing width and a preset repeated data width, which will be described in detail below.
First, a data width required to be processed repeatedly may be determined according to a filtering radius of a filter in the image processing module 130, that is, a preset repeated data width, where the preset repeated data width may be represented by padding num. When the filter in the image processing module 130 performs filtering, filtering is performed according to points or blocks, and in order to avoid image boundaries caused by filtering differences at the boundaries, it is necessary to increase the repeated processing data according to the filtering radius of the filter in the image processing module 130, for example, when there are two filters performing filtering according to blocks in the image processing module 130, the filtering radius of one filter is 3, and the filtering radius of the other filter is 5, the minimum preset repeated data width should be set to 8, that is, the padding num is 8. Meanwhile, when the preset repeated data width is determined, the data alignment operation needs to be considered.
Secondly, according to the maximum width that the chip 100 can process and the resolution of the original image data, calculating the number of the original image data that needs to be divided, that is, the number of the split screens of the image processing module 130 for processing the original image data in the split screens, for example, the chip 100 supports two million (1920x1080) resolution at most, on the premise that the image height is not limited, if the resolution of the original image data is four million (2688x1520), the original image data needs to be divided into at least two parts, that is, the original image data needs to be divided into at least two split screens, that is, a left half screen and a right half screen; if the resolution of the original image data is eight million (3840x2160), the original image data is divided into at least three parts, i.e., the original image data is divided into at least three divided screens, i.e., a left half screen, a middle half screen, and a right half screen.
It should be noted that, the above is the split screen processing on the premise that the chip 100 does not limit the image height, and if the chip 100 has a limit on the image height and the resolution of the original image data exceeds the limit height of the chip 100, the height of the original image data needs to be divided. For example, the chip 100 supports a maximum of two million (1920x1080) resolutions, while the chip 100 has a 1080 limitation on the image height, and if the resolution of the original image data is four million (2688x1520), the original image data is divided into at least four split screens, i.e., an upper left half screen, an upper right half screen, a lower left half screen, and a lower right half screen.
Next, a preset data processing width is determined according to a preset repeated data width padding num and the split screen number, where the preset data width is a width of each part of data obtained by splitting the original image data, that is, a data width processed by the image processing module 130 each time, two adjacent parts of the divided at least two parts of data include repeated data, and the data width of the repeated data is twice the preset repeated data width, that is, the data width of the repeated data is padding num 2. Taking the example that the original image data is divided into three divided screens, please refer to fig. 2, the right side of the left half screen and the left side of the middle half screen contain the repeated data with the preset repeated data width twice as wide as the data width, and the right side of the middle half screen and the left side of the right half screen contain the repeated data with the preset repeated data width twice as wide as the data width. The preset data processing width may be freely specified on the premise of not exceeding the maximum width that the chip 100 can process and satisfying the requirement of image alignment, and is not limited herein.
After the preset data processing width and the preset repeated data width are determined, the microcontroller 120 divides the original image data into at least two parts of data according to the preset data processing width and the preset repeated data width, where the at least two parts of data include the first data and other data except the first data. The first data is a part of data received by the data receiving end 110 earliest, that is, the timing at which the data receiving end 110 receives the first data is earlier than other data. For example, if the original image data is divided into two split screens, the first data is a left half screen and the other data is a right half screen; if the original image data is divided into three divided screens, the first data is a left half screen, and the other data is a middle half screen and a right half screen.
In this embodiment, the data receiving end 110 is further configured to transmit a first data of the divided at least two portions of data to the image processing module 130 and transmit other data except the first data of the at least two portions of data to the memory 140 under the control of the microcontroller 120. For example, if the original image data is divided into two split screens, the left half screen is transmitted to the image processing module 130, the right half screen is transmitted to the memory 140, and the image processing module 130 completes data processing of the right half screen within the vblank interval of the image capturing apparatus 10; if the original image data is divided into three divided screens, the left half screen is transmitted to the image processing module 130, the middle half screen and the right half screen are transmitted to the memory 140, and the image processing module 130 completes data processing of the middle half screen and the right half screen in the vblank interval of the image capturing apparatus 10.
Because the image capturing device 10 has a fixed time sequence, it can be roughly divided into two parts, namely, an effective data interval and a vblank interval, in the effective data interval of the image capturing device 10, the image processing module 130 processes the first data into a corresponding image, and meanwhile, in the vblank interval of the image capturing device 10, the image processing module 130 must sequentially read other data from the memory 140 and process the data into a corresponding image, otherwise, the original image data of the current frame is not processed, and the original image data of the next frame is transmitted, so that a frame loss situation occurs. The valid data interval and the vblank interval may be adjusted according to actual conditions, and are not limited herein, for example, the speed of the image capturing apparatus 10 transmitting the raw image data is 20 frames/second, the time for transmitting one frame of raw image data is 50 milliseconds, only 30 milliseconds may be in data transmission within the 50 milliseconds, 30 milliseconds may be referred to as a valid data interval, and the remaining 20 milliseconds may be referred to as a vblank interval.
In this embodiment, the image processing module 130 is configured to perform time-sharing processing on at least two portions of data under the control of the microcontroller 120 to obtain an image corresponding to each portion of data, and clip all images corresponding to the repeated data in the time-sharing processing process to obtain a target image. Since the at least two portions of data include the first data and other data except the first data, the image processing module 130 is further configured to sequentially read the other data from the memory 140 and process the other data into corresponding images under the control of the microcontroller 120 after processing the first data into corresponding images. For example, if the original image data is divided into two split screens, the image processing module 130 reads the right half screen from the memory 140 for processing after the left half screen processing is completed; if the original image data is divided into three divided screens, the image processing module 130 reads the middle half screen from the memory 140 for processing after the left half screen processing is completed, and reads the right half screen from the memory 140 for processing after the middle half screen processing is completed.
Meanwhile, in the process of processing the original image data in a time-sharing manner, the image processing module 130 needs to cut out images corresponding to all the repeated data in real time, so that a final target image can be obtained. In this embodiment, before the image processing module 130 performs data processing, the repeated data included in two adjacent portions of data is already determined, and is combined into fig. 2, the right side of the left half screen and the left side of the middle half screen include the repeated data with the preset repeated data width twice as wide as the data width, and the right side of the middle half screen and the left side of the right half screen include the repeated data with the preset repeated data width twice as wide as the data width, so after each portion of data is processed into an image, only the repeated data needs to be clipped, and because the repeated data corresponds to the adjacent images of the two portions of data, the two adjacent portions of images together need to clip the repeated data with the preset repeated data width (padding num × 2) twice as wide as the data width of the preset repeated data (padding num), that is, each portion of image only needs to clip the data with the preset repeated data width (padding num). For example, in fig. 2, data with a preset repeated data width (padding num) needs to be clipped on the right side of the left half screen, data with a preset repeated data width (padding num) needs to be clipped on both the left side and the right side of the middle half screen, and data with a preset repeated data width (padding num) needs to be clipped on the left side of the right half screen.
In other words, the image processing module 130 is further configured to crop the images corresponding to all the duplicated data to obtain the target image according to the processing timing sequence of the image corresponding to the first data and the images corresponding to the other data and the preset duplicated data width under the control of the microcontroller 120. For example, if the original image data is divided into three split screens, the image processing module 130 performs image processing according to the order of the left half screen, the middle half screen, and the right half screen, and cuts out the images corresponding to all the repeated data in real time in the processing process, that is, the image processing module 130 processes the left half screen into an image and cuts out the image corresponding to the preset repeated data width data on the right side of the left half screen; after the left half screen is processed, processing the middle half screen into an image and cutting out images corresponding to preset repeated data width data on two sides of the middle half screen; and after the middle half screen is processed, processing the right half screen into an image and cutting the image corresponding to the preset repeated data width data on the left side of the right half screen to obtain the target image. It should be noted that the process of cropping the image corresponding to the preset repeated data width data on the right side of the left half screen and the process of processing the middle half screen into the image are parallel, and similarly, the process of cropping the image corresponding to the preset repeated data width data on the two sides of the middle half screen and the process of processing the right half screen into the image are also parallel.
Meanwhile, in the process of cutting out the image corresponding to the preset repeated data width data from each partial image, other images except the image corresponding to the preset repeated data width data may be obtained from each partial image, for example, if the data width of the left half screen is 1920 and the preset repeated data width is 120, the process of cutting out the image corresponding to the preset repeated data width data on the right side of the left half screen may be to directly obtain the image corresponding to the data with the sequence number of 0 to 1800 after the left half screen is processed into the image, and not obtain the image corresponding to the data with the sequence number of 1801 to 1920.
In this embodiment, the image processing module 130 is further configured to obtain statistical information of the image corresponding to at least two portions of data one to one, and perform 3A calculation according to the statistical information to adjust image parameters of the target image, so that the target image achieves an optimal image in the current scene. In the implementation, the original image data is split, so that the statistical information is obtained in a split screen manner when being obtained, and the statistical information is obtained by combining the split screen information after being obtained.
Referring to fig. 3, fig. 3 is a flowchart illustrating an image processing method according to an embodiment of the invention. The image processing method is applied to the chip 100, and comprises the following steps:
in step S1, the data receiving terminal 110 receives the raw image data acquired by the image acquisition apparatus 10.
In the present embodiment, the image capturing device 10 may be a camera, an image sensor, or the like, and the raw image data is the large-resolution non-real-time data captured by the image capturing device 10.
In step S2, the microcontroller 120 divides the original image data into at least two portions of data according to a preset rule, where two adjacent portions of data include repeated data.
In this embodiment, the preset rule includes a preset data processing width and a preset repeated data width, and the microcontroller 120 divides the original image data into at least two parts of data according to the preset data processing width and the preset repeated data width. The at least two portions of data include the first data and other data except the first data, and the timing at which the data receiving end 110 receives the first data is earlier than the other data. For example, the original image data is divided into three divided screens, and the first data is the left half screen, and the other data is the middle half screen and the right half screen.
In this embodiment, the data receiving end 110 transmits the first data of the divided at least two portions of data to the image processing module 130 and transmits the other data except the first data of the at least two portions of data to the memory 140 under the control of the microcontroller 120. For example, the original image data is divided into three divided screens, the left half screen is transmitted to the image processing module 130, the middle half screen and the right half screen are transmitted to the memory 140, and the image processing module 130 completes the data processing of the middle half screen and the right half screen within the vblank interval of the image capturing apparatus 10.
In step S3, the image processing module 130 performs time-sharing processing on at least two portions of data under the control of the microcontroller 120 to obtain an image corresponding to each portion of data, and cuts out images corresponding to all the repeated data in the process of time-sharing processing to obtain a target image.
In this embodiment, since the at least two portions of data include the first data and other data except the first data, after the image processing module 130 processes the first data into a corresponding image, the other data are sequentially read from the memory 140 and processed into a corresponding image under the control of the microcontroller 120. For example, the original image data is divided into three divided screens, and the image processing module 130 reads the middle half screen from the memory 140 for processing after the left half screen processing is completed, and reads the right half screen from the memory 140 for processing after the middle half screen processing is completed.
In this embodiment, in the process of time-sharing processing the original image data, the image processing module 130 needs to cut out images corresponding to all the duplicated data in real time, so as to obtain a final target image. For example, if the original image data is divided into three divided screens, the image processing module 130 performs image processing according to the order of the left half screen, the middle half screen, and the right half screen, and cuts out all images corresponding to the repeated data in real time during the processing, that is, the image processing module 130 processes the left half screen into an image and cuts out an image corresponding to the preset repeated data width data on the right side of the left half screen; after the left half screen is processed, processing the middle half screen into an image and cutting out images corresponding to preset repeated data width data on two sides of the middle half screen; and after the middle half screen is processed, processing the right half screen into an image and cutting the image corresponding to the preset repeated data width data on the left side of the right half screen to obtain the target image. Meanwhile, the process of cutting the image corresponding to the preset repeated data width data on the right side of the left half screen and the process of processing the middle half screen into the image are parallel, and similarly, the process of cutting the image corresponding to the preset repeated data width data on the two sides of the middle half screen and the process of processing the right half screen into the image are also parallel.
It should be noted that, when the chip 100 is used to perform image processing, the data receiving end 110 may also transmit the original image data to the memory 140 under the control of the microcontroller 120; then, the microcontroller 120 divides the original image data into at least two parts of data according to the preset data processing width and the preset repeated data width, for example, if the original image data is divided into three split screens, the three parts of data include a left half screen, a middle half screen and a right half screen; next, the image processing module 130 reads the original image data from the memory 140 under the control of the microcontroller 120, and sequentially obtains at least two portions of data, for example, if the original image data is divided into three divided screens, the image processing module 130 first reads the left half screen from the memory 140 for processing, after the left half screen processing is completed, reads the middle half screen from the memory 140 for processing, and after the middle half screen processing is completed, reads the right half screen from the memory 140 for processing; meanwhile, the image processing module 130 clips the images corresponding to all the repeated data according to the processing time sequence of the images corresponding to at least two parts of data one by one and the preset repeated data width to obtain the target image, for example, if the original image data is divided into three split screens, the image processing module 130 performs image processing according to the order of the left half screen, the middle half screen and the right half screen, and clips the images corresponding to all the repeated data in real time in the processing process, that is, the image processing module 130 processes the left half screen into the images and clips the images corresponding to the preset repeated data width data on the right side of the left half screen; after the left half screen is processed, processing the middle half screen into an image and cutting out images corresponding to preset repeated data width data on two sides of the middle half screen; and after the middle half screen is processed, processing the right half screen into an image and cutting the image corresponding to the preset repeated data width data on the left side of the right half screen to obtain the target image.
Second embodiment
Referring to fig. 4, fig. 4 is a schematic structural diagram of a chip 200 according to an embodiment of the invention. The chip 200 is electrically connected to the image capturing device 10, the chip 200 includes a data receiving terminal 110, a microcontroller 120, an image processing module 130 and a memory 140, the data receiving terminal 110 is electrically connected to the image capturing device 10, the microcontroller 120 is electrically connected to both the data receiving terminal 110 and the image processing module 130, unlike the first embodiment, the data receiving terminal 110 is electrically connected to the memory 140, and the memory 140 is electrically connected to the image processing module 130 in the chip 200 provided in this embodiment.
In the present embodiment, the data receiving end 110 is electrically connected to the image capturing device 10, and is configured to receive raw image data captured by the image capturing device 10. The raw image data is high resolution non-real time data acquired by the image acquisition device 10. The data receiving end 110 is also used for transmitting the raw image data to the memory 140 under the control of the microcontroller 120.
In this embodiment, the microcontroller 120 is configured to divide the original image data into at least two portions of data according to a preset rule, where two adjacent portions of data include repeated data. The preset rule includes a preset data processing width and a preset repeated data width, that is, the microcontroller 120 is further configured to divide the original image data into at least two parts of data according to the preset data processing width and the preset repeated data width. For example, if the original image data is divided into two split screens, two pieces of data of the left half screen and the right half screen are included; if the original image data is divided into three split screens, three parts of data of a left half screen, a middle half screen and a right half screen are included. For the determination process of the preset data processing width and the preset repeated data width, reference is made to the first embodiment, and details are not described herein again.
In this embodiment, the image processing module 130 is configured to perform time-sharing processing on at least two portions of data under the control of the microcontroller 120 to obtain an image corresponding to each portion of data, and clip all images corresponding to the repeated data in the time-sharing processing process to obtain a target image. That is, the image processing module 130 is further configured to read the original image data from the memory 140 under the control of the microcontroller 120, and sequentially obtain at least two portions of data, for example, if the original image data is divided into two split screens, the image processing module 130 first reads the left half screen from the memory 140 for processing, and after the left half screen is processed, reads the right half screen from the memory 140 for processing; if the original image data is divided into three divided screens, the image processing module 130 first reads the left half screen from the memory 140 for processing, reads the middle half screen from the memory 140 for processing after the left half screen processing is completed, and reads the right half screen from the memory 140 for processing after the middle half screen processing is completed.
Meanwhile, in the process of processing the original image data in a time-sharing manner, the image processing module 130 needs to cut out images corresponding to all the repeated data in real time, so that a final target image can be obtained. That is, the image processing module 130 is further configured to crop the images corresponding to all the repeated data to obtain the target image according to the processing time sequence of the images corresponding to at least two portions of data one by one and the preset repeated data width under the control of the microcontroller 120. For example, if the original image data is divided into three split screens, the image processing module 130 performs image processing according to the order of the left half screen, the middle half screen, and the right half screen, and cuts out the images corresponding to all the repeated data in real time in the processing process, that is, the image processing module 130 processes the left half screen into an image and cuts out the image corresponding to the preset repeated data width data on the right side of the left half screen; after the left half screen is processed, processing the middle half screen into an image and cutting out images corresponding to preset repeated data width data on two sides of the middle half screen; and after the middle half screen is processed, processing the right half screen into an image and cutting the image corresponding to the preset repeated data width data on the left side of the right half screen to obtain the target image.
Referring to fig. 3, fig. 3 is a flowchart illustrating an image processing method according to an embodiment of the invention. The image processing method is applied to the chip 200, and comprises the following steps:
in step S1, the data receiving terminal 110 receives the raw image data acquired by the image acquisition apparatus 10.
In the present embodiment, the image capturing device 10 may be a camera, an image sensor, or the like, and the raw image data is the large-resolution non-real-time data captured by the image capturing device 10.
In step S2, the microcontroller 120 divides the original image data into at least two portions of data according to a preset rule, where two adjacent portions of data include repeated data.
In this embodiment, the preset rule includes a preset data processing width and a preset repeated data width, and the microcontroller 120 divides the original image data into at least two parts of data according to the preset data processing width and the preset repeated data width. For example, the original image data is divided into three divided screens, and includes three data portions of a left half screen, a middle half screen, and a right half screen.
In step S3, the image processing module 130 performs time-sharing processing on at least two portions of data under the control of the microcontroller 120 to obtain an image corresponding to each portion of data, and cuts out images corresponding to all the repeated data in the process of time-sharing processing to obtain a target image.
In this embodiment, the image processing module 130 reads the original image data from the memory 140 under the control of the microcontroller 120, and sequentially obtains at least two portions of data, for example, the original image data is divided into three divided screens, the image processing module 130 first reads the left half screen from the memory 140 for processing, after the left half screen is processed, reads the middle half screen from the memory 140 for processing, and after the middle half screen is processed, reads the right half screen from the memory 140 for processing. Meanwhile, in the process of processing the original image data in a time-sharing manner, the image processing module 130 needs to cut out images corresponding to all the repeated data in real time, so that a final target image can be obtained. For example, if the original image data is divided into three divided screens, the image processing module 130 performs image processing according to the order of the left half screen, the middle half screen, and the right half screen, and cuts out all images corresponding to the repeated data in real time during the processing, that is, the image processing module 130 processes the left half screen into an image and cuts out an image corresponding to the preset repeated data width data on the right side of the left half screen; after the left half screen is processed, processing the middle half screen into an image and cutting out images corresponding to preset repeated data width data on two sides of the middle half screen; and after the middle half screen is processed, processing the right half screen into an image and cutting the image corresponding to the preset repeated data width data on the left side of the right half screen to obtain the target image.
The chip and the image processing method provided by the embodiment of the invention have the following beneficial effects:
firstly, for large-resolution non-real-time original image data, dividing the original image data into at least two parts of data according to a preset data processing width and a preset repeated data width, so that the image processing module 130 performs time-sharing processing on the divided at least two parts of data, and the preset data processing width and the preset repeated data width can be freely specified, so that the limitation of the line cache inside a chip on the maximum width of the image which can be processed by the chip is removed, the expense of the line cache inside the chip is reduced, the area of the chip can be reduced to a certain extent under the condition of the same process level, and the cost is saved.
Secondly, by adding repeated data processing, time-sharing processing is carried out on at least two parts of data to obtain an image corresponding to each part of data, and images corresponding to all repeated data are cut in the time-sharing processing process to obtain a target image, so that matching and calibration actions in the image splicing process are reduced; meanwhile, by setting the width of the repeated data to be larger than the filtering radius in the image processing module 130, image boundaries possibly introduced at split screen positions by image splicing after split screen can be eliminated, smooth transition of target images is guaranteed, and further no loss of image quality is guaranteed.
In summary, in the chip and the image processing method provided in the embodiments of the present invention, the chip includes a microcontroller, and a data receiving end and an image processing module both electrically connected to the microcontroller; the data receiving end is used for receiving the original image data acquired by the image acquisition device; the system comprises a microcontroller, a storage unit and a processing unit, wherein the microcontroller is used for dividing original image data into at least two parts of data according to a preset rule, and the two adjacent parts of data comprise repeated data; and the image processing module is used for performing time-sharing processing on at least two parts of data under the control of the microcontroller to obtain an image corresponding to each part of data, and cutting out all the images corresponding to the repeated data in the time-sharing processing process to obtain a target image. The embodiment of the invention realizes image processing by time-sharing processing mode and time-sharing multiplexing of hardware resources of the chip, can effectively reduce the overhead of line cache in the chip, saves cost, and simultaneously cuts out images corresponding to all repeated data in the image splicing process, thereby ensuring the smooth transition of the spliced image and effectively ensuring the image quality.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
Claims (10)
1. A chip is characterized by comprising a microcontroller, a data receiving end and an image processing module, wherein the data receiving end and the image processing module are electrically connected with the microcontroller;
the data receiving end is used for receiving the original image data acquired by the image acquisition device;
the microcontroller is configured to divide the original image data into at least two portions of data according to a preset rule, where two adjacent portions of data include repeated data, the preset rule includes a preset data processing width and a preset repeated data width, the preset repeated data width is greater than a filtering radius of the image processing module, and the step of determining the preset data processing width is: calculating the split screen number of the original image data to be divided according to the maximum width which can be processed by the chip and the resolution of the original image data; determining the preset data processing width according to the preset repeated data width and the split screen number, wherein the preset data processing width is the width of each part of data after the original image data is divided;
the image processing module is used for performing time-sharing processing on the at least two parts of data under the control of the microcontroller to obtain an image corresponding to each part of data, and cutting out all the images corresponding to the repeated data in the time-sharing processing process to obtain a target image.
2. The chip of claim 1, wherein the chip further comprises a memory, the data receiving end is electrically connected to both the memory and the image processing module, and the image processing module is electrically connected to the memory;
the data receiving end is further used for transmitting first data in the at least two parts of data to the image processing module and transmitting other data except the first data in the at least two parts of data to the memory under the control of the microcontroller;
the image processing module is further configured to, after processing the first data into a corresponding image, sequentially read the other data from the memory under the control of the microcontroller and process the other data into a corresponding image.
3. The chip of claim 2, wherein the chip is further characterized by
The microcontroller is further configured to divide the original image data into the at least two portions of data according to a preset data processing width and a preset repeated data width, where the at least two portions of data include first data and other data except the first data.
4. The chip according to claim 3, wherein the image processing module is further configured to crop, under the control of the microcontroller, the images corresponding to all the duplicated data according to the processing timing sequence of the image corresponding to the first data and the images corresponding to the other data and the preset duplicated data width to obtain the target image.
5. The chip of claim 1, wherein the chip further comprises a memory, the data receiving end is electrically connected to both the memory and the image processing module, and the image processing module is electrically connected to the memory;
the data receiving end is also used for transmitting the original image data to the memory under the control of the microcontroller;
the image processing module is further configured to read the original image data from the memory under the control of the microcontroller, and sequentially obtain the at least two portions of data.
6. The chip of claim 1, wherein the chip further comprises a memory, the data receiving end is electrically connected with the memory, and the memory is electrically connected with the image processing module;
the data receiving end is also used for transmitting the original image data to the memory under the control of the microcontroller;
the image processing module is further configured to read the original image data from the memory under the control of the controller, and sequentially obtain the at least two portions of data.
7. The chip of claim 5 or 6,
the microcontroller is further configured to divide the original image data according to a preset data processing width and a preset repeated data width to obtain the at least two portions of data.
8. The chip according to claim 7, wherein the image processing module is further configured to crop, under the control of the microcontroller, images corresponding to all the duplicated data according to the processing timing sequence of the images corresponding to the at least two portions of data one to one and the preset duplicated data width to obtain a target image.
9. The chip of claim 1, wherein the image processing module is further configured to obtain statistical information of an image corresponding to the at least two portions of data one to one, and perform 3A calculation according to the statistical information to adjust image parameters of the target image.
10. An image processing method applied to the chip according to any one of claims 1 to 9, the image processing method comprising:
the data receiving end receives original image data collected by the image collecting device;
the microcontroller divides the original image data into at least two parts of data according to a preset rule, wherein the two adjacent parts of data comprise repeated data, the preset rule comprises a preset data processing width and a preset repeated data width, the preset repeated data width is greater than the filtering radius of the image processing module, and the step of determining the preset data processing width is as follows: calculating the split screen number of the original image data to be divided according to the maximum width which can be processed by the chip and the resolution of the original image data; determining the preset data processing width according to the preset repeated data width and the split screen number, wherein the preset data processing width is the width of each part of data after the original image data is divided;
the image processing module performs time-sharing processing on the at least two parts of data under the control of the microcontroller to obtain an image corresponding to each part of data, and cuts out all images corresponding to the repeated data in the time-sharing processing process to obtain a target image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811564570.8A CN109640045B (en) | 2018-12-20 | 2018-12-20 | Chip and image processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811564570.8A CN109640045B (en) | 2018-12-20 | 2018-12-20 | Chip and image processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109640045A CN109640045A (en) | 2019-04-16 |
| CN109640045B true CN109640045B (en) | 2021-05-18 |
Family
ID=66075978
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811564570.8A Active CN109640045B (en) | 2018-12-20 | 2018-12-20 | Chip and image processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109640045B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4089254B2 (en) * | 2002-03-13 | 2008-05-28 | 富士ゼロックス株式会社 | Image processing device |
| US7616813B2 (en) * | 2004-08-18 | 2009-11-10 | Ricoh Company, Ltd. | Background area extraction in document layout analysis |
| CN105988469A (en) * | 2015-02-10 | 2016-10-05 | 苏州宝时得电动工具有限公司 | Automatic walking equipment |
| CN106791621A (en) * | 2016-12-06 | 2017-05-31 | 深圳市元征科技股份有限公司 | The monitored picture forming method and system of supervising device |
| CN108475416A (en) * | 2017-06-30 | 2018-08-31 | 深圳市大疆创新科技有限公司 | The method and apparatus for handling image |
-
2018
- 2018-12-20 CN CN201811564570.8A patent/CN109640045B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4089254B2 (en) * | 2002-03-13 | 2008-05-28 | 富士ゼロックス株式会社 | Image processing device |
| US7616813B2 (en) * | 2004-08-18 | 2009-11-10 | Ricoh Company, Ltd. | Background area extraction in document layout analysis |
| CN105988469A (en) * | 2015-02-10 | 2016-10-05 | 苏州宝时得电动工具有限公司 | Automatic walking equipment |
| CN106791621A (en) * | 2016-12-06 | 2017-05-31 | 深圳市元征科技股份有限公司 | The monitored picture forming method and system of supervising device |
| CN108475416A (en) * | 2017-06-30 | 2018-08-31 | 深圳市大疆创新科技有限公司 | The method and apparatus for handling image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109640045A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE69825710T2 (en) | Audio-video decoding system | |
| CN103118247B (en) | Video data handling procedure and device, video cascade system and chip | |
| WO2019184822A1 (en) | Multi-media file processing method and device, storage medium and electronic device | |
| CN111698530A (en) | Video transmission method, device, equipment and computer readable storage medium | |
| CN114581856A (en) | Agricultural unit motion state identification method and system based on Beidou system and cloud platform | |
| CN106713762B (en) | Image processing method and device | |
| CN109640045B (en) | Chip and image processing method | |
| US20140015926A1 (en) | Image processing apparatus and image processing method and program | |
| CN104184977A (en) | Projection method and electronic equipment | |
| CN111314395A (en) | Image transmission method, terminal and storage medium | |
| EP3206387A1 (en) | Image dynamic range adjustment method, terminal, and storage media | |
| US20100322304A1 (en) | Multi-source filter and filtering method based on h.264 de-blocking | |
| CN110620874B (en) | Image processing method for parallel driving | |
| CN112887587A (en) | Self-adaptive image data fast transmission method capable of carrying out wireless connection | |
| CN101378507B (en) | Blocking effect removal system and method | |
| CN109874036B (en) | Video analysis method and device, equipment and storage medium | |
| CN109672869A (en) | A kind of time-sharing multiplex image processing apparatus, method and electronic equipment | |
| CN111277797B (en) | VR (virtual reality) stereoscopic imaging system for security monitoring | |
| CN113538268A (en) | Image processing method and device, computer readable storage medium and electronic device | |
| CN106961555B (en) | Data processing method and device | |
| CN108024121B (en) | Voice barrage synchronization method and system | |
| CN110753229A (en) | Video acquisition device and method based on H.265 coding | |
| CN114125299B (en) | Industrial camera and control method thereof | |
| CN117156300B (en) | Video stream synthesis method and device based on image sensor, equipment and medium | |
| CN113140001B (en) | Object scanner height expanding system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |