CN117750182A - Shooting method and electronic equipment - Google Patents

Abstract

The application discloses a shooting method and electronic equipment, and belongs to the technical field of shooting. The method is applied to electronic equipment, the electronic equipment comprises a main control chip, an image sensor and an image processing chip, and the method comprises the following steps: inputting a first multi-exposure image frame sequence acquired by an image sensor to an image processing chip through a main control chip; processing the first multi-exposure image frame sequence through an image processing chip to obtain a second multi-exposure image frame sequence; and when receiving a shooting instruction, shooting according to the second multi-exposure image frame sequence.

Description

Shooting method and electronic equipment

Technical Field

The application belongs to the technical field of shooting, and particularly relates to a shooting method and electronic equipment.

Background

With the development of image technology in electronic devices, users have increasingly demanded shooting functions. For example, when a user photographs a moving object, it is generally desirable for the electronic device to be able to capture an image of the moving object at the moment of movement.

Since the photographic subject is moving, the electronic device needs to reduce motion blur in the image; in the related art, in order to reduce motion blur in an image, an electronic device may acquire a plurality of images with different exposure times, and then directly perform image fusion on the images with different exposure times, so as to obtain an image capable of retaining motion details and relatively clear.

However, when the environmental brightness of the electronic device changes greatly, the brightness change between each image frame in the plurality of different exposure images collected by the electronic device is also large, and at this time, the problem of image banding (banding) exists in the images obtained by direct fusion; for example, light and shade alternate banding, resulting in poor quality images captured by the electronic device.

Disclosure of Invention

The embodiment of the application aims to provide a shooting method and electronic equipment, which can improve the image quality of an image shot by the electronic equipment.

In a first aspect, an embodiment of the present application provides a photographing method, which is applied to an electronic device, where the electronic device includes a main control chip, an image sensor, and an image processing chip; the shooting method comprises the following steps: inputting a first multi-exposure image frame sequence acquired by an image sensor to an image processing chip through a main control chip; processing the first multi-exposure image frame sequence through an image processing chip to obtain a second multi-exposure image frame sequence; and when receiving a shooting instruction, shooting according to the second multi-exposure image frame sequence.

In a second aspect, an embodiment of the present application provides an electronic device, where the electronic device includes a main control chip, an image sensor, and an image processing chip; the main control chip is used for inputting a first multi-exposure image frame sequence acquired by the image sensor to the image processing chip. And the image processing chip is used for processing the first multi-exposure image frame sequence to obtain a second multi-exposure image frame sequence. And the main control chip is also used for shooting according to the second multiple exposure image frame sequence when receiving the shooting instruction.

In a third aspect, embodiments of the present application provide an electronic device further comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method as described in the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.

In a sixth aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executable by at least one processor to implement the method according to the first aspect.

In the embodiment of the application, the electronic equipment inputs a first multi-exposure image frame sequence acquired by the image sensor to the image processing chip through the main control chip; processing the first multi-exposure image frame sequence through an image processing chip to obtain a second multi-exposure image frame sequence; and when receiving a shooting instruction, shooting according to the second multi-exposure image frame sequence. In the scheme, after the electronic equipment acquires the first multi-exposure image frame sequence, the first multi-exposure image frame sequence can be processed to reduce or eliminate light and shade alternate barrier stripes in the fused image when the environmental brightness of the electronic equipment is greatly changed, so that the image quality of the image shot by the electronic equipment is improved; in addition, the electronic equipment independently processes the first multi-exposure image frame sequence through the image processing chip, so that the calculation pressure of a main control chip in the electronic equipment can be reduced, and the operation speed of the electronic equipment is improved.

Drawings

Fig. 1 is one example diagram of an electronic device provided in an embodiment of the present application;

FIG. 2 is a diagram illustrating a second example of an electronic device according to an embodiment of the present disclosure;

fig. 3 is one of flowcharts of a photographing method provided in an embodiment of the present application;

FIG. 4 is a second flowchart of a photographing method according to an embodiment of the present disclosure;

fig. 5 is a third flowchart of a photographing method according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

fig. 7 is a second schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or otherwise described herein, and that the objects identified by "first," "second," etc. are generally of a type and do not limit the number of objects, for example, the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The terms "at least one," "at least one," and the like in the description and in the claims of the present application mean that they encompass any one, any two, or a combination of two or more of the objects. For example, at least one of a, b, c (item) may represent: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", wherein a, b, c may be single or plural. Similarly, the term "at least two" means two or more, and the meaning of the expression is similar to the term "at least one".

The shooting method and the electronic device provided by the embodiment of the application are described in detail below through specific embodiments and application scenes thereof with reference to the accompanying drawings.

The shooting method and the electronic device provided by the embodiment of the application can be applied to a scene of displaying a shooting preview interface or a scene of shooting a moving object.

With the development of communication technology, functions in electronic devices are increasing. For example, an image containing a moving object is photographed. Currently, in a camera preview process, when a shooting object moves, due to the exposure time limitation of a camera image sensor, motion information of the shooting object cannot be effectively captured, so that an image containing the moving object shot by an electronic device is blurred. On the basis, the electronic equipment can shoot the shooting object through a multiple exposure strategy so as to ensure the image quality of the image of the moving object shot by the electronic equipment. The multiple exposure strategy can collect a plurality of exposure images, such as long exposure frame images, short exposure frame images, middle exposure frame images and the like, simultaneously in the process of previewing the camera, and fusion of the plurality of exposure images is carried out during algorithm processing, so that motion details can be kept, and relatively clear images are obtained.

However, when the electronic device is in a scene with larger ambient brightness variation, the brightness variation among each image frame in the plurality of exposure images acquired by the image sensor is also larger, and later-stage compensation is difficult to make up by an algorithm, so that the definition of the shot photo is poor, obvious difference exists between the shot photo and the brightness of the real scene, and the user experience is affected.

In the shooting method and the electronic device provided by the embodiment of the application, after the electronic device acquires the first multi-exposure image frame sequence, the first multi-exposure image frame sequence can be processed to reduce or eliminate the light and shade alternate banding strips in the fused image when the environmental brightness of the electronic device is greatly changed, so that the image quality of the image shot by the electronic device is improved; in addition, the electronic equipment independently processes the first multi-exposure image frame sequence through the image processing chip, so that the calculation pressure of a main control chip in the electronic equipment can be reduced, and the operation speed of the electronic equipment is improved.

The execution subject of the shooting method provided in the embodiment of the present application may be an electronic device, or a functional module in the electronic device. The technical solution provided in the embodiments of the present application will be described below by taking an electronic device as an example.

In the electronic device provided in the embodiment of the present application, as shown in fig. 1, exemplary electronic devices include, but are not limited to: an image sensor 11, an image processing chip 12 and a buffer queue 13.

Wherein, the image sensor 11 is configured to acquire a first multiple exposure image frame sequence, and input the first multiple exposure image frame sequence to the image processing chip 12 through a main control chip (not shown in fig. 1) in the electronic device; the image processing chip 12 is configured to process the first multiple exposure image frame sequence to obtain a second multiple exposure image frame sequence, and input the second multiple exposure image frame sequence to the buffer queue 13, where the buffer queue 13 is configured to store the second multiple exposure image frame sequence.

Illustratively, the first multi-exposure image frame sequence includes at least two exposure image frame sequences, and each of the at least two exposure image frame sequences includes at least two exposure image frames.

It should be noted that, the exposure time corresponding to each of the at least two exposure image frame sequences is different.

For example, the first multi-exposure image frame sequence may include 3 exposure image frame sequences, which are respectively a long exposure image frame sequence, a medium exposure image frame sequence and a short exposure image frame sequence.

The above-mentioned main control chip may be a CPU or a graphics processor (Graphics Processing Unit, GPU) in the electronic device, for example.

Optionally, in an embodiment of the present application, as shown in fig. 2, the image processing chip 12 includes: real Time Node (RTNode), virtual processing Node IC Node1, hereinafter referred to as ICNode1, IC Node2, hereinafter referred to as ICNode2, and dynamic random access memory (Dynamic Random Access Memory, DRAM).

Wherein, RTnode, is used for receiving the first multiple exposure image frame sequence that the main control chip sends;

the ICNode1 is configured to package the 3A processing command and the first multi-exposure image frame sequence after receiving the first multi-exposure image frame sequence, store the packaged 3A processing command and the first multi-exposure image frame sequence in a DRAM, and buffer a buffer queue (BufferQueue) 13 transmitted to the electronic device.

And the ICnode2 is used for carrying out image processing on the first multi-exposure image frame sequence based on a first algorithm after receiving the first multi-exposure image frame sequence, storing the processed image data into a DRAM and transmitting the processed image data to the buffer queue 13 for buffering.

Illustratively, the above image processing includes at least one of: image brightness compensation processing, frame insertion processing, image rejection processing, deblurring processing and the like. Specifically, the method can be determined according to actual use conditions, and the embodiment of the application is not limited.

Illustratively, the image processing chip may perform frame interpolation processing on each of the first multiple-exposure image frame sequences by using the ICNode2 to obtain a plurality of exposure image frame sequences of the first multiple-exposure image frame sequences, where the plurality of exposure image frame sequences correspond to the frame interpolation processing.

For example, the image processing chip may fuse the first multi-exposure image frame sequence with an image frame sequence obtained by performing frame interpolation according to the first multi-exposure image frame sequence to obtain a second multi-exposure image frame sequence.

According to the electronic device provided by the embodiment of the application, the image processing chip is added in the camera passage, the first multi-exposure image frame sequence output by the image sensor can be continuously input into the image processing chip through the main control chip, and algorithm processing in the main control chip is not needed. When the image definition of the image is poor due to the change of the environment, the image processing chip performs frame inserting, compensating, removing and deblurring processing on the first multi-exposure image frame sequence, so that the definition of the image output by the image processing chip is ensured, and the image quality of the image shot by the electronic equipment is improved

An embodiment of the present application provides a photographing method, and fig. 3 shows a flowchart of the photographing method provided in the embodiment of the present application. As shown in fig. 3, the photographing method provided in the embodiment of the present application may include the following steps 201 to 203.

Step 201, the electronic device inputs a first multi-exposure image frame sequence acquired by the image sensor to the image processing chip through the main control chip.

Alternatively, in the embodiment of the present application, the first multiple exposure image frame sequence may be one or more.

In one example, in the case where the first multiple exposure image frame sequence is one, exposure image frames of different exposure times may be included in the first multiple exposure image frame sequence. It is understood that one exposure image frame is one image.

For example, the one sequence of multiple exposure image frames may include at least two of a long exposure frame, a short exposure frame, and a medium exposure frame.

In another example, in the case where the plurality of first multiple-exposure image frame sequences are plural, each of the plurality of first multiple-exposure image frame sequences may correspond to one exposure time. For example, the exposure image frame sequence is three, namely a long exposure frame image sequence, a short exposure frame image sequence and a medium exposure frame image sequence; the long exposure frame image sequence comprises at least two frames of long exposure frame images, the short exposure frame image sequence comprises at least two short exposure frame images, and the medium exposure frame image sequence comprises at least two medium exposure frame images.

It should be noted that, the exposure time corresponding to the long exposure frame image, the short exposure frame image and the medium exposure frame image is an exposure time set in advance, and may be specifically determined according to the actual use situation, which is not limited in the embodiments of the present application.

Alternatively, in the embodiment of the present application, the image sensor may be a Complementary Metal Oxide Semiconductor (CMOS) image sensor or a Charge-coupled Device (CCD) image sensor.

In this embodiment of the present application, the image processing chip may be added to the camera path, so after the image sensor obtains the first multiple exposure image frame sequence, the electronic device may send the first multiple exposure image frame sequence to the main control chip, and then the main control chip inputs the first multiple exposure image frame sequence to the image processing chip.

The image processing chip may be an integrated circuit (Integrated Circuit, IC) chip, for example.

For example, the main control chip may sequentially input each of the first multiple exposure image frame sequences to the image processing chip in an acquisition order of the image frame sequences.

Illustratively, the master control chip may output the first sequence of multiple-exposure image frames to the image processing chip through a mobile communications industry processor interface (Mobile Industry Processor Interface, MIPI), and then the electronic device may control an RT node in the image processing chip to receive the first sequence of multiple-exposure image frames.

For example, assuming that the long exposure image frame sequence in the first multiple exposure image frame sequence includes 5 long exposure image frames, the main control chip may input the long exposure image frames to the image processing chip through the above MIPI frame-by-frame sequence according to the acquisition sequence of the 5 long exposure image frames until the long exposure image frames of the first frame are completely input to the image processing chip.

Optionally, in the embodiment of the present application, when the electronic device runs the camera application, the electronic device may control the image sensor to acquire and obtain the first multiple-exposure image frame sequence according to different exposure times.

Optionally, in the embodiment of the present application, after obtaining multiple exposure image frames through different exposure times, the electronic device may determine an exposure time sequence corresponding to the multiple exposure image frames according to the different exposure times, so as to obtain a first multiple exposure image frame sequence.

Illustratively, assume that an electronic device acquires 5-frame long-exposure image frames according to a long exposure time, and acquires 5-frame exposure image frames according to a medium exposure time, and 5-frame short-exposure image frames according to a short exposure time; the electronic device may then determine 5 frames of long exposure image frames as a long exposure image frame sequence, determine 5 frames of exposure image frames as a medium exposure image frame sequence, and determine 5 frames of short exposure image frames as a short exposure image frame sequence, thereby obtaining a first multiple exposure image frame sequence.

Alternatively, in the embodiment of the present application, after obtaining the first multiple-exposure image frame sequence, the electronic device may store the first multiple-exposure image frame sequence.

The electronic device may store the above-described first sequence of multiple-exposure image frames in a random access Memory (random access Memory, RAM) or a Read-Only Memory (ROM), for example.

For example, the electronic device may store the first sequence of multi-exposure image frames in RAM through any of an array, a map set, or a HashMap set.

Optionally, in the embodiment of the present application, the electronic device may start a motion shooting mode in the camera application based on input of a user, so as to obtain a first multi-exposure image frame sequence through the image sensor, and input the first multi-exposure image frame sequence to the image processing chip through the main control chip.

Step 202, the electronic device processes the first multi-exposure image frame sequence through the image processing chip to obtain a second multi-exposure image frame sequence.

In this embodiment of the present application, the electronic device may perform image processing on the first multiple-exposure image frame sequence through the ICNode2 in the image processing chip, and obtain the second multiple-exposure image frame sequence based on the first multiple-exposure image frame sequence after image processing.

For example, the electronic device may input the first multi-exposure image frame sequence into the icode 2, then obtain a processed first multi-exposure image frame sequence through a corresponding image processing algorithm in the icode 2, and fuse the first multi-exposure image frame sequence and the processed first multi-exposure image frame sequence to obtain a second multi-exposure image frame sequence.

Optionally, in an embodiment of the present application, the image processing algorithm includes, but is not limited to, at least one of the following: an image brightness compensation algorithm, a frame interpolation algorithm, an image rejection algorithm, a deblurring algorithm and the like.

Optionally, in an embodiment of the present application, the second multiple exposure image frame sequence includes at least two second exposure image frame sequences, and each second exposure image frame sequence of the at least two second exposure image frame sequences includes at least two exposure image frames.

It should be noted that, the exposure time corresponding to each of the at least two second exposure image frame sequences is different.

And 203, when receiving a shooting instruction, the electronic equipment shoots according to the second multi-exposure image frame sequence.

Alternatively, in the embodiment of the present application, the electronic device may receive the shooting instruction while displaying the shooting preview interface.

In the embodiment of the present application, the shooting instruction may be a shooting instruction generated by the electronic device based on an input of a user.

The input may be any of a manual input or a voice input, for example.

For example, the input may be a click input, a slide input, a preset track input, or a long press input of a shooting control in the shooting preview interface by a user. Alternatively, the input may be a combined input by the user to a physical case in the electronic device, such as a volume key and a power key; the method and the device can be specifically determined according to actual use conditions, and the embodiment of the application is not limited.

In this embodiment of the present application, after receiving the shooting instruction, the electronic device may perform image fusion on the second multiple-exposure image frame sequence to obtain the first image.

The electronic device may perform image fusion sequentially through the image processing chip according to the sequence of each second exposure image frame sequence in the second multiple exposure image frame sequence to obtain an image corresponding to each second exposure image frame sequence, and then perform image fusion on the image corresponding to each second exposure image frame sequence to obtain the first image.

Illustratively, it is assumed that the second multi-exposure image frame sequence includes a long-exposure image frame sequence, a medium-exposure image frame sequence, and a short-exposure image frame sequence; the long exposure image frame sequence comprises the following steps: 5-frame long exposure image frames; the medium exposure image frame sequence comprises the following steps: exposing an image frame in 5 frames; the short exposure image frame sequence comprises the following steps: 5 frames short exposure image frames. The image processing chip can sequentially perform image fusion on the 5-frame long-exposure image frames in the long-exposure image frame sequence to obtain a first long-exposure image frame; sequentially performing image fusion on exposure image frames in 5 frames in the middle exposure image frame sequence to obtain a first middle exposure image frame; sequentially performing image fusion on 5 short-exposure image frames in the short-exposure image frame sequence to obtain a first short-exposure image frame; then, the image processing chip may perform image fusion on the first long-exposure image frame, the first medium-exposure image frame, and the first short-exposure image frame to obtain a first image.

Optionally, in an embodiment of the present application, after obtaining the first image, the electronic device may delete the second sequence of multiple-exposure image frames.

Alternatively, in the embodiment of the application, after obtaining the first image, the electronic device may store the first image in the album application.

Illustratively, the foregoing step 203 is specifically explained below by way of specific examples, and may be specifically implemented by the following steps 21 and 22.

Step 21, the electronic device receives a first input.

In this application implementation, the first input is used to determine a shooting control from a shooting preview interface.

In this embodiment of the present application, the first input may be input by a user to a shooting control when the electronic device displays a shooting preview interface.

Optionally, in the embodiment of the present application, the first input may be a click input, a slide input, a voice input, or a preset track input of a shooting control by a user; alternatively, the first input may be a combined input of physical keys by the user, such as a volume key, a power key, and the like. Specifically, the method can be determined according to actual use conditions, and the embodiment of the application is not limited.

Step 22, the electronic device obtains a first image by shooting in response to the first input.

Optionally, in this embodiment of the present application, the first image is an image displayed on a preview interface at an input time of the first input.

Alternatively, in an embodiment of the present application, the electronic device may generate the first image based on a second sequence of multi-exposure image frames stored in the memory.

Alternatively, in the embodiment of the present application, after obtaining the first image, the electronic device may control the image sensor to stop acquiring the multiple exposure image frames.

In the shooting method provided by the embodiment of the application, the electronic equipment inputs a first multi-exposure image frame sequence acquired by the image sensor to the image processing chip through the main control chip; processing the first multi-exposure image frame sequence through an image processing chip to obtain a second multi-exposure image frame sequence; and when receiving a shooting instruction, shooting according to the second multi-exposure image frame sequence. In the scheme, after the electronic equipment acquires the first multi-exposure image frame sequence, the first multi-exposure image frame sequence can be processed to reduce or eliminate light and shade alternate barrier stripes in the fused image when the environmental brightness of the electronic equipment is greatly changed, so that the image quality of the image shot by the electronic equipment is improved; in addition, the electronic equipment independently processes the first multi-exposure image frame sequence through the image processing chip, so that the calculation pressure of a main control chip in the electronic equipment can be reduced, and the operation speed of the electronic equipment is improved.

Optionally, in the embodiment of the present application, when the electronic device inputs the first multi-exposure image frame sequence acquired by the image sensor to the image processing chip through the main control chip, the photographing method provided in the embodiment of the present application further includes the following step 301.

Step 301, the electronic device inputs a long burst image frame sequence in the first multiple exposure image frame sequence to a display screen of the electronic device for preview display.

In this embodiment of the present application, when the electronic device displays the shooting preview interface through the display screen, the electronic device may input the long-burst image frame sequence in the first multiple-exposure image frame sequence to the display screen of the electronic device through the main control chip, so as to perform preview display through the shooting preview interface.

The electronic device may control the MIPI interface in the image sensor through the main control chip, and send the long burst image frame sequence in the first multiple exposure image frame sequence to the display screen for preview display through the photographing preview interface.

Optionally, in the embodiment of the present application, the electronic device may sequentially display each frame of the long-burst image frame in the long-burst image frame sequence in the shooting preview interface.

Optionally, in the embodiment of the present application, the electronic device may perform image fusion on a long flare image frame in the long flare image frame sequence in the first multiple exposure image frame sequence, so as to display the long flare image frame in the shooting preview interface.

For example, before the electronic device receives the shooting instruction, the electronic device may display, in real time, an image after image fusion of long-burst image frames in the long-burst image frame sequence in the first multiple-exposure image frame sequence in the shooting preview interface.

In this way, the electronic device can display the long-burst image frame sequence in the first multi-exposure image frame sequence in the shooting preview interface, so that the blurring of the preview image caused by too short exposure time can be reduced, and the image quality of the preview image displayed by the electronic device is improved.

Optionally, in the embodiment of the present application, when the electronic device processes the first multiple exposure image frame sequence through the image processing chip to obtain the second multiple exposure image frame sequence, the photographing method provided in the embodiment of the present application further includes the following step 401.

And step 401, the electronic equipment inputs the long-burst image frame sequence in the second multi-exposure image frame sequence to a display screen of the electronic equipment for preview display.

In this embodiment of the present application, in a case where an electronic device displays a shooting preview interface through a display screen, the electronic device may input, through a main control chip, a long-burst image frame sequence in a second multiple-exposure image frame sequence cached in a cache queue to the display screen of the electronic device, so as to perform preview display through the shooting preview interface.

Optionally, in the embodiment of the present application, the electronic device may further send, through an MIPI interface in the image processing chip, a long-burst image frame sequence in the second multiple-exposure image frame sequence to the display screen, so as to perform preview display through a shooting preview interface.

Optionally, in the embodiment of the present application, the electronic device may sequentially display a long-burst image frame sequence in the second multiple-exposure image frame sequence in the shooting preview interface.

Optionally, in the embodiment of the present application, the electronic device may perform image fusion on a long-burst image frame in the long-burst image frame sequence in the second multiple-exposure image frame sequence, so as to display the long-burst image frame after image fusion in a shooting preview interface.

In this way, the electronic device can display the long-burst image frame sequence in the second multi-exposure image frame sequence in the shooting preview interface, so that the blurring of the preview image caused by too short exposure time can be reduced, and the image quality of the preview image displayed by the electronic device is improved.

Alternatively, in the embodiment of the present application, as shown in fig. 4 in conjunction with fig. 3, the above step 202 may be specifically implemented by the following step 202 a.

Step 202a, the electronic device performs frame interpolation processing on each image frame sequence in the first multiple exposure image frame sequence, so as to obtain a second multiple exposure image frame sequence.

In this embodiment of the present application, the electronic device may perform frame interpolation processing on each image frame sequence in the first multiple-exposure image frame sequence through the ICNode2 in the image processing chip, so as to obtain a first multiple-exposure image frame sequence after frame interpolation processing. Then, the image processing chip can obtain a second multi-exposure image frame sequence through the first multi-exposure image frame sequence and the first multi-exposure image frame sequence after the frame interpolation processing.

For example, the electronic device may sequentially perform image fusion on each image frame sequence in the first multi-exposure image frame sequence and each image frame sequence in the first multi-exposure image frame sequence after the frame interpolation processing, so as to obtain a second multi-exposure image frame sequence.

For example, the electronic device may sequentially input each of the first multiple-exposure image frame sequences into the icode 2, and then the icode 2 may obtain, through a frame interpolation algorithm, each of the first multiple-exposure image frame sequences after frame interpolation, which corresponds to each of the first multiple-exposure image frame sequences.

Alternatively, in the embodiment of the present application, after obtaining the second multiple-exposure image frame sequence, the electronic device may store the second multiple-exposure image frame sequence.

Optionally, in an embodiment of the present application, the electronic device may store image information corresponding to an exposure image frame included in each exposure image frame sequence in the second multiple exposure image frame sequence.

Alternatively, in the embodiment of the present application, the image information may include brightness information, exposure time, contrast information, resolution information, and the like.

Optionally, in the embodiment of the present application, the electronic device may package the 3A processing information corresponding to each of the second multiple-exposure image frame sequences and the image information corresponding to each of the second multiple-exposure image frame sequences, and store the packaged image information.

Optionally, in an embodiment of the present application, for one exposure image frame sequence in the first multiple exposure image frame sequence, the electronic device may perform image processing on a first exposure image frame in the one exposure image frame sequence based on a first N exposure image frames in the one exposure image frame sequence to obtain a processed first exposure image frame.

In this embodiment of the present application, the first exposure image frame is one frame in a multiple exposure image frame sequence.

In this embodiment of the present application, the first N exposure image frames of the first exposure image frame are N consecutive images located before the first exposure image frame.

For example, the image processing chip may perform image compensation processing on the first image frame based on the first N exposure image frames of the first exposure image frame to obtain the first exposure image frame after the image compensation processing.

For example, the image processing chip may perform image compensation processing on the first exposure image frame based on the first N exposure image frames of the first exposure image frame through a first algorithm, so as to obtain the first exposure image frame after the image compensation processing.

The first algorithm may be an artificial intelligence (Artificial Intelligence, AI) algorithm or a neural network algorithm, for example.

Optionally, in the embodiment of the present application, the electronic device may start from a preset position, control the image processing chip, and perform image compensation processing on a first exposure image frame after the preset position.

For example, the electronic device may control the image processing chip after the 10 th exposure image frame, and perform the image compensation process on the exposure image frame after the 10 th exposure frame.

For example, the 11 th frame is a first exposure image frame, and the electronic device may perform image compensation on the 11 th exposure image frame through an image compensation algorithm based on the first 10 exposure image frames to obtain an exposure image frame after image compensation.

It should be noted that, the electronic device may perform the same image compensation process on each exposure image frame sequence in the first multiple exposure image frame sequence in the above manner, and in order to avoid repetition, a description thereof is omitted here.

Alternatively, in the embodiment of the present application, the image processing chip may directly store the exposure image frame image before the 11 th exposure image frame without performing image compensation processing on the exposure image frame image.

It should be noted that, the electronic device may extract more image details from the previous N exposure image frames, and perform image compensation processing on the first exposure image frame, so as to ensure the image quality of the first exposure image frame after the image compensation processing.

In the embodiment of the application, the electronic equipment can independently process the image of the first multiple exposure image frame sequence based on the image processing chip, a main control chip in the electronic equipment is not needed, and resources of the main control chip are saved.

Optionally, in the embodiment of the present application, before the step 203, as shown in fig. 5, in conjunction with fig. 3, the photographing method provided in the embodiment of the present application further includes the following step 501.

Step 501, the electronic device inputs the second multi-exposure image frame sequence to a buffer queue of the electronic device for buffering.

Alternatively, in the embodiment of the present application, the electronic device may store the second multiple-exposure image frame sequence in a storage medium in the electronic device.

In the embodiment of the application, the electronic device inputs the second multiple exposure image frame sequence to the buffer queue of the electronic device for buffering through the image processing chip, so that the electronic device can quickly acquire the second multiple exposure image frame sequence, and the efficiency of generating the first image by the electronic device is further improved.

Optionally, as shown in fig. 6, the embodiment of the present application further provides an electronic device 90, including a processor 91 and a memory 92, where a program or an instruction capable of being executed on the processor 91 is stored in the memory 92, and the program or the instruction when executed by the processor 91 implements each step of the embodiment of the preview image display method, and the same technical effects can be achieved, so that repetition is avoided and no further description is given here.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 7 is a schematic hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 100 includes, but is not limited to: the electronic device further comprises a main control chip, an image sensor and an image processing chip, wherein the main control chip comprises a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110 and the like.

Those skilled in the art will appreciate that the electronic device 100 may further include a power source (e.g., a battery) for powering the various components, and that the power source may be logically coupled to the processor 110 via a power management system to perform functions such as managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 7 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

The main control chip is used for inputting a first multi-exposure image frame sequence acquired by the image sensor into the image processing chip. And the image processing chip is used for processing the first multi-exposure image frame sequence to obtain a second multi-exposure image frame sequence. And the main control chip is also used for shooting according to the second multiple exposure image frame sequence when receiving the shooting instruction.

The embodiment of the application provides electronic equipment, which can process a first multi-exposure image frame sequence after the electronic equipment acquires the first multi-exposure image frame sequence so as to reduce or eliminate light and shade alternate screening stripes in an image obtained by fusion when the environmental brightness of the electronic equipment is greatly changed, so that the image quality of the image shot by the electronic equipment is improved; in addition, the electronic equipment independently processes the first multi-exposure image frame sequence through the image processing chip, so that the calculation pressure of a main control chip in the electronic equipment can be reduced, and the operation speed of the electronic equipment is improved.

Optionally, in this embodiment of the present application, when the first multiple exposure image frame sequence acquired by the image sensor is input to the image processing chip through the main control chip, the main control chip is further configured to input the long-burst image frame sequence in the first multiple exposure image frame sequence to the display screen of the electronic device for preview display.

Optionally, in the embodiment of the present application, when the image processing chip processes the first multiple exposure image frame sequence to obtain the second multiple exposure image frame sequence, the main control chip is further configured to input the long-burst image frame sequence in the second multiple exposure image frame sequence to a display screen of the electronic device for preview display.

Optionally, in an embodiment of the present application, the image processing chip is further configured to perform frame interpolation processing on each image frame sequence in the first multiple exposure image frame sequence.

Optionally, in the embodiment of the present application, before shooting according to the second multiple exposure image frame sequence when the shooting instruction is received, the image processing chip is further configured to input the second multiple exposure image frame sequence into a buffer queue of the electronic device for buffering.

The electronic device provided in the embodiment of the present application can implement each process implemented by the above method embodiment, and can achieve the same technical effects, so that repetition is avoided, and details are not repeated here.

The beneficial effects of the various implementation manners in this embodiment may be specifically referred to the beneficial effects of the corresponding implementation manners in the foregoing method embodiment, and in order to avoid repetition, the description is omitted here.

It should be appreciated that in embodiments of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 109 may include volatile memory or nonvolatile memory, or the memory 109 may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (ddr SDRAM), enhanced SDRAM (Enhanced SDRAM), synchronous DRAM (SLDRAM), and Direct RAM (DRRAM). Memory 109 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

Processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, etc., and a modem processor that primarily processes wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the program or the instruction implement each process of the embodiment of the method, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes computer readable storage medium such as computer readable memory ROM, random access memory RAM, magnetic or optical disk, etc.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is used for running a program or an instruction, implementing each process of the above method embodiment, and achieving the same technical effect, so as to avoid repetition, and not repeated here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

The embodiments of the present application provide a computer program product stored in a storage medium, where the program product is executed by at least one processor to implement the respective processes of the foregoing shooting method embodiments, and achieve the same technical effects, and for avoiding repetition, a detailed description is omitted herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

Claims (10)

1. A shooting method applied to an electronic device, wherein the electronic device comprises a main control chip, an image sensor and an image processing chip, the method comprising:

inputting a first multi-exposure image frame sequence acquired by the image sensor to the image processing chip through the main control chip;

processing the first multi-exposure image frame sequence through the image processing chip to obtain a second multi-exposure image frame sequence;

and when receiving a shooting instruction, shooting according to the second multi-exposure image frame sequence.

2. The method of claim 1, wherein when a first sequence of multi-exposure image frames acquired by the image sensor is input to the image processing chip by the master chip, the method further comprises:

and inputting the long-burst image frame sequence in the first multi-exposure image frame sequence to a display screen of the electronic equipment through the main control chip for preview display.

3. The method of claim 1, wherein when processing the first sequence of multi-exposure image frames by the image processing chip to obtain a second sequence of multi-exposure image frames, the method further comprises:

And inputting the long-burst image frame sequence in the second multi-exposure image frame sequence to a display screen of the electronic equipment through the main control chip for preview display.

4. A method according to any one of claims 1 to 3, wherein said processing of said first sequence of multi-exposure image frames by said image processing chip comprises:

and respectively carrying out frame inserting processing on each image frame sequence in the first multi-exposure image frame sequence through the image processing chip.

5. The method of claim 1, wherein upon receiving the photographing instruction, prior to photographing in accordance with the second sequence of multi-exposure image frames, the method further comprises:

and inputting the second multi-exposure image frame sequence into a buffer queue of the electronic equipment for buffering through the image processing chip.

6. An electronic device is characterized by comprising a main control chip, an image sensor and an image processing chip;

the main control chip is used for inputting a first multi-exposure image frame sequence acquired by the image sensor to the image processing chip;

the image processing chip is used for processing the first multi-exposure image frame sequence to obtain a second multi-exposure image frame sequence;

And the main control chip is also used for shooting according to the second multiple exposure image frame sequence when receiving a shooting instruction.

7. The electronic device of claim 6, wherein when the first sequence of multiple exposure image frames acquired by the image sensor is input to the image processing chip by the main control chip, the main control chip is further configured to input a sequence of long burst image frames in the first sequence of multiple exposure image frames to a display screen of the electronic device for preview display.

8. The electronic device of claim 6, wherein when the image processing chip processes the first multi-exposure image frame sequence to obtain a second multi-exposure image frame sequence, the main control chip is further configured to input a long-burst image frame sequence in the second multi-exposure image frame sequence to a display screen of the electronic device for preview display.

9. The electronic device of any one of claims 6 to 8, wherein the image processing chip is further configured to perform frame interpolation processing on each of the first multiple-exposure image frame sequences, respectively.

10. The electronic device of claim 6, wherein the image processing chip is further configured to input the second sequence of multi-exposure image frames to a buffer queue of the electronic device for buffering prior to capturing in accordance with the second sequence of multi-exposure image frames upon receiving a capture instruction.