CN109348124B - Image transmission method, image transmission device, electronic equipment and storage medium - Google Patents
Image transmission method, image transmission device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109348124B CN109348124B CN201811281532.1A CN201811281532A CN109348124B CN 109348124 B CN109348124 B CN 109348124B CN 201811281532 A CN201811281532 A CN 201811281532A CN 109348124 B CN109348124 B CN 109348124B
- Authority
- CN
- China
- Prior art keywords
- image
- frame
- exposure
- exposure time
- original
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/743—Bracketing, i.e. taking a series of images with varying exposure conditions
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The application discloses an image transmission method, an image transmission device, electronic equipment and a storage medium. The method comprises the following steps: acquiring multiple frames of original images from an image sensor frame by frame, storing the acquired original images into a cache every time one frame of original image is acquired, synthesizing the stored frames of original images in the cache to obtain a target image, and sending the target image to an application processor through an interface between the cache and the application processor. Therefore, the target image is directly synthesized at the camera module end and is directly sent to the AP, the trouble of sending each frame of original image to the AP is avoided, the image data transmission quantity between the camera module and the AP is greatly reduced, and the target image is directly generated in the camera module, so that the AP does not need to synthesize the target image according to the received multi-frame original image, the efficiency of providing the target image by the AP is improved, and the preview or shooting efficiency of the target image can be improved.
Description
Technical Field
The present application relates to the field of image technologies, and in particular, to an image transmission method and apparatus, an electronic device, and a computer-readable storage medium.
Background
With the continuous development of mobile terminal technology, the functions of the mobile terminal are becoming more and more diversified, wherein the photographing function has become one of the basic functions of the mobile terminal. At present, an original image is generally transmitted between a camera module in a mobile terminal and an Application Processor (AP) in the mobile terminal, and then the AP obtains a target image according to the original image.
However, in a scene requiring a plurality of frames of original images to synthesize a target image, for example, a High-Dynamic Range (HDR) image is captured by a mobile terminal. In the related art, each frame of the original image is usually transmitted to the AP through a Mobile Industry Processor Interface (MIPI Interface) between the camera module and the AP. Then, the AP synthesizes the received multi-frame original images to obtain a high dynamic range image. However, due to the influence of the data transmission rate of the MIPI interface between the camera module and the AP, the time required for displaying a high-dynamic image in the preview interface of the mobile terminal is long, and each frame of original image is transmitted to the AP, so that the data transmission amount between the camera module and a is large.
Disclosure of Invention
The object of the present application is to solve at least to some extent one of the above mentioned technical problems.
To this end, a first object of the present application is to propose an image transmission method. The method directly synthesizes the target image at the camera module end and directly sends the target image to the AP, avoids the trouble of sending each frame of original image to the AP, greatly reduces the image data transmission quantity between the camera module and the AP, and directly generates the target image in the camera module, so that the AP does not need to synthesize the target image according to the received multi-frame original image, improves the efficiency of providing the target image by the AP, and further can improve the preview or shooting efficiency of the target image.
A second object of the present application is to provide an image transmission apparatus.
A third object of the present application is to provide an electronic device.
A fourth object of the present application is to propose a computer readable storage medium.
A fifth object of the present application is to propose a computer program product.
In order to achieve the above object, an embodiment of the first aspect of the present application provides an image transmission method, including: acquiring a plurality of frames of original images from an image sensor frame by frame; every time a frame of original image is acquired, storing the acquired original image into a cache; in the cache, synthesizing the stored original images of each frame to obtain a target image; and sending the target image to an application processor through an interface between a cache and the application processor.
In order to achieve the above object, an embodiment of a second aspect of the present application provides an image transmission apparatus, including: the acquisition module is used for acquiring a plurality of frames of original images from the image sensor frame by frame; the storage module is used for storing the obtained original image into a cache every time one frame of original image is obtained; the synthesis module is used for synthesizing the stored original images of each frame in the cache to obtain a target image; and the sending module is used for sending the target image to the application processor through an interface between the cache and the application processor.
In order to achieve the above object, an electronic device according to an embodiment of the third aspect of the present application includes a camera module and an application processor, where the camera module includes an image sensor, a cache, a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the cache communicates with the application processor through an interface, and the processor executes the computer program to implement the image transmission method according to the embodiment of the first aspect of the present application.
To achieve the above object, a non-transitory computer-readable storage medium is provided in an embodiment of a fourth aspect of the present application, on which a computer program is stored, and the computer program, when executed by a processor, implements the image transmission method according to the embodiment of the first aspect of the present application.
An embodiment of a fifth aspect of the present application provides a computer program product, which when executed by an instruction processor in the computer program product, performs the image transmission method described in the embodiment of the first aspect of the present application.
According to the image transmission method, the image transmission device and the electronic equipment, multiple frames of original images are acquired from an image sensor frame by frame, one frame of original image is acquired every time, the acquired original images are stored in the cache, the stored original images are synthesized in the cache to obtain a target image, and the target image is sent to the application processor through an interface between the cache and the application processor. Therefore, the target image is directly synthesized at the camera module end and is directly sent to the AP, the trouble of sending each frame of original image to the AP is avoided, the image data transmission quantity between the camera module and the AP is greatly reduced, and the target image is directly generated in the camera module, so that the AP does not need to synthesize the target image according to the received multi-frame original image, the efficiency of providing the target image by the AP is improved, and the preview or shooting efficiency of the target image can be improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow diagram of an image transmission method according to one embodiment of the present application;
FIG. 2 is a flow diagram of an image transmission method according to another embodiment of the present application;
FIG. 3 is an exemplary diagram I of an interaction process between a cache and an AP;
FIG. 4 is an exemplary diagram of the interaction process between the cache and the AP;
FIG. 5 is a schematic diagram of a configuration of an image transmission apparatus according to an embodiment of the present application;
FIG. 6 is a schematic diagram of the structure of an image transmission apparatus according to another embodiment of the present application;
FIG. 7 is a schematic structural diagram of an image transmission apparatus according to yet another embodiment of the present application;
FIG. 8 is a schematic structural diagram of an electronic device according to one embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
An image transmission method, an apparatus, an electronic device, and a computer-readable storage medium according to embodiments of the present application are described below with reference to the accompanying drawings.
Fig. 1 is a flowchart of an image transmission method according to an embodiment of the present application.
As shown in fig. 1, the image transmission method may include:
It should be noted that the image transmission method of the embodiment is applied to an image transmission device, and the image transmission device is located in a camera module.
The camera module is located in an electronic device, for example, the electronic device may be a personal computer, a mobile terminal, a portable device, or the like of a specific camera module.
And 103, synthesizing the stored original images of each frame in the cache to obtain a target image.
The target image may be, for example, a panoramic image, a high dynamic range image, or the like.
It should be noted that, this embodiment is described by taking the target image as the high dynamic range image as an example.
And 104, sending the target image to the application processor through an interface between the cache and the application processor.
As an example, the interface between the cache and the application processor is a MIPI interface.
Specifically, after the target image is synthesized by the multiple frames of original images in the cache, the target image can be sent to the application processor through an MIPI interface between the cache and the application processor. Correspondingly, the application processor may display the target image in the preview interface after acquiring the target image. Therefore, the target image is directly synthesized at the camera module end and is directly sent to the AP, the trouble of sending each frame of original image to the AP is avoided, the image data transmission quantity between the camera module and the AP is greatly reduced, the target image is directly generated in the camera module, the AP is enabled not to synthesize the target image according to the received multi-frame original image, the efficiency of providing the target image by the AP is improved, and the display efficiency of the target image can be improved.
For example, assuming that the frame transmission time interval of the interface transmission frame between the buffer and the application processor is 33 milliseconds, assuming that three original frames of images are required for synthesizing the HDR image, the three original frames of images can be acquired by the image sensor and stored in the buffer, then the three original frames of images in the buffer are synthesized to obtain the HDR image, and then the HDR image is directly transmitted through the interface between the buffer and the application processor, so that only 33ms of time is required between the camera module and the AP when the HDR image is captured by the camera module in the electronic device, and the HDR image can be obtained. Compared with the existing mode of transmitting each frame of original image to the AP and synthesizing the target image by the AP, the mode has the time of generating the target image for at least 99 ms. Based on the above analysis, it can be seen that the image transmission method of the embodiment directly transmits the HDR image, and the AP can obtain the HDR image by transmitting the time of one frame of the original image, so that the time required for previewing or shooting the HDR image is greatly reduced, and the previewing efficiency or shooting efficiency of the HDR image can be improved.
According to the image transmission method, multiple frames of original images are acquired from an image sensor frame by frame, each time one frame of original image is acquired, the acquired original images are stored in a cache, the stored original images are synthesized in the cache to obtain a target image, and the target image is sent to an application processor through an interface between the cache and the application processor. Therefore, the target image is directly synthesized at the camera module end and is directly sent to the AP, the trouble of sending each frame of original image to the AP is avoided, the image data transmission quantity between the camera module and the AP is greatly reduced, and the target image is directly generated in the camera module, so that the AP does not need to synthesize the target image according to the received multi-frame original image, the efficiency of providing the target image by the AP is improved, and the preview or shooting efficiency of the target image can be improved.
Furthermore, since the image transmission method of this embodiment requires a short time for buffering each frame of original image, the time interval between two frames of original images is short, and therefore, the offset between the images and the ghost in the target image when the images are synthesized are much smaller, thereby improving the image quality of the target image.
Moreover, because the time interval between the two frames of original images is short, in the process of synthesizing the target image, the alignment and the de-ghosting processing of the frames of original images are not needed, and the image processing efficiency can be improved compared with the mode of synthesizing the target image at the AP end.
It should be noted that, in the process of synthesizing the target image at the AP end in the related art, since an interval between two frames of images is large (for example, a frame transmission time interval is 33 milliseconds), alignment and de-ghosting processing are required in the process of synthesizing the target image (especially, when the object is a moving object, or shooting is unstable (for example, a user uses a handheld mode, and the shooting process has jitter)).
Fig. 2 is a flowchart of an image transmission method according to another embodiment of the present application.
As shown in fig. 2, the image transmission method may include:
In order to improve the image quality, the total exposure time required for capturing the multiple frames of original images may be determined by combining the light intensity value of the current ambient light, and in one embodiment of the present application, the determining the total exposure time required for capturing the multiple frames of original images may include:
and step A, acquiring the exposure time required by each frame of original image, wherein the exposure time required by each frame of original image is determined according to the light intensity value of the current ambient light.
It should be understood that the light intensity of the current ambient light may be obtained by the ambient light sensing device, or may be obtained by other means, for example, the light intensity value of the current ambient light is detected by the image sensor, and this embodiment is not limited thereto.
When the target image is an HDR image, after obtaining the light intensity value of the current ambient light, it is to be understood that the number of the original images with different exposure degrees that are captured may also be determined according to the light intensity value of the current ambient light.
It should be understood that, in different application scenarios, the exposure time required for acquiring each frame of original image is different, for example.
As an example, after the light intensity value of the current ambient light is obtained, the exposure time required for each frame of original image may be obtained according to the pre-stored corresponding relationship between the light intensity and the original images with different exposure intensities.
As another example, after the light intensity value of the current ambient light is known, a first exposure time required for the image sensor to capture the frame image original image of the target exposure may be determined according to the light intensity value, and then a second exposure time required for the image sensor to capture the original image of the first exposure and a third exposure time required for the image sensor to capture the original image of the second exposure may be determined according to the target exposure, a relationship between the first exposure and the second exposure, and the first exposure time, wherein the first exposure is higher than the target exposure and the second exposure is lower than the target exposure.
For example, suppose three frames of images, namely a high-burst frame image, a middle-exposure frame image and a low-exposure frame image, need to be captured in order to display an HDR image on a preview interface, and suppose that the correspondence between the exposure levels of the high-burst frame image, the middle-exposure frame image and the low-exposure frame image is 0.5EV, +1EV, +1.5 EV. Assuming that the original image corresponding to the target exposure is an intermediate exposure frame image, after the exposure time of the intermediate exposure frame image is determined according to the light intensity value of the current ambient light, the exposure time corresponding to the shot high explosion frame image and the shot low exposure frame image can be determined according to the corresponding relationship of the exposure degrees among the high explosion frame image, the intermediate exposure frame image and the low exposure frame image and the exposure time of the intermediate exposure frame image.
And step B, determining the total exposure time required for shooting the multiple frames of original images according to the exposure time required for each frame of original image.
Wherein, the frame transmission interval time is determined according to the frame transmission interval time of the interface.
For example, assuming that the interface transmits each frame of image data for 33ms, the frame transmission interval time may be determined to be 33 ms.
And step 205, synthesizing the stored original images of each frame in the cache to obtain a target image.
For example, assuming that the frame transmission interval time is 33 milliseconds, three frames of images, namely a high-explosive frame image, a medium-exposure frame image and a low-exposure frame image, need to be shot in order to display an HDR image on a preview interface, and if it is determined that the total exposure time required for shooting the high-explosive frame image, the medium-exposure frame image and the low-exposure frame image is less than the frame transmission interval time, at this time, the high-explosive frame image, the medium-exposure frame image and the low-exposure frame image acquired by the image sensor may be stored in a cache, and the stored frames of original images are synthesized in the cache to obtain an HDR image, and the HDR image is sent to the application processor through an interface between the cache and the application processor. Therefore, the application processor can quickly obtain the HDR image, the trouble that the AP obtains a plurality of frames of original images and synthesizes the HDR image is avoided, the subsequent preview display efficiency is improved, the image data transmission quantity between the cache and the application processor can be greatly reduced by only transmitting the HDR image, the power consumption required by data transmission is reduced, and the cruising ability of the electronic equipment can be improved. Fig. 3 shows an example of an interaction process between the cache and the AP.
For another example, assuming that the frame transmission interval time is 33 milliseconds, two frames of images, namely a high-explosive frame image and a low-exposure frame image, need to be taken in order to display an HDR image on a preview interface, and if it is determined that the total exposure time required for taking the high-explosive frame image and the low-exposure frame image is less than the frame transmission interval time (33 milliseconds), at this time, the high-explosive frame image and the low-exposure frame image acquired by the image sensor may be stored in the cache, and the stored frames of original images are synthesized in the cache to obtain the HDR image, and the HDR image is sent to the application processor through an interface between the cache and the application processor. Therefore, the application processor can quickly obtain the HDR image, the trouble that the AP obtains a plurality of frames of original images and synthesizes the HDR image is avoided, the subsequent preview display efficiency is improved, the image data transmission quantity between the cache and the application processor can be greatly reduced by only transmitting the HDR image, the power consumption required by data transmission is reduced, and the cruising ability of the electronic equipment can be improved. An example of the interaction process between the cache and the AP is shown in fig. 4.
The image transmission method determines total exposure time required for shooting multiple frames of images with different exposure degrees, and when the total exposure time is determined to be smaller than frame transmission interval time, each time one frame of original image is obtained, the obtained original image is stored in a cache, all the stored frames of original images are synthesized in the cache to obtain a target image, and then the target image is obtained in one frame transmission interval time and is sent to an application processor through an interface between the cache and the application processor. Thus, only the target image needs to be initialized, and preview or shooting efficiency can be ensured while reducing the amount of transmitted image data.
Based on the above embodiment, when the number of the multiple frames of original images is greater than 3 frames, after the exposure time required for acquiring each frame of original image, the image transmission method may further include:
and step A, determining the maximum exposure time required by the image sensor to shoot two frames of original images according to the exposure time required by each frame of original image.
And step B, judging whether the maximum exposure time is less than the frame transmission interval time.
And step C, if the maximum exposure time is less than the frame transmission interval time, executing the step of judging whether the total exposure time is less than the frame transmission interval time.
It should be noted that, if it is determined that the maximum exposure time required for the image sensor to capture two frames of original images is greater than the frame transmission interval time, at this time, it may be controlled not to store each frame of image acquired by the image sensor in the buffer.
Corresponding to the image transmission methods provided by the above embodiments, an embodiment of the present application further provides an image transmission apparatus, and since the image transmission apparatus provided by the embodiment of the present application corresponds to the image transmission methods provided by the above embodiments, the embodiments of the image transmission method described above are also applicable to the image transmission apparatus provided by the embodiment, and are not described in detail in the embodiment.
Fig. 5 is a schematic structural diagram of an image transmission apparatus according to an embodiment of the present application.
As shown in fig. 5, the image transmission apparatus may include an acquisition module 110, a storage module 120, a composition module 130, and a transmission module 140, wherein:
the acquiring module 110 is configured to acquire multiple frames of original images from the image sensor frame by frame.
The storage module 120 is configured to store the acquired original image in a cache every time a frame of original image is acquired.
And a synthesizing module 130, configured to synthesize the stored original images of each frame in the cache to obtain a target image.
And a sending module 140, configured to send the target image to the application processor through an interface between the cache and the application processor.
In an embodiment of the present application, on the basis of fig. 5, as shown in fig. 6, the apparatus may further include:
the first determining module 150 is configured to determine a total exposure time required to capture multiple frames of original images, where the exposure degrees corresponding to the multiple frames of original images are different.
The first determining module 160 is configured to determine whether the total exposure time is less than the frame transmission interval time. Wherein, the frame transmission interval time is determined according to the frame transmission interval time of the interface.
The storage module 120 is specifically configured to: when the total exposure time is less than the frame transmission interval time, every time one frame of original image is acquired, the acquired original image is stored in a cache.
In an embodiment of the present application, the first determining module 150 is specifically configured to: the exposure time required to acquire each frame of the original image. The exposure time required by each frame of original image is determined according to the light intensity value of the current ambient light; and determining the total exposure time required for shooting the plurality of frames of original images according to the exposure time required for each frame of original image.
In an embodiment of the present application, when the number of the original images of the plurality of frames is greater than 3 frames, on the basis of fig. 6, as shown in fig. 7, the apparatus further includes:
and the second determining module 170 is configured to determine the maximum exposure time required for the image sensor to capture two frames of original images according to the exposure time required for each frame of original image.
The second determining module 180 is configured to determine whether the maximum exposure time is less than the frame transmission interval time before the first determining module determines whether the total exposure time is less than the frame transmission interval time.
The first determining module 160 is specifically configured to: and judging whether the maximum exposure time is less than the frame transmission interval time or not and judging whether the total exposure time is less than the frame transmission interval time or not.
The determining module 150 is specifically configured to: determining first exposure time required by an image sensor to shoot an original image of the target exposure according to the light intensity value; according to the target exposure, the relation between the first exposure and the second exposure and the first exposure time, determining a second exposure time required by the image sensor to shoot the original image with the first exposure and a third exposure time required by the image sensor to shoot the original image with the second exposure, wherein the first exposure is higher than the target exposure, and the second exposure is lower than the target exposure.
According to the image transmission device, a plurality of frames of original images are acquired from an image sensor frame by frame, each time one frame of original image is acquired, the acquired original images are stored in the cache, the stored original images are synthesized in the cache to obtain a target image, and the target image is sent to the application processor through an interface between the cache and the application processor. Therefore, the target image is directly synthesized at the camera module end, and the target image is directly sent to the AP, so that the trouble of sending original images of all original frames to the AP is avoided, the image data transmission quantity between the camera module and the AP is greatly reduced, and the target image is directly generated in the camera module, so that the AP does not need to synthesize the target image according to the received original images of multiple frames, the efficiency of providing the target image by the AP is improved, and the preview or shooting efficiency of the target image can be improved.
In order to implement the above embodiments, the present application further provides an electronic device.
FIG. 8 is a schematic structural diagram of an electronic device according to one embodiment of the present application.
As shown in fig. 8, the electronic device 5 may include: the camera module 10 may include an image sensor 100, a buffer memory 101, a memory 102, a processor 103, and a computer program 104 stored in the memory 102 and executable on the processor 103, the buffer memory 101 and the application processor 20 communicate with each other through an interface 105, and when the processor 103 executes the computer program 104, the image transmission method according to any of the above embodiments of the present application is implemented.
In order to achieve the above embodiments, the present application also proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the image transmission method of any of the above embodiments of the present application.
In the description of the present application, it is to be understood that the terms "first", "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (12)
1. An image transmission method, comprising:
acquiring a plurality of frames of original images from an image sensor frame by frame;
every time a frame of original image is acquired, storing the acquired original image into a cache;
in the cache, synthesizing the stored original images of each frame to obtain a target image;
sending the target image to an application processor through an interface between a cache and the application processor;
the image transmission method is applied to an image transmission device, the image transmission device is positioned in a camera module, the camera module further comprises the image sensor and the cache, and the image sensor is connected to the cache.
2. The method according to claim 1, wherein before storing the acquired original image in the buffer each time one frame of original image is acquired, further comprising:
determining the total exposure time required for shooting the multiple frames of original images, wherein the exposure degrees corresponding to each frame of original image are different;
judging whether the total exposure time is less than the frame transmission interval time or not; wherein the frame transmission interval time is determined according to the frame transmission interval time of the interface;
and if the total exposure time is less than the frame transmission interval time, determining to execute the step of storing the acquired original image into a cache every time one frame of original image is acquired.
3. The method of claim 2, wherein the determining a total exposure time required to capture the plurality of frames of original images comprises:
acquiring the exposure time required by each frame of original image; the exposure time required by each frame of original image is determined according to the light intensity value of the current ambient light;
and determining the total exposure time required for shooting the multiple frames of original images according to the exposure time required for each frame of original image.
4. The method according to claim 3, wherein after the exposure time required for acquiring each frame of original image when the number of the plurality of frames of original images is greater than 3 frames, the method further comprises:
determining the maximum exposure time required by the image sensor to shoot two frames of original images according to the exposure time required by each frame of original image;
before the determining whether the total exposure time is less than the frame transmission interval time, further comprising:
judging whether the maximum exposure time is less than the frame transmission interval time or not;
if the maximum exposure time is less than the frame transmission interval time, the step of judging whether the total exposure time is less than the frame transmission interval time is executed.
5. The method of claim 3, wherein the exposure time required to obtain each frame of original image comprises:
determining first exposure time required by the image sensor to shoot an original image of the target exposure according to the light intensity value;
and determining a second exposure time required by the image sensor to shoot the original image with the first exposure and a third exposure time required by the image sensor to shoot the original image with the second exposure according to the target exposure, the relationship between the first exposure and the second exposure and the first exposure time, wherein the first exposure is higher than the target exposure, and the second exposure is lower than the target exposure.
6. An image transmission apparatus, comprising:
the acquisition module is used for acquiring a plurality of frames of original images from the image sensor frame by frame;
the storage module is used for storing the obtained original image into a cache every time one frame of original image is obtained;
the synthesis module is used for synthesizing the stored original images of each frame in the cache to obtain a target image;
the sending module is used for sending the target image to the application processor through an interface between the cache and the application processor;
the image transmission device is positioned in the camera module, the camera module further comprises the image sensor and the cache, and the image sensor is connected to the cache.
7. The apparatus of claim 6, further comprising:
the first determining module is used for determining the total exposure time required by shooting the multiple frames of original images, wherein the exposure degrees corresponding to the multiple frames of original images are different;
the first judging module is used for judging whether the total exposure time is less than the frame transmission interval time or not; wherein the frame transmission interval time is determined according to the frame transmission interval time of the interface;
the storage module is specifically configured to:
and when the total exposure time is less than the frame transmission interval time, storing the acquired original image into a cache every time one frame of original image is acquired.
8. The apparatus of claim 7, wherein the first determining module is specifically configured to:
acquiring the exposure time required by each frame of original image; the exposure time required by each frame of original image is determined according to the light intensity value of the current ambient light;
and determining the total exposure time required for shooting the multiple frames of original images according to the exposure time required for each frame of original image.
9. The apparatus according to claim 8, further comprising, when the number of the plurality of original images is greater than 3 frames:
the second determining module is used for determining the maximum exposure time required by the image sensor for shooting two frames of original images according to the exposure time required by each frame of original image;
a second judging module, configured to judge whether the maximum exposure time is less than the frame transmission interval time before the first judging module judges whether the total exposure time is less than the frame transmission interval time;
the first judging module is specifically configured to: and judging whether the total exposure time is less than the frame transmission interval time or not after judging and knowing whether the maximum exposure time is less than the frame transmission interval time or not.
10. The apparatus of claim 8, wherein the first determining module is specifically configured to:
determining first exposure time required by the image sensor to shoot an original image of the target exposure according to the light intensity value;
and determining a second exposure time required by the image sensor to shoot the original image with the first exposure and a third exposure time required by the image sensor to shoot the original image with the second exposure according to the target exposure, the relationship between the first exposure and the second exposure and the first exposure time, wherein the first exposure is higher than the target exposure, and the second exposure is lower than the target exposure.
11. An electronic device, comprising: the camera module comprises an image sensor, a cache, a memory, a processor and a computer program which is stored on the memory and can run on the processor, the cache is communicated with the application processor through an interface, and when the processor executes the program, the image transmission method according to any one of claims 1 to 5 is realized.
12. A non-transitory computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing the image transmission method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811281532.1A CN109348124B (en) | 2018-10-23 | 2018-10-23 | Image transmission method, image transmission device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811281532.1A CN109348124B (en) | 2018-10-23 | 2018-10-23 | Image transmission method, image transmission device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109348124A CN109348124A (en) | 2019-02-15 |
| CN109348124B true CN109348124B (en) | 2021-06-11 |
Family
ID=65312545
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811281532.1A Active CN109348124B (en) | 2018-10-23 | 2018-10-23 | Image transmission method, image transmission device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109348124B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596843B (en) * | 2020-12-29 | 2023-07-25 | 北京元心科技有限公司 | Image processing method, device, electronic equipment and computer readable storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205608814U (en) * | 2016-04-15 | 2016-09-28 | 中国科学院上海技术物理研究所 | Augmented reality system based on zynq software and hardware concurrent processing |
| CN106027900A (en) * | 2016-06-22 | 2016-10-12 | 维沃移动通信有限公司 | Photographing method and mobile terminal |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101841662A (en) * | 2010-04-16 | 2010-09-22 | 华为终端有限公司 | Method for acquiring photo frame composite image by mobile terminal and mobile terminal |
| CN102420944B (en) * | 2011-04-25 | 2013-10-16 | 展讯通信（上海）有限公司 | High dynamic-range image synthesis method and device |
| EP2860957B1 (en) * | 2012-06-11 | 2020-11-18 | Sony Interactive Entertainment Inc. | Image capturing device, image capturing method and computer-readable recording medium |
| JP5782061B2 (en) * | 2013-03-11 | 2015-09-24 | レノボ・シンガポール・プライベート・リミテッド | Method for recognizing movement of moving object and portable computer |
| KR102149187B1 (en) * | 2014-02-21 | 2020-08-28 | 삼성전자주식회사 | Electronic device and control method of the same |
| CN103873772B (en) * | 2014-03-03 | 2016-03-02 | 努比亚技术有限公司 | Mobile terminal and image pickup method thereof |
| CN105049558B (en) * | 2015-07-03 | 2017-10-03 | 广东欧珀移动通信有限公司 | Terminal |
| CN105227858B (en) * | 2015-10-30 | 2019-03-05 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal |
| KR102603426B1 (en) * | 2016-06-27 | 2023-11-20 | 삼성전자주식회사 | Apparatus and method for processing an image |
| US9955085B2 (en) * | 2016-09-22 | 2018-04-24 | Apple Inc. | Adaptive bracketing techniques |
| CN107872558B (en) * | 2016-09-26 | 2020-05-15 | 福州瑞芯微电子股份有限公司 | Intelligent electronic equipment, image processing unit, image acquisition device and image acquisition method |
| CN107066400A (en) * | 2016-12-13 | 2017-08-18 | 深圳众思科技有限公司 | Signal processing method, device and the electronic equipment of electronic equipment |
| CN107205120B (en) * | 2017-06-30 | 2019-04-09 | 维沃移动通信有限公司 | A kind of processing method and mobile terminal of image |
| CN107277351A (en) * | 2017-06-30 | 2017-10-20 | 维沃移动通信有限公司 | The processing method and mobile terminal of a kind of view data |
| CN107707840A (en) * | 2017-10-27 | 2018-02-16 | 信利光电股份有限公司 | A kind of method of camera module and multilevel image data transmission |
| CN107729736B (en) * | 2017-10-27 | 2020-01-14 | Oppo广东移动通信有限公司 | Face recognition method and related product |
-
2018
- 2018-10-23 CN CN201811281532.1A patent/CN109348124B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205608814U (en) * | 2016-04-15 | 2016-09-28 | 中国科学院上海技术物理研究所 | Augmented reality system based on zynq software and hardware concurrent processing |
| CN106027900A (en) * | 2016-06-22 | 2016-10-12 | 维沃移动通信有限公司 | Photographing method and mobile terminal |
Non-Patent Citations (1)
| Title |
|---|
| 一种基于FPGA的多路视频合成及传输方法;王康景 等;《无线电通信技术》;20161221;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109348124A (en) | 2019-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109089053B (en) | Image transmission method, image transmission device, electronic equipment and storage medium | |
| US11228720B2 (en) | Method for imaging controlling, electronic device, and non-transitory computer-readable storage medium | |
| US7671892B2 (en) | Image sensing apparatus, and control method, program, and storage medium of image sensing apparatus | |
| EP3723359B1 (en) | Image processing apparatus, method for image processing, and electronic device | |
| US20170085770A1 (en) | Mobile terminal photographing method and mobile terminal | |
| JP5719418B2 (en) | High dynamic range image exposure time control method | |
| WO2020057199A1 (en) | Imaging method and device, and electronic device | |
| CN110198418B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| EP1784008A2 (en) | Image-pickup device, image-pickup method, and program | |
| US20210160416A1 (en) | Method for imaging controlling, electronic device, and non-transitory computer-readable storage medium | |
| KR20150099302A (en) | Electronic device and control method of the same | |
| CN109167923B (en) | Image transmission method, image transmission device, electronic equipment and storage medium | |
| CN110213498B (en) | Image generation method and device, electronic equipment and computer readable storage medium | |
| CN112672060A (en) | Shooting method and device and electronic equipment | |
| EP3723360A1 (en) | Method for image-processing and electronic device | |
| WO2017086091A1 (en) | Image processing device, image processing method, and program | |
| JP2018160777A (en) | Imaging device and control method thereof, program, and storage medium | |
| CN110290325A (en) | Image processing method, device, storage medium and electronic equipment | |
| JP2020202489A (en) | Image processing device, image processing method, and program | |
| CN110958361B (en) | Image pickup apparatus capable of HDR composition, control method therefor, and storage medium | |
| CN109348124B (en) | Image transmission method, image transmission device, electronic equipment and storage medium | |
| CN111193867B (en) | Image processing method, image processor, photographing device and electronic equipment | |
| CN110266965B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN110266967B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN108881731B (en) | Panoramic shooting method and device and imaging equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |