CN116668837B - Method for displaying thumbnail images and electronic device - Google Patents

Method for displaying thumbnail images and electronic device Download PDF

Info

Publication number
CN116668837B
CN116668837B CN202211467867.9A CN202211467867A CN116668837B CN 116668837 B CN116668837 B CN 116668837B CN 202211467867 A CN202211467867 A CN 202211467867A CN 116668837 B CN116668837 B CN 116668837B
Authority
CN
China
Prior art keywords
image
thumbnail
thumbnail image
shooting
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211467867.9A
Other languages
Chinese (zh)
Other versions
CN116668837A (en
Inventor
许集润
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202211467867.9A priority Critical patent/CN116668837B/en
Priority to PCT/CN2023/114173 priority patent/WO2024109207A1/en
Publication of CN116668837A publication Critical patent/CN116668837A/en
Application granted granted Critical
Publication of CN116668837B publication Critical patent/CN116668837B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/951Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application relates to the field of terminals, and provides a method for displaying thumbnail images and electronic equipment, wherein the method comprises the following steps: displaying a first display interface at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image; detecting a first operation of a first control, wherein the first operation is used for indicating to start shooting; in response to the first operation, saving the first thumbnail image in the album application and generating a second thumbnail image; detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting; in response to the second operation, the first thumbnail image, the second thumbnail image, and the third thumbnail image are sequentially displayed in the thumbnail display area, wherein the third thumbnail image has an image quality superior to that of the second thumbnail image. According to the technical scheme, the problem that the shooting response time of the electronic equipment is long can be solved, and the electronic equipment can rapidly display the thumbnail images.

Description

Method for displaying thumbnail images and electronic device
Technical Field
The present application relates to the field of terminals, and in particular, to a method and an electronic device for displaying thumbnail images.
Background
With the development of photographing functions in electronic devices, camera applications are becoming more and more widely used in electronic devices. In the camera application, after the electronic equipment finishes one shooting, thumbnail images are displayed in a shooting interface; the user typically views the thumbnail image as if one shot ended with the electronic device; the image content in the thumbnail image is consistent with the image content of the actual shooting image, and the image corresponding to the thumbnail image stored in the album can be searched according to the thumbnail image; at present, after the electronic equipment detects that a user bounces up the shooting control, the electronic equipment is triggered to generate a thumbnail image and a shooting image; the electronic equipment cannot display the thumbnail image at the moment of detecting the pop-up shooting control, namely the electronic equipment detects that the duration between the pop-up shooting control and the thumbnail image is too long; the shooting waiting time of the user is longer, so that the shooting experience of the user is poorer.
Therefore, how to display thumbnail images quickly and shorten the waiting time for shooting becomes a problem to be solved.
Disclosure of Invention
The application provides a method and electronic equipment for displaying thumbnail images, which can rapidly display the thumbnail images and improve shooting experience.
In a first aspect, a method for displaying thumbnail images is provided, applied to an electronic device, including:
Displaying a first display interface at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image, and the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images, the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time;
detecting a first operation of the first control, wherein the first operation is used for indicating to start shooting;
In response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing;
detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting;
And in response to the second operation, sequentially displaying the first thumbnail image, the second thumbnail image and a third thumbnail image in the thumbnail display area, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.
In one possible implementation, the first operation may be an operation of clicking on the shooting control, or the first operation may also be an operation of shooting through voice indication; or instruct to start shooting operation by other instructions; the present application is not limited in any way.
In one possible implementation, the second operation is an operation to pop up the shooting control; or the voice indicates the shooting ending operation; or the shooting operation is ended by other instructions.
It should be appreciated that the operation of bouncing the capture control may refer to an operation of the electronic device detecting that a user's finger has left the capture control; or the electronic device detects an operation of releasing the shooting control by the finger of the user, etc.
In one possible implementation, the image quality may include image detail information, image texture information, image brightness, or image quality assessment results obtained by any image quality assessment algorithm; the present application is not limited in any way.
In an embodiment of the present application, by dividing a photographing operation into a first operation (e.g., an operation of clicking a photographing control) and a second operation (e.g., an operation of bouncing the photographing control); triggering the electronic device to save a first thumbnail image (e.g., a false thumbnail image) and generate a second thumbnail image (e.g., a true thumbnail image) in the camera application when the electronic device detects the first operation; when the electronic device detects the second operation, sequentially displaying the first thumbnail image, the second thumbnail image, and the third thumbnail image (for example, thumbnail images obtained based on the captured image) in the display area of the display interface; since the first thumbnail image is rapidly triggered to be displayed after the second operation is detected; the thumbnail image can be displayed at the moment when the electronic equipment detects the second operation, so that the speed of shooting response is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
It should be noted that, in the embodiment of the present application, the first thumbnail image, the second thumbnail image, and the third thumbnail image may correspond to the same shot of the user; for the same shooting, displaying mutual exclusion among the first thumbnail image, the second thumbnail image and the third thumbnail image; for example, if the first thumbnail image is displayed in the display interface in the camera application, the second thumbnail image and the third thumbnail image are not displayed in the display interface; if the second thumbnail image is displayed in the display interface in the camera application program, the first thumbnail image and the third thumbnail image are not displayed in the display interface; if the third thumbnail image is displayed in the display interface in the camera application program, the first thumbnail image and the second thumbnail image are not displayed in the display interface; for example, at time T1, a first thumbnail image is displayed; displaying a second thumbnail image at time T2; displaying a third thumbnail image at a time T3; the time T1 is earlier than the time T2; time T2 is earlier than time T3.
With reference to the first aspect, in certain implementations of the first aspect, the first image processing includes downsampling processing; the second image processing has a higher algorithmic complexity than the first image processing.
In one possible implementation, the first image processing may include a downsampling process or a partial process of the ISP process; the second image processing may include multi-frame image fusion processing, ISP processing, and other software algorithms for image processing.
It will be appreciated that in embodiments of the application, the duration required for the first image processing is less than the duration required for the second image processing.
In certain implementations of the first aspect, the first thumbnail image is generated by performing a thumbnail process on the first preview image. For example, the first preview image is subjected to scaling processing based on the size of the thumbnail display area, and a first thumbnail image is generated.
With reference to the first aspect, in certain implementation manners of the first aspect, the method further includes:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
It should be understood that the third thumbnail image is obtained by scaling the first captured image based on the thumbnail display area; the first captured image does not need to be subjected to downsampling processing compared with the second thumbnail image; in addition, the first captured image may be an image based on a multi-frame Raw image fusion process; therefore, the image quality of the third thumbnail image is better than that of the second thumbnail image.
In the embodiment of the application, when the electronic equipment detects the operation of bouncing the shooting control, the electronic equipment is triggered to generate a first shooting image, and the first shooting image can be a shooting true image; by performing the scaling process on the first captured image, a third thumbnail image, that is, a thumbnail image of the first captured image can be obtained.
With reference to the first aspect, in certain implementation manners of the first aspect, the electronic device includes a storage module, where the storage module includes a first storage area, and further includes:
Performing replacement processing on the first thumbnail image of the first storage area through the second thumbnail image when the second thumbnail image is generated by the electronic device and the first captured image is not generated;
and when the electronic equipment generates the first shooting image, replacing the second thumbnail image of the first storage area through the first shooting image.
In an embodiment of the present application, after generating a second thumbnail image (e.g., a real thumbnail image), a first thumbnail image (e.g., a false thumbnail image) stored in the electronic device is directly replaced by the second thumbnail image, and after generating a first captured image (e.g., a captured image), a second thumbnail image (e.g., a real thumbnail image) stored in the electronic device is directly replaced by the first captured image; and storing the first thumbnail image, the second thumbnail image and the first thumbnail image, wherein the replacement processing is directly carried out in the embodiment of the application, so that the storage space of the electronic equipment occupied by the thumbnail images can be reduced.
In one possible implementation, the first preview image is scaled to generate the first thumbnail image.
It should be understood that, in the embodiment of the present application, since the second thumbnail image is a thumbnail image obtained by performing image processing based on a Raw image; the first thumbnail image is a thumbnail image obtained by directly scaling the preview image; since the preview image is typically lower in resolution than the Raw image captured by the image sensor, the image quality of the second thumbnail image is better than the image quality of the first thumbnail image.
In the embodiment of the application, after the electronic equipment detects the operation of clicking the shooting control, a flow of saving false thumbnail images in an album application program can be triggered; therefore, when the electronic equipment detects that the shooting control is sprung, false thumbnail images can be displayed in the display interface rapidly so as to respond to shooting operation of a user; the time length for waiting for shooting by the user is reduced, and the shooting experience of the user is improved.
With reference to the first aspect, in certain implementation manners of the first aspect, the method further includes:
Acquiring time information of detecting the first operation; and selecting the first image from a zero second delay queue in the electronic equipment based on the time information.
In one possible implementation, the time information at which the first operation is detected may be the same time as the first time.
With reference to the first aspect, in certain implementations of the first aspect, the second image processing includes a first algorithm processing and a second algorithm processing, the first algorithm being an algorithm of a first color space, the second algorithm being an algorithm of converting an image of the first color space into an image of a second color space, the generating a first captured image including:
performing first algorithm processing on the first image to obtain an image of the first color space;
fusing at least two frames of images in the first color space to obtain a fused image;
and carrying out second algorithm processing on the fusion image to generate the first shooting image.
In one possible implementation, the first algorithm is an algorithm of the Raw color space; the second algorithm is an algorithm that converts the Raw image to YUV color space.
It should be understood that the first captured image may refer to a true image generated by one photographing operation; the first captured image does not need to be subjected to downsampling processing as compared with the generation of the second thumbnail image; in addition, the first captured image may be an image based on a multi-frame Raw image fusion process; therefore, the image quality of the first captured image is better than that of the second thumbnail image; further, the image quality of the third thumbnail image obtained by performing the scaling processing based on the first captured image is superior to that of the second thumbnail image.
With reference to the first aspect, in certain implementations of the first aspect, the first operation is an operation of clicking on the first control; the second operation is an operation of bouncing the first control.
With reference to the first aspect, in certain implementations of the first aspect, the image quality includes image texture information or image brightness information.
In a second aspect, a method for displaying thumbnail images is provided, applied to an electronic device, including:
Displaying a first display interface at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time;
detecting a first operation of the first control, wherein the first operation is used for indicating to start shooting;
In response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing;
detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting;
Sequentially displaying the first thumbnail image and the second thumbnail image in the thumbnail display area in response to the second operation; and, generating a third thumbnail image having an image quality superior to the second thumbnail image;
Detecting a third operation on the first control before generating the third thumbnail image, the third operation being for instructing the start of shooting;
In response to the third operation, saving a fourth thumbnail image in the album application and generating a fifth thumbnail image; the fourth thumbnail image is generated by the second image through the first image processing; the fifth thumbnail image is generated by the second image through second image processing; the second image is an image acquired by the electronic equipment in real time at a second moment, and the second moment is later than the first moment;
Detecting a fourth operation of the first control, wherein the fourth operation is used for indicating the shooting ending;
and in response to the fourth operation, sequentially displaying the fourth thumbnail image, the fifth thumbnail image and a sixth thumbnail image in the thumbnail display area, wherein the image quality of the sixth thumbnail image is better than that of the fifth thumbnail image.
It should be understood that the first thumbnail image, the second thumbnail image, and the third thumbnail image correspond to the first photographing operation; the fourth thumbnail image, the fifth thumbnail image and the sixth thumbnail image correspond to a second photographing operation; the photographing time of the two photographing operations is different; the first thumbnail image may be a false thumbnail image of the first photographing operation; the second thumbnail image is a real thumbnail image of the first photographing operation; the third thumbnail image is a thumbnail image generated based on the actual photographed image of the first photographing operation; the fourth thumbnail image may be a false thumbnail image of the second photographing operation; the fifth thumbnail image is a real thumbnail image of the second photographing operation; the sixth thumbnail image is a thumbnail image generated based on the actual photographed image of the second photographing operation.
With reference to the second aspect, in certain implementations of the second aspect, the first image processing includes downsampling processing; the second image processing has a higher algorithmic complexity than the first image processing.
With reference to the second aspect, in certain implementations of the second aspect, the generating a third thumbnail image includes:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
With reference to the second aspect, in certain implementations of the second aspect, the method further includes:
Generating a second captured image in response to the fourth operation;
And scaling the second shooting image based on the size of the thumbnail display area to generate the sixth thumbnail image.
With reference to the second aspect, in some implementations of the second aspect, the electronic device includes a storage module, where the storage module includes a first storage area and a second storage area, and the first storage area is used to store the first thumbnail image, the second thumbnail image, or the first captured image; the second storage area is used for storing the fourth thumbnail image, the fifth thumbnail image or the second shooting image; the first storage area and the second storage area are different storage areas in the storage module.
In the embodiment of the application, a storage module in the electronic equipment corresponds to one storage area for one shooting, and after a false thumbnail image, a true thumbnail image or a shooting image of one shooting is generated, the storage module only performs replacement storage in the storage area corresponding to the shooting; different times of shooting correspond to different storage areas in the cache module.
With reference to the second aspect, in certain implementations of the second aspect, the method further includes:
performing replacement processing on the first thumbnail image of the first storage area by the second thumbnail image in a case where the second thumbnail image is generated and the first captured image is not generated;
In the case of generating the first captured image, the second thumbnail image of the first storage area is subjected to replacement processing by the first captured image.
With reference to the second aspect, in certain implementations of the second aspect, the method further includes:
performing replacement processing on the fourth thumbnail image of the second storage area by the fifth thumbnail image in a case where the fifth thumbnail image is generated and the second captured image is not generated;
in the case of generating the second captured image, the fifth thumbnail image of the second storage area is subjected to replacement processing by the second captured image.
With reference to the second aspect, in some implementations of the second aspect, the first operation and the third operation are operations of clicking on the first control; the second operation and the fourth operation are operations of bouncing up the first control.
With reference to the second aspect, in certain implementations of the second aspect, the image quality includes image texture information or image brightness information.
In a third aspect, an electronic device is provided that includes one or more processors and memory; the memory is coupled to the one or more processors, the memory for storing computer program code, the computer program code comprising computer instructions that the one or more processors call to cause the electronic device to perform:
Displaying a first display interface at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time;
detecting a first operation of the first control, wherein the first operation is used for indicating to start shooting;
In response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing;
detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting;
And in response to the second operation, sequentially displaying the first thumbnail image, the second thumbnail image and a third thumbnail image in the thumbnail display area, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.
With reference to the third aspect, in certain implementations of the third aspect, the first image processing includes downsampling processing; the second image processing has a higher algorithmic complexity than the first image processing.
With reference to the third aspect, in certain implementations of the third aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
With reference to the third aspect, in certain implementations of the third aspect, a storage module is included in the electronic device, the storage module includes a first storage area, and the one or more processors call the computer instructions to cause the electronic device to perform:
Performing replacement processing on the first thumbnail image of the first storage area through the second thumbnail image when the second thumbnail image is generated by the electronic device and the first captured image is not generated;
and when the electronic equipment generates the first shooting image, replacing the second thumbnail image of the first storage area through the first shooting image.
With reference to the third aspect, in certain implementations of the third aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:
Acquiring time information of detecting the first operation;
And selecting the first image from a zero second delay queue in the electronic equipment based on the time information.
With reference to the third aspect, in certain implementations of the third aspect, the second image processing includes a first algorithmic processing and a second algorithmic processing, and the one or more processors invoke the computer instructions to cause the electronic device to perform:
Performing first algorithm processing on the first image to obtain an image in a first color space;
fusing at least two frames of images in the first color space to obtain a fused image;
And performing second algorithm processing on the fusion image to generate the first shooting image.
With reference to the third aspect, in some implementations of the third aspect, the first operation is an operation of clicking on the first control; the second operation is an operation of bouncing the first control.
With reference to the third aspect, in certain implementations of the third aspect, the image quality includes image texture information or image brightness information.
In a fourth aspect, an electronic device is provided, the electronic device comprising one or more processors and memory; the memory is coupled to the one or more processors, the memory for storing computer program code, the computer program code comprising computer instructions that the one or more processors call to cause the electronic device to perform:
Displaying a first display interface at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time;
detecting a first operation of the first control, wherein the first operation is used for indicating to start shooting;
In response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing;
detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting;
Sequentially displaying the first thumbnail image and the second thumbnail image in the thumbnail display area in response to the second operation; and, generating a third thumbnail image having an image quality superior to the second thumbnail image;
Detecting a third operation on the first control before generating the third thumbnail image, the third operation being for instructing the start of shooting;
In response to the third operation, saving a fourth thumbnail image in the album application and generating a fifth thumbnail image; the fourth thumbnail image is generated by the second image through the first image processing; the fifth thumbnail image is generated by the second image through second image processing; the second image is an image acquired by the electronic equipment in real time at a second moment, and the second moment is later than the first moment;
Detecting a fourth operation of the first control, wherein the fourth operation is used for indicating the shooting ending;
and in response to the fourth operation, sequentially displaying the fourth thumbnail image, the fifth thumbnail image and a sixth thumbnail image in the thumbnail display area, wherein the image quality of the sixth thumbnail image is better than that of the fifth thumbnail image.
With reference to the fourth aspect, in certain implementations of the fourth aspect, the first image processing includes downsampling processing; the second image processing has a higher algorithmic complexity than the first image processing.
With reference to the fourth aspect, in certain implementations of the fourth aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
With reference to the fourth aspect, in certain implementations of the fourth aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:
Generating a second captured image in response to the fourth operation;
And scaling the second shooting image based on the size of the thumbnail display area to generate the sixth thumbnail image.
With reference to the fourth aspect, in some implementations of the fourth aspect, the electronic device includes a storage module, where the storage module includes a first storage area and a second storage area, and the first storage area is used to store the first thumbnail image, the second thumbnail image, or the first captured image; the second storage area is used for storing the fourth thumbnail image, the fifth thumbnail image or the second shooting image; the first storage area and the second storage area are different storage areas in the storage module.
With reference to the fourth aspect, in certain implementations of the fourth aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:
performing replacement processing on the first thumbnail image of the first storage area by the second thumbnail image in a case where the second thumbnail image is generated and the first captured image is not generated;
In the case of generating the first captured image, the second thumbnail image of the first storage area is subjected to replacement processing by the first captured image.
With reference to the fourth aspect, in certain implementations of the fourth aspect, the one or more processors invoke the computer instructions to cause the electronic device to perform:
performing replacement processing on the fourth thumbnail image of the second storage area by the fifth thumbnail image in a case where the fifth thumbnail image is generated and the second captured image is not generated;
in the case of generating the second captured image, the fifth thumbnail image of the second storage area is subjected to replacement processing by the second captured image.
With reference to the fourth aspect, in some implementations of the fourth aspect, the first operation and the third operation are operations of clicking on the first control; the second operation and the fourth operation are operations of bouncing up the first control.
With reference to the fourth aspect, in certain implementations of the fourth aspect, the image quality includes image texture information or image brightness information.
In a fifth aspect, an electronic device is provided, comprising means for performing the method of displaying thumbnail images in the first aspect or in any of the implementations of the first aspect.
In a sixth aspect, an electronic device is provided, comprising means for performing the method of displaying thumbnail images in the second aspect or in any of the implementations of the second aspect.
In a seventh aspect, an electronic device is provided that includes one or more processors and memory; the memory is coupled with the one or more processors, the memory for storing computer program code comprising computer instructions that the one or more processors invoke the computer instructions to cause the electronic device to perform the method of displaying thumbnail images in any of the aspects or any of the implementations of any of the aspects.
In an eighth aspect, a chip system is provided, the chip system being applied to an electronic device, the chip system comprising one or more processors for invoking computer instructions to cause the electronic device to perform any one of the aspects or a method of displaying thumbnail images.
In a ninth aspect, there is provided a computer readable storage medium storing computer program code which, when executed by an electronic device, causes the electronic device to perform the method of displaying thumbnail images in any one of the aspects or any one of the implementation forms of any one of the aspects.
In a tenth aspect, there is provided a computer program product comprising: computer program code which, when run by an electronic device, causes the electronic device to perform the method of displaying thumbnail images in any one of the aspects or any one of the implementations of any one of the aspects.
In an embodiment of the present application, by dividing a photographing operation into a first operation (e.g., an operation of clicking a photographing control) and a second operation (e.g., an operation of bouncing the photographing control); triggering the electronic device to save a first thumbnail image (e.g., a false thumbnail image) and generate a second thumbnail image (e.g., a true thumbnail image) in the camera application when the electronic device detects the first operation; when the electronic device detects the second operation, sequentially displaying the first thumbnail image, the second thumbnail image, and the third thumbnail image (for example, thumbnail images obtained based on the captured image) in the display area of the display interface; since the first thumbnail image is rapidly triggered to be displayed after the second operation is detected; the thumbnail image can be displayed at the moment when the electronic equipment detects the second operation, so that the speed of shooting response is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
Drawings
FIG. 1 is a schematic diagram of a hardware system suitable for use in an electronic device of the present application;
FIG. 2 is a schematic diagram of an application scenario suitable for use in embodiments of the present application;
Fig. 3 is a schematic flowchart of a method of displaying thumbnail images provided by an embodiment of the present application;
FIG. 4 is a schematic flow chart of another method of displaying thumbnail images provided by an embodiment of the present application;
FIG. 5 is a schematic diagram of a software architecture according to an embodiment of the present application;
FIG. 6 is a schematic diagram of a graphical user interface suitable for use with embodiments of the present application;
FIG. 7 is a schematic diagram of another graphical user interface provided by an embodiment of the present application that is suitable for use with an embodiment of the present application;
FIG. 8 is a schematic diagram of yet another graphical user interface provided by an embodiment of the present application that is suitable for use with an embodiment of the present application;
FIG. 9 is a schematic diagram of another software architecture according to an embodiment of the present application;
FIG. 10 is a schematic diagram of a graphical user interface suitable for use with embodiments of the present application;
FIG. 11 is a schematic diagram of another graphical user interface suitable for use with embodiments of the present application;
FIG. 12 is a schematic diagram of yet another graphical user interface provided by an embodiment of the present application that is suitable for use with an embodiment of the present application;
FIG. 13 is a schematic diagram of yet another graphical user interface provided by an embodiment of the present application that is suitable for use with an embodiment of the present application;
FIG. 14 is a schematic diagram of yet another graphical user interface provided by an embodiment of the present application that is suitable for use with an embodiment of the present application;
FIG. 15 is a schematic diagram of yet another graphical user interface provided by an embodiment of the present application that is suitable for use with an embodiment of the present application;
FIG. 16 is a schematic diagram of yet another graphical user interface provided by an embodiment of the present application that is suitable for use with an embodiment of the present application;
fig. 17 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
Fig. 18 is a schematic structural diagram of another electronic device according to an embodiment of the present application.
Detailed Description
In embodiments of the present application, the following terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present embodiment, unless otherwise specified, the meaning of "plurality" is two or more.
In order to facilitate understanding of the embodiments of the present application, related concepts related to the embodiments of the present application will be briefly described.
1. Thumbnail image
The thumbnail image is an image with smaller resolution cached in the electronic equipment, and the quality of the thumbnail image is poorer than that of a shooting image; the resolution of the thumbnail image is smaller than the photographed image in the electronic device; alternatively, the thumbnail images through the photographing interface may be indexed to the actual photographed images in the album.
2. Zero-second delay (ZSL) queue
Before shooting, the electronic device generally displays an image of a picture to be shot in the electronic device; these displayed images are also referred to as preview images; the electronic device sequentially buffers the preview image and the actual shot image in an image queue according to time sequence, and the image queue is called as a ZSL queue.
Alternatively, the images in the ZSL queue may be Raw images.
Fig. 1 shows a hardware system suitable for use in the electronic device of the application.
The electronic device 100 may be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, an in-vehicle electronic device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), a projector, etc., and the specific type of the electronic device 100 is not limited in the embodiments of the present application.
The electronic device 100 may include A processor 110, an external memory interface 120, an internal memory 121, A universal serial bus (universal serial bus, USB) interface 130, A charge management module 140, A power management module 141, A battery 142, an antenna 1, an antenna 2, A mobile communication module 150, A wireless communication module 160, an audio module 170, A speaker 170A, A receiver 170B, A microphone 170C, an earphone interface 170D, A sensor module 180, keys 190, A motor 191, an indicator 192, A camera 193, A display 194, and A subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
The configuration shown in fig. 1 does not constitute a specific limitation on the electronic apparatus 100. In other embodiments of the application, electronic device 100 may include more or fewer components than those shown in FIG. 1, or electronic device 100 may include a combination of some of the components shown in FIG. 1, or electronic device 100 may include sub-components of some of the components shown in FIG. 1. The components shown in fig. 1 may be implemented in hardware, software, or a combination of software and hardware.
Illustratively, the processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, a neural-Network Processor (NPU). The different processing units may be separate devices or integrated devices. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.
In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include at least one of the following interfaces: inter-INTEGRATED CIRCUIT, I2C interface, inter-integrated circuit audio (inter-INTEGRATED CIRCUIT SOUND, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver transmitter (universal asynchronous receiver/transceiver, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input/output (GPIO) interface, SIM interface, USB interface.
Illustratively, in an embodiment of the present application, the processor 110 may be configured to perform the method for displaying thumbnail images provided by the embodiment of the present application; for example, a first display interface is displayed at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at a first moment in real time; detecting a first operation of a first control, wherein the first operation is used for indicating to start shooting, and shooting can comprise shooting; in response to the first operation, saving the first thumbnail image in the album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing; detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting; in response to the second operation, the first thumbnail image, the second thumbnail image, and the third thumbnail image are sequentially displayed in the thumbnail display area, wherein the third thumbnail image has an image quality superior to that of the second thumbnail image.
The connection relationships between the modules shown in fig. 1 are merely illustrative, and do not constitute a limitation on the connection relationships between the modules of the electronic device 100. Alternatively, the modules of the electronic device 100 may also use a combination of the various connection manners in the foregoing embodiments.
The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The electronic device 100 may implement display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 194 may be used to display images or video.
Alternatively, the display screen 194 may be used to display images or video. The display 194 includes a display panel. The display panel may employ a Liquid Crystal Display (LCD) CRYSTAL DISPLAY, an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (MINI LIGHT-emitting diode, mini LED), a micro light-emitting diode (micro LED), a micro OLED (Micro OLED) or a quantum dot light LIGHT EMITTING diode (QLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.
Illustratively, the electronic device 100 may implement a photographing function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
Illustratively, the ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the camera, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. The ISP can carry out algorithm optimization on noise, brightness and color of the image, and can optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.
Illustratively, a camera 193 (which may also be referred to as a lens) is used to capture still images or video. The shooting function can be realized by triggering and starting through an application program instruction, such as shooting and acquiring an image of any scene. The camera may include imaging lenses, filters, image sensors, and the like. Light rays emitted or reflected by the object enter the imaging lens, pass through the optical filter and finally are converged on the image sensor. The imaging lens is mainly used for converging and imaging light emitted or reflected by all objects (also called a scene to be shot and a target scene, and also called a scene image expected to be shot by a user) in a shooting view angle; the optical filter is mainly used for filtering out redundant light waves (such as light waves except visible light, such as infrared light) in the light; the image sensor may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The image sensor is mainly used for photoelectrically converting a received optical signal into an electrical signal, and then transmitting the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format.
Illustratively, the digital signal processor is configured to process digital signals, and may process other digital signals in addition to digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.
Illustratively, video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, and MPEG4.
Illustratively, the gyroscopic sensor 180B may be used to determine a motion pose of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., x-axis, y-axis, and z-axis) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B can also be used for scenes such as navigation and motion sensing games.
For example, the acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically, x-axis, y-axis, and z-axis). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The acceleration sensor 180E may also be used to recognize the gesture of the electronic device 100 as an input parameter for applications such as landscape switching and pedometer.
Illustratively, a distance sensor 180F is used to measure distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, for example, in a shooting scene, the electronic device 100 may range using the distance sensor 180F to achieve fast focus.
Illustratively, ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.
Illustratively, the fingerprint sensor 180H is used to capture a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to perform functions such as unlocking, accessing an application lock, taking a photograph, and receiving an incoming call.
Illustratively, the touch sensor 180K, also referred to as a touch device. The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a touch screen. The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor 180K may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 and at a different location than the display 194.
Currently, after the electronic device detects that the user pops up the shooting control, the electronic device is triggered to generate a real thumbnail image and a shooting image (for example, a shooting true image); the electronic equipment cannot display the thumbnail image at the moment of detecting the pop-up shooting control, namely the electronic equipment detects that the duration between the pop-up shooting control and the thumbnail image is too long; the shooting waiting time of the user is longer, so that the shooting experience of the user is poorer.
In view of the above, embodiments of the present application provide a method of displaying a thumbnail image and an electronic apparatus; in the embodiment of the application, shooting operation is divided into operation of clicking a shooting control and operation of bouncing the shooting control, and when the electronic equipment detects the operation of clicking the shooting control, the electronic equipment is triggered to store false thumbnail images in an album application program and generate real thumbnail images; the false thumbnail image is a thumbnail image obtained by scaling based on the preview image; the real thumbnail image is a thumbnail image generated by selecting original image data for image processing; triggering and displaying a false thumbnail image when the electronic equipment detects that a user pops up a shooting control; the thumbnail image can be displayed at the moment when the electronic equipment detects the operation of bouncing the shooting control, so that the shooting response speed is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
In addition, triggering to generate a shooting image when the shooting control is detected to be sprung; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shot image is generated, the real thumbnail image can be subjected to replacement processing through the thumbnail image obtained by scaling the shot image; the image quality of the thumbnail image can be ensured while improving the photographing response speed.
Fig. 2 is a schematic diagram of an application scenario of a method for displaying thumbnail images according to an embodiment of the present application.
Illustratively, after the electronic device runs the camera application, a preview interface 201 is displayed, as shown in fig. 2 (a); the preview interface 201 comprises a preview image, a thumbnail display control 202 and a shooting control 203, wherein the thumbnail display control 203 is used for displaying a thumbnail image of the last shot image; at a first time, the electronic device detects an operation of clicking the photographing control 203, as shown in (b) in fig. 2; at a second moment, the electronic device detects that the user has sprung up the shooting control 203, and displays a display interface 204, as shown in (c) in fig. 2; the thumbnail image displayed in the thumbnail display control 202 in the display interface 204 is still the thumbnail image of the last shot image; at the third time, the electronic device displays the display interface 205, and the thumbnail image displayed in the thumbnail display control 203 in the display interface 205 is the thumbnail image of the current captured image, as shown in (d) in fig. 2.
It should be understood that, in general, the user views the thumbnail image of the current shooting image as completing the current shooting, so that the electronic device cannot display the thumbnail image at the moment when the pop-up shooting control is detected, which results in that the user considers that the response of the shooting is too slow and the shooting experience is poor.
In an embodiment of the application, a method and an electronic device for displaying thumbnail images are provided; according to the method for displaying the thumbnail images, the problem that the shooting response time of the electronic equipment is long can be solved, and the electronic equipment can display the thumbnail images rapidly.
Alternatively, the method for displaying thumbnail images in the embodiment of the present application may be applied to a photographing mode of a camera application; or the method for displaying the thumbnail in the embodiment of the application can be applied to a quick photographing mode of a camera application program.
It should be noted that, the method for displaying thumbnail images in the embodiment of the present application may be applied to night scene shooting in a shooting mode, but is not applicable to a night scene shooting mode; because each frame of image acquired by the electronic equipment is obtained by fusing a long exposure image, a normal exposure image and a short exposure image in a night scene shooting mode; because in the embodiment of the application, the electronic equipment is triggered to generate the false thumbnail image and the real thumbnail image when the shooting control is detected to be clicked, and the false thumbnail image is displayed when the shooting control is detected to be sprung; after the false thumbnail image is displayed in the electronic equipment, the user considers that the electronic equipment can be moved when the shooting is completed; but at this time the short exposure image and the long exposure image may not have been generated yet; after the electronic equipment is moved, the contents in the short exposure image, the long exposure image and the normal exposure image are different, so that the image quality is poor; therefore, the method of displaying thumbnail images provided in the embodiment of the present application is not suitable for the night scene mode.
It should be understood that the foregoing is illustrative of an application scenario, and is not intended to limit the application scenario of the present application in any way.
The method of displaying thumbnail images provided in the embodiment of the present application will be described in detail with reference to fig. 3 to 16.
Fig. 3 is a schematic flowchart of a method of displaying thumbnail images according to an embodiment of the present application. The method 300 may be performed by the electronic device shown in fig. 1; the method 300 includes S310 to S350, and S310 to S350 are described in detail below, respectively.
S310, displaying a first display interface at a first moment.
The first display interface comprises a first control, a thumbnail display area and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at a first moment in real time.
Optionally, as shown in fig. 5, the camera module may send the first image collected at the first moment to the preview storage module and the ZSL queue storage module respectively; the preview storage module is used for storing preview images, wherein the preview images are images generated by performing preview processing on images acquired by the camera module; the images stored in the ZSL queue storage module are used for generating photographed actual photographed images.
Illustratively, the first display interface may be as shown in (a) of fig. 6; the first control may refer to control 612 shown in fig. 6 (a); the display area may refer to an area where the control 613 is located as shown in (a) in fig. 6.
Alternatively, a camera application may be run before S310.
For example, the user may instruct the electronic device to run the camera application by clicking on an icon of the "camera" application.
For example, when the electronic device is in a locked state, the user may instruct the electronic device to run the camera application through a gesture that slides to the right on the display screen of the electronic device. Or the electronic equipment is in a screen locking state, the screen locking interface comprises an icon of the camera application program, and the user instructs the electronic equipment to operate the camera application program by clicking the icon of the camera application program. Or when the electronic equipment runs other applications, the applications have the authority of calling the camera application program; the user may instruct the electronic device to run the camera application by clicking on the corresponding control. For example, while the electronic device is running an instant messaging type application, the user may instruct the electronic device to run the camera application, etc., by selecting a control for the camera function.
It should be appreciated that the above is illustrative of the operation of running a camera application; the camera application program can be run by the voice indication operation or other operation indication electronic equipment; the present application is not limited in any way.
It should also be understood that running the camera application may refer to launching the camera application.
S320, detecting a first operation of the first control.
Wherein the first operation is for instructing to start shooting. The photographing may include photographing.
Alternatively, the photographing operation may be a photographing operation.
Illustratively, as shown in (c) of fig. 6, the first operation may be a click operation on control 612.
Alternatively, in the embodiment of the present application, the above description is given by way of example of the first operation being a click operation; in the embodiment of the present application, the first operation may also be an operation of instructing shooting by voice; or instruct to start shooting operation by other instructions; the present application is not limited in any way.
S330, in response to the first operation, saving the first thumbnail image in the album application and generating a second thumbnail image.
The first thumbnail image is generated by the first image through first image processing; the second thumbnail image is a thumbnail image generated by the first image through a second image process, the first image process being different from the second image process.
In one possible implementation, the first image processing may include a downsampling process or a partial process of the ISP process; the second image processing may include multi-frame image fusion processing, ISP processing, and other software algorithms for image processing.
It will be appreciated that in embodiments of the application, the duration required for the first image processing is less than the duration required for the second image processing.
Illustratively, the first thumbnail image may be a thumbnail image as displayed in the control 613 in (a) of fig. 7; the second thumbnail image may be a thumbnail image as displayed in the control 613 in (c) in fig. 7.
In one possible implementation, generating the first thumbnail image includes:
And scaling the first preview image to generate a first thumbnail image. The specific implementation may be referred to in the following description of the first flow 430 in fig. 4, which is not repeated here.
In the embodiment of the application, after the electronic equipment detects the operation of clicking the shooting control, a flow of saving false thumbnail images in an album application program can be triggered; therefore, when the electronic equipment detects that the shooting control is sprung, false thumbnail images can be displayed in the display interface rapidly so as to respond to shooting operation of a user; the time length for waiting for shooting by the user is reduced, and the shooting experience of the user is improved.
Optionally, the method further comprises:
Generating a first photographed image in response to the second operation; the first captured image is subjected to scaling processing based on the size of the thumbnail display area, and a third thumbnail image is generated.
It should be understood that the third thumbnail image is obtained by scaling the first captured image based on the thumbnail display area; the first captured image does not need to be subjected to downsampling processing compared with the second thumbnail image; in addition, the first captured image may be an image based on a multi-frame Raw image fusion process; therefore, the image quality of the third thumbnail image is better than that of the second thumbnail image.
In the embodiment of the application, when the electronic equipment detects the operation of bouncing the shooting control, the electronic equipment is triggered to generate a first shooting image, and the first shooting image can be a shooting true image; by performing the scaling process on the first captured image, a third thumbnail image, that is, a thumbnail image of the first captured image can be obtained.
Optionally, the second image processing includes a first algorithm processing and a second algorithm processing, the first algorithm being an algorithm of a first color space, the second algorithm being an algorithm of converting an image of the first color space into an image of a second color space, generating the first captured image, including:
Performing first algorithm processing on the first image to obtain an image in a first color space; fusing at least two frames of images in the first color space to obtain a fused image; and performing second algorithm processing on the fusion image to generate a first shooting image.
Alternatively, the specific implementation may be referred to the following description of the second flow 440 shown in fig. 4, which is not repeated here.
Illustratively, the first image may be Raw image data, i.e. the first image may be a Raw image; the first algorithm may comprise an algorithm of the Raw color space.
For example, algorithms for the Raw color space may include, but are not limited to: black level correction processing (Black Level Correction, BLC), lens shading correction (LENS SHADING correction, LSC), and the like.
The black level correction processing is used for correcting the black level, wherein the black level refers to the level of a video signal which is not output by a row of brightness on a display device after a certain calibration; the reason for performing the black level correction is that: on one hand, the dark current exists in the image sensor, so that the pixel also has the problem of voltage output under the condition of no illumination; on the other hand, the accuracy is insufficient when the image sensor performs analog-to-digital conversion. Lens shading Correction (LENS SHADING Correction, LSC) is used to eliminate the problem of color around the image and the inconsistency of brightness with the center of the image due to the lens optics.
For example, the second algorithm includes an algorithm that converts the Raw image into a YUV color space.
Optionally, the method further comprises:
Acquiring time information of detecting a first operation; a first image is selected in a zero second delay queue in the electronic device based on time information.
In the embodiment of the application, when the operation of clicking the shooting control is detected, the electronic equipment can be triggered to generate a second thumbnail image, namely a real thumbnail image; compared with the prior art, after the pop-up shooting operation is detected, the method and the device trigger the flow of generating the real thumbnail image, in the embodiment of the application, the time for triggering the electronic equipment to generate the real thumbnail image is advanced, so that the response shooting time of the electronic equipment can be reduced; the time length for waiting for shooting by the user is reduced, and the shooting experience of the user is improved.
S340, detecting a second operation on the first control.
Wherein the second operation is for indicating the end of shooting.
Illustratively, the second operation may be an operation of bouncing up the photographing control, as shown in (a) of fig. 7.
It should be appreciated that the operation of bouncing the capture control may refer to an operation of the electronic device detecting that a user's finger has left the capture control; or the electronic device detects an operation of releasing the shooting control by the finger of the user, etc.
Optionally, the above is an example description of the second operation; in the embodiment of the present application, the second operation may also be an operation of ending shooting by voice indication; or instruct to end shooting operation through other instructions; the present application is not limited in any way.
And S350, in response to the second operation, sequentially displaying the first thumbnail image, the second thumbnail image and the third thumbnail image in the thumbnail display area.
Wherein the third thumbnail image has an image quality superior to that of the second thumbnail image.
In one possible implementation, the image quality may include image detail information, image texture information, image brightness, or image quality assessment results obtained by any image quality assessment algorithm; the present application is not limited in any way.
It should be noted that, in the embodiment of the present application, the first thumbnail image, the second thumbnail image, and the third thumbnail image may correspond to the same shot of the user; for the same shooting, displaying mutual exclusion among the first thumbnail image, the second thumbnail image and the third thumbnail image; for example, if the first thumbnail image is displayed in the display interface in the camera application, the second thumbnail image and the third thumbnail image are not displayed in the display interface; if the second thumbnail image is displayed in the display interface in the camera application program, the first thumbnail image and the third thumbnail image are not displayed in the display interface; if the third thumbnail image is displayed in the display interface in the camera application program, the first thumbnail image and the second thumbnail image are not displayed in the display interface; for example, at time T1, a first thumbnail image is displayed; displaying a second thumbnail image at time T2; displaying a third thumbnail image at a time T3; the time T1 is earlier than the time T2; time T2 is earlier than time T3.
Optionally, the electronic device includes a storage module, where the storage module includes a first storage area, and further includes:
When the electronic device generates the second thumbnail image and does not generate the first shooting image, replacing the first thumbnail image of the first storage area through the second thumbnail image;
when the electronic device generates the first photographed image, the replacement process is performed on the second thumbnail image of the first storage area through the first photographed image.
In an embodiment of the present application, after generating a second thumbnail image (e.g., a real thumbnail image), a first thumbnail image (e.g., a false thumbnail image) stored in the electronic device is directly replaced by the second thumbnail image, and after generating a first captured image (e.g., a captured image), a second thumbnail image (e.g., a real thumbnail image) stored in the electronic device is directly replaced by the first captured image; and storing the first thumbnail image, the second thumbnail image and the first thumbnail image, wherein the replacement processing is directly carried out in the embodiment of the application, so that the storage space of the electronic equipment occupied by the thumbnail images can be reduced.
In an embodiment of the present application, by dividing a photographing operation into a first operation (e.g., an operation of clicking a photographing control) and a second operation (e.g., an operation of bouncing the photographing control); triggering the electronic device to save a first thumbnail image (e.g., a false thumbnail image) and generate a second thumbnail image (e.g., a true thumbnail image) in the camera application when the electronic device detects the first operation; when the electronic device detects the second operation, sequentially displaying the first thumbnail image, the second thumbnail image, and the third thumbnail image (for example, thumbnail images obtained based on the captured image) in the display area of the display interface; since the first thumbnail image is rapidly triggered to be displayed after the second operation is detected; the thumbnail image can be displayed at the moment when the electronic equipment detects the second operation, so that the speed of shooting response is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
Example one
Detecting a shooting operation for the electronic equipment, namely detecting a first operation and a second operation by the electronic equipment; for example, the electronic device detects an operation of clicking the photographing control once and an operation of bouncing the photographing control once.
Illustratively, as shown in (a) in fig. 7 for one shot, a first thumbnail image, that is, a false thumbnail image, is displayed in the display thumbnail control 613 at the time T (12); as shown in (c) in fig. 7, a second thumbnail image, that is, a real thumbnail image is displayed in the display thumbnail control 613 at the time T (13); as shown in (a) of fig. 8, a third thumbnail image, that is, a thumbnail image of a captured image is displayed in the thumbnail control 613 at a time T (14), where the time T (12) is earlier than the time T (13) and the time T (13) is earlier than the time T (14).
Optionally, if the electronic device detects the first operation and the second operation once, the first thumbnail image, the second thumbnail image and the third thumbnail image include a first shooting object.
Optionally, the method further comprises:
generating a first image in response to the second operation; and scaling the first image to generate a third thumbnail image.
For example, the implementation of generating the first image may be referred to in the following description of the third process 470 in fig. 4, which is not repeated herein; the implementation manner of generating the third thumbnail image may be referred to the following description of S480 in fig. 4, and will not be repeated here.
In the embodiment of the application, when the electronic equipment detects the operation of bouncing the shooting control, the electronic equipment is triggered to generate a first image, wherein the first image can be a shooting image, namely a shooting true image; by performing the scaling process on the first image, a third thumbnail image, that is, a thumbnail image of the captured image can be obtained.
Optionally, generating the first image includes:
performing first algorithm processing on the second image to obtain an image in a first color space; fusing at least two frames of images in the first color space to obtain a fused image; and performing second algorithm processing on the fusion image to generate a first image.
For example, time information at which the first operation is detected may be acquired; selecting a second image from a zero second delay queue in the electronic device based on the time information; carrying out algorithm processing of a Raw color space on the second image to obtain a processed Raw image; and carrying out fusion processing on the Raw images subjected to at least two frames of processing to obtain a first image.
It should be understood that the first image may refer to a true image generated by capturing an image at a time; the first image does not need to be downsampled compared to the second thumbnail image; in addition, the first image may be an image after fusion processing based on a plurality of frames Raw image; therefore, the image quality of the first image is better than that of the second thumbnail image; further, the image quality of the third thumbnail image obtained by performing the scaling processing based on the first image is superior to that of the second thumbnail image.
Optionally, the electronic device includes a storage module, where the storage module includes a first storage area, and further includes:
storing the first thumbnail image in the first storage area when the electronic device generates the first thumbnail image and the second thumbnail image is not generated;
When the electronic device generates the second thumbnail image and does not generate the first image, replacing the first thumbnail image of the first storage area through the second thumbnail image;
when the electronic device generates the first image, the second thumbnail image of the first storage area is subjected to replacement processing through the first image.
Illustratively, as shown in (b) of fig. 7, a cache module may be included in an album application of the electronic device; at time T (12), a first storage location in the cache module is used to store a first thumbnail image (e.g., false thumbnail image 1); as shown in (d) of fig. 7, at time T (13), the first storage area in the buffer module is used to store a second thumbnail image (e.g., a real thumbnail image 11); for example, at time T (13), the dummy thumbnail image may be subjected to replacement processing by the real thumbnail image, the dummy thumbnail image is deleted and the real thumbnail image is stored in the same storage area; at time T (14), a first storage area in the buffer module is used to store a first image (e.g., a captured image); for example, at the third timing, the real thumbnail image may be subjected to replacement processing by the captured image, the real thumbnail image is deleted, and the captured image is stored in the same storage space.
It should be understood that the above-described false thumbnail image, true thumbnail image, and photographed image correspond to the same shot of the user; in other words, the false thumbnail image, the real thumbnail image and the shot image correspond to the same click shooting control and pop-up shooting control of the user; in addition, for the same shooting, the false thumbnail image, the real thumbnail image and the thumbnail image of the shooting image are mutually exclusive; for example, if a false thumbnail image is displayed in a display interface in a camera application, a thumbnail image of a real thumbnail and a photographed image is not displayed in the display interface; if the real thumbnail image is displayed in the display interface in the camera application program, the false thumbnail image and the thumbnail image of the shot image are not displayed in the display interface; if the thumbnail image of the shot image is displayed in the display interface in the camera application program, the false thumbnail image and the true thumbnail image are not displayed in the display interface.
In an embodiment of the present application, after generating a second thumbnail image (e.g., a real thumbnail image), a first thumbnail image (e.g., a false thumbnail image) stored in the electronic device is directly replaced by the second thumbnail image, and after generating a first image (e.g., a photographed image), a second thumbnail image (e.g., a real thumbnail image) stored in the electronic device is directly replaced by the first image; and storing the first thumbnail image, the second thumbnail image and the first thumbnail image, wherein the replacement processing is directly carried out in the embodiment of the application, so that the storage space of the electronic equipment occupied by the thumbnail images can be reduced.
Example two
Detecting at least two shooting operations for the electronic equipment, namely detecting at least two first operations and at least two second operations by the electronic equipment; for example, the electronic device detects an operation of clicking the photographing control for the first time and an operation of bouncing the photographing control for the first time; before generating the first shot image, the electronic device detects a second click operation of the shooting control and a second pop-up operation of the shooting control.
Optionally, the electronic device detecting one first operation and one second operation is that the electronic device detects one shooting operation; if the number of times of shooting operations detected by the electronic device is greater than one, the first thumbnail image and the second thumbnail image comprise a first shooting object, the third thumbnail image comprises a second shooting object, and the first shooting object is different from the second shooting object.
Illustratively, a first photographic subject included in the first thumbnail image and the second thumbnail image, such as a photographic subject 811 shown in (c) in fig. 10; a second subject included in the third thumbnail image, such as the subject 815 shown in (a) in fig. 11.
Optionally, the electronic device includes a storage module, where the storage module includes a first storage area and a second storage area, and further includes:
storing the first thumbnail image in the first storage area when the electronic device generates the first thumbnail image and the second thumbnail image is not generated;
when the electronic device generates a second thumbnail image, replacing the first thumbnail image of the first storage area by the second thumbnail image;
When the electronic device generates the third thumbnail image, the third thumbnail image is stored in the second storage area.
Illustratively, as shown in (b) of fig. 11, a cache module may be included in an album application of the electronic device; at time T (22), the electronic device generates a first thumbnail image, the first storage location in the cache module for storing the first thumbnail image (e.g., false thumbnail image 1); as shown in (d) of fig. 11, at time T (23), the electronic device generates a second thumbnail image, and the first storage area in the buffer module is used to store the second thumbnail image (e.g., the real thumbnail image 11); for example, at time T (23), the dummy thumbnail image may be subjected to replacement processing by the real thumbnail image, the dummy thumbnail image is deleted and the real thumbnail image is stored in the same storage area; as shown in (d) of fig. 12, at time T (25), a third thumbnail image, that is, a false thumbnail image of the second shot is generated; the second storage area in the buffer module is used to store a third image (e.g., the second shot dummy thumbnail image 2).
Optionally, the method further comprises:
generating a third image of the first photographic subject in response to the second operation; and replacing the second thumbnail image of the first storage area by a third image, wherein the image quality of the third image is better than that of the second thumbnail image.
The third image may be, for example, a photographed image photographed for the first time; as shown in (b) of fig. 13, after the electronic device generates the photographed image of the first photographing, the second thumbnail image (for example, the real thumbnail image 11) stored in the buffer module may be subjected to the replacement process by the photographed image.
Optionally, after the third thumbnail image is displayed in the display area, further comprising:
And displaying a fourth thumbnail image in the display area, wherein the fourth thumbnail image is a thumbnail image of the second shooting object, and the image quality of the fourth thumbnail image is better than that of the third thumbnail image.
Illustratively, the fourth thumbnail image may refer to a real thumbnail image photographed the second time, which may be a thumbnail image as shown in the control 813 in (c) of fig. 13.
Optionally, the method further comprises:
And replacing the third thumbnail image of the second storage area by the fourth thumbnail image.
Illustratively, as shown in (b) in fig. 13 and (d) in fig. 13, after the electronic device generates the fourth thumbnail image (e.g., the real thumbnail image 22) photographed for the second time, the replacement process of the third thumbnail image (e.g., the dummy thumbnail image 2) in the buffer module may be performed by the real thumbnail image 22.
Optionally, the method further comprises:
Acquiring a second preview image of a second shooting object, wherein the second preview image is stored in a camera application program of the electronic equipment; and scaling the second preview image to generate a third thumbnail image.
For example, after the electronic device detects the second click on the shooting control, a flow of generating a false thumbnail image of the second shooting may be triggered; therefore, when the electronic equipment detects that the shooting control is sprung up for the second time, false thumbnail images can be displayed in the display interface rapidly so as to respond to shooting operation of a user; the time length for waiting for shooting by the user is reduced, and the shooting experience of the user is improved.
In an embodiment of the present application, by dividing a photographing operation into a first operation (e.g., an operation of clicking a photographing control) and a second operation (e.g., an operation of bouncing the photographing control); triggering the electronic device to generate a first thumbnail image (e.g., a false thumbnail image) and a second thumbnail image (e.g., a true thumbnail image) when the electronic device detects the first operation; when the electronic device detects the second operation, sequentially displaying the first thumbnail image, the second thumbnail image, and the third thumbnail image (for example, thumbnail images obtained based on the captured image) in the display area of the display interface; since the first thumbnail image is rapidly triggered to be displayed after the second operation is detected; the thumbnail image can be displayed at the moment when the electronic equipment detects the second operation, so that the speed of shooting response is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
The implementation of the embodiment of the present application is described in detail below with reference to fig. 4 to 14.
Implementation one
For example, when the electronic device detects a shooting operation (for example, an operation of clicking a shooting control and an operation of bouncing the shooting control), the electronic device sequentially generates a false thumbnail image, a real thumbnail image, and a shooting image; and displaying the false thumbnail image, the real thumbnail image and the thumbnail image of the shooting image in sequence in a thumbnail display control in the shooting interface.
Fig. 4 is a schematic flow chart of another method of displaying thumbnail images provided by an embodiment of the present application. The method 400 may be performed by the electronic device shown in fig. 1; the method includes S410 to S480, and S410 to S480 are described in detail below, respectively.
It should be noted that S410 to S480 are exemplified by a shooting process in which the electronic device detects the user; namely, when the electronic equipment detects one-time operation of clicking the shooting control and one-time operation of bouncing the shooting control, the processing flow of the thumbnail image is displayed.
S401, running a camera application program.
For example, the user may instruct the electronic device to run the camera application by clicking on an icon of the "camera" application. Or when the electronic equipment is in a screen locking state, the user can instruct the electronic equipment to run the camera application program through a gesture of sliding rightwards on the display screen of the electronic equipment. Or the electronic equipment is in a screen locking state, the screen locking interface comprises an icon of the camera application program, and the user instructs the electronic equipment to operate the camera application program by clicking the icon of the camera application program. Or when the electronic equipment runs other applications, the applications have the authority of calling the camera application program; the user may instruct the electronic device to run the camera application by clicking on the corresponding control. For example, while the electronic device is running an instant messaging type application, the user may instruct the electronic device to open the camera application, etc., by selecting a control for the camera function.
It should be appreciated that the above description is illustrative of the operation of running a camera application; the camera application program can be run by the voice indication operation or other operation indication electronic equipment; the present application is not limited in any way.
S420, detecting the operation of clicking the shooting control.
Optionally, an operation of clicking on the photographing control is illustrated in S420; in S420, an operation to instruct start of shooting may also be detected; for example, the electronic device is instructed to start shooting by voice or other instruction information.
It should be appreciated that in an embodiment of the present application, the photographing operation may include: an operation of instructing start of shooting and an operation of ending shooting; for example, the photographing operation may include: clicking and bouncing the shooting control.
It should be noted that, the operation of bouncing the shooting control may refer to an operation that the electronic device detects that the finger of the user leaves the shooting control; or the electronic device detects an operation of releasing the shooting control by the finger of the user, etc.
In an embodiment of the present application, when the electronic device detects the operation of the shooting control of the user, the first procedure 430 and the second procedure 440 may be triggered simultaneously; the first flow 430 is a flow of generating a false thumbnail image for an electronic device; the second process 440 is a process of generating a real thumbnail image for the electronic device; the process of generating the real thumbnail image can be any existing algorithm for generating the thumbnail image.
Optionally, when the electronic device detects an operation of clicking the shooting control, the first procedure and the second procedure may be triggered simultaneously; namely, a process of triggering generation of a quick thumbnail image and a process of triggering generation of a real thumbnail image.
Illustratively, the first procedure 430 includes S431 and S432; s431 and S432 will be described in detail below.
S431, acquiring a preview image.
It should be understood that the preview image is an image acquired in a memory module of the electronic device.
Illustratively, the preview image may be an image stored in a pre-storage module in the camera application, as shown in fig. 5.
Alternatively, the preview image may be in JPEG format, JPG format or other format.
S432, processing the preview image to generate a false thumbnail image.
Illustratively, the preview image may be a one-frame processed JPEG format image; the image in JPEG format may be scaled to obtain a false thumbnail image.
It should be understood that, in the embodiment of the present application, the false thumbnail image is an image obtained by directly performing scaling processing on the basis of the preview image; therefore, the process of generating the dummy thumbnail image requires a shorter time, and the quick generation of the dummy thumbnail image can be generated in a shorter time.
Illustratively, the second procedure 440 includes S441 and S442; s441 and S442 are described in detail below.
S441, selecting an image frame in a ZSL queue.
Optionally, an image frame may be selected in the ZSL queue according to time information, where the time information may be acquired when an operation of clicking the photographing control is detected at S420; for example, a time stamp is acquired when a click shooting operation is detected.
The electronic device detects that the shooting control is clicked, and the acquired time information is a time identifier 1; the ZSL queue includes: time stamp 1-image frame 1, time stamp 2-image frame 2, time stamp 3-image frame 3; based on time identification 1, the electronic device may select image frame 1 in the ZSL queue.
Alternatively, the image frames stored in the ZSL queue may be Raw images; the Raw image refers to Raw image data acquired by the image sensor.
S442, processing the selected image frames to generate a real thumbnail image.
Illustratively, the selected Raw image may be processed to convert the Raw image to a YUV image; the YUV image can be converted into RGB image for display; in addition, the YUV image may be converted into other formats (e.g., JPEG format (JPG format), GIF format, DNG format, or RAW format, etc.) for storage.
It should be understood that since the real thumbnail image is a thumbnail image obtained by performing image processing based on the Raw image; the false thumbnail image is a thumbnail image obtained by directly scaling the preview image stored in the electronic equipment; therefore, the timeliness of generating the false thumbnail image is higher than that of generating the real thumbnail image.
Alternatively, the electronic device may generate the quick thumbnail image first and then generate the real thumbnail image.
It should also be understood that since the real thumbnail image is a thumbnail image obtained by performing image processing based on the Raw image; the false thumbnail image is a thumbnail image obtained by directly scaling the preview image; since preview images are typically lower in resolution than Raw images captured by the image sensor, the image quality of real thumbnail images is better than that of false thumbnail images.
Optionally, S442 includes, but is not limited to, the following steps:
1. downsampling the selected Raw image to obtain a downsampled Raw image;
2. Executing a Raw domain algorithm on the Raw image after the downsampling processing to obtain a processed Raw image; wherein the Raw domain algorithm includes, but is not limited to: black level correction processing, lens shading correction and other algorithms;
The black level correction processing is used for correcting the black level, wherein the black level refers to the level of a video signal which is not output by a row of brightness on a display device after a certain calibration; the reason for performing the black level correction is that: on one hand, the dark current exists in the image sensor, so that the pixel also has the problem of voltage output under the condition of no illumination; on the other hand, the accuracy is insufficient when the image sensor performs analog-to-digital conversion. Lens shading Correction (LENS SHADING Correction, LSC) is used to eliminate the problem of color around the image and the inconsistency of brightness with the center of the image due to the lens optics.
3. Converting the processed Raw image into a YUV color space to obtain a down-sampled YUV image; and obtaining a real thumbnail image.
4. Converting the down-sampled YUV image into an RGB image, wherein the RGB image is used for being displayed in a display screen of the electronic equipment; furthermore, the downsampled YUV image is converted into an image in another storage format for storage in the electronic device.
S450, detecting the operation of bouncing up the shooting control.
It should be appreciated that the operation of bouncing the capture control may include the electronic device detecting that the user's finger has left the capture control; or the electronic device detects an operation of releasing the shooting control by the finger of the user, etc.
Alternatively, the above S450 may also refer to detection of an operation indicating the end of shooting; for example, a voice instruction or other operation to instruct the end of shooting is detected.
In an embodiment of the present application, when the electronic device detects an operation to pop up the shooting control, the third flow 470 may be triggered to be executed and a false thumbnail image may be displayed; wherein the third process 470 is a process for generating a photographed image; alternatively, the process of generating the photographed image may be any existing algorithm for generating the photographed image.
Alternatively, when the electronic device detects operation of bouncing the capture control, it may trigger the simultaneous execution of the third process 470 and display of a false thumbnail image.
S461, at the first time, a false thumbnail image is displayed.
Illustratively, an interface diagram showing a false thumbnail image at a first time is shown in (a) in fig. 6 later.
Alternatively, the dummy thumbnail image may be stored in the electronic device while the dummy thumbnail image is displayed.
For example, at the instant the electronic device detects operation of bouncing the capture control, an instruction may be sent; the false thumbnail images are stored in a gallery and displayed in the electronic device.
In the embodiment of the application, after the electronic equipment detects the operation of bouncing the shooting control, the electronic equipment can quickly display false thumbnail images in the shooting interface; when shooting, a user usually views a thumbnail image as if it were displayed in a shooting interface, and finishes a shooting process; in the embodiment of the application, the electronic equipment can quickly display the false thumbnail image in the shooting interface in a short time for the user to pop up the shooting control; in other words, the electronic device may respond to the shooting operation of the user in a short time, so that the user perceives that shooting is completed, thereby improving shooting experience of the user.
It should be appreciated that when displaying a false thumbnail image, a real thumbnail image may not have been generated yet; at this time, a false thumbnail image may be displayed in the photographing interface first; after the real thumbnail image is generated, the false thumbnail image may be replaced by the real thumbnail image, and the real thumbnail image may be displayed in the photographing interface.
S462, at a second moment, displaying the real thumbnail image.
Wherein the second time is after the first time.
An interface schematic diagram for displaying a real thumbnail image at the second time is shown in (a) in fig. 7 later.
Alternatively, the real thumbnail image may be stored in the electronic device while the real thumbnail image is displayed.
Optionally, a cache module may be included in an album application of the electronic device; at a first moment, a first storage space in the cache module is used for storing the false thumbnail image; at a second moment, the first storage space in the buffer memory module is used for storing the real thumbnail image; for example, at the second time, the dummy thumbnail image may be subjected to replacement processing by the real thumbnail image, the dummy thumbnail image is deleted, and the real thumbnail image is stored in the same storage space.
In an embodiment of the present application, after a real thumbnail image is generated, a false thumbnail image stored in an electronic device is directly replaced by the real thumbnail image; compared with the storage of the false thumbnail image and the real thumbnail image, the method and the device directly perform replacement processing in the embodiment of the application, so that the storage space of the electronic equipment occupied by the thumbnail image can be reduced.
Illustratively, the third process 470 includes S471 and S472; s471 and S472 are described in detail below.
S471, selecting the image frame from the ZSL queue.
Alternatively, image frames may be selected in the ZSL queue according to time information of an operation of detecting a click of the photographing control.
It should be appreciated that a user typically desires to acquire an image of the moment the shooting control is clicked on when the user takes the image; therefore, when generating a shot image, the electronic device can select an image frame in the ZSL queue according to the time information of detecting the operation of clicking the shooting control.
The electronic device detects that the shooting control is clicked, and the acquired time information is a time identifier 1; the ZSL queue includes: time stamp 1-image frame 1, time stamp 2-image frame 2, time stamp 3-image frame 3; based on time identification 1, the electronic device may select image frame 1 in the ZSL queue.
Alternatively, the image frames stored in the ZSL queue may be Raw images; the Raw image refers to Raw image data acquired by the image sensor.
Alternatively, the image frames used to generate the captured image may be obtained directly from the second process 440.
S472, generating a shooting image based on the selected image frame.
Illustratively, the selected Raw image may be processed to convert the Raw image to a YUV image; the YUV image can be converted into RGB image for display; in addition, the YUV image may be converted to other formats (e.g., JPEG format, JPG format, GIF format, etc.) for storage.
It should be appreciated that the captured image differs from the actual thumbnail image in that the resolution and image quality of the captured image are typically better than the actual thumbnail image.
Illustratively, the selected Raw image may be processed to convert the Raw image to a YUV image; the YUV image can be converted into RGB image for display; in addition, the YUV image may be converted to other formats (e.g., JPEG format, JPG format, GIF format, etc.) for storage.
Optionally, S472 includes, but is not limited to, the following steps:
1. Carrying out a Raw domain algorithm on the selected Raw image to obtain a processed Raw image; wherein the Raw domain algorithm includes, but is not limited to: black level correction processing, lens shading correction and other algorithms;
2. carrying out fusion processing on the multi-frame processed Raw image to obtain a fused Raw image;
Illustratively, fusion processing is performed on the long-exposure Raw image, the short-exposure Raw image and the normal-exposure Raw image, so as to obtain a fused Raw image.
3. Converting the fused Raw image into a YUV color space to obtain a YUV image; obtaining a shooting image;
4. Converting the YUV image into an RGB image, and performing scaling treatment on the RGB image to obtain a thumbnail image corresponding to the shooting image;
Optionally, the YUV image may be scaled to obtain a small-sized YUV image; converting the small-sized YUV image into a small-sized RGB image; a small-sized RGB image is displayed.
5. The YUV image is converted to an image in another storage format for storage in the electronic device. Optionally, the above is an example of the physical manner of S472; s472 can refer to any existing algorithm for generating a captured image, which is not limited in the present application.
S480, displaying the thumbnail image of the shot image at the third moment.
Wherein the third time is after the second time.
An interface schematic diagram of displaying a thumbnail image of a captured image at a third timing is illustrated in (a) in fig. 8 later.
Alternatively, the thumbnail image of the captured image may refer to a thumbnail image obtained by performing a scaling process on the captured image after the captured image is generated.
It should be understood that, assuming that the image size of the dummy thumbnail image is a first size, the image size of the real thumbnail image is a second size, and the image size of the photographed image is a third size; wherein the first size is the same as the second size; the third dimension is greater than the first dimension, or the third dimension is greater than the second dimension.
It should be understood that capturing an image may refer to capturing a true image generated by the image at a time; compared with a real thumbnail image, the shot image does not need to be subjected to downsampling processing; in addition, the photographed image may be an image based on a multi-frame Raw image fusion process; therefore, the image quality of the photographed image is better than that of the real thumbnail image.
After the electronic device generates the shot image, a thumbnail image obtained by scaling the shot image may be displayed on a display interface of the camera application, as shown in fig. 8 (a); at this time, stored in the album application is a captured image, such as image 111 shown in (b) in fig. 8.
Illustratively, for the same photographic subject, a false thumbnail is shown as 1 in fig. 4; the real thumbnail is shown as 11 in fig. 4; the captured image is shown as 111 in fig. 4.
Optionally, storing the captured image in an album application of the electronic device; when storing the photographed image, the real thumbnail image can be directly replaced by the photographed image.
Illustratively, a cache module may be included in an album application of the electronic device; at a first moment, a first storage space in the cache module is used for storing the false thumbnail image; at a second moment, the first storage space in the buffer memory module is used for storing the real thumbnail image; for example, at the second moment, the false thumbnail image may be subjected to replacement processing by the real thumbnail image, the false thumbnail image is deleted and the real thumbnail image is stored in the same storage space; at a third moment, the first storage space in the buffer memory module is used for storing the shot image; for example, at the third timing, the real thumbnail image may be subjected to replacement processing by the captured image, the real thumbnail image is deleted, and the captured image is stored in the same storage space.
It should be understood that the above-described false thumbnail image, true thumbnail image, and photographed image correspond to the same shot of the user; in other words, the false thumbnail image, the real thumbnail image and the shot image correspond to the same click shooting control and pop-up shooting control of the user; in addition, for the same shooting, the false thumbnail image, the real thumbnail image and the thumbnail image of the shooting image are mutually exclusive; for example, if a false thumbnail image is displayed in a display interface in a camera application, a thumbnail image of a real thumbnail and a photographed image is not displayed in the display interface; if the real thumbnail image is displayed in the display interface in the camera application program, the false thumbnail image and the thumbnail image of the shot image are not displayed in the display interface; if the thumbnail image of the shot image is displayed in the display interface in the camera application program, the false thumbnail image and the true thumbnail image are not displayed in the display interface.
Optionally, in an embodiment of the present application, a length of time required for the electronic device to generate the false thumbnail image is smaller than a length of time required to generate the real thumbnail image for one shooting; the electronic device generates a real thumbnail image for a duration less than a duration required to generate a thumbnail image of a captured image.
In the embodiment of the application, after a photographed image is generated, a real thumbnail image stored in an electronic device is directly replaced by the photographed image; compared with a photographed image and a real thumbnail image, the embodiment of the application directly performs the replacement processing, so that the storage space of the electronic device occupied by the thumbnail image can be reduced.
In the embodiment of the application, shooting operation is divided into operation of clicking a shooting control and operation of bouncing the shooting control, and when the electronic equipment detects the operation of clicking the shooting control, the electronic equipment is triggered to generate a false thumbnail image and a real thumbnail image; the false thumbnail image is a thumbnail image obtained by scaling based on the preview image; the real thumbnail image is a thumbnail image generated by selecting original image data for image processing; triggering and displaying a false thumbnail image when the electronic equipment detects that a user pops up a shooting control; the thumbnail image can be displayed at the moment when the electronic equipment detects the operation of bouncing the shooting control, so that the shooting response speed is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
In addition, triggering to generate a shooting image when the shooting control is detected to be sprung; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shot image is generated, the real thumbnail image can be subjected to replacement processing through the thumbnail image obtained by scaling the shot image; the image quality of the thumbnail image can be ensured while improving the photographing response speed.
Fig. 5 is a software architecture diagram according to an embodiment of the present application.
As shown in fig. 5, the software architecture provided by the embodiment of the present application may include an application layer, an application framework layer, a hardware abstraction layer, and a hardware layer.
By way of example, the application layer may include a series of application packages. As shown in fig. 5, the application package may include a camera application and an album application.
For example, as shown in FIG. 5, a preview storage module may be included in the camera application; the preview storage module is used for storing preview images.
Illustratively, the application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.
For example, as shown in fig. 5, in an embodiment of the present application, the application framework layer may include a click shooting control detection mode, a false thumbnail image generation module, a pop-up shooting control detection module, and a thumbnail image display module. The functions of each module will be described in detail in the following embodiments, and are not described in detail here.
For example, the hardware abstraction layer may provide interfaces between other modules and the hardware layer.
For example, as shown in fig. 5, the hardware abstraction layer may include a real thumbnail image generation module, a ZSL queue storage module, an image frame selection module, and a photographed image generation mode. The functions of each module will be described in detail in the following embodiments, and are not described in detail here.
The hardware layer may include a series of hardware modules, for example. As shown in fig. 5, the hardware layer may include a camera module.
Next, taking an example of detecting a shooting operation of the user, the interaction flow between the modules in the electronic device will be described in detail with reference to the software architecture diagram shown in fig. 5.
S511, the camera application program sends an instruction for collecting images to the camera module.
For example, after running the camera application, the camera application may send instructions to the camera module to capture images.
It should be understood that after the camera module obtains the instruction to collect the image, two paths of data streams can be generated; wherein, one path of data flow user generates preview image; the other data stream is used to generate a photographed image later.
S512, the camera module sends the image frames to the preview storage module.
Illustratively, the image frames sent by the camera module into the preview storage module are used to generate the preview image.
And S513, the camera module sends the image frames to the ZSL queue storage module.
Illustratively, the image frames sent by the camera module into the preview storage module are used to generate the captured image.
Alternatively, S513 and S512 may be performed simultaneously. For example, when the click shooting control detection module detects an operation of clicking the shooting control, step S513 and step S514 are triggered.
S514, a shooting control in the machine application program is clicked to trigger a shooting event; the clicking shooting module detects the operation that the shooting control is clicked.
Specifically, the description of the operation of clicking the shooting control detected by the block may refer to the correlation in step S420, which is not described herein.
S515, the click shooting detection module sends information to the false thumbnail image generation module, where the information may include time information that detects that the shooting control is clicked.
S516, the false thumbnail image generation module is used for acquiring a preview image from the preview storage module according to the time information; and scaling the preview image to generate a false thumbnail image.
Alternatively, the implementation of generating the dummy thumbnail image may be described with reference to the first flowchart 430 shown in fig. 4, which is not described herein.
S517, the click shooting detection module sends information to the image frame selection module, wherein the information can comprise time information for detecting that the shooting control is clicked.
And S518, the image frame selection module is used for acquiring original image data from the ZSL queue storage module according to the time information.
And S519, a real thumbnail image generation module is used for performing image processing on the original image data sent by the image rotation module to generate a real thumbnail image.
Alternatively, the implementation of generating the real thumbnail image may be described with reference to the second flowchart 440 shown in fig. 4, which is not described herein.
And S520, the bouncing shooting control detection module is used for detecting the shooting control operation in the bouncing camera application program.
Alternatively, when the pop-up shooting control detection module detects an operation of the pop-up shooting control, step S521 and step S525 may be triggered.
And S521, the pop-up shooting control detection sends an instruction to the thumbnail image display module, wherein the instruction is used for instructing the thumbnail image display module to display the thumbnail image.
S522, the thumbnail image display module acquires the false thumbnail image in the false thumbnail image generation module.
S523, the camera application program acquires the false thumbnail image sent by the thumbnail image display module and displays the false thumbnail image.
S524, the album application program obtains the false thumbnail image sent by the thumbnail image display module, and displays and stores the false thumbnail image.
And S525, the bouncing shooting control detection control is used for sending an instruction to the shooting image generation module, and the instruction is used for instructing the shooting image generation module to acquire an image frame to generate a shooting image.
S526, a shot image generation module is used for acquiring the image frames in the ZSL queue storage module and processing the image frames to generate shot images.
Alternatively, the implementation manner of generating the captured image may be described in relation to the third flow 470 shown in fig. 4, which is not described herein.
S527, the real thumbnail image generation module is configured to send the real thumbnail image to the thumbnail image display module after generating the real thumbnail image.
S528, the camera application acquires the real thumbnail image transmitted from the thumbnail image display module and displays the real thumbnail image.
S529, the album application acquires the real thumbnail image transmitted from the thumbnail image display module, displays the real thumbnail image, and performs substitution processing on the false thumbnail image stored by the real thumbnail image pair.
And S530, the shot image generation module is used for sending the shot image to the thumbnail image display module after generating the shot image.
S531, the camera application is used to acquire the captured image sent by the thumbnail image display module and display the thumbnail image of the captured image.
S532, the album application program is used for acquiring the shot image sent by the thumbnail image display module, displaying the shot image and replacing the stored real thumbnail image by the shot image.
In the embodiment of the application, shooting operation is divided into operation of clicking a shooting control and operation of bouncing the shooting control, and when the electronic equipment detects the operation of clicking the shooting control, the electronic equipment is triggered to generate a false thumbnail image and a real thumbnail image; the false thumbnail image is a thumbnail image obtained by scaling based on the preview image; the real thumbnail image is a thumbnail image generated by selecting original image data for image processing; triggering and displaying a false thumbnail image when the electronic equipment detects that a user pops up a shooting control; the thumbnail image can be displayed at the moment when the electronic equipment detects the operation of bouncing the shooting control, so that the shooting response speed is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
In addition, triggering to generate a shooting image when the shooting control is detected to be sprung; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shot image is generated, the real thumbnail image can be subjected to replacement processing through the thumbnail image obtained by scaling the shot image; the image quality of the thumbnail image can be ensured while improving the photographing response speed.
The following is an illustration of an interface diagram of an electronic device detecting a shooting operation with reference to fig. 6 and 7.
Illustratively, at time T (10), the electronic device detects that the camera application is running, as shown in fig. 6 (a) as a preview interface 610 of the camera application; included in the preview interface 610 are a first photographic subject 611, a photographic control 612, and a thumbnail display control 613; wherein the thumbnail image displayed in the thumbnail display control 613 is the thumbnail image of the last shot image; fig. 6 (b) is a schematic diagram of an album application, in which a first shot image 621 and a second shot image 622 are included in an album display interface 620; next, a buffer module 630 is included in the album application, and the buffer module 630 includes the first photographed image 621 and the second photographed image 622.
For example, as can be seen from (a) in fig. 6 and (b) in fig. 6, the thumbnail image displayed in the thumbnail control 612 in the preview interface 610 is a thumbnail image corresponding to the first captured image 621; if the electronic device detects an operation to click on the thumbnail control 612, it may index into the first captured image 621 in the album application and display the first captured image 621.
It should be appreciated that the cache module 630 is not displayed in the display interface 620 of the camera application; the buffer module 630 is a module for storing images in an electronic device.
Illustratively, at time T (11), the electronic device detects an operation of clicking on the capture control 612, as shown in (c) of fig. 6; at this time, the thumbnail image displayed in the thumbnail display control 613 is the thumbnail image of the last completed captured image (for example, the thumbnail image of the first captured image 621); when the electronic device detects an operation of clicking the photographing control 612 by the user, the display interface of the album application is as shown in (d) of fig. 6; at time T (12), the electronic device detects operation of bouncing the capture control 612, and a false thumbnail image of the first capture object is displayed in the display interface 614; wherein the shooting interface 614 includes the second shooting object 615, and the thumbnail image displayed in the thumbnail display control 613 is a false thumbnail image of the first shooting object 611, as shown in (a) in fig. 7; at this time, the display interface 620 of the album application includes the dummy thumbnail image 1 of the first photographing object, the first photographing image 621, and the second photographing image 622; the buffer module 630 includes a false thumbnail image of the first shooting object, a first shooting image and a second shooting image; at time T (13), after the electronic device generates the real thumbnail image, a display interface 616 is displayed, the display interface 616 includes the second photographic subject 615, the thumbnail display control 612, and the photographic control 612, and the real thumbnail image of the first photographic subject is displayed in the thumbnail display control 613, as shown in (c) in fig. 7; at this time, the camera application display interface 624 includes the real thumbnail image 11 of the first photographic subject, the first photographic image 621, and the second photographic image 622; the buffer module 630 stores therein the real thumbnail image of the first photographing object, the first photographing image 621, and the second photographing image 622.
After the real thumbnail image of the first photographic subject is generated in the electronic device, the real thumbnail image is displayed in the display interface, and the dummy thumbnail image of the first photographic subject is replaced by the real thumbnail image of the first photographic subject in the album application.
Alternatively, the implementation manner of generating the false thumbnail image of the first photographic subject may refer to the first flowchart 430 shown in fig. 4, which is not described herein.
Alternatively, the implementation manner of generating the real thumbnail image of the first photographic subject may refer to the second flowchart 440 shown in fig. 4, which is not described herein.
Illustratively, at time T (14), after the electronic device generates the captured image of the first captured object, display interface 617 is displayed, with display interface 617 including second captured object 615, thumbnail display control 613, and capture control 612; a thumbnail image of a captured image of the first capturing object is displayed in the thumbnail display control 613 as shown in (a) in fig. 8; at this time, the camera application displays a display interface 625, and the display interface 625 includes the captured image 111 of the first captured object, the first captured image 621, and the second captured image 622; the buffer module 630 stores the photographed image of the first photographing object, the first photographed image, and the second photographed image.
After the captured image of the first subject is generated in the electronic device, a thumbnail image of the captured image is displayed in the display interface, and a real thumbnail image of the first subject is subjected to replacement processing by the captured image of the first subject in the album application.
Optionally, the implementation manner of generating the captured image of the first capturing object may refer to the third process 470 shown in fig. 4, which is not described herein.
In the embodiment of the application, shooting operation is divided into operation of clicking a shooting control and operation of bouncing the shooting control, and when the electronic equipment detects the operation of clicking the shooting control, the electronic equipment is triggered to generate a false thumbnail image and a real thumbnail image; the false thumbnail image is a thumbnail image obtained by scaling based on the preview image; the real thumbnail image is a thumbnail image generated by selecting original image data for image processing; triggering and displaying a false thumbnail image when the electronic equipment detects that a user pops up a shooting control; the thumbnail image can be displayed at the moment when the electronic equipment detects the operation of bouncing the shooting control, so that the shooting response speed is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
In addition, triggering to generate a shooting image when the shooting control is detected to be sprung; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shot image is generated, the real thumbnail image can be subjected to replacement processing through the thumbnail image obtained by scaling the shot image; the image quality of the thumbnail image can be ensured while improving the photographing response speed.
Implementation II
Optionally, the electronic device detects two shooting operations; for example, the electronic device sequentially detects: the shooting control is clicked for the first time, the shooting control is sprung up for the first time, and the shooting control is clicked for the second time and sprung up for the second time.
Example one
Alternatively, when the electronic device generates the second shot dummy thumbnail image, the electronic device has generated the first shot dummy thumbnail image, the first shot real thumbnail image, and no first shot image.
For example, the order in which the electronic device generates the images is in turn: a false thumbnail image 1 photographed for the first time, a true thumbnail image 11 photographed for the first time, a false thumbnail image 2 photographed for the second time, a photographed image 111 photographed for the first time, a true thumbnail image 22 photographed for the second time, and a photographed image 222 photographed for the second time.
Fig. 9 is a software architecture diagram according to an embodiment of the present application.
As shown in fig. 9, the software architecture provided by the embodiment of the present application may include an application layer, an application framework layer, a hardware abstraction layer, and a hardware layer.
By way of example, the application layer may include a series of application packages. As shown in fig. 9, the application package may include a camera application and an album application.
For example, as shown in FIG. 9, a preview storage module may be included in the camera application; the preview storage module is used for storing preview images.
Illustratively, the application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.
For example, as shown in fig. 9, in an embodiment of the present application, the application framework layer may include a click shooting control detection mode, a false thumbnail image generation module, a pop-up shooting control detection module, and a thumbnail image display module. The functions of each module will be described in detail in the following embodiments, and are not described in detail here.
For example, the hardware abstraction layer may provide interfaces between other modules and the hardware layer.
For example, as shown in fig. 9, the hardware abstraction layer may include a real thumbnail image generation module, a ZSL queue storage module, an image frame selection module, and a photographed image generation mode. The functions of each module will be described in detail in the following embodiments, and are not described in detail here.
The hardware layer may include a series of hardware modules, for example. As shown in fig. 9, the hardware layer may include a camera module.
Next, taking the above case as an example, the interaction flow between the modules in the electronic device will be described in detail with reference to the software architecture diagram shown in fig. 9.
S711, the camera application program sends an instruction for acquiring an image to the camera module.
For example, after running the camera application, the camera application may send instructions to the camera module to capture images.
It should be understood that after the camera module obtains the instruction to collect the image, two paths of data streams can be generated; wherein, one path of data flow user generates preview image; the other data stream is used to generate a photographed image later.
S712, the camera module sends the image frames to the preview storage module.
Illustratively, the image frames sent by the camera module into the preview storage module are used to generate the preview image.
And S713, the camera module sends the image frames to the ZSL queue storage module.
Illustratively, the image frames sent by the camera module into the preview storage module are used to generate the captured image.
Alternatively, S713 and S712 may be performed simultaneously.
S714, a shooting control in the machine application program is clicked to trigger a shooting event; the clicking shooting module detects the clicked operation of the shooting control; for example, the first click of the photographing control is detected.
Specifically, the relevant description of the operation of clicking the shooting control detected by the block may refer to the relevant description in step S420, which is not described herein.
S715, the click shooting detection module sends first information to the false thumbnail image generation module, where the first information may include time information 1 when the first click shooting control is detected.
S716, the false thumbnail image generation module is used for acquiring a preview image 1 from the preview storage module according to the time information 1; the preview image 1 is subjected to scaling processing to generate a false thumbnail image 1.
For example, the false thumbnail image generating module is used for acquiring the preview image 1 from the preview storage module according to the time information 1 of the first detected click shooting control; the preview image 1 is subjected to scaling processing to generate a false thumbnail image 1.
For example, the implementation of generating the dummy thumbnail image 1 may be referred to in fig. 4 as a description related to the first flowchart 430, which is not repeated herein.
S717, the click detection module sends second information to the image frame selection module, where the second information may include time information 1 when the first click of the shooting control is detected.
S718, the image frame selection module is used for acquiring original image data 1 from the ZSL queue storage module according to the time information 1.
S719, the real thumbnail image generating module is configured to perform image processing on the original image data 1 sent by the image selecting module, to generate a real thumbnail image 11.
S720, a bouncing shooting control detection module is used for detecting the operation of shooting controls in the bouncing camera application program.
Illustratively, the pop-up capture control detection module detects operation of the pop-up capture control for the first time.
Optionally, in an embodiment of the present application, the pop-up shooting control detection module and the click shooting control detection module may be the same module; the present application is not limited in any way.
Alternatively, when the pop-up shooting control detection module detects the operation of the first pop-up shooting control, a flow of displaying the false thumbnail image 1 (e.g., S721 to S724) and generating the shooting image of the first shooting (e.g., S725 and S726) may be triggered.
For example, the process of displaying a false thumbnail image and generating a photographed image of the first photographing may be triggered simultaneously.
And S721, the bouncing shooting control detection sends a first instruction to the thumbnail image display module, wherein the first instruction is used for instructing the thumbnail image display module to display the thumbnail image.
S722, the thumbnail image display module acquires the false thumbnail image 1 in the false thumbnail image generation module.
S723, the camera application acquires the false thumbnail image 1 sent by the thumbnail image display module, and displays the false thumbnail image 1.
S724, the album application program acquires the false thumbnail image 1 sent by the thumbnail image display module, and displays and stores the false thumbnail image 1.
And S725, the bouncing shooting control detection control is used for sending a second instruction to the shooting image generation module, and the second instruction is used for instructing the shooting image generation module to acquire the image frame to generate the shooting image 111.
S726, the shot image generation module is used for acquiring the image frames in the ZSL queue storage module and processing the image frames to generate the shot image 111.
For example, the implementation of generating the captured image 111 may refer to the related description of the third process 470 in fig. 4, which is not repeated herein.
S727, the real thumbnail image generation module is configured to generate the real thumbnail image 11, and transmit the real thumbnail image 11 to the thumbnail image display module after generating the real thumbnail image 11.
For example, the implementation of generating the real thumbnail image 11 may refer to the related description of the second flow 440 in fig. 4, which is not repeated herein.
S728, the camera application acquires the real thumbnail image 11 sent by the thumbnail image display module, and displays the real thumbnail image 11.
S729, the album application acquires the real thumbnail image 11 sent by the thumbnail image display module, displays the real thumbnail image, and performs replacement processing on the stored dummy thumbnail image 1 by the real thumbnail image 11.
S730, detecting the clicked operation of the shooting control by the clicking shooting module; for example, a second click of the photographing control is detected.
S731, the false thumbnail image generating module is configured to obtain, from the click detection module, time information 2 of the second click shooting control.
S732, the false thumbnail image generation module is used for acquiring a preview image 2 from the preview storage module according to the time information 2 of the second detection of clicking the shooting control; the preview image 2 is scaled to generate a false thumbnail image 2.
For example, the false thumbnail image generating module is used for acquiring a preview image 2 from the preview storage module according to the time information 2 of the second detection of clicking the shooting control; the preview image 2 is scaled to generate a false thumbnail image 2.
For example, the implementation of generating the dummy thumbnail image 2 may be described with reference to the first flowchart 430 in fig. 4, and will not be described herein.
S733, the false thumbnail image generating module is configured to send the false thumbnail image 2 to the thumbnail image display module after generating the false thumbnail image 2.
For example, the implementation of generating the dummy thumbnail image 2 may be described with reference to the first flowchart 430 in fig. 4, and will not be described herein.
S734, the pop-up shooting control detection module is used for detecting the operation of shooting controls in the pop-up camera application program.
For example, the pop-up capture control module detects operation of the pop-up capture control a second time.
Alternatively, when the pop-up shooting control detection module detects the operation of the pop-up shooting control for the second time, the flow of displaying the false thumbnail image 2 and generating the shooting image for the second time may be triggered.
S735, the pop-up shooting control detection module is configured to send a third instruction to the thumbnail image display module, where the third instruction is configured to instruct the thumbnail image display module to display the thumbnail image 2.
S736, the camera application is configured to receive the dummy thumbnail image 2 sent by the thumbnail image display module, and display the dummy thumbnail image 2.
S737, the album application is used for receiving the dummy thumbnail image 2 transmitted from the thumbnail image display module, and displaying and storing the dummy thumbnail image 2.
S738, the captured image generating module is configured to send the captured image 111 to the thumbnail image display module after generating the captured image 111 captured for the first time.
It should be noted that, since the time information 2 of the second shot control is later than the time information 1 of the first shot control; the camera application program generally displays a thumbnail image closest to the current moment according to the time information; therefore, after the false thumbnail image 2 of the second shot is displayed in the camera application, the electronic device does not display the thumbnail image of the shot image 111 of the first shot any more.
S739, the album application is for receiving the photographed image transmitted from the thumbnail image display module, displaying the photographed image, and performing a replacement process on the real thumbnail image stored by the photographed image.
S740, the image frame selection module is used for acquiring time information 2 of the second click shooting control from the click shooting module.
And S741, an image frame selection module is used for acquiring original image data 2 from the ZSL queue storage module according to the time information 2.
S742, the real thumbnail image generating module is configured to perform image processing on the original image data 2 sent by the image selecting module, and generate a real thumbnail image 22.
And S743, a bouncing shooting control detection module is used for detecting the operation of shooting controls in the bouncing camera application program.
Illustratively, the pop-up capture control detection module is configured to detect operation of a capture control in the second pop-up camera application.
S744, the pop-up shooting control detection control is configured to send a fourth instruction to the shot image generation module, where the fourth instruction is configured to instruct the shot image generation module to acquire the image frame to generate the shot image 222 that is shot for the second time.
And S745, the shot image generation module is used for acquiring the image frames in the ZSL queue storage module and processing the image frames to generate shot images 222.
For example, the implementation of generating the captured image 222 may refer to the related description of the third process 470 in fig. 4, which is not repeated herein.
S746, the real thumbnail image generation module is configured to generate the real thumbnail image 22 photographed for the second time, and transmit the real thumbnail image 22 to the thumbnail image display module after generating the real thumbnail image 22.
For example, the implementation of generating the real thumbnail image 22 may be referred to in fig. 4 in the second flowchart 440, and will not be described herein.
S747, the camera application acquires the real thumbnail image 22 sent by the thumbnail image display module, and displays the real thumbnail image 22.
S748 the album application is configured to receive the real thumbnail image 22 sent by the thumbnail image display module, and display the real thumbnail image 22; and performs a replacement process for the stored dummy thumbnail image 2 through the real thumbnail image 22.
S749, the captured image generating module is configured to send the captured image 222 to the thumbnail image display module after generating the captured image 222.
S750, the camera application is configured to receive the captured image 222 sent by the thumbnail image display module, and display a thumbnail image of the captured image 222.
S751, the album application is configured to receive the captured image 222 sent by the thumbnail image display module, and display the captured image 222; and performs a replacement process for the stored real thumbnail image 22 by photographing the image 222.
Alternatively, the click shooting control detection module and the pop-up shooting control detection module shown in fig. 9 may be the same module; and may be different modules, which the present application does not in any way limit.
In the embodiment of the application, shooting operation is divided into operation of clicking a shooting control and operation of bouncing the shooting control, and when the electronic equipment detects the operation of clicking the shooting control, the electronic equipment is triggered to generate a false thumbnail image and a real thumbnail image; the false thumbnail image is a thumbnail image obtained by scaling based on the preview image; the real thumbnail image is a thumbnail image generated by selecting original image data for image processing; triggering and displaying a false thumbnail image when the electronic equipment detects that a user pops up a shooting control; the thumbnail image can be displayed at the moment when the electronic equipment detects the operation of bouncing the shooting control, so that the shooting response speed is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
In addition, triggering to generate a shooting image when the shooting control is detected to be sprung; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shot image is generated, the real thumbnail image can be subjected to replacement processing through the thumbnail image obtained by scaling the shot image; the image quality of the thumbnail image can be ensured while improving the photographing response speed.
The interface schematic diagrams of the above example one are illustrated below with reference to fig. 10 to 14.
Illustratively, at time T (20), the electronic device detects that the camera application is running, as shown in fig. 10 (a) as a preview interface 810 of the camera application; included in the preview interface 810 are a first photographic subject 811, a photographic control 812, and a thumbnail display control 813; wherein the thumbnail image displayed in the thumbnail display control 813 is a thumbnail image of the last shot image; fig. 10 (b) shows a display interface 820 of the album application, and a first captured image 821 is included in the display interface 820; next, a buffer module 830 is included in the album application, and the buffer module 830 includes the first captured image 821.
For example, as can be seen from (a) in fig. 10 and (b) in fig. 10, the thumbnail image displayed in the thumbnail control 812 in the preview interface 810 is a thumbnail image corresponding to the first captured image 821; if the electronic device detects an operation to click on the thumbnail control 812, it may index into the first captured image 821 in the album application and display the first captured image 821.
It should be appreciated that the cache module 830 is not shown in the display interface 820 of the camera application; the buffer module 830 is a module for storing images in the electronic device.
Illustratively, at time T (21), the electronic device detects an operation to click on the capture control 812; for example, the operation of clicking the photographing control 812 for the first time is detected, as shown in (c) in fig. 10; at this time, the thumbnail image displayed in the thumbnail display control 813 is a thumbnail image of the last completed captured image (for example, a thumbnail image of the first captured image 821); when the electronic device detects an operation of clicking the photographing control 812 by the user, the display interface of the album application is as shown in (d) of fig. 10; at time T (22), the electronic device detects operation of bouncing the capture control 812, and displays a display interface 814; for example, detecting the operation of bouncing the shooting control 812 for the first time, the display interface 814 is displayed; the display interface 814 includes the second shot 815 and a thumbnail display control 813, where the thumbnail image displayed in the thumbnail display control 813 is a false thumbnail image of the first shot 811, as shown in (a) in fig. 11; at this time, as shown in (b) in fig. 11, the false thumbnail image 1 of the first photographic subject and the first photographic image 821 are included in the display interface 823 of the album application; the buffer module 830 includes a false thumbnail image of the first photographing object and the first photographing image; at time T (23), after the electronic device generates a real thumbnail image of the first photographic subject, display interface 816 is displayed; the display interface 816 includes a second shot 815, a thumbnail display 813, and a shot 812, and a thumbnail display 8613 displays a real thumbnail image of the first shot, as shown in fig. 11 (c); at this time, as shown in (d) of fig. 11, the camera application display interface 824 includes the real thumbnail image 11 of the first photographic subject and the first photographic image 821; the buffer module 830 stores therein the real thumbnail image of the first photographing object and the first photographing image.
After the real thumbnail image of the first photographic subject is generated in the electronic device, the real thumbnail image of the first photographic subject is displayed in the display interface, and the dummy thumbnail image 1 of the first photographic subject is subjected to substitution processing by the real thumbnail image 11 of the first photographic subject in the album application.
Alternatively, the implementation manner of generating the false thumbnail image of the first photographic subject may refer to the first flowchart 430 shown in fig. 4, which is not described herein.
Alternatively, the implementation manner of generating the real thumbnail image of the first photographic subject may refer to the second flowchart 440 shown in fig. 4, which is not described herein.
Illustratively, at time T (24), the electronic device detects an operation to click on the capture control 812, displaying a display interface 816; for example, the operation of clicking the photographing control 812 for the second time is detected, as shown in (a) in fig. 12; the display interface 816 includes a second shot 815 and a thumbnail display control 813, and the thumbnail display control 813 displays a real thumbnail image of the first shot 811; at this time, as shown in (b) in fig. 12, the real thumbnail image 11 of the first photographic subject and the first photographic image 821 are included in the display interface 824 of the album application; the buffer module 830 includes a real thumbnail image of the first photographing object and the first photographing image. At time T (25), the electronic device detects an operation of bouncing the shooting control 812, and displays a display interface 817; for example, the operation of bouncing the shooting control 812 for the second time is detected, and the display interface 817 is displayed; the display interface 817 includes a third shooting object and a thumbnail display control 813, where the thumbnail image displayed in the thumbnail display control 813 is a false thumbnail image of the second shooting object 815, as shown in (c) in fig. 12; at this time, as shown in (d) of fig. 12, the false thumbnail image 2 of the second photographic subject, the true thumbnail image 11 of the first photographic subject, and the first photographic image 821 are included in the display interface 825 of the booklet application; the buffer module 830 includes a false thumbnail image of the second photographing object, a real thumbnail image of the first photographing object, and the first photographing image.
It is understood that at times T (24) and T (25), the electronic device has not yet generated a captured image of the first subject, and has detected the second capturing operation.
Illustratively, at time T (26), as shown in (a) of fig. 13, after the electronic device generates the captured image of the first captured object, the display interface 817 includes the third captured object, the capturing control 812, and the thumbnail display control 813; at this time, as shown in (b) of fig. 13, the display interface 817 includes the false thumbnail image 2 of the second photographic subject, the photographic image 111 of the first photographic subject, and the first photographic image 821 in the display interface 826 of the album application; the buffer module 830 includes a false thumbnail image of the second photographing object, a real image of the first photographing object, and the first photographing image.
Alternatively, after the photographed image of the first photographing object is generated in the electronic device, a replacement process is performed on the real thumbnail image of the first photographing object through the photographed image of the first photographing object in the album application.
Optionally, the implementation manner of generating the captured image of the first capturing object may refer to the third process 470 shown in fig. 4, which is not described herein.
It should be appreciated that since the second shot is operated later than the first shot; therefore, even if the electronic device generates the photographed image of the first photographing object after the electronic device displays the thumbnail image of the second photographing object, the thumbnail image of the photographed image of the first photographing object is not displayed in the thumbnail display control in the display interface in the camera application; therefore, the display interface of the camera application is the same at time T (26) as at time T (25).
It should also be appreciated that the second shot is a two-shot independent shooting process from the first shot; therefore, in the cache module in the camera application program, the previously generated thumbnail image is replaced by the later generated real thumbnail image in the same shooting process; replacing the previously generated real thumbnail image with the later generated photographed image; but the second shot image does not replace the first shot image.
Illustratively, at time T (27), the electronic device generates a real thumbnail image of the second photographic subject, and displays a display interface 818, as shown in (c) in fig. 13; the display interface 818 includes a third shooting object and a thumbnail display control 813, where the thumbnail display control 813 displays a real thumbnail image of the second shooting object; at this time, as shown in (d) of fig. 13, the real thumbnail image 22 of the second photographic subject, the photographic image 111 of the first photographic subject, and the first photographic image 821 are included in the display interface 827 of the album application; the buffer module 830 stores the real thumbnail image of the second subject, the captured image of the first subject, and the first captured image.
Illustratively, at time T (28), the electronic device generates a real image of the second photographic subject, and displays a display interface 819, as shown in fig. 14 (a); the display interface 819 includes a third shot object and a thumbnail display control 813, where the thumbnail display control 813 displays a thumbnail image that is a shot image of the second shot object 815; at this time, as shown in (b) in fig. 14, the display interface 828 of the album application includes the photographed image 222 of the second photographing object, the photographed image 111 of the first photographing object, and the first photographed image 821; the buffer module 830 stores the second shot image, the first shot image, and the first shot image.
After the shot image is generated, the shot image is stored in the album application program, and the thumbnail image obtained by scaling the shot image is displayed in the camera application program; and after the electronic device generates the real thumbnail image or the false thumbnail image, storing the real thumbnail image or the false thumbnail image in the album application and displaying the real thumbnail image or the false thumbnail image in the camera application.
Optionally, the implementation manner of generating the captured image of the second capturing object may refer to the third process 470 shown in fig. 4, which is not described herein.
Example two
Optionally, when the electronic device generates the second shot dummy thumbnail image, the electronic device has generated the first shot dummy thumbnail image, the first shot real thumbnail image, and the first shot image. The specific implementation process may be referred to in the related description of example one, and will not be described herein.
Example three
Alternatively, when the electronic device generates the second shot dummy thumbnail image, the electronic device has generated the first shot dummy thumbnail image and has not generated the first shot real thumbnail image and the first shot image. The specific implementation process may be referred to in the related description of example one, and will not be described herein.
In the embodiment of the application, shooting operation is divided into operation of clicking a shooting control and operation of bouncing the shooting control, and when the electronic equipment detects the operation of clicking the shooting control, the electronic equipment is triggered to generate a false thumbnail image and a real thumbnail image; the false thumbnail image is a thumbnail image obtained by scaling based on the preview image; the real thumbnail image is a thumbnail image generated by selecting original image data for image processing; triggering and displaying a false thumbnail image when the electronic equipment detects that a user pops up a shooting control; the thumbnail image can be displayed at the moment when the electronic equipment detects the operation of bouncing the shooting control, so that the shooting response speed is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
In addition, triggering to generate a shooting image when the shooting control is detected to be sprung; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shot image is generated, the real thumbnail image can be subjected to replacement processing through the thumbnail image obtained by scaling the shot image; the image quality of the thumbnail image can be ensured while improving the photographing response speed.
An interface schematic diagram of the electronic device for displaying the false thumbnail image in an opening manner, i.e., performing the method for displaying the thumbnail image according to the embodiment of the present application, will be described with reference to fig. 15 and 16.
In one example, after the electronic device detects the operation of clicking the intelligent control 840 as shown in (b) of fig. 15, the method for displaying a thumbnail image provided by the embodiment of the present application is performed.
Illustratively, after the electronic device runs the camera application, a preview interface as shown in (a) in fig. 15 is displayed; in the preview interface, preview images are included with the intelligent control 840; the electronic device detects an operation of clicking on the intelligent control 840, as shown in (b) of fig. 15; after the electronic device detects the operation of clicking the intelligent control 840, the method for displaying the thumbnail image provided by the embodiment of the present application is performed.
In one example, after the electronic device detects the operation of clicking the control 851 as shown in (d) of fig. 16, the method for displaying a thumbnail image provided by the embodiment of the present application is performed.
Illustratively, after the camera application is run in the electronic device, a preview interface as shown in (a) in fig. 16 may be displayed; the preview interface includes a preview image and a setup control 850; the electronic device detects an operation of clicking the setting control 850, as shown in (b) in fig. 16; after the electronic device detects the operation of clicking the setting control 850, a setting interface is displayed, as shown in (c) in fig. 16; setting a control 851 comprising a quick thumbnail image in the interface; the electronic apparatus detects an operation of clicking on the control 851 of the quick thumbnail image, as shown in (d) in fig. 16; after the electronic device detects the operation of the control 851 for the quick thumbnail image, the method for displaying the thumbnail image provided by the embodiment of the application is executed.
In the embodiment of the application, shooting operation is divided into operation of clicking a shooting control and operation of bouncing the shooting control, and when the electronic equipment detects the operation of clicking the shooting control, the electronic equipment is triggered to generate a false thumbnail image and a real thumbnail image; the false thumbnail image is a thumbnail image obtained by scaling based on the preview image; the real thumbnail image is a thumbnail image generated by selecting original image data for image processing; triggering and displaying a false thumbnail image when the electronic equipment detects that a user pops up a shooting control; the thumbnail image can be displayed at the moment when the electronic equipment detects the operation of bouncing the shooting control, so that the shooting response speed is improved; the shooting waiting time of the user is reduced, and shooting experience is improved.
In addition, triggering to generate a shooting image when the shooting control is detected to be sprung; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shot image is generated, the real thumbnail image can be subjected to replacement processing through the thumbnail image obtained by scaling the shot image; the image quality of the thumbnail image can be ensured while improving the photographing response speed.
It should be noted that the foregoing is illustrative of the application of the electronic device to the display interface for photographing a scene, and the present application is not limited thereto.
It should be understood that the above description is intended to aid those skilled in the art in understanding the embodiments of the present application, and is not intended to limit the embodiments of the present application to the specific values or particular scenarios illustrated. It will be apparent to those skilled in the art from the foregoing description that various equivalent modifications or variations can be made, and such modifications or variations are intended to be within the scope of the embodiments of the present application.
The method for displaying thumbnail images provided by the embodiment of the present application is described in detail above with reference to fig. 1 to 16; an embodiment of the device of the present application will be described in detail with reference to fig. 17 to 18. It should be understood that the apparatus in the embodiments of the present application may perform the methods of the foregoing embodiments of the present application, that is, specific working procedures of the following various products may refer to corresponding procedures in the foregoing method embodiments.
Fig. 17 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 900 includes a display module 910 and a processing module 920.
In one implementation, the display module 910 is configured to display a first display interface at a first time, where the first display interface includes a first control, a thumbnail display area, and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time; the processing module 920 is configured to detect a first operation on the first control, where the first operation is used to instruct start of shooting, where shooting may include shooting; in response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing; detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting; the display module 910 is further configured to sequentially display, in response to the second operation, the first thumbnail image, the second thumbnail image, and a third thumbnail image in the thumbnail display area, where the third thumbnail image has an image quality better than that of the second thumbnail image.
Optionally, as an embodiment, the first image processing includes a downsampling process; the second image processing has a higher algorithmic complexity than the first image processing.
Optionally, as an embodiment, the processing module 920 is further configured to:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
Optionally, as an embodiment, the electronic device includes a storage module, where the storage module includes a first storage area, and the processing module 920 is further configured to:
Performing replacement processing on the first thumbnail image of the first storage area through the second thumbnail image when the second thumbnail image is generated by the electronic device and the first captured image is not generated;
and when the electronic equipment generates the first shooting image, replacing the second thumbnail image of the first storage area through the first shooting image.
Optionally, as an embodiment, the processing module 920 is specifically configured to:
Acquiring time information of detecting the first operation;
And selecting the first image from a zero second delay queue in the electronic equipment based on the time information.
Optionally, as an embodiment, the second image processing includes a first algorithm processing and a second algorithm processing, where the first algorithm is an algorithm of a first color space, and the second algorithm is an algorithm of converting an image of the first color space into an image of a second color space, and the processing module 920 is specifically configured to:
Performing first algorithm processing on the first image to obtain an image in a first color space;
fusing at least two frames of images in the first color space to obtain a fused image;
And performing second algorithm processing on the fusion image to generate the first shooting image.
Optionally, as an embodiment, the first operation is an operation of clicking on the first control; the second operation is an operation of bouncing the first control.
Optionally, as an embodiment, the image quality includes image texture information or image brightness information.
In one implementation, the display module 910 is configured to display a first display interface at a first time, where the first display interface includes a first control, a thumbnail display area, and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time; the processing module 920 is configured to detect a first operation on the first control, where the first operation is used to instruct start of shooting, where shooting may include shooting; in response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing; detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting; the display module 910 is configured to sequentially display the first thumbnail image and the second thumbnail image in the thumbnail display area in response to the second operation; and, generating a third thumbnail image having an image quality superior to the second thumbnail image; the processing module 920 is configured to detect, before generating the third thumbnail image, a third operation on the first control, where the third operation is used to instruct the start of shooting; in response to the third operation, saving a fourth thumbnail image in the album application and generating a fifth thumbnail image; the fourth thumbnail image is generated by the second image through the first image processing; the fifth thumbnail image is generated by the second image through second image processing; the second image is an image acquired by the electronic equipment in real time at a second moment, and the second moment is later than the first moment; detecting a fourth operation of the first control, wherein the fourth operation is used for indicating the shooting ending; the display module 910 is configured to sequentially display, in response to the fourth operation, the fourth thumbnail image, the fifth thumbnail image, and a sixth thumbnail image in the thumbnail display area, where the image quality of the sixth thumbnail image is better than that of the fifth thumbnail image.
Optionally, as an embodiment, the first image processing includes a downsampling process; the second image processing has a higher algorithmic complexity than the first image processing.
Optionally, as an embodiment, the processing module 920 is specifically configured to:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
Optionally, as an embodiment, the processing module 920 is further configured to:
Generating a second captured image in response to the fourth operation;
And scaling the second shooting image based on the size of the thumbnail display area to generate the sixth thumbnail image.
Optionally, as an embodiment, the electronic device includes a storage module, where the storage module includes a first storage area and a second storage area, and the first storage area is used to store the first thumbnail image, the second thumbnail image, or the first shot image; the second storage area is used for storing the fourth thumbnail image, the fifth thumbnail image or the second shooting image; the first storage area and the second storage area are different storage areas in the storage module.
Optionally, as an embodiment, the processing module 920 is further configured to:
performing replacement processing on the first thumbnail image of the first storage area by the second thumbnail image in a case where the second thumbnail image is generated and the first captured image is not generated;
In the case of generating the first captured image, the second thumbnail image of the first storage area is subjected to replacement processing by the first captured image.
Optionally, as an embodiment, the processing module 920 is further configured to:
performing replacement processing on the fourth thumbnail image of the second storage area by the fifth thumbnail image in a case where the fifth thumbnail image is generated and the second captured image is not generated;
in the case of generating the second captured image, the fifth thumbnail image of the second storage area is subjected to replacement processing by the second captured image.
Optionally, as one embodiment, the first operation and the third operation are operations of clicking the first control; the second operation and the fourth operation are operations of bouncing up the first control.
Optionally, as an embodiment, the image quality includes image texture information or image brightness information.
The electronic device 900 is embodied in the form of a functional module. The term "module" herein may be implemented in software and/or hardware, and is not specifically limited thereto.
For example, a "module" may be a software program, a hardware circuit, or a combination of both that implements the functionality described above. The hardware circuitry may include Application Specific Integrated Circuits (ASICs), electronic circuits, processors (e.g., shared, proprietary, or group processors, etc.) and memory for executing one or more software or firmware programs, merged logic circuits, and/or other suitable components that support the described functions.
Thus, the elements of the examples described in the embodiments of the present application can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
Fig. 18 shows a schematic structural diagram of an electronic device provided by the present application. The dashed line in fig. 18 indicates that the unit or the module is optional; the electronic device 1100 may be used to implement the method of displaying thumbnail images described in the above-described method embodiments.
The electronic device 1000 includes one or more processors 1001, which one or more processors 1001 may support the electronic device 1000 to implement the method of displaying thumbnail images in a method embodiment. The processor 1001 may be a general purpose processor or a special purpose processor. For example, the processor 1001 may be a central processing unit (central processing unit, CPU), a digital signal processor (DIGITAL SIGNAL processor, DSP), an Application Specific Integrated Circuit (ASIC), a field programmable gate array (field programmable GATE ARRAY, FPGA), or other programmable logic device such as discrete gates, transistor logic, or discrete hardware components.
Alternatively, the processor 1001 may be configured to control the electronic device 1000, execute a software program, and process data of the software program. The electronic device 1000 may also include a communication unit 1005 to enable input (reception) and output (transmission) of signals.
For example, the electronic device 1000 may be a chip, the communication unit 1005 may be an input and/or output circuit of the chip, or the communication unit 1005 may be a communication interface of the chip, which may be an integral part of a terminal device or other electronic device.
For another example, the electronic device 1000 may be a terminal device, the communication unit 1005 may be a transceiver of the terminal device, or the communication unit 1005 may include one or more memories 1002 in the communication unit 1000, on which a program 1004 is stored, the program 1004 being executable by the processor 1001 to generate the instruction 1003, so that the processor 1001 performs the method of displaying a thumbnail image described in the above-described method embodiment according to the instruction 1003.
Optionally, the memory 1002 may also have data stored therein.
Alternatively, the processor 1001 may also read data stored in the memory 1002, which may be stored at the same memory address as the program 1004, or which may be stored at a different memory address than the program 1004.
Alternatively, the processor 1001 and the memory 1002 may be provided separately or may be integrated together, for example, on a System On Chip (SOC) of the terminal device.
Illustratively, the memory 1002 may be used to store a related program 1004 of a method of displaying thumbnail images provided in an embodiment of the present application, and the processor 1001 may be used to call the related program 1004 of the method of displaying thumbnail images stored in the memory 1002 when executing the method of displaying thumbnail images, to execute the method of displaying thumbnail images of an embodiment of the present application; for example, a first display interface is displayed at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at a first moment in real time; detecting a first operation of a first control, wherein the first operation is used for indicating to start shooting, and shooting can comprise shooting; in response to the first operation, saving the first thumbnail image in the album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing; detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting; in response to the second operation, the first thumbnail image, the second thumbnail image, and the third thumbnail image are sequentially displayed in the thumbnail display area, wherein the third thumbnail image has an image quality superior to that of the second thumbnail image.
Optionally, the present application also provides a computer program product which when executed by the processor 1001 implements the method of displaying thumbnail images in any of the method embodiments of the present application.
For example, the computer program product may be stored in the memory 1002, such as the program 1004, and the program 1004 is finally converted into an executable object file capable of being executed by the processor 1001 through preprocessing, compiling, assembling, and linking.
Alternatively, the present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a computer, implements the method of displaying thumbnail images of any of the method embodiments of the present application. The computer program may be a high-level language program or an executable object program.
For example, the computer-readable storage medium is, for example, the memory 1002. The memory 1002 may be volatile memory or nonvolatile memory, or the memory 1002 may include both volatile memory and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an erasable programmable ROM (erasable PROM), an electrically erasable programmable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM) which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (STATIC RAM, SRAM), dynamic random access memory (DYNAMIC RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (doubledata RATE SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCHLINK DRAM, SLDRAM), and direct memory bus random access memory (direct rambus RAM, DR RAM).
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the above-described embodiments of the electronic device are merely illustrative, e.g., the division of modules is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
It should be understood that, in various embodiments of the present application, the size of the sequence number of each process does not mean that the execution sequence of each process should be determined by its functions and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
In addition, the term "and/or" herein is merely an association relation describing an association object, and means that three kinds of relations may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely illustrative embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about variations or substitutions within the technical scope of the present application, and the application should be covered. Therefore, the protection scope of the present application should be defined by the claims, and the above description is only a preferred embodiment of the technical solution of the present application, and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (20)

1. A method of displaying thumbnail images, applied to an electronic device, comprising:
Displaying a first display interface at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image, the first control is a control for indicating shooting, the thumbnail display area is used for displaying the thumbnail image, the first preview image is an image generated by previewing a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time;
detecting a first operation of the first control, wherein the first operation is used for indicating to start shooting;
In response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing;
detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting;
And in response to the second operation, sequentially displaying the first thumbnail image, the second thumbnail image and a third thumbnail image in the thumbnail display area, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.
2. The method of claim 1, wherein the first image processing comprises a downsampling process; the second image processing has a higher algorithmic complexity than the first image processing.
3. The method as recited in claim 2, further comprising:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
4. The method of claim 3, wherein the electronic device includes a memory module therein, the memory module including the first memory area therein, further comprising:
Performing replacement processing on the first thumbnail image of the first storage area through the second thumbnail image when the second thumbnail image is generated by the electronic device and the first captured image is not generated;
and when the electronic equipment generates the first shooting image, replacing the second thumbnail image of the first storage area through the first shooting image.
5. The method of claim 3 or 4, further comprising:
Acquiring time information of detecting the first operation;
And selecting the first image from a zero second delay queue in the electronic equipment based on the time information.
6. The method of claim 5, wherein the second image processing includes a first algorithmic process and a second algorithmic process, the first algorithmic process being an algorithm of a first color space, the second algorithmic process being an algorithm that converts an image of the first color space to an image of a second color space, the generating a first captured image comprising:
performing first algorithm processing on the first image to obtain an image of the first color space;
fusing at least two frames of images in the first color space to obtain a fused image;
and carrying out second algorithm processing on the fusion image to generate the first shooting image.
7. The method of any one of claims 1 to 4, 6, wherein the first operation is an operation to click on the first control; the second operation is an operation of bouncing the first control.
8. The method of any one of claims 1 to 4, 6, wherein the image quality comprises image texture information or image brightness information.
9. A method of displaying thumbnail images, applied to an electronic device, comprising:
Displaying a first display interface at a first moment, wherein the first display interface comprises a first control, a thumbnail display area and a first preview image; the first control is a control for indicating shooting; the thumbnail display area is used for displaying thumbnail images; the first preview image is an image generated by preview processing of a first image acquired by the electronic equipment, and the first image is an image acquired by the electronic equipment at the first moment in real time;
detecting a first operation of the first control, wherein the first operation is used for indicating to start shooting;
In response to the first operation, saving a first thumbnail image in an album application and generating a second thumbnail image; the first thumbnail image is generated by the first image through first image processing; the second thumbnail image is generated by the first image through second image processing, and the first image processing is different from the second image processing;
detecting a second operation of the first control, wherein the second operation is used for indicating ending shooting;
Sequentially displaying the first thumbnail image and the second thumbnail image in the thumbnail display area in response to the second operation; and, generating a third thumbnail image having an image quality superior to the second thumbnail image;
Detecting a third operation on the first control before generating the third thumbnail image, the third operation being for instructing the start of shooting;
In response to the third operation, saving a fourth thumbnail image in the album application and generating a fifth thumbnail image; the fourth thumbnail image is generated by the second image through the first image processing; the fifth thumbnail image is generated by the second image through second image processing; the second image is an image acquired by the electronic equipment in real time at a second moment, and the second moment is later than the first moment;
Detecting a fourth operation of the first control, wherein the fourth operation is used for indicating the shooting ending;
and in response to the fourth operation, sequentially displaying the fourth thumbnail image, the fifth thumbnail image and a sixth thumbnail image in the thumbnail display area, wherein the image quality of the sixth thumbnail image is better than that of the fifth thumbnail image.
10. The method of claim 9, wherein the first image processing comprises a downsampling process; the second image processing has a higher algorithmic complexity than the first image processing.
11. The method of claim 10, wherein the generating a third thumbnail image comprises:
generating a first photographed image in response to the second operation;
and scaling the first shooting image based on the size of the thumbnail display area to generate the third thumbnail image.
12. The method as recited in claim 11, further comprising:
Generating a second captured image in response to the fourth operation;
And scaling the second shooting image based on the size of the thumbnail display area to generate the sixth thumbnail image.
13. The method of claim 12, wherein the electronic device includes a storage module, the storage module including a first storage area and a second storage area, the first storage area being configured to store the first thumbnail image, the second thumbnail image, or the first captured image; the second storage area is used for storing the fourth thumbnail image, the fifth thumbnail image or the second shooting image; the first storage area and the second storage area are different storage areas in the storage module.
14. The method as recited in claim 13, further comprising:
performing replacement processing on the first thumbnail image of the first storage area by the second thumbnail image in a case where the second thumbnail image is generated and the first captured image is not generated;
In the case of generating the first captured image, the second thumbnail image of the first storage area is subjected to replacement processing by the first captured image.
15. The method of claim 13 or 14, further comprising:
performing replacement processing on the fourth thumbnail image of the second storage area by the fifth thumbnail image in a case where the fifth thumbnail image is generated and the second captured image is not generated;
in the case of generating the second captured image, the fifth thumbnail image of the second storage area is subjected to replacement processing by the second captured image.
16. The method of any one of claims 9 to 14, wherein the first operation and the third operation are operations of clicking on the first control; the second operation and the fourth operation are operations of bouncing up the first control.
17. The method of any of claims 9 to 14, wherein the image quality comprises image texture information or image brightness information.
18. An electronic device, comprising:
One or more processors and memory;
the memory is coupled to the one or more processors, the memory for storing computer program code comprising computer instructions that the one or more processors invoke to cause the electronic device to perform the method of any of claims 1-8, or 9-17.
19. A chip system for application to an electronic device, the chip system comprising one or more processors for invoking computer instructions to cause the electronic device to perform the method of any of claims 1 to 8, or 9 to 17.
20. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program, which when executed by a processor causes the processor to perform the method of any one of claims 1 to 8, or 9 to 17.
CN202211467867.9A 2022-11-22 2022-11-22 Method for displaying thumbnail images and electronic device Active CN116668837B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202211467867.9A CN116668837B (en) 2022-11-22 2022-11-22 Method for displaying thumbnail images and electronic device
PCT/CN2023/114173 WO2024109207A1 (en) 2022-11-22 2023-08-22 Method for displaying thumbnail, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211467867.9A CN116668837B (en) 2022-11-22 2022-11-22 Method for displaying thumbnail images and electronic device

Publications (2)

Publication Number Publication Date
CN116668837A CN116668837A (en) 2023-08-29
CN116668837B true CN116668837B (en) 2024-04-19

Family

ID=87714154

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211467867.9A Active CN116668837B (en) 2022-11-22 2022-11-22 Method for displaying thumbnail images and electronic device

Country Status (2)

Country Link
CN (1) CN116668837B (en)
WO (1) WO2024109207A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117499777A (en) * 2023-09-15 2024-02-02 荣耀终端有限公司 Image display method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104754223A (en) * 2015-03-12 2015-07-01 广东欧珀移动通信有限公司 Method for generating thumbnail and shooting terminal
CN107509038A (en) * 2017-10-16 2017-12-22 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN112449099A (en) * 2019-08-30 2021-03-05 华为技术有限公司 Image processing method, electronic equipment and cloud server
CN113497888A (en) * 2020-04-07 2021-10-12 华为技术有限公司 Photo preview method, electronic device and storage medium
CN114500821A (en) * 2020-10-26 2022-05-13 北京小米移动软件有限公司 Photographing method and device, terminal and storage medium
CN114679538A (en) * 2019-05-22 2022-06-28 华为技术有限公司 Shooting method and terminal

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140321770A1 (en) * 2013-04-24 2014-10-30 Nvidia Corporation System, method, and computer program product for generating an image thumbnail
US9749649B2 (en) * 2014-08-27 2017-08-29 Fingram Co., Ltd. Method and system for generating and displaying thumbnail images from original images
CN108124099B (en) * 2017-12-14 2021-01-08 Tcl移动通信科技(宁波)有限公司 Method for generating camera thumbnail, mobile terminal and storage medium
CN110166708B (en) * 2019-06-13 2021-06-11 Oppo广东移动通信有限公司 Night scene image processing method and device, electronic equipment and storage medium
CN112672035B (en) * 2019-10-16 2022-02-22 青岛海信移动通信技术股份有限公司 Thumbnail generation method and terminal
CN111432121A (en) * 2020-03-30 2020-07-17 Oppo广东移动通信有限公司 Generation method, electronic device, and storage medium
CN117915194A (en) * 2022-07-05 2024-04-19 荣耀终端有限公司 Method for displaying thumbnail during photographing and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104754223A (en) * 2015-03-12 2015-07-01 广东欧珀移动通信有限公司 Method for generating thumbnail and shooting terminal
CN107509038A (en) * 2017-10-16 2017-12-22 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN114679538A (en) * 2019-05-22 2022-06-28 华为技术有限公司 Shooting method and terminal
CN112449099A (en) * 2019-08-30 2021-03-05 华为技术有限公司 Image processing method, electronic equipment and cloud server
CN113497888A (en) * 2020-04-07 2021-10-12 华为技术有限公司 Photo preview method, electronic device and storage medium
CN114500821A (en) * 2020-10-26 2022-05-13 北京小米移动软件有限公司 Photographing method and device, terminal and storage medium

Also Published As

Publication number Publication date
WO2024109207A1 (en) 2024-05-30
CN116668837A (en) 2023-08-29

Similar Documents

Publication Publication Date Title
CN111212235B (en) Long-focus shooting method and electronic equipment
CN114092364B (en) Image processing method and related device
CN115526787B (en) Video processing method and device
CN115633262B (en) Image processing method and electronic device
WO2024045670A1 (en) Method for generating high-dynamic-range video, and electronic device
CN110198418A (en) Image processing method, device, storage medium and electronic equipment
WO2023142830A1 (en) Camera switching method, and electronic device
WO2024109207A1 (en) Method for displaying thumbnail, and electronic device
CN115767290B (en) Image processing method and electronic device
CN113744139A (en) Image processing method, image processing device, electronic equipment and storage medium
WO2023124202A1 (en) Image processing method and electronic device
CN116437198B (en) Image processing method and electronic equipment
CN116709042B (en) Image processing method and electronic equipment
WO2023060921A1 (en) Image processing method and electronic device
CN110266967A (en) Image processing method, device, storage medium and electronic equipment
CN116258633A (en) Image antireflection method, training method and training device for image antireflection model
CN116128739A (en) Training method of downsampling model, image processing method and device
CN116668836B (en) Photographing processing method and electronic equipment
CN115767287B (en) Image processing method and electronic equipment
CN116723417B (en) Image processing method and electronic equipment
CN116723264B (en) Method, apparatus and storage medium for determining target location information
CN117692763A (en) Photographing method, electronic device, storage medium and program product
CN117082339A (en) Shooting mode switching method and device, electronic equipment and readable storage medium
CN116664701A (en) Illumination estimation method and related equipment thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant