CN113852756A

CN113852756A - Image acquisition method, device, equipment and storage medium

Info

Publication number: CN113852756A
Application number: CN202111032055.7A
Authority: CN
Inventors: 李海波; 李涛
Original assignee: Vivo Mobile Communication Hangzhou Co Ltd
Current assignee: Vivo Mobile Communication Hangzhou Co Ltd
Priority date: 2021-09-03
Filing date: 2021-09-03
Publication date: 2021-12-28
Anticipated expiration: 2041-09-03
Also published as: CN113852756B

Abstract

The application discloses an image acquisition method, an image acquisition device, image acquisition equipment and a storage medium, and belongs to the technical field of image processing. The image acquisition method comprises the following steps: receiving a first input of a user to a video playing interface; in response to the first input, obtaining a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined in accordance with the first input; and obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first region in the target image is greater than that of an image of a second region in the first preview video image, and the second region is an image region at a position corresponding to the first region.

Description

Image acquisition method, device, equipment and storage medium

Technical Field

The present application belongs to the field of image processing technologies, and in particular, to an image acquisition method, apparatus, device, and storage medium.

Background

With the rapid development of electronic technology and information technology, more and more electronic devices are capable of recording and playing videos. In the process of recording a video, the quality of the recorded video is poor due to factors such as environment or manual operation (for example, equipment jitter), and in the process of playing the video, if a user intercepts a video frame, the quality of the obtained image is also poor, so that the requirements of the user cannot be met.

Disclosure of Invention

The embodiment of the application aims to provide an image acquisition method, an image acquisition device, image acquisition equipment and a storage medium, which can solve the problem that the image quality of an image captured by a user in the video playing process is poor.

In a first aspect, an embodiment of the present application provides an image acquisition method, including:

receiving a first input of a user to a video playing interface;

in response to the first input, obtaining a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined in accordance with the first input;

and obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first region in the target image is greater than that of an image of a second region in the first preview video image, and the second region is an image region at a position corresponding to the first region.

In a second aspect, an embodiment of the present application provides an image capturing apparatus, including:

the receiving module is used for receiving a first input of a user to the video playing interface;

an obtaining module, configured to obtain, in response to the first input, a sequence of video frames including a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined according to the first input;

and the processing module is used for obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first area in the target image is greater than that of an image of a second area in the first preview video image, and the second area is an image area at a position corresponding to the first area.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In a sixth aspect, the present application provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the image acquisition method according to the first aspect are implemented.

In the embodiment of the application, in response to a first input of a user to a video playing interface, a video frame sequence including a first original video image is obtained, where the first original video image is an original image associated with a first preview video image, the first preview video image is an image determined according to the first input from a video of the video playing interface, and a target image is obtained according to the video frame sequence. Because the image of the user interested region (second region) is optimized through the original video image, the resolution of the image of the first region in the target image is larger than that of the image of the second region in the first preview video image, and therefore the image quality of the user interested region in the obtained target image is better.

Drawings

Fig. 1 is a schematic flowchart of an image acquisition method provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of a first preview video image provided by an embodiment of the present application;

FIG. 3 is one of the schematic diagrams of a target image provided by the embodiments of the present application;

FIG. 4a is a schematic view of a video playing interface provided in an embodiment of the present application;

FIG. 4b is a schematic interface diagram of the video playing interface shown in FIG. 4a after being operated by a user;

fig. 5a is a second schematic view of a video playing interface provided in the embodiment of the present application;

FIG. 5b is a schematic diagram of the video playback interface shown in FIG. 5a after being operated by a user;

FIG. 5c is a schematic view of the video playback interface shown in FIG. 5b after being operated by a user;

FIG. 6 is a second schematic diagram of a target image provided by the present application;

FIG. 7 is a third schematic diagram of a target image provided by an embodiment of the present application;

fig. 8 is a schematic view of a video recording interface provided in an embodiment of the present application;

fig. 9 is a second schematic view of a video recording interface provided in the embodiment of the present application;

fig. 10a is a third schematic view of a video playing interface provided in the embodiment of the present application;

FIG. 10b is a fourth schematic view of a video playing interface provided in the embodiment of the present application;

FIG. 11 is a schematic structural diagram of an image capturing apparatus according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 13 is a schematic diagram of a hardware structure of an electronic device implementing the embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The image acquisition method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

First, an application scenario related to the embodiment of the present application is described.

The method of the embodiment of the present application may be applied to an electronic device, and in an embodiment, the electronic device includes: mobile phones, tablet computers, smart watches, cameras, and the like. Optionally, the electronic device has a display screen.

According to the image acquisition method, under the condition that a video is played, a user wants to intercept an image in the played video, and in order to obtain an image with better image quality, a target image wanted by the user is obtained based on an original image which is associated with the image to be intercepted in recorded original video data.

Fig. 1 is a schematic flowchart of an image acquisition method according to an embodiment of the present application. As shown in fig. 1, the image acquiring method provided by this embodiment includes:

step 101, receiving a first input of a user to a video playing interface.

Specifically, a video playing interface plays a pre-recorded video. Optionally, recording is performed according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data and the video playing data are in one-to-one correspondence according to the time stamps and are stored in an associated manner. And the video played in the video playing interface is obtained based on the video playing data. The original frame rates of the obtained original video data and the video playing data are both the preset frame rates, the resolution of the video playing data is the preset resolution, the resolution of the original video data is determined by hardware of the recording device, and the resolution of an original image in the original video data is generally greater than the resolution of an image in the video playing data.

Optionally, the video playing data is obtained by performing format conversion on the basis of original video data, and some image information may be lost in the process of obtaining the video playing data by performing format conversion on the original video data, so that an original image in the original video data has more image information than an image in a playing video, for example, a resolution of the original image in the original video data is generally greater than a resolution of an image in the video playing data.

The preset frame rate and the preset resolution may be set by a user or by default.

The first input may be implemented by an input device (e.g., a mouse, a keyboard, a microphone, etc.) connected to the apparatus, or implemented by a user operating a display screen of the electronic apparatus, and the like, which is not limited in this embodiment of the application.

In one embodiment, the first input may be: the click input of the user to the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

The specific gesture in the embodiment of the application can be any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure identification gesture, a long-press gesture, an area change gesture, a double-press gesture and a double-click gesture; the click input in the embodiment of the application can be click input, double-click input, click input of any number of times and the like, and can also be long-time press input or short-time press input.

For example, the user double clicks on the video image frame being played in the video playing interface, which indicates that the user needs to intercept the video image frame.

Step 102, in response to a first input, obtaining a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined in accordance with the first input.

Specifically, the first preview video image is an image determined based on a first input of a user in a video played in the video playing interface, for example, the first preview video image is an image being played at a time when the first input is received. The first original video image associated with the first preview video image is an original image in the original video data corresponding to the time stamp of the first preview video image, and the sequence of video frames for example comprises only the first original video image, or a plurality of original images derived from the original video data comprising the first original video image. For example, a frame of original image corresponding to the timestamp is obtained from the original video data, or multiple frames of original images are obtained from the frame of original image as a start. For example, if the timestamp of the current first preview video image is 10 seconds, the original image of 10 seconds is searched in the original video data, and the first original video image is obtained. For example, the resolution of the first original video image is 4608 × 3456, and the resolution of the first preview video image is 1440 × 1080.

Step 103, obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first region in the target image is greater than the resolution of an image of a second region in the first preview video image, and the second region is an image region at a position corresponding to the first region.

Specifically, the target image is acquired based on the video frame sequence, for example, the target image is obtained by image-synthesizing the original video images in the video frame sequence, and the resolution of the image in the first region in the target image is greater than the resolution of the image in the second region in the first preview video image, so that the image quality of the acquired target image is better.

The first region may be a whole region in the image or a partial region in the image, which is not limited in this embodiment of the application.

As shown in fig. 2, the user double-clicks the video playing interface, selects a first preview video image currently being played, for example, a 6 th second image in the video currently being played, and the electronic device obtains one or more frames of original images in the original video data based on the time to obtain a video frame sequence, where the video frame sequence includes the first original video image, for example, obtains a frame of first original video image corresponding to the time, obtains at least one frame of original image based on the first original video image to obtain a video frame sequence, and obtains a target image based on the video frame sequence, where the target image is, for example, an image shown in fig. 3. It is obvious from fig. 2 and fig. 3 that the image quality is improved, and the person and the butterfly in fig. 3 have clearer outlines compared with those in fig. 2, so that the display effect of capturing the image from the video to obtain the target image is enhanced.

In the method of this embodiment, in response to a first input of a user to a video playing interface, a video frame sequence including a first original video image is acquired, where the first original video image is an original image associated with a first preview video image, the first preview video image is an image determined according to the first input from a video of the video playing interface, and a target image is obtained according to the video frame sequence.

In one embodiment, step 102 can be implemented by:

one implementation is as follows:

displaying at least one video frame acquisition option;

receiving a second input of a first video frame acquisition option in the at least one video frame acquisition option from the user, wherein the first video frame acquisition option indicates a first video frame acquisition mode;

in response to a second input, a sequence of video frames including a first original video image is acquired in accordance with a first video frame acquisition mode.

Specifically, as shown in fig. 4a and 4b, after receiving a first input to the video playing interface from the user, at least one video frame acquisition option is displayed, and as shown in fig. 4b, the video frame acquisition option includes: an automatic option, a manual option, where the user selects one of the video frame acquisition options, for example, the automatic option is selected, the device receives a second input from the user for the one of the video frame acquisition options, and acquires a sequence of video frames comprising the first original video image for a first video frame acquisition mode indicated by the second input.

The second input may be input through an input device (e.g., a mouse, a keyboard, or a microphone) connected to the device, or the second input is an operation of a touch display screen of the electronic device by a user, which is not limited in this embodiment of the application.

In one embodiment, the second input may be: the click input of the user to the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

For example, the user clicks on a setting window on the video playing interface, or the user outputs a voice prompt of "set to automatic option".

The first video frame obtaining manner is, for example, obtaining a plurality of original video images including the first original video image according to a default manner of the device, where the default manner may be a preset manner, for example, setting a frame number of the video frame sequence, a selection manner (for example, continuous selection or interval selection) of each frame in the video frame sequence, and the like.

In the above embodiment, the input of the user is received through the displayed video frame acquisition option, and then the video frame sequence is acquired based on the input of the user, and the user can flexibly select the video frame to improve the image quality of the region of interest.

Alternatively, the step of acquiring a sequence of video frames comprising the first original video image according to the first video frame acquisition mode may be implemented by:

acquiring N frames of original video images including a first original video image;

acquiring X frame target original video images from N frame original video images according to preset image parameters to obtain a video frame sequence, wherein the X frame target original video images comprise first original video images;

obtaining a target image according to the video frame sequence, comprising:

carrying out image synthesis on the X frame target original video image to obtain a target image;

wherein N and X are both positive integers, and X is less than or equal to N.

Optionally, the manner of acquiring the N frames of original video images may be implemented by at least one of the following manners:

acquiring a first original video image of a frame corresponding to a time stamp of the first preview video image and an original video image of a target frame number before the time stamp in the original video data, wherein the target frame number is greater than or equal to 1.

And acquiring a first original video image of one frame corresponding to the time stamp of the first preview video image and an original video image of a target frame number after the time stamp in the original video data, wherein the target frame number is more than or equal to 1.

Specifically, N frames may be taken forward, or N frames may be taken backward, or several frames may be taken forward, and several frames may be taken backward to obtain N frames, for example, multiple frames may be successively obtained in sequence according to the time stamp order, or obtained at intervals, which is not limited in this embodiment of the application.

The preset image parameter refers to a parameter value of an image parameter that meets a preset condition, where the preset condition is, for example, a maximum weighted average of the parameter values, and the like, and this is not limited in the embodiment of the present application; or, the preset image parameter refers to a preset value of an image parameter. The preset image parameters may be device default or user preset.

Wherein the image parameters comprise, for example, at least one of: an Automatic Exposure (AE) value, an Automatic White Balance (AWB) value, an Automatic Focus (AF) value, a beauty parameter, and the like, and further, an X frame target original video image with a better image parameter value is selected from the N frame original video images to obtain a video frame sequence, wherein the X frame target original video image comprises the first original video image. For example, the first X frame original images with the largest weighted average of the parameter values of the image parameters are selected from the N frame original video images, and then the X frame original images are subjected to image synthesis. For example, X frames of original images having parameter values greater than a preset value may be selected from N frames.

As shown in fig. 4a, a user double-clicks to select a frame of a first preview video image (corresponding to a first input of the user), at this time, the playing is suspended, a dialog box of a video frame acquisition option (such as the dialog box displayed in fig. 4 b) is displayed on a video playing interface, and then a second input that the user selects the first video frame acquisition option (such as an automatic option) is received, when the user selects the automatic option, N frames of original video images corresponding to a timestamp of the first preview video image are acquired, based on a parameter value corresponding to an image parameter of the N frames of original video images, X frames of original video images are extracted from the N frames of original video images, and in case that the user focuses on the whole image, the X frames of original video images are directly subjected to image synthesis.

In the above embodiment, the X-frame original video images are image-synthesized to obtain the target image, and the first preview video image is processed based on the original video data, so that some image information is lost, and the target image obtained based on the X-frame original video images of the video frame sequence in the original video data has a first region with a higher resolution than a second region corresponding to the first region in the first preview video image, so that the image quality of the target image is better, and the image quality of the image region concerned by the user is improved.

The other realization mode is as follows:

displaying at least one video frame acquisition option;

receiving a third input of a user to a second video frame acquisition option of the at least one video frame acquisition option;

displaying at least one video frame acquisition sub-option in response to the third input;

receiving a fourth input of the user for the at least one video frame acquisition sub-option;

in response to the fourth input, a sequence of video frames including the first original video image is acquired in accordance with a second video frame acquisition mode determined in accordance with the fourth input.

Specifically, as shown in fig. 5a to 5c, after receiving a first input of the video playing interface from the user, at least one video frame capturing option is displayed, as shown in fig. 5b, the video frame capturing option includes, for example: an automatic option, a manual option, where the user selects one of the video frame acquisition options, for example, selects the manual option, the device receives a third input from the user for one of the video frame acquisition options, in response to the third input, as shown in fig. 5c, at least one video frame acquisition sub-option (frame forward or frame backward) may be displayed, receives a fourth input from the user for the at least one video frame acquisition sub-option, and acquires a sequence of video frames comprising the first original video image for a second video frame acquisition mode indicated by the fourth input.

The third input may be implemented by an input device (e.g., a mouse, a keyboard, or a microphone) connected to the apparatus, or implemented by a user operating a touch display screen of the electronic apparatus, which is not limited in this embodiment of the application.

In one embodiment, the third input may be: the click input of the user to the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

The implementation of the fourth input is similar to that of the third input, and is not described herein again.

The second video frame obtaining mode may be a mode that obtains the video frame sequence through user setting, for example, the user sets a frame number, a frame obtaining mode, and the like of the video frame sequence.

As shown in fig. 5b and 5c, in the case that the user selects the manual option, at least one video frame acquisition sub-option is displayed, parameters set by the user, such as frame forward or frame backward, are acquired, and a video frame sequence is acquired based on the user settings.

In an embodiment, the number of frames to be taken may be preset, or a default value may be adopted, or may be set by a user, for example, the number of frames to be taken in fig. 5c may also be displayed in the video frame acquisition sub-option, which is not limited in this embodiment of the application.

Optionally, the second video frame acquisition mode may be implemented by at least one of the following modes:

forward frame fetching mode: acquiring a frame of first original video image corresponding to a time stamp of a first preview video image and an original video image of a target frame number before the time stamp from original video data, wherein the target frame number is more than or equal to 1;

backward frame taking mode: and acquiring a first original video image of one frame corresponding to the time stamp of the first preview video image and an original video image of a target frame number after the time stamp in the original video data, wherein the target frame number is more than or equal to 1.

Assuming that the number of the second video frames is m, m frames may be taken forward, m frames may be taken backward, or several frames are taken forward, and several frames are taken backward to obtain m frames, for example, multiple frames may be taken sequentially in time stamp order, or at intervals, which is not limited in this embodiment of the application.

Optionally, the image acquiring method further includes:

displaying at least one image parameter adjustment control in response to a third input;

receiving a fifth input of the user to the at least one image parameter adjustment control;

step 103 may be specifically implemented as follows:

responding to a fifth input, and carrying out image synthesis on an original video image in the video frame sequence according to the first image parameter to obtain a target image; the first image parameters are determined from a fifth input.

The fifth input is similar to the fourth input in implementation manner, and is not described again here.

Specifically, after receiving the third input, at least one image parameter adjustment control is displayed, as shown in fig. 5c, the image parameter adjustment control includes: and adjusting controls of parameters such as an AE value, an AWB value or an AF value, adjusting the parameter values of the parameters by a user, and synthesizing the original video images in the video frame sequence according to the parameter values set by the user to obtain the target image.

Exemplarily, as shown in fig. 4a, a user double-clicks to select a frame of a first preview video image (corresponding to a first input of the user), at this time, the playing is suspended, and a dialog box (the dialog box shown in fig. 4 b) for selecting a video frame acquisition option is displayed on a video playing interface, when the user selects an automatic option, the electronic device will select N original images (for example, N is 10) closest to this time, calculate an image parameter value of each original image, including an AE value, an AWB value, an AF value, and the like, and finally select X original images (for example, 6) with optimal AE values, AWB values, and AF values from the N original images for image synthesis, so as to generate a target image with higher quality corresponding to the first preview video image at this time; when selecting the manual option, the user needs to select to take frames forward or backward, for example, take 6 frames of original video images including the first original video image to perform image synthesis, manually set parameter values corresponding to image parameters, including AE values, AWB values, or AF values, and perform image synthesis on 6 original video images based on the set parameter values corresponding to the image parameters, so as to obtain a target image, which is shown in fig. 3.

In the above embodiment, the original video images in the sequence of video frames are image-synthesized according to the first image parameter to obtain the target image, and since the first preview video image is processed based on the original video data, some image information is lost, and the target image obtained based on the original video images in the sequence of video frames in the original video data has a higher resolution in the first region than in the second region corresponding to the first region in the first preview video image, the image quality of the target image is better, and the image quality of the image region concerned by the user is improved.

In one embodiment, the user may only be interested in certain objects in the image, so step 101 may be implemented as follows:

receiving a first input of a user to a target object in a video playing interface;

obtaining a sequence of video frames comprising a first original video image, comprising:

acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where a target object in the first original video image is located;

obtaining a target image according to the video frame sequence, comprising:

obtaining a target object intermediate image according to the target video frame sequence;

carrying out image synthesis on the target object intermediate image and the first preview video image to obtain a target image;

and the resolution of the image of the area where the target object is located in the target image is greater than the resolution of the image of the area where the target object is located in the first preview video image.

Alternatively, the user may focus on the entire image, for example, the user clicks a blank area of the image in the playing video interface shown in fig. 2, which indicates that the user focuses on the entire image and needs to improve the image quality of the entire first preview video image.

Optionally, when the user clicks the video playing interface, a selection dialog box may be displayed on the video playing interface, for example, an image of the whole image or a partial region is selected.

Alternatively, the user may only focus on certain target objects in the first preview video image, e.g. the user double-clicks on a target object in the first preview video image, such as the avatar of the person in fig. 4 a. I.e. by an indication of the first input, a target object of interest to the user in the first preview video image may be determined. Optionally, the first input is used to indicate position information input by the user, and the corresponding target object is found through the position information, that is, the target object corresponding to the image area to which the position information belongs is determined, for example, the user double-clicks a certain position of the image area where the target object is located, for example, double-clicks an avatar of the person area by the user in fig. 4 a. Alternatively, the first input may be used to input identification information of the target object, and the identification information may be a name, for example, a "name of the target object" is input by a user through voice to indicate that the image quality of the person in fig. 4a is improved to acquire the target image.

Responding to a first input of a user for a target object, acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where the target object in the first original video image is located; the target video frame sequence is obtained in a similar manner as the video frame sequence in the previous embodiment, and optionally, the target video frame sequence is the same as the video frame sequence in the previous embodiment.

Further, obtaining a target object intermediate image according to the target video frame sequence; for example, image synthesis is performed on each original video image in the target video frame sequence, an image of a region where the target object is located is captured from the synthesized image, and a target object intermediate image is obtained, or image synthesis is performed on an image of a third region where the target object is located in each original video image in the target video frame sequence, and a target object intermediate image is obtained. And carrying out image synthesis on the target object intermediate image and the first preview video image to obtain a target image.

In other embodiments, the target video frame sequence may also be formed by using the image of the third region where the target object is located in each original video image in the video frame sequence acquired in the foregoing embodiments. At this time, all images in the target video frame sequence are directly subjected to image synthesis with the first preview video image without obtaining an intermediate image of the target object, so as to obtain the target image.

For example, in fig. 4a, an image of a third region where a person is located is acquired from an original video image, and the image of the third region where the person is located is image-synthesized with the first preview video image to acquire a target image, as shown in fig. 6.

In one embodiment, an intermediate image of the target object, such as an image of the region where the person is located, may also be saved.

As shown in fig. 6, the user can view the acquired target image, and fig. 6 is the target image obtained in the 10 th second of video playing, the image quality of the person region concerned by the user in fig. 6 is improved, and the display effect of the target image obtained by capturing a picture from the video is enhanced.

The effect of the butterfly focused by the user in fig. 7 is improved, and the display effect of the image area focused by the user is optimized.

Exemplarily, as shown in fig. 4a and 4b, at 10 seconds of video playing, double-clicking an object a (character) in a video playing interface, pausing the video playing and displaying a video frame acquisition option selection dialog box in the video playing interface, selecting an automatic option by a user, taking a first preview video image of the frame selected by the user as a reference frame, taking the object a selected by the user as a target object, respectively calculating image parameter values including AE values, AWB values, AF values and the like of an image of an area where the object a is located in 10 original video images closest to the reference frame time, finally selecting 6 original video images with optimal weighted average values of AE values, AWB values and AF values from the 10 original video images for image synthesis to obtain a target image with better user focus point picture quality, storing the target image in an album, and after the user selects the automatic option, the video automatically continues to play.

Exemplarily, as shown in fig. 5a, when the video is played for 16 seconds, the playing frame rate of the video is adjusted to 1 frame/second, an object B (butterfly) in the video playing interface is double-clicked, the video is paused and displayed, a video frame acquisition option selection dialog box is displayed, a user selects a manual option, and in the manual option setting dialog box, a frame fetching mode, an image parameter value, and the like are respectively set, after the completion, a confirmation key is clicked, and the video is automatically continuously played after the confirmation key is clicked. As shown in fig. 5B and 5c, the user selects the manual option, selects the backward frame taking and sets the AE value, the AWB value, and the like, the electronic device selects the 6 frames of original video images closest to the current time backward, and performs image synthesis on the image of the area where the object B concerned by the user is located according to the image parameter value set by the user, and then obtains the target image based on the synthesized image and the first preview video image, and the target image is automatically saved in the album after being generated. Target image as shown in fig. 7, the resolution of the image of the region where the target object is located in the target image is greater than the resolution of the image of the region where the target object is located in the first preview video image shown in fig. 2.

In the above embodiment, since the first preview video image is obtained by processing the original video image in the original video data, some image information is lost, and the image quality of the target object intermediate image obtained through the target video frame sequence is better than that of the image of the region where the target object is located in the first preview video image, so that the image composition is performed based on the target object intermediate image and the first preview video image, the image quality of the obtained target image is better, and the image quality of the image region of the target object concerned by the user is improved.

In one embodiment, the image acquisition method further comprises:

receiving a fifth input of the user to the video recording interface;

responding to a fifth input, and recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises a video frame sequence, and the video playing data comprises a first preview video image;

and storing the original video data and the video playing data in an associated manner.

The fifth input may be implemented by an input device (e.g., a mouse, a keyboard, or a microphone) connected to the apparatus, or implemented by a user operating a display screen of the electronic apparatus, which is not limited in this embodiment of the application.

In one embodiment, the fifth input may be: the click input of the user to the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

For example, an image acquisition component (e.g., an image sensor) acquires original video data, and performs image processing such as format conversion on the original video data to acquire video playing data; and the time stamps of all the original video images in the original video data correspond to the time stamps of all the video images in the video playing data one by one, and are stored in an associated manner.

In an embodiment, in the case of a video recording interface of an electronic device, for example, by clicking a video recording control on a preview interface of a camera APP, entering the video recording interface, clicking a video recording control on the video recording interface, and starting video recording, optionally, as shown in fig. 8, a setting control (an icon displayed in the upper right corner in fig. 8) may be displayed on the video recording interface, and after clicking the setting control, a video recording mode selection dialog box is displayed, assuming that a user selects a high definition video recording mode, and selects a frame rate of 60 frames/second and a resolution of 1080P, that is, a preset frame rate and a preset resolution are set.

Alternatively, in the case of video recording in the high-definition video recording mode, a high-definition mark may be displayed on the display screen, for example, in fig. 9, the word "H" is displayed in the upper left corner of the display screen.

In the case of video recording, the original video data output by the image sensor, for example, video playing data in RAW format and YUV format, are respectively generated into video files, and the time stamps of each original video image in the original video data and each video image in the video playing data are in one-to-one correspondence, so that the video files of the original video data and the video files of the video playing data can be stored, for example, uploaded to an album database for storage.

In the above embodiment, the original video data and the video playing data are obtained by video recording, and the original video data and the video playing data are stored in association, when the video is played, a certain frame of image displayed in the played video can be selected as a reference, the corresponding original video image and the video frame sequence including the original video image are selected, and the video frame sequence is processed to obtain the target image, so that the purpose of converting the image at a certain moment in the video into the high-quality target image is achieved.

In an embodiment, before the receiving the first input to the video playing interface user, the method further includes:

receiving a sixth input of the user to the video playing interface;

and in response to a sixth input, reducing the playing frame rate of the video in the video playing interface.

The sixth input may be implemented by an input device (e.g., a mouse, a keyboard, or a microphone) connected to the apparatus, or implemented by a user operating a display screen of the electronic apparatus, which is not limited in this embodiment of the application.

In one embodiment, the sixth input may be: the click input of the user to the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

For example, as shown in fig. 10a and 10b, sliding up and down on the video playing interface of the display screen to adjust the playing frame rate of the video in the video playing interface, for example, sliding up in fig. 10a increases the playing frame rate, and sliding down in fig. 10b decreases the playing frame rate.

In order to more accurately capture a target image focused by a user, that is, to more accurately obtain the first preview video image, the play frame rate may be reduced, for example, the play frame rate may be directly reduced, or may be increased first and then reduced, which is not limited in this embodiment of the application.

As shown in fig. 10a, when the video is played for the 6 th second, the user's finger slides upwards on the video playing interface, so that the video playing frame rate can be increased, and the purpose of fast playing the video is achieved. During video playing, the display screen may display the current video playing frame rate in real time, for example, in the upper right corner of the screen in fig. 10 a. As shown in fig. 10b, at the 8 th second of video playing, the finger slides downward on the video playing interface, so that the video playing frame rate can be reduced, and optionally, the video playing frame rate can be reduced to 1 at the minimum, thereby achieving the purpose of slow video playing, accurately determining the timestamp of the first preview video image, and further accurately obtaining the target image focused by the user.

In the above embodiment, by adjusting the video playing frame rate in the video playing interface, the playing process of the video in the video playing interface can be controlled, and particularly the playing time is controlled, for example, the playing frame rate can be reduced for a video part concerned by a user, and the playing frame rate can be increased for a video part not concerned by the user, so that the flexibility is higher, and particularly, the playing frame rate of the video in the video playing interface is reduced, so that a target image concerned by the user can be more accurately captured.

In an embodiment, after receiving a first input of the video playing interface from the user, the image acquisition method further includes:

pausing the playing of the video in the video playing interface;

after obtaining the target image, the image obtaining method further comprises:

and continuing to play the video in the video playing interface.

Specifically, after receiving a first input of a user to the video recording interface, the playing of the video may be suspended, so that the electronic device may more accurately determine a timestamp of a current first preview video image, and further acquire a first original video image, acquire a sequence of video frames based on the first original video image, and further acquire a target image, and after the target image is acquired, the target video may continue to be played.

It should be noted that, in the image acquisition method provided in the embodiment of the present application, the execution subject may be an image acquisition apparatus, or a processing module in the image acquisition apparatus for executing the image acquisition method. In the embodiment of the present application, an image acquisition apparatus executing an image acquisition method is taken as an example, and the image acquisition apparatus provided in the embodiment of the present application is described.

Fig. 11 is a schematic structural diagram of an image acquisition apparatus provided in the present application. The image acquisition apparatus provided by the embodiment includes:

the receiving module 210 is configured to receive a first input of a user to the video playing interface;

an obtaining module 220, configured to, in response to the first input, obtain a sequence of video frames including a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined according to the first input;

a processing module 230, configured to obtain a target image according to the sequence of video frames, where a resolution of an image in a first region in the target image is greater than a resolution of an image in a second region in the first preview video image, where the second region is an image region in a position corresponding to the first region.

The apparatus of this embodiment, in response to a first input to the video playing interface by a user, acquires a video frame sequence including a first original video image, where the first original video image is an original image associated with a first preview video image, the first preview video image is an image determined according to the first input from a video of the video playing interface, and obtains a target image according to the video frame sequence, and since a resolution of an image of a first region in the target image is greater than a resolution of an image of a second region in the first preview video image, an image quality of the first region in the obtained target image that is focused by the user is better.

Optionally, the system further comprises a display module, wherein the display module is used for displaying at least one video frame acquisition option;

the receiving module 210 is specifically configured to: receiving a second input of a first video frame acquisition option in the at least one video frame acquisition option from a user, wherein the first video frame acquisition option indicates a first video frame acquisition mode;

the obtaining module 220 is specifically configured to:

in response to the second input, acquiring the sequence of video frames comprising the first original video image according to the first video frame acquisition mode.

In the above embodiment, the input of the user is received through the displayed video frame acquisition option, and then the video frame sequence is acquired based on the input of the user, so that the flexibility is high, and the user experience is good.

Optionally, the obtaining module 220 is specifically configured to:

acquiring X frames of target original video images from the N frames of original video images according to preset image parameters to obtain the video frame sequence, wherein the X frames of target original video images comprise the first original video image;

optionally, the processing module 230 is specifically configured to:

carrying out image synthesis on the X frame target original video image to obtain the target image;

wherein N and X are both positive integers, and X is less than or equal to N.

Optionally, the display module is configured to:

displaying at least one video frame acquisition option;

the receiving module 210 is specifically configured to: receiving a third input of a user to a second video frame acquisition option of the at least one video frame acquisition option;

the display module is further configured to: displaying at least one video frame acquisition sub-option in response to the third input;

the receiving module 210 is specifically configured to: receiving a fourth input of the user for the at least one video frame acquisition sub-option;

the obtaining module 220 is specifically configured to: in response to the fourth input, acquiring the sequence of video frames comprising the first original video image according to a second video frame acquisition mode determined according to the fourth input.

Optionally, the display module is configured to:

displaying at least one image parameter adjustment control in response to the third input;

the receiving module 210 is specifically configured to: receiving a fifth input from the user to the at least one image parameter adjustment control;

optionally, the processing module 230 is specifically configured to:

responding to the fifth input, and carrying out image synthesis on original video images in the video frame sequence according to a first image parameter to obtain the target image; the first image parameter is determined from the fifth input.

Optionally, the receiving module 210 is specifically configured to: receiving a first input of a user to a target object in a video playing interface;

the obtaining module 220 is specifically configured to: acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where a target object in the first original video image is located;

the processing module 230 is specifically configured to: obtaining a target object intermediate image according to the target video frame sequence;

performing image synthesis on the target object intermediate image and the first preview video image to obtain the target image;

Optionally, the receiving module 210 is further configured to: receiving a fifth input of the user to the video recording interface;

the processing module 230 is further configured to: responding to the fifth input, and recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises the video frame sequence, and the video playing data comprises the first preview video image;

Optionally, the receiving module 210 is further configured to: receiving a sixth input of the user to the video playing interface;

the processing module 230 is further configured to: and responding to the sixth input, and reducing the playing frame rate of the video in the video playing interface.

In the above embodiment, by adjusting the video playing frame rate in the video playing interface, the playing process of the video in the video playing interface can be controlled, and particularly, the video playing frame rate in the video playing interface is reduced, so that the target image concerned by the user can be more accurately captured.

The image acquisition device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The image acquisition apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The image acquisition device provided in the embodiment of the present application can implement each process implemented by the image acquisition device in the method embodiments of fig. 1 to fig. 10, and for avoiding repetition, details are not repeated here.

Optionally, as shown in fig. 12, an electronic device 1200 is further provided in an embodiment of the present application, and includes a processor 1201, a memory 1202, and a program or an instruction stored in the memory 1202 and executable on the processor 1201, where the program or the instruction is executed by the processor 1201 to implement each process of the above-mentioned embodiment of the image obtaining method, and can achieve the same technical effect, and no further description is provided here to avoid repetition.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

The electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.

Those skilled in the art will appreciate that the electronic device 1000 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 13 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The user input unit 1007 is used for receiving a first input of a user to the video playing interface;

a processor 1010 configured to obtain, in response to the first input, a sequence of video frames including a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined in accordance with the first input;

In the embodiment of the present application, the user input unit 1007 may be a display screen of the electronic device.

The electronic device provided by the embodiment of the application, in response to a first input of a user to a video playing interface, acquires a video frame sequence including a first original video image, where the first original video image is an original image associated with a first preview video image, the first preview video image is an image determined according to the first input from a video of the video playing interface, and obtains a target image according to the video frame sequence.

Optionally, the display unit 1006 is configured to:

displaying at least one video frame acquisition option;

a user input unit 1007, configured to receive a second input of a first video frame acquisition option from the at least one video frame acquisition option, where the first video frame acquisition option indicates a first video frame acquisition mode;

the processor 1010 is specifically configured to: in response to the second input, acquiring the sequence of video frames comprising the first original video image according to the first video frame acquisition mode.

Optionally, the processor 1010 is further configured to:

wherein N and X are both positive integers, and X is less than or equal to N.

Optionally, the display unit 1006 is further configured to: displaying at least one video frame acquisition option;

a user input unit 1007, configured to receive a third input of a second video frame acquisition option from the user in the at least one video frame acquisition option;

the display unit 1006, in particular, is configured to: displaying at least one video frame acquisition sub-option in response to the third input;

a user input unit 1007, further configured to receive a fourth input of the at least one video frame acquisition sub-option from the user;

the processor 1010 is specifically configured to: in response to the fourth input, acquiring the sequence of video frames comprising the first original video image according to a second video frame acquisition mode determined according to the fourth input.

Optionally, the display unit 1006 is specifically configured to: displaying at least one image parameter adjustment control in response to the third input;

a user input unit 1007, configured to receive a fifth input from the user to the at least one image parameter adjustment control;

the processor 1010 is specifically configured to: responding to the fifth input, and carrying out image synthesis on original video images in the video frame sequence according to a first image parameter to obtain the target image; the first image parameter is determined from the fifth input.

Optionally, a user input unit 1007 configured to: receiving a first input of a user to a target object in a video playing interface;

the processor 1010 is specifically configured to: acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where a target object in the first original video image is located;

Optionally, a user input unit 1007 configured to:

receiving a fifth input of the user to the video recording interface;

the processor 1010 is specifically configured to: responding to the fifth input, and recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises the video frame sequence, and the video playing data comprises the first preview video image;

Optionally, a user input unit 1007 configured to:

receiving a sixth input of the user to the video playing interface;

the processor 1010 is specifically configured to: and responding to the sixth input, and reducing the playing frame rate of the video in the video playing interface.

It should be understood that in the embodiment of the present application, the input Unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042, and the Graphics Processing Unit 10041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 may include two parts, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1009 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. Processor 1010 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1010.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the embodiment of the image obtaining method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned embodiment of the image acquisition method, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

An embodiment of the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements each process of the embodiment of the image obtaining method, and can achieve the same technical effect, and for avoiding repetition, details are not repeated here.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An image acquisition method, comprising:

receiving a first input of a user to a video playing interface;

2. The image acquisition method according to claim 1, characterized in that said acquisition of a sequence of video frames comprising a first original video image comprises:

displaying at least one video frame acquisition option;

receiving a second input of a first video frame acquisition option in the at least one video frame acquisition option from a user, wherein the first video frame acquisition option indicates a first video frame acquisition mode;

3. The method according to claim 2, wherein said obtaining the sequence of video frames including the first original video image according to the first video frame obtaining manner comprises:

obtaining a target image according to the video frame sequence, including:

wherein N and X are both positive integers, and X is less than or equal to N.

4. The image acquisition method according to claim 1, characterized in that said acquisition of a sequence of video frames comprising a first original video image comprises:

displaying at least one video frame acquisition option;

in response to the fourth input, acquiring the sequence of video frames comprising the first original video image according to a second video frame acquisition mode determined according to the fourth input.

5. The image acquisition method according to claim 4, characterized in that the method further comprises:

receiving a fifth input from the user to the at least one image parameter adjustment control;

obtaining a target image according to the video frame sequence, including:

6. The image acquisition method according to claim 1, wherein the receiving a first input of a video playing interface from a user comprises:

the obtaining a sequence of video frames comprising a first original video image comprises:

obtaining a target image according to the video frame sequence, including:

7. The image capturing method according to any one of claims 1 to 6, wherein before receiving the first input of the video playing interface from the user, the method further comprises:

receiving a fifth input of the user to the video recording interface;

responding to the fifth input, and recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises the video frame sequence, and the video playing data comprises the first preview video image;

8. The image capturing method according to any one of claims 1 to 6, wherein before receiving the first input of the video playing interface from the user, the method further comprises:

receiving a sixth input of the user to the video playing interface;

and responding to the sixth input, and reducing the playing frame rate of the video in the video playing interface.

9. An image acquisition apparatus, characterized by comprising:

10. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the image acquisition method according to any one of claims 1 to 8.

11. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the image acquisition method according to any one of claims 1 to 8.