CN112363787A - Image processing method and device and electronic equipment - Google Patents

Image processing method and device and electronic equipment Download PDF

Info

Publication number
CN112363787A
CN112363787A CN202011197934.0A CN202011197934A CN112363787A CN 112363787 A CN112363787 A CN 112363787A CN 202011197934 A CN202011197934 A CN 202011197934A CN 112363787 A CN112363787 A CN 112363787A
Authority
CN
China
Prior art keywords
image
target
target interface
content
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011197934.0A
Other languages
Chinese (zh)
Inventor
张益兴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Software Technology Co Ltd
Original Assignee
Vivo Software Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Software Technology Co Ltd filed Critical Vivo Software Technology Co Ltd
Priority to CN202011197934.0A priority Critical patent/CN112363787A/en
Publication of CN112363787A publication Critical patent/CN112363787A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438Window management, e.g. event handling following interaction with the user interface
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20112Image segmentation details
    • G06T2207/20132Image cropping

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses an image processing method, an image processing device and electronic equipment, and belongs to the technical field of communication. The image processing method may include: receiving first input of an intercepted target interface, wherein the target interface comprises a suspension control; responding to the first input, and carrying out corresponding processing on the screenshot image of the target interface according to whether the suspension control blocks the content in the target interface to obtain a target screenshot image; and displaying a target screen capture image, wherein the target screen capture image is the image of the target interface after the floating control is removed. The method provided by the embodiment of the application can solve the problem of poor screen capture image effect.

Description

Image processing method and device and electronic equipment
Technical Field
The present application belongs to the field of communication technologies, and in particular, to an image processing method, an image processing apparatus, an electronic device, and a storage medium.
Background
With the development of technology, electronic devices have become indispensable tools in people's daily life. When a user needs to share or save content displayed on a screen, the content on the screen is often acquired by means of screen capture.
Currently, many applications in electronic devices are used with a floating window mode, such as a floating window for video calls or a floating window for navigation. Thus, when a user wants to capture a screen while using these applications with the floating window mode, the presence of these floating windows greatly affects the effect of capturing the screen image. For example, on one hand, the floating window may block the content that the user wants to capture, and on the other hand, the floating window may contain the privacy of the user, and the user does not want to show the content on the screen capture image, such as portrait information displayed in the window of a video call.
Disclosure of Invention
An object of the embodiments of the present application is to provide an image processing method, an image processing apparatus, an electronic device, and a storage medium, which can solve the problem of poor effect of capturing a screen image.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides an image processing method, including:
receiving first input of an intercepted target interface, wherein the target interface comprises a suspension control;
responding to the first input, and carrying out corresponding processing on the screenshot image of the target interface according to whether the suspension control blocks the content in the target interface to obtain a target screenshot image;
and displaying a target screen capture image, wherein the target screen capture image is the image of the target interface after the suspension control is removed.
In a second aspect, an embodiment of the present application provides an image processing apparatus, including:
the receiving module is used for receiving first input of an intercepted target interface, and the target interface comprises a suspension control;
the processing module is used for responding to the first input, and carrying out corresponding processing on the screenshot image of the target interface according to whether the floating control blocks the content in the target interface or not to obtain the target screenshot image;
and the display module is used for displaying the target screen capture image, and the target screen capture image is the image of the target interface after the suspension control is removed.
In a third aspect, the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the image processing method as shown in the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a program or instructions are stored, and when executed by a processor, the program or instructions implement the steps of the image processing method as shown in the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the steps of the image processing method according to the first aspect.
In the embodiment of the application, in the process of screen capturing by a user, it is detected that the captured target interface includes a suspension control, and at this time, corresponding processing is performed on the screen capturing image of the target interface according to whether the suspension control blocks the content in the target interface, so as to obtain the target screen capturing image of the target interface after the suspension control is removed. Therefore, when the user uses the application programs with the floating controls and wants to capture the screen, the floating controls in the captured image are automatically removed, and the effect of the captured image is improved.
Drawings
Fig. 1 is a schematic view of an application scenario of image processing according to an embodiment of the present application;
fig. 2 is a schematic interface diagram of image processing according to an embodiment of the present disclosure;
fig. 3 is a flowchart of an image processing method according to an embodiment of the present application;
FIG. 4 is a schematic view of a setup interface provided in an embodiment of the present application;
FIG. 5 is a schematic diagram of an interface for determining a target screenshot image according to an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of another interface for determining a target screenshot image according to an embodiment of the present application;
FIG. 7 is a schematic diagram of yet another interface for determining a target screenshot image provided in an embodiment of the present application;
fig. 8 is a schematic view of an interface for displaying prompt information according to an embodiment of the present disclosure;
fig. 9 is a schematic flowchart of determining a target screenshot image in an image processing method according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 12 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The image processing method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
First, an application scenario of image processing is provided in an embodiment of the present application. Referring to the left diagram a in fig. 1, the operating system of the electronic device is used with a floating window mode, that is, a movable floating control is floating on a display interface (e.g., a display desktop of the electronic device), and the floating control can display the content of the application program G. Alternatively, referring to fig. 1 b on the right, some applications in the electronic device may have a floating window mode when in use, that is, floating a movable floating control on a display interface (e.g., session 3 interface of application a), where the floating control may display the video content of session 3. Therefore, the user can display various contents and quickly start various functions through the floating control.
As shown in fig. 2, in a case where a user wants to perform a screen shot while using the applications (or functions provided by the operating system) with the hover control 20, the electronic device receives a first input 22 from the user that intercepts a target interface 21, where the target interface 21 includes the hover control 20; responding to the screen capture input, and performing corresponding processing on the screen capture image of the target interface 21 according to whether the floating control 20 blocks the content in the target interface 21, so as to obtain and display a target screen capture image 23, wherein the target screen capture image 23 is an image of the target interface without the floating control.
Therefore, in the process of screen capture of a user, it is detected that the captured target interface includes the suspension control, and at this time, the screen capture image of the target interface is correspondingly processed according to whether the suspension control blocks the content in the target interface, so that the target screen capture image of the target interface after the suspension control is removed is obtained. Therefore, when the user uses the application programs with the floating controls and wants to capture the screen, the floating controls in the captured image are automatically removed, and the effect of the captured image is improved.
In addition, the image processing method provided in the embodiment of the application can enable a user to correspondingly process the screenshot image of the target interface according to whether the floating control blocks the content in the target interface when the user uses the suspended control to capture the screenshot in the process of using the video, so as to obtain the target screenshot image without the floating control in the screenshot image, and ensure the privacy of the user while improving the screenshot image effect, thereby improving the user experience.
It should be noted that the floating control in the embodiment of the present application may include a control in at least one of the following cases: the system comprises a suspension control of video or voice call, a suspension control of video or picture playing, a suspension control of shopping interface and a suspension control of webpage link. Here, the present application is described with respect to the levitation control in these cases, including but not limited to these cases.
According to the application scenario, the following describes in detail the image processing method provided by the embodiment of the present application with reference to fig. 3.
Fig. 3 is a flowchart of an image processing method according to an embodiment of the present application.
As shown in fig. 3, the image processing method may specifically include the following steps:
first, in step 310, a first input of an intercepting target interface is received, wherein the target interface comprises a floating control.
And step 320, responding to the first input, and performing corresponding processing on the screenshot image of the target interface according to whether the floating control blocks the content in the target interface to obtain the target screenshot image.
Then, in step 330, a target screen capture image is displayed, and the target screen capture image is the image of the target interface after the floating control is removed.
Therefore, when the user uses the application programs with the floating controls and wants to capture the screen, the floating controls in the captured image are automatically removed, and the effect of the captured image is improved.
The above steps are described in detail below, specifically as follows:
first, referring to step 310, after receiving a first input of an intercepted target interface, in this embodiment, it needs to detect whether a hover control is included in the intercepted target interface.
In the event that a hover control is detected in the target interface, step 320 is performed. On the contrary, under the condition that the suspension control is not included in the target interface, the screen capture image corresponding to the target interface is intercepted and displayed.
In a possible embodiment, before receiving the first input of the intercepting target interface, the condition that the user relates to the screen capture needs to be received in the embodiment of the application. Thus, prior to the step of receiving a first input intercepting a target interface, the image processing method further comprises:
receiving a second input for setting the interception interface; in response to the second input, screen capture conditions of the capture interface are determined, and a target screen capture image is determined through the screen capture conditions. Wherein the screen capture condition comprises at least one of the following: and generating conditions of the screen shot image, and removing the conditions of the suspension control.
For example, as shown in FIG. 4, a second input is received from the user setting the screenshot, a settings interface 40 is displayed, and the settings interface 40 may include options for screenshot settings such as a floating window screenshot and other screenshots. In the case where an input that a user selects a floating window screen capture is received, conditions for generating a screen capture image, such as image completion and image stitching, are displayed.
In this way, in the case where the user selects image stitching, the condition for removing the floating control is displayed in association with the picture stitching scheme. Wherein the condition for removing the floating control is zooming and splicing options and/or floating control moving and splicing options.
For the floating control moving splicing option, the user can manually select the floating control at a left-right symmetrical position option, a top-bottom symmetrical position option or an adjacent position option shown in fig. 4, and then the electronic device removes the floating control according to the position manually selected by the user; or the electronic equipment automatically searches for a blank position, namely an option of the blank area, and moves the floating control to the blank area, so that the floating control is indirectly removed later when the blank area is removed.
Then, step 320 is involved, and two situations are provided in the embodiment of the present application, that is, if the floating control blocks the content in the target interface, the process of performing corresponding processing on the screenshot image of the target interface by using 320 involved in the situation 1 to obtain the target screenshot image is adopted; otherwise, if the floating control does not block the content in the target interface, the process of performing corresponding processing on the screenshot image of the target interface by using 320 related to the case 2 to obtain the target screenshot image is adopted.
Based on this, in the embodiment of the present application, a manner of determining a target screenshot image is provided according to two scenarios, which are described below respectively.
In case 1, the floating control blocks the content in the target interface, and this step 320 may specifically include the following three ways of determining the target screenshot image.
The first method is as follows: when the floating control blocks the content in the target interface, determining that the floating control blocks a first image of the content in the target interface;
removing the area where the suspension control in the target interface is located to obtain a second image;
and determining the image obtained by splicing the first image and the second image as a target screen capture image.
It should be noted that the removing and intercepting in the present application can be classified as an image segmentation technique, where image segmentation refers to a process of subdividing a digital image into a plurality of image sub-regions (or sets of pixels, also referred to as super-pixels). The image completion and the image splicing in the application can be classified as an image completion technology, and here, the missing area of the image to be repaired can be completed according to the image information or the image library information, so that the repaired image looks more natural.
Specifically, the step of determining the first image in which the floating control overlaps with the content in the target interface may specifically include:
according to the first position, size information of the suspension control in the target interface is obtained;
obtaining zoom information of the target interface according to the corresponding relation between the size information and preset zoom information;
zooming the target image according to the zooming information to obtain a shielding image of the shielding content of the suspension control, wherein the target image is the image of the content in the target interface;
an occlusion image is determined as the first image.
For example, a user may set a condition of the capture interface in advance, and referring to fig. 5, when it is determined that the screen capture condition of the capture interface is image completion and zoom stitching, the position of the floating control in the target interface is determined in response to a first input of the user capturing the target interface, and the longest distance of the size information, such as the horizontal and vertical spans, of the floating control in the target interface is calculated. And then, calculating the scaling information, such as scaling proportion, of the target interface according to the corresponding relation between the size information and the preset scaling information. Then, the zoomed-out target image 50, which is the image of the content in the target interface, such as the images of two children in fig. 5, is displayed in the upper left corner according to the zoom ratio. At this time, an image of the occlusion of the content occluded by the floating control may be captured, and the image may be enlarged according to the scaling ratio to obtain the first image 51. Thus, the reduced target interface is enlarged to the target interface before reduction. And intercepting the second image except the floating control in the target interface, and splicing the second image with the first image 51 to obtain a target screen shot image.
Therefore, when the user uses the application program of the suspension control, the operation of closing the suspension control is not needed when the user executes screenshot operation, the suspension control in the screenshot image is automatically removed in the picture scaling and splicing mode, the screenshot image effect is improved, and the user experience of screenshot of the user in the suspension window state is improved.
The second method comprises the following steps: when the suspension control blocks the content in the target interface, acquiring at least two frames of images corresponding to the first input, wherein the at least two frames of images comprise a first frame of image and a second frame of image behind the first frame of image, and the positions of the suspension control in the first frame of image and the position of the suspension control in the second frame of image are different;
intercepting a third image after the suspension control is removed from the first frame of image, and intercepting a fourth image after the suspension control is removed from the second frame of image;
and splicing the third image and the fourth image to obtain a target screen capture image.
In one possible embodiment, the position of the hover control may be changed by receiving an input from a user dragging the hover control to obtain the first frame image and the second frame image. Of course, in another possible embodiment, the electronic device may also intercept the second frame image when the position of the floating control is moved to a position different from the position of the floating control in the first frame image according to a preset moving condition.
It should be noted that, the shorter the interval between the first frame image and the second frame image, the better, two adjacent frames before and after the refresh of the electronic device may be generally set. In addition, in order to ensure the effect of screenshot, the second frame image may be multiple, and the second frame image with a position different from that of the floating control in the first frame image is acquired from the multiple second frame images.
For example, referring to fig. 6, when the screen capture condition of the capture interface is determined to be an option of image stitching and automatically finding a blank position, that is, a blank area, in response to a first input of the user capture target interface, a first frame image 61 corresponding to the first input and a second frame image 62 following the first frame image are obtained, where positions of a floating control in the first frame image and a floating control in the second frame image are different. In this way, a third image 63 after the floating control is removed from the first frame image is intercepted, and a fourth image 64 after the floating control is removed from the second frame image is intercepted; and splicing the third image and the fourth image to obtain a target screen capture image 65.
Therefore, when the user uses the application program of the suspension control, the user can execute the screenshot operation without closing the pain point of the suspension control, and the user can move the position of the suspension control to capture the covered screenshots at the front position and the rear position. And then, a final target screen capture image is completed by adopting a splicing method, a suspension control in the screen capture image is automatically removed, the effect of the screen capture image is improved, and the screen capture use experience of a user in a suspension window state is improved.
The third method comprises the following steps: when the floating control blocks the content in the target interface, determining that the target interface comprises a blank area, wherein the blank area is an area not comprising the content in the target interface or the blank degree of the area comprising the content in the target interface is greater than or equal to a preset threshold value;
moving the suspension control to the blank area, and intercepting a fifth image of the target interface with the blank area removed;
and performing image completion on the area of the fifth image from which the blank area is removed to obtain a target screen capture image.
Here, the blank area referred to above is, in the embodiment of the present disclosure, other than an area indicating an area not including content in the target interface or an area including content in the target interface, the blank degree of which is greater than or equal to a preset threshold value. A continuous smooth space may also be represented. Where a continuous smooth space refers to a continuous spatial domain in which the amount of detail, abrupt changes, edges, and noise in the image is below a certain threshold.
Here, in a possible embodiment, when the floating control occludes the content in the target interface, the determining that the target interface includes the blank area may specifically include:
when the floating control blocks the content in the target interface, determining whether the floating control is removed through an artificial intelligence algorithm;
and under the condition that the floating control is not removed through the artificial intelligence algorithm, determining that the target interface comprises a blank area.
On the contrary, under the condition that the floating control is removed through an artificial intelligence algorithm, a seventh image of the target interface, from which the floating control is removed, is intercepted;
and completing the image of the area of the seventh image without the suspension control to obtain a target screen capture image.
In addition, in the event that it is determined that the target interface does not include a blank area, displaying a prompt;
and the prompt information is used for prompting that the screen capture image generated by the target interface comprises the floating control.
For example, as shown in fig. 7, when the floating control blocks the content in the target interface, it is determined whether to remove the floating control through an artificial intelligence algorithm.
And under the condition that the floating control is not removed through an artificial intelligence algorithm, detecting whether the target interface comprises a blank area. Under the condition that the target interface is detected to comprise a blank area, moving the floating control to the blank area, and intercepting a fifth image of the target interface, wherein the blank area is removed; and performing image completion on the area of the fifth image from which the blank area is removed to obtain a target screen capture image. On the contrary, as shown in fig. 8, in the case that it is detected that the target interface does not include a blank area, a prompt message is displayed; and the prompt information is used for prompting that the screen capture image generated by the target interface comprises the floating control. Or, the mode in the first execution mode and the second execution mode is that the target screen capture image is determined by adopting a capturing and splicing mode.
Intercepting a seventh image of the target interface from which the floating control is removed under the condition that the floating control is removed through an artificial intelligence algorithm;
and completing the image of the area of the seventh image without the suspension control to obtain a target screen capture image.
Here, the third embodiment can be explained in its entirety with reference to the flowchart of fig. 9, specifically as follows.
The user can set the condition of the interception interface in advance, and referring to fig. 9, the image processing method may specifically include steps 910 to 960.
First, referring to step 910, when it is determined that the screen capture condition of the capture interface is image stitching and an option of automatically finding a blank position, i.e. a blank area, a first input of the target interface is captured in response to a user.
Next, referring to step 920, a detection model is called to determine whether the floating control in the target interface can be removed by calling an Artificial Intelligence (AI) algorithm.
When detecting that the floating control in the target interface can call an AI algorithm to remove the floating control, that is, when the floating control does not shield the content in the target interface or the area shielding the content in the target interface is smaller than the preset area, executing step 930; otherwise, when it is detected that the floating control in the target interface cannot call the AI algorithm to remove the floating control, that is, the floating control blocks the content in the target interface, and the area blocking the content in the target interface is greater than or equal to the preset area, step 940 is executed.
Specifically, the step of calling the AI algorithm to remove the floating control may be to identify the boundary of the floating control through an AI algorithm model, identify the layer where the floating control is located and the layer where the content in the target interface is located, remove the layer where the floating control is located, and generate the portion that is blocked by the floating control and lost through an image completion algorithm.
Furthermore, step 930 is involved, capturing the image of the target interface without the floating control; and completing the image of the area without the suspension control in the image to obtain a target screen capture image.
At this time, if the floating control does not block the content in the target interface, capturing a sixth image of the target interface without the floating control; and completing the image of the region without the suspension control in the sixth image to obtain a target screen capture image.
If the area for blocking the content in the target interface is smaller than the preset area, go to step 940.
Next, at step 940, it is detected whether the target interface includes a blank area.
In the event that the target interface is detected to include a blank area, performing step 950; otherwise, in case it is detected that the target interface does not include a blank area, step 960 is performed.
Step 950, moving the floating control to the blank area, and capturing a fifth image of the target interface with the blank area removed; and performing image completion on the area of the fifth image from which the blank area is removed to obtain a target screen capture image.
Then, step 960 is involved, displaying a prompt; and the prompt information is used for prompting that the screen capture image generated by the target interface comprises the floating control.
Therefore, when the user uses the application program of the suspension control, the user can execute screenshot operation without closing pain points of the suspension control, remove the suspension control through the AI algorithm model, move the position of the suspension control to the blank area under the condition that the suspension control cannot be removed through the AI algorithm model, remove the suspension control, and then complete the final target screenshot image in an image completion mode. Therefore, the suspension control in the screen capture image can be automatically removed, the effect of the screen capture image is improved, and the use experience of the screen capture of a user in the suspension control state is improved.
In case 2, when the floating control does not shield the content in the target interface, a sixth image of the target interface, from which the floating control is removed, is captured;
and completing the image of the region without the suspension control in the sixth image to obtain a target screen capture image.
It should be noted that, in the embodiment of the present application, since the screen capture operation is a process of acquiring pixel contents on a screen element of an electronic greeting device and saving a picture, only one layer exists in an entire image. Therefore, the content blocked by the floating control cannot be acquired during screen capture. Therefore, the storage space of two units of each pixel point can be set on the screen element, so that the storage controls of the two units can correspondingly store two layers, and only the content in the target interface shielded by the suspension control can be read during screenshot, so as to obtain the accurate content in the target interface shielded by the suspension control.
In addition, in the embodiment of the present application, the screen refresh frequency is above 60 hertz (hz). Therefore, the screen capturing operation can be performed while the floating control is hidden in a certain frame during screen capturing, and the operation of obtaining the target screen capturing image can be completed under the condition that a user cannot perceive the target screen capturing image.
In summary, the embodiment of the application provides a method for performing corresponding processing on a screenshot image of a target interface according to whether a floating control blocks content in the target interface when the electronic device starts the floating control, so as to automatically remove the floating control, obtain a target screenshot image, and improve the effect of the screenshot image. The suspension control in the target interface can be judged whether to be automatically removed when the screen is shot, and the suspension control can be directly removed without closing or hiding the suspension control by automatically removing the suspension control through an AI algorithm.
And automatically calculating whether blank areas exist in the target interface or not for the suspension control which cannot be removed. And if the floating control exists, prompting the user to move the floating control to the corresponding position through arrow guidance or automatically moving the floating control to a blank area and then performing screen capturing. Otherwise, if the information does not exist, corresponding prompt information is given to the user.
In addition, the target interface is zoomed, the content in the target interface and the content in the target interface covered by the suspension control can be simultaneously displayed in the current interface, and then the operation of automatically removing the suspension control is realized by an image splicing method. Alternatively, a moving hover control position is employed. And intercepting screenshots of the two suspension controls at different positions, and splicing the screenshots to realize the operation of automatically removing the suspension controls.
Therefore, the image processing method provided by the embodiment of the application enables a user to automatically remove the floating control in the screen capture image when the user uses the application programs with the floating controls and wants to capture the screen, so that the privacy of the user is guaranteed while the screen capture image effect is provided, and the user experience is improved.
Based on the same inventive concept, the application also provides an image processing device. This is explained in detail with reference to fig. 10.
Fig. 10 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
As shown in fig. 10, the image processing apparatus 100 is applied to an electronic device, and may specifically include: a receiving module 1001, configured to receive a first input of an intercepted target interface, where the target interface includes a floating control;
a processing module 1002, configured to, in response to the first input, perform corresponding processing on the screenshot image of the target interface according to whether the floating control blocks the content in the target interface, to obtain a target screenshot image
The display module 1003 is configured to display a target screen capture image, where the target screen capture image is an image of the target interface after the floating control is removed.
Therefore, when the user uses the application programs with the floating controls and wants to capture the screen, the floating controls in the captured image are automatically removed, and the effect of the captured image is improved.
The image processing apparatus 100 according to the embodiment of the present application will be described in detail below.
In a possible embodiment, the processing module 1002 in this embodiment of the present application is configured to determine that the floating control blocks the first image of the content in the target interface when the floating control blocks the content in the target interface;
removing the area where the suspension control in the target interface is located to obtain a second image;
and determining the image obtained by splicing the first image and the second image as a target screen capture image.
Specifically, the processing module 1002 may be specifically configured to obtain size information of the floating control in the target interface according to the first position;
obtaining zoom information of the target interface according to the corresponding relation between the size information and preset zoom information;
zooming the target image according to the zooming information to obtain a shielding image of the shielding content of the suspension control, wherein the target image is the image of the content in the target interface;
an occlusion image is determined as the first image.
In another possible embodiment, the processing module 1002 in this embodiment of the application may be specifically configured to, when the floating control blocks content in the target interface, obtain at least two frames of images corresponding to the first input, where the at least two frames of images include a first frame of image and a second frame of image behind the first frame of image, and positions of the floating control in the first frame of image are different from positions of the floating control in the second frame of image;
intercepting a third image after the suspension control is removed from the first frame of image, and intercepting a fourth image after the suspension control is removed from the second frame of image;
and splicing the third image and the fourth image to obtain a target screen capture image.
In another possible embodiment, the processing module 1002 in this embodiment of the application may be specifically configured to, when the floating control blocks the content in the target interface, determine that the target interface includes a blank area, where the blank area is an area that does not include the content or a blank degree of the area that includes the content is greater than or equal to a preset threshold;
moving the suspension control to the blank area, and intercepting a fifth image of the target interface with the blank area removed;
and performing image completion on the area of the fifth image from which the blank area is removed to obtain a target screen capture image.
Based on this, the processing module 1002 may be specifically configured to determine whether to remove the floating control through an artificial intelligence algorithm according to the first position;
determining that the target interface includes a blank area without removing the hover control through an artificial intelligence algorithm.
In another possible embodiment, the processing module 1002 in this embodiment of the application may be specifically configured to, when the floating control does not obscure the content in the target interface, intercept a sixth image of the target interface from which the floating control is removed;
and completing the image of the region without the suspension control in the sixth image to obtain a target screen capture image.
The image processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in an electronic device. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The image processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The image processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments in fig. 1 to fig. 9, and is not described herein again to avoid repetition.
In summary, the embodiment of the present application provides a method for performing corresponding processing on a screenshot image of a target interface according to whether a floating control blocks content in the target interface when the electronic device starts the floating control, so as to automatically remove the floating control, obtain a target screenshot image, and improve the effect of the screenshot image. The suspension control in the target interface can be judged whether to be automatically removed when the screen is shot, and the suspension control can be directly removed without closing or hiding the suspension control by automatically removing the suspension control through an AI algorithm.
And automatically calculating whether blank areas exist in the target interface or not for the suspension control which cannot be removed. And if the floating control exists, prompting the user to move the floating control to the corresponding position through arrow guidance or automatically moving the floating control to a blank area and then performing screen capturing. Otherwise, if the information does not exist, corresponding prompt information is given to the user.
In addition, the target interface is zoomed, the content in the target interface and the content in the target interface covered by the suspension control can be simultaneously displayed in the current interface, and then the operation of automatically removing the suspension control is realized by an image splicing method. Alternatively, a moving hover control position is employed. And intercepting screenshots of the two suspension controls at different positions, and splicing the screenshots to realize the operation of automatically removing the suspension controls.
Therefore, the image processing method provided by the embodiment of the application enables a user to automatically remove the floating control in the screen capture image when the user uses the application programs with the floating controls and wants to capture the screen, so that the privacy of the user is guaranteed while the screen capture image effect is provided, and the user experience is improved.
Optionally, as shown in fig. 11, an electronic device 1100 is further provided in an embodiment of the present application, and includes a processor 1101, a memory 1102, and a program or an instruction stored in the memory 1102 and executable on the processor 1101, where the program or the instruction is executed by the processor 1101 to implement each process of the embodiment of the image processing method, and can achieve the same technical effect, and no repeated description is repeated here to avoid repetition.
It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic device and the non-mobile electronic device described above.
Fig. 12 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
The electronic device 1200 includes, but is not limited to: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensors 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 1209, and processor 1210.
Those skilled in the art will appreciate that the electronic device 1200 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 1210 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 12 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
In this embodiment of the present application, the user input unit 1207 is configured to receive a first input of an intercepting target interface, where the target interface includes a floating control.
And the processor 1210 is configured to, in response to the first input, perform corresponding processing on the screenshot image of the target interface according to whether the floating control blocks the content in the target interface, so as to obtain a target screenshot image.
The display unit 1206 is configured to display a target screenshot image, where the target screenshot image is an image of the target interface after the floating control is removed.
Therefore, when the user uses the application programs with the floating controls and wants to capture the screen, the floating controls in the captured image are automatically removed, and the effect of the captured image is improved.
It is to be understood that the input Unit 1204 may include a Graphics Processing Unit (GPU) 12041 and a microphone 12042, and the Graphics processor 12041 processes image data of still pictures or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1207 includes a touch panel 12071 and other input devices 12072. A touch panel 12071, also referred to as a touch screen. The touch panel 12071 may include two parts of a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1209 may be used to store software programs as well as various data, including but not limited to application programs and an operating system. Processor 1210 may integrate an application processor, which handles primarily the operating system, user interface, applications, etc., and a modem processor, which handles primarily wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1210.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned information identification method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
In addition, an embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned embodiment of the image processing method, and the same technical effect can be achieved.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the methods of the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (11)

1. An image processing method, comprising:
receiving a first input of an intercepted target interface, wherein the target interface comprises a suspension control;
responding to the first input, and carrying out corresponding processing on the screenshot image of the target interface according to whether the floating control blocks the content in the target interface or not to obtain a target screenshot image;
and displaying the target screen capture image, wherein the target screen capture image is the image of the target interface without the suspension control.
2. The method of claim 1, wherein the correspondingly processing the screenshot image of the target interface to obtain a target screenshot image comprises:
when the floating control blocks the content in the target interface, determining that the floating control blocks a first image of the content;
removing the area where the suspension control is located in the target interface to obtain a second image;
and determining the image obtained by splicing the first image and the second image as the target screen capture image.
3. The method of claim 2, wherein the determining that the hover control occludes the first image of content comprises:
according to the first position, obtaining size information of the suspension control in the target interface;
obtaining zoom information of the target interface according to the corresponding relation between the size information and preset zoom information;
zooming a target image according to the zooming information to obtain an occlusion image of the floating control occluding the content, wherein the target image is an image of the content in the target interface;
determining the occlusion image as the first image.
4. The method of claim 1, wherein the correspondingly processing the screenshot image of the target interface to obtain a target screenshot image comprises:
when the floating control blocks the content in the target interface, acquiring at least two frames of images corresponding to the first input, wherein the at least two frames of images comprise a first frame of image and a second frame of image behind the first frame of image, and the positions of the floating control in the first frame of image and the floating control in the second frame of image are different;
intercepting a third image of the first frame image after the suspension control is removed, and intercepting a fourth image of the second frame image after the suspension control is removed;
and splicing the third image and the fourth image to obtain the target screen capture image.
5. The method of claim 1, wherein the correspondingly processing the screenshot image of the target interface to obtain a target screenshot image comprises:
when the floating control blocks the content in the target interface, determining that the target interface comprises a blank area, wherein the blank area is an area not comprising the content or the blank degree of the area comprising the content is greater than or equal to a preset threshold value;
moving the floating control to the blank area, and intercepting a fifth image of the target interface, from which the blank area is removed;
and completing the image of the area of the fifth image without the blank area to obtain a target screen capture image.
6. The method of claim 5, wherein the determining that the target interface includes a blank area comprises:
determining whether the floating control is removed through an artificial intelligence algorithm or not according to the first position;
determining that the target interface includes a blank area if the hover control is not removed by an artificial intelligence algorithm.
7. The method of claim 1, wherein the correspondingly processing the screenshot image of the target interface to obtain a target screenshot image comprises:
when the floating control does not shield the content in the target interface, intercepting a sixth image in the target interface, from which the floating control is removed;
and completing the image of the region of the sixth image without the suspension control to obtain a target screen capture image.
8. An image processing apparatus characterized by comprising:
the receiving module is used for receiving first input of an intercepted target interface, and the target interface comprises a suspension control;
the processing module is used for responding to the first input, and carrying out corresponding processing on the screenshot image of the target interface according to whether the floating control blocks the content in the target interface or not to obtain a target screenshot image;
and the display module is used for displaying the target screen capture image, and the target screen capture image is the image of the target interface after the suspension control is removed.
9. The apparatus of claim 8, wherein the processing module is specifically configured to determine that the hover control occludes a first image of content in the target interface when the hover control occludes the content;
removing the area where the suspension control is located in the target interface to obtain a second image;
and determining the image obtained by splicing the first image and the second image as the target screen capture image.
10. The apparatus according to claim 9, wherein the processing module is specifically configured to obtain, according to the first position, size information of the floating control in the target interface;
obtaining zoom information of the target interface according to the corresponding relation between the size information and preset zoom information;
zooming a target image according to the zooming information to obtain an occlusion image of the floating control occluding the content, wherein the target image is the image of the content in the target interface;
determining the occlusion image as the first image.
11. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the image processing method according to any one of claims 1 to 7.
CN202011197934.0A 2020-10-30 2020-10-30 Image processing method and device and electronic equipment Pending CN112363787A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011197934.0A CN112363787A (en) 2020-10-30 2020-10-30 Image processing method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011197934.0A CN112363787A (en) 2020-10-30 2020-10-30 Image processing method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN112363787A true CN112363787A (en) 2021-02-12

Family

ID=74514148

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011197934.0A Pending CN112363787A (en) 2020-10-30 2020-10-30 Image processing method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112363787A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115291777A (en) * 2022-08-04 2022-11-04 维沃移动通信有限公司 Screen capturing method and device, terminal and readable storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106168872A (en) * 2016-06-23 2016-11-30 珠海市魅族科技有限公司 Screenshotss method and apparatus
CN106775298A (en) * 2016-11-28 2017-05-31 北京小米移动软件有限公司 The processing method and processing device of sectional drawing
CN106970754A (en) * 2017-03-28 2017-07-21 北京小米移动软件有限公司 The method and device of screenshotss processing
CN107943551A (en) * 2017-11-14 2018-04-20 维沃移动通信有限公司 A kind of screen display method and mobile terminal
CN109144370A (en) * 2018-09-30 2019-01-04 珠海市君天电子科技有限公司 A kind of screenshotss method, apparatus, terminal and computer-readable medium
CN109976859A (en) * 2019-03-28 2019-07-05 努比亚技术有限公司 Screenshot method, terminal and computer readable storage medium
CN110418004A (en) * 2019-07-29 2019-11-05 努比亚技术有限公司 Screenshot processing method, terminal and computer readable storage medium
CN110737374A (en) * 2019-09-27 2020-01-31 维沃移动通信有限公司 Operation method and electronic equipment
CN111641750A (en) * 2020-05-19 2020-09-08 Oppo广东移动通信有限公司 Screen capture method, terminal and non-volatile computer-readable storage medium
CN111831152A (en) * 2020-06-03 2020-10-27 北京百度网讯科技有限公司 Control method and device of touch screen, electronic equipment and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106168872A (en) * 2016-06-23 2016-11-30 珠海市魅族科技有限公司 Screenshotss method and apparatus
CN106775298A (en) * 2016-11-28 2017-05-31 北京小米移动软件有限公司 The processing method and processing device of sectional drawing
CN106970754A (en) * 2017-03-28 2017-07-21 北京小米移动软件有限公司 The method and device of screenshotss processing
CN107943551A (en) * 2017-11-14 2018-04-20 维沃移动通信有限公司 A kind of screen display method and mobile terminal
CN109144370A (en) * 2018-09-30 2019-01-04 珠海市君天电子科技有限公司 A kind of screenshotss method, apparatus, terminal and computer-readable medium
CN109976859A (en) * 2019-03-28 2019-07-05 努比亚技术有限公司 Screenshot method, terminal and computer readable storage medium
CN110418004A (en) * 2019-07-29 2019-11-05 努比亚技术有限公司 Screenshot processing method, terminal and computer readable storage medium
CN110737374A (en) * 2019-09-27 2020-01-31 维沃移动通信有限公司 Operation method and electronic equipment
CN111641750A (en) * 2020-05-19 2020-09-08 Oppo广东移动通信有限公司 Screen capture method, terminal and non-volatile computer-readable storage medium
CN111831152A (en) * 2020-06-03 2020-10-27 北京百度网讯科技有限公司 Control method and device of touch screen, electronic equipment and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115291777A (en) * 2022-08-04 2022-11-04 维沃移动通信有限公司 Screen capturing method and device, terminal and readable storage medium

Similar Documents

Publication Publication Date Title
US11114130B2 (en) Method and device for processing video
US20180232135A1 (en) Method for window displaying on a mobile terminal and mobile terminal
CN111866423B (en) Screen recording method for electronic terminal and corresponding equipment
CN110100251B (en) Apparatus, method, and computer-readable storage medium for processing document
US11410342B2 (en) Method for adding special effect to video, electronic device and storage medium
US20220382427A1 (en) Method and apparatus for controlling display of video call interface, storage medium and device
US20170039753A1 (en) Method, apparatus and non-transitory computer-readable storage medium for uninstalling an application
EP3822757A1 (en) Method and apparatus for setting background of ui control
CN112860163A (en) Image editing method and device
EP4345756A1 (en) Special effect generation method and apparatus, electronic device and storage medium
CN113359995B (en) Man-machine interaction method, device, equipment and storage medium
CN107870703B (en) Method, system and terminal equipment for full-screen display of picture
CN111190677A (en) Information display method, information display device and terminal equipment
CN111857511A (en) Wallpaper display control method and device and electronic equipment
CN113655929A (en) Interface display adaptation processing method and device and electronic equipment
CN112363787A (en) Image processing method and device and electronic equipment
US20130169660A1 (en) Image editing system and method
CN112508020A (en) Labeling method and device, electronic equipment and storage medium
CN110737417A (en) demonstration equipment and display control method and device of marking line thereof
CN110427153B (en) Writing content display method, device, equipment and medium
KR101832838B1 (en) Apparatus and method for controlling display size in portable terminal
CN114116106A (en) Chart display method and device, electronic equipment and storage medium
CN112165584A (en) Video recording method, video recording device, electronic equipment and readable storage medium
CN115129203A (en) Interface display method and device of application program
CN112286430A (en) Image processing method, apparatus, device and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination