CN110719402B - Image processing method and terminal equipment - Google Patents
Image processing method and terminal equipment Download PDFInfo
- Publication number
- CN110719402B CN110719402B CN201910907111.3A CN201910907111A CN110719402B CN 110719402 B CN110719402 B CN 110719402B CN 201910907111 A CN201910907111 A CN 201910907111A CN 110719402 B CN110719402 B CN 110719402B
- Authority
- CN
- China
- Prior art keywords
- target image
- terminal device
- target
- module
- privacy information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Telephone Function (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the invention provides an image processing method and terminal equipment, which are applied to the technical field of communication and are used for solving the problem of privacy information leakage in the process of long-distance shooting. The method comprises the following steps: under the condition that a first zoom multiple of a camera of the terminal equipment is larger than or equal to a preset threshold value, acquiring a target image in a preview interface of the camera; and identifying the target image, and blurring a target area in the target image if the target image is identified to contain the preset privacy information, wherein the target area is an area where the preset privacy information is located.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to an image processing method and terminal equipment.
Background
With the development of terminal equipment technology, the frequency of using the terminal equipment by a user is higher and higher, and the requirement of the user on the shooting function of the terminal equipment is higher and higher.
At present, a camera in a terminal device increases the zoom factor of the camera through optical zooming and digital zooming, so that a distant scene during shooting can be enlarged, and a high-quality distant image can be shot.
However, a user can easily shoot a high-quality long-range image through the terminal device, which also makes the user possibly shoot the privacy of others carelessly, or some lawbreakers can also take the privacy of others with no help, and further causes a problem of revealing the privacy information of others in the process of long-range shooting.
Disclosure of Invention
The embodiment of the invention provides an image processing method and terminal equipment, and aims to solve the problem of privacy information leakage in a long-distance shooting process.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present invention provides an image processing method, where the method includes:
under the condition that a first zoom multiple of a camera of the terminal equipment is larger than or equal to a preset threshold value, acquiring a target image in a preview interface of the camera;
and identifying the target image, and blurring a target area in the target image if the target image is identified to contain the preset privacy information, wherein the target area is an area where the preset privacy information is located.
In a second aspect, an embodiment of the present invention further provides a terminal device, where the terminal device includes:
the terminal equipment comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a target image in a preview interface of a camera of the terminal equipment under the condition that a first zoom multiple of the camera is larger than or equal to a preset threshold;
the identification module is used for identifying the target image acquired by the acquisition module;
and the blurring module is used for blurring a target area in the target image if the target image is identified by the identification module to contain the preset privacy information, wherein the target area is an area where the preset privacy information is located.
In a third aspect, an embodiment of the present invention provides a terminal device, which includes a processor, a memory, and a computer program stored on the memory and operable on the processor, and when executed by the processor, the computer program implements the steps of the image processing method according to the first aspect.
In a fourth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the image processing method according to the first aspect.
In the embodiment of the invention, when the first zoom multiple of the camera of the terminal equipment is greater than or equal to the preset threshold value, the terminal equipment acquires the target image in the preview interface of the camera and identifies the target image, and when the target image is identified to contain the preset privacy information, the terminal equipment prevents the privacy information of other people from being leaked unintentionally or maliciously in the process of long-distance shooting by blurring the area where the preset privacy information is located in the target image.
Drawings
Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of an image processing method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of an interface applied by an image processing method according to an embodiment of the present invention;
fig. 4 is a second schematic diagram of an interface applied by the image processing method according to the embodiment of the present invention;
fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present invention;
fig. 6 is a second schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that "/" in this context means "or", for example, A/B may mean A or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone.
It should be noted that "a plurality" herein means two or more than two.
It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
It should be noted that, for the convenience of clearly describing the technical solutions of the embodiments of the present invention, in the embodiments of the present invention, words such as "first" and "second" are used to distinguish the same items or similar items with substantially the same functions or actions, and those skilled in the art can understand that the words such as "first" and "second" do not limit the quantity and execution order. For example, the first zoom factor and the second zoom factor are specific orders for distinguishing different zoom factors, not for describing zoom factors.
The execution subject of the image processing method provided in the embodiment of the present invention may be the terminal device (including a mobile terminal device and a non-mobile terminal device), or may also be a functional module and/or a functional entity capable of implementing the image processing method in the terminal device, which may be determined specifically according to actual use requirements, and the embodiment of the present invention is not limited. The following takes a terminal device as an example to exemplarily explain an image processing method provided by the embodiment of the present invention.
The terminal device in the embodiment of the invention can be a mobile terminal device and can also be a non-mobile terminal device. The mobile terminal device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc.; the non-mobile terminal device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, or the like; the embodiments of the present invention are not particularly limited.
The terminal device in the embodiment of the present invention may be a terminal device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present invention are not limited in particular.
The following describes a software environment to which the image processing method provided by the embodiment of the present invention is applied, by taking an android operating system as an example.
Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention. In fig. 1, the architecture of the android operating system includes 4 layers, which are respectively: an application layer, an application framework layer, a system runtime layer, and a kernel layer (specifically, a Linux kernel layer).
The application program layer comprises various application programs (including system application programs and third-party application programs) in an android operating system.
The application framework layer is a framework of the application, and a developer can develop some applications based on the application framework layer under the condition of complying with the development principle of the framework of the application.
The system runtime layer includes libraries (also called system libraries) and android operating system runtime environments. The library mainly provides various resources required by the android operating system. The android operating system running environment is used for providing a software environment for the android operating system.
The kernel layer is an operating system layer of an android operating system and belongs to the bottommost layer of an android operating system software layer. The kernel layer provides kernel system services and hardware-related drivers for the android operating system based on the Linux kernel.
Taking an android operating system as an example, in the embodiment of the present invention, a developer may develop a software program for implementing the image processing method provided in the embodiment of the present invention based on the system architecture of the android operating system shown in fig. 1, so that the image processing method may operate based on the android operating system shown in fig. 1. Namely, the processor or the terminal device can implement the image processing method provided by the embodiment of the invention by running the software program in the android operating system.
The following describes an image processing method according to an embodiment of the present invention with reference to a flowchart of the image processing method shown in fig. 2, where fig. 2 is a schematic flowchart of an image processing method according to an embodiment of the present invention, and includes steps 201 to 202:
step 201: under the condition that the first zoom multiple of a camera of the terminal equipment is larger than or equal to a preset threshold value, the terminal equipment acquires a target image in a preview interface of the camera.
In an embodiment of the present invention, the zooming may include: optical zoom, digital zoom, and telephoto zoom.
Illustratively, the terminal device may zoom in a distant scene at the time of shooting by increasing the zoom factor of the camera to capture a high-quality distant image. In the embodiment of the present invention, when a user performs shooting, the terminal device may automatically acquire the first zoom multiple of the camera, and when the first zoom multiple of the camera is greater than or equal to a predetermined threshold (for example, the zoom multiple is 3 times), it may be considered that the camera of the terminal device enters a telephoto shooting mode, and the terminal device acquires a target image in a preview interface of the camera.
Step 202: and the terminal equipment identifies the target image, and if the target image is identified to contain preset privacy information, the terminal equipment blurs a target area in the target image.
In the embodiment of the present invention, the target area is an area where preset privacy information is located, and the terminal device may determine the target area by obtaining coordinates of the preset privacy information in the target image.
For example, the preset privacy information may include: the payment codes (such as two-dimensional codes or bar codes) of customers in stores and the payment passwords of customers in stores can be set according to actual requirements, but the invention is not limited to the above.
For example, the terminal device may utilize a blurring algorithm to blur the target region in the target image, and it is understood that blurring the target region in the target image is to blur the target region in the target image.
Illustratively, the above-mentioned blurring algorithm includes at least one of: the gaussian fuzzy filtering algorithm, the mean fuzzy filtering algorithm and the laplacian fuzzy filtering algorithm can be set according to actual requirements, and the method is not limited to this.
For example, when the user adjusts the first zoom multiple of the camera of the terminal device to 5 times and greater than the zoom multiple to 3 times (i.e., the predetermined threshold value mentioned above), at this time, as shown in fig. 3, the terminal device acquires an image of a distant building in the preview interface of the camera (i.e., the target image mentioned above, as shown in fig. 3, 31 in fig. 3), and when the terminal device recognizes that a householder wearing the householder (i.e., the preset privacy information mentioned above) is displayed in the image 31, as shown in fig. 4, the terminal device blurs an area (i.e., the target area mentioned above, as shown in fig. 4) in the image (i.e., 41 in fig. 4) of the distant building acquired by the camera by the householder using a gaussian fuzzy filtering algorithm. In fig. 4, the hatching at 42 is used to indicate blurring.
In addition, the terminal device may exit the long-distance shooting mode after recognizing that the target image contains the preset privacy information. For example, the terminal device may adjust the first zoom factor of the camera. Wherein the adjusted zoom factor is less than the predetermined threshold. It can be considered that the terminal device has exited the telephoto mode, at which time no further processing is performed on the target image as described above.
Optionally, in the embodiment of the present invention, the terminal device may adjust the blurring degree of the target area in the target image according to the first zoom multiple.
Illustratively, the step 202 includes the following steps 202 a:
step 202 a: the terminal equipment determines a target fuzzy multiple corresponding to the first zooming multiple of the camera.
Step 202 b: and the terminal equipment blurring a target area in the target image according to the target blurring multiple.
In one example, the blur multiple of the image of the target area in the target image is proportional to the first zoom multiple of the camera.
For example, assuming that the terminal device uses a gaussian blur filtering algorithm to blur the target region in the target image, the blur multiple may be adjusted by the size of a gaussian blur kernel, and the blur multiple is proportional to the first zoom multiple of the camera, and it can be understood that the size of the gaussian blur kernel is proportional to the first zoom multiple of the camera, that is, the larger the first zoom multiple is, the larger the corresponding gaussian blur kernel is, the larger the degree of blurring the target region is.
According to the image processing method provided by the embodiment of the invention, under the condition that the first zoom multiple of the camera of the terminal equipment is larger than or equal to the preset threshold value, the terminal equipment acquires the target image in the preview interface of the camera and identifies the target image, and under the condition that the target image is identified to contain the preset privacy information, the terminal equipment prevents the privacy information of others from being leaked unintentionally or maliciously in the process of long-distance shooting by blurring the area where the preset privacy information is located in the target image.
Optionally, in the embodiment of the present invention, in a case that the target image includes preset privacy information, the terminal device may further remind or warn the user that the target image includes the preset privacy information in another manner.
Illustratively, if the terminal device recognizes that the target image contains preset privacy information, the method further includes the following step 203:
step 203: the terminal equipment sends out warning information.
For example, the warning message may include: a vibration warning signal and/or a text warning message. For example, when the terminal device recognizes that the target image contains the preset privacy information, the terminal device controls the terminal device to vibrate (i.e., the vibration warning signal described above), and displays "the image contains the privacy information" (i.e., the text warning information described above) on the screen.
Therefore, the terminal equipment can directly remind the user that the target image contains the preset privacy information in a vibration and character mode.
For example, if the terminal device recognizes that the target image contains the preset privacy information, the terminal device blurs the target area in the target image and the terminal device sends out the warning information without an obvious sequence in the execution process. The terminal device may send the warning message before blurring the target area in the target image, or the terminal device may send the warning message while blurring the target area in the target image, or the terminal device may send the warning message after blurring the target area in the target image, which is not limited in this embodiment of the present invention.
In an example, after the terminal device sends out a vibration warning signal to remind a user that a target image contains preset privacy information, the user may manually switch a shooting scene, and at this time, the terminal device may reacquire an image in a preview interface of the camera, where the image is the target image.
Optionally, in the embodiment of the present invention, in a case that the terminal device virtualizes the target area, the terminal device may exit the long-distance shooting mode, and the remote shooting mode may be implemented by at least two possible implementation manners.
Illustratively, the method further comprises the following step 204 in the above step:
step 204: and the terminal equipment adjusts the first zooming multiple of the camera to be a second zooming multiple.
And the adjusted second zoom multiple is smaller than the preset threshold value.
In a first possible implementation, the terminal device may actively focus. And after blurring the target area, the terminal equipment directly performs focusing according to a preset second zoom multiple (smaller than the preset threshold), namely the terminal equipment exits from the long-distance shooting and does not perform blurring on the target image any more.
In a second possible implementation, the user may manually focus. After the terminal device virtualizes the target area, the user may manually lower a first zoom multiple of a camera of the terminal device, and at this time, when a second zoom multiple obtained by the terminal device is smaller than a predetermined threshold, the terminal device may be considered to have exited the long-distance shooting mode, and at this time, the terminal device does not perform virtualization processing on the target image, that is, the terminal device enters normal shooting.
It should be noted that, if the zoom factor is proportional to the blurring degree, in the process of manually lowering the first zoom factor of the camera of the terminal device by the user, the blurring degree of the target area by the terminal device may be reduced as the zoom factor becomes smaller until the terminal device does not perform blurring processing on the target image any more.
Optionally, the target image is identified, and if the target image is identified to contain the preset privacy information, the zoom multiple of the camera may be directly reduced, that is, the first zoom multiple is reduced to a second zoom multiple, and the second zoom multiple is smaller than a predetermined threshold, so that the target area where the preset privacy information is located may not be blurred.
Optionally, in the embodiment of the present invention, after the terminal device acquires the target image currently acquired by the camera, it is required to identify whether the target image includes preset privacy information.
Illustratively, the step 202 specifically includes the following step a 1:
step A1: and the terminal equipment adopts an image detection model to identify the target image to obtain an identification result.
In an embodiment of the present invention, the recognition result is used to indicate whether the target image includes preset privacy information.
Further optionally, in an embodiment of the present invention, before the step a1, the method further includes the following step a 2:
step A2: and the terminal equipment trains the image detection model according to the training samples in the training sample library.
In an embodiment of the present invention, the training sample library includes at least one training sample, and each of the at least one training sample includes preset privacy information.
For example, the training sample may be an image captured by a terminal device (e.g., a camera, a mobile phone, etc.) having an image capturing function.
Illustratively, after the terminal device identifies the target image in step 202, the method further includes the following step B1:
step B1: and if the terminal equipment identifies that the target image contains preset privacy information, the terminal equipment takes the target image as a training sample and stores the training sample into the training sample library.
Illustratively, the terminal device recognizes that the target image contains preset privacy information, and the target image can be stored in a sample library, so that training samples in the training sample library can be enriched, and the accuracy of the recognition result of the image detection model can be improved.
In an example, when the recognition result obtained by the image detection model recognizing the target image is incorrect (for example, the target image includes the preset privacy information, but the recognition result indicates that the preset privacy information is not included), at this time, the target image may be used as a training sample, stored in the training sample library, and the image detection model is retrained with the training sample in the supplemented training sample library, so as to improve the accuracy of the recognition result obtained by the image detection model recognizing the target image.
Fig. 5 is a schematic diagram of a possible structure of a terminal device according to an embodiment of the present invention, and as shown in fig. 5, the terminal device 600 includes: an obtaining module 601, an identifying module 602, and a blurring module 603, wherein:
the obtaining module 601 is configured to obtain a target image in a preview interface of a camera of the terminal device when a first zoom multiple of the camera is greater than or equal to a predetermined threshold.
An identifying module 602, configured to identify the target image acquired by the acquiring module.
A blurring module 603, configured to blur a target area in the target image if the identification module 602 identifies that the target image includes preset privacy information, where the target area is an area where the preset privacy information is located.
Optionally, as shown in fig. 5, the terminal device further includes: a conditioning module 604, wherein: the adjusting module 604 is configured to adjust a first zoom multiple of the camera to be a second zoom multiple, where the second zoom multiple is smaller than the predetermined threshold.
Optionally, the identifying module 602 is specifically configured to identify the target image acquired by the acquiring module 601 by using an image detection model to obtain an identification result, where the identification result is used to indicate whether the target image includes preset privacy information.
Optionally, as shown in fig. 5, the terminal device further includes: a training module 605 and a storage module 606, wherein: the training module 605 is configured to train the image detection model according to the training samples in the training sample library; the training sample library comprises at least one training sample, and each training sample in the at least one training sample contains preset privacy information. The storage module 606 is configured to, if it is identified that the target image includes preset privacy information, store the target image acquired by the acquisition module 601 as a training sample in the training sample library.
Optionally, as shown in fig. 5, the terminal device further includes: a determination module 607, wherein: the determining module 607 is configured to determine a target blur multiple corresponding to the first zoom multiple; the blurring module 602 is specifically configured to blur a target area in the target image according to the target blur multiple determined by the determining module 607.
Optionally, as shown in fig. 5, the terminal device further includes: a sending module 608, wherein: the sending module 608 is configured to send out a warning message.
According to the terminal device provided by the embodiment of the invention, under the condition that the first zoom multiple of the camera of the terminal device is larger than or equal to the preset threshold value, the terminal device acquires the target image in the preview interface of the camera and identifies the target image, and under the condition that the target image is identified to contain the preset privacy information, the terminal device avoids the unintentional or malicious disclosure of the privacy information of others in the process of long-distance shooting by blurring the area where the preset privacy information is located in the target image.
The terminal device provided by the embodiment of the present invention can implement each process implemented by the terminal device in the above method embodiments, and is not described here again to avoid repetition.
Fig. 6 is a schematic diagram of a hardware structure of a terminal device for implementing various embodiments of the present invention, where the terminal device 100 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the configuration of the terminal device 100 shown in fig. 6 does not constitute a limitation of the terminal device, and that the terminal device 100 may include more or less components than those shown, or combine some components, or arrange different components. In the embodiment of the present invention, the terminal device 100 includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, a pedometer, and the like.
The processor 110 is configured to acquire a target image in a preview interface of a camera of the terminal device when a first zoom multiple of the camera is greater than or equal to a predetermined threshold; and the target image processing module is also used for identifying the target image, and if the target image is identified to contain the preset privacy information, blurring a target area in the target image, wherein the target area is an area where the preset privacy information is located.
According to the terminal device provided by the embodiment of the invention, under the condition that the zoom multiple of the first camera of the terminal device is greater than or equal to the preset threshold value, the terminal device acquires the target image in the preview interface of the camera and identifies the target image, and under the condition that the target image is identified to contain the preset privacy information, the terminal device avoids the unintentional or malicious disclosure of the privacy information of others in the process of long-distance shooting by blurring the area where the preset privacy information is located in the target image.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.
The terminal device 100 provides the user with wireless broadband internet access via the network module 102, such as helping the user send and receive e-mails, browse web pages, and access streaming media.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the terminal device 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.
The input unit 104 is used to receive an audio or video signal. The input unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.
The terminal device 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the terminal device 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the terminal device posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration identification related functions (such as pedometer, tapping), and the like; the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-emitting diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal device 100. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 6, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the terminal device 100, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the terminal device 100, and is not limited herein.
The interface unit 108 is an interface for connecting an external device to the terminal apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the terminal apparatus 100 or may be used to transmit data between the terminal apparatus 100 and the external device.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 110 is a control center of the terminal device 100, connects various parts of the entire terminal device 100 by various interfaces and lines, and performs various functions of the terminal device 100 and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the terminal device 100. Processor 110 may include one or more processing units; alternatively, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The terminal device 100 may further include a power supply 111 (such as a battery) for supplying power to each component, and optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the terminal device 100 includes some functional modules that are not shown, and are not described in detail here.
Optionally, an embodiment of the present invention further provides a terminal device, which includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor 110, where the computer program, when executed by the processor, implements each process of the above-mentioned image processing method embodiment, and can achieve the same technical effect, and details are not repeated here to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (12)
1. An image processing method, characterized in that the method comprises:
under the condition that a first zoom multiple of a camera of a terminal device is larger than or equal to a preset threshold value, acquiring a target image in a preview interface of the camera;
identifying the target image, and blurring a target area in the target image if the target image is identified to contain preset privacy information, wherein the target area is an area where the preset privacy information is located;
after the blurring the target region in the target image, the method further comprises:
adjusting a first zoom multiple of the camera to be a second zoom multiple, wherein the second zoom multiple is smaller than the preset threshold value; and under the condition that the camera is in the second zoom multiple, the terminal equipment exits from the long-distance shooting.
2. The method of claim 1, wherein the identifying the target image comprises:
and identifying the target image by adopting an image detection model to obtain an identification result, wherein the identification result is used for indicating whether the target image contains the preset privacy information.
3. The method according to claim 2, wherein before the identifying the target image by using the image detection model and obtaining the identification result, the method further comprises:
training the image detection model according to training samples in a training sample library; the training sample library comprises at least one training sample, and each training sample in the at least one training sample contains the preset privacy information;
after the identifying the target image, the method further comprises:
and if the target image is identified to contain the preset privacy information, the target image is used as a training sample and is stored in the training sample library.
4. The method of claim 1, wherein blurring the target region in the target image comprises:
determining a target blur multiple corresponding to the first zoom multiple;
and blurring a target area in the target image according to the target blurring multiple.
5. The method of claim 1, wherein if the target image is identified to contain predetermined privacy information, the method further comprises:
and sending out warning information.
6. A terminal device, characterized in that the terminal device comprises:
the acquisition module is used for acquiring a target image in a preview interface of a camera of the terminal equipment under the condition that a first zoom multiple of the camera is larger than or equal to a preset threshold value;
the identification module is used for identifying the target image acquired by the acquisition module;
the blurring module is used for blurring a target area in the target image if the identification module identifies that the target image contains preset privacy information, wherein the target area is an area where the preset privacy information is located;
the adjusting module is used for adjusting a first zooming multiple of the camera to be a second zooming multiple, and the second zooming multiple is smaller than the preset threshold value; and under the condition that the camera is in the second zoom multiple, the terminal equipment exits from the long-distance shooting.
7. The terminal device of claim 6,
the identification module is specifically configured to identify the target image acquired by the acquisition module by using an image detection model to obtain an identification result, where the identification result is used to indicate whether the target image includes the preset privacy information.
8. The terminal device according to claim 7, wherein the terminal device further comprises: training module and storage module, wherein:
the training module is used for training the image detection model according to training samples in a training sample library; the training sample library comprises at least one training sample, and each training sample in the at least one training sample contains the preset privacy information;
and the storage module is used for taking the target image identified by the identification module as a training sample and storing the training sample into the training sample library if the target image is identified to contain the preset privacy information.
9. The terminal device according to claim 6, wherein the terminal device further comprises: a determination module, wherein:
the determining module is used for determining a target fuzzy multiple corresponding to the first zooming multiple;
the blurring module is specifically configured to blur a target region in the target image according to the target blur multiple determined by the determining module.
10. The terminal device according to claim 6, wherein the terminal device further comprises: a sending module, wherein:
and the sending module is used for sending out warning information.
11. A terminal device, characterized in that it comprises a processor, a memory and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, implements the steps of the image processing method according to any one of claims 1 to 5.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the image processing method according to any one of claims 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910907111.3A CN110719402B (en) | 2019-09-24 | 2019-09-24 | Image processing method and terminal equipment |
| PCT/CN2020/106777 WO2021057267A1 (en) | 2019-09-24 | 2020-08-04 | Image processing method and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910907111.3A CN110719402B (en) | 2019-09-24 | 2019-09-24 | Image processing method and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110719402A CN110719402A (en) | 2020-01-21 |
| CN110719402B true CN110719402B (en) | 2021-07-06 |
Family
ID=69210032
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910907111.3A Active CN110719402B (en) | 2019-09-24 | 2019-09-24 | Image processing method and terminal equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110719402B (en) |
| WO (1) | WO2021057267A1 (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110719402B (en) * | 2019-09-24 | 2021-07-06 | 维沃移动通信（杭州）有限公司 | Image processing method and terminal equipment |
| CN111339831B (en) * | 2020-01-23 | 2023-08-18 | 深圳市大拿科技有限公司 | Lighting lamp control method and system |
| CN113742183A (en) * | 2020-05-29 | 2021-12-03 | 青岛海信移动通信技术股份有限公司 | Screen recording method, terminal and storage medium |
| CN112040145B (en) * | 2020-08-28 | 2023-04-07 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| CN112257123A (en) * | 2020-09-07 | 2021-01-22 | 西安万像电子科技有限公司 | Image processing method and system |
| CN112057874A (en) * | 2020-09-10 | 2020-12-11 | 重庆五诶科技有限公司 | Game auxiliary system and method with privacy protection function |
| CN112182648A (en) * | 2020-09-18 | 2021-01-05 | 支付宝(杭州)信息技术有限公司 | Privacy image and face privacy processing method, device and equipment |
| CN114815638A (en) * | 2021-08-25 | 2022-07-29 | 北京京东方技术开发有限公司 | Device configuration method, electronic apparatus, and computer-readable storage medium |
| CN113987602A (en) * | 2021-10-28 | 2022-01-28 | 维沃移动通信有限公司 | Image data processing method and electronic equipment |
| CN114463264A (en) * | 2021-12-28 | 2022-05-10 | 浙江大华技术股份有限公司 | Privacy protection method and device in high-altitude parabolic monitoring |
| CN114692202A (en) * | 2022-03-31 | 2022-07-01 | 马上消费金融股份有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN117135307A (en) * | 2022-08-08 | 2023-11-28 | 惠州Tcl移动通信有限公司 | Camera monitoring method and device |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100771137B1 (en) * | 2005-02-21 | 2007-10-30 | 삼성전자주식회사 | Observation System capable of masking privacy zone and method to setting masking zone |
| JP5088161B2 (en) * | 2008-02-15 | 2012-12-05 | ソニー株式会社 | Image processing apparatus, camera apparatus, communication system, image processing method, and program |
| JP5637633B2 (en) * | 2010-07-06 | 2014-12-10 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ | Image distribution device |
| EP2771865A4 (en) * | 2011-10-25 | 2015-07-08 | Sony Corp | Image processing apparatus, method and computer program product |
| JP6687488B2 (en) * | 2015-12-24 | 2020-04-22 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ | Unmanned aerial vehicle and control method thereof |
| CN105653041A (en) * | 2016-01-29 | 2016-06-08 | 北京小米移动软件有限公司 | Display state adjusting method and device |
| US9848167B1 (en) * | 2016-06-21 | 2017-12-19 | Amazon Technologies, Inc. | Low bandwidth video |
| JP6910772B2 (en) * | 2016-09-08 | 2021-07-28 | キヤノン株式会社 | Imaging device, control method and program of imaging device |
| CN106803930A (en) * | 2017-02-10 | 2017-06-06 | 上海斐讯数据通信技术有限公司 | A kind of intelligent video monitoring method and intelligent router based on router |
| CN107122679A (en) * | 2017-05-16 | 2017-09-01 | 北京小米移动软件有限公司 | Image processing method and device |
| CN109413323A (en) * | 2017-08-15 | 2019-03-01 | 联发科技（新加坡）私人有限公司 | Image processing method, photographing device and storage medium |
| CN107958161A (en) * | 2017-11-30 | 2018-04-24 | 维沃移动通信有限公司 | A kind of multitask display methods and mobile terminal |
| CN108366196B (en) * | 2018-01-25 | 2020-09-01 | 西安中科创达软件有限公司 | Method for protecting picture privacy |
| CN108848334A (en) * | 2018-07-11 | 2018-11-20 | 广东小天才科技有限公司 | A kind of method, apparatus, terminal and the storage medium of video processing |
| CN109040594B (en) * | 2018-08-24 | 2020-12-18 | 创新先进技术有限公司 | Photographing method and device |
| CN110719402B (en) * | 2019-09-24 | 2021-07-06 | 维沃移动通信（杭州）有限公司 | Image processing method and terminal equipment |
-
2019
- 2019-09-24 CN CN201910907111.3A patent/CN110719402B/en active Active
-
2020
- 2020-08-04 WO PCT/CN2020/106777 patent/WO2021057267A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021057267A1 (en) | 2021-04-01 |
| CN110719402A (en) | 2020-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110719402B (en) | Image processing method and terminal equipment | |
| CN110913132B (en) | Object tracking method and electronic equipment | |
| CN110891144B (en) | Image display method and electronic equipment | |
| CN109743498B (en) | Shooting parameter adjusting method and terminal equipment | |
| CN110062105B (en) | Interface display method and terminal equipment | |
| CN110896451B (en) | Preview picture display method, electronic device and computer readable storage medium | |
| CN109032445B (en) | Screen display control method and terminal equipment | |
| CN110769155B (en) | Camera control method and electronic equipment | |
| CN109857494B (en) | Message prompting method and terminal equipment | |
| CN110058836B (en) | Audio signal output method and terminal equipment | |
| CN111142991A (en) | Application function page display method and electronic equipment | |
| CN108307106B (en) | Image processing method and device and mobile terminal | |
| CN110752981B (en) | Information control method and electronic equipment | |
| CN109523253B (en) | Payment method and device | |
| CN111401463B (en) | Method for outputting detection result, electronic equipment and medium | |
| CN110830713A (en) | Zooming method and electronic equipment | |
| CN110944113B (en) | Object display method and electronic equipment | |
| CN109104573B (en) | Method for determining focusing point and terminal equipment | |
| CN110012151B (en) | Information display method and terminal equipment | |
| CN109992192B (en) | Interface display method and terminal equipment | |
| CN110908750A (en) | Screen capturing method and electronic equipment | |
| CN110769162B (en) | Electronic equipment and focusing method | |
| CN111026263B (en) | Audio playing method and electronic equipment | |
| CN111246105B (en) | Photographing method, electronic device, and computer-readable storage medium | |
| CN111147754B (en) | Image processing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |