CN112950443A - Adaptive privacy protection method, system, device and medium based on image sticker - Google Patents
Adaptive privacy protection method, system, device and medium based on image sticker Download PDFInfo
- Publication number
- CN112950443A CN112950443A CN202110162662.9A CN202110162662A CN112950443A CN 112950443 A CN112950443 A CN 112950443A CN 202110162662 A CN202110162662 A CN 202110162662A CN 112950443 A CN112950443 A CN 112950443A
- Authority
- CN
- China
- Prior art keywords
- image
- privacy
- sticker
- protected
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 230000003044 adaptive effect Effects 0.000 title claims description 56
- 230000006978 adaptation Effects 0.000 claims abstract description 18
- 238000010801 machine learning Methods 0.000 claims description 32
- 238000012549 training Methods 0.000 claims description 27
- 230000001960 triggered effect Effects 0.000 claims description 16
- 230000004927 fusion Effects 0.000 claims description 6
- 238000005516 engineering process Methods 0.000 description 12
- 238000012545 processing Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 3
- 238000007796 conventional method Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007499 fusion processing Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012821 model calculation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
- G06T1/0028—Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
- G06T1/0035—Output size adaptive watermarking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Image Processing (AREA)
Abstract
The invention relates to the technical field of image privacy protection, and discloses a self-adaptive privacy protection method and system based on image stickers, terminal equipment and a computer storage medium. The self-adaptive privacy protection method based on the image paster determines an image to be protected and identifies privacy content in the image to be protected; acquiring display parameters of the privacy content, and obtaining a target image sticker according to the display parameter adaptation; and shielding the privacy content according to the target image paster. Compared with the traditional mode of protecting the privacy content in the image based on manual operation, the method and the device can automatically identify the privacy content needing to be protected in the image, and adaptively match the image paster capable of covering the privacy content, so that the image paster is used for shielding the privacy content to realize privacy protection, manual operation of a user is not needed, the privacy content can be more accurately shielded, and the efficiency of image privacy protection is improved.
Description
Technical Field
The invention relates to the technical field of image privacy protection, in particular to an image sticker-based adaptive privacy protection method, an image sticker-based adaptive privacy protection system, terminal equipment and a computer storage medium.
Background
With the development of computer technology, especially with the development of computer network technology, more and more image data containing personal privacy content will be collected, crawled and transmitted in the network inadvertently, and the personal privacy security of people is not threatened by malicious disclosure anytime and anywhere.
In the prior art, a plurality of similar ways for protecting the privacy content by performing processes such as coding and shielding on image content exist, but all of the ways often require manual operation to select the privacy content to be processed in the image, and in many cases, when the privacy content is selected by manual operation, the problem that the adjustment of the image is complicated and the user cannot accurately select the privacy content is very easy to occur, and in addition, when the privacy content protection is required to be performed on a large amount of image data, the manual selection of the privacy content by the user is very difficult to realize.
In summary, the conventional method for protecting the privacy content in the image based on manual operation is complex to operate and poor in accuracy, which results in low efficiency of image privacy protection.
Disclosure of Invention
The invention mainly aims to provide a self-adaptive privacy protection method, a self-adaptive privacy protection system, terminal equipment and a computer storage medium based on image stickers, and aims to solve the technical problem that the image privacy protection efficiency is low due to complicated operation and poor accuracy of the conventional method for protecting the privacy content in an image based on manual operation.
In order to achieve the above object, the present invention provides an adaptive privacy protection method based on an image sticker, including:
determining an image to be protected and identifying privacy content in the image to be protected;
acquiring display parameters of the privacy content, and obtaining a target image sticker according to the display parameter adaptation;
and shielding the privacy content according to the target image paster.
Optionally, the display parameter includes a first display size, and the step of obtaining the target image sticker according to the display parameter includes:
according to the first display size, all image stickers to be selected with the same display size are matched from all preset image stickers;
receiving a first selection instruction triggered based on each image paster to be selected, and taking a first image paster to be selected associated with the first selection instruction as a target image paster, wherein the number of the first image pasters to be selected is greater than or equal to one.
Optionally, the step of obtaining the target image sticker according to the display parameter adaptation further includes:
receiving a second selection instruction triggered based on all preset image stickers;
detecting whether the first display size is the same as a second display size of a second image paster to be selected associated with the second selection instruction, wherein the number of the second image pasters to be selected is greater than or equal to one;
if so, taking the second image paster to be selected as a target image paster;
and if not, adjusting the second display size of the second image paster to be selected according to the first display size, and taking the adjusted second image paster to be selected as the target image paster.
Optionally, the display parameter further includes a display position, and the step of blocking the private content according to the target image sticker includes:
generating an upper layer blank image of the image to be protected, and determining a corresponding position of the display position on the upper layer blank image;
and generating the target image paster at the corresponding position to shield the privacy content.
Optionally, after the determining the corresponding position of the display position on the upper blank image, further includes:
and moving the target image sticker from a preset region to be selected to the corresponding position so as to shield the privacy content.
Optionally, the step of determining an image to be protected and identifying privacy content in the image to be protected includes:
and calling a preset image privacy recognition model to recognize the privacy content in the image to be protected, wherein the image privacy recognition model is obtained by performing machine learning training according to image sample data.
Optionally, the adaptive privacy protection method based on image stickers further includes:
transmitting model parameters obtained by local machine learning training based on image sample data to a preset federal server, wherein the preset federal server is connected with a plurality of terminal devices;
and receiving an image privacy recognition model fed back by the preset federated server after fusion based on the model parameters uploaded by each terminal device, so as to recognize the privacy content based on the image privacy recognition model.
In addition, to achieve the above object, the present invention further provides an adaptive privacy protection system based on an image sticker, including:
the privacy identification module is used for determining an image to be protected and identifying privacy content in the image to be protected;
the sticker adaptation module is used for acquiring the display parameters of the privacy content and obtaining a target image sticker according to the display parameter adaptation;
and the privacy protection module is used for shielding the privacy content according to the target image sticker.
In addition, to achieve the above object, the present invention also provides a terminal device, including: a memory, a processor, and an image-sticker-based adaptive privacy preserving program stored on the memory and executable on the processor, the image-sticker-based adaptive privacy preserving program, when executed by the processor, implementing the steps of the image-sticker-based adaptive privacy preserving method as described above.
Further, to achieve the above object, the present invention also provides a computer storage medium having stored thereon an adaptive privacy protecting program based on an image-sticker, which when executed by a processor, implements the steps of the adaptive privacy protecting method based on an image-sticker as described above.
The invention provides a self-adaptive privacy protection method, a self-adaptive privacy protection system, terminal equipment and a computer storage medium based on image stickers, which are characterized in that an image to be protected is determined and privacy contents in the image to be protected are identified; acquiring display parameters of the privacy content, and obtaining a target image sticker according to the display parameter adaptation; and shielding the privacy content according to the target image paster.
Under the condition that a user needs to process image data so as to protect privacy content, terminal equipment automatically determines an image to be protected, which needs to be subjected to privacy protection currently, of the user, automatically identifies the privacy content, which needs to be protected, of the image to be protected, then obtains display parameters of the identified privacy content, adaptively matches a target image sticker for covering the privacy content based on the display parameters, and finally shields the privacy content according to the target image sticker so as to prevent the privacy content from being leaked along with the output display of the image.
Compared with the traditional mode of protecting the privacy content in the image based on manual operation, the method and the device can automatically identify the privacy content needing to be protected in the image, and adaptively match the image paster capable of covering the privacy content, so that the privacy content is shielded by using the image paster to realize privacy protection, the privacy content in the image is selected without manual operation of a user, the privacy content in the image can be more accurately shielded, and the efficiency of image privacy protection is greatly improved.
Drawings
FIG. 1 is a schematic diagram of an apparatus architecture of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a first embodiment of a method for adaptive privacy protection based on image stickers according to the present invention;
FIG. 3 is a functional block diagram of an embodiment of the adaptive privacy preserving system based on image stickers according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic device structure diagram of a hardware operating environment according to an embodiment of the present invention.
The terminal device according to the embodiment of the present invention may be a device serving as a message middleware system in a production consumption model, and the device may be a PC (Personal Computer), a tablet Computer, a portable Computer, or the like.
As shown in fig. 1, the terminal device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal device configuration shown in fig. 1 is not intended to be limiting of the terminal device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an adaptive privacy securing program based on an image sticker.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client and performing data communication with the client; and the processor 1001 may be configured to invoke the adaptive privacy preserving program based on image stickers stored in the memory 1005 and perform the following operations:
determining an image to be protected and identifying privacy content in the image to be protected;
acquiring display parameters of the privacy content, and obtaining a target image sticker according to the display parameter adaptation;
and shielding the privacy content according to the target image paster.
Further, the display parameter comprises a first display size, and the processor 1001 may call the adaptive privacy protection program based on image sticker stored in the memory 1005, and further perform the following operations:
according to the first display size, all image stickers to be selected with the same display size are matched from all preset image stickers;
receiving a first selection instruction triggered based on each image paster to be selected, and taking a first image paster to be selected associated with the first selection instruction as a target image paster, wherein the number of the first image pasters to be selected is greater than or equal to one.
Further, the processor 1001 may call the adaptive privacy protection program based on image sticker stored in the memory 1005, and also perform the following operations:
receiving a second selection instruction triggered based on all preset image stickers;
detecting whether the first display size is the same as a second display size of a second image paster to be selected associated with the second selection instruction, wherein the number of the second image pasters to be selected is greater than or equal to one;
if so, taking the second image paster to be selected as a target image paster;
and if not, adjusting the second display size of the second image paster to be selected according to the first display size, and taking the adjusted second image paster to be selected as the target image paster.
Further, the display parameters also include a display position, and the processor 1001 may call the adaptive privacy protection program based on the image sticker stored in the memory 1005, and further perform the following operations:
generating an upper layer blank image of the image to be protected, and determining a corresponding position of the display position on the upper layer blank image;
and generating the target image paster at the corresponding position to shield the privacy content.
Further, the processor 1001 may call the adaptive privacy protection program based on an image sticker stored in the memory 1005, and after performing the step of determining the corresponding position of the display position on the upper layer blank image, further perform the following operations:
and moving the target image sticker from a preset region to be selected to the corresponding position so as to shield the privacy content.
Further, the processor 1001 may call the adaptive privacy protection program based on image sticker stored in the memory 1005, and also perform the following operations:
and calling a preset image privacy recognition model to recognize the privacy content in the image to be protected, wherein the image privacy recognition model is obtained by performing machine learning training according to image sample data.
Further, the processor 1001 may call the adaptive privacy protection program based on image sticker stored in the memory 1005, and also perform the following operations:
transmitting model parameters obtained by local machine learning training based on image sample data to a preset federal server, wherein the preset federal server is connected with a plurality of terminal devices;
and receiving an image privacy recognition model fed back by the preset federated server after fusion based on the model parameters uploaded by each terminal device, so as to recognize the privacy content based on the image privacy recognition model.
Based on the hardware structure, the invention provides various embodiments of the image sticker-based adaptive privacy protection method.
It should be noted that, with the development of computer technology, especially with the development of computer network technology, more and more image data containing personal privacy content will be collected, crawled and transmitted in the network inadvertently, and the personal privacy security of people will not be threatened by malicious disclosure anytime and anywhere.
In the prior art, a plurality of similar ways for protecting the privacy content by performing processes such as coding and shielding on image content exist, but all of the ways often require manual operation to select the privacy content to be processed in the image, and in many cases, when the privacy content is selected by manual operation, the problem that the adjustment of the image is complicated and the user cannot accurately select the privacy content is very easy to occur, and in addition, when the privacy content protection is required to be performed on a large amount of image data, the manual selection of the privacy content by the user is very difficult to realize.
In summary, the conventional method for protecting the privacy content in the image based on manual operation is complex to operate and poor in accuracy, which results in low efficiency of image privacy protection.
Aiming at the phenomenon, the invention provides an adaptive privacy protection method based on an image sticker. Referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of an adaptive privacy protection method based on an image sticker according to the present invention.
In this embodiment, the adaptive privacy protection method based on image stickers includes:
step S10, determining an image to be protected and identifying privacy content in the image to be protected;
the method comprises the steps that in the process that a user processes image data so as to protect privacy contents, a terminal device determines images to be protected, wherein the images need to be protected by the user, and the determined images to be protected are identified so as to identify the privacy contents, which are required to be protected by the user, in the images to be protected.
It should be noted that, in this embodiment, the terminal device may employ any image recognition processing technology to recognize the determined image to be protected, which needs to be subjected to privacy protection by the user, so as to obtain the privacy content in the image to be protected, it should be understood that, based on different design requirements of practical applications, in different feasible embodiments, the terminal device may of course employ different or the same image recognition processing technology, and this embodiment is not specifically limited to the process of recognizing the privacy content in the image to be protected by the terminal device.
Specifically, for example, the user currently needs to perform privacy protection with respect to the face image of the other person other than the own face image among the images output and displayed on the screen of the terminal device, therefore, the terminal equipment directly uses the image data output and displayed by the front-end screen at the current moment as the image to be protected, which needs privacy protection currently, based on the privacy protection instruction triggered by the fact that the user touches and clicks the specific instruction control, then, calling a mature image recognition processing technology to recognize the image to be protected so as to recognize all face images in the image to be protected, and compares the whole face image with the face image of the user recorded in advance one by one, therefore, all face images except the face image of the user are used as privacy content needing to be protected.
Further, in a possible embodiment, in addition to the "step S10, determining the image to be protected and identifying the private content in the image to be protected" being performed by the terminal device based on the user-triggered privacy protection instruction in real time at the current time, the terminal device may also perform the "step S10, determining the image to be protected and identifying the private content in the image to be protected" automatically in the background during the idle time based on another privacy protection instruction.
Specifically, for example, the user may automatically perform a privacy protection instruction for performing privacy protection on all or part of the image in the gallery when the configuration terminal device is triggered to be idle, therefore, the terminal device can automatically read the image data appointed by the user in the gallery as the image to be protected when the system does not perform other operation consuming system resources, then calling mature image recognition processing technology one by one to recognize the image to be protected so as to recognize all face images in the image to be protected, and compares the whole face image with the face image of the user recorded in advance one by one, therefore, all the face images except the face image of the user are used as the privacy content to be protected, then, the subsequent image privacy protection operation such as sticker adaptation is automatically performed based on the privacy content.
Step S20, obtaining the display parameters of the privacy content, and obtaining a target image sticker according to the display parameters in an adaptive manner;
after the terminal equipment determines an image to be protected and identifies the image to be protected to obtain privacy content to be protected by a user in the image to be protected, the terminal equipment obtains display parameters of the privacy content, and then matches out a target image sticker capable of covering the privacy content from all preset image stickers in a self-adaptive mode based on the display parameters.
It should be noted that, in this embodiment, the terminal may employ any feasible image recognition processing technology to recognize and obtain the display parameter of the privacy content from the image to be protected, and the adaptive privacy protection method based on the image sticker of the present invention is not specifically limited to the process of the terminal device employing the image recognition processing technology to obtain the display parameter of the privacy content in the image to be protected.
Further, in a possible embodiment, the display parameter includes a first display size, and the step of "obtaining the target image sticker according to the display parameter adaptation" in the step S20 may include:
step S201, according to the first display size, matching all image stickers to be selected with the same display size from all preset image stickers;
it should be noted that, in this embodiment, the preset all image stickers are stickers that are automatically generated by the terminal device and have various display sizes smaller than the display size of the image to be protected, such as cartoon images, specific landscape photos, and the like, or the all image stickers may also be stickers that are formed by the user after the user personally sets the selected image and have a display size smaller than the display size of the image to be protected. It should be understood that, based on different design requirements of practical applications, the terminal device may automatically or based on user operations generate an image sticker in any content form for covering and blocking the privacy content in the image to be protected, and the adaptive privacy protection method based on the image sticker of the present invention is not specifically limited to the type, number, etc. of the image stickers.
The terminal equipment identifies and obtains a first display size of the determined privacy content from the image to be protected based on any image identification processing technology, and then, the terminal equipment automatically matches one or more image stickers to be selected, of which the display size is the same as the first display size, from all the generated image stickers by using the first display size, so that the privacy content can be covered and shielded.
Specifically, for example, in the determined image to be protected, the terminal device obtains, based on the image recognition processing, the respective first display sizes of all the other face images as privacy content to be protected, and then the terminal device matches the generated image stickers one by one to obtain a plurality of image stickers to be selected, each of which has a display size that is the same as the corresponding first display size.
Further, in another possible embodiment, the terminal device may further match, for the same privacy content, a plurality of image stickers with the same display size and the same display size as the first display size, but different images from each other, as the image stickers to be selected for the privacy content.
Step S202, receiving a first selection instruction triggered based on each image paster to be selected, and taking a first image paster to be selected associated with the first selection instruction as a target image paster, wherein the number of the first image pasters to be selected is greater than or equal to one.
The terminal equipment automatically matches one or more image stickers to be selected with the same display size as the first display size from all the image stickers by using the acquired first display size of the privacy content, then outputs and displays the one or more image stickers to be selected, receives a first selection instruction triggered by a user through selection based on the one or more image stickers to be selected, and then selects the associated first image sticker to be selected as a target image sticker for covering and shielding the current privacy content by using the first selection instruction.
Specifically, for example, after the terminal device matches a plurality of image stickers to be selected, each of which has a display size that is the same as the first display size of the corresponding other face image, one by one from all the generated image stickers, the terminal device outputs the output display images of the image stickers to be selected in a dialog box form for further selection or direct confirmation by the user, then the terminal device sequentially selects each target image sticker corresponding to the other face image as the privacy content through the dialog box, or selects a plurality of target image stickers corresponding to the other face images as the privacy content in batch at one time, and clicks the "confirmation" control to trigger generation of a first selection instruction after completion of selection, so that the terminal device can directly select the first image sticker specified in the first selection instruction after receiving the first selection instruction, the target image paster which corresponds to each other face image and can accurately cover and shield each other face image is used.
Further, in another possible embodiment, in addition to automatically outputting the matched image sticker to be selected with the display size being the same as the first display size of the private content to the user in the recommended form by the terminal device, the terminal device may obtain the target image sticker of the private content after adjusting the display parameters based on the image sticker actively selected by the user directly from all the image stickers.
In the step S20, the step of "obtaining the target image sticker according to the display parameter adaptation" may further include:
step S203, receiving a second selection instruction triggered based on all preset image stickers;
after the terminal equipment identifies and determines the privacy content which needs privacy protection currently from the images to be protected based on any image identification processing technology, the terminal equipment directly outputs and displays the privacy content to the user, synchronously outputs and displays all the generated image stickers to the user based on the selection frame of the image stickers, and receives a second selection instruction triggered by the user based on the selection frame to automatically select the image stickers.
Specifically, for example, after the terminal device identifies all face images except for the face image of the user as privacy content to be protected in the determined current image to be protected, directly generating marks at the respective display positions of all other face images in the image to be protected, outputting and displaying the marks, meanwhile, the terminal device also generates a selection frame of the image sticker (or generates the selection frame in a floating window form) in a specific area of the image to be protected, and outputs and displays all the image stickers that have been generated in the selection frame, so that the user can autonomously select the image paster of each other face image one by one based on the selection frame or select the image pasters of the other face images in batch at one time, and clicking the 'confirmation' control to trigger and generate a second selection instruction after the selection is finished, and receiving the second selection instruction by the terminal equipment.
It should be noted that, in this embodiment, after generating and outputting the mark at the display position of the private content in the image to be protected, the terminal device may further receive a mark erasing instruction generated by the user performing a selection operation based on the mark, so as to give up continuing to perform a subsequent privacy protection operation on the private content at the display position corresponding to the mark based on the mark erasing instruction.
Step S204, detecting whether the first display size is the same as a second display size of a second to-be-selected image paster associated with the second selection instruction, wherein the number of the second to-be-selected image pasters is greater than or equal to one;
step S205, if yes, the second image paster to be selected is used as a target image paster;
after receiving a second selection instruction triggered by a user to select an image sticker based on a selection frame, the terminal device determines one or more second image stickers to be selected, which are specified by the second selection instruction and used for covering and shielding the privacy content, then the terminal device detects whether the display sizes of the second image stickers to be selected are the same as the first display size of the privacy content one by one, and when detecting that the display sizes of the second image stickers to be selected are the same as the first display size of the privacy content, the terminal device directly determines the second image stickers to be selected as target image stickers capable of covering and shielding the privacy content.
And S206, if not, adjusting the second display size of the second to-be-selected image paster according to the first display size, and taking the adjusted second to-be-selected image paster as a target image paster.
In the process that the terminal device detects whether the display size of each second image sticker to be selected is the same as the first display size of the privacy content one by one, if the terminal device detects that the display size of the second image sticker to be selected is not the same as the first display size of the privacy content, the terminal device starts to perform adaptive adjustment on the second display size of the second image sticker to be selected, the second display size is directly adjusted to be the same as the first display size, and then the terminal device uses the second image sticker to be selected, which is adjusted to be the same as the first display size, as a target image sticker capable of accurately covering and shielding the corresponding privacy content.
And step S30, shielding the private content according to the target image paster.
The terminal equipment adaptively matches out a target image sticker capable of covering the privacy content from all preset image stickers based on the display parameters of the privacy content in the image to be protected, and then covers and shields the privacy content according to the target image sticker to protect the privacy.
Further, in a possible embodiment, the display parameter further includes a display position, and the step S30 may include:
step S301, generating an upper layer blank image of the image to be protected, and determining a corresponding position of the display position on the upper layer blank image;
after the terminal equipment adaptively matches out a target image sticker capable of covering the privacy content from all preset image stickers based on the display parameters of the privacy content in the image to be protected, firstly, an upper-layer blank image output on the upper layer of the current image to be protected is generated, the display position of the privacy content is determined, and the corresponding position of the upper-layer blank image is mapped.
Specifically, for example, after the terminal device determines that each of the other face images as the privacy content corresponds to a target image sticker capable of accurately covering and shielding each of the other face images, the terminal device further generates an upper layer blank image having a display size that is the same as the display size of the to-be-protected image to which each of the other face images belongs, outputs and displays the upper layer blank image on the upper layer of the to-be-protected image, and then maps the display position of each of the other face images on the current to-be-protected image to the upper layer blank image one by one to obtain each corresponding position.
Step S302, generating the target image paster at the corresponding position to shield the privacy content.
The method comprises the steps that the terminal equipment determines the display position of the private content in an upper-layer blank image of an image to be protected, and directly generates a determined target image sticker capable of accurately covering and shielding the private content at a corresponding position after mapping the display position of the private content at the corresponding position on the upper-layer blank image, so that the private content is protected based on the target image sticker.
Specifically, for example, after mapping the display positions of the other face images on the current image to be protected to the upper blank image one by one to obtain corresponding positions, the terminal device sequentially generates a target image sticker of the face image currently serving as the privacy content at each corresponding position, so that the target image sticker accurately covers and blocks the face image serving as the privacy content based on the same display size of the target image sticker and the face image, and when a user needs to use the image to be protected, the terminal device outputs the image to be protected and the upper blank image on which the target image sticker is generated together as a complete image, thereby protecting the privacy content in the current image to be protected.
Further, in another possible embodiment, after the step of "determining the corresponding position of the display position on the upper blank image" in the step S301, the method for adaptive privacy protection based on an image sticker according to the present invention may further include:
step S303, moving the target image sticker from a preset region to be selected to the corresponding position so as to shield the privacy content.
It should be noted that, in this embodiment, the preset region to be selected is a selection frame of the image sticker, where the terminal device generates all image stickers to be output and displayed to the user, so that the user can autonomously select the image stickers to trigger the second selection instruction.
The terminal equipment determines the display position of the privacy content in an upper-layer blank image of an image to be protected, after mapping the display position of the privacy content on the upper-layer blank image, the terminal equipment can also move a target image sticker of the privacy content selected by a user from a selection frame of a master image sticker and a slave image sticker to the corresponding position on the upper-layer blank image, starting from the display position of the target image sticker currently in the selection frame, according to the nearest (or other personalized) moving path between the display position and the corresponding position of the privacy content, and therefore the privacy content is accurately covered and shielded based on the target image sticker to protect the privacy content.
The embodiment of the invention provides an adaptive privacy protection method based on image stickers, which comprises the steps of determining an image to be protected, which needs privacy protection, of a user through terminal equipment in the process of protecting privacy contents by processing image data of the user, and identifying the determined image to be protected so as to identify the privacy contents, which need to be protected, of the image to be protected; the method comprises the steps that after a terminal device determines an image to be protected and identifies the image to be protected to obtain privacy content to be protected by a user in the image to be protected, the terminal device obtains display parameters of the privacy content, then a target image sticker capable of covering the privacy content is matched from all preset image stickers in a self-adaptive mode based on the display parameters, and after the target image sticker capable of covering the privacy content is matched from all preset image stickers in a self-adaptive mode based on the display parameters of the privacy content in the image to be protected, the terminal device further covers and shields the privacy content according to the target image sticker to protect the privacy.
Compared with the traditional mode of protecting the privacy content in the image based on manual operation, the method and the device can automatically identify the privacy content needing to be protected in the image, and adaptively match the image paster capable of covering the privacy content, so that the privacy content is shielded by using the image paster to realize privacy protection, the privacy content in the image is selected without manual operation of a user, the privacy content in the image can be more accurately shielded, and the efficiency of image privacy protection is greatly improved.
Further, based on the first embodiment, a second embodiment of the adaptive privacy protection method based on an image sticker is proposed, in this embodiment, the step S10 of determining an image to be protected and identifying privacy content in the image to be protected may include:
step S101, calling a preset image privacy recognition model to recognize privacy contents in the image to be protected, wherein the image privacy recognition model is obtained by performing machine learning training according to image sample data.
It should be noted that, in this embodiment, the preset image privacy identification model is a model obtained by performing machine learning training according to image sample data, and specifically, the prediction model may be an autoregressive model, a neural network model, or another machine learning model. It should be understood that, based on different design requirements of practical applications, in different possible embodiments, the terminal device may select to use different types of models to perform the prediction operation of real-time task processing exception based on the requirements, and the scheduling method of real-time tasks according to the present invention is not limited to a specific type of the prediction model.
The method comprises the steps that a terminal device determines an image to be protected, which needs privacy protection currently by a user, and before the image to be protected is identified to determine privacy content, the terminal device firstly utilizes a local image as image sample data to train a machine learning model to obtain an image privacy identification model which can accurately identify and analyze the privacy content, which needs privacy protection currently by the user, of any image, so that after the image to be protected is determined, the terminal device can automatically input the image to be protected into the trained image privacy identification model as input data, and the image privacy identification model performs model calculation and outputs all privacy content, which needs privacy protection by the user, of the image to be protected.
Further, in a possible embodiment, the adaptive privacy protection method based on the image sticker of the present invention may further include:
step S40, transmitting model parameters obtained by machine learning training based on image sample data locally to a preset federal server, wherein the preset federal server is connected with a plurality of terminal devices;
in this embodiment, when the terminal device trains the machine learning model by using local image data to obtain an image privacy recognition model capable of accurately recognizing and analyzing privacy contents, the terminal device may perform machine learning training of the image privacy recognition model in a federal learning manner in order to ensure that the privacy contents in the image as sample data do not flow out of the local area and cause leakage.
After the terminal equipment reads image data locally and the image data is used as image sample data for machine learning training, iterative training is carried out on a machine learning model only by using the image sample data locally, after the machine learning model is converged or the number of times of the iterative training reaches the maximum training number, the terminal equipment extracts each model parameter of the trained machine learning model, and uploads each model parameter to a federal server which is simultaneously connected with a plurality of terminal equipment which are the same as the current terminal equipment and respectively carry out the machine learning training by using the image sample data locally.
It should be noted that, in this embodiment, the preset federal server may be any server or any trusted terminal device in each terminal device, and the model parameters of the machine learning model extracted and uploaded to the federal server by the terminal device are parameters of any machine learning model, for example, the model parameters may specifically be intermediate gradients, weights, and the like, and based on different design requirements of practical applications, in different feasible embodiments, the model parameters extracted and uploaded to the federal server by the terminal device may certainly be different.
Step S50, receiving an image privacy recognition model fed back by the preset federation server after fusion based on the model parameters uploaded by each terminal device, so as to recognize the privacy content based on the image privacy recognition model.
The method comprises the steps that a terminal device extracts model parameters of a machine learning model after machine learning training is conducted locally, the model parameters are uploaded to a federal server, the federal server performs fusion processing on the model parameters uploaded by a plurality of terminal devices respectively, and therefore an image privacy recognition model capable of accurately recognizing privacy content of a user in an image, wherein the privacy content needs to be subjected to privacy protection, then the image privacy recognition model is fed back to the terminal device by the federal server, the terminal device can determine an image to be protected after receiving the image privacy recognition model, directly takes the image to be protected as input data, inputs the image to be protected into the image privacy recognition model to be subjected to recognition analysis of the image privacy recognition model and output of the image to be protected, and the user needs to perform privacy protection on the privacy content.
Further, in a possible embodiment, after receiving the image privacy recognition model fed back by the federal server, it is also possible to first call an image as test data in advance to test against the image privacy recognition model, therefore, when the image privacy identification model is tested to be capable of accurately identifying all the privacy contents in the image which need privacy protection, the image privacy recognition model is formally called to carry out recognition analysis on the image to be protected, otherwise, the terminal equipment reuses the image sample data to carry out machine learning training on the image privacy recognition model fed back by the federated server until convergence, then extracting model parameters and uploading the model parameters to a federal server for fusion and feeding back a new image privacy recognition model, and circulating until the image privacy identification model can accurately identify all privacy contents in the test data.
In this embodiment, after image data is read locally by a terminal device and is used as image sample data for machine learning training, iterative training is performed on a machine learning model only locally by using the image sample data, after the machine learning model is converged or the number of times of iterative training reaches the maximum training number, the terminal device extracts each model parameter of the trained machine learning model, and uploads each model parameter to a federal server which is simultaneously connected with a plurality of terminal devices which are the same as the current terminal device and each of which performs machine learning training locally by using the image sample data; the federal server performs fusion processing on the model parameters uploaded by the plurality of terminal devices respectively, so that an image privacy recognition model capable of accurately recognizing privacy content of the user needing privacy protection in the image is obtained, then the federal server feeds the image privacy recognition model back to the terminal devices, the terminal devices can directly use the image to be protected as input data after determining the image to be protected after receiving the image privacy recognition model, the input data is input into the image privacy recognition model to be used for the image privacy recognition model to recognize and analyze and output the image to be protected, and the user needs to perform privacy protection on the privacy content.
Compared with the traditional mode of protecting the privacy content in the image based on manual operation, the invention obtains the image privacy identification model capable of automatically identifying the privacy content needing to be protected in the image through federal learning training, thereby outputting the privacy content after identifying and analyzing the image to be protected of which the privacy is needed by a user by calling the image privacy identification model, realizing more accurate identification of the privacy content needing to be protected by the user based on machine learning, further improving the accuracy of shielding and protecting the privacy content in the image, and in addition, when the terminal equipment carries out machine learning training of the image privacy identification model, the image containing the privacy content as image sample data does not need to flow out of the local part of the terminal equipment, thereby further ensuring the safety of the privacy content needing to be protected by the user, the efficiency of image privacy protection is further improved.
Furthermore, the invention also provides an adaptive privacy protection system based on the image paster. Referring to fig. 3, fig. 3 is a functional module diagram of an embodiment of an adaptive privacy protection system based on image stickers according to the present invention. As shown in fig. 3, the adaptive privacy protecting system based on image sticker of the present invention comprises:
the privacy identification module 10 is used for determining an image to be protected and identifying privacy content in the image to be protected;
the sticker adaptation module 20 is configured to obtain display parameters of the private content, and adapt to obtain a target image sticker according to the display parameters;
and the privacy protection module 30 is used for shielding the privacy content according to the target image sticker.
Further, the display parameters include a first display size, a sticker adaptation module 20, including:
the adaptation unit is used for adapting all image stickers to be selected with the same display size from all preset image stickers according to the first display size;
the first confirming unit is used for receiving a first selection instruction triggered based on each image paster to be selected and taking a first image paster to be selected related to the first selection instruction as a target image paster, wherein the number of the first image pasters to be selected is larger than or equal to one.
Further, the sticker adaptation module 20 further includes:
the receiving unit is used for receiving a second selection instruction triggered based on all preset image stickers;
the detection unit is used for detecting whether the first display size is the same as the second display size of a second image paster to be selected related to the second selection instruction or not, and the number of the second image pasters to be selected is larger than or equal to one;
the second confirming unit is used for taking the second image paster to be selected as the target image paster if the second confirming unit is used for taking the second image paster to be selected as the target image paster;
and the adjusting unit is used for adjusting the second display size of the second image paster to be selected according to the first display size if the second image paster to be selected is not the target image paster, and the adjusted second image paster to be selected is used as the target image paster.
Further, the display parameters further include a display location, and the privacy protecting module 30 includes:
the generating unit is used for generating an upper layer blank image of the image to be protected and determining the corresponding position of the display position on the upper layer blank image;
and the first shielding unit is used for generating the target image paster at the corresponding position so as to shield the privacy content.
Further, the privacy protecting module 30 further includes:
and the second shielding unit is used for moving the target image sticker from a preset region to be selected to the corresponding position so as to shield the privacy content.
Further, the privacy identification module 10 is further configured to invoke a preset image privacy identification model to identify the privacy content in the image to be protected, where the image privacy identification model is obtained by performing machine learning training according to image sample data.
Further, the invention relates to an adaptive privacy protection system based on image stickers, which further comprises:
the model training module is used for transmitting model parameters obtained by machine learning training based on image sample data to a preset federated server, wherein the preset federated server is connected with a plurality of terminal devices; and receiving an image privacy recognition model fed back by the preset federated server after fusion based on the model parameters uploaded by each terminal device, so as to recognize the privacy content based on the image privacy recognition model.
The function implementation of each module in the adaptive privacy protection system based on the image sticker corresponds to each step in the embodiment of the adaptive privacy protection method based on the image sticker, and the functions and implementation processes are not described in detail herein.
The present invention also provides a computer storage medium having stored thereon an image-sticker-based adaptive privacy preserving program that, when executed by a processor, implements the steps of the image-sticker-based adaptive privacy preserving method according to any one of the above embodiments.
The specific embodiment of the computer storage medium of the present invention is substantially the same as the embodiments of the adaptive privacy protection method based on the image sticker, and will not be described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An adaptive privacy protection method based on an image sticker is characterized by comprising the following steps:
determining an image to be protected and identifying privacy content in the image to be protected;
acquiring display parameters of the privacy content, and obtaining a target image sticker according to the display parameter adaptation;
and shielding the privacy content according to the target image paster.
2. The method of claim 1, wherein the display parameters include a first display size, and wherein the step of adapting the target image sticker according to the display parameters comprises:
according to the first display size, all image stickers to be selected with the same display size are matched from all preset image stickers;
receiving a first selection instruction triggered based on each image paster to be selected, and taking a first image paster to be selected associated with the first selection instruction as a target image paster, wherein the number of the first image pasters to be selected is greater than or equal to one.
3. The adaptive privacy preserving method based on image stickers according to claim 2, wherein the step of obtaining the target image sticker according to the display parameter adaptation further comprises:
receiving a second selection instruction triggered based on all preset image stickers;
detecting whether the first display size is the same as a second display size of a second image paster to be selected associated with the second selection instruction, wherein the number of the second image pasters to be selected is greater than or equal to one;
if so, taking the second image paster to be selected as a target image paster;
and if not, adjusting the second display size of the second image paster to be selected according to the first display size, and taking the adjusted second image paster to be selected as the target image paster.
4. The image-sticker-based adaptive privacy preserving method of claim 1, wherein the display parameters further include a display location, the step of obscuring the privacy content from the target image sticker comprising:
generating an upper layer blank image of the image to be protected, and determining a corresponding position of the display position on the upper layer blank image;
and generating the target image paster at the corresponding position to shield the privacy content.
5. The image-sticker-based adaptive privacy preserving method of claim 4, further comprising, after the step of determining the corresponding location of the display location on the upper-level blank image:
and moving the target image sticker from a preset region to be selected to the corresponding position so as to shield the privacy content.
6. The image-sticker-based adaptive privacy preserving method of claim 1, wherein the steps of determining an image to be protected and identifying privacy content in the image to be protected comprise:
and calling a preset image privacy recognition model to recognize the privacy content in the image to be protected, wherein the image privacy recognition model is obtained by performing machine learning training according to image sample data.
7. The image-sticker-based adaptive privacy preserving method of claim 6, wherein the image-sticker-based adaptive privacy preserving method further comprises:
transmitting model parameters obtained by local machine learning training based on image sample data to a preset federal server, wherein the preset federal server is connected with a plurality of terminal devices;
and receiving an image privacy recognition model fed back by the preset federated server after fusion based on the model parameters uploaded by each terminal device, so as to recognize the privacy content based on the image privacy recognition model.
8. An adaptive privacy protection system based on image stickers, comprising:
the privacy identification module is used for determining an image to be protected and identifying privacy content in the image to be protected;
the sticker adaptation module is used for acquiring the display parameters of the privacy content and obtaining a target image sticker according to the display parameter adaptation;
and the privacy protection module is used for shielding the privacy content according to the target image sticker.
9. A terminal device, characterized in that the terminal device comprises: memory, a processor and an image-sticker-based adaptive privacy preserving program stored on the memory and executable on the processor, the image-sticker-based adaptive privacy preserving program when executed by the processor implementing the steps of the image-sticker-based adaptive privacy preserving method of any one of claims 1-7.
10. A computer storage medium, characterized in that the computer storage medium has stored thereon an image-sticker-based adaptive privacy protection program that, when executed by a processor, implements the steps of the image-sticker-based adaptive privacy protection method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110162662.9A CN112950443B (en) | 2021-02-05 | 2021-02-05 | Self-adaptive privacy protection method, system, equipment and medium based on image sticker |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110162662.9A CN112950443B (en) | 2021-02-05 | 2021-02-05 | Self-adaptive privacy protection method, system, equipment and medium based on image sticker |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112950443A true CN112950443A (en) | 2021-06-11 |
| CN112950443B CN112950443B (en) | 2023-11-24 |
Family
ID=76242778
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110162662.9A Active CN112950443B (en) | 2021-02-05 | 2021-02-05 | Self-adaptive privacy protection method, system, equipment and medium based on image sticker |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112950443B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113709519A (en) * | 2021-08-27 | 2021-11-26 | 上海掌门科技有限公司 | Method and equipment for determining live broadcast shielding area |
| CN114419720A (en) * | 2022-03-30 | 2022-04-29 | 浙江大华技术股份有限公司 | Image occlusion method and system and computer readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107358111A (en) * | 2017-08-28 | 2017-11-17 | 维沃移动通信有限公司 | A kind of method for secret protection and mobile terminal |
| CN107644172A (en) * | 2016-07-20 | 2018-01-30 | 平安科技（深圳）有限公司 | The guard method of content displaying and device |
| CN110135195A (en) * | 2019-05-21 | 2019-08-16 | 司马大大（北京）智能***有限公司 | Method for secret protection, device, equipment and storage medium |
| CN111462097A (en) * | 2020-04-03 | 2020-07-28 | 深圳前海微众银行股份有限公司 | Image processing method, device, equipment and storage medium based on federal learning |
| CN111783175A (en) * | 2020-07-10 | 2020-10-16 | 深圳传音控股股份有限公司 | Display interface privacy protection method, terminal and computer readable storage medium |
| CN111967412A (en) * | 2020-08-21 | 2020-11-20 | 深圳前海微众银行股份有限公司 | Face attribute recognition method, client, device and medium based on federal learning |
-
2021
- 2021-02-05 CN CN202110162662.9A patent/CN112950443B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107644172A (en) * | 2016-07-20 | 2018-01-30 | 平安科技（深圳）有限公司 | The guard method of content displaying and device |
| CN107358111A (en) * | 2017-08-28 | 2017-11-17 | 维沃移动通信有限公司 | A kind of method for secret protection and mobile terminal |
| CN110135195A (en) * | 2019-05-21 | 2019-08-16 | 司马大大（北京）智能***有限公司 | Method for secret protection, device, equipment and storage medium |
| CN111462097A (en) * | 2020-04-03 | 2020-07-28 | 深圳前海微众银行股份有限公司 | Image processing method, device, equipment and storage medium based on federal learning |
| CN111783175A (en) * | 2020-07-10 | 2020-10-16 | 深圳传音控股股份有限公司 | Display interface privacy protection method, terminal and computer readable storage medium |
| CN111967412A (en) * | 2020-08-21 | 2020-11-20 | 深圳前海微众银行股份有限公司 | Face attribute recognition method, client, device and medium based on federal learning |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113709519A (en) * | 2021-08-27 | 2021-11-26 | 上海掌门科技有限公司 | Method and equipment for determining live broadcast shielding area |
| CN113709519B (en) * | 2021-08-27 | 2023-11-17 | 上海掌门科技有限公司 | Method and equipment for determining live broadcast shielding area |
| CN114419720A (en) * | 2022-03-30 | 2022-04-29 | 浙江大华技术股份有限公司 | Image occlusion method and system and computer readable storage medium |
| CN114419720B (en) * | 2022-03-30 | 2022-10-18 | 浙江大华技术股份有限公司 | Image occlusion method and system and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112950443B (en) | 2023-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108664364B (en) | Terminal testing method and device | |
| CN107239666B (en) | Method and system for desensitizing medical image data | |
| US11099657B2 (en) | Remote information input method, device and system | |
| CN112100431B (en) | Evaluation method, device and equipment of OCR system and readable storage medium | |
| US20210004587A1 (en) | Image detection method, apparatus, device and storage medium | |
| CN110751149B (en) | Target object labeling method, device, computer equipment and storage medium | |
| CN110619314A (en) | Safety helmet detection method and device and electronic equipment | |
| CN109194689B (en) | Abnormal behavior recognition method, device, server and storage medium | |
| CN108229485A (en) | For testing the method and apparatus of user interface | |
| CN110555171B (en) | Information processing method, device, storage medium and system | |
| CN112950443A (en) | Adaptive privacy protection method, system, device and medium based on image sticker | |
| CN111832561B (en) | Character sequence recognition method, device, equipment and medium based on computer vision | |
| CN108805035A (en) | Interactive teaching and learning method based on gesture identification and device | |
| CN113486785A (en) | Video face changing method, device, equipment and storage medium based on deep learning | |
| CN111160157B (en) | Text extraction method based on DWG drawing and related products | |
| CN113807342A (en) | Method and related device for acquiring equipment information based on image | |
| CN111881740A (en) | Face recognition method, face recognition device, electronic equipment and medium | |
| CN114792285A (en) | Image processing method and processing device, electronic device and readable storage medium | |
| US20180336243A1 (en) | Image Search Method, Apparatus and Storage Medium | |
| US20140354676A1 (en) | Hair colouring device and method | |
| CN108287707B (en) | JSX file generation method and device, storage medium and computer equipment | |
| CN109753217B (en) | Dynamic keyboard operation method and device, storage medium and electronic equipment | |
| CN108805121B (en) | License plate detection and positioning method, device, equipment and computer readable medium | |
| CN115497152A (en) | Customer information analysis method, device, system and medium based on image recognition | |
| CN104035655B (en) | The method and device that control character input method is shown |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |