CN114489549A - Screen projection image processing method and device, electronic equipment and storage medium - Google Patents
Screen projection image processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114489549A CN114489549A CN202210113739.8A CN202210113739A CN114489549A CN 114489549 A CN114489549 A CN 114489549A CN 202210113739 A CN202210113739 A CN 202210113739A CN 114489549 A CN114489549 A CN 114489549A
- Authority
- CN
- China
- Prior art keywords
- area
- screen projection
- message notification
- screen
- projection image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- Medical Informatics (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses a screen projection image processing method, a screen projection image processing device, electronic equipment and a storage medium, wherein the screen projection image processing method comprises the following steps: acquiring at least one initial screen projection image frame; identifying a message notification area in each initial screen projection image frame; if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame. The technical problem that privacy is revealed in the screen projection process in the prior art is solved.
Description
Technical Field
The present application relates to the field of screen projection technologies, and in particular, to a screen projection image processing method and apparatus, an electronic device, and a storage medium.
Background
With the development of science and technology and the improvement of living standards of people, the functions of displaying screens of mobile devices such as mobile phones, tablet computers and computers are increasingly popularized through display devices such as large television screens and projectors, users often push pictures, music, videos and the like of the mobile devices to the display devices for playing, however, when the screens of the mobile devices are delivered on the same screen, notification messages received on the mobile devices can also be delivered on the display devices synchronously, the display devices are screens with public attributes, and if privacy information exists in the notification messages, privacy disclosure can be caused.
Disclosure of Invention
The application mainly aims to provide a screen projection image processing method and device, electronic equipment and a storage medium, and aims to solve the technical problem that privacy is revealed in the screen projection process in the prior art.
In order to achieve the above object, the present application provides a screen projection image processing method, including:
acquiring at least one initial screen projection image frame;
identifying a message notification area in each initial screen projection image frame;
if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame.
Optionally, the step of identifying the message notification area in each of the initial screen shot image frames includes:
intercepting a region image from a preset region range of each initial screen projection image frame;
and comparing each area image with a preset standard area image, and identifying a message notification area with block difference in each area image.
Optionally, before the step of comparing each of the area images with a preset standard area image and identifying a message notification area with a block difference in each of the area images, the method further includes:
sequentially detecting block-shaped difference regions between two region images adjacent to the frame sequence according to the frame sequence;
when a block-shaped difference area exists between two area images adjacent to a frame sequence, judging whether an edge line exists in the block-shaped difference according to the pixel value of the block-shaped difference area;
and taking the area image corresponding to the block-shaped difference area without the edge line as a preset standard area image.
Optionally, after the step of identifying the message notification area in each of the initial screen shot image frames, the method further includes:
and if the message notification area is not identified in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
Optionally, the step of performing hiding processing on each message notification area to obtain at least one target screen projection image frame includes:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.
Optionally, the step of performing hiding processing on each message notification area to obtain at least one target screen projection image frame includes:
and replacing each message notification area with a preset message notification standard image to obtain at least one target screen projection image frame.
Optionally, before the step of acquiring at least one initial screen shot image frame, the method further includes:
acquiring a current screen projection display mode;
and if the current screen projection display mode is the privacy protection mode, generating prompt information of which the privacy protection mode is started.
The application also provides a screen projection image processing device, the screen projection image processing device is applied to screen projection image processing equipment, the screen projection image processing device includes:
the acquisition module is used for acquiring at least one initial screen projection image frame;
the identification module is used for identifying the message notification area in each initial screen projection image frame;
and the hiding processing module is used for hiding each message notification area to obtain at least one target screen projection image frame if at least one message notification area is identified in each initial screen projection image frame.
The present application further provides an electronic device, the electronic device is an entity device, the electronic device includes: a memory, a processor and a program of the screen-shot image processing method stored on the memory and executable on the processor, which program, when executed by the processor, may implement the steps of the screen-shot image processing method as described above.
The present application also provides a storage medium, which is a computer-readable storage medium, on which a program for implementing the screen-shot image processing method is stored, and when executed by a processor, the program for implementing the screen-shot image processing method as described above is implemented.
The present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the screen-projection image processing method as described above.
The application provides a screen-shot image processing method, a screen-shot image processing device, an electronic device and a storage medium, wherein the acquisition of an initial screen-shot image frame to be screened is realized by acquiring at least one initial screen-shot image frame, the determination of a message notification area possibly containing privacy information appearing in the initial screen-shot image frame to be screened is realized by identifying the message notification area in each initial screen-shot image frame, at least one target screen-shot image frame is obtained by hiding each message notification area if at least one message notification area is identified in each initial screen-shot image frame, the hiding of the message notification area in each initial screen-shot image frame is realized, namely the message notification information possibly containing the privacy information in each initial screen-shot image frame is hidden, and the target screen-shot image frame with the message notification information hidden is obtained, the protection of the personal privacy in the screen projection image frame is effectively improved, and the technical problem that the privacy is revealed in the screen projection process in the prior art is solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
Fig. 1 is a schematic view of a screen projection connection scene according to an embodiment of a screen projection image processing method of the present application;
fig. 2 is a schematic structural diagram of an electronic device in a hardware operating environment related to a screen projection image processing method in an embodiment of the present application;
FIG. 3 is a schematic flowchart of an embodiment of a screen projection image processing method according to the present application;
FIG. 4 is a schematic view of a scene in which an embodiment of the screen-shot conversation method of the present application can be implemented;
FIG. 5 is a schematic flowchart of another embodiment of a screen shot image processing method according to the present application;
fig. 6 is a schematic structural diagram of a device related to a screen projection image processing method in the embodiment of the present application.
The objectives, features, and advantages of the present application will be further described with reference to the accompanying drawings.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic view of a screen projection connection according to an embodiment of the present invention.
As shown in fig. 1, the screen projector includes: the electronic device comprises a screen projector transmitter and/or a screen projector receiver, wherein the first electronic device can be a personal computer, or can be a mobile terminal device such as a smart phone, a tablet computer, an electronic book reader, a portable computer, or the like, and the second electronic device can be a television, or can be a display device such as a display, a projector, or the like, having a display function.
In some embodiments, the first electronic device is connected with the screen projector transmitter and/or the screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected with the screen projector receiver through a wireless network to perform data transmission and interaction, or the screen projector transmitter is connected with the second electronic equipment through the wireless network to perform data transmission and interaction; the screen projector receiver is connected with the second electronic equipment through a wired or wireless network to perform data transmission and interaction. In an optional implementation manner, the wired connection between the screen projector receiver and the second electronic device and the wired connection between the screen projector transmitter and the first electronic device may include wired connections based on HDMI (High Definition Multimedia Interface), USB (Universal Serial Bus), DP (display Interface), VGA (Video Graphics Array), and the like. The wireless communication modes between the first electronic device and the screen projector and between the first electronic device and the screen projector receiver and between the second electronic device and the screen projector receiver can include wireless communication such as Bluetooth (Bluetooth), wireless broadband (Wi-Fi) and infrared communication.
Therefore, the possible connection modes for realizing screen projection between the first electronic device, the screen projector transmitter, the screen projector receiver and the second electronic device at least include:
(1) the screen projector transmitter is connected with the screen projector receiver, and the first electronic equipment picture is finally projected to the second electronic equipment through the screen projector transmitter and the screen projector receiver;
(2) the screen projector transmitter is wirelessly connected with the second electronic equipment, the picture of the first electronic equipment is projected to the second electronic equipment through the screen projector transmitter, and at the moment, the screen projector transmitter is connected with a wireless communication module arranged in the second electronic equipment through a wireless network;
(3) the first electronic equipment is connected with the screen projector receiver, and the first electronic equipment picture is projected to the second electronic equipment through the screen projector receiver.
Referring to fig. 2, fig. 2 is a schematic structural diagram of an electronic device in a hardware operating environment related to a screen projection image processing method in the embodiment of the present application. The electronic device in the embodiments of the present disclosure may include, but is not limited to, a fixed terminal such as a television, a screen projector receiver, a screen projector transmitter, a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), a digital TV, a desktop computer, and the like.
As shown in fig. 2, the electronic device further includes: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a network interface 1003, and a memory 1004. Wherein a communication bus 1002 is used to enable connective communication between these components. The network interface 1003 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (WI-FI) interface). The Memory 1004 may be a Random Access Memory (RAM) Memory, or may be a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1004 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the mobile terminal is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer and tapping) and the like for recognizing the attitude of the mobile terminal; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the configuration shown in FIG. 2 does not constitute a limitation of the operating device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 2, the memory 1004, which is a storage medium, may include therein an operating system, a data storage module, a network communication module, and a screen-shot image processing program.
In the operation device shown in fig. 2, the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and the memory 1004 in the execution apparatus of the present invention may be provided in an execution apparatus that calls the screen-projected image processing program stored in the memory 1004 through the processor 1001 and performs the following operations:
acquiring at least one initial screen projection image frame;
identifying a message notification area in each initial screen projection image frame;
if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame.
Further, the processor 1001 may call the screen projection image processing program stored in the memory 1004, and further perform the following operations:
intercepting a region image from a preset region range of each initial screen projection image frame;
and comparing each area image with a preset standard area image, and identifying a message notification area with block difference in each area image.
Further, the processor 1001 may call the screen projection image processing program stored in the memory 1004, and further perform the following operations:
sequentially detecting block-shaped difference regions between two region images adjacent to the frame sequence according to the frame sequence;
when a block-shaped difference area exists between two area images adjacent to a frame sequence, judging whether an edge line exists in the block-shaped difference according to the pixel value of the block-shaped difference area;
and taking the area image corresponding to the block-shaped difference area without the edge line as a preset standard area image.
Further, the processor 1001 may call the screen projection image processing program stored in the memory 1004, and further perform the following operations:
and if the message notification area is not identified in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
Further, the processor 1001 may call the screen projection image processing program stored in the memory 1004, and further perform the following operations:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.
Further, the processor 1001 may call the screen projection image processing program stored in the memory 1004, and further perform the following operations:
and replacing each message notification area with a preset message notification standard image to obtain at least one target screen projection image frame.
Further, the processor 1001 may call the screen projection image processing program stored in the memory 1004, and further perform the following operations:
acquiring a current screen projection display mode;
and if the current screen projection display mode is the privacy protection mode, generating prompt information of which the privacy protection mode is started.
In a first embodiment of the screen projection image processing method of the present application, referring to fig. 3, the screen projection image processing method includes:
step S10, acquiring at least one initial screen projection image frame;
in this embodiment, it should be noted that the screen projection is a process of projecting a display picture of the screen projection pushing end to a screen projection receiving end for display, in the screen projection process, the screen projection pushing end sends a screen projection image frame to the screen projection receiving end for display, after the screen projection pushing end generates a screen projection image frame and before the screen projection receiving end displays the screen projection image frame, the screen projection pushing end or the screen projection receiving end can hide a message notification area in the screen projection image frame, that is, message notification information that may have private information in the screen projection image frame can be hidden, so that the screen projection receiving end finally hides the screen projection image frame after processing, and effective protection of the private information in the screen projection image is achieved.
The implementation subject of this embodiment may be a screen projection pushing end or a screen projection receiving end, where the screen projection receiving end is a device for receiving screen projection, such as a television, a computer, or a projector, and in an implementable manner, the screen projection receiving end may also be a signal receiver connected to a display and/or a speaker, and the signal receiver may be connected to the display and/or the speaker by a wired or wireless connection, and after receiving the audio signal and the image signal of screen projection, the audio signal and the image signal received by screen projection are output through the display and/or the speaker connected to the signal receiver; the screen projection pushing end is a mobile device for pushing and projecting screens, such as a mobile phone, a computer or a tablet personal computer, and the screen projection pushing end can communicate with other mobile devices through a traditional communication network or the internet, the screen projection pushing end and the screen projection receiving end can be in wired or wireless connection, in an implementable mode, the screen projection pushing end can also be a signal transmitter connected with the mobile device, the signal transmitter and the mobile device can be in wired or wireless connection, and the mobile device sends audio signals and image signals needing screen projection to the screen projection receiving end through the signal transmitter.
Specifically, after an initial screen projection image frame is generated by a screen projection pushing end, at least one initial screen projection image frame is acquired, where the initial screen projection image frame is an image frame to be projected, the initial screen projection image frame is acquired by acquiring all initial screen projection image frames corresponding to a preset time period or acquiring initial screen projection image frames of a preset image frame number, and the preset time period and the preset image frame number may be set according to actual conditions, for example, all initial screen projection image frames within T milliseconds are sequentially acquired from a first initial screen projection image frame to be processed, or C initial screen projection image frames and the like are sequentially acquired from the first initial screen projection image frame to be processed.
Optionally, before the step of acquiring at least one initial screen shot image frame, the method further includes:
step A10, acquiring a current screen projection display mode;
step A20, if the current screen projection display mode is the privacy protection mode, generating the prompt information that the privacy protection mode is opened.
In this embodiment, specifically, the currently set screen-casting display mode of the screen-casting connection is obtained, whether the currently set screen-casting display mode is the privacy protection mode is determined, if the currently screen-casting display mode is the privacy protection mode, prompt information that the privacy protection mode is turned on is generated, and the prompt information is output through a display device corresponding to the screen-casting receiving end, where the screen-casting display mode is a display mode that performs or does not perform screen-casting display according to different situations during screen casting, and includes a privacy protection mode, an unlimited throw mode, a conference mode, and/or a game mode, and may be preset according to big data or test data, and may also guide a user to perform setting and changing according to their own needs, and the trigger time of the step of obtaining the current screen-casting display mode may be when the screen-casting push end establishes a screen-casting connection with the screen-casting receiving end, or when the screen projection display mode is changed.
Step S20, identifying a message notification area in each of the initial screen shot image frames;
in this embodiment, specifically, image pixel information corresponding to each initial screen-projection image frame is obtained, and a message notification area in each initial screen-projection image frame is identified according to each image pixel information, where the manner of identifying the message notification area in each initial screen-projection image frame according to each image pixel information includes identifying the message notification area in each initial screen-projection image frame by using an image identification technology, or comparing each initial screen-projection image with a preset standard screen-projection image, identifying a block difference image between the two images, and using an area corresponding to the block difference image between the two images as the message notification area, where the preset standard screen-projection image may be one of the initial screen-projection images or may be set in advance according to an actual situation, the block difference image is an entire block image with an area exceeding a preset area and having a regular frame, the preset area can be determined according to the actual screen size or the actual test result, the regular frame can be determined by judging whether the same or similar pixel values are connected with each other to form a closed loop, furthermore, the graph formed by the pixel value groups forming the closed loop can be subjected to similarity matching with the graph in a preset graph library, and the entire block image corresponding to the pixel value groups with the similarity higher than the preset similarity is determined as the block difference image.
Step S30, if at least one message notification area is identified in each initial screen-shot image frame, performing hiding processing on each message notification area to obtain at least one target screen-shot image frame.
In this embodiment, specifically, if at least one message notification area is identified in each initial screen projection image frame, a hiding process is performed on a portion of each message notification area corresponding to each initial screen projection image frame to obtain at least one target screen projection image frame, and the target screen projection image frame is output through a display device, where the hiding process is an operation of hiding information in each message notification area, and includes a blurring process, an image replacement, and the like, and the target screen projection image frame is a screen projection image output and displayed by a display device corresponding to a screen projection receiving end.
Optionally, after the step of identifying the message notification area in each of the initial screen shot image frames, the method further includes:
and if the message notification area is not identified in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
In this embodiment, specifically, if no message notification area is identified in each initial screen-projection image frame, it is described that no message notification is received within a time range corresponding to each initial screen-projection image frame, and a problem of privacy information leakage in the message notification does not occur, so that each initial screen-projection image frame is directly used as a target screen-projection image frame, and the target screen-projection image frame is output through a display device.
Optionally, the step of performing hiding processing on each message notification area to obtain at least one target screen projection image frame includes:
step B10, obtaining at least one initial pixel value of each message notification area;
in this embodiment, specifically, part or all of the initial pixel values of each message notification area are acquired, for example, a text area in each message notification area is identified, and only the initial pixel values of the text area are acquired.
And step B20, converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.
In this embodiment, specifically, each initial pixel value is input into a preset morphing algorithm, a blurred pixel value corresponding to each initial pixel value is obtained through transformation, and a pixel value of another region in each initial screen-projecting image frame except for the message notification region is kept unchanged, so that a target screen-projecting image frame with a message notification region being hidden is obtained, where the blurred pixel value is obtained through transforming the initial pixel value of the message notification region with clear original semantics through a preset morphing algorithm, so as to obtain a pixel value which cannot be accurately represented by the original semantics, an image composed of the blurred pixel values is blurred compared with an image composed of the initial pixel values, such as mosaic processing, gaussian blurring, and the like, and the preset morphing algorithm is similar to an algorithm in the prior art for performing blurring processing such as mosaic processing, gaussian blurring and the like, and will not be described in detail herein.
Optionally, the step of performing hiding processing on each message notification area to obtain at least one target screen projection image frame includes:
and replacing each message notification area with a preset message notification standard image to obtain at least one target screen projection image frame.
In this embodiment, specifically, each message notification area is replaced with a preset message notification standard image, and other areas except for the message notification area in each initial screen projection image frame are kept unchanged to obtain at least one target screen projection image frame, where the message notification standard image is a standard image for prompting a user to receive a message notification.
In an implementable manner, the step of replacing each of the message notification areas with a preset message notification standard image includes: acquiring area specification information and an initial message notification image of each message notification area, performing specification adjustment on the standard message notification image according to the area specification information to obtain a standard message notification image, and replacing each message notification area with a preset standard message notification image, wherein the specification adjustment comprises cutting, stretching, zooming and the like.
In an implementable manner, the step of replacing each of the message notification areas with a preset message notification standard image includes: recognizing the text information in each message notification area, judging the target application information corresponding to the message notification area according to the text information, determining a target message notification standard image corresponding to the target application information according to the mapping relation between the application information and the message notification standard image, and replacing each message notification area with the target message notification standard image.
In an implementable manner, referring to fig. 4, the screen projection receiving end includes a television 400 and a screen projector receiver 300, the television 400 is in communication connection with the screen projector receiver 300, the screen projection pushing end includes a mobile phone 100 and a screen projector transmitter 200, the mobile phone 100 is in communication connection with the screen projector transmitter 200, the screen projector receiver 300 is in communication connection with the screen projector transmitter 200, in the process that the mobile phone 100 projects a screen to the television 400, the screen projector transmitter 200 transmits the screen image and the sound of the mobile phone 100 to the screen projector receiver 300 synchronously, the screen projector receiver 300 transmits the received screen image and the sound of the mobile phone 100 to the television 400 for image display and sound play, the screen projector transmitter 200 acquires at least one initial screen projection image frame generated by the mobile phone 100, and identifies a message notification area in each initial screen projection image frame, if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame, sending the target screen projection image frame to the screen projector receiver 300, and then sending the target screen projection image frame to the television 400 through the screen projector 300 to display the target screen projection image frame.
In this embodiment, the acquisition of an initial screen-projection image frame to be screen-projected is realized by acquiring at least one initial screen-projection image frame, and further, the determination of a message notification area, where privacy information may exist, appearing in the initial screen-projection image frame to be screen-projected is realized by identifying a message notification area in each initial screen-projection image frame, and further, if at least one message notification area is identified in each initial screen-projection image frame, the hiding processing is performed on each message notification area to obtain at least one target screen-projection image frame, the hiding processing of the message notification area in each initial screen-projection image frame is realized, that is, the message notification information, where the privacy information may exist, in each initial screen-projection image frame is hidden is obtained, the target screen-projection image frame, where the message notification information is hidden, is obtained, and the protection of personal privacy in the screen-projection image frame is effectively improved, the technical problem that privacy is revealed in the screen projection process in the prior art is solved.
Further, in another embodiment of the screen shot image processing method, referring to fig. 5, the step of identifying the message notification area in each of the initial screen shot image frames includes:
step S21, intercepting area images from the preset area range of each initial screen projection image frame;
in this embodiment, specifically, each of the initial screen projection image frames is cut according to a preset region range to obtain a region image corresponding to each of the initial screen projection image frames, where the preset region range may be set according to an actual situation, for example, a message notification is often displayed on the top of a screen, so that the image may be divided into four equal parts, the uppermost quarter region is used as the preset region range, and a region of the image away from the top by a preset distance is also used as the preset region range.
Step S22, comparing each of the area images with a preset standard area image, and identifying a message notification area having a block difference in each of the area images.
In this embodiment, specifically, each of the area images is compared with a preset standard area image, whether a block difference exists between each of the area images and the preset standard area image is determined, and a preset area range in which the block difference exists is used as a message notification area, where the preset standard area image may be one of the area images or may be set in advance according to an actual situation, the block difference is a whole block difference area having an area exceeding a preset area and having a regular frame, the preset area may be determined according to an actual screen size or an actual test result, the determination of the regular frame may be determined by determining whether identical or similar pixel values are connected with each other to form a closed loop, and further, a graph formed by a set of pixel values forming the closed loop may be subjected to similarity matching with a graph in a preset graph library, and determining a preset area range corresponding to the pixel value group with the graph similarity higher than the preset similarity as a message notification area.
In one practical way, the step of identifying the message notification area with the block difference in each area image includes: comparing every two area images, comparing and detecting whether a difference area exceeding a preset difference area exists between any two area images, if the difference area exists between any two target area images, judging whether an edge line exists in the difference area according to the pixel value of the difference area, and if the edge line exists in any one of the two initial area images, determining that the two target area images have block difference.
Optionally, before the step of comparing each of the area images with a preset standard area image and identifying a message notification area having a block difference in each of the area images, the method further includes:
step C10, detecting block-shaped difference areas between two area images adjacent to the frame sequence according to the frame sequence;
in this embodiment, specifically, a frame sequence of an initial screen projection image frame corresponding to each of the initial region images is determined, two initial region images adjacent to the frame sequence are sequentially obtained according to the frame sequence, and a block-shaped difference region between the two initial region images adjacent to the frame sequence is sequentially detected according to the frame sequence.
Step C20, when detecting that there is block difference area between two adjacent area images of frame sequence, judging whether there is edge line in the block difference according to the pixel value of the block difference area;
in the present embodiment, specifically, when it is detected that a block-like difference region exists between two region images adjacent to a frame sequence, pixel values of the block-like difference region are acquired, judging whether the block difference has an edge line according to the pixel value of the block difference area, when the block difference area between two area images adjacent to the frame sequence is not detected, continuously detecting other adjacent regional image pairs according to the frame sequence in sequence until all detectable regional images are detected, if no block-shaped difference region exists between two regional images adjacent to the frame sequence, indicating that no message notification area exists in each initial screen-projected image frame, using each initial screen-projected image frame as a target screen-projected image frame, outputting the initial screen-projected image frame through a display device, the edge line is a continuous frame line which is formed by pixel points with the same or similar pixel values and is connected end to end.
And step C30, taking the area image corresponding to the block-shaped difference area without the edge line as a preset standard area image.
In this embodiment, specifically, an area image corresponding to a block-shaped difference area where the edge line does not exist is taken as a preset standard area image, and an area image corresponding to a block-shaped difference area where the edge line exists is taken as a message notification area.
In the embodiment, by means of image comparison of the area images, the area range to be compared can be reduced, the comparison time can be effectively shortened, the screen projection delay can be reduced, the area range can be limited, misjudgment of message notification area identification caused by other accidents except for message notification in the screen projection images can be effectively avoided, and accuracy of message notification area identification which possibly causes privacy disclosure is effectively improved.
Further, an embodiment of the present application further provides a screen projection image processing apparatus, and with reference to fig. 6, the screen projection image processing apparatus is applied to a screen projection image processing device, and the screen projection image processing apparatus includes:
an obtaining module 10, configured to obtain at least one initial screen projection image frame;
an identifying module 20, configured to identify a message notification area in each initial screen-shot image frame;
a hiding processing module 30, configured to, if at least one message notification area is identified in each initial screen projection image frame, hide each message notification area to obtain at least one target screen projection image frame.
Optionally, the identification module 20 is further configured to:
intercepting a region image from a preset region range of each initial screen projection image frame;
and comparing each area image with a preset standard area image, and identifying a message notification area with block difference in each area image.
Optionally, the identification module 20 is further configured to:
sequentially detecting block-shaped difference regions between two region images adjacent to the frame sequence according to the frame sequence;
when a block-shaped difference area exists between two area images adjacent to a frame sequence, judging whether an edge line exists in the block-shaped difference according to the pixel value of the block-shaped difference area;
and taking the area image corresponding to the block-shaped difference area without the edge line as a preset standard area image.
Optionally, the identification module 20 is further configured to:
and if the message notification area is not identified in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
Optionally, the hiding processing module 30 is further configured to:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.
Optionally, the hiding module 30 is further configured to:
and replacing each message notification area with a preset message notification standard image to obtain at least one target screen projection image frame.
Optionally, the screen-projection image processing apparatus further includes a prompt module, where the prompt module is configured to:
acquiring a current screen projection display mode;
and if the current screen projection display mode is the privacy protection mode, generating prompt information of which the privacy protection mode is started.
By adopting the screen-projecting image processing method in the embodiment, the screen-projecting image processing device provided by the invention solves the technical problem of privacy disclosure in the screen projecting process in the prior art. Compared with the prior art, the beneficial effects of the projected image processing device provided by the embodiment of the invention are the same as the beneficial effects of the projected image processing method provided by the embodiment, and other technical features of the projected image processing device are the same as those disclosed by the embodiment method, which are not repeated herein.
Further, the present application also provides a computer program product comprising a computer program which, when being executed by a processor, realizes the steps of the screen projection image processing method as described above.
The computer program product provided by the application solves the technical problem that privacy is revealed in the screen projection process in the prior art. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the invention are the same as the beneficial effects of the screen projection image processing method provided by the embodiment, and are not repeated herein.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.
Claims (10)
1. A screen projection image processing method is characterized by comprising the following steps:
acquiring at least one initial screen projection image frame;
identifying a message notification area in each initial screen projection image frame;
if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame.
2. The screen-shot image processing method of claim 1, wherein the step of identifying a message notification area in each of the initial screen-shot image frames comprises:
intercepting a region image from a preset region range of each initial screen projection image frame;
and comparing each area image with a preset standard area image, and identifying a message notification area with block difference in each area image.
3. The screen-projection image processing method of claim 2, wherein before the step of comparing each area image with a preset standard area image and identifying the message notification area with block difference in each area image, the method further comprises:
sequentially detecting block-shaped difference regions between two region images adjacent to the frame sequence according to the frame sequence;
when a block-shaped difference area exists between two area images adjacent to a frame sequence, judging whether an edge line exists in the block-shaped difference according to the pixel value of the block-shaped difference area;
and taking the area image corresponding to the block-shaped difference area without the edge line as a preset standard area image.
4. The screen-shot image processing method of claim 1, wherein the step of identifying a message notification area in each of the initial screen-shot image frames is followed by the step of:
and if the message notification area is not identified in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
5. The screen-shot image processing method of claim 1, wherein the step of performing concealment processing on each of the message notification areas to obtain at least one target screen-shot image frame comprises:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.
6. The screen-shot image processing method of claim 1, wherein the step of performing concealment processing on each of the message notification areas to obtain at least one target screen-shot image frame comprises:
and replacing each message notification area with a preset message notification standard image to obtain at least one target screen projection image frame.
7. The screen-shot image processing method of claim 1, wherein said step of obtaining at least one initial screen-shot image frame is preceded by the steps of:
acquiring a current screen projection display mode;
and if the current screen projection display mode is the privacy protection mode, generating prompt information of which the privacy protection mode is started.
8. A screen-projected image processing apparatus characterized by comprising:
the acquisition module is used for acquiring at least one initial screen projection image frame;
the identification module is used for identifying the message notification area in each initial screen projection image frame;
and the hiding processing module is used for hiding each message notification area to obtain at least one target screen projection image frame if at least one message notification area is identified in each initial screen projection image frame.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the projected image processing method of any of claims 1 to 7.
10. A storage medium, characterized in that the storage medium is a computer-readable storage medium having stored thereon a program for implementing a projected image processing method, the program being executed by a processor to implement the steps of the projected image processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210113739.8A CN114489549B (en) | 2022-01-30 | 2022-01-30 | Screen projection image processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210113739.8A CN114489549B (en) | 2022-01-30 | 2022-01-30 | Screen projection image processing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114489549A true CN114489549A (en) | 2022-05-13 |
| CN114489549B CN114489549B (en) | 2023-04-25 |
Family
ID=81478500
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210113739.8A Active CN114489549B (en) | 2022-01-30 | 2022-01-30 | Screen projection image processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114489549B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4336339A4 (en) * | 2022-07-29 | 2024-03-13 | Guangzhou Shiyuan Electronics Co Ltd | Data transmission method and apparatus, and conference system, wireless screen transmitter and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104238986A (en) * | 2014-09-26 | 2014-12-24 | 深圳市中兴移动通信有限公司 | Screen transfer display method and device |
| KR20150063953A (en) * | 2013-12-02 | 2015-06-10 | 삼성전자주식회사 | Apparatus and method for displaying images |
| CN108549608A (en) * | 2018-04-18 | 2018-09-18 | 武汉极意网络科技有限公司 | A kind of the UI sectional drawings test method and system of APP |
| CN109829456A (en) * | 2017-11-23 | 2019-05-31 | 腾讯科技（深圳）有限公司 | Image-recognizing method, device and terminal |
| CN110784758A (en) * | 2019-08-22 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Screen projection processing method and device |
| CN111259907A (en) * | 2020-03-12 | 2020-06-09 | Oppo广东移动通信有限公司 | Content identification method and device and electronic equipment |
| US20200202576A1 (en) * | 2018-12-19 | 2020-06-25 | Samsung Electronics Co., Ltd. | Electronic apparatus and control method thereof |
| CN112965680A (en) * | 2021-04-20 | 2021-06-15 | 努比亚技术有限公司 | Screen projection method, screen projection initiating device and storage medium |
| CN113313089A (en) * | 2021-07-28 | 2021-08-27 | 湖南涉外经济学院 | Data processing method, device and computer readable storage medium |
| CN113391774A (en) * | 2020-03-11 | 2021-09-14 | 钉钉控股（开曼）有限公司 | Screen projection processing method, device, equipment and storage medium |
| CN113596593A (en) * | 2021-07-28 | 2021-11-02 | 深圳创维－Rgb电子有限公司 | Multi-terminal interaction method, television and computer readable storage medium |
-
2022
- 2022-01-30 CN CN202210113739.8A patent/CN114489549B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20150063953A (en) * | 2013-12-02 | 2015-06-10 | 삼성전자주식회사 | Apparatus and method for displaying images |
| CN104238986A (en) * | 2014-09-26 | 2014-12-24 | 深圳市中兴移动通信有限公司 | Screen transfer display method and device |
| CN109829456A (en) * | 2017-11-23 | 2019-05-31 | 腾讯科技（深圳）有限公司 | Image-recognizing method, device and terminal |
| CN108549608A (en) * | 2018-04-18 | 2018-09-18 | 武汉极意网络科技有限公司 | A kind of the UI sectional drawings test method and system of APP |
| US20200202576A1 (en) * | 2018-12-19 | 2020-06-25 | Samsung Electronics Co., Ltd. | Electronic apparatus and control method thereof |
| CN110784758A (en) * | 2019-08-22 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Screen projection processing method and device |
| CN113391774A (en) * | 2020-03-11 | 2021-09-14 | 钉钉控股（开曼）有限公司 | Screen projection processing method, device, equipment and storage medium |
| CN111259907A (en) * | 2020-03-12 | 2020-06-09 | Oppo广东移动通信有限公司 | Content identification method and device and electronic equipment |
| CN112965680A (en) * | 2021-04-20 | 2021-06-15 | 努比亚技术有限公司 | Screen projection method, screen projection initiating device and storage medium |
| CN113313089A (en) * | 2021-07-28 | 2021-08-27 | 湖南涉外经济学院 | Data processing method, device and computer readable storage medium |
| CN113596593A (en) * | 2021-07-28 | 2021-11-02 | 深圳创维－Rgb电子有限公司 | Multi-terminal interaction method, television and computer readable storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4336339A4 (en) * | 2022-07-29 | 2024-03-13 | Guangzhou Shiyuan Electronics Co Ltd | Data transmission method and apparatus, and conference system, wireless screen transmitter and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114489549B (en) | 2023-04-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021159594A1 (en) | Image recognition method and apparatus, electronic device, and storage medium | |
| JP6336206B2 (en) | Method, apparatus, program and recording medium for processing moving picture file identifier | |
| US9591256B2 (en) | Methods and devices for video communication | |
| US20160065785A1 (en) | Methods and apparatuses for generating photograph | |
| CN110996175A (en) | Method, device and storage medium for controlling horizontal and vertical screen operation of television | |
| US20220248102A1 (en) | Subtitle border-crossing processing method and apparatus, and electronic device | |
| CN114428598A (en) | Screen projection method and device, electronic equipment and storage medium | |
| CN110807769B (en) | Image display control method and device | |
| CN114489549B (en) | Screen projection image processing method and device, electronic equipment and storage medium | |
| US11600300B2 (en) | Method and device for generating dynamic image | |
| CN114647468B (en) | Screen projection image display method and device, electronic equipment and storage medium | |
| WO2019020112A1 (en) | Terminal display method, terminal and computer-readable storage medium | |
| EP3799415A2 (en) | Method and device for processing videos, and medium | |
| CN112738606A (en) | Audio file processing method and device, terminal and storage medium | |
| CN109561258B (en) | Light supplementing method and terminal equipment | |
| CN112328193A (en) | Multi-terminal screen combination method, device, equipment and computer storage medium | |
| CN115205164B (en) | Training method of image processing model, video processing method, device and equipment | |
| US11810336B2 (en) | Object display method and apparatus, electronic device, and computer readable storage medium | |
| WO2023142370A1 (en) | Screen mirroring display method and apparatus, and electronic device and readable storage medium | |
| CN112492331B (en) | Live broadcast method, device, system and storage medium | |
| CN114666623A (en) | Video content display method and device, electronic equipment and storage medium | |
| CN109389547B (en) | Image display method and device | |
| CN112788425A (en) | Dynamic area display method, device, equipment and computer readable storage medium | |
| CN108540726B (en) | Method and device for processing continuous shooting image, storage medium and terminal | |
| CN112616080B (en) | Television photographing anti-shake method, device, equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |