CN114489549B - Screen projection image processing method and device, electronic equipment and storage medium - Google Patents
Screen projection image processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114489549B CN114489549B CN202210113739.8A CN202210113739A CN114489549B CN 114489549 B CN114489549 B CN 114489549B CN 202210113739 A CN202210113739 A CN 202210113739A CN 114489549 B CN114489549 B CN 114489549B
- Authority
- CN
- China
- Prior art keywords
- screen
- area
- message notification
- projection image
- image frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 28
- 238000000034 method Methods 0.000 claims abstract description 34
- 238000012545 processing Methods 0.000 claims description 36
- 230000008569 process Effects 0.000 abstract description 14
- 238000004891 communication Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 238000005266 casting Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- Medical Informatics (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses a screen projection image processing method, a device, electronic equipment and a storage medium, wherein the screen projection image processing method comprises the following steps: acquiring at least one initial screen-throwing image frame; identifying a message notification area in each initial screen-projection image frame; and if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame. The technical problem that prior art privacy was revealed in the screen throwing process has been solved to this application.
Description
Technical Field
The present disclosure relates to the field of screen projection technologies, and in particular, to a screen projection image processing method, a device, an electronic apparatus, and a storage medium.
Background
Along with development of technology and improvement of living standard of people, functions of displaying screens of mobile devices such as mobile phones, tablet computers and computers through display devices such as television large screens and projectors are increasingly popular, users often push pictures, music and videos of the mobile devices to the display devices to play, however, notification messages received by the mobile devices can be synchronously sent to the display devices when the screens of the mobile devices are sent on the same screen, the display devices are often screens with public properties, and privacy leakage can be caused if privacy information exists in the notification messages.
Disclosure of Invention
The main purpose of the application is to provide a screen projection image processing method, a device, electronic equipment and a storage medium, and aims to solve the technical problem of privacy disclosure in the screen projection process in the prior art.
In order to achieve the above object, the present application provides a projection screen image processing method, including:
acquiring at least one initial screen-throwing image frame;
identifying a message notification area in each initial screen-projection image frame;
and if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame.
Optionally, the step of identifying a message notification area in each of the initial screen-projection image frames includes:
intercepting an area image from a preset area range of each initial screen projection image frame;
comparing each area image with a preset standard area image, and identifying a message notification area with a block difference in each area image.
Optionally, before the step of comparing each of the area images with a preset standard area image and identifying the message notification area with the block difference in each of the area images, the method further includes:
sequentially detecting block difference areas between two adjacent area images of the frame sequence according to the frame sequence;
when a block difference region exists between two adjacent region images of a frame sequence, judging whether an edge line exists in the block difference according to the pixel value of the block difference region;
and taking the area image corresponding to the block difference area without the edge line as a preset standard area image.
Optionally, after the step of identifying the message notification area in each of the initial screen-projection image frames, the method further includes:
and if the message notification area is not recognized in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
Optionally, the step of hiding each message notification area to obtain at least one target projection image frame includes:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target projection image frame.
Optionally, the step of hiding each message notification area to obtain at least one target projection image frame includes:
and replacing each message notification area with a preset message notification standard image to obtain at least one target projection image frame.
Optionally, before the step of acquiring at least one initial screen-projection image frame, the method further includes:
acquiring a current screen display mode;
if the current screen-throwing display mode is the privacy protection mode, generating prompt information that the privacy protection mode is started.
The application also provides a projection screen image processing device, the projection screen image processing device is applied to projection screen image processing equipment, the projection screen image processing device includes:
the acquisition module is used for acquiring at least one initial screen projection image frame;
the identification module is used for identifying the message notification area in each initial screen projection image frame;
and the hiding processing module is used for hiding each message notification area if at least one message notification area is identified in each initial screen projection image frame, so as to obtain at least one target screen projection image frame.
The application also provides an electronic device, which is an entity device, and includes: the projection screen image processing device comprises a memory, a processor and a program of the projection screen image processing method which is stored in the memory and can be run on the processor, wherein the program of the projection screen image processing method can realize the steps of the projection screen image processing method when being executed by the processor.
The present application also provides a storage medium, which is a computer readable storage medium, where a program for implementing a method for processing a screen image is stored on the computer readable storage medium, where the program for implementing the method for processing a screen image implements the steps of the method for processing a screen image as described above when being executed by a processor.
The present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of a method for processing a projected image as described above.
The application provides a screen projection image processing method, device, electronic equipment and storage medium, wherein the acquisition of at least one initial screen projection image frame is realized, the acquisition of the initial screen projection image frame to be projected is realized, further, the identification of the message notification area in each initial screen projection image frame is realized, the determination of the message notification area possibly with privacy information in the initial screen projection image frame to be projected is realized, and further, if at least one message notification area is identified in each initial screen projection image frame, the hiding processing is carried out on each message notification area to obtain at least one target screen projection image frame, the hiding processing of the message notification area in each initial screen projection image frame is realized, namely, the message notification information of the privacy information possibly existing in each initial screen projection image frame is hidden, the target screen projection image frame with the message notification information hidden is obtained, the protection of personal privacy in the screen projection image frame is effectively improved, and the technical problem of privacy leakage in the screen projection process in the prior art is overcome.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic view of a screen connection scenario according to an embodiment of a screen image processing method of the present application;
fig. 2 is a schematic structural diagram of an electronic device in a hardware running environment related to a projection screen image processing method in an embodiment of the present application;
FIG. 3 is a flowchart illustrating an embodiment of a projection image processing method according to the present application;
FIG. 4 is a schematic view of a scenario in which one embodiment of the method for on-screen calling of the present application may be implemented;
FIG. 5 is a flowchart of another embodiment of a projection image processing method according to the present application;
fig. 6 is a schematic diagram of a device structure related to a projection image processing method in an embodiment of the present application.
The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.
Detailed Description
In order to make the above objects, features and advantages of the present invention more comprehensible, the following description of the embodiments accompanied with the accompanying drawings will be given in detail. It will be apparent that the described embodiments are only some, but not all, embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic view of a screen connection according to an embodiment of the present invention.
As shown in fig. 1, the projector includes: the first electronic device may be a personal computer, a mobile terminal device such as a smart phone, a tablet computer, an electronic book reader, a portable computer, etc., and the second electronic device may be a television, a display, a projector, etc., which has a display function.
In some embodiments, the first electronic device is connected to the projector transmitter and/or the projector receiver via a wired or wireless network for data transmission and interaction; the screen projector is connected with the screen projector receiver through a wireless network to perform data transmission and interaction, or is connected with the second electronic equipment through a wireless network to perform data transmission and interaction; the screen projector receiver is connected with the second electronic equipment through a wired or wireless network to carry out data transmission and interaction. In an alternative implementation, the wired connection between the projector receiver and the second electronic device and between the projector transmitter and the first electronic device may include wired connection based on HDMI (High Definition Multimedia Interface, high-definition multimedia interface), USB (Universal Serial Bus ), DP (DisplayPort, display interface), VGA (Video Graphics Array ), and the like. The wireless communication modes between the first electronic device and the projector and the receiver of the projector and between the second electronic device and the projector and the receiver of the projector can comprise Bluetooth (Bluetooth), wireless broadband (Wi-Fi), infrared communication and other wireless communication modes.
Therefore, possible connection modes for implementing screen projection between the first electronic device, the screen projector receiver and the second electronic device at least include:
(1) The screen projector is connected with the screen projector receiver, and the first electronic equipment picture is finally projected to the second electronic equipment through the screen projector and the screen projector receiver;
(2) The screen projector is in wireless connection with the second electronic equipment, the first electronic equipment images are projected to the second electronic equipment through the screen projector, and at the moment, the screen projector is connected with a wireless communication module arranged in the second electronic equipment through a wireless network;
(3) The first electronic equipment is connected with the screen projector receiver, and the screen of the first electronic equipment is projected to the second electronic equipment through the screen projector receiver.
Referring to fig. 2, fig. 2 is a schematic diagram of an electronic device structure of a hardware running environment related to a screen image processing method in an embodiment of the present application. The electronic device in the embodiments of the present disclosure may include, but is not limited to, a fixed terminal such as a television, a projector receiver, a projector transmitter, a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle-mounted terminal (e.g., a vehicle-mounted navigation terminal), a digital TV, a desktop computer, and the like.
As shown in fig. 2, the electronic device further includes: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a network interface 1003, and a memory 1004. Wherein the communication bus 1002 is used to enable connected communication between these components. The network interface 1003 may optionally include a standard wired interface, a Wireless interface (e.g., wireless-Fidelity (WI-FI) interface). The Memory 1004 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable Non-Volatile Memory (NVM), such as a disk Memory. The memory 1004 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the terminal may also include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and so on. Among other sensors, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal moves to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and the direction when the mobile terminal is stationary, and the mobile terminal can be used for recognizing the gesture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, and the like, which are not described herein.
It will be appreciated by those skilled in the art that the structure shown in fig. 2 is not limiting of the operating device and may include more or fewer components than shown, or certain components may be combined, or a different arrangement of components.
As shown in fig. 2, an operating system, a data storage module, a network communication module, and a projection screen image processing program may be included in the memory 1004 as one storage medium.
In the operating device shown in fig. 2, the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and the memory 1004 in the operation device of the present invention may be provided in an operation device that calls a screen image processing program stored in the memory 1004 through the processor 1001 and performs the following operations:
acquiring at least one initial screen-throwing image frame;
identifying a message notification area in each initial screen-projection image frame;
and if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame.
Further, the processor 1001 may call a projection screen image processing program stored in the memory 1004, and further perform the following operations:
intercepting an area image from a preset area range of each initial screen projection image frame;
comparing each area image with a preset standard area image, and identifying a message notification area with a block difference in each area image.
Further, the processor 1001 may call a projection screen image processing program stored in the memory 1004, and further perform the following operations:
sequentially detecting block difference areas between two adjacent area images of the frame sequence according to the frame sequence;
when a block difference region exists between two adjacent region images of a frame sequence, judging whether an edge line exists in the block difference according to the pixel value of the block difference region;
and taking the area image corresponding to the block difference area without the edge line as a preset standard area image.
Further, the processor 1001 may call a projection screen image processing program stored in the memory 1004, and further perform the following operations:
and if the message notification area is not recognized in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
Further, the processor 1001 may call a projection screen image processing program stored in the memory 1004, and further perform the following operations:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target projection image frame.
Further, the processor 1001 may call a projection screen image processing program stored in the memory 1004, and further perform the following operations:
and replacing each message notification area with a preset message notification standard image to obtain at least one target projection image frame.
Further, the processor 1001 may call a projection screen image processing program stored in the memory 1004, and further perform the following operations:
acquiring a current screen display mode;
if the current screen-throwing display mode is the privacy protection mode, generating prompt information that the privacy protection mode is started.
An embodiment of the present application provides a screen image processing method, in a first embodiment of the screen image processing method of the present application, referring to fig. 3, the screen image processing method includes:
step S10, at least one initial screen projection image frame is acquired;
in this embodiment, it should be noted that, the screen projection is a process of sending a display image of a screen projection pushing end to a screen projection receiving end for display, in the screen projection process, the screen projection pushing end sends a screen projection image frame to the screen projection receiving end for display, after the screen projection pushing end generates the screen projection image frame, before the screen projection receiving end displays the screen projection image frame, the screen projection pushing end or the screen projection receiving end can hide a message notification area in the screen projection image frame, so that message notification information possibly having privacy information in the screen projection image frame can be hidden, so that the screen projection receiving end finally displays the screen projection image frame after hiding, and further effective protection of privacy information in the screen projection image is realized.
The execution body of the embodiment may be a projection screen pushing end or a projection screen receiving end, where the projection screen receiving end is a device for receiving a projection screen, such as a television, a computer, or a projector, and in one implementation manner, the projection screen receiving end may also be a signal receiver connected to a display and/or a speaker, where the signal receiver and the display and/or the speaker may be connected by a wire or wirelessly, and after receiving an audio signal and an image signal of a projection screen, the signal receiver outputs the audio signal and the image signal received by the projection screen through the display and/or the speaker connected to the signal receiver; the screen projection pushing end is a mobile device for pushing the screen, such as a mobile phone, a computer or a tablet personal computer, and the like, the screen projection pushing end can communicate with other mobile devices through a traditional communication network or the internet, the screen projection pushing end and the screen projection receiving end can be connected through wires or wirelessly, in an implementation manner, the screen projection pushing end can also be a signal transmitter connected with the mobile device, the signal transmitter and the mobile device can be connected through wires or wirelessly, and the mobile device can send audio signals and image signals required to be projected to the screen projection receiving end through the signal transmitter.
Specifically, after the screen-throwing pushing end generates the initial screen-throwing image frame, at least one initial screen-throwing image frame is acquired, where the initial screen-throwing image frame is an image frame to be thrown generated by the screen-throwing pushing end, a mode of acquiring the initial screen-throwing image frame may be to acquire all initial screen-throwing image frames corresponding to a preset time period, or may be to acquire initial screen-throwing image frames of a preset image frame number, and the preset time period and the preset image frame number may be set according to actual situations, for example, all initial screen-throwing image frames within T milliseconds are sequentially acquired from a first initial screen-throwing image frame to be processed, or C Zhang Chushi screen-throwing image frames are sequentially acquired from the first initial screen-throwing image frame to be processed.
Optionally, before the step of acquiring at least one initial screen-projection image frame, the method further includes:
step A10, acquiring a current screen display mode;
and step A20, if the current screen display mode is a privacy protection mode, generating prompt information that the privacy protection mode is started.
In this embodiment, specifically, the screen-throwing display mode that is currently set by the screen-throwing connection is obtained, whether the currently set screen-throwing display mode is a privacy protection mode is determined, if the current screen-throwing display mode is the privacy protection mode, prompt information that the privacy protection mode is started is generated, and the prompt information is output through a display device corresponding to the screen-throwing receiving end, where the screen-throwing display mode is a display mode that performs screen-throwing display or does not perform screen-throwing display and is determined according to different situations in the screen-throwing process, and includes a privacy protection mode, an infinite free-throwing mode, a conference mode, a game mode, and the like, and may be preset according to big data or test data, or may guide a user to perform setting and changing according to own needs, and the triggering time of the step of obtaining the current screen-throwing display mode may be when the screen-throwing pushing end establishes the screen-throwing connection with the screen-throwing receiving end, or when the screen-throwing display mode is changed, and the like.
Step S20, identifying message notification areas in each initial screen projection image frame;
in this embodiment, specifically, image pixel information corresponding to each initial projection screen image frame is obtained, and a message notification area in each initial projection screen image frame is identified according to each image pixel information, where a manner of identifying the message notification area in each initial projection screen image frame according to each image pixel information includes identifying the message notification area in each initial projection screen image frame by using an image identification technology, or comparing each initial projection screen image with a preset standard projection screen image, identifying a block difference image between the two block difference images, and taking a region corresponding to the block difference image between the two block difference images as the message notification area, where the preset standard projection screen image may be one of the initial projection screen images, or may be preset according to an actual situation, where the block difference image refers to a whole image with an area exceeding a preset area and having a regular frame, where the preset area may be determined according to an actual screen size or an actual test result, where the judgment of the regular frame may be determined by judging whether there is a closed loop formed by connecting the same or similar pixel values with each other, and further determining that the block difference image is a group of the block difference image is a preset image, and the block difference image may be further determined to be a high-like, and the corresponding block difference image is a preset image is a group of a preset image.
Step S30, if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame.
In this embodiment, specifically, if at least one message notification area is identified in each initial screen-projection image frame, a portion of each message notification area corresponding to each initial screen-projection image frame is subjected to a hiding process to obtain at least one target screen-projection image frame, and the target screen-projection image frame is output through a display device, where the hiding process is an operation of hiding information in each message notification area, and includes a blurring process, an image replacement, and the like, and the target screen-projection image frame is a screen-projection image that is output and displayed by a display device corresponding to a screen-projection receiving end.
Optionally, after the step of identifying the message notification area in each of the initial screen-projection image frames, the method further includes:
and if the message notification area is not recognized in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
In this embodiment, specifically, if the message notification area is not identified in each of the initial screen-projection image frames, it is indicated that the message notification is not received in the time range corresponding to each of the initial screen-projection image frames, and the problem of leakage of the privacy information in the message notification does not occur, so that each of the initial screen-projection image frames is directly used as a target screen-projection image frame, and the target screen-projection image frame is output through the display device.
Optionally, the step of hiding each message notification area to obtain at least one target projection image frame includes:
step B10, at least one initial pixel value of each message notification area is obtained;
in this embodiment, specifically, a part or all of the initial pixel values of each of the message notification areas are acquired, for example, a text area in each of the message notification areas is identified, and only the initial pixel values of the text area are acquired.
And step B20, converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target projection screen image frame.
In this embodiment, specifically, each initial pixel value is input into a preset deformation algorithm, a blurred pixel value corresponding to each initial pixel value is obtained through conversion, and pixel values of other areas except for the message notification area in each initial screen projection image frame are kept unchanged, so that a target screen projection image frame after the message notification area is hidden is obtained, wherein the blurred pixel value is obtained by converting the initial pixel value of the message notification area with clear original semantics through the preset deformation algorithm, the obtained pixel value which enables the original semantics to be not accurately represented is blurred compared with the image formed by the initial pixel value, for example, mosaic processing, gaussian blur and the like, and the preset deformation algorithm is similar to the algorithm for carrying out the blurring processing such as mosaic processing, gaussian blur processing and the like in the prior art, and is not repeated herein.
Optionally, the step of hiding each message notification area to obtain at least one target projection image frame includes:
and replacing each message notification area with a preset message notification standard image to obtain at least one target projection image frame.
In this embodiment, specifically, each of the message notification areas is replaced by a preset message notification standard image, and other areas except for the message notification area in each of the initial screen projection image frames are kept unchanged, so as to obtain at least one target screen projection image frame, where the message notification standard image is a standard image for prompting a user to receive a message notification.
In one embodiment, the step of replacing each of the message notification areas with a preset message notification standard image includes: obtaining area specification information and an initial message notification image of each message notification area, performing specification adjustment on the message notification standard image according to the area specification information to obtain a message notification standard image, and replacing each message notification area with a preset message notification standard image, wherein the specification adjustment comprises cutting, stretching, zooming and the like.
In one embodiment, the step of replacing each of the message notification areas with a preset message notification standard image includes: identifying text information in each message notification area, judging target application information corresponding to the message notification area according to the text information, determining a target message notification standard image corresponding to the target application information according to the mapping relation between the application information and the message notification standard image, and replacing each message notification area with the target message notification standard image.
In an embodiment, referring to fig. 4, the screen receiving end includes a television 400 and a screen receiver 300, the television 400 is communicatively connected to the screen receiver 300, the screen pushing end includes a mobile phone 100 and a screen transmitter 200, the mobile phone 100 is communicatively connected to the screen transmitter 200, the screen receiver 300 is communicatively connected to the screen transmitter 200, during the screen casting process of the mobile phone 100 to the television 400, the screen transmitter 200 transmits the screen picture and sound of the mobile phone 100 to the screen receiver 300, the screen receiver 300 transmits the received screen picture and sound of the mobile phone 100 to the television 400 for picture display and sound play, the screen transmitter 200 acquires at least one initial screen image frame generated by the mobile phone 100, identifies a message notification area in each initial screen image frame, if at least one message notification area is identified in each initial screen image frame, processes each message area, and transmits at least one target image frame to the screen receiver 300 to the screen receiver, and the screen receiver 300 transmits the target image frame to the screen receiver 300 for hiding the screen image frame.
In this embodiment, by acquiring at least one initial screen-projection image frame, acquiring the initial screen-projection image frame to be projected, further identifying a message notification area in each initial screen-projection image frame, determining a message notification area in which privacy information may exist in the initial screen-projection image frame to be projected, further hiding each message notification area if at least one message notification area is identified in each initial screen-projection image frame, so as to obtain at least one target screen-projection image frame, hiding the message notification area in each initial screen-projection image frame, namely hiding the message notification information of privacy information which may exist in each initial screen-projection image frame, so as to obtain a target screen-projection image frame in which the message notification information is hidden, effectively improving protection of personal privacy in the screen-projection image frame, and overcoming the technical problem of privacy leakage in the screen-projection process in the prior art.
Further, in another embodiment of the method for processing a projection image of the present application, referring to fig. 5, the step of identifying a message notification area in each of the initial projection image frames includes:
s21, intercepting an area image from a preset area range of each initial screen projection image frame;
in this embodiment, specifically, each initial screen-projection image frame is cut according to a preset area range, so as to obtain an area image corresponding to each initial screen-projection image frame, where the preset area range may be set according to an actual situation, for example, a message notification is always displayed at the top of the screen, so that the image may be quartered, an uppermost quarter area may be used as a preset area range, and an area of the image that is a preset distance from the top may also be used as a preset area range.
Step S22, comparing each area image with a preset standard area image, and identifying a message notification area with block differences in each area image.
In this embodiment, specifically, each area image is compared with a preset standard area image, whether a block difference exists between each area image and the preset standard area image is determined, a preset area range with the block difference is used as a message notification area, wherein the preset standard area image can be one of the area images, or can be preset according to actual conditions, the block difference is a whole difference area with a larger area than a preset area and a regular frame, the preset area can be determined according to an actual screen size or an actual test result, the determination of the regular frame can be determined by determining whether the same or similar pixel values are connected with each other to form a closed loop, further, a graph formed by a closed loop forming pixel value group and a graph in a preset graph library are subjected to similarity matching, and the preset area range corresponding to the pixel value group with the graph similarity higher than the preset similarity is determined as the message notification area.
In one embodiment, the step of identifying the message notification area in which the block difference exists in each of the area images includes: and comparing the area images in pairs, detecting whether a difference area exceeding a preset difference area exists between any two area images, judging whether an edge line exists in the difference area according to the pixel value of the difference area if the difference area exists between two target area images, and determining that a block difference exists between the two target area images if the edge line exists in any one of the two initial area images.
Optionally, before the step of comparing each of the area images with a preset standard area image and identifying the message notification area with the block difference in each of the area images, the method further includes:
step C10, sequentially detecting block difference areas between two adjacent area images of the frame sequence according to the frame sequence;
in this embodiment, specifically, a frame sequence of an initial screen-projection image frame corresponding to each initial area image is determined, two initial area images adjacent to the frame sequence are sequentially acquired according to the frame sequence, and a block difference area between the two initial area images adjacent to the frame sequence is sequentially detected according to the frame sequence.
Step C20, judging whether an edge line exists in the block difference according to the pixel value of the block difference region when the block difference region exists between two adjacent region images of the frame sequence;
in this embodiment, specifically, when a block difference area exists between two adjacent area images of a frame sequence is detected, a pixel value of the block difference area is obtained, whether an edge line exists in the block difference is judged according to the pixel value of the block difference area, when the block difference area exists between the two adjacent area images of the frame sequence is not detected, other adjacent area image pairs are continuously detected in sequence according to the frame sequence until all detectable area images are detected, if the block difference area exists between the two adjacent area images of the frame sequence is not detected, it is indicated that a message notification area does not exist in each initial screen projection image frame, each initial screen projection image frame is taken as a target screen projection image frame, and the initial screen projection image frames are output through a display device, wherein the edge line is a continuous frame line formed by pixel points with the same or similar pixel values and connected end to end.
And step C30, taking the area image corresponding to the block difference area without the edge line as a preset standard area image.
In this embodiment, specifically, an area image corresponding to a block difference area where the edge line does not exist is taken as a preset standard area image, and an area image corresponding to a block difference area where the edge line exists is taken as a message notification area.
In this embodiment, by performing image comparison on the area images, the area range required to be compared can be reduced, the comparison time is effectively shortened, the screen-throwing delay is reduced, and the area range is limited, so that misjudgment of recognition of the message notification area caused by other unexpected conditions except message notification in the screen-throwing images can be effectively avoided, and accuracy of recognition of the message notification area possibly causing privacy leakage is effectively improved.
Further, an embodiment of the present application further provides a screen image processing apparatus, referring to fig. 6, which is applied to a screen image processing device, and includes:
an acquisition module 10, configured to acquire at least one initial screen-projection image frame;
an identification module 20, configured to identify a message notification area in each of the initial screen-projection image frames;
and the hiding processing module 30 is configured to, if at least one message notification area is identified in each of the initial screen-projection image frames, perform hiding processing on each of the message notification areas, so as to obtain at least one target screen-projection image frame.
Optionally, the identification module 20 is further configured to:
intercepting an area image from a preset area range of each initial screen projection image frame;
comparing each area image with a preset standard area image, and identifying a message notification area with a block difference in each area image.
Optionally, the identification module 20 is further configured to:
sequentially detecting block difference areas between two adjacent area images of the frame sequence according to the frame sequence;
when a block difference region exists between two adjacent region images of a frame sequence, judging whether an edge line exists in the block difference according to the pixel value of the block difference region;
and taking the area image corresponding to the block difference area without the edge line as a preset standard area image.
Optionally, the identification module 20 is further configured to:
and if the message notification area is not recognized in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
Optionally, the concealment processing module 30 is further configured to:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target projection image frame.
Optionally, the concealment processing module 30 is further configured to:
and replacing each message notification area with a preset message notification standard image to obtain at least one target projection image frame.
Optionally, the projection screen image processing device further includes a prompt module, where the prompt module is configured to:
acquiring a current screen display mode;
if the current screen-throwing display mode is the privacy protection mode, generating prompt information that the privacy protection mode is started.
The screen projection image processing device provided by the invention adopts the screen projection image processing method in the embodiment, and solves the technical problem of privacy leakage in the screen projection process in the prior art. Compared with the prior art, the beneficial effects of the screen projection image processing device provided by the embodiment of the invention are the same as those of the screen projection image processing method provided by the embodiment, and other technical features of the screen projection image processing device are the same as those disclosed by the method of the embodiment, so that details are not repeated.
Further, the present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of a method for processing a projected image as described above.
The technical problem of prior art privacy disclosure in the screen throwing process is solved by the computer program product that this application provided. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the invention are the same as those of the screen projection image processing method provided by the embodiment, and are not described in detail herein.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims.
Claims (8)
1. A screen projection image processing method, characterized in that the screen projection image processing method comprises:
acquiring at least one initial screen-throwing image frame;
identifying a message notification area in each initial screen-projection image frame;
if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame;
the step of identifying the message notification area in each initial screen projection image frame comprises the following steps:
intercepting an area image from a preset area range of each initial screen projection image frame;
sequentially detecting block difference areas between two adjacent area images of the frame sequence according to the frame sequence;
when a block difference region exists between two adjacent region images of a frame sequence, judging whether an edge line exists in the block difference according to the pixel value of the block difference region;
taking an area image corresponding to the block difference area without the edge line as a preset standard area image;
comparing each area image with a preset standard area image, and identifying a message notification area with a block difference in each area image.
2. The method of processing a screen image according to claim 1, wherein after the step of identifying the message notification area in each of the initial screen image frames, further comprising:
and if the message notification area is not recognized in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.
3. The method for processing a projection screen image according to claim 1, wherein the step of hiding each of the message notification areas to obtain at least one target projection screen image frame comprises:
acquiring at least one initial pixel value of each message notification area;
and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target projection image frame.
4. The method for processing a projection screen image according to claim 1, wherein the step of hiding each of the message notification areas to obtain at least one target projection screen image frame comprises:
and replacing each message notification area with a preset message notification standard image to obtain at least one target projection image frame.
5. The method of claim 1, wherein prior to the step of acquiring at least one initial projection image frame, further comprising:
acquiring a current screen display mode;
if the current screen-throwing display mode is the privacy protection mode, generating prompt information that the privacy protection mode is started.
6. A screen image processing apparatus, characterized in that the screen image processing apparatus comprises:
the acquisition module is used for acquiring at least one initial screen projection image frame;
the identification module is used for identifying the message notification area in each initial screen projection image frame;
the hiding processing module is used for hiding each message notification area if at least one message notification area is identified in each initial screen projection image frame, so as to obtain at least one target screen projection image frame;
the identification module is further used for intercepting area images from a preset area range of each initial screen projection image frame; sequentially detecting block difference areas between two adjacent area images of the frame sequence according to the frame sequence; when a block difference region exists between two adjacent region images of a frame sequence, judging whether an edge line exists in the block difference according to the pixel value of the block difference region; taking an area image corresponding to the block difference area without the edge line as a preset standard area image; comparing each area image with a preset standard area image, and identifying a message notification area with a block difference in each area image.
7. An electronic device, the electronic device comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the method of any one of claims 1 to 5.
8. A storage medium, characterized in that the storage medium is a computer-readable storage medium having stored thereon a program for realizing the projection image processing method, the program for realizing the projection image processing method being executed by a processor to realize the steps of the projection image processing method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210113739.8A CN114489549B (en) | 2022-01-30 | 2022-01-30 | Screen projection image processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210113739.8A CN114489549B (en) | 2022-01-30 | 2022-01-30 | Screen projection image processing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114489549A CN114489549A (en) | 2022-05-13 |
| CN114489549B true CN114489549B (en) | 2023-04-25 |
Family
ID=81478500
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210113739.8A Active CN114489549B (en) | 2022-01-30 | 2022-01-30 | Screen projection image processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114489549B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117859130A (en) * | 2022-07-29 | 2024-04-09 | 广州视源电子科技股份有限公司 | Data transmission method, device, conference system, wireless screen transmitter and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110784758A (en) * | 2019-08-22 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Screen projection processing method and device |
| CN111259907A (en) * | 2020-03-12 | 2020-06-09 | Oppo广东移动通信有限公司 | Content identification method and device and electronic equipment |
| CN112965680A (en) * | 2021-04-20 | 2021-06-15 | 努比亚技术有限公司 | Screen projection method, screen projection initiating device and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103677517B (en) * | 2013-12-02 | 2016-06-29 | 三星电子（中国）研发中心 | A kind of picture searching method and apparatus |
| CN104238986A (en) * | 2014-09-26 | 2014-12-24 | 深圳市中兴移动通信有限公司 | Screen transfer display method and device |
| CN109829456B (en) * | 2017-11-23 | 2022-05-17 | 腾讯科技（深圳）有限公司 | Image identification method and device and terminal |
| CN108549608A (en) * | 2018-04-18 | 2018-09-18 | 武汉极意网络科技有限公司 | A kind of the UI sectional drawings test method and system of APP |
| KR20200081527A (en) * | 2018-12-19 | 2020-07-08 | 삼성전자주식회사 | Electronic apparatus and control method thereof |
| CN113391774A (en) * | 2020-03-11 | 2021-09-14 | 钉钉控股（开曼）有限公司 | Screen projection processing method, device, equipment and storage medium |
| CN113596593A (en) * | 2021-07-28 | 2021-11-02 | 深圳创维－Rgb电子有限公司 | Multi-terminal interaction method, television and computer readable storage medium |
| CN113313089B (en) * | 2021-07-28 | 2021-10-01 | 湖南涉外经济学院 | Data processing method, device and computer readable storage medium |
-
2022
- 2022-01-30 CN CN202210113739.8A patent/CN114489549B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110784758A (en) * | 2019-08-22 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Screen projection processing method and device |
| CN111259907A (en) * | 2020-03-12 | 2020-06-09 | Oppo广东移动通信有限公司 | Content identification method and device and electronic equipment |
| CN112965680A (en) * | 2021-04-20 | 2021-06-15 | 努比亚技术有限公司 | Screen projection method, screen projection initiating device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114489549A (en) | 2022-05-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9591256B2 (en) | Methods and devices for video communication | |
| JP6336206B2 (en) | Method, apparatus, program and recording medium for processing moving picture file identifier | |
| WO2021147657A1 (en) | Frame interpolation processing method and related product | |
| KR102317021B1 (en) | Display apparatus and image correction method thereof | |
| CN110602401A (en) | Photographing method and terminal | |
| EP3043343A1 (en) | Information processing device, information processing method, and program | |
| CN114428598A (en) | Screen projection method and device, electronic equipment and storage medium | |
| CN107248137B (en) | Method for realizing image processing and mobile terminal | |
| US20220248102A1 (en) | Subtitle border-crossing processing method and apparatus, and electronic device | |
| CN110070063B (en) | Target object motion recognition method and device and electronic equipment | |
| CN114489549B (en) | Screen projection image processing method and device, electronic equipment and storage medium | |
| CN111083386A (en) | Image processing method and electronic device | |
| CN109947988B (en) | Information processing method and device, terminal equipment and server | |
| CN109104573B (en) | Method for determining focusing point and terminal equipment | |
| CN109005314B (en) | Image processing method and terminal | |
| CN109167917B (en) | Image processing method and terminal equipment | |
| CN114647468B (en) | Screen projection image display method and device, electronic equipment and storage medium | |
| WO2019020112A1 (en) | Terminal display method, terminal and computer-readable storage medium | |
| CN109561258B (en) | Light supplementing method and terminal equipment | |
| JP7164637B2 (en) | Volume display method, device, terminal device and storage medium | |
| WO2023142370A1 (en) | Screen mirroring display method and apparatus, and electronic device and readable storage medium | |
| CN115423794A (en) | Dynamic picture detection method, device, display and storage medium | |
| CN109389547B (en) | Image display method and device | |
| CN108540726B (en) | Method and device for processing continuous shooting image, storage medium and terminal | |
| CN112788425A (en) | Dynamic area display method, device, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |