CN114647468B - Screen projection image display method and device, electronic equipment and storage medium - Google Patents
Screen projection image display method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114647468B CN114647468B CN202210189624.7A CN202210189624A CN114647468B CN 114647468 B CN114647468 B CN 114647468B CN 202210189624 A CN202210189624 A CN 202210189624A CN 114647468 B CN114647468 B CN 114647468B
- Authority
- CN
- China
- Prior art keywords
- screen projection
- image
- target
- screen
- projected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- Transforming Electric Information Into Light Information (AREA)
Abstract
The application discloses a screen projection image display method, a screen projection image display device, electronic equipment and a storage medium, wherein the screen projection image display method comprises the following steps: acquiring upper application information of the screen projection pushing end; switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper application information; when receiving a screen image to be projected sent by a screen projection pushing end, carrying out image processing on the screen image to be projected according to the target screen projection display mode to obtain a target screen projection image; and outputting the target screen projection image. The application solves the technical problem that the screen projection display effect is poor in the prior art.
Description
Technical Field
The present application relates to the field of screen projection technologies, and in particular, to a screen projection image display method and apparatus, an electronic device, and a storage medium.
Background
With the development of science and technology and the improvement of living standards of people, the functions of displaying screens of mobile devices such as mobile phones, tablet computers and computers are increasingly popularized through display devices such as large television screens and projectors, and users often push pictures, music, videos and the like of the mobile devices to the display devices for playing.
Disclosure of Invention
The application mainly aims to provide a screen-projecting image display method, a screen-projecting image display device, electronic equipment and a storage medium, and aims to solve the technical problem that the screen-projecting display effect is poor in the prior art.
In order to achieve the above object, the present application provides a screen-projected image display method, including:
acquiring upper-layer application information of the screen projection pushing end;
switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper application information;
when receiving a screen image to be projected sent by a screen projection pushing end, carrying out image processing on the screen image to be projected according to the target screen projection display mode to obtain a target screen projection image;
and outputting the target screen projection image.
Optionally, the step of performing image processing on the image to be projected according to the target screen projection display mode to obtain a target screen projection image includes:
acquiring initial display parameters corresponding to the image to be projected;
adjusting the initial display parameters according to the target screen projection display mode to obtain target display parameters;
and carrying out image processing on the image to be projected according to the target display parameters to obtain a target screen projection image.
Optionally, the display parameters include a frame rate and a resolution, and the adjusting the initial display parameters according to the target screen projection display mode to obtain the target display parameters includes:
if the target screen projection display mode is determined to be a frame rate priority mode, increasing and adjusting the initial frame rate to obtain a target frame rate, and decreasing and adjusting the initial resolution to obtain a target resolution;
and if the target screen projection display mode is determined to be a resolution priority mode, reducing and adjusting the initial frame rate to obtain a target frame rate, and increasing and adjusting the initial resolution to obtain a target resolution.
Optionally, the screen-projecting display mode includes a frame rate priority mode and a resolution priority mode, and the step of switching the target screen-projecting display mode of the screen projection to the screen-projecting display mode corresponding to the upper-layer application information includes:
judging whether the upper layer application of the screen projection pushing end is a high frame rate application or not according to the upper layer application information;
if the upper-layer application of the screen projection pushing end is determined to be the high frame rate application, switching the target screen projection display mode of the screen projection to a frame rate priority mode;
and if the upper application of the screen projection pushing end is determined not to be the high frame rate application, switching the target screen projection display mode of the screen projection to a resolution priority mode.
Optionally, the upper layer application information includes an upper layer application type, and the step of determining whether the upper layer application of the screen projection pushing end is a high frame rate application according to the upper layer application information includes:
judging whether the upper layer application type belongs to a preset high frame rate application white list or not;
and if the upper application type belongs to a preset high frame rate application white list, judging that the upper application of the screen projection pushing end is the high frame rate application.
Optionally, after the step of outputting the target screen projection image, the method further includes:
monitoring whether image frame loss occurs in the screen projection process in real time;
and when the image frame loss is detected in the screen projection process, switching the screen projection display mode of the screen projection to a frame rate priority mode.
Optionally, after the step of outputting the target screen projection image, the method further includes:
monitoring whether the change rate of the target screen projection image is smaller than a preset change rate or not in real time;
and when detecting whether the change rate of the target screen projection image is smaller than a preset change rate, switching the target screen projection display mode of the screen projection to a resolution priority mode.
The application also provides a screen projection image display device, the screen projection image display device is applied to screen projection image display equipment, the screen projection image display device includes:
the acquisition module is used for acquiring upper-layer application information of the screen projection pushing end;
the mode switching module is used for switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper-layer application information;
the image processing module is used for carrying out image processing on the screen image to be projected according to the target screen projection display mode when the screen image to be projected sent by the screen projection pushing end is received, so as to obtain a target screen projection image;
and the output module is used for outputting the target screen projection image.
The present application further provides an electronic device, the electronic device is an entity device, the electronic device includes: a memory, a processor and a program of the screen-shot image display method stored on the memory and executable on the processor, which program, when executed by the processor, may implement the steps of the screen-shot image display method as described above.
The present application also provides a storage medium which is a computer-readable storage medium having stored thereon a program for implementing a screen-shot image display method, which when executed by a processor implements the steps of the screen-shot image display method as described above.
The present application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the screen-shot image display method as described above.
The application provides a screen projection image display method, a screen projection image display device, electronic equipment and a storage medium, wherein a target screen projection display mode of a screen projection is switched to a screen projection display mode corresponding to upper application information by acquiring upper application information of a screen projection pushing end, so that the target screen projection display mode is switched according to the upper application of the screen projection pushing end, and then when a screen image to be projected sent by the screen projection pushing end is received, the screen image to be projected is subjected to image processing according to the target screen projection display mode to obtain a target screen projection image, and the target screen projection image is output.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
Fig. 1 is a schematic view of a screen projection connection scene in an embodiment of a screen projection image display method of the present application;
fig. 2 is a schematic structural diagram of an electronic device in a hardware operating environment related to a screen projection image display method in an embodiment of the present application;
FIG. 3 is a flowchart illustrating a screen shot image display method according to an embodiment of the present disclosure;
FIG. 4 is a schematic view of a scene in which an embodiment of a screen-shot image display method according to the present application can be implemented;
FIG. 5 is a flowchart illustrating an embodiment of a screen shot image display method according to the present application;
FIG. 6 is a flowchart illustrating a screen shot image display method according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a device related to a screen projection image display method in the embodiment of the present application.
The objectives, features, and advantages of the present application will be further described with reference to the accompanying drawings.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. It should be apparent that the described embodiments are only some embodiments of the present invention, and not all embodiments. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
Referring to fig. 1, fig. 1 is a schematic view of a screen projection connection according to an embodiment of the present invention.
As shown in fig. 1, the screen projector includes: the electronic device comprises a screen projector transmitter and/or a screen projector receiver, wherein the first electronic device can be a personal computer, or can be a mobile terminal device such as a smart phone, a tablet computer, an electronic book reader, a portable computer, or the like, and the second electronic device can be a television, or can be a display device such as a display, a projector, or the like, having a display function.
In some embodiments, the first electronic device is connected with the screen projector transmitter and/or the screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected with the screen projector receiver through a wireless network to perform data transmission and interaction, or the screen projector transmitter is connected with the second electronic equipment through the wireless network to perform data transmission and interaction; the screen projector receiver is connected with the second electronic equipment through a wired or wireless network to perform data transmission and interaction. In an optional implementation manner, the wired connection between the screen projector receiver and the second electronic device and the wired connection between the screen projector transmitter and the first electronic device may include wired connections based on HDMI (High Definition Multimedia Interface), USB (Universal Serial Bus), DP (display Interface), VGA (Video Graphics Array), and the like. Wireless communication modes between the first electronic device and the screen projector transmitter and the screen projector receiver, and between the second electronic device and the screen projector transmitter and the screen projector receiver, may include wireless communications such as Bluetooth (r), wireless broadband (Wi-Fi), infrared communications, etc.
Therefore, the possible connection modes for realizing screen projection between the first electronic device, the screen projector transmitter, the screen projector receiver and the second electronic device at least include:
(1) The screen projector transmitter is connected with the screen projector receiver, and the first electronic equipment picture is finally projected to the second electronic equipment through the screen projector transmitter and the screen projector receiver;
(2) The screen projector transmitter is wirelessly connected with the second electronic equipment, the picture of the first electronic equipment is projected to the second electronic equipment through the screen projector transmitter, and at the moment, the screen projector transmitter is connected with a wireless communication module arranged in the second electronic equipment through a wireless network;
(3) The first electronic equipment is connected with the screen projector receiver, and the first electronic equipment picture is projected to the second electronic equipment through the screen projector receiver.
Referring to fig. 2, fig. 2 is a schematic structural diagram of an electronic device in a hardware operating environment related to a screen projection image display method in the embodiment of the present application. The electronic device in the embodiments of the present disclosure may include, but is not limited to, a fixed terminal such as a television, a screen projector receiver, a screen projector transmitter, a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), a digital TV, a desktop computer, and the like.
As shown in fig. 2, the electronic device further includes: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a network interface 1003, and a memory 1004. The communication bus 1002 is used to implement connection communication among these components. The network interface 1003 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (WI-FI) interface). The Memory 1004 may be a Random Access Memory (RAM) Memory, or may be a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1004 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when the mobile terminal is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer and tapping) and the like for recognizing the attitude of the mobile terminal; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the configuration shown in FIG. 2 does not constitute a limitation of the operating device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 2, the memory 1004, which is a storage medium, may include therein an operating system, a data storage module, a network communication module, and a screen-shot image display program.
In the operation device shown in fig. 2, the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and the memory 1004 in the execution apparatus of the present invention may be provided in the execution apparatus that calls the screen-shot image display program stored in the memory 1004 through the processor 1001 and performs the following operations:
acquiring upper-layer application information of the screen projection pushing end;
switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper application information;
when receiving a screen image to be projected sent by a screen projection pushing end, carrying out image processing on the screen image to be projected according to the target screen projection display mode to obtain a target screen projection image;
and outputting the target screen projection image.
Further, the processor 1001 may call a screen-shot image display program stored in the memory 1004, and further perform the following operations:
acquiring initial display parameters corresponding to the image to be projected;
adjusting the initial display parameters according to the target screen projection display mode to obtain target display parameters;
and carrying out image processing on the image to be projected according to the target display parameters to obtain a target screen projection image.
Further, the processor 1001 may call a screen-shot image display program stored in the memory 1004, and further perform the following operations:
if the target screen projection display mode is determined to be a frame rate priority mode, increasing and adjusting the initial frame rate to obtain a target frame rate, and decreasing and adjusting the initial resolution to obtain a target resolution;
and if the target screen projection display mode is determined to be a resolution priority mode, reducing and adjusting the initial frame rate to obtain a target frame rate, and increasing and adjusting the initial resolution to obtain a target resolution.
Further, the processor 1001 may call the screen-projection image display program stored in the memory 1004, and also perform the following operations:
judging whether the upper layer application of the screen projection pushing end is a high frame rate application or not according to the upper layer application information;
if the upper-layer application of the screen projection pushing end is determined to be the high frame rate application, switching the target screen projection display mode of the screen projection to a frame rate priority mode;
and if the upper application of the screen projection pushing end is determined not to be the high frame rate application, switching the target screen projection display mode of the screen projection to a resolution priority mode.
Further, the processor 1001 may call the screen-projection image display program stored in the memory 1004, and also perform the following operations:
judging whether the upper layer application type belongs to a preset high frame rate application white list or not;
and if the upper application type belongs to a preset high frame rate application white list, judging that the upper application of the screen projection pushing end is the high frame rate application.
Further, the processor 1001 may call a screen-shot image display program stored in the memory 1004, and further perform the following operations:
monitoring whether the image frame is lost or not in the screen projection process in real time;
and when the image frame loss is detected in the screen projection process, switching the screen projection display mode of the screen projection to a frame rate priority mode.
Further, the processor 1001 may call the screen-projection image display program stored in the memory 1004, and also perform the following operations:
monitoring whether the change rate of the target screen projection image is smaller than a preset change rate or not in real time;
and when detecting whether the change rate of the target screen projection image is smaller than a preset change rate, switching the target screen projection display mode of the screen projection to a resolution priority mode.
In a first embodiment of the screen-projected image display method according to the present application, referring to fig. 3, the screen-projected image display method includes:
step S10, acquiring upper layer application information of the screen projection pushing end;
in this embodiment, it should be noted that the screen projection is a process of projecting the display screen and/or sound of the screen projection pushing end to the screen projection receiving end for outputting and displaying. In an implementable manner, the screen projection receiving end may also be a screen projector receiver connected to a display and/or a speaker, and the screen projector receiver may be connected to the display and/or the speaker by a wired or wireless connection, and after receiving the projected audio signal and the projected image signal, the screen projection receiving end outputs the received projected audio signal and the received projected image signal through the display and/or the speaker connected to the screen projector receiver; the screen projecting push end is a mobile device for pushing and projecting screens, such as a mobile phone, a computer or a tablet personal computer, and the screen projecting push end can communicate with other mobile devices through a traditional communication network or the internet, the screen projecting push end and the screen projecting receiving end can be in wired or wireless connection, in a practical mode, the screen projecting push end can also be a screen projecting device emitter connected with the mobile device, the screen projecting device emitter and the mobile device can be in wired or wireless connection, and the mobile device sends audio signals and image signals needing screen projection to the screen projecting receiving end through the screen projecting device emitter.
Specifically, in the process of a screen projection from a screen projection pushing end to a screen projection receiving end, current upper layer application information of the screen projection pushing end is acquired from the screen projection pushing end, wherein the upper layer application information is related information of an application displayed on the uppermost layer of the screen projection pushing end and includes an application name, an application type (for example, a first person shooter game, a chess and card game, a video application, a chat application, and the like), display parameters (for example, a frame rate, a resolution, and the like), and the manner of acquiring the upper layer application information of the screen projection pushing end includes, but is not limited to: detecting an upper application of the screen-casting push end, and directly acquiring upper application information corresponding to the upper application; acquiring an image to be projected, performing image recognition on the image to be projected, and determining upper application information in the image to be projected.
In an implementation manner, before the step of acquiring the upper layer application information of the screen projection pushing end, the method further includes: monitoring whether an upper application of the screen projection pushing end changes or not, and acquiring current upper application information of the screen projection pushing end when the upper application is detected to change, wherein the upper application information is new upper application information of the screen projection pushing end after the upper application changes.
Step S20, switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper application information;
in this embodiment, it should be noted that the projection display mode is a mode for adjusting display parameters of an image output by a projection receiving end, and includes a frame rate priority mode, a Resolution priority mode, a smooth mode, and the like, where the frame rate priority mode is a mode for ensuring that a frame rate is within a preset high frame rate range by using a preset frame rate priority technique or algorithm (e.g., MEMC (Motion Estimation and Motion Compensation) technique, and the like), and the Resolution priority mode is a mode for ensuring that a frame rate is within a preset high frame rate range by using a preset Resolution priority technique or algorithm (e.g., AI-SR (Artificial Intelligence Super Resolution) technique, AI-PQ (Artificial Intelligence image Quality enhancement) technique, and the like), and the display parameters other than Resolution are reduced or unchanged, so that a Resolution is increased or maintained, and the Resolution is within a high Resolution adjustment range, and the projection display mode is set by switching the preset frame rate priority mode, and the projection display mode is set as a mode for ensuring that the user can be switched to the projection display parameters are within the high Resolution adjustment range, and the projection display mode is set based on the preset frame rate priority mode, and the user is set as a smooth projection display mode.
Specifically, a screen-projecting display mode corresponding to the upper-layer application information is determined according to a mapping relationship between preset application information and the screen-projecting display mode, the target screen-projecting display mode of the screen projection is switched to the screen-projecting display mode corresponding to the upper-layer application information, the mapping relationship between the application information and the screen-projecting display mode may be set in advance according to an actual situation, may be a mapping relationship between an application name and the screen-projecting display mode, may be a mapping relationship between an application type and the screen-projecting display mode, may be a mapping relationship between a parameter range to which a display parameter belongs and the screen-projecting display mode, and may also be a mapping relationship between an application classification determined according to a plurality of application information (for example, an application with an application type of a movie and a frame rate greater than 60fps is determined as a high-frame-rate application, an application with an application type of a game and a frame rate greater than 60fps is determined as a high-frame-rate application, etc.) and the screen-projecting display mode.
Optionally, the screen-projecting display mode includes a frame rate priority mode and a resolution priority mode, and the step of switching the target screen-projecting display mode of the screen projection to the screen-projecting display mode corresponding to the upper-layer application information includes:
step S21, judging whether the upper layer application of the screen projection pushing end is a high frame rate application or not according to the upper layer application information;
in this embodiment, specifically, whether an upper application of the screen projection pushing end is a high frame rate application is determined according to a preset classification rule and the upper application information, where the preset classification rule is a determination rule for determining whether an application is a high frame rate application, and may be to establish a high frame rate application list, and determine whether an application name or an application type in the upper application information belongs to an application name or an application type in the high frame rate application list; or setting a frame rate lower limit in advance, determining whether a frame rate in the upper layer application information is higher than the frame rate lower limit, and if the frame rate in the upper layer application information is higher than the frame rate lower limit, determining that the upper layer application is a high frame rate application.
Optionally, the upper layer application information includes an upper layer application type, and the step of determining whether the upper layer application of the screen projection pushing end is a high frame rate application according to the upper layer application information includes:
step S211, judging whether the upper layer application type belongs to a preset high frame rate application white list or not;
step S212, if the upper layer application type belongs to a preset white list of high frame rate applications, determining that the upper layer application of the screen projection pushing end is a high frame rate application.
In this embodiment, specifically, whether the upper layer application type belongs to a preset high frame rate application white list is determined, if the upper layer application type belongs to the preset high frame rate application white list, it is determined that the upper layer application of the screen projection pushing end is a high frame rate application, and if the upper layer application type does not belong to the preset high frame rate application white list, it is determined that the upper layer application of the screen projection pushing end is not a high frame rate application, where the high frame rate application white list is an application type corresponding to a high frame rate application, the application types are application classification tags, each application may belong to one or more application types, and the high frame rate application white list may be set by a system or a user according to an actual situation, for example, all games may be listed in the high frame rate application white list, or a first person shooting game and a movie with a frame rate higher than 60fps may be listed in the high frame rate application white list, and the setting of the high frame rate application white list may accurately divide the high frame rate application frame application, thereby reducing erroneous determination.
Step S22, if the upper layer application of the screen projection pushing end is determined to be the high frame rate application, switching the target screen projection display mode of the screen projection to a frame rate priority mode;
in this embodiment, specifically, if it is determined that an upper application of the screen projection pushing end is a high frame rate application, a target screen projection display mode corresponding to the screen projection is switched to a frame rate priority mode, where the frame rate priority mode is a mode in which a preset frame rate priority technique or algorithm (e.g., MEMC technique or the like) is used, so that other display parameters except for a frame rate are reduced or unchanged, so as to increase or keep the frame rate unchanged, and ensure that the frame rate is within a preset high frame rate range.
And step S23, if the upper application of the screen projection pushing end is determined not to be the high frame rate application, switching the target screen projection display mode of the screen projection to a resolution priority mode.
In this embodiment, specifically, if it is determined that the upper layer application of the screen projection pushing end is not the high frame rate application, the target screen projection display mode corresponding to the screen projection is switched to a preset resolution priority mode, where the resolution priority mode is a mode that uses a preset resolution priority technology or algorithm (e.g., AI-SR technology, AI-PQ technology, etc.) to reduce or keep other display parameters except for resolution so as to improve or keep resolution unchanged, and the resolution is guaranteed to be within a preset high resolution range.
Step S30, when receiving a screen image to be projected sent by a screen projection pushing end, carrying out image processing on the screen image to be projected according to the target screen projection display mode to obtain a target screen projection image;
in this embodiment, specifically, when an image to be projected that is sent by a projection pushing end is received, image processing is performed on the image to be projected according to an image processing algorithm corresponding to the target projection display mode, where the image to be projected may be a static image or a dynamic image, the number of the images to be projected may be one or more, the image processing includes image resolution adjustment, image frame rate adjustment, image size adjustment, image reconstruction, and the like, and the image processing algorithm includes an MEMC algorithm, an AI-SR algorithm, an AI-PQ algorithm, and the like.
Optionally, the step of performing image processing on the image to be projected according to the target screen projection display mode to obtain a target screen projection image includes:
step S31, acquiring initial display parameters corresponding to the image to be projected;
step S32, adjusting the initial display parameters according to the target screen projection display mode to obtain target display parameters;
in this embodiment, specifically, at least one initial display parameter corresponding to the image to be projected is obtained, and the initial display parameter corresponding to each image to be projected is adjusted according to an image processing algorithm corresponding to the current target projection display mode, so as to obtain a target display parameter, where the image to be projected may be a static image or a dynamic image, the number of the images to be projected may be one or more, and the display parameter is a relevant parameter for outputting and displaying the image to be projected on a display device, and includes a resolution, a frame rate, a bandwidth, and/or the like.
Optionally, the display parameters include a frame rate and a resolution, and the step of adjusting the initial display parameters according to the target screen projection display mode to obtain target display parameters includes:
step S321, if the target screen projection display mode is determined to be a frame rate priority mode, performing increase adjustment on the initial frame rate to obtain a target frame rate, and performing decrease adjustment on the initial resolution to obtain a target resolution;
in this embodiment, it should be noted that the display parameters include a frame rate and a resolution, that is, the initial display parameters include an initial frame rate and an initial resolution, and the target display parameters include a target frame rate and a target resolution.
Specifically, whether the target screen projection display mode is a frame rate priority mode is judged, if it is determined that the target screen projection display mode is the frame rate priority mode, the initial frame rate is increased and adjusted to obtain a target frame rate, and the initial resolution is decreased and adjusted to obtain a target resolution, it is easy to understand that the frame rate and the resolution can be adjusted by using a preset frame rate priority technology or algorithm, for example, an MEMC algorithm and the like, which is similar to the prior art, and therefore, redundant description is not repeated here.
For the screen-casting scenes such as the first-person shooting game and the high-frame-rate film, which have higher requirements on the frame rate, the adjustment resolution is reduced, and the adjustment frame rate is appropriately increased, so that the image processing and transmission speed can be effectively ensured, the situation of blocking or frame dropping is avoided, the frame rate can be compensated, the requirement on the higher frame rate is met, the screen-casting smoothness is effectively improved, and the screen-casting effect is improved.
Step S322, if it is determined that the target screen projection display mode is the resolution priority mode, performing reduction adjustment on the initial frame rate to obtain a target frame rate, and performing increase adjustment on the initial resolution to obtain a target resolution.
In this embodiment, specifically, whether the target screen-projection display mode is a resolution priority mode is determined, and if it is determined that the target screen-projection display mode is the resolution priority mode, the initial frame rate is decreased and adjusted to obtain the target frame rate, and the initial resolution is increased and adjusted to obtain the target resolution, it is easily understood that the manner of adjusting the frame rate and the resolution may be implemented by using a preset resolution priority technology or algorithm, for example, an AI-SR algorithm or an AI-PQ algorithm, and the AI-SR algorithm and the AI-PQ algorithm are similar to the prior art, and thus, redundant description is not repeated here.
For the screen projection scenes such as pictures and films with lower frame rates, the frame rate is properly reduced, and the resolution is properly adjusted, so that the image processing and transmission speed can be effectively guaranteed, the image blocking condition is avoided, the resolution of the images can be improved, the resolution of the original images is effectively improved, the images are clearer, and the screen projection effect is improved.
And S33, performing image processing on the image to be projected according to the target display parameters to obtain a target screen projection image.
In this embodiment, specifically, the image to be projected is subjected to image processing according to the target display parameter, so as to obtain a target projection image with a display parameter as the target display parameter.
And S40, outputting the target screen projection image.
In this embodiment, specifically, the target screen projection image is output and displayed through a display device corresponding to the screen projection receiving end.
In an implementation manner, referring to fig. 4, the screen projection receiving end includes a television 400 and a screen projector receiver 300, the television 400 is in communication connection with the screen projector receiver 300, the screen projection pushing end includes a mobile phone 100 and a screen projector transmitter 200, the mobile phone 100 is in communication connection with the screen projector transmitter 200, the screen projector receiver 300 is in communication connection with the screen projector transmitter 200, in a process that the mobile phone 100 projects a screen to the television 400, the screen projector transmitter 200 acquires upper layer application information of the mobile phone 100 and transmits the upper layer application information to the screen projector receiver 300, the screen projector receiver 300 switches a target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper layer application information, the screen projector transmitter 200 synchronously transmits a screen picture and sound of the mobile phone 100 to the screen projector receiver 300, the screen projector receiver 300 transmits the received screen picture and sound of the mobile phone 100 to the television 400 for display and sound playing, and when the screen projector receiver 300 receives the screen projector transmits the screen projector to the target screen projector receiver 200, the target screen image is projected and the target image is output according to the target screen image to be projected.
In this embodiment, by acquiring the upper layer application information of the screen projection pushing end, the target screen projection display mode of the screen projection is switched to the screen projection display mode corresponding to the upper layer application information, so that the target screen projection display mode is switched according to the upper layer application of the screen projection pushing end, and then when the screen image to be projected sent by the screen projection pushing end is received, the screen image to be projected is subjected to image processing according to the target screen projection display mode, so as to obtain a target screen projection image, and the target screen projection image is output, so that the screen image to be projected of the screen is subjected to image processing according to the target screen projection display mode, that is, the image processing is performed on the screen image to be projected of the screen projection according to the upper layer application of the screen projection pushing end, so that the output target screen projection image is adaptively adjusted according to the difference of the upper layer application, thereby not only different display requirements of different upper layer applications can be met, but also the processing speed of the screen image to be projected can be effectively improved, further, the conditions that the screen projection cards may be dropped in the process, and the display effect of the prior art is effectively improved.
Further, in another embodiment of the screen projection image display method according to the present application, with reference to fig. 5, after the step of outputting the target screen projection image, the method further includes:
step A10, monitoring whether image frame loss occurs in the screen projection process in real time;
in this embodiment, specifically, in a process of screen projection from a screen projection pushing end to a screen projection receiving end, whether image frame loss occurs or not is monitored in real time, where the image frame loss is a phenomenon that the number of image frames output by the screen projection receiving end is less than a theoretical output frame number, such as a jam or a frame drop, and whether image frame loss occurs or not is monitored by monitoring whether data abnormality occurs in an image processing and image transmission process or not, whether image frame loss occurs or not is judged by obtaining fluency parameters such as a packet loss rate and an image processing speed in the screen projection process, calculating and comparing according to the fluency parameters, and whether image frame loss occurs or not is judged by comparing and detecting similarities between output image frames.
Step A20, when the image frame loss is detected in the screen projection process, switching the screen projection display mode of the screen projection to a frame rate priority mode.
In this embodiment, specifically, when it is detected that an image frame is lost in the screen projection process, the screen projection display mode of the screen projection is switched to a frame rate priority mode, so as to perform reduction adjustment on a target resolution corresponding to the target screen projection image, and perform increase adjustment on a target frame rate corresponding to the target screen projection image, so that by reducing and adjusting the resolution of the target screen projection image, loads of image processing and image transmission can be effectively reduced, image processing and image transmission speeds can be improved, and by increasing and adjusting the frame rate of the target screen projection image, frame rate compensation can be performed on the condition that the image frame is lost due to an excessive image processing or image transmission load, so that a screen projection display effect can be effectively improved, and screen projection experience can be improved.
Further, in another embodiment of the screen projection image display method according to the present application, with reference to fig. 6, after the step of outputting the target screen projection image, the method further includes:
step B10, monitoring whether the change rate of the target screen projection image is smaller than a preset change rate or not in real time;
in this embodiment, specifically, in the process of projecting a screen to a screen projection receiving end by a screen projection pushing end, similarity between a preset number of consecutive image frames in the image to be projected is compared, a change rate of the target screen projection image is determined according to the similarity, and whether the change rate is smaller than a preset change rate is determined, where a manner of determining the change rate of the target screen projection image according to the similarity may be to use the similarity as the change rate, or may be to further calculate the change rate through a preset change rate algorithm according to the similarity, which is not limited in this embodiment.
And B20, when detecting whether the change rate of the target screen projection image is smaller than a preset change rate, switching the target screen projection display mode of the screen projection to a resolution priority mode.
In this embodiment, specifically, when it is detected whether the change rate of the target screen projection image is smaller than a preset change rate, the screen projection display mode of the screen projection is switched to a resolution priority mode, so as to perform a decrease-increase adjustment on the target resolution corresponding to the target screen projection image, and perform a decrease-adjustment on the target frame rate corresponding to the target screen projection image, when the change rate of the target screen projection image is smaller, the screen projection content at this time may be a picture, a non-high frame rate movie, and the like.
Further, an embodiment of the present application further provides a screen projection image display apparatus, and with reference to fig. 7, the screen projection image display apparatus is applied to a screen projection image display device, and the screen projection image display apparatus includes:
an obtaining module 10, configured to obtain upper layer application information of the screen projection pushing end;
a mode switching module 20, configured to determine a target screen projection display mode corresponding to the upper layer application information;
the image processing module 30 is configured to, when receiving a to-be-projected image sent by a screen projection pushing end, obtain an initial display parameter corresponding to the to-be-projected image;
and the output module 40 is configured to adjust the initial display parameters according to the target screen projection display mode to obtain target display parameters, and output the to-be-projected screen image based on the target display parameters.
Optionally, the mode switching module 20 is further configured to:
judging whether the upper layer application of the screen projection pushing end is a high frame rate application or not according to the upper layer application information;
and if the upper layer application of the screen projection pushing end is determined to be the high frame rate application, determining a preset frame rate priority mode as a target screen projection display mode.
Optionally, the mode switching module 20 is further configured to:
and if the upper application of the screen projection pushing end is determined not to be the high frame rate application, determining a preset resolution priority mode as a target screen projection display mode.
Optionally, the output module 40 is further configured to:
judging whether the target screen projection display mode is a frame rate priority mode or not;
and if the target screen projection display mode is determined to be a frame rate priority mode, carrying out constant or increasing adjustment on the initial frame rate to obtain a target frame rate, and carrying out constant or decreasing adjustment on the initial resolution to obtain a target resolution.
Optionally, the output module 40 is further configured to:
judging whether the target screen projection display mode is a resolution priority mode or not;
and if the target screen projection display mode is determined to be a resolution priority mode, carrying out constant or decreasing adjustment on the initial frame rate to obtain a target frame rate, and carrying out constant or increasing adjustment on the initial resolution to obtain a target resolution.
Optionally, the screen projection image display apparatus further includes a monitoring module, further configured to:
monitoring whether the image frame is lost or not in the screen projection process in real time;
and when the image frame loss is detected in the screen projection process, adjusting the target display parameters according to the target screen projection display mode.
Optionally, the monitoring module is further configured to:
if the target screen projection display mode is determined to be a frame rate priority mode, reducing and adjusting the target resolution to obtain a new target resolution;
and if the target screen projection display mode is determined to be a resolution priority mode, reducing and adjusting the target frame rate to obtain a new target frame rate.
The screen-projecting image display device provided by the invention adopts the screen-projecting image display method in the embodiment, and solves the technical problem of poor screen-projecting display effect in the prior art. Compared with the prior art, the beneficial effects of the projected image display device provided by the embodiment of the invention are the same as the beneficial effects of the projected image display method provided by the embodiment, and other technical features of the projected image display device are the same as those disclosed by the embodiment method, which are not repeated herein.
Further, the present application also provides a computer program product comprising a computer program which, when being executed by a processor, realizes the steps of the projected image display method as described above.
The computer program product provided by the application solves the technical problem that the screen projection display effect is poor in the prior art. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the invention are the same as the beneficial effects of the screen projection image display method provided by the embodiment, and details are not repeated herein.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.
Claims (8)
1. A screen-projected image display method is characterized by comprising the following steps:
acquiring upper-layer application information of a screen projection pushing end;
switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper application information;
when receiving a screen image to be projected sent by a screen projection pushing end, carrying out image processing on the screen image to be projected according to the target screen projection display mode to obtain a target screen projection image, wherein the image processing comprises image resolution adjustment and image frame rate adjustment;
outputting the target screen projection image;
wherein, after the step of outputting the target screen projection image, the method further comprises:
monitoring whether image frame loss occurs in the screen projection process in real time;
when the image frame loss is detected in the screen projection process, switching a screen projection display mode of the screen projection to a frame rate priority mode so as to reduce and adjust the target resolution corresponding to the target screen projection image and increase and adjust the target frame rate corresponding to the target screen projection image;
after the step of outputting the target screen projection image, the method further comprises the following steps:
comparing the similarity between a preset number of continuous image frames in the image to be projected, determining the change rate of the target screen projection image according to the similarity, and monitoring whether the change rate of the target screen projection image is smaller than a preset change rate in real time;
when the change rate of the target screen projection image is smaller than the preset change rate, switching the screen projection target display mode to a resolution priority mode to increase and adjust the target resolution corresponding to the target screen projection image and decrease and adjust the target frame rate corresponding to the target screen projection image.
2. The screen-projected image display method of claim 1, wherein the step of performing image processing on the image to be projected according to the target screen-projected display mode to obtain a target screen-projected image comprises:
acquiring initial display parameters corresponding to the image to be projected;
adjusting the initial display parameters according to the target screen projection display mode to obtain target display parameters;
and carrying out image processing on the image to be projected according to the target display parameters to obtain a target screen projection image.
3. The method for displaying a projected image according to claim 2, wherein the display parameters include a frame rate and a resolution, and the step of adjusting the initial display parameters according to the target projected display mode to obtain the target display parameters comprises:
if the target screen projection display mode is determined to be a frame rate priority mode, increasing and adjusting the initial frame rate to obtain a target frame rate, and decreasing and adjusting the initial resolution to obtain a target resolution;
and if the target screen projection display mode is determined to be a resolution priority mode, reducing and adjusting the initial frame rate to obtain a target frame rate, and increasing and adjusting the initial resolution to obtain a target resolution.
4. The method for displaying a projected image according to claim 1, wherein the projected display mode includes a frame rate priority mode and a resolution priority mode, and the step of switching the target projected display mode of the projected screen to the projected display mode corresponding to the upper layer application information includes:
judging whether the upper layer application of the screen projection pushing end is a high frame rate application or not according to the upper layer application information;
if the upper-layer application of the screen projection pushing end is determined to be the high frame rate application, switching the target screen projection display mode of the screen projection to a frame rate priority mode;
and if the upper application of the screen projection pushing end is determined not to be the high frame rate application, switching the target screen projection display mode of the screen projection to a resolution priority mode.
5. The method for displaying the screen-projected image according to claim 4, wherein the upper layer application information includes an upper layer application type, and the step of determining whether the upper layer application of the screen-projected push terminal is a high frame rate application according to the upper layer application information includes:
judging whether the upper layer application type belongs to a preset high frame rate application white list or not;
and if the upper layer application type belongs to a preset high frame rate application white list, judging that the upper layer application of the screen projection pushing end is the high frame rate application.
6. A screen-projected image display apparatus, comprising:
the acquisition module is used for acquiring upper-layer application information of the screen projection pushing end;
the mode switching module is used for switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper-layer application information;
the image processing module is used for carrying out image processing on the screen image to be projected according to the target screen projection display mode when the screen image to be projected sent by the screen projection pushing end is received, so as to obtain a target screen projection image;
the output module is used for outputting the target screen projection image, wherein the image processing comprises image resolution adjustment and image frame rate adjustment;
the monitoring module is used for monitoring whether the image frame is lost in the screen projection process in real time; when the image frame loss occurs in the screen projection process, adjusting target display parameters according to the target screen projection display mode so as to reduce and adjust the target resolution ratio corresponding to the target screen projection image and increase and adjust the target frame rate corresponding to the target screen projection image;
the monitoring module is further used for comparing the similarity among a preset number of continuous image frames in the image to be projected, determining the change rate of the target screen projected image according to the similarity, and monitoring whether the change rate of the target screen projected image is smaller than a preset change rate in real time; and when detecting that the change rate of the target screen projection image is smaller than a preset change rate, switching the target screen projection display mode of the screen projection to a resolution priority mode.
7. An electronic device, characterized in that the electronic device comprises:
at least one processor; and (c) a second step of,
a memory communicatively coupled to the at least one processor; wherein, the first and the second end of the pipe are connected with each other,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the projected image display method of any of claims 1 to 5.
8. A storage medium, characterized in that the storage medium is a computer-readable storage medium having stored thereon a program for implementing a projected image display method, the program being executed by a processor to implement the steps of the projected image display method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210189624.7A CN114647468B (en) | 2022-02-28 | 2022-02-28 | Screen projection image display method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210189624.7A CN114647468B (en) | 2022-02-28 | 2022-02-28 | Screen projection image display method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114647468A CN114647468A (en) | 2022-06-21 |
| CN114647468B true CN114647468B (en) | 2023-04-07 |
Family
ID=81993257
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210189624.7A Active CN114647468B (en) | 2022-02-28 | 2022-02-28 | Screen projection image display method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114647468B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117560534A (en) * | 2022-08-05 | 2024-02-13 | 华为技术有限公司 | Multi-window screen projection method, electronic equipment and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112019897B (en) * | 2020-08-27 | 2022-11-08 | 北京字节跳动网络技术有限公司 | Screen projection method and device, electronic equipment and computer readable medium |
| CN113556598A (en) * | 2020-09-10 | 2021-10-26 | 华为终端有限公司 | Multi-window screen projection method and electronic equipment |
| CN112667181A (en) * | 2020-12-31 | 2021-04-16 | 努比亚技术有限公司 | Screen projection method, screen projection equipment, screen projection control system and storage medium |
| CN112822538A (en) * | 2020-12-31 | 2021-05-18 | 努比亚技术有限公司 | Screen projection display method, screen projection device, terminal and storage medium |
-
2022
- 2022-02-28 CN CN202210189624.7A patent/CN114647468B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN114647468A (en) | 2022-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11321906B2 (en) | Asynchronous time and space warp with determination of region of interest | |
| WO2021147657A1 (en) | Frame interpolation processing method and related product | |
| WO2019153671A1 (en) | Image super-resolution method and apparatus, and computer readable storage medium | |
| US10270966B2 (en) | Profiles identifying camera capabilities | |
| CN108234894B (en) | Exposure adjusting method and terminal equipment | |
| CN109462745B (en) | White balance processing method and mobile terminal | |
| WO2022048424A1 (en) | Screen picture adaptive adjustment method, apparatus and device, and storage medium | |
| CN109348019B (en) | Display method and device | |
| CN110213484B (en) | Photographing method, terminal equipment and computer readable storage medium | |
| CN110868544B (en) | Shooting method and electronic equipment | |
| CN114428598A (en) | Screen projection method and device, electronic equipment and storage medium | |
| CN111432261A (en) | Video window picture display method and device | |
| US20220312057A1 (en) | Method and device for transmitting video content by using edge computing service | |
| WO2023160617A9 (en) | Video frame interpolation processing method, video frame interpolation processing device, and readable storage medium | |
| CN114647468B (en) | Screen projection image display method and device, electronic equipment and storage medium | |
| US20220172440A1 (en) | Extended field of view generation for split-rendering for virtual reality streaming | |
| JP6058257B2 (en) | Image output apparatus, image output method, and program | |
| CN114489549B (en) | Screen projection image processing method and device, electronic equipment and storage medium | |
| CN112905132B (en) | Screen projection method and device | |
| CN111010514B (en) | Image processing method and electronic equipment | |
| CN109561258B (en) | Light supplementing method and terminal equipment | |
| WO2021036551A1 (en) | Power consumption adjustment method and device, and computer-readable storage medium | |
| WO2021258608A1 (en) | Bandwidth determination method and apparatus, and terminal, and storage medium | |
| CN114690894A (en) | Method and device for realizing display processing, computer storage medium and terminal | |
| CN114428596B (en) | Screen projection display method, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |