CN115097926A - Screen projection method, device, equipment, system and storage medium - Google Patents

Screen projection method, device, equipment, system and storage medium Download PDF

Info

Publication number
CN115097926A
CN115097926A CN202210684186.1A CN202210684186A CN115097926A CN 115097926 A CN115097926 A CN 115097926A CN 202210684186 A CN202210684186 A CN 202210684186A CN 115097926 A CN115097926 A CN 115097926A
Authority
CN
China
Prior art keywords
screen
duration
brightness
state
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210684186.1A
Other languages
Chinese (zh)
Other versions
CN115097926B (en
Inventor
刘光磊
张伟
王琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202210684186.1A priority Critical patent/CN115097926B/en
Publication of CN115097926A publication Critical patent/CN115097926A/en
Priority to PCT/CN2022/143554 priority patent/WO2023241009A1/en
Application granted granted Critical
Publication of CN115097926B publication Critical patent/CN115097926B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3265Power saving in display device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3228Monitoring task completion, e.g. by use of idle timers, stop commands or wait commands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The embodiment of the application discloses a screen projection method, a screen projection device, screen projection equipment, a screen projection system and a storage medium, and belongs to the technical field of screen projection. The method comprises the following steps: in a screen throwing state, setting a screen extinguishing time length from a first time length to a second time length, wherein the screen extinguishing time length is the time length when the source end equipment automatically enters the screen extinguishing state, and the second time length is longer than the first time length; controlling the screen to be extinguished under the condition that the target duration is reached, wherein the source end device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration; and under the condition that the screen is extinguished and the second duration is not reached, the transmission of the screen-casting data stream between the screen and the destination terminal equipment is kept. By adopting the scheme provided by the embodiment of the application, the source end equipment can automatically prolong the screen-off duration in the screen-on state, and keep screen-on data stream transmission with the destination end equipment under the condition that the screen is turned off but does not enter the screen-off state.

Description

Screen projection method, device, equipment, system and storage medium
Technical Field
The embodiment of the application relates to the technical field of screen projection, in particular to a screen projection method, device, equipment, system and storage medium.
Background
In order to meet the demand of people on screen projection display, the mirror image screen projection technology is continuously developed.
In the related art, in the process of performing mirror image projection, a source device needs to be always kept in a bright screen state, once the source device enters a screen-off state, a projection screen picture of a destination device is interrupted, which results in poor screen projection experience of a user, and the source device is always kept in the bright screen state, which results in increased power consumption of the source device.
Disclosure of Invention
The embodiment of the application provides a screen projection method, a screen projection device, screen projection equipment and a storage medium. The technical scheme is as follows:
in one aspect, an embodiment of the present application provides a screen projection method, where the method is performed by a source device, and the method includes:
in a screen throwing state, setting a screen extinguishing time length from a first time length to a second time length, wherein the screen extinguishing time length is the time length when the source end equipment automatically enters the screen extinguishing state, and the second time length is longer than the first time length;
under the condition that a target duration is reached, controlling a screen to be extinguished, wherein the source end device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration;
and under the condition that the screen is extinguished and the second time length is not reached, the screen projection data stream transmission between the screen and the destination terminal equipment is kept.
In another aspect, an embodiment of the present application provides a screen projection apparatus, including:
the time length setting module is used for setting the screen off time length from a first time length to a second time length in the screen throwing state, wherein the screen off time length is the time length for the source end equipment to automatically enter the screen off state, and the second time length is greater than the first time length;
the screen control module is used for controlling the screen to be extinguished under the condition that the target duration is reached, wherein the source end device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration;
and the data transmission module is used for keeping screen projection data stream transmission with the destination terminal equipment under the condition that the screen is extinguished and the second duration is not reached.
On the other hand, the embodiment of the application provides a screen projection system, which comprises a source end device and a destination end device;
the source end device is configured to set a screen-off duration from a first duration to a second duration in a screen-on state, where the screen-off duration is a duration when the source end device automatically enters the screen-off state, and the second duration is greater than the first duration; controlling the screen to be extinguished under the condition that the target duration is reached, wherein the source end device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration; under the condition that the screen is extinguished and the second duration is not reached, screen projection data stream transmission between the device and the destination terminal is kept;
the destination device is used for receiving the audio and video data stream transmitted by the source device under the condition that the screen projection data stream between the destination device and the source device keeps transmitting; and playing screen projection content based on the audio and video data stream.
In another aspect, an embodiment of the present application provides a computer device, which includes a processor and a memory; the memory stores at least one instruction for execution by the processor to implement a screen projection method as described in the above aspect.
In another aspect, the present invention provides a computer-readable storage medium, in which at least one program code is stored, and the program code is loaded and executed by a processor to implement the screen projection method according to the above aspect.
In another aspect, embodiments of the present application provide a computer program product including computer instructions, which are stored in a computer-readable storage medium. The computer instructions are read by a processor of the computer device from a computer-readable storage medium, and the computer instructions are executed by the processor to cause the computer device to execute the screen projection method provided in the various alternative implementations of the above aspects.
In the embodiment of the application, in a screen-casting state, the screen-off time of the source end device automatically entering the screen-off state is prolonged from a first time to a second time, and the screen is controlled to be turned off when a target time is reached, wherein the target time is shorter than the second time. By adopting the scheme provided by the embodiment of the application, the source end equipment can automatically prolong the screen-off time in the screen-off state, and can keep the screen-casting data stream transmission with the target end equipment under the condition that the screen is turned off but does not enter the screen-off state, so that the normal screen casting between the source end equipment and the target end equipment is ensured, the power consumption increase of the source end equipment due to long-time screen lightening can be avoided, and the power consumption of the source end equipment in the screen casting process can be reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 illustrates a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;
FIG. 2 illustrates a flow chart of a screen projection method provided by an exemplary embodiment of the present application;
FIG. 3 is a diagram illustrating an implementation of a screen blanking for a duration of time to reach target according to an exemplary embodiment of the present application;
FIG. 4 illustrates a flow chart of a screen projection method provided by another exemplary embodiment of the present application;
FIG. 5 is a diagram illustrating an implementation of controlling screen brightness in accordance with an exemplary embodiment of the present application;
FIG. 6 is a flowchart of a screen after blanking in a screen-in state provided by another exemplary embodiment of the present application;
FIG. 7 is a flowchart of entering a lock-out state provided by another exemplary embodiment of the present application;
FIG. 8 is a schematic diagram illustrating an implementation of resuming the transmission of a projected data stream after an unlocking is successful according to another exemplary embodiment of the present application;
fig. 9 is a flowchart illustrating operations in a screen-locked and screen-off state during a screen projection process according to another exemplary embodiment of the present application;
FIG. 10 is a general operational flow diagram for entering a screen projection state as provided by another exemplary embodiment of the present application;
FIG. 11 is a block diagram of a screen projection system provided in an exemplary embodiment of the present application;
FIG. 12 is a block diagram of a screen projection device provided in an exemplary embodiment of the present application;
fig. 13 is a block diagram illustrating a computer device according to an exemplary embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Reference herein to "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
In the related art, in the process of a source device projecting a screen to a destination device, the source device needs to always keep a screen-on working state, and once the source device enters a screen-off state, the source device interrupts the connection with the destination device to finish the screen projection.
In a possible scenario, in the process of performing mirror image screen projection on a destination device by a source device, when a user operates a screen projection picture through the destination device and does not operate any more through the source device, the source device still needs to keep a screen-on state, and once the source device enters a screen-off state, the connection between the source device and the destination device is interrupted, and then screen projection fails. Therefore, in the screen projection process, a user needs to intermittently operate the source device (for example, perform a touch screen operation), or manually close an automatic screen-off function of the source device, so as to prevent the source device from entering a screen-off state. However, the source device remaining in the bright state may cause an increase in power consumption, increasing power consumption.
In the embodiment of the application, aiming at the problems, in the process of screen projection, the source end equipment automatically prolongs the screen extinguishing time, and controls the screen to extinguish under the condition of not reaching the screen extinguishing time after prolonging, so that the screen projection data stream transmission between the source end equipment and the target end equipment can be maintained under the condition of only extinguishing the screen without entering the screen extinguishing state, the power consumption of the source end equipment is reduced, and the screen projection interruption caused by the fact that the source end equipment automatically enters the screen extinguishing state is avoided.
FIG. 1 is a diagram illustrating an implementation environment provided by an exemplary embodiment of the present application. The implementation environment includes a source end device 101 and a destination end device 102.
The source device 101 is an electronic device having a screen projection function, where the screen projection function may be a native application in the electronic device, or a function of a third-party application; the destination device 102 is an electronic device with a screen projection display function, wherein the screen projection display function may be a native application in the electronic device or a function of a third-party application. The electronic device may be a smart phone, a tablet computer, a personal computer, a wearable device, a vehicle-mounted terminal, or the like, and in fig. 1, the source device 101 is a smart phone, and the destination device 102 is a television terminal, for example, but not limited thereto.
In one possible implementation, the source device 101 and the destination device 102 are located under the same local area network, and perform screen-casting data stream transmission through the local area network.
As shown in fig. 1, a source device 101 and a destination device 102 are simultaneously connected to the same local area network provided by a router 103, so that the router 103 performs screen-casting data stream transmission.
In the process that the source device 101 projects a screen to the destination device 102, the source device 101 records a screen and collects device audio, so that the recorded screen and the audio are encoded to generate an audio-video data stream, the audio-video data stream is transmitted to the destination device 102 through the router 103, and the audio-video data stream is decoded and played by the destination device 102. In addition, when the reverse control function is supported, the destination device 102 may transmit a reverse control instruction to the source device 101 through the router 103, and the source device 101 executes a corresponding reverse control operation according to the reverse control instruction.
It should be noted that, the source device 101 and the destination device 102 may be connected to the same local area network at the same time, or may be connected to the same router at the same time in other possible manners, which is not limited in this embodiment of the present application. In other possible embodiments, the source device 101 and the destination device 102 may also project screens through the internet, which is not limited in this embodiment.
In addition, the source device 101 may transmit the screen projection data streams to a plurality of destination devices 102 having the screen projection function at the same time (i.e., one-to-many screen projection), and the destination device 102 may also receive the screen projection data streams of a plurality of source devices 101 at the same time (i.e., many-to-one screen projection).
Referring to fig. 2, a flowchart of a screen projection method provided by an exemplary embodiment of the present application is shown. In this embodiment, taking the method as an example for being used in the source device shown in fig. 1, the method may include the following steps:
step 201, in the screen-throwing state, setting the screen-off duration from the first duration to a second duration, where the screen-off duration is a duration when the source end device automatically enters the screen-off state, and the second duration is greater than the first duration.
Since the power consumption is increased when the source device still maintains the screen lighting state when the screen keep-on operation (for example, a touch screen operation) or an event (for example, an incoming call notification) is not received for a long time, in order to reduce the power consumption, the source device may set a screen-off duration, and automatically enter the screen-off state when the screen-off duration is reached.
In the screen-off state, the source device turns down or closes the output of a part of voltage, stores running application data in a memory, monitors an application switched to background running, turns off the screen and keeps the screen to enter a locked state. And only after receiving the unlocking operation of the screen, the source device can lighten the screen and continue the running of the application in the foreground.
Optionally, in a non-screen-projection state, the screen-off duration of the source end device is set to be the first duration. Namely, in a non-screen-projection state, if no screen-on-hold operation or event is received within a first time period, the source end device automatically enters a screen-off state.
In order to avoid that the source end device automatically enters the screen-off state when the screen-on keeping operation or event is not received after the first duration is reached in the screen-throwing state, the source end device automatically sets the screen-off duration from the first duration to a second duration while entering the screen-throwing state, wherein the second duration is greater than the first duration. By setting the second duration, the time that the source end equipment automatically enters the screen-off state can be prolonged, and the problem of screen projection interruption caused by the fact that the source end equipment enters the screen-off state in a short time is avoided.
Optionally, the second duration may be a maximum value of candidate values of the screen-off duration that is set by the source device support, for example, the second duration is a maximum integer (int). Or, when the source end device closes the automatic screen-off function, and the screen-off duration is set to the second duration, the source end device will not enter the screen-off state, that is, the automatic screen-off function is closed.
Optionally, the screen projection state refers to a mirror screen projection state. The source terminal device records the screen to obtain a screen recording picture, and the target terminal device displays the screen recording picture.
Illustratively, as shown in fig. 3, in a non-screen projection state, a duration that the source device 301 automatically enters the screen-off state is 2 minutes, and when the screen projection function is started to project a screen onto the destination device 302, the duration that the source device 301 automatically enters the screen-off state is extended to an integer (int) maximum, so that the source device 301 will not enter the screen-off state, that is, the screen-off function is automatically turned off.
Step 202, controlling the screen to be extinguished under the condition that the target duration is reached, wherein the source device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration.
Different from the related art, after the source device prolongs the automatic screen-off time, the screen is always in a bright screen state. In this embodiment, in order to reduce power consumption of the source end device, on the premise of prolonging the screen-off duration, the source end device can control the screen to be extinguished without entering the screen-off state when the target duration is reached, so as to reduce power consumption.
Optionally, the target duration is shorter than the second duration, and may be the first duration, or may be other durations shorter than the second duration. When the target duration is the first duration, the duration of turning off the control screen is the same as the duration of automatically entering the screen-off state of the source end device, so that a process similar to the turning off of the control screen entering the screen-off state is provided for a user, and in terms of user experience, the turning off process of the screen of the source end device is consistent with the turning off process of the screen entering the screen-off state.
In one possible implementation, the source device sets a countdown timer whose countdown duration is the target duration, and after the countdown timer expires, the control screen goes off.
In the above process, since the screen-off duration of the source end device is prolonged, the source end device will not automatically enter the screen-off state under the condition that the second duration is not reached. And through reaching the long condition of target duration, the source end equipment can control the screen to extinguish, has not only avoided source end equipment consumption too big, and in addition to user experience, the process that the source end equipment screen was extinguish is similar with the process that the screen was extinguish when getting into the state of extinguishing the screen.
Optionally, the manner of controlling the screen to be turned off may be to turn the screen brightness to zero, or may also be to stop power supply to the screen alone, which is not limited in this embodiment of the application.
In a possible implementation manner, the source device controls the screen to be extinguished, and does not enter the screen-extinguished state, and the screen is in the unlocked state, while the source device maintains the screen-recording and screen-projecting state.
Illustratively, as shown in fig. 3, in a case where no operation is received within 2 minutes, the source device 301 extinguishes the screen, does not enter the screen-off state, and remains in the screen-casting state.
And step 203, keeping the transmission of the screen projection data stream between the terminal device and the destination terminal device under the condition that the screen is extinguished and the second duration is not reached.
Under the condition that the screen is extinguished and the second duration is not reached, the source device does not enter the screen extinguishing state, so that the source device can maintain the transmission of the screen casting data stream with the destination device, wherein the screen casting data stream includes the audio and video data stream sent by the source device to the destination device and the reverse control instruction sent by the destination device to the source device.
Illustratively, as shown in fig. 3, when the extended screen-off duration is not reached, the source device 301 continues to maintain the screen-casting data stream transmission with the destination device 302, and the destination device 302 continues to display the screen recording picture.
In summary, in the embodiment of the present application, in the screen-casting state, the screen-off duration that the source device automatically enters the screen-off state is extended from the first duration to the second duration, and the screen is controlled to be extinguished when the target duration is reached, where the target duration is shorter than the second duration. By adopting the scheme provided by the embodiment of the application, the source end equipment can automatically prolong the screen-off time under the screen-on state, and the screen-on data stream transmission between the source end equipment and the destination end equipment is kept under the condition that the screen is turned off but does not enter the screen-off state, so that the normal screen-on between the source end equipment and the destination end equipment is ensured, the power consumption increase of the source end equipment caused by long-time screen lightening can be avoided, and the power consumption of the source end equipment in the screen-on process can be reduced.
In general, the process of automatically entering the screen-off state from the screen-on state of the source device includes the process of turning off the screen from the screen-on state to the screen-off state. In the embodiment of the present application, in order to improve user experience, a process of turning off a control screen of a source device may be consistent with a screen turning-off process that is expressed when the source device automatically enters a screen turning-off state, and a process of turning off the control screen of the source device and a working state under the screen turning-off condition are described in detail through a specific embodiment below.
Referring to fig. 4, a flowchart of a screen projection method provided by another exemplary embodiment of the present application is shown. In this embodiment, taking the method as an example for being used in the source device shown in fig. 1, the method may include the following steps:
step 401, in a screen-throwing state, setting a screen-off duration from a first duration to a second duration, where the screen-off duration is a duration that a source end device automatically enters a screen-off state, and the second duration is greater than the first duration.
The step 201 may be referred to in the implementation manner of this step, and this embodiment is not described herein again.
Step 402, under the condition that the third time length is reached, the screen brightness is adjusted from the first brightness to a second brightness, the third time length is less than the target time length, and the second brightness is less than the first brightness.
According to a screen extinguishing process expressed in the process that the source end device automatically enters the screen extinguishing state under the normal condition, the source end device sets a third time length, and under the condition that the third time length is reached, the source end device adjusts the screen brightness from the first brightness to the second brightness, so that the process that the screen becomes dark in the process that the source end device automatically enters the screen extinguishing state is simulated.
Optionally, the difference between the third time length and the target time length is a fixed value. For example, the fixed value is 5 seconds, and when the target time period is 1 minute, the third time period is 55 seconds; when the target time period is 30 seconds, the third time period is 25 seconds. In one possible implementation, the source device determines the third time length based on the target time length and the fixed value, thereby setting a countdown timer with the countdown time length being the third time length, and starts the countdown timer, thereby adjusting the screen brightness from the first brightness to the second brightness when the countdown timer expires.
In order to ensure the screen display effect under different environments, a user generally sets the brightness adjustment mode of the screen to a first adjustment mode (or called an automatic adjustment mode). Under the first adjusting mode, the function of automatically adjusting the screen brightness based on the ambient light brightness is turned on, the source end device automatically adjusts the screen brightness according to the ambient light brightness (which can be acquired by an ambient light sensor) of the environment where the source end device is located, and under the condition that the user manually adjusts the screen brightness, the source end device still adjusts the screen brightness according to the ambient light brightness of the environment where the source end device is located. In this embodiment of the present application, since the screen brightness needs to be adjusted from the first brightness to the second brightness, in order to ensure normal execution of the screen brightness adjustment process (the adjusted second brightness will not be changed due to the first adjustment mode), in a possible implementation manner, the brightness adjustment process may include the following steps:
1. in the case where the brightness adjustment mode is the first adjustment mode, the brightness adjustment mode is set to the second adjustment mode.
In one possible implementation, the source device determines the current brightness adjustment mode. If the current brightness adjusting mode is the first adjusting mode, the brightness adjusting mode is modified into a second adjusting mode (or called as a manual adjusting mode), wherein in the second adjusting mode, the function of automatically adjusting the screen brightness based on the ambient light brightness is turned off, the source end device does not automatically adjust the screen brightness according to the ambient light brightness, and in the case that the user manually adjusts the screen brightness, the source end device does not adjust the screen brightness according to the ambient light brightness of the environment where the source end device is located. And if the current brightness adjusting mode is the second adjusting mode, keeping the second adjusting mode.
It should be noted that the setting process of the brightness adjustment mode is automatically performed by the source device in the background, and is not perceived by the user side.
2. And in the second adjusting mode, the screen brightness is automatically adjusted from the first brightness to the second brightness.
Further, in the second adjusting mode, the source device automatically adjusts the screen brightness from the first brightness to the second brightness. Since the screen brightness does not change with the change of the ambient light brightness in the second adjustment mode, the screen brightness will not change after being set to the second brightness.
It should be noted that, in the case that the initial brightness adjustment mode of the source device is the second adjustment mode, the source device directly adjusts the first brightness to the second brightness.
In some embodiments, the second brightness is a fixed value, and the second brightness is the brightness of the screen after the brightness of the screen is reduced before the screen-off state is normally entered. For example, the second luminance is 50 nit.
In one illustrative example, when the target time period is 1 minute, the source device sets the brightness adjustment mode to the second adjustment mode when 55 seconds are reached, and adjusts the screen brightness from 1000nit to 50 nit.
In the normal automatic screen-off process, before entering the screen-off state, if a user operates the device or the device receives a specific notification, the device needs to keep on the screen. In order to simulate the effect, in a possible implementation manner, the source end device monitors a target event in a screen projection state, and when the third duration is reached and the target event is not monitored, the source end device adjusts the screen brightness from the first brightness to the second brightness, where the target event has a function of keeping a screen of the source end device in a bright screen state.
Optionally, the target event may be an incoming call notification, a message prompt, a touch screen operation, a voice control instruction, and the like, which is not limited in this embodiment of the application.
Optionally, if the target event is monitored under the condition that the third duration is not reached, the source end device responds to the target event and maintains the first brightness.
In one possible implementation, the source device sets a countdown timer with a third duration, and starts the countdown timer. If the target event is not monitored in the countdown process, adjusting the screen brightness to be the second brightness after the countdown timer expires; if the target event is monitored in the countdown process, resetting the countdown timer when the target event is monitored, and keeping the screen brightness as the first brightness.
Illustratively, as shown in fig. 5, the source end device 501 sets the target duration to be 1 minute, the third duration to be 55 seconds, and when the third duration is reached and the touch operation and the incoming call notification are not monitored, the source end device 501 adjusts the screen brightness from the first brightness 1000nit to the second brightness 50 nit.
In a possible implementation manner, in the case that the third duration is reached and the target duration is not reached, and the target event is monitored, the source device adjusts the screen brightness to the first brightness.
And when the third duration is reached and the target duration is not reached, the source end device monitors the target event, and in order to facilitate subsequent operation processing of the user, the source end device restores the screen brightness to the first brightness.
Illustratively, as shown in fig. 5, in the case that the source device 501 monitors a touch screen operation, the screen brightness is adjusted from 50nit to 1000nit, so as to facilitate the user to perform subsequent operation processing.
And step 403, controlling the screen to be extinguished under the condition that the target duration is reached and the target event is not monitored, wherein the target event has a function of keeping the screen of the source end device in a bright screen state.
In one possible implementation, in the screen-casting state, the source device sets a countdown timer whose countdown duration is the target duration, and starts the countdown timer. And if the target event is not monitored in the countdown process, controlling the screen to be turned off after the countdown timer expires.
The target event has a function of keeping a screen of the source device in a bright screen state, and may be triggered by an operation of a user on the source device, such as a touch event triggered by a touch operation of the user on the source device, or triggered by a notification received by the source device, such as an incoming call notification received by the source device.
Illustratively, as shown in fig. 5, if the source device 501 does not monitor the touch screen operation and the incoming call notification within the target time length, the source device controls the screen to be turned off when the target time length is reached.
And step 404, under the condition that the target event is monitored in the target time length, keeping the screen in a bright screen state, and resetting a countdown timer, wherein the countdown time length of the countdown timer is the target time length.
In one possible implementation, in the case that the target event is monitored during the countdown (the countdown duration of the countdown timer is the target duration), in order to facilitate the user to perform subsequent operation processing, the source device keeps the screen in the bright state, and resets the countdown timer when the target event is monitored.
In a possible implementation manner, if the target event is not monitored within the third duration, the source device stores the current brightness adjustment mode and the first brightness. And if the target event is monitored under the condition that the third duration is reached but the target duration is not reached, the source end equipment restores the stored brightness adjusting mode and restores the screen brightness to the first brightness.
And 405, under the condition that the screen is extinguished and the second time duration is not reached, maintaining the transmission of the screen-casting data stream between the terminal device and the destination terminal device.
The step 203 may be referred to in the implementation manner of this step, and this embodiment is not described herein again.
And 406, receiving a reverse control instruction sent by the destination device under the condition that the screen is extinguished and the second duration is not reached, wherein the reverse control instruction is used for performing reverse control on the source device.
And under the condition that the screen is turned off and the second duration is not reached, when the user operates on the screen projection picture through the destination device, the destination device sends the user operation to the source device in a reverse control instruction mode, and further, the source device receives the reverse control instruction, so that corresponding reverse control operation is executed.
In a possible implementation manner, the destination device receives an operation instruction of a user on the screen projection screen, and optionally, the destination device receives a touch operation of the user on the screen, or receives the operation instruction through an external device (such as a mouse, a keyboard, and the like). After receiving the operation instruction, the destination device identifies the operation instruction, converts the operation instruction into a reverse control instruction for the source device, and sends the reverse control instruction to the source device.
The reverse control instruction comprises an operation type and a corresponding operation parameter. For example, when the destination device receives a click operation from a mouse, the reverse control instruction includes an operation type "click", a click coordinate corresponding to the click operation, and a number of times of click of the click operation; when the destination device receives the sliding operation, the reverse control instruction comprises an operation type 'sliding' and a sliding track coordinate of the sliding operation; when the destination device receives the long-press operation, the reverse operation instruction comprises an operation type of long-press, a long-press coordinate corresponding to the long-press operation, a long-press duration and the like. The embodiments of the present application do not limit the specific parameters included in the reverse control command.
In step 407, the reverse control operation indicated by the reverse control instruction is executed.
Further, the source device executes the reverse control operation instructed by the source device according to the reverse control instruction. Accordingly, the user can see the screen projection picture updated after the reverse control operation through the destination terminal equipment.
It should be noted that, because the screen sizes of the source device and the destination device may be different, before the source device performs the reverse control operation, the source device needs to perform coordinate conversion on a parameter in the reverse control instruction, which is not described in detail herein.
In addition, in this embodiment, in the process of performing reverse control on the source end device by the destination end device, the screen of the source end device remains off.
And step 408, under the condition that a screen lightening event is monitored, lightening the screen, wherein the picture displayed on the lightened screen is a non-screen-locking picture, and the screen lightening event is an event triggering the screen lightening.
In order to simulate the process of the source end device lighting the screen in the normal screen-off state, the source end device monitors the screen-on event under the condition that the screen is off, and lights the screen under the condition that the screen-on event is monitored. The screen-lightening event is an event triggering the screen to lighten.
Optionally, the bright screen event may be an event triggered by pressing a physical key, an event triggered by touch operation, time triggered by a voice control instruction, an event triggered by a specific notification (such as an incoming call notification), and the like, which is not limited in this embodiment of the present application.
It should be noted that, after the screen is extinguished, the source device needs to register the bright screen event, and only when the registered bright screen event is monitored, the source device may light the screen.
Optionally, the registered screen-up event may be the same as or different from an event for waking up the source device to exit the screen-off state, which is not limited in this embodiment of the application. For example, when the source device supports exiting the screen-off state through a power key, screen click, and message notification, the registered bright screen events may include a power key press event, a screen click event, and a notification event, or may include only a power key press event and an incoming call notification event (i.e., a notification event of a specified type).
Under the condition that the source end device is awakened to exit the screen-off state, the source end device still stays in the screen-locking state, so that the source end device can display a screen-locking interface after lighting the screen to wait for unlocking operation. In the embodiment of the present application, in the screen projection state, the source device only controls the screen to be turned off, but does not enter the screen turning-off state (does not enter the screen locking state), so that in the case of monitoring the screen lightening event, the source device lightens the screen, and the lightened screen directly displays the current screen projection picture, instead of the screen locking interface.
In an illustrative example, the source device registers a pressing operation of the power key as a screen-up event, and in response to the pressing operation of the power key, the source device lights up the screen to directly display the current screen-up picture without performing an unlocking operation.
In an illustrative example, to ensure privacy security, when a source device registers an incoming call notification as a bright screen event, the source device lights up a screen to display an incoming call interface when the incoming call notification is monitored. In the process of answering the incoming call, the source end device firstly carries out privacy processing on the screen recording picture, then codes the screen recording picture, generates a data stream and transmits the data stream to the destination end device, wherein the privacy processing method comprises but is not limited to mosaic processing on the number of the incoming call display.
Step 409, setting the screen brightness as a first brightness, and setting the brightness adjustment mode as a first adjustment mode.
In the process of controlling screen blanking, the source end device adjusts the brightness adjustment mode and the screen brightness under the condition that the screen brightness adjustment mode is the first adjustment mode, so that in order to ensure the consistency of the screen brightness and the brightness adjustment mode after the screen is lightened and before the screen is blanked, the source end device sets the screen brightness as the first brightness and resets the brightness adjustment mode as the first adjustment mode.
Further, after the source device is turned on, the step 402 is continuously executed.
And step 410, setting the screen-off duration as a first duration under the condition of exiting the screen-casting state.
The second duration is set to avoid that the source end device rapidly enters the screen-off state in the screen-projecting state, so that the source end device adjusts the screen-off duration from the second duration to the first duration in order to reduce power consumption under the condition of exiting the screen-projecting state, namely, the source end device automatically enters the screen-off duration in the normal use state. It should be noted that, if the screen projection state exits during the screen blanking process, the source device needs to recover the brightness adjustment mode and the screen brightness.
Optionally, the screen-off state may be triggered by the destination device, for example, when a screen-off instruction sent by the destination device is received, the source device exits the screen-off state; or, the quitting of the screen-casting state may also be triggered by the source device, for example, when receiving a screen-casting quitting operation, the source device quits the screen-casting state; or, the quitting of the screen-projecting state may be automatically triggered when the screen-projecting link is disconnected, for example, when the screen-projecting link is disconnected due to a network reason, the source device quits the screen-projecting state.
In the above embodiment, in the screen projection state, by setting the third duration and monitoring the target event, the source device can keep the process of controlling the screen to be extinguished consistent with the process of controlling the screen to be extinguished when entering the screen extinguishing state, so that the use experience of a user is improved, and under the condition of monitoring the bright screen event, the source device can directly display the interface where the bright screen event is located, so that the step of unlocking the screen is omitted, and the user can conveniently perform subsequent processing in time.
It should be noted that the foregoing embodiment is only one possible control logic, and in other possible implementations, after the control screen is extinguished, the source device may monitor the bright-screen event and receive the reverse control instruction sent by the destination device at the same time, and this embodiment of the present application does not limit the specific control logic.
According to the above embodiment, as shown in fig. 6, it shows a workflow diagram after the screen is extinguished in the screen projecting state provided by another exemplary embodiment of the present application. After the source device 601 controls the screen to be extinguished in the screen-projecting state, the transmission of the screen-projecting data stream with the destination device 602 is maintained. Under the condition that the source end device 601 registers the incoming call notification and the trigger operation of the power key as a bright screen event, the source end device 601 sequentially judges the events, firstly judges whether a reverse control instruction is received, under the condition that the reverse control instruction is received, the source end device executes the reverse control operation indicated by the reverse control instruction and keeps the screen off; under the condition that a reverse control instruction is not received, whether the incoming call notification is monitored or not is continuously judged, and under the condition that the incoming call notification is monitored, the source end equipment lights a screen to display the incoming call notification; under the condition that the incoming call notification is not monitored, whether the volume key triggering operation is monitored or not is continuously judged, and under the condition that the volume key triggering operation is monitored, the source end equipment adjusts the volume according to the volume key triggering operation and keeps the screen off; and under the condition that the triggering operation of the volume key is not monitored, continuously judging whether the triggering operation of the power key is monitored, under the condition that the triggering operation of the power key is monitored, lighting the screen by the source end equipment to directly display a screen projection picture, and under the condition that the triggering operation of the power key is not monitored, keeping the screen off by the source end equipment.
It should be noted that the foregoing embodiment is only used for illustrative purposes, and in other possible implementations, during the process of determining an event, the source device may simultaneously determine to receive a reverse control instruction, to listen to an incoming call operation, to listen to a volume key trigger operation, and to listen to a power key trigger operation, or may determine according to a determination sequence different from that shown in fig. 6, which is not limited in this embodiment of the application.
Different from the related art, in the screen projection process, in response to a screen locking event of the source end device, the destination end device disconnects the source end device, exits the screen projection state, and screen projection needs to be performed again. In the embodiment of the application, when the source end device responds to the screen locking event and enters the screen off state, the destination end device maintains the connection state with the source end device, and displays the screen locking prompt picture to prompt the source end device of the user to be in the screen locking and screen off state. And after the source end equipment unlocks the screen, the target end equipment interface restores to display the screen projection picture.
And under the condition that a screen locking event is monitored in the target duration, the source end equipment enters a screen extinguishing state, wherein the transmission of screen projection data stream between the source end equipment and the target end equipment is interrupted in the screen extinguishing state.
In a possible implementation manner, when a screen locking event is monitored within a target duration, the source device enters a screen locking and screen extinguishing state, stops screen recording operation on a picture, interrupts screen projection data stream transmission between the source device and the destination device, and monitors an application running in a background.
Optionally, the screen locking event may be an event triggered by a physical key (for example, a power key is pressed), or may also be an event triggered by a voice control instruction, and the like, which is not limited in this embodiment of the application.
As shown in fig. 7, the process specifically includes the following steps:
step 701, sending a screen locking message to the destination device under the condition that a screen locking event is monitored within the target duration, so that the destination device can display a screen locking prompt picture based on the screen locking message.
In a possible implementation manner, when a screen locking event is monitored within a target duration, a source device sends a screen locking message to a destination device to prompt that the screen-projection data stream of the destination device is interrupted, that is, the destination device is about to enter a screen locking and screen blanking state.
The screen locking message may be an instruction in a screen projection data stream transmitted by the source device to the destination device, and instructs the destination device to display a preset screen locking prompt picture; or a screen locking prompt image contained in the screen projection data stream, and the destination device displays a screen locking prompt picture based on the image. In the process that the destination device decodes the screen projection data stream to generate the screen projection picture, when the destination device monitors the instruction or the screen locking prompt image, the destination device receives a screen locking message that the source device is about to enter a screen locking and screen extinguishing state.
Step 702, enter the screen-off state.
In a possible implementation manner, the source device enters a screen-off state, and interrupts the transmission of the screen-casting data stream with the destination device, and at the same time, the destination device displays a screen-locking prompt picture.
Illustratively, as shown in fig. 8, the source device 801 enters a screen-off state, and interrupts transmission of a screen projection data stream with the destination device 802, and at the same time, the destination device 802 displays a screen lock prompt screen.
And 703, in the screen off state, lightening the screen and displaying a screen locking interface under the condition that a screen lightening event is monitored, wherein the screen lightening event is an event for triggering the screen lightening.
In a possible implementation manner, after monitoring the screen-up event, the source device lights up the screen and displays the screen-lock to-be-unlocked interface, where the screen brightness is set to the first brightness, and the source device continues to maintain the interruption of the screen-casting data stream with the destination device.
And when the fourth time length is reached and the unlocking operation is not monitored, the source end equipment extinguishes the screen and continuously keeps the screen extinguishing state, wherein the fourth time length is the screen lightening time length for waiting the user to carry out the unlocking operation.
Illustratively, a source device registers an incoming call notification as a screen-up event, and lights up a screen to display an incoming call picture when the incoming call notification is monitored, and keeps on screen when the incoming call is ended when the unlocking operation is monitored; and after the incoming call is ended and the unlocking operation is not monitored, the source end equipment still keeps the screen-off state.
And step 704, recovering the screen-casting data stream transmission between the target terminal device and the terminal device under the condition that the unlocking is successful.
In a possible implementation manner, under the condition that unlocking is successful, the source device continues to record the screen picture and acquire the device audio, so that the recorded picture and the audio are encoded to generate an audio-video data stream, and the generated audio-video data stream is transmitted to the destination device. And under the condition that the destination terminal equipment receives the audio and video data stream, ending displaying the screen locking prompt picture, and displaying the screen projection picture again. Meanwhile, the source device receives a reverse control instruction from the destination device and performs a reverse control operation indicated by the reverse control instruction.
Schematically, as shown in fig. 8, in the case that unlocking is successful, the source device 801 continues to record a screen, collects device audio, and transmits a generated audio and video data stream to the destination device 802, and the destination device 802 directly displays a screen shot.
In the above embodiment, in the screen projection process, after the source end device enters the screen locking and screen extinguishing state, the connection with the destination end device can be maintained, and the destination end device prompts that the source end device is in the screen locking and screen extinguishing state, which is helpful for a user to know the state of the source end device in time. Under the condition that unlocking is successful, the source end device can directly recover screen projection data stream transmission between the source end device and the destination end device, and convenience in operation in the screen projection process is improved.
According to the above embodiment, as shown in fig. 9, it shows a flowchart of the work flow in the screen-locking and screen-extinguishing state in the screen projecting process provided by another exemplary embodiment of the present application. In the screen lock and screen off state, the source device 901 interrupts the transmission of the screen projection data stream with the destination device 902, and the destination device 902 displays a screen lock prompt screen. Under the condition that the source device 901 registers an incoming call notification and a trigger operation on a power key as a screen-on event, the source device 901 sequentially judges the events, under the condition that the incoming call notification is monitored, the source device 901 lights up a screen, and after the incoming call is ended, if an unlocking success operation exists, the source device exits a screen-locking and screen-off state; if the unlocking success operation does not exist, the source end equipment restores the screen locking and screen extinguishing state; under the condition that the incoming call notification is not monitored, whether the triggering operation of the power key is monitored or not is continuously judged, under the condition that the triggering operation of the power key is monitored, the source end device 901 lights up the screen, if the unlocking success operation exists, the source end device 901 exits the screen locking and extinguishing state, and screen projection data stream transmission between the source end device 901 and the destination end device 902 is recovered. In the case where the trigger operation of the power key is not monitored, the source device 901 maintains the lock screen-off state.
It should be noted that, in the screen-locking and screen-off state in the screen-projecting process, the source device may determine the notification of the incoming call and the trigger operation of the power key, and this embodiment of the present application does not limit the specific execution sequence.
In conjunction with the above embodiments, as shown in fig. 10, a general work flow diagram for entering a screen-projection state provided by another exemplary embodiment of the present application is shown.
And 1001, keeping the screen bright in a screen projection state.
And in the screen projection state, the source end equipment keeps bright screen and performs screen projection data stream transmission with the destination end equipment.
Step 1002, judging whether a screen locking event exists.
The source device monitors the screen locking event, judges whether the screen locking event exists, and if the screen locking event exists, the step 1003 is executed; if there is no screen lock event, step 1004 is entered.
And step 1003, entering a screen locking and screen extinguishing state.
And under the condition that a screen locking event is monitored, the source end equipment sends a screen locking message to the destination end equipment, the destination end equipment displays a screen locking prompt picture, and the source end equipment interrupts screen projection data stream transmission with the destination end equipment.
And step 1004, judging whether an incoming call notification or a touch screen operation exists.
The source end device monitors the incoming call notification and the touch screen operation, judges whether the incoming call notification or the touch screen operation exists, and returns to the step 1001 to keep the screen bright if the incoming call notification or the touch screen operation exists; if there is no incoming call notification or touch screen operation, go to step 1005.
Step 1005, adjusting the screen brightness.
And under the condition that the third duration is reached, the source end equipment adjusts the screen brightness from the first brightness to the second brightness, and under the condition that the brightness adjusting mode is the first adjusting mode, the brightness adjusting mode is adjusted to the second adjusting mode.
Step 1006, continuously determining whether there is an incoming call notification or a touch screen operation.
The source device continues to monitor the incoming call notification and the touch screen operation, judges whether the incoming call notification or the touch screen operation exists, and returns to the step 1001 to keep the screen bright if the incoming call notification or the touch screen operation exists; if there is no incoming call notification or touch screen operation, step 1007 is entered.
Step 1007, controlling screen to go off, monitoring incoming call notification and triggering operation of power key.
When the target duration is reached, the source end device controls the screen to be turned off, monitors incoming call notification and triggering operation of a power key, meanwhile, the source end device keeps screen projection data stream transmission with the target end device, and the target end device keeps screen projection pictures to be displayed.
Referring to fig. 11, a block diagram of a screen projection system provided by an exemplary embodiment of the present application is shown, where the screen projection system includes a source device 1101 and a destination device 1102.
The source end equipment is used for setting the screen-off duration from a first duration to a second duration in the screen-throwing state, the screen-off duration is the duration when the source end equipment automatically enters the screen-off state, and the second duration is longer than the first duration; under the condition that the target duration is reached, controlling the screen to be extinguished, wherein the source end device does not enter a screen extinguishing state after the screen is extinguished, and the target duration is less than a second duration; and under the condition that the screen is extinguished and the second time length is not reached, the screen projection data stream transmission between the screen and the destination terminal equipment is kept.
The destination end equipment is used for receiving the audio and video data stream transmitted by the source end equipment under the condition that the screen projection data stream between the destination end equipment and the source end equipment keeps transmitting; and playing the screen projection content based on the audio and video data stream.
In a possible implementation, the screen projection data stream transmitted between the source device and the destination device further includes a reverse control instruction.
The destination end equipment is used for receiving reverse control operation on the screen projection content under the condition that the screen of the source end equipment is extinguished and does not reach the second duration; and sending a reverse control instruction to the source end device based on the reverse control operation.
And under the condition that the destination equipment receives a reverse control operation on the screen projection content, converting the reverse control operation into a corresponding reverse control instruction, wherein the reverse control instruction comprises an operation type and a corresponding operation parameter, and then sending the reverse control instruction to the source equipment by the destination equipment.
And the source end equipment is used for executing the reverse control operation indicated by the reverse control instruction.
In a possible implementation manner, when the source device enters a screen lock and screen off state, the transmission of the screen projection data stream between the source device and the destination device is interrupted.
The source end device is used for entering a screen-off state and sending a screen-locking message to the destination end device under the condition that a screen-locking event is monitored in a target duration, wherein the transmission of a screen-casting data stream between the source end device and the destination end device is interrupted in the screen-off state;
and the destination end equipment is used for displaying a screen locking prompt picture based on the screen locking message under the condition that the source end equipment enters the screen extinguishing state.
And under the condition that the source end equipment enters the screen-off state, the destination end equipment displays a screen-locking prompt picture based on the received screen-locking message in order to prompt that the source end equipment is in the screen-locking and screen-off state.
The source end equipment is also used for lightening the screen and displaying a screen locking interface under the condition of monitoring a screen lightening event in the screen extinguishing state, wherein the screen lightening event is an event for triggering the screen lightening; and under the condition that the unlocking is successful, the screen projection data stream transmission between the target end equipment and the target end equipment is recovered.
Referring to fig. 12, a block diagram of a screen projection device provided in an exemplary embodiment of the present application is shown, where the screen projection device may include the following structure:
a duration setting module 1201, configured to set a screen-off duration from a first duration to a second duration in a screen-casting state, where the screen-off duration is a duration when the source end device automatically enters the screen-off state, and the second duration is greater than the first duration;
the screen control module 1202 is configured to control screen blanking when a target duration is reached, where after the screen is blanked, the source device does not enter the screen blanking state, and the target duration is shorter than the second duration;
and the data transmission module 1203 is configured to keep the transmission of the screen-casting data stream with the destination device when the screen is turned off and the second duration is not reached.
In the alternative,
the screen control module 1202 is further configured to adjust the screen brightness from the first brightness to a second brightness when a third duration is reached, where the third duration is less than the target duration, and the second brightness is less than the first brightness.
Optionally, the screen control module 1202 is configured to:
under the condition that the brightness adjusting mode is a first adjusting mode, setting the brightness adjusting mode to be a second adjusting mode, wherein in the first adjusting mode, a function of automatically adjusting the screen brightness based on the ambient light brightness is started, and in the second adjusting mode, the function of automatically adjusting the screen brightness based on the ambient light brightness is closed;
and in the second adjusting mode, automatically adjusting the screen brightness from the first brightness to the second brightness.
In the alternative,
the screen control module 1202 is further configured to light the screen when a screen-lighting event is monitored, where a picture displayed on the screen after lighting is a non-screen-locking picture, and the screen-lighting event is an event that triggers screen lighting;
setting the screen brightness to the first brightness, and setting the brightness adjustment mode to the first adjustment mode.
Optionally, the screen control module 1202 is configured to:
when the third duration is reached and a target event is not monitored, adjusting the screen brightness from the first brightness to the second brightness, wherein the target event has a function of keeping a screen of the source end device in a bright screen state;
and under the condition that the target duration is not reached and the target event is monitored, adjusting the screen brightness to be the first screen brightness.
Optionally, the screen control module 1202 is configured to:
controlling a screen to be extinguished under the condition that the target duration is reached and a target event is not monitored, wherein the target event has a function of keeping a screen of the source end device in a bright screen state;
and under the condition that the target event is monitored in the target time length, keeping the screen in a bright screen state, resetting a countdown timer, wherein the countdown time length of the countdown timer is the target time length.
Optionally, the apparatus further comprises:
and the screen locking and extinguishing module is used for entering a screen extinguishing state under the condition that a screen locking event is monitored in the target duration, wherein the transmission of the screen throwing data stream between the source end equipment and the target end equipment is interrupted in the screen extinguishing state.
Optionally, the screen locking and extinguishing module is configured to:
under the condition that the screen locking event is monitored in the target duration, sending a screen locking message to the destination terminal device, so that the destination terminal device displays a screen locking prompt picture based on the screen locking message;
and entering the screen-off state.
Optionally, the method is further used for lighting the screen and displaying a screen locking interface in the screen off state under the condition that a screen lightening event is monitored, wherein the screen lightening event is an event triggering screen lightening;
the data transmission module 1203 is further configured to resume screen-casting data stream transmission with the destination device when the unlocking is successful.
Alternatively to this, the first and second parts may,
the data transmission module 1203 is further configured to receive a reverse control instruction sent by the destination device when the screen is turned off and the second duration is not reached, where the reverse control instruction is used to perform reverse control on the source device;
and the operation execution module is used for executing the reverse control operation indicated by the reverse control instruction.
Alternatively to this, the first and second parts may,
the screen control module 1202 is further configured to set the screen-off duration to the first duration when the screen-projecting state is exited.
In summary, in the embodiment of the present application, in the screen-casting state, the screen-off duration that the source device automatically enters the screen-off state is extended from the first duration to the second duration, and the screen is controlled to be extinguished when the target duration is reached, where the target duration is shorter than the second duration. By adopting the scheme provided by the embodiment of the application, the source end equipment can automatically prolong the screen-off time in the screen-off state, and can keep the screen-casting data stream transmission with the target end equipment under the condition that the screen is turned off but does not enter the screen-off state, so that the normal screen casting between the source end equipment and the target end equipment is ensured, the power consumption increase of the source end equipment due to long-time screen lightening can be avoided, and the power consumption of the source end equipment in the screen casting process can be reduced.
In addition, in the screen projection state, by setting the third time and monitoring the target event, the source end device can enable the process of controlling the screen to be extinguished to be consistent with the process of controlling the screen to be extinguished when the screen is in the screen extinguishing state, so that the use experience of a user is improved, and in the case of monitoring the screen lightening event, the source end device can directly display the interface where the screen lightening event is located, so that the step of unlocking the screen is omitted, and the user can conveniently and timely perform subsequent processing.
It should be noted that: the device provided in the above embodiment is only illustrated by dividing the functional modules, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and the implementation process thereof is detailed in the method embodiments, which are not described herein again.
Referring to fig. 13, a block diagram of a computer device according to an exemplary embodiment of the present application is shown. Computer device 1300 may include one or more of the following components: a processor 1310, a memory 1320, and a display 1330.
Processor 1310 may include one or more processing cores. The processor 1310 interfaces with various interfaces and circuitry throughout the computer device 1300 to perform various functions of the computer device 1300 and to process data by executing or performing instructions, programs, code sets, or instruction sets stored in the memory 1320 and invoking data stored in the memory 1320. Alternatively, the processor 1310 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 1310 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Neural-Network Processing Unit (NPU), a modem, and the like. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing contents required to be displayed by the touch display screen; the NPU is used for realizing an Artificial Intelligence (AI) function; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 1310, but may be implemented by a single chip.
The Memory 1320 may include a Random Access Memory (RAM) or a Read-Only Memory (ROM). Optionally, the memory 1320 includes a non-transitory computer-readable medium. The memory 1320 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 1320 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like; the stored data area may store data (such as audio data, a phonebook) created according to the use of the computer apparatus 1300, and the like.
The display screen 1330 is a component for performing screen display. Optionally, the display screen 1330 also has a touch function, and a user can control the display content by performing touch operation on the display screen 1330. For example, the display 1330 is a touch display of a smart phone, or the display 1330 is a non-touch display of a television terminal.
In addition, those skilled in the art will appreciate that the configuration of the computer device 1300 illustrated in the above-described figures does not constitute a limitation of the computer device, and that the computer device may include more or less components than those illustrated, or some components may be combined, or a different arrangement of components. For example, the computer device 1300 further includes a camera, a microphone, a speaker, a radio frequency circuit, an input unit, a sensor (such as an acceleration sensor, an angular velocity sensor, a light sensor, and the like), an audio circuit, a WiFi module, a power supply, a bluetooth module, and the like, which are not described herein again.
The embodiment of the present application also provides a computer-readable storage medium, which stores at least one program code, and the program code is loaded and executed by a processor to implement the screen projection method according to the above embodiments.
Embodiments of the present application provide a computer program product comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the screen projection method provided in the various alternative implementations of the above aspects.
It should be understood that reference to "a plurality" herein means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. In addition, the step numbers described herein only exemplarily show one possible execution sequence among the steps, and in some other embodiments, the steps may also be executed out of the numbering sequence, for example, two steps with different numbers are executed simultaneously, or two steps with different numbers are executed in a reverse order to the order shown in the drawings, which is not limited in this embodiment of the present application.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (20)

1. A screen projection method, performed by a source device, the method comprising:
in a screen-throwing state, setting a screen-off duration from a first duration to a second duration, wherein the screen-off duration is a duration for the source end equipment to automatically enter a screen-off state, and the second duration is longer than the first duration;
controlling the screen to be extinguished under the condition that the target duration is reached, wherein the source end device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration;
and under the condition that the screen is extinguished and the second time length is not reached, the screen projection data stream transmission between the screen and the destination terminal equipment is kept.
2. The method of claim 1, further comprising:
and under the condition of reaching a third time length, adjusting the screen brightness from the first brightness to a second brightness, wherein the third time length is less than the target time length, and the second brightness is less than the first brightness.
3. The method of claim 2, wherein adjusting the screen brightness from a first brightness to a second brightness comprises:
setting the brightness adjusting mode to be a second adjusting mode under the condition that the brightness adjusting mode is a first adjusting mode, wherein in the first adjusting mode, a function of automatically adjusting the screen brightness based on the ambient light brightness is started, and in the second adjusting mode, the function of automatically adjusting the screen brightness based on the ambient light brightness is closed;
and in the second adjusting mode, automatically adjusting the screen brightness from the first brightness to the second brightness.
4. The method of claim 3, further comprising:
the method comprises the steps that under the condition that a screen lightening event is monitored, a screen is lightened, wherein a picture displayed on the lightened screen is a non-screen locking picture, and the screen lightening event is an event for triggering the screen to lighten;
setting the screen brightness to the first brightness, and setting the brightness adjustment mode to the first adjustment mode.
5. The method of claim 2, wherein adjusting the screen brightness from the first brightness to the second brightness when the third duration is reached comprises:
when the third duration is reached and a target event is not monitored, adjusting the screen brightness from the first brightness to the second brightness, wherein the target event has a function of keeping a screen of the source end device in a bright screen state;
the method further comprises the following steps:
and under the condition that the target duration is not reached and the target event is monitored, adjusting the screen brightness to the first brightness.
6. The method according to any one of claims 1 to 5, wherein the controlling of the screen to be extinguished in the case that the target duration is reached comprises:
controlling a screen to be extinguished under the condition that the target duration is reached and a target event is not monitored, wherein the target event has a function of keeping a screen of the source end device in a bright screen state;
the method further comprises the following steps:
and under the condition that the target event is monitored in the target time length, keeping the screen in a bright screen state, resetting a countdown timer, wherein the countdown time length of the countdown timer is the target time length.
7. The method of any of claims 1 to 5, further comprising:
and entering the screen-off state under the condition that a screen locking event is monitored in the target duration, wherein the transmission of the screen projection data stream between the source end equipment and the target end equipment is interrupted in the screen-off state.
8. The method of claim 7, wherein entering the screen-out state in the case that a screen-locking event is monitored within the target duration comprises:
under the condition that the screen locking event is monitored in the target duration, sending a screen locking message to the destination terminal device, so that the destination terminal device displays a screen locking prompt picture based on the screen locking message;
and entering the screen-off state.
9. The method of claim 7, further comprising:
in the screen-off state, under the condition that a screen-on event is monitored, lightening a screen and displaying a screen-locking interface, wherein the screen-on event is an event for triggering the screen to be turned on;
and recovering the screen projection data stream transmission between the target terminal equipment and the terminal equipment under the condition of successful unlocking.
10. The method of any of claims 1 to 5, further comprising:
receiving a reverse control instruction sent by the destination device under the condition that the screen is extinguished and the second duration is not reached, wherein the reverse control instruction is used for performing reverse control on the source device;
and executing the reverse control operation indicated by the reverse control instruction.
11. The method of any of claims 1 to 5, further comprising:
and setting the screen-off duration as the first duration under the condition of exiting the screen-projecting state.
12. A screen projection apparatus, comprising:
the source end equipment comprises a time length setting module, a screen switching module and a display module, wherein the time length setting module is used for setting the screen switching-off time length from a first time length to a second time length in the screen switching state, the screen switching-off time length is the time length when the source end equipment automatically enters the screen switching-off state, and the second time length is longer than the first time length;
the screen control module is used for controlling the screen to be extinguished under the condition that the target duration is reached, wherein the source end device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration;
and the data transmission module is used for keeping screen projection data stream transmission with the destination terminal equipment under the condition that the screen is extinguished and the second duration is not reached.
13. A screen projection system is characterized by comprising a source end device and a destination end device;
the source end device is configured to set a screen-off duration from a first duration to a second duration in a screen-on state, where the screen-off duration is a duration when the source end device automatically enters the screen-off state, and the second duration is greater than the first duration; controlling the screen to be extinguished under the condition that the target duration is reached, wherein the source end device does not enter the screen extinguishing state after the screen is extinguished, and the target duration is less than the second duration; under the condition that the screen is turned off and the second duration is not reached, screen-casting data stream transmission between the screen and the destination terminal equipment is kept;
the destination device is used for receiving the audio and video data stream transmitted by the source device under the condition that the screen projection data stream between the destination device and the source device keeps transmitting; and playing the screen projection content based on the audio and video data stream.
14. The screen projection system of claim 13, wherein the screen projection data stream transmitted between the source device and the destination device further comprises a reverse control instruction;
the destination device is further configured to receive a reverse control operation on the screen projection content when the screen of the source device is extinguished and the second duration is not reached; sending a reverse control instruction to the source end device based on the reverse control operation;
the source device is configured to execute the reverse control operation indicated by the reverse control instruction.
15. The screen projection system of claim 13,
the source end device is further configured to enter the screen-off state when a screen locking event is monitored within the target duration, where transmission of a screen-casting data stream between the source end device and the destination end device in the screen-off state is interrupted;
the destination device is further configured to display a screen locking prompt picture when the source device enters a screen-off state.
16. The screen projection system of claim 15,
the source end device is further configured to send a screen locking message to the destination end device when the screen locking event is monitored within the target duration;
and the destination terminal equipment is used for displaying the screen locking prompt picture based on the screen locking message.
17. The screen projection system of claim 15,
the source device is further configured to, in a screen-off state, light up a screen and display a screen locking interface when a screen-on event is monitored, where the screen-on event is an event that triggers screen-on of the screen; and recovering the screen projection data stream transmission between the target terminal equipment and the terminal equipment under the condition of successful unlocking.
18. A computer device, wherein the computer device comprises a processor and a memory; the memory stores at least one instruction for execution by the processor to implement a screen projection method as claimed in any one of claims 1 to 11.
19. A computer-readable storage medium having at least one program code stored therein, the program code being loaded and executed by a processor to implement a screen projection method according to any one of claims 1 to 11.
20. A computer program product, characterized in that the computer program product comprises computer instructions, the computer instructions being stored in a computer readable storage medium; a processor of a computer device reads the computer instructions from the computer-readable storage medium, the processor executing the computer instructions to cause the computer device to implement the screen projection method of any one of claims 1 to 11.
CN202210684186.1A 2022-06-16 2022-06-16 Screen projection method, device, equipment, system and storage medium Active CN115097926B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210684186.1A CN115097926B (en) 2022-06-16 2022-06-16 Screen projection method, device, equipment, system and storage medium
PCT/CN2022/143554 WO2023241009A1 (en) 2022-06-16 2022-12-29 Screen projection method, apparatus and system, device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210684186.1A CN115097926B (en) 2022-06-16 2022-06-16 Screen projection method, device, equipment, system and storage medium

Publications (2)

Publication Number Publication Date
CN115097926A true CN115097926A (en) 2022-09-23
CN115097926B CN115097926B (en) 2024-05-17

Family

ID=83291453

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210684186.1A Active CN115097926B (en) 2022-06-16 2022-06-16 Screen projection method, device, equipment, system and storage medium

Country Status (2)

Country Link
CN (1) CN115097926B (en)
WO (1) WO2023241009A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023241009A1 (en) * 2022-06-16 2023-12-21 Oppo广东移动通信有限公司 Screen projection method, apparatus and system, device, and storage medium
WO2024093530A1 (en) * 2022-10-31 2024-05-10 荣耀终端有限公司 Screen mirroring method and electronic device

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107450801A (en) * 2017-07-26 2017-12-08 广东欧珀移动通信有限公司 A kind of control method of screen display, device, storage medium and mobile terminal
CN107734619A (en) * 2017-11-27 2018-02-23 维沃移动通信有限公司 Reduce the method and mobile terminal of mobile terminal power consumption
CN107968874A (en) * 2016-10-19 2018-04-27 中兴通讯股份有限公司 Screen control method, device and terminal
CN108446628A (en) * 2018-03-19 2018-08-24 广东欧珀移动通信有限公司 Screen control method, device, mobile terminal and computer readable storage medium
CN108574778A (en) * 2018-04-19 2018-09-25 Oppo广东移动通信有限公司 Throw screen brightness adjusting method and Related product
CN109660665A (en) * 2018-12-21 2019-04-19 Oppo广东移动通信有限公司 A kind of screen control method, screen control device and terminal device
CN109788138A (en) * 2019-02-01 2019-05-21 Oppo广东移动通信有限公司 Screen control method, device, terminal and storage medium
CN110175479A (en) * 2019-05-31 2019-08-27 努比亚技术有限公司 Terminal puts out screen control method, device, mobile terminal and readable storage medium storing program for executing
CN112346685A (en) * 2020-10-26 2021-02-09 努比亚技术有限公司 Screen-off and screen-projection control method and device and computer readable storage medium
CN113093898A (en) * 2021-04-19 2021-07-09 Tcl通讯(宁波)有限公司 Power saving method, storage medium and system in multi-screen interaction scene
WO2021244184A1 (en) * 2020-06-02 2021-12-09 Oppo广东移动通信有限公司 Screen control method and apparatus, and mobile terminal and storage medium
CN113889055A (en) * 2021-09-30 2022-01-04 荣耀终端有限公司 Screen brightness adjusting method, electronic equipment and storage medium
CN114518854A (en) * 2020-11-20 2022-05-20 华为技术有限公司 Screen projection method and equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426145B (en) * 2015-11-06 2019-04-23 武汉卡比特信息有限公司 A kind of method that mobile phone screen projects computer terminal
JP2017139603A (en) * 2016-02-03 2017-08-10 京セラ株式会社 Portable terminal, display control method and program
CN115097926B (en) * 2022-06-16 2024-05-17 Oppo广东移动通信有限公司 Screen projection method, device, equipment, system and storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107968874A (en) * 2016-10-19 2018-04-27 中兴通讯股份有限公司 Screen control method, device and terminal
CN107450801A (en) * 2017-07-26 2017-12-08 广东欧珀移动通信有限公司 A kind of control method of screen display, device, storage medium and mobile terminal
CN107734619A (en) * 2017-11-27 2018-02-23 维沃移动通信有限公司 Reduce the method and mobile terminal of mobile terminal power consumption
CN108446628A (en) * 2018-03-19 2018-08-24 广东欧珀移动通信有限公司 Screen control method, device, mobile terminal and computer readable storage medium
CN108574778A (en) * 2018-04-19 2018-09-25 Oppo广东移动通信有限公司 Throw screen brightness adjusting method and Related product
CN109660665A (en) * 2018-12-21 2019-04-19 Oppo广东移动通信有限公司 A kind of screen control method, screen control device and terminal device
CN109788138A (en) * 2019-02-01 2019-05-21 Oppo广东移动通信有限公司 Screen control method, device, terminal and storage medium
CN110175479A (en) * 2019-05-31 2019-08-27 努比亚技术有限公司 Terminal puts out screen control method, device, mobile terminal and readable storage medium storing program for executing
WO2021244184A1 (en) * 2020-06-02 2021-12-09 Oppo广东移动通信有限公司 Screen control method and apparatus, and mobile terminal and storage medium
CN112346685A (en) * 2020-10-26 2021-02-09 努比亚技术有限公司 Screen-off and screen-projection control method and device and computer readable storage medium
CN114518854A (en) * 2020-11-20 2022-05-20 华为技术有限公司 Screen projection method and equipment
CN113093898A (en) * 2021-04-19 2021-07-09 Tcl通讯(宁波)有限公司 Power saving method, storage medium and system in multi-screen interaction scene
CN113889055A (en) * 2021-09-30 2022-01-04 荣耀终端有限公司 Screen brightness adjusting method, electronic equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023241009A1 (en) * 2022-06-16 2023-12-21 Oppo广东移动通信有限公司 Screen projection method, apparatus and system, device, and storage medium
WO2024093530A1 (en) * 2022-10-31 2024-05-10 荣耀终端有限公司 Screen mirroring method and electronic device

Also Published As

Publication number Publication date
CN115097926B (en) 2024-05-17
WO2023241009A1 (en) 2023-12-21

Similar Documents

Publication Publication Date Title
CN115097926B (en) Screen projection method, device, equipment, system and storage medium
US11425315B2 (en) Video communications method and apparatus, terminal, and computer-readable storage medium
CN111314768A (en) Screen projection method, screen projection device, electronic equipment and computer readable storage medium
CN111078168B (en) Information processing method, first electronic equipment and storage medium
CN111629239B (en) Screen projection processing method, device, equipment and computer readable storage medium
CN111866433B (en) Video source switching method, video source playing method, video source switching device, video source playing device, video source equipment and storage medium
JP4501991B2 (en) Terminal device and program
CN112835549A (en) Method and device for switching audio output device
CN112346685B (en) Screen-off and screen-projection control method and device and computer readable storage medium
CN112019893B (en) Screen projection method of terminal and screen projection device of terminal
JP2005221907A (en) Display device
EP3282644B1 (en) Timing method and device
US11146854B2 (en) Method for playing videos and electronic device
CN112822433B (en) Control method and related device in video conference
EP3056970A1 (en) Method and device for controlling power consumption
CN113938748B (en) Video playing method, device, terminal, storage medium and program product
CN110708581B (en) Display device and method for presenting multimedia screen saver information
CN110830813B (en) Video switching method and device, electronic equipment and storage medium
CN112445384A (en) Information screen display method and device, processor and display equipment
CN109474833B (en) Network live broadcast method, related device and system
CN114780010A (en) Display device and control method thereof
KR100487623B1 (en) Method for controlling the multimedia contents of mobile phone
CN115129283A (en) Screen display method and device, electronic equipment and computer readable storage medium
CN113282362A (en) Application program management method, device, storage medium and terminal
WO2020186506A1 (en) Photographing device control method and photographing device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant