CN116055693B

CN116055693B - Screen projection method, electronic device, system and computer readable storage medium

Info

Publication number: CN116055693B
Application number: CN202210868897.4A
Authority: CN
Inventors: 吴柯文; 时元甲
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-07-21
Filing date: 2022-07-21
Publication date: 2024-04-02
Anticipated expiration: 2042-07-21
Also published as: CN116055693A

Abstract

The application provides a screen projection method, electronic equipment, a system and a computer readable storage medium, which belong to the technical field of electronics, and the method is applied to the electronic equipment and comprises the steps of receiving a start-up operation; responding to the starting operation, and determining that the received network signal strength value is greater than or equal to a preset strength value; determining equipment capability, wherein the equipment capability is used for representing a frequency band of wireless transmission which can be supported by a WiFi chip of the electronic equipment; and setting P2P monitoring time and WiFi surfing time based on the equipment capability, so that the first electronic equipment alternately executes P2P monitoring and WiFi surfing according to the P2P monitoring time and the WiFi surfing time. According to the screen projection method, the use duration of WIFI P2P monitoring and the use duration of WIFI surfing can be dynamically adjusted, startup can be realized as much as possible, the network transmission rate of surfing is ensured, and therefore the user experience is improved.

Description

Screen projection method, electronic device, system and computer readable storage medium

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to a screen projection method, an electronic device, and a computer readable storage medium.

Background

Currently, more and more electronic devices support wireless screen projection technology. The wireless screen-throwing technology refers to that the electronic device A transmits the displayed image data on the screen of the electronic device A to the electronic device B in real time through the wireless technology, so that the image data which is the same as the image data of the electronic device A are displayed on the electronic device B in real time. The method and the device realize that the user can watch the content played by the electronic device A on the electronic device B.

However, when the device chip of the electronic device B has poor capability or the signal is greatly interfered by the outside, the performance of wireless transmission of the electronic device B will be reduced, and the screen-throwing experience will be reduced.

Disclosure of Invention

In view of the above, the present invention provides a screen projection method, an electronic device, and a computer readable storage medium for improving the influence on the screen projection experience of a user when the chip capability is poor or the signal is greatly interfered by the outside.

Some embodiments of the present application provide a screen projection method. The present application is described in terms of various aspects, embodiments and advantages of which are referred to below.

In a first aspect, the present invention provides a screen projection method, applied to a system including at least a first electronic device, the method including:

The first electronic equipment receives a starting operation;

responding to a starting operation, and determining that the received network signal strength value is greater than or equal to a preset strength value by the first electronic equipment;

the method comprises the steps that a first electronic device determines device capability, wherein the device capability is used for representing a frequency band of wireless transmission which can be supported by a WiFi chip of the first electronic device;

the first electronic equipment sets P2P monitoring time length and WiFi surfing time length based on equipment capability, so that the first electronic equipment alternately executes P2P monitoring and WiFi surfing according to the P2P monitoring time length and the WiFi surfing time length, and further the first electronic equipment balances the P2P monitoring and finds equipment time length for screen throwing and network transmission speed of WiFi surfing based on the obtained network signal strength value.

According to the screen projection method, the WIFI P2P monitoring time length and the WIFI surfing time length are adjusted by judging the equipment capability and the signal strength, the startup can be realized as much as possible, the network transmission rate of surfing is ensured, and therefore the user experience is improved.

As an embodiment of the first aspect of the present application, when the first electronic device determines that the device capability is a wireless transmission capability that only supports the 2.4G band, the first electronic device sets a P2P listening duration and a WiFi surfing duration based on the device capability, including: the first electronic device keeps the original P2P monitoring time unchanged, and prolongs the original WiFi surfing time to the first using time. By prolonging the internet surfing using time under the condition that the equipment capacity is relatively weak, the starting-up and internet surfing speed can be balanced better.

As an embodiment of the first aspect of the present application, the P2P listening duration is 50ms, and the wifi surfing duration is 950ms.

As an embodiment of the first aspect of the present application, the setting, by the first electronic device, a P2P listening duration and a WiFi surfing duration based on device capabilities includes: the method comprises the steps that a first electronic device detects the opening condition of video applications in a white list, and when the video applications without the white list are opened, the first electronic device determines that the current network transmission rate is a first network rate; the first electronic device adjusts P2P monitoring duration and WiFi surfing duration based on the first network rate. According to the condition that the electronic equipment starts the video application, the P2P monitoring time length and the WiFi surfing time length are dynamically adjusted, so that the surfing speed is ensured, and the startup can be realized.

As an embodiment of the first aspect of the present application, when the video application is opened, the first electronic device closes P2P listening, and closes the screen throwing function. In the case of a relatively weak device capability, smoothness of the video watched by the user is ensured when played.

As an embodiment of the first aspect of the present application, the determining, by the first electronic device, the device capability to support wireless transmission capability of a frequency band other than the 2.4G frequency band, where the first electronic device sets a P2P listening duration and a WiFi surfing duration based on the device capability includes:

The first electronic device keeps the original P2P monitoring time length and the original WiFi surfing time length unchanged.

As an embodiment of the first aspect of the present application, the original P2P listening duration is 50ms, and the wifi surfing duration is 500ms.

As an embodiment of the first aspect of the present application, the setting, by the first electronic device, a use duration of P2P listening and a use duration of WiFi surfing based on device capabilities includes: the method comprises the steps that a first electronic device detects the opening condition of a video application in a white list, and when the video application in the white list is not opened, the first electronic device determines that the current network transmission rate is a second network rate; the first electronic device adjusts P2P monitoring duration and WiFi surfing duration based on the second network rate. And combining the equipment capability and the current network rate, dynamically adjusting the P2P monitoring time length and the WiFi surfing time length, improving surfing speed as much as possible, and ensuring the time of equipment discovery by screen throwing.

As an embodiment of the first aspect of the present application, when the video application in the whitelist is opened, the first electronic device prolongs the WiFi internet duration.

As an embodiment of the first aspect of the present application, the method further comprises: and determining that the received signal strength value is smaller than a preset strength value, and closing the P2P monitoring and screen throwing functions by the first electronic equipment. The scene is suitable for an environment with non-poor signal strength, and the internet surfing speed of the user using the electronic equipment is preferentially ensured.

As an embodiment of the first aspect of the present application, the system further includes at least a second electronic device, when the first electronic device discovers the second electronic device based on the P2P listening duration and the WiFi surfing duration, and establishes a P2P connection with the second electronic device, the method includes: the first electronic device receives video images for screen projection sent by the second electronic device based on P2P connection, and sets a first playing buffer time length so as to ensure that image frames are displayed in real time; when the first electronic device determines that the image frames played in the screen are abnormal, the first electronic device prolongs the first playing buffer time to the second playing buffer time. The fluency of playing the multimedia content can be ensured, and the condition that a screen is jumped or blocked on the screen is improved.

As an embodiment of the first aspect of the present application, the method further comprises: when the abnormal condition of the image frames played in the screen is determined, the first electronic device also determines that the resolution used for screen projection reaches the preset resolution, the frame rate of the screen projection reaches the preset frame rate, and the first electronic device sends a request for reducing the resolution and the frame rate to the second electronic device; the second electronic device responds to the request, and reduces the resolution and the frame rate of the use of the second electronic device when the second electronic device is on screen. Further improving the fluency of playing the multimedia content.

As an embodiment of the first aspect of the present application, the determining, by the first electronic device, that an abnormal situation occurs in an image frame played in a screen includes: when it is determined that the play time difference of two adjacent image frames is larger than the first preset time and reaches the preset times in the second preset time; or determining that the packet loss rate of the continuous image frames reaches the preset packet loss rate, and determining that the image frames played in the screen are abnormal by the first electronic equipment.

As an embodiment of the first aspect of the present application, the method further comprises: the second electronic equipment determines that video application is started currently, and sends information of video starting to the first electronic equipment; the first electronic equipment receives the information of video starting, and sets the playing buffer time length to be a third playing buffer time length, wherein the third playing buffer time length is longer than the second playing buffer time length. Furthermore, for the video application when the screen is projected, the buffer time can be further prolonged, the blocking can be effectively avoided, and the user experience is improved.

As an embodiment of the first aspect of the present application, the second electronic device determines that there is currently a video application started, and if the video application is a video application in a white list, then information that there is a video start is sent to the first electronic device. Further, the play effect is improved for the selected video application by setting the video application in the white list.

In a second aspect, the present application further provides an electronic device, including:

the acquisition module is used for receiving starting operation;

the processing module is used for responding to the starting operation and determining that the received network signal strength value is greater than or equal to a preset strength value;

the processing module determines equipment capability, wherein the equipment capability is used for representing a frequency band of wireless transmission which can be supported by a WiFi chip of the first electronic equipment;

the processing module sets P2P monitoring time and WiFi surfing time based on the equipment capability, so that the first electronic equipment alternately executes P2P monitoring and WiFi surfing according to the P2P monitoring time and the WiFi surfing time. And further, P2P monitoring is balanced, and the equipment duration for screen projection and the network transmission speed of WiFi surfing are found.

As an embodiment of the second aspect of the present application, when the first electronic device determines that the device capability is a wireless transmission capability supporting only the 2.4G band, the first electronic device sets a P2P listening duration and a WiFi surfing duration and based on the device capability, including: the first electronic device keeps the original P2P monitoring time unchanged, and prolongs the original WiFi surfing time to the first using time. By prolonging the internet surfing using time under the condition that the equipment capacity is relatively weak, the starting-up and internet surfing speed can be balanced better.

As an embodiment of the second aspect of the present application, the P2P listening duration is 50ms, and the wifi surfing duration is 950ms.

As an embodiment of the second aspect of the present application, the electronic device further includes a detection module, configured to detect an opening condition of a video application in the white list, and when the video application without the white list is opened, the processing module determines that the current network transmission rate is the first network rate; the processing module adjusts P2P monitoring time length and WiFi surfing time length based on the first network rate. According to the condition that the electronic equipment starts the video application, the P2P monitoring time length and the WiFi surfing time length are dynamically adjusted, so that the surfing speed is ensured, and the startup can be realized.

As an embodiment of the second aspect of the present application, when the video application is opened, the processing module closes the P2P listening and closes the screen throwing function. In the case of a relatively weak device capability, smoothness of the video watched by the user is ensured when played.

As an embodiment of the second aspect of the present application, the first electronic device determining that the device capability is a wireless transmission capability supporting a frequency band other than the 2.4G frequency band, the first electronic device setting a P2P listening duration and a WiFi surfing duration based on the device capability, including: the first electronic device keeps the original P2P monitoring time length and the original WiFi surfing time length unchanged.

As an embodiment of the second aspect of the present application, the original P2P listening duration is 50ms, and the wifi surfing duration is 500ms.

As an embodiment of the second aspect of the present application, the detecting module is further configured to detect an opening condition of a video application in the whitelist, and when no video application in the whitelist is opened, the processing module is configured to determine that the current network transmission rate is the second network rate; the processing module is used for adjusting P2P monitoring time length and WiFi surfing time length based on the second network rate. And combining the equipment capability and the current network rate, dynamically adjusting the P2P monitoring time length and the WiFi surfing time length, improving surfing speed as much as possible, and ensuring the time of equipment discovery by screen throwing.

As an embodiment of the second aspect of the present application, when the video application in the whitelist is opened, the processing module extends the WiFi internet duration.

As an embodiment of the second aspect of the present application, the processing module is further configured to determine that the received signal strength value is greater than or equal to a preset strength value, and the first electronic device turns off the P2P listening and screen throwing function. The scene is suitable for an environment with non-poor signal strength, and the internet surfing speed of the user using the electronic equipment is preferentially ensured.

As an embodiment of the second aspect of the present application, when the electronic device includes a communication module, configured to establish a P2P connection with another electronic device based on a P2P listening period and a WiFi surfing period, the communication module is configured to receive, based on the P2P connection, a video image sent from the other electronic device and used for screen projection, and set a first play buffering period to ensure that an image frame is displayed in real time; when the processing module of the electronic device determines that the image frames played in the screen have abnormal conditions, the processing module is used for prolonging the first playing buffer time to the second playing buffer time. The fluency of playing the multimedia content can be ensured, and the condition that the screen is jumped or blocked on the screen is improved

As an embodiment of the second aspect of the present application, when it is determined that an abnormal situation occurs in an image frame played in a screen, the processing module further determines that a resolution used for screen projection reaches a preset resolution, and the frame rate of the screen projection reaches a preset frame rate, and the communication module is configured to send a request for reducing the resolution and the frame rate to another electronic device;

as an embodiment of the second aspect of the present application, when it is determined that the difference between the playing time of two adjacent image frames is greater than the first preset time, and the preset number of times is reached within the second preset time; or determining that the packet loss rate of the continuous image frames reaches the preset packet loss rate, and determining that the image frames played in the screen are abnormal by the processing module.

As an embodiment of the second aspect of the present application, the receiving module is configured to receive information that video is started, and the processor sets a play buffer duration to a third play buffer duration according to the information that video is started, where the third play buffer duration is longer than the second play buffer duration. Furthermore, for the video application when the screen is projected, the buffer time can be further prolonged, the blocking can be effectively avoided, and the user experience is improved.

As one embodiment of the second aspect of the present application, the video application is a video application in a whitelist. Further, the play effect is improved for the selected video application by setting the video application in the white list.

In a third aspect, the present application further discloses an electronic device, including:

a memory for storing instructions for execution by one or more processors of the device, an

A processor, configured to perform a method performed by the first electronic device or a method performed by the second electronic device according to an embodiment of the first aspect.

In a fourth aspect, the present application further includes a screen projection system, including a first electronic device and a second electronic device, where the first electronic device is configured to execute a method executed by the first electronic device of the first aspect embodiment, and the second electronic device is configured to execute a method executed by the second electronic device of the first aspect embodiment.

In a fifth aspect, the present application provides a computer readable storage medium storing a computer program, which when executed by a processor, causes the processor to perform a method performed by the first electronic device or a method performed by the second electronic device according to the embodiment of the first aspect.

In a sixth aspect, the present application discloses a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method performed by the first electronic device of the above-described first aspect embodiment, or the method performed by the second electronic device.

Drawings

Fig. 1a is a schematic diagram of a projection scene according to an embodiment of the present application;

FIG. 1b is a schematic view of an interface during screen projection according to an embodiment of the present application;

fig. 2 is a graph of the influence of WIFI P2P listening on the internet surfing rate at different network signal strengths;

FIG. 3 is a schematic diagram of an electronic device according to an embodiment of the present application;

FIG. 4 is a block diagram of the software architecture of an electronic device according to one embodiment of the present application;

FIG. 5a is a flow chart of a screen projection method according to one embodiment of the present application;

fig. 5b is a table of correspondence between network data rate of surfing and P2P monitoring duration and surfing duration in the case that the device supports only 2.4G according to an embodiment of the present application;

Fig. 5c is a table of correspondence between network data rate of surfing and P2P monitoring duration and surfing duration in the case that the device according to an embodiment of the present application does not support only 2.4G;

FIG. 6a is an interaction flow chart of a module corresponding to the screen projection method in the embodiment of the present application;

FIG. 6b is a flowchart showing interaction of each module when the intelligent screen of the embodiment of the present application supports only 2.4G;

FIG. 6c is a flowchart illustrating interaction of each module in the case that the intelligent screen according to the embodiment of the present application does not support only 2.4G;

FIG. 7 is a system architecture diagram of another projection screen scenario according to an embodiment of the present application;

FIG. 8 is an interactive flowchart of a method for performing a screen-casting between a mobile phone and a smart screen according to an embodiment of the present application;

fig. 9 is an interface operation schematic diagram of a mobile phone according to an embodiment of the present application;

fig. 10 is a schematic diagram of another interface operation of the mobile phone according to the embodiment of the present application;

FIG. 11 is an interactive flowchart of a method for performing a screen-casting between a mobile phone and a smart screen according to another embodiment of the present application;

fig. 12 is a block diagram of a system-on-chip according to some embodiments of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

In order to facilitate understanding of the technical solutions of the present application, the technical problems to be solved by the present application are first described below.

Referring to fig. 1a, fig. 1a shows a schematic diagram of a projection scene according to an embodiment of the present application. In this application, the screen may be a mirror image screen, as shown in fig. 1a, a wireless fidelity direct connection (Wireless Fidelity direct.wifi direct), also called a wireless fidelity point-to-point connection (Wireless Fidelity Peer to Peer, WIFI P2P) communication connection, hereinafter referred to as "WIFI P2P" for short, may be established between the mobile phone 101 and the smart screen 102. The mobile phone 101 may transmit the multimedia content acquired from the network side or the multimedia content acquired from the local side to the smart screen 102 through the P2P connection in a peer-to-peer manner. As shown in fig. 1b, fig. 1b is a schematic view of an interface during screen projection according to an embodiment of the present application. Through the point-to-point transmission, the image interface data on the mobile phone 101 can be transmitted to the intelligent screen 102 in real time (transmission delay is ignored here, etc.), so that the display interfaces on the screen of the mobile phone 101 can be displayed on both the mobile phone 101 and the intelligent screen 102, and a user can watch a video through another device with a larger screen, thereby improving the visual experience of the user.

In some embodiments, as shown in fig. 1a, when the handset 101 and the smart screen 102 respectively establish a WiFi connection with the router 103, and acquire network signal strength values for respective surfing. But when the router 103 connects too many devices, or when the handset 101 and the smart screen 102 are far from the router 103, the network signal strength values received by the handset 101 and the smart screen 102 are low. The smart screen 102 is illustrated as an example. At the time of starting up, the smart screen 102 may default to start WIFI P2P monitoring, but when the WIFI signal intensity is poor, and when the device capability of the smart screen is poor, for example, a wireless network (Wireless Fidelity, WIFI) chip only supporting 2.4G frequency band is provided, and especially in the case of poor wireless network signal, if WIFI P2P monitoring is started, the influence of WIFI internet surfing speed is aggravated. In order to guarantee the internet surfing speed, the intelligent screen can close WIFI P2P monitoring so as to improve the internet surfing speed. However, the WIFI P2P monitoring is turned off, so that the smart screen cannot find the device that wants to throw the screen, for example, the mobile phone 101, and thus the mirror image screen throwing cannot be realized, and the experience of automatic screen throwing of the user is reduced.

Referring to fig. 2, a graph of the influence of WIFI P2P monitoring on the internet surfing rate is opened under different network signal strengths. The graph compares the percentage value of the rate drop of the network transmission rate corresponding to the intelligent screen 102 before and after the WIFI P2P monitoring is not opened and the WIFI P2P monitoring is opened when the intelligent screen 102 receives the received signal strengths (network signal strength values) with different strengths. In the following, with reference to fig. 2, a Downlink (DOWN) network transmission rate corresponding to the smart screen will be described as an example. As shown in fig. 1 and fig. 2, when the received signal strength (Received Signal Strength Indicator, RSSI) of the smart screen 102 is-50 db, the downlink network transmission rate (Mbps) corresponding to the smart screen 102 is reduced to "45.1", "51.5" is reduced to "47.7", "54.1" is reduced to "48.9", and "102" is reduced to "94.2" in order of "49.6" and "49.1" before and after the WIFI P2P listening is turned on (enabling power-on-up and power-on-ready). The drop percentages for the network transmission rates were "9.07%", "7.38%", "9.61%", and "7.65%", respectively. When the received signal strength is-65 db, the drop percentages of the downlink network transmission rates before and after the unopened P2P monitoring and the opened WIFI P2P monitoring obtained by comparison and calculation are "25.87%", "44.21%", "35.83%", and "56.78%". When the received signal strength is-80 db, the drop percentages of the downlink network transmission rates corresponding to the unopened P2P monitoring and the WIFI P2P monitoring before and after opening are "37.61%", "54.44%", "62.62%", and "74.29%", which are obtained by comparing and calculating. As can be seen from fig. 2, as the received signal strength is lower, the network transmission rate corresponding to the smart screen 102 is lower and the drop amplitude is larger after the WIFI P2P monitoring is turned on. And when the network signal strength is weaker, the WIFI P2P monitoring is started, and the influence on the network transmission rate of the intelligent screen is larger. This can significantly reduce the user experience. In addition, in some schemes, if a power-on projection scheme is not adopted, namely, when the power-on is started, a P2P monitoring function is not started, then a user needs to firstly open a projection screen APP on an intelligent screen, the mobile phone can find out, the operation is troublesome, and the user experience is also reduced.

In order to solve the above problems, the present application provides a screen projection method. The WIFI P2P monitoring time length and the WIFI surfing time length are adjusted by judging the equipment capability and the signal strength, the startup can be realized as much as possible, the surfing network transmission rate is ensured, and therefore the user experience is improved.

The screen projection method of the embodiment of the application is described below with reference to the accompanying drawings.

In connection with the scenario shown in fig. 1, when the smart screen 102 receives a power-on operation, the smart screen executes a power-on procedure in response to the power-on operation, and periodically detects a received network signal strength value after power-on. When it is determined that the received network signal strength value is greater than or equal to the preset strength value, the smart screen 102 further determines the device capability, i.e. detects the frequency band corresponding to the wireless transmission capability supported by the WiFi chip. E.g. whether only the radio transmission capability of the 2.4G band is supported, or only 5G is supported, or, alternatively, 2.4G and 5G multiplexing is supported. Based on the device capability, the intelligent screen sets P2P monitoring time and WiFi surfing time. The longer the P2P monitoring time, the more rapid the connected screen-throwing equipment can be found. The longer the WiFi surfing time, the more the surfing speed can be ensured. Therefore, the P2P monitoring time length and the WiFi surfing time length are dynamically adjusted through different equipment capacities and signal strengths, so that the time length of the intelligent screen for finding the equipment for screen throwing based on the P2P monitoring time length and the WiFi surfing speed are balanced. For example, in several cases of supporting only 2.4G frequency band, supporting 5G frequency band, and supporting 2.4G and 5G multiplexing, although the 2.4G frequency band has strong penetration capability, the 2.4G frequency band signal screen width is narrower than that of the 5G frequency band, so that it is easily affected by network environment, resulting in situations of slow internet surfing speed, unstable internet speed, and low transmission efficiency. Therefore, under the condition of only supporting the equipment capability of the 2.4G frequency band, the corresponding WIFI surfing time length is longer than that of other two conditions, so that surfing speed which is affected by weak transmission capability is compensated, and surfing speed is ensured as much as possible. Meanwhile, P2P monitoring can be executed, startup can be realized, the scheme can better balance the time length and the internet surfing speed of the screen projection equipment, and the user experience is improved.

In the above description, taking the electronic device as an example of the smart screen, in other embodiments of the present application, the electronic device may also be an electronic device having a display screen, such as a mobile phone, a tablet computer, a desktop computer, a television (smart screen), a wearable device, a vehicle-mounted device, a personal digital assistant (personal digital assistant, PDA), etc., and supporting a screen throwing function, which does not limit the specific type of the electronic device.

The screen projection method of the embodiment of the present application is described below with reference to a specific structure of an electronic device.

Fig. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) connector 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The processor 110 may generate operation control signals according to the instruction operation code and the timing signals to complete instruction fetching and instruction execution control.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it may be called directly from memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In one embodiment of the present application, the processor 110 may receive the network signal strength value after the power-on is completed, and determine whether the network signal strength value is greater than a preset strength value. When the network signal strength value is greater than the preset strength value, the device capability is further determined, for example, only the wireless transmission capability of the 2.4G frequency band is supported, or the 5G frequency band is supported, or the 2.4G multiplexing and 5G multiplexing are supported, and the processor 110 sets the P2P monitoring duration and the WiFi internet duration according to different device capabilities, where the P2P monitoring is set to be used for discovering the screen-throwing device, so that the electronic device 100 is paired with the screen-throwing device, and when the screen-throwing is required, real-time transmission of data can be realized. The WiFi internet time can determine the network transmission rate when surfing the internet. Therefore, by using different devices, the time for the electronic device 100 to discover the screen-throwing device and the network transmission rate during surfing can be balanced better by corresponding to different P2P monitoring time and WiFi surfing time. Furthermore, when the equipment capability is weak, screen projection can be realized, the network transmission rate can be ensured, and the user experience can be improved.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of transmitting audio data through the screen. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, so as to realize a function of playing sound when the screen is thrown.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing functions of electronic device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display functionality of the electronic device 100. For example, an interface displayed when a screen is thrown is realized.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, the processor 110 receives the network via the wireless communication module 160 and obtains a network signal strength value, and the further processor 110 determines a power-on-ready-to-power-on-un-ready-to-power-on-ready-to-power-on-off scheme based on the network signal strength value.

In some embodiments, the wireless communication module may perform the monitoring and surfing functions according to the set P2P monitoring and WIFI surfing time length. To ensure that a screenable device is discovered and network signals are provided for surfing the internet.

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

In some embodiments, the display screen 194 is used to display images, videos, and the like. For example, a video image transmitted by another electronic device through a screen-casting function may be displayed. The two devices can display the same video content at the same time.

The internal memory 121 may be used to store computer-executable program code that includes instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 110 performs various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

In one embodiment of the present application, the internal memory 121 may store an instruction of the screen-throwing method, and the processor 110 runs the instruction of the screen-throwing method, so that when the electronic device 100 is started, based on the network signal strength value and the device capability, a reasonable P2P monitoring duration and a WiFi internet duration are set, and the P2P monitoring and discovery of the device duration for screen throwing and the network transmission speed of WiFi internet are balanced.

Further, when the electronic device 100 starts to throw a screen, the processor 110 displays the same interface as the screen throwing device by controlling the display 194. And the processor 110 may adjust the playing buffer time according to the playing time difference of two adjacent image frames or the image frame packet loss rate, so as to avoid abnormal image display, for example, abnormal situations such as screen display, blocking, etc. on the interface of the display screen as much as possible.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may play audio or the like transmitted by the projection device through the speaker 170A.

The software system of the electronic device 100 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the invention, taking an Android system with a layered architecture as an example, a software structure of the electronic device 100 is illustrated.

Fig. 3 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present invention.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 3, the application package may include applications such as a drop-in application, a camera, a gallery, a calendar, a call, a map, a WLAN, bluetooth, music, video, a short message, etc.

The screen-casting application provides a wireless screen-casting function, and supports wireless screen-casting sharing of multimedia content between the electronic device 100 and another screen-casting device.

The video application can provide a wireless screen-throwing function, support the electronic device 100 to establish connection with other electronic devices in the local area network through wireless screen throwing, and realize the screen-throwing function.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 3, the application framework layer may include a drop service, a WiFi service, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a video whitelist module, and the like.

The screen throwing service can obtain the network signal intensity value through the WiFi service, judge the network signal intensity value, and close the P2P monitoring function through the WiFi service when the network signal intensity value is smaller than a preset value. And when the network signal strength value is greater than a preset value, setting the P2P monitoring and WIFI surfing time according to the equipment capability.

In some embodiments, the screen-throwing service may further obtain a network data rate of the foreground operation data, and further adjust the P2P monitoring and WIFI surfing time according to the network speed. The situation that the played content is blocked when the user uses the electronic equipment 100 to surf the internet is reduced while the startup is ensured to be available.

The WiFi service may invoke the wireless communication module 160 to establish a connection with the router and obtain the network signal strength value and send to the screen casting service.

In addition, the WiFi service can call the wireless communication module to execute P2P monitoring, and information of the electronic equipment which is on the screen is obtained. Therefore, P2P connection with other electronic equipment is realized, and the wireless screen throwing function is convenient to realize.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

In some embodiments, the window manager may obtain a screen size, and upon receiving image data sent by the screen casting device, display a corresponding video image in accordance with the screen size.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

In one embodiment of the present application, the content provider may provide buffered image data, for example, in a process of screen-casting between the electronic device 100 and another electronic device, the electronic device 100 may receive and cache image data within a preset duration sent by the other electronic device, and then obtain the data by the video application, so as to realize playing on the display screen, so as to avoid situations of video on the display screen that is blocked and screen-printed.

In some embodiments, the content provider may also provide video applications Bai Mingshan, e.g., recordable video application a and video application B in Bai Mingshan, and when a video application in the whitelist is opened by the electronic device 100, the electronic device 100 may turn off the P2P listening module to stop listening to other devices. Or, the time length of the equipment capable of being put on the screen and the network transmission speed of surfing the Internet are found by setting the P2P monitoring time length and the WiFi surfing time length in a balanced mode.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

In some embodiments, the resource manager may store the attribute value of the WiFi chip, and may determine the attribute (device capability) of the WiFi chip according to the attribute value, for example, only support the transmission capability of the 2.4G band or the 5G band, or support both 2.4G and 5G.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

The video white list module is used for acquiring a white list of the video application and an application program corresponding to the content played in the current display screen. And judging whether the played application is a video application in the white list.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver, a sensor driver and a WiFi driver. The WiFi driver is configured to implement communication between the WiFi service and the wireless communication module 160, so as to implement invocation of the wireless communication module 160 by the WiFi service, so as to implement wireless network connection.

The following describes the screen projection method provided in the embodiment of the present application in detail from two aspects by taking an intelligent screen as an example.

In the first aspect, when the intelligent screen is started, whether other screen-throwing equipment needs to be monitored is judged through the network signal intensity value. And under the condition that other screen throwing equipment can be monitored, setting P2P monitoring time length and WIFI surfing time length according to the equipment capacity of the intelligent screen so as to balance the time length of the intelligent screen for finding the screen throwing equipment and the network transmission rate during surfing. The user can enjoy the screen throwing experience at any time, and the internet surfing speed is not influenced.

In a second aspect, improvements may be made on the basis of the screening scheme taught in the first aspect. Under the condition that the intelligent screen is connected with other screen throwing equipment and the screen throwing time is set, the condition that the screen is jumped or the image is blocked when the image of the screen throwing is played due to poor equipment capacity of the intelligent screen is improved by setting the playing buffer time.

The screen projection method provided by the embodiment of the application can be applied to the electronic equipment with the hardware structure shown in the figure 3 and the software structure shown in the figure 4. Or more or less components than illustrated, or some components may be combined, or some components may be separated, or different components may be arranged, or the like in hardware and software configurations.

The method for projecting a screen according to the first aspect will be described first, and the method will be described as applied to a smart screen. Referring to fig. 5a, fig. 5a shows a flowchart of a screen projection method according to an embodiment of the present application. The screen projection method comprises S501-S514.

S501, receiving a starting operation. For example, the user opens the smart screen through the on-off key of the smart screen, or sends an electrical signal to the smart screen through a remote controller or other devices to realize the start-up operation.

S502, responding to a starting operation, and receiving a network signal strength value.

The process can be completed by the wireless communication module of the intelligent screen, and after the intelligent screen is started, the processor of the intelligent screen establishes connection with the WIFI access point device, such as a router, through controlling the wireless communication module, and acquires the network signal strength value.

S503, judging whether the network signal strength value is smaller than-80 db (preset strength value).

It should be noted that, in the present application, the preset intensity value is illustrated as a threshold value when the preset intensity value is-80 db, and in some embodiments, the preset intensity value may also be other values, for example, -70db, -75db, -85db, 90db, etc., and the specific values of the parameters are not limited in the present application.

When the network signal strength value is smaller than-80 db, if the WIFI P2P monitoring is started, the internet surfing speed is seriously affected, so that the intelligent screen executes S514 to ensure the internet surfing speed, and closes the WIFI P2P monitoring.

When the network signal strength value is equal to or greater than-80 db, S504 is performed.

In S504, it is determined whether or not the WiFi chip capability (device capability) is detected to support only 2.4G.

The WIFI chip capability (device capability) in the present application refers to a transmission capability of a frequency band that the chip can support, for example, a transmission capability of only 2.4G frequency band, 5G frequency band, and several frequency bands that support 2.4G and 5G multiplexing. Because the 2.4G frequency band signal screen width is narrower than the signal screen width of 5G frequency band, so receive network environment influence easily, lead to the circumstances that internet surfing speed is slow, the internet surfing speed is unstable, transmission efficiency is low. Therefore, different P2P monitoring and surfing using time periods are set for devices with different capabilities by judging the capability of the WiFi chip. The time of the screen-throwing device is found out and the network data rate when surfing the internet are better balanced.

In one embodiment of the present application, if the WiFi chip capability is determined to be a transmission capability supporting only the 2.4G band, the smart screen executes S505.

In S505, the P2P listening duration is set to 50ms, and the wifi surfing duration is set to 950ms. For example, after the intelligent screen controls the P2P monitoring time period to be 50ms, the intelligent screen stops monitoring and controls the WIFI surfing time period to be 950ms. The ratio is based on the network signal value currently received by the intelligent screen, and the corresponding P2P monitoring duration and WIFI surfing duration obtained by the transmission capacity of the WIFI chip only supporting the 2.4G frequency band. Monitoring of the screen throwing device can be achieved, WIFI P2P connection with the mobile phone 101 of the intelligent screen 102 in the scene of fig. 1a is maintained, surfing speed can be ensured, and therefore user experience can be improved.

In an embodiment of the present application, after executing 505, the smart screen may further execute S506 to S508 and S514, that is, by detecting whether the video application is opened in the current screen and the network data rate corresponding to the current smart screen, further adjust the P2P monitoring and WIFI surfing time length, so as to select a better time length according to the actual use situation of the smart screen, balance the monitoring time length and surfing speed, and further improve the user experience.

In S506, the period detects whether a video application is open.

If yes, the intelligent screen executes S514 to close the P2P monitor. Considering that the scenario is based on the device capability being the transmission capability supporting only the 2.4G frequency band, the device capability is relatively poor, and if the P2P monitoring is started, the internet surfing speed is greatly affected, so when the video application is started, the P2P monitoring is closed to ensure the smoothness of video playing.

If not, the intelligent screen performs S507 to determine the network data rate (first network rate) of the current network. The network data rate refers to the network data traffic used by the intelligent screen in unit time. In different scenes, the internet surfing data rate can be different, and the required practical internet surfing time length can also have different requirements, so that the P2P monitoring and internet surfing time is adjusted based on the first network rate, and the dynamic balance of screen throwing and internet surfing speed according to different scenes can be realized.

In some embodiments of the present application, a video application may refer to a video application that is placed in a whitelist. At this time, if there is an open video application, but not a video application in the white list, the smart screen may still execute 507.

And S508, adjusting the P2P monitoring time length and the WIFI surfing time length according to the network data rate. The correspondence between the number of network data and the second ratio is described below with reference to the graph.

Referring to fig. 5b, fig. 5b shows a table of correspondence between network data rates of surfing and P2P listening and WiFi surfing durations in case that the device supports only 2.4G. The intelligent screen can determine the network data flow used according to the set duration, for example, within 5 seconds or more, calculate the average network flow per second, and obtain the network data rate. And comparing the obtained network data rate with the corresponding relation in fig. 5b to determine the using time length of the P2P monitoring and surfing. As shown in fig. 5b, the P2P listening duration and the WiFi surfing duration corresponding to the network data rate of "0-1 MB/sec" are respectively 50ms/850ms. Since the user typically does not use the intelligent screen to surf the internet when the network data rate is between 0-1 MB/sec, the screen runs the application in the noon, which belongs to a scene of no data and no background data. Therefore, the proper use time of surfing the internet can be reduced, and the screen throwing equipment such as a mobile phone can be discovered or connected more quickly.

Accordingly, as shown in fig. 5b, when the smart screen plays music and a small amount of data in the market is referenced, namely, the corresponding network data rate is the P2P monitoring duration corresponding to the network data rate of "1-5 MB/s" and the WiFi internet use duration is "50ms/950ms".

In addition, if the opened video application is not the video application in the whitelist as mentioned in S506 above, the smart screen also needs to confirm the scene of the opened video application in the non-whitelist. As shown in fig. 5b, scenes of "general video" and "high quality video" can be classified. Wherein, the general video, such as the playing video with resolution less than 720P. High quality video, such as video at 1080P resolution, or greater resolution. When the smart screen determines that the network data rate is "5-20 MB/sec", it indicates that it is a scene for playing general video. The corresponding P2P listening duration and WiFi surfing duration are "50ms/1050ms". When the network data rate is determined to be "20 MB/sec or more", a scene in which high-quality video is played is indicated. The corresponding P2P listening and surfing time is "50ms/1150ms". Therefore, based on scenes corresponding to network data rates with different requirements, different P2P monitoring time lengths and WiFi surfing time lengths are set, surfing speed can be ensured, screen projection can be realized, and user experience is improved.

In S504, if the chip capability for detecting WIFI is the transmission capability supporting not only the 2.4G band. For example, the transmission capability of the 5G band is also supported, which indicates that the transmission capability of the WIFI chip is better, and the smart screen executes S509.

In S509, the P2P listening duration is set to 50ms, and the wifi surfing duration is set to 500ms. The original duration can be regarded as a default ratio, the network signal value currently received by the intelligent screen is comprehensively considered in the duration, and the WIFI chip not only supports the transmission capability of the 2.4G frequency band, but also can monitor the screen throwing equipment, so that the intelligent screen 102 is connected with the WIFI P2P of the mobile phone 101 in the scene of fig. 1a, the surfing speed is improved as much as possible, and the user experience is improved.

In an embodiment of the present application, after the execution 509, the smart screen may further execute S510-S513, that is, by detecting whether the video application is opened in the current screen and the network data rate currently corresponding to the smart screen, further adjust the P2P monitoring and WIFI surfing time length, so as to select a better time length proportion according to the actual use situation of the smart screen, balance the P2P monitoring time length and surfing speed, and further improve the user experience.

And S510, periodically detecting whether a video application is opened.

And when the intelligent screen judges that the video application is opened, executing S513, and setting the P2P monitoring time length to 50ms and the WIFI surfing time length to 950ms. Compared with the condition that the video is not started, the WIFI surfing time is prolonged, so that surfing speed can be ensured, and video playing fluency is ensured.

When the smart screen determines that no video application is open, S511 is performed to determine the network data rate (second network rate) of the current network. Where the network data rate refers to the network data traffic used by the smart screen per unit time. The scenario is the same as the scenario in which the first network rate is determined, and the first network rate may be the same as or different from the second network rate. In different scenes, different equipment capacities, different demands are also met for the required internet surfing use time, and the longer the internet surfing practical time is, the more the internet surfing speed can be ensured. Therefore, the P2P monitoring time length and the Internet surfing time length are adjusted based on the second network rate, and the dynamic balance of the screen throwing and Internet surfing speed according to different scenes can be realized.

In some embodiments of the present application, a video application may refer to a video application that is placed in a whitelist. At this time, if there is an open video application, but not a video application in the white list, the smart screen may still execute S511. And S512, adjusting the P2P monitoring time length and the WIFI surfing time length according to the current network data rate. The corresponding relation between the network data rate and the P2P monitoring time length and the WIFI surfing time length is described below by combining with a chart.

Referring to fig. 5c, fig. 5c shows a table of correspondence between network data rates of surfing and P2P listening and surfing time periods for a device that does not support only 2.4G. As shown in fig. 5b, the P2P listening and surfing duration corresponding to the network data rate of "0-1 MB/sec" is 50ms/400ms, respectively. Since the user typically does not use the intelligent screen to surf the internet when the network data rate is between 0-1 MB/sec, the screen runs the application in the noon, which belongs to a scene of no data and no background data. Therefore, the proper use time of surfing the internet can be reduced, and the screen throwing equipment such as a mobile phone can be discovered or connected more quickly.

Accordingly, as shown in fig. 5c, when the smart screen plays music and a small amount of data in the market is referenced, that is, the corresponding network data rate is that the P2P listening duration and the WiFi surfing duration corresponding to the network data rate of "1-5 MB/s" are "50ms/500ms" respectively.

In addition, if the opened video application is not the video application in the whitelist as mentioned in S510 above, the smart screen also needs to confirm the scene of the opened video application in the non-whitelist. As shown in fig. 5c, scenes of "general video" and "high quality video" can be classified. When the intelligent screen determines that the network data rate is 5-20 MB/s, and the intelligent screen shows that the intelligent screen plays a scene of a common video, the corresponding P2P monitoring time length and the corresponding WiFi surfing time length are 50ms/700ms respectively. When the network data rate is determined to be more than 20 MB/s, which indicates that the scene of playing high-quality video is shown, the corresponding P2P monitoring and surfing time periods are respectively 50ms/950 ms. Therefore, based on scenes corresponding to network data rates with different requirements, different P2P monitoring time lengths and surfing time lengths are set, surfing speed can be ensured, screen projection can be realized, and user experience is improved.

The screen projection method of the embodiment of the present application is described below with reference to each module of the smart screen.

Referring to fig. 6a, fig. 6a shows an interaction flow chart of corresponding modules of the screen projection method in the embodiment of the application. The interaction flow corresponds to S501-S505, S509 and S514 in fig. 5 a. This process is illustrated by the smart screen execution example. As shown in fig. 6a, the smart screen may include a resource management module, a screen-throwing service, a WiFi service, and a WiFi driver, where a WiFi chip model is stored in the resource management module, and a corresponding attribute value is determined based on the WiFi chip model, that is, a device capability of the WiFi chip is determined. The flowchart includes S610-S680.

S610, the screen service receives a startup completion event. For example, after the boot execution module receives the user boot operation, the boot is executed, the smart screen boot process is completed, and at a time node after the smart screen is completed, the boot execution module sends a boot completion event to the screen projection service to trigger the screen projection service to execute S620. In S620, the screen casting service acquires a network signal strength value.

In one embodiment of the present application, as shown in fig. 6a, the screen-throwing service may first communicate with the WIFI service, notify the WIFI service to obtain a network signal strength value, after receiving the notification, send the notification to the WIFI driver, where the WIFI driver is a bridge connected to software and hardware, control the signal transceiver to obtain a network signal, and finally send the obtained network signal strength value to the screen-throwing service. S630, the screen throwing service judges whether the network signal strength value is smaller than-80 db. This process corresponds to S503 in fig. 5a, and specific reference is made to the description in S503.

When the network signal strength value is smaller than-80 db, the on-screen service executes S640 to notify the WiFi service to close the P2P listening. The WiFi service sends a close P2P listening command to the WiFi driver, which notifies hardware (e.g., radio frequency module) to stop listening.

When the network signal strength value is greater than or equal to-80 db, the screen-casting service executes S650 to obtain the WiFi chip model from the resource management module. Device capabilities are obtained based on the WiFi chip model. For example, only 2.4G bands are supported, 5G bands are supported, and transmission capabilities of 2.4G and 5G multiplexing are supported, etc.

S660, judging whether only 2.4G is supported. For example, a corresponding attribute value is obtained based on the WiFi chip model, and corresponding device capability is obtained according to the attribute value. Corresponding to S504 in FIG. 5a

If only 2.4G is supported, the screen-casting service executes S670, sets the P2P monitoring time length to be 50ms, sets the WIFI surfing time length to be 950ms, and sends the WIFI surfing time length to the WiFi driver. And the WiFi driving controls the wireless communication module 160 shown in fig. 3 to alternately perform monitoring and surfing according to the P2P monitoring duration of 50ms and the WiFi surfing duration of 950 ms. Corresponding to S505 in fig. 5 a.

If the method only supports 2.4G and S680, the P2P monitoring time length is set to be 50ms, the WIFI surfing time length is set to be 500ms, and the method is sent to the WiFi driver. And the WiFi driving controls the wireless communication module 160 to perform monitoring and surfing according to the P2P monitoring duration of 50ms and the WiFi surfing duration of 500 ms. Corresponding to S509 in fig. 5 a.

According to the screen projection method, based on the network signal intensity value received by the equipment and the actual condition of the equipment capacity, P2P monitoring and WIFI surfing time length are dynamically adjusted, or P2P monitoring is closed. Therefore, in the environment with serious WiFi signal interference (the received signal strength value is lower), the system can be started as much as possible, and the surfing speed is ensured.

In one embodiment of the present application, after S660 is performed in fig. 6a, two scenarios of different device capabilities occur, the first scenario: only 2.4G is supported. The second scenario is one that does not support only 2.4G, e.g., supports 2.4G and 5G multiplexing. In different scenes, each module can also consider whether the video application on the device is started or not, parameters such as network data flow (network data rate) of the device in unit time, and the like, so that the screen throwing effect is further improved. In the following embodiment, a first scene projection method will be described with reference to fig. 6b, and a second scene projection method will be described with reference to fig. 6 c.

First scenario: the decision is that only 2.4G of scenes are supported.

Referring to fig. 6a, in S660, when it is determined that only 2.4G is supported, the smart screen may further detect whether there is a situation of opening the video application and the current network data rate of the device to further adjust the P2P listening and WIFI surfing time period. The process corresponds to S506-S508 and S514 as in fig. 5 a.

Referring to fig. 6b, fig. 6b shows a flow chart of interaction of the modules in case that the smart screen of the embodiment of the present application has determined to support only 2.4G. In combination with 670 in fig. 6a, the screen-throwing service sets the P2P listening time length to be 50ms, and the wifi surfing time length to be 950ms later. The intelligent screen may also continue to execute S671-S679 as shown in fig. 6 b.

The screen service periodically detects whether a video application is opened at S671.

In one embodiment of the present application, the screen-casting service may obtain whether there is a running video application in the screen according to the window management module.

If it is determined that no video application is opened, the screen-casting service executes S672, sets the P2P monitoring duration to 50ms and the WiFi internet duration to 950ms, and sends the P2P monitoring duration to the WiFi driver through the WiFi service. And the wireless communication module 160 is controlled by the WiFi drive to alternately execute according to the P2P monitoring time length of 50ms and the WIFI surfing time length of 950ms so as to realize monitoring and surfing of the intelligent screen.

If it is determined that the video application is open, the screen-casting service performs S673 to send the name of the video application to the video whitelist module, and in some embodiments, information indicating the unique identifier of the video application, such as address information of the application, etc. may also be sent.

S674, the video whitelisting module confirms whether an application in the whitelisting is based on the name of the video application.

The video whitelist module can query whether the name of the application of which the video is opened is in a prefabricated database or a table, and if so, judge that the video application is the video application in the whitelist. If no longer, the whiteside is not an application in the whitelist. The video whitelist module sends the corresponding result to the screen-throwing service.

The video applications in the white list may be manually set according to the needs of the user, for example, the user may add the glory video or the third party application messenger video application to the white list. So that the user can turn off P2P listening when opening these applications in order to ensure better viewing fluency.

When the video application in the white list is judged, the video white list module sends information confirming that the video application is in the white list to the screen throwing service, and in S675, the screen throwing service notifies the WiFi service to close P2P monitoring. The WiFi service notifies the WiFi driver to control the wireless communication module 160 to turn off listening. In addition, in some embodiments, after the P2P monitoring is turned off, if the user still wants to throw the screen, the screen throwing function may be manually turned on to turn on the P2P monitoring function, so as to implement screen throwing.

When it is determined that the application is not a video application in the white list, the video white list management module sends an unknown application notification in the white list to the screen-casting service in S676.

After receiving the notification that it is not in the white list application, the screen service executes S677 to acquire the current network data rate.

As shown in S677 in fig. 6b, the screen-drop service may send a request for acquiring the network data rate to the WiFi service, the WiFi service sends a request command to the WiFi driver, and the WiFi driver executes the command to acquire a set duration, for example, 5 seconds of data traffic from the wireless communication module 160, calculate an average network traffic per second, obtain the network data rate, and send the network data rate to the screen-drop service.

S678, the screen throwing service looks up a table according to the network data rate to obtain the corresponding P2P monitoring and WIFI surfing time length. This step corresponds to S508 in fig. 5a, and the corresponding table is the table shown in fig. 5 a.

S679, the screen-drop service sends the ratio to the WiFi driver via the WiFi service, so that the WiFi driver performs an action of a corresponding duration through the wireless communication module 160. Therefore, the P2P monitoring and WIFI surfing time length is dynamically adjusted according to the actual use scene, so that the user can obtain the best experience under the corresponding scene under different scenes.

The second scenario: it is determined that a scenario of 2.4G is not supported.

When it is determined in S660 that not only 2.4G is supported based on the screen projection method of fig. 6a, the scenario includes a case where 2.4G and 5G multiplexing are supported. The intelligent screen can further detect whether the video application and the current network data rate condition of the equipment are opened or not to further adjust the P2P monitoring and WIFI surfing time. The process corresponds to S510-S513 in fig. 5 a.

Referring to FIG. 6c, FIG. 6c shows a flow chart of interactions of the modules in the case where the smart screen of an embodiment of the present application has been determined to not support only 2.4G. In combination with 680 in fig. 6a, the screen-casting service sets the P2P listening duration to 50ms, and the wifi surfing duration to 500ms later. The intelligent screen may also continue to execute S681-S689 as shown in fig. 6 c.

If it is determined that no video application is opened, the screen-casting service executes S682, sets the P2P monitoring duration to 50ms and the WiFi internet duration to 500ms, and sends the corresponding duration to the WiFi driver through the WiFi service. The WiFi drive control wireless communication module 160 controls the P2P monitoring duration and WiFi surfing according to the corresponding duration.

If it is determined that the video application is open, the screen-casting service executes S683 to send the name of the video application to the video whitelist module.

S684, the video whitelisting module confirms whether or not it is an application in the whitelisting based on the name of the video application. The determination process may refer to S674, and is not described here in detail.

When the video application in the white list is judged, the video white list module sends the information confirming the video application is in the white list to the screen throwing service, and in S685, the screen throwing service sets the P2P monitoring time length to be 50ms and the WIFI surfing time length to be 950ms, and sends the information to the WIFI driver through the WIFI service, and the WIFI driver controls the wireless communication module 160 to execute monitoring and surfing time length.

When it is determined that the application is not a video application in the white list, S686, the video white list management module sends an unknown application notification in the white list to the screen-casting service.

Upon receiving the notification that it is not in the white list application, the screen service performs S687 to acquire the current network data rate.

As shown in S687 in fig. 6c, the screen-drop service may send a request for acquiring the network data rate to the WiFi service, the WiFi service sends a request command to the WiFi driver, and the WiFi driver executes the command to acquire a set duration, for example, 5 seconds of data traffic from the wireless communication module 160, calculate an average network traffic per second, obtain the network data rate, and send the network data rate to the screen-drop service.

S688, the screen projection service looks up a table according to the network data rate to obtain corresponding P2P monitoring and WIFI surfing time length. This step corresponds to S512 in fig. 5a, and the corresponding table is the table shown in fig. 5 b.

S689, the screen-drop service sends the ratio to the WiFi driver via the WiFi service, so that the WiFi driver performs an action corresponding to the ratio through the wireless communication module 160. Therefore, the P2P monitoring and WIFI surfing time length is dynamically adjusted according to different equipment capacities and different use scenes, so that the best experience of a user in a corresponding scene can be obtained in different scenes.

In the above embodiments, the description is performed by using specific durations of the P2P monitoring duration and the WIFI internet surfing duration, and in some embodiments, the ratio of the P2P monitoring duration to the WIFI internet surfing duration may be set reasonably, for example, the ratio of the P2P monitoring duration to the WIFI internet surfing duration is 1/5,1/19, etc., and based on the ratio, the upper limit and the lower limit of the P2P monitoring duration and the upper limit and the lower limit of the WIFI internet surfing duration may be further defined, so that too short or too long a time is avoided, so that the discovery of the screen-throwing device is too long, or the long time is at a low network speed, which affects the user experience.

In addition, in the process of throwing the screen, if equipment capability is poor, and especially under the relatively poor condition of wireless network signal, meet WIFI interference big, when the poor condition of signal, throw the screen in-process and have the card and hang up, screen phenomenon for the user throws the screen experience greatly reduced.

Based on the above problems, the present application further provides a screen projection method of the second aspect, which is used for solving the phenomena of blocking and screen-splash so as to provide a user experience.

The screen projection scheme of the second aspect is described below in connection with the screen projection method explained in the embodiments of the first aspect described above with reference to fig. 5 to 6 c. The scene is adapted to a scene in which screen projection has been started between the screen projection device and the screen-projected device, and the scene can be based on the screen projection method of the first aspect.

Referring to fig. 7, fig. 7 shows a system architecture diagram of another screen-drop scenario in an embodiment of the present application. The architecture diagram adds a cloud server 104 to the architecture diagram shown in fig. 1 a. The cloud server may store a whitelist of corresponding video applications. As shown in fig. 7, the mobile phone 101 establishes a WIFI P2P connection with the smart screen 102. And the mobile phone 101 and the smart screen 102 are respectively connected with the router 103 through WiFi. The mobile phone 101 establishes a wireless connection with the cloud server 104, and the cloud server 104 can obtain a white list. When the mobile phone 101 throws a screen to the smart screen 102, multimedia data (including image, audio data, etc.) can be transmitted in real time through the P2P connection established between the two. When the mobile phone 101 starts to throw the screen to the smart screen 102, the mobile phone 101 can improve the situation that the screen is stained or the image is blocked when the smart screen plays the image of throwing the screen by setting the playing buffer time. Especially, can improve the screen or the image card that lead to when the equipment ability of wisdom screen is poor and stop the condition.

The process of the mobile phone and the smart screen is described below with reference to fig. 7.

Referring to fig. 8, fig. 8 shows an interaction flow chart of a method for performing screen projection with a smart screen in the embodiment of the present application. As shown in fig. 8, the flow includes S801 to S811.

S801, the mobile phone detects the mirror image screen projection operation.

Referring to fig. 9, fig. 9 shows an interface operation schematic of the mobile phone. When the user wants to throw the screen, the user opens the task management center by sliding down in the interface 910 as shown in fig. 9 (a), and then clicks the mirror screen throw key 921 to open the mirror screen throw in the task management center, so as to obtain the interface 920 as shown in fig. 9 (b). So that the mobile phone obtains multimedia content data such as interface images and sounds and sends the multimedia content data to the intelligent screen through the P2P connection.

In the embodiment of the application, when the user clicks the mirror image screen, if a plurality of devices are found to be connected, the mobile phone can be used for the user to select the device which wants to screen in a popup window mode. Fig. 10 is a schematic diagram of another interface operation of the mobile phone shown in fig. 10. As shown in fig. 10 (a), after the user clicks the mirror image screen projection key 1011 in the interface 1010, an interface 1020 as shown in fig. 10 (b) is displayed, a popup window is displayed in the interface 1020, and the popup window has a "smart screen" and a "tablet" for the user to select, and when the user clicks the smart screen, the mobile phone executes S802.

S802, the mobile phone sends the multimedia content to the intelligent screen. The multimedia content includes interface images acquired by the mobile phone or data information such as sound, for example, images of the mobile phone interface are acquired by means of screen recording, sound data are acquired by means of sound recording, and specific recording schemes can refer to existing technical schemes and will not be described in detail herein.

S803, the smart screen sets a play buffer for 100ms (first play buffer duration). The intelligent screen can smoothly play the streaming media content when the video is normally played through setting the play buffer.

S804, the intelligent screen detects whether the playing is abnormal or not at regular time. Among them, the abnormal play may mean that white stripes or spots appear on the image on the screen. The time interval between two consecutive image frames appearing on the screen exceeds a preset time, for example, the playing time difference of each image frame is greater than 1/60 second (the first preset time), and the two adjacent image frames are blocked because the playing time interval of the two adjacent image frames is greater than the set time of 1/60 second, or the blocking time is longer, the device can delete some image frames, namely, the situation of packet loss occurs, and if the packet loss rate of the image frames reaches the preset packet loss rate, for example, 2%, the intelligent screen determines that the current playing situation is abnormal playing.

When the smart screen determines that the playback is abnormal, the smart screen executes S805 to set a playback buffer of 500ms (second playback buffer duration).

S806, the intelligent screen judges whether the screen-throwing resolution is larger than or equal to the preset resolution and whether the frame rate is larger than or equal to the preset frame rate. For example, the preset resolution is 1080P, the preset frame rate is 60 frames/second, and when it is judged that the screen-casting resolution is 1080P, the frame rate is 60 frames/second, the smart screen performs S807.

In S807, the smart screen notifies the handset to reduce resolution and frame rate.

S808, the mobile phone receives the notification of reducing the resolution and the frame rate, and reduces the screen-throwing resolution and the frame rate. For example, the resolution is reduced to 720P and the frame rate is reduced to 40P/S. The specific value of the reduction can be the default value of the mobile phone or the user can set the value by hand.

S809, the mobile phone sends the multimedia content with reduced resolution and frame rate to the smart screen.

And S810, playing the multimedia content. The method can ensure that the screen projection picture is displayed in real time and the smoothness of playing the multimedia content is ensured.

According to the screen projection method, the situation that the image played on the intelligent screen is blocked or the screen is jumped when the screen is projected can be avoided as far as possible, and user experience is improved.

In an embodiment of the present application, the mobile phone may further adjust a playing buffer duration when determining whether the currently played video application is a whitelist application and determining that the currently played video application is an application in a whitelist.

Referring to fig. 11 in conjunction with the scenario shown in fig. 7, fig. 11 shows an interaction flow chart of a method for performing screen-casting with a smart screen in accordance with another embodiment of the present application. As shown in fig. 11, the flow includes S1101-S1105.

S1101, the mobile phone identifies that the multimedia content corresponds to a video application.

The condition for triggering the mobile phone to execute S1101 may be that the mobile phone may execute S1101 when the smart screen executes S807 in fig. 8, that is, when the smart screen notifies the book to reduce resolution and frame rate.

In some embodiments of the present application, after the smart screen playing is performed S810, when there is still a play abnormality, the mobile phone may perform S1101 when receiving a notification of the play abnormality. The present application is not limited in this respect.

S1102, the mobile phone acquires a video application white list from the cloud server.

The video application white list can be stored in the cloud server, and the video application white list can be a white list set by the cloud server according to the user use condition of big data statistics. For example, when the number of times the video application is used is high and the playback resolution and the frame rate are both kept high, for example, the resolution is equal to 1080P and the playback frame rate is 60 frames/second, the cloud server adds the corresponding video application to the whitelist based on these use cases.

In some embodiments, the whitelist may also be stored locally on the handset and the video applications in the whitelist may be added or subtracted by the user by setting up.

S1103, the mobile phone judges whether the video application is a video application in a white list.

After the mobile phone acquires the white list, comparing the video application identifier, such as the name, of the current screen-casting playing with the name in the white list, and informing the intelligent screen of the comparison result.

When the video is not the application video in the white list, the mobile phone executes S1104 to notify the smart screen that the current video application is the video application in the non-white list. After receiving the notification, the intelligent screen can keep the original playing buffer time, for example, 500ms, and play the screen-throwing image.

When the application video is in the white list, the mobile phone executes S1105 to notify the smart screen that the current video application is the video application in the white list.

S1105, the intelligent screen sets playing buffer duration 3S. Thus, the smoothness of the application video playing of the white list can be ensured.

According to the screen projection method of the second aspect of the embodiments of the present application, the playing buffer duration, the balance delay and the blocking can be dynamically adjusted according to the state of the screen projection, for example, normal playing (non-blocking, screen-churning situation) and abnormal playing (abnormal conditions such as screen churning, blocking and the like). Namely, under the non-abnormal condition, the playing buffer is small, the time delay is ensured, and the picture can be displayed in real time. When the video is played in abnormal conditions, the user does not pay attention to time delay when the mobile phone plays the video in the screen throwing mode, and the smoothness of playing is more concerned, so that the smoothness of playing is ensured by means of increasing buffering, reducing resolution and/or frame rate and the like, and the experience of watching the video of the user is provided.

The application also provides an electronic device comprising:

A processor for performing the method explained in connection with fig. 5 to 11 in the above embodiments.

The present application also provides a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the method explained in fig. 5 to 11 in the above embodiments.

The present application also provides a computer program product comprising instructions which, when run on an electronic device, cause a processor to perform the method shown in fig. 5 to 11 in the above embodiments.

Referring now to fig. 12, shown is a block diagram of a SoC (System on Chip) 1300 in accordance with an embodiment of the present application. In fig. 12, similar parts have the same reference numerals. In addition, the dashed box is an optional feature of a more advanced SoC. In fig. 12, soC1300 includes: an interconnect unit 1350 coupled to the application processor 1310; a system agent unit 1380; a bus controller unit 1390; an integrated memory controller unit 1340; a set or one or more coprocessors 1320 which may include integrated graphics logic, an image processor, an audio processor, and a video processor; a static random access memory (Static Random Access Memory, SRAM) unit 1330; a Direct Memory Access (DMA) unit 1360. In one embodiment, coprocessor 1320 includes a special-purpose processor, such as, for example, a network or communication processor, compression engine, GPGPU, a high-throughput MIC processor, embedded processor, or the like.

One or more computer-readable media for storing data and/or instructions may be included in Static Random Access Memory (SRAM) unit 1330. The computer-readable storage medium may have stored therein instructions, and in particular, temporary and permanent copies of the instructions. The instructions may include: when executed by at least one unit in the processor, the Soc1300 is caused to execute the screen projection method according to the above embodiment, and the method explained with reference to fig. 5 to 11 of the above embodiment may be specifically referred to, which is not described herein.

Embodiments of the mechanisms disclosed herein may be implemented in hardware, software, firmware, or a combination of these implementations. Embodiments of the present application may be implemented as a computer program or program code that is executed on a programmable system including at least one processor, a storage system (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.

Program code may be applied to input instructions to perform the functions described herein and generate output information. The output information may be applied to one or more output devices in a known manner. For purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (Digital Signal Processor, DSP), microcontroller, application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or microprocessor.

The program code may be implemented in a high level procedural or object oriented programming language to communicate with a processing system. Program code may also be implemented in assembly or machine language, if desired. Indeed, the mechanisms described in the present application are not limited in scope to any particular programming language. In either case, the language may be a compiled or interpreted language.

In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried by or stored on one or more transitory or non-transitory machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed over a network or through other computer readable media. Thus, a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including, but not limited to, floppy diskettes, optical disks, compact disk Read-Only memories (Compact Disc Read Only Memory, CD-ROMs), magneto-optical disks, read-Only memories (ROMs), random Access Memories (RAMs), erasable programmable Read-Only memories (Erasable Programmable Read Only Memory, EPROMs), electrically erasable programmable Read-Only memories (Electrically Erasable Programmable Read Only Memory, EEPROMs), magnetic or optical cards, flash Memory, or tangible machine-readable Memory for transmitting information (e.g., carrier waves, infrared signal digital signals, etc.) in an electrical, optical, acoustical or other form of propagated signal using the internet. Thus, a machine-readable medium includes any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).

In the drawings, some structural or methodological features may be shown in a particular arrangement and/or order. However, it should be understood that such a particular arrangement and/or ordering may not be required. Rather, in some embodiments, these features may be arranged in a different manner and/or order than shown in the drawings of the specification. Additionally, the inclusion of structural or methodological features in a particular figure is not meant to imply that such features are required in all embodiments, and in some embodiments, may not be included or may be combined with other features.

It should be noted that, in the embodiments of the present application, each unit/module is a logic unit/module, and in physical aspect, one logic unit/module may be one physical unit/module, or may be a part of one physical unit/module, or may be implemented by a combination of multiple physical units/modules, where the physical implementation manner of the logic unit/module itself is not the most important, and the combination of functions implemented by the logic unit/module is the key to solve the technical problem posed by the present application. Furthermore, to highlight the innovative part of the present application, the above-described device embodiments of the present application do not introduce units/modules that are less closely related to solving the technical problems presented by the present application, which does not indicate that the above-described device embodiments do not have other units/modules.

It should be noted that in the examples and descriptions of this patent, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

While the present application has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present application.

Claims

1. A screen projection method applied to a system at least comprising a first electronic device, the method comprising:

the first electronic equipment receives a starting operation;

responding to the starting operation, and determining whether the received network signal strength value is greater than or equal to a preset strength value by the first electronic equipment;

when the first electronic equipment determines that the received signal strength value is smaller than a preset strength value, the first electronic equipment closes the P2P monitoring and screen throwing function;

when the first electronic equipment determines that the received network signal strength value is greater than or equal to a preset strength value;

the first electronic device determines device capability, wherein the device capability is used for representing a frequency band of wireless transmission which can be supported by a WiFi chip of the first electronic device;

in the case where the first electronic device determines that the device capability is wireless transmission capability supporting only the 2.4G band,

when detecting that no video application is opened, determining that the current network transmission rate is a first network rate;

setting a P2P monitoring time length and a WiFi surfing time length based on the first network rate, keeping the original P2P monitoring time length unchanged, and extending the original WiFi surfing time length to a using time length matched with the first network rate so that the first electronic equipment alternately executes P2P monitoring and WiFi surfing according to the P2P monitoring time length and the WiFi surfing time length;

And when the condition that the video application is opened is detected, the first electronic equipment closes P2P monitoring and closes a screen throwing function.

2. The method of claim 1, wherein the P2P listening time period is 50ms and the WiFi internet time period is 950ms.

3. The method according to claim 1 or 2, wherein determining that the current network transmission rate is the first network rate when detecting that no video application is open comprises:

the first electronic equipment detects the opening condition of the video application in the white list, and when the video application without the white list is opened, the first electronic equipment determines that the current network transmission rate is the first network rate.

4. The method of claim 1, wherein the first electronic device determining that the device capability is a wireless transmission capability supporting a frequency band other than the 2.4G frequency band, the first electronic device setting a P2P listening period and a WiFi surfing period based on the device capability, comprises:

and the first electronic equipment keeps the original P2P monitoring time length and the original WiFi surfing time length unchanged.

5. The method of claim 4, wherein the original P2P listening time period is 50ms and the WiFi internet time period is 500ms.

6. The method according to claim 4 or 5, wherein the first electronic device sets a P2P listening use period and a WiFi internet use period based on the device capability, including:

the first electronic equipment detects the opening condition of the video application in the white list, and when the video application in the white list is not opened, the first electronic equipment determines that the current network transmission rate is the second network rate;

and the first electronic equipment adjusts P2P monitoring time length and WiFi surfing time length based on the second network rate.

7. The method of claim 6, wherein the first electronic device extends the WiFi internet duration when a video application in a whitelist is open.

8. The method of claim 1, wherein the system further comprises at least a second electronic device, the first electronic device discovers the second electronic device based on a P2P listening period and a WiFi surfing period, and establishes a P2P connection with the second electronic device, the method comprising:

the first electronic device receives video images for screen projection sent by the second electronic device based on P2P connection, and sets a first playing buffer time length so as to ensure that image frames are displayed in real time;

When the first electronic device determines that the abnormal situation occurs in the image frames played in the screen, the first electronic device prolongs the first playing buffer time length to a second playing buffer time length.

9. The method as recited in claim 8, further comprising:

when the abnormal situation of the image frames played in the screen is determined, the first electronic device also determines that the resolution used for screen projection reaches a preset resolution, the frame rate of the screen projection reaches a preset frame rate, and the first electronic device sends a request for reducing the resolution and the frame rate to the second electronic device;

and the second electronic equipment responds to the request, and reduces the resolution and the frame rate of the use of the second electronic equipment when the second electronic equipment is used for screen projection.

10. The method according to claim 8 or 9, wherein the first electronic device determining that the image frame played in the screen is abnormal comprises:

when it is determined that the play time difference of two adjacent image frames is larger than the first preset time and reaches the preset times in the second preset time; or,

and determining that the packet loss rate of the continuous image frames reaches a preset packet loss rate, and determining that the image frames played in the screen are abnormal by the first electronic equipment.

11. The method according to claim 8 or 9, further comprising:

the second electronic equipment determines that video application is started currently, and sends information of video starting to the first electronic equipment;

the first electronic device receives information of video start, and sets playing buffer time length to be third playing buffer time length, wherein the third playing buffer time length is longer than the second playing buffer time length.

12. The method of claim 11, wherein the second electronic device determines that a video application is currently launched and the video application is a video application in a whitelist, and sends information of video launching to the first electronic device.

13. An electronic device, comprising:

A processor for performing the method of screening according to any one of claims 1-12.

14. A screen projection system, comprising: a first electronic device and a second electronic device connected with the first electronic device P2P;

the first electronic device is configured to perform the method of screening according to any one of claims 1-12.

15. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, causes the processor to perform the screen projection method according to any one of claims 1-12.