CN115460445A - Screen projection method of electronic equipment and electronic equipment - Google Patents

Screen projection method of electronic equipment and electronic equipment Download PDF

Info

Publication number
CN115460445A
CN115460445A CN202110643966.7A CN202110643966A CN115460445A CN 115460445 A CN115460445 A CN 115460445A CN 202110643966 A CN202110643966 A CN 202110643966A CN 115460445 A CN115460445 A CN 115460445A
Authority
CN
China
Prior art keywords
screen projection
equipment
screen
electronic device
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110643966.7A
Other languages
Chinese (zh)
Other versions
CN115460445B (en
Inventor
王冬伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202110643966.7A priority Critical patent/CN115460445B/en
Publication of CN115460445A publication Critical patent/CN115460445A/en
Application granted granted Critical
Publication of CN115460445B publication Critical patent/CN115460445B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/146Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/2866Architectures; Arrangements
    • H04L67/30Profiles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64Addressing
    • H04N21/6402Address allocation for clients
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8166Monomedia components thereof involving executable data, e.g. software
    • H04N21/8173End-user applications, e.g. Web browser, game

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

The embodiment of the application provides a screen projection method of electronic equipment and the electronic equipment, wherein the method comprises the following steps: receiving screen projection operation of a user, and projecting a screen to screen projection equipment by electronic equipment in a system mirror image screen projection mode; receiving video playing operation of electronic equipment, and acquiring screen projection information of the electronic equipment, wherein the screen projection information comprises first equipment information of the screen projection equipment; and switching a screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to DLNA screen projection according to the first equipment information. According to the method, when the electronic equipment plays the video, if the electronic equipment is in the state of system mirror image screen projection at present, the DLNA screen projection can be automatically switched, so that the problems of black edge, blockage, unsynchronized flower screen and sound and picture and the like of the picture are reduced, the played video picture is clear and smooth, the screen projection effect is effectively improved, other operations of a user are not needed, and the watching experience of the user is also improved.

Description

Screen projection method of electronic equipment and electronic equipment
Technical Field
The application relates to the technical field of electronics, in particular to a screen projection method of electronic equipment and the electronic equipment.
Background
Currently, many electronic devices support a wireless screen projection technology, that is, a display interface of an electronic device a (e.g., a mobile phone or a tablet) is displayed on a screen of another device B (e.g., a computer, a television, a kiosk, or a projector) in real time, and a user can view picture contents through the device B.
When a user needs to use the wireless screen projection function of the electronic device, the user usually clicks a "wireless screen projection" button in a system pull-down menu of the electronic device first, and then selects screen projection equipment from an available equipment list searched by the electronic device, so that the wireless screen projection of the electronic device can be completed. At this time, the electronic device implements system image projection (hereinafter referred to as image projection), that is, what interface is displayed on the electronic device, and what interface is also displayed on the projection device.
However, in the process of screen projection by system mirroring, if the electronic device currently plays a video, the video interface of the screen projection device is prone to problems such as blockage, screen splash, black borders, asynchronism of sound and pictures and the like, and the screen projection effect is poor.
Disclosure of Invention
The application provides a screen projection method of electronic equipment and the electronic equipment, which can automatically switch the screen projection of a mirror image between the electronic equipment and the screen projection equipment into Digital Living Network Alliance (DLNA) screen projection when the electronic equipment plays a video, and effectively improve the screen projection effect.
In a first aspect, the present application provides a screen projection method for an electronic device, including: receiving screen projection operation of a user, and projecting a screen to screen projection equipment by electronic equipment in a system mirror image screen projection mode; receiving video playing operation of electronic equipment, and acquiring screen projection information of the electronic equipment, wherein the screen projection information comprises first equipment information of the screen projection equipment, and the first equipment information comprises at least one of an internet protocol address (IP address), a media access control address (Mac address), a universal unique identifier (uuid), an equipment identifier and an equipment name of the screen projection equipment; and switching the screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to DLNA screen projection according to the first equipment information.
The method comprises the steps that a system mirror image screen projection process is that the electronic equipment encodes and decodes data of a display interface and then sends the data to the screen projection equipment for displaying, and if the current playing of the electronic equipment is a video, a video stream is encoded and decoded and then sent to the screen projection equipment for playing. DLNA screen projection is a technology for serving digital media and content, the electronic equipment can send the address of a video stream to the screen projection equipment, and the screen projection equipment downloads video resources according to the address to play, so that real-time screen projection of video data is realized. When the electronic equipment plays videos, if the electronic equipment is currently in a state that the system mirror image is projected on the screen, the DLNA screen can be automatically switched, so that the problems of black edge of the screen, blockage, unsynchronized screen and sound and picture and the like are solved, the played video picture is clear and smooth, the screen projection effect is effectively improved, other operations are not required for a user, and the watching experience of the user is also improved.
Optionally, the video played by the electronic device may be played online through a video application, or may be played locally through a video player.
Before the electronic device switches the screen projection mode, the stored device information of the screen projection device needs to be acquired, and then the DLNA of the electronic device is projected to the screen projection device according to the first device information (such as an IP address). Optionally, the implementation manner may be applicable to a situation that the electronic device and the screen projection device are in the same local area network, and the IP address of the screen projection device searched through the mirror image protocol is the same as the IP address of the screen projection device searched through the DLNA protocol.
With reference to the first aspect, in some implementation manners of the first aspect, the switching a screen projection manner between the electronic device and the screen projection device from system mirror image screen projection to DLNA screen projection according to the first device information includes: searching first available screen projection equipment through a DLNA protocol, and acquiring second equipment information of the first available screen projection equipment, wherein the first available screen projection equipment is equipment which is in the same local area network with the electronic equipment and supports DLNA screen projection, and the second equipment information comprises at least one of an IP (Internet protocol) address, a Mac (machine access control) address, a uuid, an equipment identifier and an equipment name of the first available screen projection equipment; and matching the first equipment information with the second equipment information, and if the first equipment information is successfully matched with the second equipment information, projecting the screen of the electronic equipment to screen projection equipment in a DLNA screen projection mode.
Because some mirroring protocols search for the screen projection device without a local area network, such as the Miracast protocol, for the same device, the IP address searched by the mirroring protocol is different from the IP address searched by the DLNA protocol, so that the first device information and the second device information need to be matched, and if the matching is successful, the DLNA screen projection device is used for projecting the screen of the electronic device to the screen projection device. Therefore, the success rate of switching the electronic equipment into DLNA screen projection can be further improved.
With reference to the first aspect, in some implementation manners of the first aspect, the above projecting the electronic device to the screen projection device in a DLNA screen projection manner includes: and sending the video address of the video to the screen projection equipment according to the IP address of the first available screen projection equipment, so that the screen projection equipment downloads the video resource according to the video address and plays the video resource.
In this implementation manner, the electronic device projects the screen to the screen projecting device according to the IP address of the available screen projecting device searched by the DLNA protocol (at this time, the screen projecting device and the available screen projecting device are the same device) so as to improve the accuracy of the determined DLNA screen projecting device, and further improve the success rate of switching from system mirror image screen projection to DLNA screen projection.
With reference to the first aspect, in some implementation manners of the first aspect, the receiving a screen projection operation of a user, the screen projecting to the screen projecting device by the electronic device in a system image screen projecting manner includes: receiving screen projection operation; searching and displaying second available screen projection equipment through a mirror image protocol; receiving selection operation of a second available screen projection device, and determining the screen projection device; and sending the data of the display interface of the electronic equipment to the screen projection equipment according to the first equipment information.
The screen projection operation may be a click operation of a "wireless screen projection" button in a system pull-down menu by a user, or a click operation of a "wireless screen projection" button in a "setting" path of the electronic device. When the electronic equipment only searches one screen projection equipment, the display interface can be directly projected to the screen projection equipment in a mirror image mode; when a plurality of screen projection devices are searched, the available device list can be displayed to the user for the user to select the corresponding device, and the data of the display interface is sent to the screen projection devices for display. And then the electronic equipment can record the equipment information of the screen projection equipment after the system mirror image is projected on the screen, so that information matching can be performed in the subsequent DLNA screen projection process, and the success rate of switching to the DLNA screen projection is improved.
With reference to the first aspect, in some implementations of the first aspect, the video is played by a video application installed in the electronic device. When the user watches videos through video application, if the screen projection mode between the electronic equipment and the screen projection equipment is switched from the system mirror image screen projection mode to the DLNA screen projection mode, the screen projection effect can be improved, and meanwhile, the experience degree of watching videos of the user is improved.
With reference to the first aspect, in some implementation manners of the first aspect, the switching a screen projection manner between the electronic device and the screen projection device from system mirroring screen projection to DLNA screen projection includes: and calling a DLNA interface through the video application, and switching a screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to DLNA screen projection.
The DLNA interface can be provided for the video application or other applications in the system of the electronic equipment, when the electronic equipment opens a system mirror image screen projection mode and acquires the equipment information of the screen projection equipment, the video application can call the DLNA interface to project the DLNA of the electronic equipment to the screen projection equipment, the experience degree of watching videos by a user is improved, other operations can be performed on the electronic equipment by the user, and the video playing of the screen projection equipment is not influenced.
With reference to the first aspect, in some implementation manners of the first aspect, the screen projection information further includes a status identifier of the electronic device, where the status identifier is used to indicate whether the electronic device is in a screen projection state of a system image; the above-mentioned receipt electronic equipment plays video operation, obtains electronic equipment's the information of throwing the screen, includes: receiving video playing operation of a video application, acquiring a state identifier from a configuration file, and acquiring first equipment information from a database; before switching the screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to DLNA screen projection according to the first equipment information, the method further comprises the following steps: and determining that the electronic equipment is in the state of system image screen projection through the state identifier.
In the implementation mode, when the video application plays a video, the state identifier is actively acquired to further determine that the electronic device is in a state of system image screen projection, so as to further improve the success rate of switching to DLNA screen projection.
With reference to the first aspect, in some implementations of the first aspect, after the electronic device is projected to the screen projection device by using a system mirror image, the method further includes: the method comprises the steps of storing a state identifier of the electronic equipment in a system mirror image screen projection state into a configuration file, and storing first equipment information of the screen projection equipment into a database. Therefore, a data base can be provided for acquiring screen projection information for subsequent video applications.
In a second aspect, the present application provides an apparatus, included in an electronic device, that has functionality for implementing the behavior of the electronic device in the first aspect and possible implementations of the first aspect. The functions may be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above-described functions. Such as a receiving module or unit, a processing module or unit, etc.
In a third aspect, the present application provides an electronic device, comprising: a processor, a memory, and an interface; the processor, the memory and the interface cooperate with each other to enable the electronic device to perform any one of the methods of the first aspect.
Optionally, the electronic device may further include a wireless screen projection module, configured to receive screen projection operation; the screen projection capability center module is used for searching second available screen projection equipment through a mirror image protocol; the display module is used for displaying the second available screen projection equipment, receiving selection operation of the second available screen projection equipment and determining the screen projection equipment; the multi-screen interaction module is used for sending data of a display interface of the electronic equipment to the screen projection equipment for screen projection display according to the first equipment information; the wireless screen projection module is also used for storing first equipment information of the screen projection equipment into a database; the video application is used for playing a video, acquiring a state identifier from the configuration file, acquiring first equipment information from the database, and determining that the electronic equipment is in a system mirror image screen projection state according to the state identifier; the screen projection capability center module is also used for searching the first available screen projection equipment through a DLNA protocol; and the multi-screen interaction module is also used for acquiring second equipment information of the first available screen projection equipment, matching the first equipment information with the second equipment information, and if the first equipment information is successfully matched with the second equipment information, sending a video address of a video to the screen projection equipment according to the IP address of the first available screen projection equipment, so that the screen projection equipment downloads and plays the video resource according to the video address.
In a fourth aspect, the present application provides a chip comprising a processor. The processor is adapted to read and execute the computer program stored in the memory to perform the method of the first aspect and any possible implementation thereof.
Optionally, the chip further comprises a memory, the memory being connected to the processor by a circuit or a wire.
Further optionally, the chip further comprises a communication interface.
In a fifth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the processor is caused to execute any one of the methods in the first aspect.
In a sixth aspect, the present application provides a computer program product comprising: computer program code for causing an electronic device to perform any of the methods of the first aspect when the computer program code runs on the electronic device.
Drawings
Fig. 1 (a) is a schematic view of an example of a video playing interface provided in the embodiment of the present application;
FIG. 1 (b) is a schematic diagram of an example of a system drop-down menu interface provided by an embodiment of the present application;
FIG. 1 (c) is a schematic diagram of an example of a list of available devices showing an interface according to an embodiment of the present disclosure;
fig. 1 (d) is a schematic diagram illustrating a comparison between display effects of an example of an electronic device and a screen projection device provided in an embodiment of the present application;
FIG. 2 is a schematic diagram of a system drop-down menu interface provided by an embodiment of the present application;
fig. 2 (b) is a schematic diagram of another example of a list display interface of available devices provided in the embodiment of the present application;
fig. 2 (c) is a schematic diagram showing a comparison between the display effect of another electronic device and the display effect of a screen projection device provided by the embodiment of the present application;
fig. 2 (d) is a schematic diagram illustrating a comparison between a display effect of another electronic device and a display effect of a screen projection device provided by an embodiment of the present application;
fig. 3 is a schematic diagram illustrating a comparison between display effects of an electronic device and a screen projection device when a DLNA is projected on a screen according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an example of an electronic device according to an embodiment of the present disclosure;
FIG. 5 is a block diagram of a software architecture of an electronic device according to an embodiment of the present disclosure;
fig. 6 is a system architecture diagram illustrating an example of a screen projection method of an electronic device according to an embodiment of the present application;
fig. 7 (a) is a system architecture diagram illustrating a screen projection method of another electronic device according to an embodiment of the present application;
fig. 7 (b) is a schematic system architecture diagram of a screen projection method of an electronic device according to still another embodiment of the present application;
fig. 8 is a flowchart illustrating an example of a screen projection method of an electronic device according to an embodiment of the present application;
fig. 9 (a) is a schematic diagram of an example of a process that an electronic device switches from a mirror image projection to a DLNA projection according to an embodiment of the present application;
fig. 9 (b) is a schematic diagram illustrating a process of switching from mirror image projection to DLNA projection of another electronic device according to an embodiment of the present application;
fig. 10 is a schematic flowchart of a screen projection method of another electronic device provided in an embodiment of the present application;
fig. 11 is a flowchart illustrating a screen projection method of an electronic device according to another embodiment of the present application;
fig. 12 is a schematic diagram illustrating comparison between device information for mirror image projection and device information for DLNA screen projection provided in the embodiment of the present application;
fig. 13 is a schematic diagram illustrating comparison between device information of another example of mirror projection and device information of DLNA projection provided in this embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.
In the following, the terms "first", "second" and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.
Currently, when a user wants to watch a video using a system image projection screen (hereinafter, referred to as image projection screen) mode of an electronic device, the electronic device may be switched to the image projection screen mode by:
the method I comprises the following steps: when the electronic device is playing a video by using a video Application (APP), that is, when the electronic device is in a display interface shown in (a) of fig. 1, the user uses a system pull-down menu, and the electronic device may switch to the display interface shown in (b) of fig. 1, and on the interface, the user clicks a "wireless screen projection" button to trigger the electronic device to search for and display available devices for wireless screen projection. On the available device list display interface shown in fig. 1 (c), after the user clicks the selected screen projection device, the display interfaces of the electronic device can be displayed on both the electronic device and the screen projection device, and the effect comparison schematic diagram can be seen in fig. 1 (d), that is, the mirror image screen projection process is completed.
The second method comprises the following steps: the electronic equipment is located on any display interface, such as a desktop interface, a user uses a system pull-down menu, the electronic equipment can be switched to the display interface shown in the diagram (a) in fig. 2, and on the interface, the user clicks a wireless screen projection button to trigger the electronic equipment to search and display available equipment for wireless screen projection. On the available device list display interface shown in fig. 2 (b), after the user clicks the selected screen projection device, desktop interfaces of the electronic device can be displayed on both the electronic device and the screen projection device, and the effect comparison schematic diagram can be seen in fig. 2 (c), that is, the mirror image screen projection process is completed. Then, the user plays the video by using the video APP on the electronic device, the screen projection device correspondingly shows a video interface, and a comparison diagram of the effects of the electronic device and the screen projection device can be seen in fig. 2 (d).
According to the first mode and the second mode, the display interfaces of the screen projection equipment and the electronic equipment are consistent, namely, the screen projection is realized by mirroring currently, but at the moment, two sides of the screen projection equipment have more black edges, and even if the electronic equipment is switched to full-screen playing, the two sides of the screen projection equipment also have the black edges; in addition, in the process of playing the video, the electronic device needs to download video data and encode and decode the video stream of the electronic device, and then the video stream is displayed on the screen projection device, so that the problems of unsynchronization of screens and pictures can be caused, and the screen projection effect is poor.
In view of this, an embodiment of the present application provides a screen projection method for an electronic device, which may be applied to an electronic device having a mirror projection function, such as a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, a super-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), and the like, when the electronic device plays a video in a mirror projection mode, the mirror projection screen may be automatically switched to a DLNA screen projection screen, and a comparison diagram of a display interface between the electronic device and the screen projection device may be shown in fig. 3, so that the screen projection device plays the video clearly and the video screen is smooth, thereby effectively improving a screen projection effect, eliminating the need for a user to perform other operations, and improving user experience. It should be noted that, in the embodiment of the present application, the manner in which the electronic device starts the mirror image screen projection mode may be the first manner and the second manner, and no limitation is imposed on a specific type of the electronic device.
For example, fig. 4 is a schematic structural diagram of an example of the electronic device 100 according to the embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.
Wherein the controller may be a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the time sequence signal to finish the control of instruction fetching and instruction execution.
A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.
In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.
The I2C interface is a bidirectional synchronous serial bus comprising a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, the processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the electronic device 100.
The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through the I2S interface, so as to implement a function of receiving a call through a bluetooth headset.
The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, audio module 170 and wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also transmit the audio signal to the wireless communication module 160 through the PCM interface, so as to implement the function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.
The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a bluetooth headset.
MIPI interfaces may be used to connect processor 110 with peripheral devices such as display screen 194, camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the capture functionality of electronic device 100. Processor 110 and display screen 194 communicate via a DSI interface to implement display functions of electronic device 100.
The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, and the like.
The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.
It should be understood that the connection relationship between the modules illustrated in the embodiment of the present application is only an exemplary illustration, and does not limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.
The charging management module 140 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.
The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In other embodiments, the power management module 141 may be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.
The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. The structure of the antenna 1 and the antenna 2 in fig. 4 is only an example. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 150 may provide a solution including wireless communication of 2G/3G/4G/5G, etc. applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.
The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.
In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that electronic device 100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. GNSS may include Global Positioning System (GPS), global navigation satellite system (GLONASS), beidou satellite navigation system (BDS), quasi-zenith satellite system (QZSS), and/or Satellite Based Augmentation System (SBAS).
The electronic device 100 implements display functions via the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.
The electronic device 100 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display 194, the application processor, and the like.
The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.
The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.
The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.
Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.
The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in the external memory card.
The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.
The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.
The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The electronic apparatus 100 can listen to music through the speaker 170A or listen to a handsfree call.
The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic apparatus 100 receives a call or voice information, it is possible to receive voice by placing the receiver 170B close to the human ear.
The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.
The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic apparatus 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but have different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.
The gyro sensor 180B may be used to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects a shake angle of the electronic device 100, calculates a distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the electronic device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.
The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude, aiding in positioning and navigation, from barometric pressure values measured by barometric pressure sensor 180C.
The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the automatic unlocking of the flip cover is set.
The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. The method can also be used for recognizing the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.
A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, taking a picture of a scene, the electronic device 100 may utilize the distance sensor 180F to range to achieve fast focus.
The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic apparatus 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there are no objects near the electronic device 100. The electronic device 100 can utilize the proximity sensor 180G to detect that the user holds the electronic device 100 close to the ear for talking, so as to automatically turn off the screen to save power. The proximity light sensor 180G may also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.
The ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 may adaptively adjust the brightness of display screen 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, answer an incoming call with the fingerprint, and so on.
The temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 implements a temperature processing strategy using the temperature detected by temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 performs a reduction in performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the electronic device 100 heats the battery 142 when the temperature is below another threshold to avoid the low temperature causing the electronic device 100 to shut down abnormally. In other embodiments, when the temperature is lower than a further threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.
The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided via the display screen 194. In other embodiments, the touch sensor 180K may be disposed on a surface of the electronic device 100, different from the position of the display screen 194.
The bone conduction sensor 180M can acquire a vibration signal. In some embodiments, the bone conduction sensor 180M may acquire a vibration signal of the human voice vibrating a bone mass. The bone conduction sensor 180M may also contact the human body pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 180M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 170 may analyze a voice signal based on the vibration signal of the bone block vibrated by the sound part acquired by the bone conduction sensor 180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signals acquired by the bone conduction sensor 180M, and the heart rate detection function is achieved.
The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The electronic apparatus 100 may receive a key input, and generate a key signal input related to user setting and function control of the electronic apparatus 100.
The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.
Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.
The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic apparatus 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
The software system of the electronic device 100 may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of the electronic device 100.
Fig. 5 is a block diagram of a software structure of the electronic device 100 according to the embodiment of the present application. The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom. The application layer may include a series of application packages.
As shown in fig. 5, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc.
The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.
As shown in FIG. 5, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.
The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.
The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
The phone manager is used to provide communication functions of the electronic device 100. Such as management of call status (including on, off, etc.).
The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.
The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a brief dwell, and does not require user interaction. Such as a notification manager used to notify download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scrollbar text in a status bar at the top of the system, such as a notification of a running application in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.
The Android runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.
The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.
The system library may include a plurality of functional modules. For example: surface managers (surface managers), media libraries (media libraries), three-dimensional graphics processing libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), and the like.
The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.
The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.
The 2D graphics engine is a drawing engine for 2D drawing.
The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
For convenience of understanding, the following embodiments of the present application will specifically describe a screen projection method of an electronic device provided in the embodiments of the present application, by taking the electronic device having the structure shown in fig. 4 and 5 as an example, with reference to the accompanying drawings.
The screen projection method of the electronic device provided in the embodiment of the present application may be applied to the system architecture shown in fig. 6, and a processing flow of the embodiment of the present application is described below with reference to fig. 6.
First, the SystemUI is operated in the Android system in the form of a system application, and the above-described (b) diagram in fig. 1 and (a) diagram in fig. 2 are quick settings (quick settings) among the functions implemented by the SystemUI. After the user clicks the "wireless screen projection" button in the diagram (b) in fig. 1 or the diagram (a) in fig. 2 (or finds the "wireless screen projection" button through the "setting" path of the electronic device), the electronic device may send the click instruction to the wireless screen projection module of the business layer. The wireless screen projection module searches for the screen projection device through a mirror image protocol provided by a screen projection capability center, for example, searches through a Miracast protocol, then calls a wireless video display manager WiFiDisplay of an application framework layer, and determines to connect with a Wifi peer-to-peer (P2P) screen projection device through a multi-screen interaction framework. After the electronic device is connected with the screen projection device, a data stream of a display interface can be pushed to the screen projection device for displaying, and a state identifier of the opened mirror image screen projection is written into a configuration file Settings and device information of the connected screen projection device is written into a DataBase SQLite (DataBase), which is hereinafter referred to as DB for short. Optionally, the state identifier and the device information may also be written in other storable files, and the storage manner is not limited in the embodiments of the present application. Then, if the third-party video APP is playing a video, the video APP reads the state identifier in Settings and the device information in the DB through an interface provided by the system. When the read state identification is that the mirror image screen projection is started and the DB contains connected equipment information, the video APP calls a DLNA interface inside the system, the mirror image screen projection is converted into DLNA screen projection, and DLNA screen projection connection success information is sent to the wireless screen projection module. It is understood that the device information in the DB may include, but is not limited to, an IP address, a Mac address, a uuid, a device identification, a device name, etc. of the screen-casting device. Generally, video data for mirror projection is in an H264 video coding format, and video data for DLNA projection is in an x264 video coding format.
When the wireless screen projection module searches for the screen projection equipment through the mirror image protocol, the corresponding mirror image protocol can be preferentially selected according to the capability of the current screen projection equipment, and the current popular mirror image protocols comprise a Miracast protocol, a Cast + protocol, an AirPlay protocol, a Lelink protocol and the like.
Specifically, miracast is a wireless display standard established by a Wi-Fi alliance in 2012 and based on Wi-Fi Direct (Wi-Fi Direct), a wireless local area network does not need to be accessed by a device which performs wireless screen projection by adopting a Miracast protocol, and an electronic device can directly play videos or photos on the screen projection device through the protocol without any connecting line or wireless Access Point (AP); in the Miracast application scenario, one P2P-capable smart phone may be directly connected to one P2P-capable smart tv, and the smart phone may transmit its own screen or media resource to the smart tv for display or playing. The Cast + protocol can support electronic equipment of a fixed brand A to conduct wireless screen projection, and the packet loss rate is low in the audio and video data transmission process. The AirPlay protocol is a wireless display standard based on wifi, can be applied between electronic equipment of a fixed brand B and screen projection equipment, and supports a push mode and a mirror mode. The equipment adopting the Lelink protocol for wireless screen projection needs to be accessed to the same wireless local area network.
The screen projection method of the electronic device provided by the embodiment of the present application can also be applied to the system architecture shown in fig. 7, and a processing flow of the embodiment of the present application is described below with reference to fig. 7.
First, when the third-party video APP is playing a video, a user clicks a "wireless screen projection" button in (b) of fig. 1 or (a) of fig. 2 (or finds the "wireless screen projection" button through a "setting" path of the electronic device). Then, if the wireless screen projection module of the service layer monitors that the video APP is playing a video, the screen projection device can search through a mirror image protocol provided by the screen projection capability center, for example, through the Miracast protocol, at this time, the screen projection capability center opens a P2P or wlan connection channel, and establishes a channel with a WiFi P2P screen projection device through a WiFi P2PManager manager, or establishes a channel with a WiFi (STA) screen projection device. In one implementation, as shown in (a) of fig. 7, after the channel is established, the screen-casting capability center does not push a data stream to the display manager DisplayManager, but the multi-screen interaction framework still writes the status identifier of the opened mirror screen casting into the configuration file Settings and the device information of the connected screen casting device into the DB. And then, if the third-party video APP monitors that the mirror image screen projection of the electronic equipment is started, calling a DLNA interface in the system to carry out DLNA screen projection.
In another realizable way, as shown in (b) of fig. 7, after the above-mentioned setup of the channel, the screen-casting capability center pushes the data stream to the DisplayManager, but the data stream is filtered out by the DisplayManager, i.e., not displayed on the screen-casting device. And then writing the state identification of the opened mirror image screen projection into a configuration file Settings and writing the equipment information of the connected screen projection equipment into the DB by the multi-screen interaction framework. And if the third-party video APP monitors that the mirror image projection screen of the electronic equipment is started, calling a DLNA interface in the system to carry out DLNA projection screen.
In summary, when the mirror image is projected, the screen projection device has the problems of the black edge of the screen and the like, and after the mirror image screen projection function is started, the video APP can call the internal DLNA interface to automatically turn to DLNA screen projection. When the DLNA (digital living network alliance) of the electronic equipment is used for projecting a screen, the address of the played audio and video data (such as a Uniform Resource Locator (URL)) can be pushed to the screen projecting equipment, the screen projecting equipment can download data resources according to the address of the audio and video data, full-screen playing is further achieved, the problems of black edge, blockage, unsynchronized flower screen and sound picture and the like of the picture can be reduced, the played video picture is clear and smooth, the screen projecting effect is effectively improved, other operations are not needed for a user, and the experience degree of the user is also improved. In addition, by adopting a DLNA screen projection mode, a user can execute other operations on the electronic equipment without influencing the normal video playing of the screen projection equipment.
First, a process of implementing the scene in fig. 1 is described, that is, a scene in which the electronic device first plays a video and then opens a mirror image for screen projection is introduced, and with reference to the system architecture shown in fig. 6, fig. 8 is a schematic flowchart of a screen projection method for the electronic device according to an embodiment of the present application, where the method includes:
s201, receiving video playing operation of the electronic equipment, and acquiring a state identifier of the electronic equipment.
When the electronic device is in the mirror image screen projection state, the state identifier may be 1, and when the electronic device is not in the mirror image screen projection state, the state identifier may be 0.
S202, determining that the electronic equipment is not in a mirror image screen projection state through the state identification, receiving screen projection operation of a user, and projecting the screen to the screen projection equipment by the electronic equipment in a mirror image screen projection mode.
Specifically, when the electronic device is not yet in the state of mirror image screen projection (that is, the state identifier is 0), if the video APP in the electronic device starts to play the video, the screen cannot be projected on the screen projection device, and at this time, the user is required to open the function of mirror image screen projection (that is, screen projection operation).
After a user opens the mirror image screen projection function, the electronic equipment can search the equipment through the mirror image protocol, and when the electronic equipment only searches one screen projection device, the electronic equipment can directly project the display interface mirror image to the screen projection device. When the electronic device searches for multiple screen projection devices, a list of available devices may be displayed to a user, such as the display interface shown in fig. 1 (c), and then, after receiving a selection operation of the user, the electronic device projects a display interface mirror image to the screen projection device selected by the user. When the screen projection device searched by the electronic device is the screen projection device selected by the user before, the display interface can be directly projected to the screen projection device in a mirror image mode. It can be understood that after the display interface of the electronic device is projected to the screen projection device in a mirror image manner, the electronic device can record the state identifier of the opened mirror image screen projection and the device information of the connected screen projection device.
S203, first device information of the screen projection device is obtained, and the screen projection mode between the electronic device and the screen projection device is switched from mirror image screen projection to DLNA screen projection according to the first device information.
Specifically, after the electronic device is in a state of mirror image screen projection, the video APP can acquire device information of the screen projection device, an internal DLNA interface is called, and a screen projection mode between the electronic device and the screen projection device is switched from mirror image screen projection to DLNA screen projection. Before the video APP calls the internal DLNA interface, the electronic equipment needs to search nearby equipment supporting DLNA screen projection through a DLNA protocol, and when the equipment supporting DLNA screen projection and the screen projection equipment for mirror image screen projection are the same, the video APP can call the DLNA interface to realize DLNA screen projection. It should be noted that, the device that uses the DLNA protocol to perform wireless screen projection needs to access the same wireless lan.
For this process, as can be seen from the manner that the electronic device starts the mirror image screen projection mode to watch the video described in fig. 1, the manner is that the electronic device first plays the video and then starts the mirror image screen projection, and for this manner, the following description describes a process of switching to DLNA screen projection: referring to the diagram (a) in fig. 9, in the process of playing a video, if the current electronic device does not start the function of mirror image screen projection, the video APP starts the monitoring module ContentObserver to monitor the data in the Settings (that is, when the video APP plays a video, it monitors whether the electronic device is in the state of mirror image screen projection). When monitoring that the state identification in Settings is that the mirror image is opened and the screen is projected, namely the electronic device has the mirror image projected to the screen projecting device at the moment, and the video APP also plays the video at the moment, then the video APP acquires the device information of the connected screen projecting device from the DB again, and the screen projecting mode between the electronic device and the screen projecting device is switched from the mirror image projection to the DLNA projection. In addition, the ContentObserver can also monitor whether the mirror image screen projection is disconnected between the electronic device and the screen projection device, for example, after the mirror image screen projection is disconnected by the electronic device, the video APP monitors the disconnection message, and the internal DLNA interface is called to disconnect the DLNA screen projection.
According to the screen projection method of the electronic equipment, when the electronic equipment plays a video, if the electronic equipment is not in the state of system mirror image screen projection at present, the electronic equipment can receive the operation of starting the system mirror image screen projection function by a user, and the mirror image screen projection is switched into DLNA screen projection, so that the problems of picture black border, blockage, unsynchronized flower screen and sound and picture and the like are reduced, the played video picture is clear and smooth, the screen projection effect is effectively improved, other operations are not required for the user, and the watching experience of the user is also improved.
For the scenario in fig. 1, the system architecture shown in fig. 7 may also be implemented in combination, and fig. 10 is a schematic flowchart of a screen projection method of another example of electronic equipment provided in the embodiment of the present application, where the method includes:
s301, receiving video playing operation of the electronic equipment, and acquiring a state identifier of the electronic equipment.
The implementation process of S301 may refer to the process of S201 described above, and is not described herein again.
S302, determining that the electronic equipment is not in a mirror image screen projection state through the state identification, receiving screen projection operation of a user, and establishing channel connection between the electronic equipment and the screen projection equipment.
Specifically, when the electronic device is not yet in a state of mirror image screen projection, if a video APP in the electronic device starts playing a video, the screen cannot be projected on the screen projection device, and at this time, a user is required to open a function of mirror image screen projection (namely screen projection operation).
After a user opens the mirror image screen projection function, the electronic equipment can search equipment through a mirror image protocol, and after the screen projection equipment is searched, channel connection between the electronic equipment and the screen projection equipment is established. In an implementation mode, the electronic device and the screen projection device only establish channel connection, and data streams are not pushed to the screen projection device; in another implementation, the electronic device establishes a channel connection with the screen projection device and pushes a data stream to the screen projection device, but this data stream is filtered by the screen projection device. That is, in this implementation, the screen projection device does not display an interface of the electronic device mirror image screen projection.
It can be understood that after the electronic device and the screen projection device establish channel connection, the state identifier of the started mirror image screen projection and the device information of the connected screen projection device can also be recorded.
And S303, acquiring first equipment information of the screen projection equipment, and projecting the screen of the electronic equipment to the screen projection equipment in a DLNA screen projection mode according to the first equipment information.
Specifically, video APP can monitor whether the electronic equipment is in a state of mirror image screen projection, when the mirror image screen projection is started, the equipment information of the screen projection equipment is obtained, an internal DLNA interface is called, therefore, the electronic equipment does not mirror image screen projection to the screen projection equipment, the electronic equipment can be directly projected to the screen projection equipment in a mode of projecting the screen through the DLNA, and at the moment, no mirror image screen projection is conducted on the user view, and the switching process to the DLNA screen projection is conducted.
According to the screen projection method of the electronic equipment, when the electronic equipment plays a video, if the electronic equipment is not in a state of projecting a screen by a system mirror image currently, the electronic equipment can receive the operation of starting the screen projection function by a user, and the DLNA screen projection mode is directly adopted to project the screen to the screen projection equipment, so that the problems of picture black edges, blockage, unsynchronized flower screen and sound picture and the like are reduced, the played video picture is clear and smooth, the screen projection effect is effectively improved, other operations are not required for the user, and the viewing experience of the user is also improved.
Next, a process of implementing the scene in fig. 2 is introduced, that is, a scene in which the electronic device first opens the mirror image screen projection and then plays the video is presented, and with reference to the system architecture shown in fig. 6, fig. 11 is a schematic flowchart of a screen projection method of another example of the electronic device provided in the embodiment of the present application, where the method includes:
s401, receiving screen projection operation of a user, and projecting the screen to screen projection equipment by the electronic equipment in a mirror image screen projection mode.
The screen projection operation may be a click operation of the "wireless screen projection" button in the diagram (a) in fig. 2 described above by the user, or a click operation of the "wireless screen projection" button in the "setting" path of the electronic device. The mirror image screen projection process in this step can refer to the description of the above embodiments, and is not described herein again.
S402, receiving video playing operation of the electronic equipment, and acquiring screen projection information of the electronic equipment, wherein the screen projection information comprises first equipment information of the screen projection equipment.
And S403, switching the screen projection mode between the electronic equipment and the screen projection equipment from mirror image screen projection to DLNA screen projection according to the first equipment information.
Specifically, after the electronic equipment mirror image is projected to the screen projection equipment, the current screen projection information can be stored, if a video APP installed in the electronic equipment plays a video, the screen projection information is actively acquired by the video APP, an internal DLNA interface is called by the video APP in the state that the electronic equipment is in the mirror image screen projection, and the screen projection mode between the electronic equipment and the screen projection equipment is switched from the mirror image screen projection to DLNA screen projection.
For this process, as can be seen from the manner that the electronic device starts the mirror image screen projection mode to watch the video described in fig. 2, the manner is that the electronic device starts the mirror image screen projection first and then plays the video, and for this manner, a process of switching to DLNA screen projection is described below: referring to the diagram (b) in fig. 9, the electronic device is already in the mirror image screen projection mode, when the user clicks on the video APP to play a video, the video APP calls a system interface to obtain data in Settings and the DB, and if the state identifier in Settings is that the mirror image screen projection is started and the DB has device information of the connected screen projection device, the screen projection mode between the electronic device and the screen projection device is switched from the mirror image screen projection to the DLNA screen projection. This method is different from the method described in the above-mentioned diagram (a) of fig. 9 in that the method does not need to start the snooping module ContentObserver to actively snoop the state of the system image screen shot.
According to the screen projection method of the electronic equipment, when the electronic equipment plays a video, if the electronic equipment is currently in the state of screen projection of a system mirror image, the screen projection can be automatically switched to DLNA, so that the problems of black edge of a picture, blockage, unsynchronized flower screen and sound and picture and the like are solved, the played video picture is clear and smooth, the screen projection effect is effectively improved, other operations are not required for a user, and the watching experience of the user is also improved.
In an actual scene, when a DLNA screen projection device is adopted to project the electronic device to the screen projection device, the electronic device can be successfully switched to the DLNA screen projection device only by ensuring that the screen projection device determined by the DLNA protocol is the same as the screen projection device which is connected with the DLNA screen projection device (or the screen projection device which projects the screen in a mirror image mode). As can be seen from the above description, after the electronic device and the screen projection device are connected, the device information of the screen projection device may be recorded in the DB, where the device information includes an IP address, a Mac address, a uuid, a device identifier, a device name, and the like, and then the electronic device may search for an available screen projection device supporting DLNA screen projection through a DLNA protocol, obtain the device information of the available screen projection device supporting DLNA screen projection, compare the device information of the available screen projection device supporting DLNA screen projection with the device information in the DB, and if the comparison is successful, may switch the mirror image screen projection to DLNA screen projection.
In an implementable manner, the device information (1) of the screen projection device recorded in the DB (i.e. the device information of the screen projection device projected by the electronic device system image) comprises an IP address, and the device information (2) of the available screen projection device searched by the electronic device through the DLNA protocol also comprises the IP address. If the electronic equipment searches for the screen projection equipment through the mirror image protocol through the same wireless local area network, for example, a Lelink protocol is adopted, and the DLNA protocol searches for the available screen projection equipment through the same wireless local area network, so that the IP address of the obtained equipment information (1) is the same as the IP address of the equipment information (2), the video APP in the electronic equipment can directly obtain the IP address of the equipment information (1) from the DB, and the DLNA projects the screen to the screen projection equipment corresponding to the IP address, and the DLNA screen projection process is completed. Optionally, in this implementation, since the IP address of the device information (1) is the same as the IP address of the device information (2), the electronic device may also perform DLNA screen projection directly according to the IP address of the device information (1) in the DB without performing DLNA protocol search.
In another implementable manner, the device information (1) of the screen-projecting device recorded in the DB (i.e., the device information of the screen-projecting device whose electronic device system image is projected) may include an IP address, a Mac address, a uuid, and a device name, and the device information (2) of the available screen-projecting device searched by the electronic device through the DLNA protocol may include an IP address, a Mac address, a uuid, and a device name. If the electronic device searches for the screen projection device through the mirror image protocol without passing through the same wireless local area network, for example, the Miracast protocol or the Cast + protocol (which can be searched through Wifi P2P) is adopted, and the DLNA protocol searches for the available screen projection device without passing through the same wireless local area network, the IP address of the device information (1) is different from the IP address of the device information (2), and the electronic device needs to write the IP address of the device information (2) into the DB for the video APP to query. Exemplarily, if a user wants to screen a mobile phone to a television in a living room for watching a video, both the mobile phone and the television are connected to WiFi in the living room, and can search through WiFi P2P when performing mirror image screen projection, wherein an IP address of the television acquired by the mobile phone is 192.168.49.1; in the process of switching to DLNA screen projection, a DLNA protocol is required to be adopted to search for a television through a WiFi wireless network in a living room, the IP address of the television acquired by the mobile phone is 192.168.43.238 at the moment, and the two IP addresses are different.
Alternatively, the number of available screen projection devices searched by the DLNA protocol may be one or more. For example, as shown in fig. 12, the device information (1) of the screen projection device and the device information (2) of the available screen projection device may be compared to find that only uuid information in the device information (1) and the device information (2) is the same because uuid is the device unique identification code, and thus, the embodiment of the present application may perform association according to uuid. If the number of available screen projection devices searched by the DLNA protocol is one, the electronic device compares uuid of the device information (2) with uuid of the device information (1), and if the two uuids are the same, the available screen projection devices and the screen projection devices are the same device, that is, the screen projection devices that are performing mirror projection, and the electronic device can write the IP address (192.168.43.238 in fig. 9) of the device information (2) into the DB. And then the video APP can acquire the IP address from the DB, and the DLNA screen projection is carried out to the screen projection equipment corresponding to the IP address, so that the DLNA screen projection process is completed.
If the number of the available screen projection devices searched by the DLNA protocol is multiple, the electronic device takes the device which is the same as the uuid of the screen projection device for mirror image screen projection in the available screen projection devices as a target screen projection device (namely, the device is the same as the screen projection device, namely, the screen projection device for mirror image screen projection), and writes the IP address of the target screen projection device into the DB. And then the video APP can acquire the IP address of the target screen projection equipment from the DB, and the DLNA projects the screen to the screen projection equipment corresponding to the IP address, so that the process of projecting the screen to the DLNA is completed.
Optionally, after the DLNA of the electronic device is projected to the screen projection device, the video APP may further store the device information (2) in a white list. When the electronic equipment finishes mirror image screen projection next time, the video APP compares the equipment information of the screen projection equipment of the mirror image screen projection with the equipment information in the white list, and if the comparison is successful, the video APP projects the screen to the equipment corresponding to the IP address according to the IP address DLNA in the white list; and if the comparison is not successful, searching the available equipment through the DLNA protocol. Therefore, the number of DLNA searching times can be reduced, and the screen projection switching efficiency is improved.
In the implementation manner, the electronic device associates the screen projection device with the unique identification code uuid, so that the accuracy of the determined DLNA screen projection device can be improved, the screen projection device determined by the DLNA protocol is ensured to be the same as the screen projection device for mirror image screen projection, and the success rate of DLNA screen projection is improved.
In yet another implementable manner, the device information (1) of the screen-projection device recorded in the DB (i.e., the device information of the screen-projection device whose electronic device system image is projected) may include an IP address, a Mac address, a device identification, and a device name, and the device information (2) of the available screen-projection device searched by the electronic device through the DLNA protocol may include an IP address, a Mac address, a device identification, and a device name. That is to say, there is no uuid in the device information obtained in this scenario, the device identifier therein is other information for identifying the screen projection device, and the device identifier searched through the mirror image protocol may not be consistent with the device identifier searched through the DLNA protocol.
Exemplarily, as shown in fig. 13, the device information (1) of the screen projection device and the device information (2) of the available screen projection device may be found by comparison that only the device name information in the device information (1) and the device information (2) is the same, so that the embodiments of the present application may associate according to the device name. If the number of the available screen projection devices searched by the DLNA protocol is one, the electronic device compares the device name of the device information (2) with the device name of the device information (1), and if the two device names are the same, the available screen projection device and the screen projection device are the same device, that is, the screen projection device that is performing mirror image projection, and the electronic device can write the IP address (192.168.43.56 in fig. 10) of the device information (2) into the DB. And then the video APP can acquire the IP address from the DB, and the DLNA screen projection is carried out to the screen projection equipment corresponding to the IP address, so that the DLNA screen projection process is completed.
If the number of the available screen projection devices searched by the DLNA protocol is multiple, the electronic device uses a device with the same device name as the screen projection device for mirror screen projection in the available screen projection devices as a target screen projection device (i.e., the same device as the screen projection device, i.e., the screen projection device for mirror screen projection), and writes the IP address of the target screen projection device into the DB. And then the video APP can acquire the IP address of the target screen projection equipment from the DB, and the DLNA projects the screen to the screen projection equipment corresponding to the IP address, so that the DLNA screen projection process is completed. If a plurality of devices with the same device name as the screen projection device in the available screen projection devices exist, the electronic device cannot identify which device is the same as the screen projection device, and at the moment, the electronic device can output a device list of the devices through a display interface, so that a user can select the screen projection device according to own mirror image.
In the implementation manner, when the searched device information of the screen projection device does not include uuid, the electronic device may associate through the device name to adapt to the screen projection switching process of different scenes. In addition, when a plurality of searched DLNA screen projection devices exist, the DLNA screen projection devices can be selected and determined by the user, and the watching experience degree of the user is further improved.
In one scenario, when a user wants to view a locally stored video in a mirror image screen projection mode of the electronic device, the electronic device may also perform DLNA screen projection in the above manner. The local video can be played by adopting a gallery application or a player of the electronic equipment; when the "gallery" application or the player of the electronic device is playing a video and the mirror image screen projection mode is started, DLNA screen projection is performed between the electronic device and the screen projection device, and the specific screen projection process can be referred to the description of the above embodiment and is not described herein again. It should be noted that DLNA screen projection only supports fixed format audio/video data, such as image data in formats of JPEG, PNG, GIF, etc., audio data in formats of AAC, MP3, WMA, etc., video data in formats of MPEG-2, MPEG-4, AVC, WMV, etc., before screen projection switching is performed, the electronic device may also determine the format of the video data, switch to DLNA screen projection if the format of the video data meets the condition, and do not switch to the screen projection mode if the format of the video data does not meet the condition.
An example of the screen projection method of the electronic device provided in the embodiment of the present application is described above in detail. It will be appreciated that the electronic device, in order to implement the above-described functions, comprises corresponding hardware and/or software modules for performing the respective functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, with the embodiment described in connection with the particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional modules according to the method example, for example, the functional modules may be divided into the functional modules corresponding to the functions, such as the detection unit, the processing unit, the display unit, and the like, or two or more functions may be integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and another division manner may be available in actual implementation.
It should be noted that all relevant contents of each step related to the method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.
The electronic device provided by the embodiment is used for executing the screen projection method of the electronic device, so that the same effect as the realization method can be achieved.
Where an integrated unit is employed, the electronic device may further include a processing module, a storage module, and a communication module. The processing module can be used for controlling and managing the action of the electronic equipment. The memory module may be used to support the electronic device in executing stored program codes and data, etc. The communication module can be used for supporting the communication between the electronic equipment and other equipment.
The processing module may be a processor or a controller. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. A processor may also be a combination of computing functions, e.g., a combination of one or more microprocessors, a Digital Signal Processing (DSP) and a microprocessor, or the like. The storage module may be a memory. The communication module may specifically be a radio frequency circuit, a bluetooth chip, a Wi-Fi chip, or other devices that interact with other electronic devices.
In an embodiment, when the processing module is a processor and the storage module is a memory, the electronic device according to this embodiment may be a device having the structure shown in fig. 4.
The embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the processor is enabled to execute the screen projection method of the electronic device in any of the above embodiments.
The embodiment of the present application further provides a computer program product, which when running on a computer, causes the computer to execute the above related steps to implement the screen projection method of the electronic device in the above embodiment.
In addition, embodiments of the present application also provide an apparatus, which may be specifically a chip, a component or a module, and may include a processor and a memory connected to each other; when the device runs, the processor can execute the computer execution instructions stored in the memory, so that the chip can execute the screen projection method of the electronic equipment in the above method embodiments.
The electronic device, the computer-readable storage medium, the computer program product, or the chip provided in this embodiment are all configured to execute the corresponding method provided above, so that the beneficial effects achieved by the electronic device, the computer-readable storage medium, the computer program product, or the chip may refer to the beneficial effects in the corresponding method provided above, and are not described herein again.
Through the description of the foregoing embodiments, those skilled in the art will understand that, for convenience and simplicity of description, only the division of the functional modules is used for illustration, and in practical applications, the above function distribution may be completed by different functional modules as needed, that is, the internal structure of the device may be divided into different functional modules, so as to complete all or part of the functions described above.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is only one type of logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another apparatus, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed to a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a variety of media that can store program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (18)

1. A screen projection method of an electronic device, the method comprising:
receiving screen projection operation of a user, wherein the electronic equipment projects a screen to screen projection equipment in a system mirror image screen projection mode;
receiving video playing operation of the electronic equipment, and acquiring screen projection information of the electronic equipment, wherein the screen projection information comprises first equipment information of the screen projection equipment, and the first equipment information comprises at least one of an Internet Protocol (IP) address, a media access control (Mac) address, a universal unique identification code uuid, an equipment identifier and an equipment name of the screen projection equipment;
and switching a screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to digital living network alliance DLNA screen projection according to the first equipment information.
2. The method according to claim 1, wherein switching a screen projection mode between the electronic device and the screen projection device from system mirror image screen projection to DLNA screen projection according to the first device information comprises:
searching a first available screen projection device through a DLNA protocol, and acquiring second device information of the first available screen projection device, wherein the first available screen projection device is a device which is in the same local area network with the electronic device and supports DLNA screen projection, and the second device information comprises at least one of an IP address, a Mac address, a uuid, a device identifier and a device name of the first available screen projection device;
and matching the first equipment information with the second equipment information, and if the first equipment information is successfully matched with the second equipment information, projecting the screen of the electronic equipment to the screen projecting equipment in a DLNA screen projecting mode.
3. The method according to claim 2, wherein the projecting the electronic device to the screen projecting device by DLNA screen projecting comprises:
and sending the video address of the video to the screen projection equipment according to the IP address of the first available screen projection equipment, so that the screen projection equipment downloads and plays the video resource according to the video address.
4. The method according to any one of claims 1 to 3, wherein the receiving a user screen projection operation, the electronic device projecting a screen to the screen projection device by means of system image screen projection, comprises:
receiving the screen projection operation;
searching and displaying second available screen projection equipment through a mirror image protocol;
receiving selection operation of the second available screen projection equipment, and determining the screen projection equipment;
and sending the data of the display interface of the electronic equipment to the screen projection equipment for screen projection display according to the first equipment information.
5. The method of any of claims 1-4, wherein the video is played by a video application installed in the electronic device.
6. The method according to claim 5, wherein switching the screen projection mode between the electronic device and the screen projection device from system mirroring screen projection to DLNA screen projection comprises:
and calling a DLNA interface through the video application, and switching a screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to DLNA screen projection.
7. The method of claim 5, wherein the screen projection information further comprises a status identifier of the electronic device, and the status identifier is used to indicate whether the electronic device is in a state of system image screen projection;
the receiving the video playing operation of the electronic equipment and acquiring the screen projection information of the electronic equipment comprises the following steps:
receiving video playing operation of the video application, acquiring the state identifier from a configuration file, and acquiring the first equipment information from a database;
before switching the screen projection mode between the electronic device and the screen projection device from system mirror image screen projection to DLNA screen projection according to the first device information, the method further comprises:
and determining that the electronic equipment is in a system mirror image screen projection state through the state identifier.
8. The method of claim 7, wherein after the electronic device is projected to the screen projection device by way of system image projection, the method further comprises:
and storing the state identifier of the electronic equipment in the state of system image screen projection to the configuration file, and storing the first equipment information of the screen projection equipment to the database.
9. An electronic device, comprising:
one or more processors;
one or more memories;
a module installed with a plurality of applications;
the memory stores one or more programs that, when executed by the processor, cause the electronic device to perform the steps of:
receiving screen projection operation of a user, wherein the electronic equipment projects a screen to screen projection equipment in a system mirror image screen projection mode;
receiving video playing operation of the electronic equipment, and acquiring screen projection information of the electronic equipment, wherein the screen projection information comprises first equipment information of the screen projection equipment, and the first equipment information comprises at least one of an IP address, a Mac address, a uuid, an equipment identifier and an equipment name of the screen projection equipment;
and switching the screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to DLNA screen projection according to the first equipment information.
10. The electronic device of claim 9, wherein the one or more programs, when executed by the processor, cause the electronic device to perform the steps of:
searching a first available screen projection device through a DLNA protocol, and acquiring second device information of the first available screen projection device, wherein the first available screen projection device is a device which is in the same local area network with the electronic device and supports DLNA screen projection, and the second device information comprises at least one of an IP address, a Mac address, a uuid, a device identifier and a device name of the first available screen projection device;
and matching the first device information with the second device information, and if the first device information is successfully matched with the second device information, projecting the screen of the electronic device to the screen projecting device in a DLNA screen projecting mode.
11. The electronic device of claim 10, wherein the one or more programs, when executed by the processor, cause the electronic device to perform the steps of:
and sending the video address of the video to the screen projection equipment according to the IP address of the first available screen projection equipment, so that the screen projection equipment downloads and plays the video resource according to the video address.
12. The electronic device of any of claims 9-11, wherein the one or more programs, when executed by the processor, cause the electronic device to perform the steps of:
receiving the screen projection operation;
searching and displaying second available screen projection equipment through a mirror image protocol;
receiving selection operation of the second available screen projection equipment, and determining the screen projection equipment;
and sending the data of the display interface of the electronic equipment to the screen projection equipment for screen projection display according to the first equipment information.
13. The electronic device of any of claims 9-12, wherein the video is played by a video application installed in the electronic device.
14. The electronic device of claim 13, wherein the one or more programs, when executed by the processor, cause the electronic device to perform the steps of:
and calling a DLNA interface through the video application, and switching a screen projection mode between the electronic equipment and the screen projection equipment from system mirror image screen projection to DLNA screen projection.
15. The electronic device of claim 13, wherein the screen projection information further comprises a status identifier of the electronic device, and the status identifier is used to indicate whether the electronic device is in a state of system image screen projection;
the one or more programs, when executed by the processor, cause the electronic device to perform the steps of:
receiving video playing operation of the video application, acquiring the state identifier from a configuration file, and acquiring the first equipment information from a database;
and determining that the electronic equipment is in a system mirror image screen projection state through the state identifier.
16. The electronic device of claim 15, wherein the one or more programs, when executed by the processor, cause the electronic device to perform the steps of:
and storing the state identifier of the electronic equipment in the state of system image screen projection to the configuration file, and storing the first equipment information of the screen projection equipment to the database.
17. The electronic device of claim 9, further comprising:
the wireless screen projection module is used for receiving the screen projection operation;
the screen projection capability center module is used for searching second available screen projection equipment through a mirror image protocol;
the display module is used for displaying the second available screen projection equipment, receiving selection operation of the second available screen projection equipment and determining the screen projection equipment;
the multi-screen interaction module is used for sending the data of the display interface of the electronic equipment to the screen projection equipment for screen projection display according to the first equipment information;
the multi-screen interaction module is also used for storing a state identifier of the electronic equipment in a system mirror image screen projection state into a configuration file, and the wireless screen projection module is also used for storing first equipment information of the screen projection equipment into a database;
the video application is used for playing a video, acquiring the state identifier from the configuration file, acquiring the first equipment information from the database, and determining that the electronic equipment is in a system mirror image screen projection state through the state identifier;
the screen projection capability center module is also used for searching the first available screen projection equipment through a DLNA protocol;
and the multi-screen interaction module is also used for acquiring second equipment information of the first available screen projection equipment, matching the first equipment information with the second equipment information, and if the first equipment information is successfully matched with the second equipment information, sending the video address of the video to the screen projection equipment according to the IP address of the first available screen projection equipment, so that the screen projection equipment downloads video resources according to the video address and plays the video resources.
18. A computer-readable storage medium, in which a computer program is stored which, when executed by a processor, causes the processor to carry out the method of any one of claims 1 to 8.
CN202110643966.7A 2021-06-09 2021-06-09 Screen projection method of electronic equipment and electronic equipment Active CN115460445B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110643966.7A CN115460445B (en) 2021-06-09 2021-06-09 Screen projection method of electronic equipment and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110643966.7A CN115460445B (en) 2021-06-09 2021-06-09 Screen projection method of electronic equipment and electronic equipment

Publications (2)

Publication Number Publication Date
CN115460445A true CN115460445A (en) 2022-12-09
CN115460445B CN115460445B (en) 2024-03-22

Family

ID=84294380

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110643966.7A Active CN115460445B (en) 2021-06-09 2021-06-09 Screen projection method of electronic equipment and electronic equipment

Country Status (1)

Country Link
CN (1) CN115460445B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103338139A (en) * 2013-06-18 2013-10-02 华为技术有限公司 Multi-screen interaction method and device, and terminal equipment
US20150095510A1 (en) * 2013-09-30 2015-04-02 Cavium, Inc. Protocol Switching over Multi-Network Interface
US20180335926A1 (en) * 2014-11-07 2018-11-22 Huawei Technologies Co., Ltd. Media resource sharing method, and device
CN110602319A (en) * 2019-09-04 2019-12-20 深圳市乐得瑞科技有限公司 Wireless screen projection connection method and device
CN111654742A (en) * 2020-06-18 2020-09-11 中电长城(长沙)信息技术有限公司 Remote intelligent linkage screen projection method and system
CN111901674A (en) * 2020-07-13 2020-11-06 腾讯科技(深圳)有限公司 Video playing control and device
CN111966314A (en) * 2020-08-11 2020-11-20 北京小米移动软件有限公司 Image projection method, image projection device, mobile terminal and projection equipment
CN112350981A (en) * 2019-08-09 2021-02-09 华为技术有限公司 Method, device and system for switching communication protocol
CN112351322A (en) * 2019-08-09 2021-02-09 华为技术有限公司 Terminal device, method and system for realizing touch screen projection through remote controller
CN112394895A (en) * 2020-11-16 2021-02-23 Oppo广东移动通信有限公司 Cross-equipment display method and device of picture and electronic equipment

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103338139A (en) * 2013-06-18 2013-10-02 华为技术有限公司 Multi-screen interaction method and device, and terminal equipment
US20150095510A1 (en) * 2013-09-30 2015-04-02 Cavium, Inc. Protocol Switching over Multi-Network Interface
US20180335926A1 (en) * 2014-11-07 2018-11-22 Huawei Technologies Co., Ltd. Media resource sharing method, and device
CN112350981A (en) * 2019-08-09 2021-02-09 华为技术有限公司 Method, device and system for switching communication protocol
CN112351322A (en) * 2019-08-09 2021-02-09 华为技术有限公司 Terminal device, method and system for realizing touch screen projection through remote controller
CN110602319A (en) * 2019-09-04 2019-12-20 深圳市乐得瑞科技有限公司 Wireless screen projection connection method and device
CN111654742A (en) * 2020-06-18 2020-09-11 中电长城(长沙)信息技术有限公司 Remote intelligent linkage screen projection method and system
CN111901674A (en) * 2020-07-13 2020-11-06 腾讯科技(深圳)有限公司 Video playing control and device
CN111966314A (en) * 2020-08-11 2020-11-20 北京小米移动软件有限公司 Image projection method, image projection device, mobile terminal and projection equipment
CN112394895A (en) * 2020-11-16 2021-02-23 Oppo广东移动通信有限公司 Cross-equipment display method and device of picture and electronic equipment

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LONGFEI PENG 等: "A media resources sharing system based on DLNA", 《2016 FIRST IEEE INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND THE INTERNET》 *
刘堃: "浅析多屏互动和屏幕镜像技术及其应用", 《科技风》 *
叶楠: "基于网关的多屏互动***的设计与实现", 《电视技术》 *

Also Published As

Publication number Publication date
CN115460445B (en) 2024-03-22

Similar Documents

Publication Publication Date Title
CN113542839B (en) Screen projection method of electronic equipment and electronic equipment
CN111316598B (en) Multi-screen interaction method and equipment
WO2020259452A1 (en) Full-screen display method for mobile terminal, and apparatus
CN111628916B (en) Method for cooperation of intelligent sound box and electronic equipment
CN113923230B (en) Data synchronization method, electronic device, and computer-readable storage medium
CN113691842B (en) Cross-device content projection method and electronic device
CN114040242B (en) Screen projection method, electronic equipment and storage medium
CN109981885B (en) Method for presenting video by electronic equipment in incoming call and electronic equipment
CN113254409B (en) File sharing method, system and related equipment
CN114125130B (en) Method for controlling communication service state, terminal device and readable storage medium
CN110602312B (en) Call method, electronic device and computer readable storage medium
CN112543447A (en) Device discovery method based on address list, audio and video communication method and electronic device
WO2021052388A1 (en) Video communication method and video communication apparatus
WO2022170854A1 (en) Video call method and related device
CN114827098A (en) Method and device for close shooting, electronic equipment and readable storage medium
CN115460445B (en) Screen projection method of electronic equipment and electronic equipment
CN113271577B (en) Media data playing system, method and related device
CN114125805B (en) Bluetooth reconnection method and terminal equipment
WO2023093778A1 (en) Screenshot capture method and related apparatus
CN115857964A (en) Application program installation method and related equipment
CN116170782A (en) Screen projection method, related device and system
CN115604773A (en) Channel switching method and device
CN114691066A (en) Application display method and electronic equipment
CN115941836A (en) Interface display method, electronic equipment and storage medium
CN117785312A (en) Audio playing method, electronic device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant