WO2017128913A1 - 一种移动终端投影方法、终端设备及*** - Google Patents

一种移动终端投影方法、终端设备及*** Download PDF

Info

Publication number
WO2017128913A1
WO2017128913A1 PCT/CN2016/112410 CN2016112410W WO2017128913A1 WO 2017128913 A1 WO2017128913 A1 WO 2017128913A1 CN 2016112410 W CN2016112410 W CN 2016112410W WO 2017128913 A1 WO2017128913 A1 WO 2017128913A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
projection area
projection
screen
external device
Prior art date
Application number
PCT/CN2016/112410
Other languages
English (en)
French (fr)
Inventor
陶冬
何利鹏
王佰祥
Original Assignee
努比亚技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 努比亚技术有限公司 filed Critical 努比亚技术有限公司
Publication of WO2017128913A1 publication Critical patent/WO2017128913A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the present application relates to, but is not limited to, the field of communications technologies, and in particular, to a mobile terminal projection method, a terminal device, and a system.
  • Wi-Fi Display function is born with the wave of technological development, that is, in mobile devices. WFD function. This function can wirelessly project a projection device interface and projection device status to another receiving device, which can then operate the projection device.
  • An embodiment of the present invention provides a mobile terminal projection method, a terminal device, and a system, for delivering a media data stream to an external device, where the external device includes a display screen or a screen, and the method includes:
  • the mobile terminal establishes a communication connection with an external device
  • a media data stream of the projection area is generated and transmitted to the external device.
  • the mobile terminal establishes a communication connection with an external device, Includes the following steps:
  • the mobile terminal sends a WFD connection request
  • the mobile terminal establishes a WFD connection with an external device.
  • the determining a projection area of the screen of the mobile terminal includes:
  • the mobile terminal After the WFD connection is successful, the mobile terminal displays a projection area selection frame while projecting, and determines the projection area according to the position of the projection area selection frame.
  • the mobile terminal projection method further includes:
  • the mobile terminal receives an input signal, wherein the input signal is used to control the display area selection frame to be displayed or closed, and the content in the projection area selection frame is projected when the projection area selection frame is displayed, when the projection area selection frame is closed.
  • Full screen projection
  • the projection area selection frame when the mobile terminal supports the upper and lower split screens, the projection area selection frame is displayed with the height as a reference value; when the mobile terminal supports the left and right split screens, the projection area selection frame is referenced by the width. Display; when the mobile terminal supports free split screen, the projection area selection box can be displayed anywhere on the screen.
  • the generating a media data stream of the projection area includes:
  • the mobile terminal captures image information of the projection area in a preset period, and packs each frame image in time sequence to form an audio/video stream.
  • the generating a media data stream of the projection area and transmitting the data stream to the external device includes:
  • the abscissa of the determined projection area Converting, by the external device, the abscissa of the determined projection area to a ratio of the abscissa to the first preset value, and converting the ordinate to a ratio of the ordinate to the second preset value; wherein the first preset value For the width of the projection area of the mobile terminal, the second preset value is the height of the projection area of the mobile terminal.
  • the embodiment of the invention further provides a terminal device, including:
  • connection module configured to establish a communication connection between the mobile terminal and an external device
  • Determining a module configured to determine a projection area of the screen of the mobile terminal
  • a transmission module configured to generate a media data stream of the projection area and transmit the same to the external device.
  • connection module is further configured to send a WFD connection request
  • the determining module is further configured to: after the WFD connection is successful, display a projection area selection frame while the mobile terminal performs projection, and determine the projection area according to the position of the projection area selection frame.
  • the determining module is further configured to receive an input signal, wherein the input signal is used to control a display area selection frame to be displayed or closed, and the content in the selection frame is selected for the projection area when the projection area selection frame is displayed. Projection, full-screen projection when the projection area selection box is closed.
  • the projection area selection frame when the mobile terminal supports the upper and lower split screens, the projection area selection frame is displayed with the height as a reference value; when the mobile terminal supports the left and right split screens, the projection area selection frame is referenced by the width. Display; when the mobile terminal supports free split screen, the projection area selection box can be displayed anywhere on the screen.
  • the transmission module is configured to generate a media data stream of the projection area by:
  • the image information of the projection area is captured by the mobile terminal in a preset period, and each frame image is packed in time order to form an audio/video stream.
  • the transmission module is configured to send a coordinate point of the projection area of the mobile terminal to the external device;
  • the abscissa of the determined projection area Converting, by the external device, the abscissa of the determined projection area to a ratio of the abscissa to the first preset value, and converting the ordinate to a ratio of the ordinate to the second preset value; wherein the first preset value For the width of the projection area of the mobile terminal, the second preset value is the height of the projection area of the mobile terminal.
  • An embodiment of the present invention further provides a projection system, including a mobile terminal and one or more external devices, wherein the mobile terminal is configured to establish a communication connection with an external device, and determine a projection area of the screen of the mobile terminal. Generating a media data stream of the projection area and transmitting the same to the external device;
  • the one or more external devices are configured to transmit a discovery response in response to the received discovery request, and display the media data stream after establishing a connection with the mobile terminal.
  • the external device is further configured to convert the abscissa of the projection area of the mobile terminal to a ratio of the abscissa to the first preset value, and convert the ordinate to the ordinate and the second preset value. a ratio; wherein the first preset value is a width of a projection area of the mobile terminal, and the second preset value is a height of a projection area of the mobile terminal.
  • the mobile terminal is further configured to receive an input signal, wherein the input signal is for controlling display or selection of the projection area selection frame, and the projection is performed when the projection area selection frame is displayed Content projection in the area selection box, and full-screen projection when the projection area selection box is closed;
  • the projection area selection frame is displayed with the height as a reference value
  • the projection area selection frame is displayed with a width as a reference value
  • the projection area selection box may be any position of the screen for display.
  • An embodiment of the present invention further provides a mobile terminal, including: an input device, a display screen, a processor, and a wireless communication unit;
  • the wireless communication unit is configured to establish a communication connection between the mobile terminal and an external device
  • the input device is configured to receive an input signal and transmit to the processor
  • the processor is configured to determine a projection area of the display screen based on the input signal, generate a media data stream of the projection area, and transmit the media data stream to the external device.
  • the mobile terminal further includes: an audio unit configured to: The media data stream of the projection area generated by the processor is converted into an audio signal and output.
  • the input device is a touch screen.
  • a mobile terminal projection method can realize one-to-one or one-to-many screen projection and sharing, and can reduce dependence on a place through a WFD network, and can be applied to a multimedia conference room or an audio-visual function classroom.
  • the WFD network can be quickly formed to realize resource sharing.
  • the projection side device can be quickly set to customize the projection area to quickly select the desktop area to be shared with other devices.
  • the implementation of the method overcomes the current Wi-Fi Display function to project the entire projection desktop to the receiving end, which affects the user experience. At the same time, it can well reflect the humanized design concept of mobile terminals.
  • FIG. 1 is a schematic structural diagram of hardware of an exemplary mobile terminal implementing an embodiment of the present application
  • FIG. 2 is a search flow chart of a projection side device according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of a method for projecting a mobile terminal according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a terminal projected by a mobile terminal according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a network structure capable of implementing multi-screen projection control according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram of a projection side device turning on multiple processes to perform screen data transmission control according to an embodiment of the present invention
  • Figure 7 is a schematic diagram of the control effect shown in Figure 6;
  • FIG. 8 is a structural block diagram of a terminal device according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of an interaction interface of a terminal device according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of a projection system of a mobile terminal according to an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of a mobile terminal that implements projection in an embodiment of the present invention.
  • the mobile terminal can be implemented in various forms.
  • the terminals described in this application may include, for example, mobile phones, smart phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), navigation devices, and the like.
  • Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like.
  • the terminal is a mobile terminal.
  • configurations in accordance with embodiments of the present application can be applied to fixed type terminals in addition to elements that are specifically for mobile purposes.
  • FIG. 1 is a schematic structural diagram of hardware of a terminal device according to an embodiment of the present invention.
  • the terminal device 100 of the embodiment of the present invention includes: a probe connection unit 101, a control unit 102, and a display unit 103.
  • the probe connection unit 101 is configured to perform device discovery to search for neighboring other devices available to the Wi-Fi Display service. When the other devices are found, the probe connection unit 101 performs interaction and capability negotiation with other devices through the Rapid Spanning Tree Protocol (RTSP) protocol to connect the terminal device 100 with other devices.
  • RTSP Rapid Spanning Tree Protocol
  • the control unit 102 controls basic operations within the terminal device 100.
  • the control unit 102 performs control so that the content (screen data) displayed by the display unit 103 is transmitted to other devices through the probe connection unit 101 based on RTP (Real-time Transport Protocol).
  • RTP is the real-time transport protocol.
  • the control unit 102 determines the input signal form from the user through the display unit 103 to control the terminal device 100 in accordance with the input signal. For example, a device search or the like is initiated based on an input signal.
  • the probe connection unit 101 is further configured to establish a connection with the device on the projection side to receive screen data.
  • the control unit 102 is also used to perform control such that the display unit 103 displays the received screen data.
  • the search process of the embodiment of the present invention includes:
  • the projection side device performs device discovery for finding neighboring external devices that support Wi-Fi Display.
  • the projection side device sets a connection with the device, performs switching capability, and performs negotiation.
  • Playback step the device uses the RTSP protocol to perform capability negotiation and match related parameters.
  • the current screen data of the projection side device is first packaged into an audio and video stream, and then the audio stream packet is directly sent to the receiving side through the RTP protocol.
  • the device, the screen data on the projection side is transmitted to the receiving side by stream type (audio/video (AV) stream).
  • RTSP is a real-time transport protocol, which belongs to an application layer protocol in the TCP/IP protocol system and is mainly responsible for device capability negotiation.
  • a projection method of the device split screen of the embodiment of the present invention is proposed. As shown in FIG. 3, in the embodiment of the present invention, a projection method of a device split screen is applied to a mobile terminal, and includes the following steps:
  • step S11 the mobile terminal establishes a communication connection with an external device.
  • the mobile terminal is equivalent to a projection side device such as a mobile phone, a PAD (tablet computer) or the like
  • the external device is equivalent to a receiving side device
  • the external device includes a display screen or a screen such as a mobile phone, a television, a projector, and the like.
  • the mobile terminal can be converted into an external device, that is, converted into a receiving device, and the external device can be converted into a mobile terminal, that is, converted into a projection device.
  • the projection device supports the split screen function, and The receiving side device is not limited.
  • the split screen function refers to dividing the screen of the mobile terminal into several areas, and each area is a separate display area, and can also implement a split screen in the form of a single window, a double window, a floating window, etc., for example, in a split screen state.
  • the next user can open a Taobao shopping while chatting with friends on WeChat.
  • the projection side device and the receiving side device can be directly connected to each other through Wi-Fi direct without using a wireless local area network (WLAN) access point (AP) or the like.
  • the projection side device finds the receiving side device.
  • the projection side device sends a probe request frame on a predefined channel.
  • the probe request frame includes information such as a peer-to-peer (P2P) information element (IE), a P2P wildcard SSID, a wildcard SSID, a destination address, a device type, and a device ID.
  • P2P peer-to-peer
  • the receiving side device listens to the probe request frame on a predefined channel. Each device determines that the information in the probe request frame matches the search criteria. If a match is found, the receiving side device transmits a probe request frame having the device description to the projection side device.
  • Step S12 determining a projection area of the screen of the mobile terminal.
  • the projection side device After the projection side device enters the normal connection projection through the WFD, the projection side device connects the entire screen to the receiving side device by default, and at the same time, the projection side device displays a projection area selection frame of the selectable projection, and the position of the projection area selection frame can be The desktop condition of the projection side device is adjusted.
  • the projection area selection box is equal to or smaller than the current desktop application icon size by default, and the user can manually adjust the size of the projection area selection box.
  • the display area selection frame may include: the projection side device only supports the upper and lower split screens, and the projection area selection frame is displayed with the height as a reference value; the projection side device only supports the left and right points.
  • the projection area selection box is displayed with the width as a reference value; the projection side device supports freely selecting the projection area, and the projection area selection box can be displayed at any position of the screen.
  • the projection device of the embodiment of the present invention can customize a projection area, and the rectangular dotted frame of the device 200 in the figure represents a projection area selection frame that can be dragged to change at least one of the position and the size, and the projection area selection box.
  • the inside P indicates a projection area, and the projection side device transmits the content of the projection area P to the receiving side device, and the unprojected area Q is not affected by the projection area P.
  • the projection side device is configured to trigger the projection area selection box to display or hide the switch.
  • the projection area selection frame can be set to press the time t, and T ⁇ t, the projection area selection frame is closed, and the projection is closed.
  • the side device performs full screen projection.
  • the projection side device can be set to press and hold a certain area time t, and T ⁇ t, the projection area selection frame is displayed.
  • a touch button or a button for triggering the projection area selection box is set.
  • step S13 a media data stream of the projection area is generated and transmitted to the external device.
  • the projection side device utilizes the underlying wireless chain according to the connection created when the connection is established.
  • the road packs the current screen video and audio data and transmits it to the corresponding receiving side device in combination with the RTP protocol.
  • the projection side device captures the current screen data every preset time (for example, 30 ms), packages it into an audio and video stream, and transmits the screen data to the receiving side device according to the RTP protocol.
  • the receiving side device is mainly responsible for displaying the screen data transmitted by the projection side device.
  • the receiving side device caches and displays the received media data stream containing the screen data.
  • the projection side device screens the screen and crops each frame according to the size of the screen projection area, only retains the image of the screen projection area, and then makes the cropped screenshot into an audio/video stream. , sent to an external device.
  • the receiving side device converts the abscissa of the projection area of the projection side device into a ratio of the abscissa to the first preset value, and the projection area The ordinate is converted into a ratio of the ordinate to the second preset value; wherein the first preset value is a width of a projection area of the mobile terminal, and the second preset value is a height of a projection area of the mobile terminal.
  • the projection area of the projection side device has a width of W0 and a height of H0, and a coordinate point is (X0, Y0), it is converted into (X0/W0, Y0/H0), that is, it is converted into occupied.
  • conversion can also be performed in other ways. If the width of the screen of the receiving device is W1, the height is H1, and the received coordinate is (X0/W0, Y0/H0), the coordinates of the point of the receiving device correspond to the coordinates of the projection device ((X0) /W0) ⁇ W1, (Y0/H0) ⁇ H1). As shown in FIG.
  • the receiving side device 300 displays the received projection content in full screen, and cannot view other unprojected areas of the projection side device. It should be understood that the receiving side device 300 can also be adjusted to display the received projected content in a certain area.
  • the projection method given in this embodiment is not limited to the above sequence of steps, and the mobile terminal may first determine the projection area of the screen, and then establish a communication connection with the external device.
  • the mobile terminal projection method of the embodiment of the invention can realize one-to-one screen projection and sharing, and can reduce the dependence on the location through the WFD network, and can be applied to a specific demand scene such as a multimedia conference room or an audio-visual function classroom.
  • the projection side device can be quickly set to customize the projection area to quickly select the desktop area to be shared with other devices.
  • the implementation of the method Overcoming the current Wi-Fi Display function, the entire projection desktop is projected to the receiving end, which affects the user experience.
  • the receiving side device only operates or views the projection area of the projection side device, and cannot view other unprojected areas of the projection side device, and the unprojected area of the projection side device is not affected by the projection area.
  • the embodiment of the present invention further provides a multi-screen projection method, which has one or more receiving side devices with respect to one projection side device.
  • FIG. 5 is a schematic structural diagram of a network capable of implementing multi-screen projection control according to an embodiment of the present invention.
  • the network 1000 includes: one projection side device 200 and at least one reception side device 300.
  • the hardware configuration of the projection side device 200 and the reception side device 300 can be referred to the above FIG.
  • Network 1000 has the same meaning as a Wi-Fi peer-to-peer (P2P) network.
  • the projection side device 200 and the reception side device 300 in the network 1000 are directly connected to each other through Wi-Fi direct without using a wireless local area network (WLAN) access point (AP) or the like.
  • WLAN wireless local area network
  • the projection side device 200 performs device discovery in the network 1000 environment to discover the reception side device 300.
  • the projection side device 200 transmits a probe request frame on a predefined channel.
  • the probe request frame includes information such as a peer-to-peer (P2P) information element (IE), a P2P wildcard SSID, a wildcard SSID, a destination address, a device type, and a device ID.
  • P2P peer-to-peer
  • IE peer-to-peer
  • P2P wildcard SSID a P2P wildcard SSID
  • a wildcard SSID a destination address
  • a device type a device ID
  • the receiving side device 300 in the network 1000 environment listens to the probe request frame on a predefined channel. Each device determines that the information in the probe request frame matches the search criteria. If a match is found, the receiving side device 300 transmits a probe request frame having the device description to the projection side device 200.
  • the projection side device 200 After the device discovery is completed, the projection side device 200 performs service discovery to obtain a service supported by the reception side device 300. During the service discovery, the projection side device 200 transmits a GAS initial request to the receiving side device 300. In response, the receiving side device 300 transmits the GAS initial response with the service information to the projection side device 200. Thereafter, the projection side device 200 establishes a WFD connection with the reception side device 300 using the device and service description obtained from the reception side device 300, that is, the device connection establishment in FIG.
  • each receiving side device 300 in the embodiment of the present invention establishes a connection with the projection side device 200 in the above manner. Thereby, the projection side device 200 and the plurality of receiving side devices 300 can be Called a group.
  • the projection side device 300 is designated as a group owner (GO).
  • the receiving side device 300 functions as a group client.
  • device A is a projection side device
  • device B, device C, and device D are both receiving side devices.
  • Device B, device C, and device D are connected to device A through Wireless.
  • Device A starts multiple process services, and each process manages communication with one receiving device separately.
  • the sub-process 1 corresponds to the communication connection data of the processing device B
  • the sub-process 2 corresponds to the communication connection data of the processing device C
  • the sub-process 3 corresponds to the communication connection data of the processing device D.
  • device A also starts a parent process for listening connections and so on.
  • each process is transmitted according to the WFD protocol.
  • the device A allocates an IP address to each receiving device, and stores the correspondence between each receiving device and its IP address in an IP list.
  • any device connected to the device A through the IP list can access other devices through the IP list, establish a TCP/IP connection, and implement two-way communication, so that any device can display screen data. Passed to other devices over a TCP/IP link. Thereby, screen mutual investment between devices can be achieved.
  • the screen data transfer process between the entire group includes:
  • the projection side device performs the discovery process of the receiving side device according to the above-mentioned execution, and listens for the connection request from other devices; and selects the specified device to establish a connection according to the discovered device.
  • the projection side device creates a plurality of sub-processes to process the bidirectional data transmission with each device separately.
  • the projection side device uses the underlying Wireless link to package the current screen video and audio data according to the process service created when the connection is established, and transmits it to all receiving side devices in combination with the RTP protocol.
  • the projection side device captures the current screen data every preset time (for example, 30 ms), packs it into an audio and video stream, and sends the screen data to the receiving side device according to the RTP protocol.
  • the projection side device interval screens the screen and according to the screen projection area The size of each frame is cropped, leaving only the image of the projected area of the screen, and then the cropped screenshot is made into an audio/video stream and sent to an external device.
  • the receiving side device is mainly responsible for displaying the screen data transmitted by the projection side device.
  • the receiving side device caches and displays the received media data stream containing the screen data. Referring to Figure 7, after the screen data begins to be transmitted, devices B, C, and D receive the screen data of device A and display it.
  • the projection side device manages the list of devices that establish the connection to ensure information security, and prevent irrelevant devices from joining, and also manages the joining of new devices in the middle or the exit of devices in the link.
  • the multi-screen projection control method of the embodiment of the invention can realize one-to-many screen projection and sharing, and can reduce the dependence on the location through the WFD network; and can be applied to a specific demand scene such as a multimedia conference room or an audio-visual function classroom. Quickly set up a WFD network to achieve resource sharing.
  • FIG. 8 is a structural block diagram of a terminal device according to an embodiment of the present invention, including: a connection module 11, a determining module 12, and a transmission module 13, wherein
  • the connection module 11 is arranged to establish a communication connection between the mobile terminal and an external device.
  • the mobile terminal is equivalent to the projection side device, and the external device is equivalent to the receiving side device.
  • the mobile terminal can be converted into an external device, that is, converted into a receiving device, and the external device can be converted into a mobile terminal, that is, converted into a projection device.
  • the projection device supports the split screen function, and The receiving side device is not limited.
  • the projection side device and the receiving side device can be directly connected to each other through Wi-Fi direct without using a wireless local area network (WLAN) access point (AP) or the like.
  • the projection side device finds the receiving side device.
  • the projection side device sends a probe request frame on a predefined channel.
  • the probe request frame includes information such as a peer-to-peer (P2P) information element (IE), a P2P wildcard SSID, a wildcard SSID, a destination address, a device type, and a device ID.
  • P2P peer-to-peer
  • the receiving side device listens to the probe request frame on a predefined channel. Each device determines that the information in the probe request frame matches the search criteria. If a match is found, the receiving side device transmits a probe request frame having the device description to the projection side device.
  • the determining module 12 is configured to determine a projected area of the screen of the mobile terminal.
  • the projection side device After the projection side device enters the normal connection projection through the WFD, the projection side device connects the entire screen to the receiving side device by default, and at the same time, the projection side device displays a projection area selection frame of the selectable projection, and the position of the projection area selection frame can be The desktop condition of the projection side device is adjusted.
  • the projection area selection box is equal to or smaller than the current desktop application icon size by default, and the user can manually adjust the size of the projection area selection box.
  • the display area selection frame may include: the projection side device only supports the upper and lower split screens, and the projection area selection frame is displayed with the height as a reference value; the projection side device only supports the left and right points. In the screen, the projection area selection box is displayed with the width as a reference value; the projection side device supports freely selecting the projection area, and the projection area selection box can be displayed at any position of the screen.
  • the projection side device is configured to trigger the projection area selection box to display or hide the switch.
  • the projection area selection frame can be set to press the time t, and T ⁇ t, the projection area selection frame is closed, and the projection is closed.
  • the side device performs full screen projection.
  • the projection side device can be set to press and hold a certain area time t, and T ⁇ t, the projection area selection frame is displayed.
  • a touch button or a button for triggering the projection area selection box is set.
  • the transmission module 13 is configured to generate a media data stream of the projection area and transmit it to an external device.
  • the projection side device uses the underlying Wireless link to package the current screen video and audio data according to the connection created when the connection is established, and transmits it to the corresponding receiving side device in combination with the RTP protocol.
  • the projection side device captures the current screen data every preset time (for example, 30 ms), packages it into an audio and video stream, and transmits the screen data to the receiving side device according to the RTP protocol.
  • the receiving side device is mainly responsible for displaying the screen data transmitted by the projection side device.
  • the receiving side device caches the received media data stream containing the screen data.
  • the projection side device screens the screen and crops each frame according to the size of the screen projection area, only retains the image of the screen projection area, and then makes the cropped screenshot into an audio/video stream. , sent to an external device.
  • the receiving side device converts the abscissa of the projection area of the projection side device into a ratio of the abscissa to the first preset value, and the projection area The ordinate is converted into a ratio of the ordinate to the second preset value; wherein the first preset value is a width of a projection area of the mobile terminal, and the second preset value is a height of a projection area of the mobile terminal.
  • the projection area of the projection side device has a width of W0 and a height of H0.
  • a coordinate point When a coordinate point is (X0, Y0), it is converted into (X0/W0, Y0/H0), that is, it is converted into a ratio of the projection area of the occupied mobile terminal in the width direction and the length direction. In addition, conversion can also be performed in other ways. If the width of the screen of the receiving device is W1, the height is H1, and the received coordinate is (X0/W0, Y0/H0), the coordinates of the point of the receiving device correspond to the coordinates of the projection device ((X0) /W0) ⁇ W1, (Y0/H0) ⁇ H1).
  • a terminal device of the embodiment of the invention can realize one-to-one screen projection and sharing, and can reduce the dependence on the location through the WFD network, and can be applied to a specific demand scene such as a multimedia conference room or an audio-visual function classroom.
  • the projection side device can be quickly set to customize the projection area to quickly select the desktop area to be shared with other devices.
  • the implementation of the method overcomes the current Wi-Fi Display function to project the entire projection desktop to the receiving end, which affects the user experience. At the same time, it can well reflect the humanized design concept of mobile terminals.
  • the embodiment of the invention further provides a terminal device having a hardware structure as shown in FIG. 1 .
  • the terminal device includes: a connection module configured to establish a communication connection between the mobile terminal and the external device; a determining module configured to adjust a split screen of the mobile terminal to determine a projection area of the screen; and a transmission module configured to The determined projection area is used for screen data transmission and display with external devices.
  • the terminal device can be used as a projection side device or as a receiving side device.
  • the screen projection function When the screen projection function is turned on, the user can see the interactive interface as shown on the left side of FIG. 9 through the display unit.
  • the interaction interface jumps to the interface on the upper right side, and the terminal device acts as a projection side device, performs a device discovery step, and searches for an adjacent external other supporting Wi-Fi Display. device.
  • the device list is displayed, and a connection is established with the selected user device according to the user's selection, and the exchange capability is performed using RTSP and negotiation is performed.
  • the terminal device After the connection is established, the terminal device directly transmits the screen data of the projection side device to the receiving side device after the RTSP play command; when receiving the response from the receiving side, starts the audio/video (AV) stream for mirroring, and the projection is performed.
  • the screen data of the side is transmitted to the receiving side device by the stream type.
  • the terminal device acts as a receiving side device, waits for the projection party to initiate an invitation, and when the invitation is received, that is, after establishing a connection with the projection side, the screen data sent by the projection side can be received.
  • a terminal device of the embodiment of the invention can realize one-to-one screen projection and sharing, and can reduce the dependence on the location through the WFD network, and can be applied to a specific demand scene such as a multimedia conference room or an audio-visual function classroom.
  • the projection side device can be quickly set to customize the projection area, so that the desktop area to be shared with other devices can be quickly selected, and multi-screen interaction can be realized, and the role can be switched.
  • a device can be shared to enhance the user experience.
  • an embodiment of the present invention further provides a projection system.
  • the system includes:
  • the mobile terminal 701 is configured to establish a communication connection with an external device, determine a screen projection area of the mobile terminal, generate an audio/video stream of the screen projection area, and transmit the audio/video stream to the external device;
  • the one or more external devices 702 are configured to transmit a discovery response in response to the received discovery request, displaying the audio/video stream after establishing a connection with the mobile terminal.
  • the mobile terminal is equivalent to a projection side device, such as a mobile phone, a PAD (tablet computer), etc.
  • the external device is equivalent to a receiving side device
  • the external device includes a display screen or a screen, such as a mobile phone, a television, a projector, and the like.
  • the mobile terminal can be converted into an external device, that is, converted into a receiving device, and the external device can be converted into a mobile terminal, that is, converted into a projection device.
  • the projection device supports the split screen function, and
  • the receiving side device is not limited.
  • the mobile terminal 701 is also arranged to send a WFD connection request to establish a WFD connection with one or more external devices.
  • the mobile terminal 701 is further configured to adjust the split screen, determine a projection area of the screen, and perform screen data transmission with the external device according to the determined projection area.
  • the projection area of the determining screen comprises:
  • the projection area selection frame is displayed with the height as a reference value
  • the projection area selection frame is displayed with the width as a reference value
  • the projection area selection box can be displayed anywhere in the screen.
  • the projection side device is configured to trigger the projection area selection box to display or hide the switch.
  • the projection area selection frame can be set to press the time t, and T ⁇ t, the projection area selection frame is closed, and the projection is closed.
  • the side device performs full screen projection.
  • the projection side device can be set to press and hold a certain area time t, and T ⁇ t, the projection area selection frame is displayed.
  • a touch button or a button for triggering the projection area selection box is set.
  • One or more external devices 702 are arranged to receive and display the received screen data.
  • the external device 702 is further configured to convert the abscissa of the determined projection area into a ratio of the abscissa to the first preset value, and convert the ordinate to a ratio of the ordinate to the second preset value; wherein the first The preset value is the width of the projection area of the mobile terminal, and the second preset value is the height of the projection area of the mobile terminal.
  • the receiving side device converts the abscissa of the projection area of the projection side device into a ratio of the abscissa to the first preset value, and the projection area The ordinate is converted into a ratio of the ordinate to the second preset value; wherein the first preset value is a width of a projection area of the mobile terminal, and the second preset value is a height of a projection area of the mobile terminal.
  • the projection area of the projection side device has a width W0 and a height of H0 and a coordinate point is (X0, Y0), it is converted into (X0/W0, Y0/H0), that is, it is converted into a occupied movement.
  • conversion can also be performed in other ways. If the screen of the receiving device is W1, the height is H1, and the received coordinates are (X0/W0, Y0/H0), the coordinates of the point of the receiving device correspond to the coordinates of the projection device ((X0/). W0) ⁇ W1, (Y0/H0) ⁇ H1).
  • the mobile terminal 701 includes a display screen and the display screen includes a first display area and a second display area; the one or more external devices 702 include a display screen, and the projection area determined according to the mobile terminal The field is projected.
  • the mobile terminal supports the split screen function, and no restrictions are imposed on the external device. It should be understood that the implementation principles and details described in the above embodiments 1 to 3 are applicable to the embodiment.
  • the device split screen projection system of the embodiment of the invention can realize one-to-one or one-to-many screen projection and sharing, and can reduce the dependence on the location through the WFD network, and can be applied to a multimedia conference room or an audio-visual function classroom.
  • the WFD network can be quickly formed to achieve resource sharing.
  • the projection side device can be quickly set to customize the projection area to quickly select the desktop area to be shared with other devices.
  • the implementation of the method overcomes the current Wi-Fi Display function to project the entire projection desktop to the receiving end, which affects the user experience.
  • the humanized design concept of the mobile terminal can be well reflected.
  • the mobile terminal of the embodiment of the present invention includes: an input device, a processor 903, a display screen 904, a wireless communication unit 905, and an audio unit 906.
  • the input device is a touch screen 2010.
  • the touch screen 2010 includes a touch panel 901 and a touch controller 902.
  • the input device may also be a non-touch input device (eg, an infrared input device, etc.) or the like.
  • the wireless communication unit 905 can include a short-range communication module (e.g., a WiFi chip) for the mobile terminal to establish a communication connection with an external device.
  • a short-range communication module e.g., a WiFi chip
  • Touch controller 902 can be a single application specific integrated circuit (ASIC), which can include one or more processor subsystems, which can include one or more ARM processors or other processors with similar functions and capabilities.
  • ASIC application specific integrated circuit
  • the touch controller 902 is mainly used for receiving a touch signal generated by the touch panel 901, and processing the same to the processor 903 of the mobile terminal. Such processing can determine the projection area of the screen of the mobile terminal, for example, by analog-to-digital conversion of the physical input signal, processing to obtain touch point coordinates, processing to obtain touch duration, and the like.
  • the processor 903 receives the output of the touch controller 902, performs processing, and performs an action based on the output.
  • the actions include, but are not limited to, capturing image information of a projection area within a preset period (eg, 30 ms), packing each frame image in time sequence to form an audio/video stream, and transmitting to the external device, etc. Wait.
  • the processor 903 is also coupled to the display screen 904.
  • Display 904 is used to provide a UI to a user of the device.
  • the audio unit 906 is for converting the screen projection area audio/video stream generated by the processor 903 into an audio signal and outputting it as a sound.
  • processor 903 can be a separate component from touch controller 902. In other embodiments, the processor 903 can be a composite component with the touch controller 902.
  • the touch panel 901 is provided with a discrete capacitive sensor, a resistive sensor, a force sensor, an optical sensor, or the like.
  • the touch panel 901 includes an electrode array made of a conductive material in a lateral direction and a longitudinal direction.
  • the touch controller 902 uses a self-capacitance scan, and then scans the M rows and the N columns respectively, according to each row and each column.
  • the signal is used to calculate the coordinates of the finger on the touch screen.
  • the number of scans is M+N times.
  • the touch controller 902 uses multi-contact mutual capacitance scanning to intersect the rows and columns. Scanning, whereby the number of scans is M ⁇ N times.
  • the touch panel When the user's finger touches the panel, the touch panel generates a touch signal (which is an electrical signal) to the touch controller 902.
  • the touch controller 902 can obtain the coordinates of the touched point by scanning.
  • the touch panel 901 of the touch screen 2010 is physically a set of independent coordinate positioning systems. After the touch point coordinates of the touch are reported to the processor 903, the processor 903 is converted to the display screen 904. Pixel coordinates to correctly identify the input operation.
  • the terminal device, the mobile terminal, and the external device of the embodiments of the present invention may be implemented in various forms.
  • the devices described in this application may include, for example, mobile phones, mobile phones, smart phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), navigation devices Mobile devices such as the like and fixed devices such as digital TVs, desktop computers, and the like.
  • computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .
  • the embodiment of the present invention provides a mobile terminal projection method, a terminal device, and a system, which overcomes the current Wi-Fi Display function, and projects the entire projection end desktop to the receiving end, thereby affecting the user experience, and can well reflect the civilization of the mobile terminal. Design concept.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

一种移动终端投影方法、终端设备及***，所述方法应用于移动终端，包括以下步骤：所述移动终端建立与外部设备之间的通信连接（S11）；所述移动终端调整分屏，确定屏幕投影的区域（S12）；根据所述确定的屏幕投影区域，进行与外部设备间的屏幕数据传输。基于移动设备中Wi-Fi Display与分屏功能，可对投影侧设备进行快速设置自定义投影区域，达到快速选择需共享给其他设备的桌面区域。

Description

一种移动终端投影方法、终端设备及*** 技术领域
本申请涉及但不限于通信技术领域，尤其涉及一种移动终端投影方法、终端设备及***。
背景技术
随着电子产业的快速发展，移动终端智能化程度越来越高。移动终端研发公司也越来越注重智能化、人性化设计。在此移动终端快速发展的背景下，终端的便捷操作和人性化设计成为移动终端不可忽视的一部分。
当前移动终端快速普及，越来越多的用户开始持有两个或多个移动设备，因此，Wi-Fi Display(WFD，无线网显示)功能随科技发展浪潮而诞生，即现移动设备中的WFD功能。该功能可以将一个投影设备界面及投影设备状况通过无线方式投影到另一个接收设备上，该接收设备则可以操作该投影设备。
但目前Wi-Fi Display功能与移动终端分屏功能没有做有效的结合，影响了用户真正的使用体验。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本发明实施例提供一种移动终端投影方法、终端设备及***，用于将媒体数据流投送给外部设备，所述外部设备包括显示屏或屏幕，所述方法包括：
移动终端建立与外部设备之间的通信连接；
确定所述移动终端屏幕的投影区域；
生成所述投影区域的媒体数据流，并传送给所述外部设备。
在示例性实施方式中，所述移动终端建立与外部设备之间的通信连接， 包括以下步骤：
移动终端发送WFD连接请求；
在所述移动终端处接收发现响应，其中，所述发现响应是外部设备响应于已接收到的发现请求而发送的；
移动终端建立与外部设备之间的WFD连接。
在示例性实施方式中，所述确定移动终端屏幕的投影区域，包括：
当WFD连接成功后，移动终端进行投影的同时显示一投影区域选择框，根据投影区域选择框的位置，确定投影区域。
在示例性实施方式中，所述移动终端投影方法还包括：
所述移动终端接收输入信号，其中，所述输入信号用于控制投影区域选择框显示或关闭，当投影区域选择框显示时对投影区域选择框内的内容投影，当投影区域选择框关闭时进行全屏投影。
在示例性实施方式中，当移动终端支持上下分屏时，则投影区域选择框以高度为参考值，进行显示；当移动终端支持左右分屏时，则投影区域选择框以宽度为参考值，进行显示；当移动终端支持自由分屏时，则投影区域选择框可以为屏幕的任意位置，进行显示。
在示例性实施方式中，所述生成所述投影区域的媒体数据流，包括：
移动终端在预设周期内捕捉投影区域的图像信息，对每一帧图像以时间顺序打包从而形成音/视频流。
在示例性实施方式中，所述生成所述投影区域的媒体数据流，并传送给所述外部设备，包括：
将所述移动终端确定投影区域的坐标点发送给所述外部设备；
由所述外部设备将确定投影区域的横坐标转换为横坐标与第一预设值的比值，将纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。
本发明实施例还提供一种终端设备，包括：
连接模块，设置为建立移动终端与外部设备之间的通信连接；
确定模块，设置为确定所述移动终端屏幕的投影区域；
传输模块，设置为生成所述投影区域的媒体数据流，并传送给所述外部设备。
在示例性实施方式中，所述连接模块还设置为发送WFD连接请求；
在所述移动终端处接收发现响应，其中，所述发现响应是外部设备响应于已接收到的发现请求而发送的；
建立移动终端与外部设备之间的WFD连接。
在示例性实施方式中，所述确定模块还设置为当WFD连接成功后，在移动终端进行投影的同时显示一投影区域选择框，根据投影区域选择框的位置，确定投影区域。
在示例性实施方式中，所述确定模块还设置为接收输入信号，其中，所述输入信号用于控制投影区域选择框显示或关闭，当投影区域选择框显示时对投影区域选择框内的内容投影，当投影区域选择框关闭时进行全屏投影。
在示例性实施方式中，当移动终端支持上下分屏时，则投影区域选择框以高度为参考值，进行显示；当移动终端支持左右分屏时，则投影区域选择框以宽度为参考值，进行显示；当移动终端支持自由分屏时，则投影区域选择框可以为屏幕的任意位置，进行显示。
在示例性实施方式中，所述传输模块设置为通过以下方式生成所述投影区域的媒体数据流：
在移动终端在预设周期内捕捉投影区域的图像信息，对每一帧图像以时间顺序打包从而形成音/视频流。
在示例性实施方式中，所述传输模块设置为将所述移动终端确定投影区域的坐标点发送给所述外部设备；
由所述外部备将确定投影区域的横坐标转换为横坐标与第一预设值的比值，将纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。
本发明实施例还提供一种投影***，包括移动终端和一个或多个外部设备，其中，所述移动终端，设置为建立与外部设备之间的通信连接，确定所述移动终端屏幕的投影区域，生成所述投影区域的媒体数据流，并传送给所述外部设备；
所述一个或多个外部设备，设置为发送响应于已接收到的发现请求的发现响应，与所述移动终端建立连接后显示所述媒体数据流。
在示例性实施方式中，所述外部设备还设置为将移动终端确定投影区域的横坐标转换为横坐标与第一预设值的比值，将纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。
在示例性实施方式中，所述移动终端还设置为接收输入信号，其中，所述输入信号用于控制所述投影区域选择框显示或关闭，当所述投影区域选择框显示时对所述投影区域选择框内的内容投影，当所述投影区域选择框关闭时进行全屏投影；
其中，当所述移动终端支持上下分屏时，则所述投影区域选择框以高度为参考值，进行显示；
当所述移动终端支持左右分屏时，则所述投影区域选择框以宽度为参考值，进行显示；
当所述移动终端支持自由分屏时，则所述投影区域选择框可以为屏幕的任意位置，进行显示。
本发明实施例还提供一种移动终端，包括：输入设备、显示屏、处理器以及无线通信单元；
所述无线通信单元配置为建立移动终端与外部设备之间的通信连接；
所述输入设备配置为接收输入信号，并传输给所述处理器；
所述处理器配置为根据所述输入信号，确定显示屏的投影区域，生成所述投影区域的媒体数据流，并传送给所述外部设备。
在示例性实施方式中，所述移动终端还包括：音频单元，配置为将所述 处理器生成的所述投影区域的媒体数据流转换成音频信号并输出。
在示例性实施方式中，所述输入设备为触摸屏。
本发明实施例的一种移动终端投影方法，可实现一对一或一对多的屏幕投影和分享，通过WFD网络，可减少对地点的依赖，可应用于多媒体会议室或视听功能教室等特定需求的场景中，实现快速组建WFD网络，实现资源共享。基于移动设备中Wi-Fi Display与分屏功能，可对投影侧设备进行快速设置自定义投影区域，达到快速选择需共享给其他设备的桌面区域。该方法的实现，克服当前Wi-Fi Display功能将整个投影端桌面投影到接收端，影响用户使用体验。同时，可很好体现出移动终端的人性化设计理念。
在阅读并理解了附图和详细描述后，可以明白其他方面。
附图概述
下面将结合附图及实施例对本申请作进一步说明，附图中：
图1是实现本申请实施例的一个示例性移动终端的硬件结构示意图；
图2是本发明实施例的投影侧设备的搜索流程图；
图3是本发明实施例的移动终端投影方法流程图；
图4是本发明实施例的移动终端投影的终端示意图；
图5是本发明实施例的可实现多屏投影控制的网络结构示意图；
图6是本发明实施例的投影侧设备开启多个进程进行屏幕数据传输控制的示意图；
图7是图6所示的控制效果示意图；
图8是本发明实施例的终端设备的结构框图；
图9是本发明实施例的终端设备的交互界面示意图；
图10是本发明实施例的移动终端投影***的结构示意图；
图11是本发明实施例中实现投影的移动终端的结构示意图。
本发明的实施方式
应当理解，此处所描述的实施例仅仅用以解释本申请，并不用于限定本申请。
现在将参考附图描述实现本申请实施例的移动终端。在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本申请的说明，其本身并没有特定的意义。因此，"模块"与"部件"可以混合地使用。
移动终端可以以各种形式来实施。例如，本申请中描述的终端可以包括诸如移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下面，假设终端是移动终端。然而，本领域技术人员将理解的是，除了特别用于移动目的的元件之外，根据本申请的实施方式的构造也能够应用于固定类型的终端。
实施例1
参见图1，为本发明实施例的终端设备的硬件结构示意图。
本发明实施例的终端设备100包括：探测连接单元101、控制单元102、显示单元103。
当终端设备100作为投影侧(Source端)时：
探测连接单元101用于执行设备发现，以搜索Wi-Fi Display服务可用的相邻其它设备。当发现其它设备时，探测连接单元101通过RTSP(Rapid Spanning Tree Protocol，快速生成树协议)协议与其它设备进行交互、能力协商，以使终端设备100与其它设备连接。
控制单元102控制终端设备100内的基本操作。控制单元102进行控制以使得显示单元103显示的内容(屏幕数据)基于RTP(Real-time Transport Protocol，实时传输协议)通过探测连接单元101被发送给其它设备。RTP即实时传输协议。控制单元102通过显示单元103确定来自用户的输入信号形式以根据输入信号控制终端设备100。例如，根据输入信号发起设备搜索等。
当终端设备100作为接收侧(Sink端)时：
探测连接单元101还用于与投影侧的设备建立连接，接收屏幕数据。控制单元102还用于进行控制以使得显示单元103显示接收到的屏幕数据。
参见图2为本发明实施例的投影侧设备的搜索流程图。本发明实施例的搜索流程包括：
设备发现步骤：投影侧设备执行用于寻找支持Wi-Fi Display的相邻外部其它设备的设备发现。
设备连接步骤：当任一其它设备被发现时，投影侧设备设置与该设备的连接，进行交换能力并且执行协商。
播放步骤：设备利用RTSP协议进行能力协商并匹配相关参数，经过RTSP播放命令后，首先将投影侧设备的当前屏幕数据打包成视音频流，然后经过RTP协议直接将该音频流包发送到接收侧设备，投影侧的屏幕数据是通过流类型(音/视频(AV)流)发送到接收侧。RTSP即实时传输协议，属于TCP/IP协议体系中的一个应用层协议，主要负责设备能力协商。
实施例2
基于上述终端设备硬件结构以及投影侧终端的搜索流程，提出本发明实施例的设备分屏的投影方法。如图3所示，在本发明实施例中，设备分屏的投影方法，应用于移动终端，包括以下步骤：
步骤S11，移动终端建立与外部设备之间的通信连接。
应理解，移动终端相当于投影侧设备，如手机、PAD(平板电脑)等，外部设备相当于接收侧设备，所述外部设备包括显示屏或屏幕，如手机、电视机、投影仪等。在一定的条件下，移动终端可转换为外部设备即转换为接收侧设备，外部设备可转换为移动终端即转换为投影侧设备，在本实施例中，投影侧设备支持分屏功能，而对接收侧设备不做限制。分屏功能是指将移动终端屏幕划分若干个区域，且每个区域为一个独立的显示区域，也可以实现应用的单窗口、双窗口、浮动窗口等形式的分屏，例如，在分屏状态下用户可以一边开着淘宝购物，一边跟朋友聊微信。
投影侧设备和接收侧设备可以通过Wi-Fi direct直接相互连接，而无需使用无线局域网络(WLAN)接入点(AP)等。投影侧设备发现接收侧设备。在设备发现期间，投影侧设备在预定义的信道上发送探查请求帧(probe request frame)。探查请求帧包括诸如对等(P2P)信息元素(IE)、P2P通配符SSID、通配符SSID、目的地地址、设备类型和设备ID之类的信息。接收侧设备在预定义的信道上听取探查请求帧。每个设备确定探查请求帧中的信息匹配搜索标准。如果发现匹配，则接收侧设备将具有设备描述的探查请求帧发送到投影侧设备。
步骤S12，确定移动终端屏幕的投影区域。
在投影侧设备通过WFD进入正常的连接投影后，投影侧设备默认将整个屏幕连接到接收侧设备，同时在投影侧设备显示可选择投影的投影区域选择框，该投影区域选择框的位置可根据投影侧设备的桌面情况进行调整，该投影区域选择框默认等于或小于当前桌面应用图标大小，用户可手动调整该投影区域选择框的大小。根据投影侧设备的分屏设计情况，显示投影区域选择框的形式可以包括：投影侧设备只支持上下分屏，则投影区域选择框以高度为参考值，进行显示；投影侧设备只支持左右分屏，则投影区域选择框以宽度为参考值，进行显示；投影侧设备支持自由选择投影区域，则投影区域选择框可以为屏幕的任意位置，进行显示。如图4所示，本发明实施例的投影设备可以自定义投影区域，图中设备200的矩形虚线框表示可以拖动改变位置和大小中至少一项的一个投影区域选择框，投影区域选择框内的P表示投影区域，投影侧设备将投影区域P的内容发送给接收侧设备，而未投影区域Q不受投影区域P影响。
在本实施例中，投影侧设备设置触发投影区域选择框显示或隐藏开关，如在显示时，可设置在投影区域选择框长按时间t，且T<t，则关闭投影区域选择框，投影侧设备进行全屏投影。在投影进行时，可在投影侧设备设置长按某区域时间t，且T<t，则显示投影区域选择框。同理，根据投影侧设备情况，设置触发投影区域选择框的触压按钮或按键等。
步骤S13，生成投影区域的媒体数据流，并传送给外部设备。
投影侧设备根据连接建立时创建的连接，利用底层的无线(Wireless)链 路，将当前屏幕视音频数据打包，结合RTP协议传输给相应的接收侧设备。投影侧设备每隔预设时间(例如，30ms)抓取一次当前屏幕数据，打包成视音频流，并根据RTP协议将屏幕数据发送至接收侧设备。接收侧设备主要负责投影侧设备传输的屏幕数据的显示。接收侧设备将接收到的包含屏幕数据的媒体数据流进行缓存处理并显示。在另一个实施例中，投影侧设备间隔对屏幕进行截图，并根据屏幕投影区域的大小对每帧截图进行裁剪，仅保留屏幕投影区域的图像，然后将裁剪后的截图制成音/视频流，发送给外部设备。
为了使得投影侧设备中投影区域能够自适应接收侧设备屏幕大小显示投影内容，接收侧设备将投影侧设备的投影区域的横坐标转换为横坐标与第一预设值的比值，将投影区域的纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。例如，投影侧设备的投影区域的宽度为W0，高度为H0，一坐标点为(X0，Y0)，则将其转换为(X0/W0，Y0/H0)，即其被转换成了所占移动终端的投影区域在宽度方向和长度方向上的比例。此外，也可按照其他方式进行转换。若接收侧设备的屏幕的宽度为W1，高度为H1，接收到的坐标为(X0/W0，Y0/H0)，则接收侧设备的该点的坐标对应于投影侧设备的坐标为((X0/W0)×W1，(Y0/H0)×H1)。如图4所示，当设备200确定P为投影区域后，将投影区域P的内容投影到设备300，并且设备300根据投影区域大小与设备自身的显示区域进行调整，本实施例中接收侧设备300为全屏显示所接收的投影内容，且无法查看投影侧设备其他未投影区域。应理解，接收侧设备300也可以调整为某一区域显示所接收的投影内容。
应理解，本实施例中给出的投影方法不限于上述步骤顺序，移动终端也可以先确定屏幕的投影区域，再进行建立与外部设备之间的通信连接。
本发明实施例的一种移动终端投影方法，可实现一对一的屏幕投影和分享，通过WFD网络，可减少对地点的依赖，可应用于多媒体会议室或视听功能教室等特定需求的场景中，实现快速组建WFD网络，实现资源共享。基于移动设备中Wi-Fi Display与分屏功能，可对投影侧设备进行快速设置自定义投影区域，达到快速选择需共享给其他设备的桌面区域。该方法的实现， 克服当前Wi-Fi Display功能将整个投影端桌面投影到接收端，影响用户使用体验。而且，接收侧设备只对投影侧设备的投影区域进行操作或观看，无法查看投影侧设备其他未投影区域，投影侧设备的未投影区域不受投影区域影响。
实施例3
基于上述实施例，本发明实施例还提出一种多屏投影方法，相对于一个投影侧设备，有一个或多个接收侧设备。参见图5为本发明实施例的可实现多屏投影控制的网络结构示意图。
网络1000包括：一个投影侧设备200和至少一个接收侧设备300。投影侧设备200和接收侧设备300的硬件结构可参照上述图1所示。
网络1000具有与Wi-Fi点对点(P2P)网络相同的含义。在网络1000中的投影侧设备200和接收侧设备300通过Wi-Fi direct直接相互连接，而无需使用无线局域网络(WLAN)接入点(AP)等。
投影侧设备200在网络1000环境中执行设备发现以发现接收侧设备300。在设备发现期间，投影侧设备200在预定义的信道上发送探查请求帧(probe request frame)。探查请求帧包括诸如对等(P2P)信息元素(IE)、P2P通配符SSID、通配符SSID、目的地地址、设备类型和设备ID之类的信息。在网络1000环境中的接收侧设备300在预定义的信道上听取探查请求帧。每个设备确定探查请求帧中的信息匹配搜索标准。如果发现匹配，则接收侧设备300将具有设备描述的探查请求帧发送到投影侧设备200。
在设备发现完成后，投影侧设备200执行服务发现以获得接收侧设备300所支持的服务。在服务发现期间，投影侧设备200将GAS初始请求发送到接收侧设备300。作为响应，接收侧设备300将具有服务信息的GAS初始响应发送到投影侧设备200。此后，投影侧设备200使用从接收侧设备300获得的设备和服务描述与接收侧设备300设立WFD连接，即图2中的设备连接建立。
应理解，本发明实施例中的每一接收侧设备300均按照上述方式建立与投影侧设备200的连接。由此，可将投影侧设备200和多个接收侧设备300 称为一个群组(Group)。投影侧设备300被指定为群组所有者(GO)。接收侧设备300作为群组客户端。
参见图6，设备A为投影侧设备，设备B、设备C和设备D均为接收侧设备。设备B、设备C、设备D通过Wireless与设备A相连。
设备A启动多个进程服务，每个进程分别管理和一台接收侧设备的通信。例如：子进程1对应处理设备B的通信连接数据，子进程2对应处理设备C的通信连接数据，子进程3对应处理设备D的通信连接数据。此外，设备A还启动一个父进程用于进行监听连接等。
在本发明实施例中，每个进程都按照WFD协议进行传输。
为了实现底层的通信链路，设备A为每一台接收侧设备分配一个IP地址，且将每一接收侧设备与其IP地址的对应关系存储到一IP列表中。
在本发明实施例中，通过IP列表，与设备A连接的任何设备都可以通过该IP列表访问到其他设备，建立TCP/IP连接，实现双向通信，这样，任何一台设备都可以将屏幕数据通过TCP/IP链路传递给其他设备。由此，可实现设备间的屏幕互投。
整个群组之间的屏幕数据传输过程包括：
(1)连接建立
在底层链路，投影侧设备按照上述执行发现接收侧设备的发现过程，监听发现来自其它设备的连接请求；并根据发现的设备，选择指定的设备建立连接。当与多个(两个或两个以上)设备建立连接时，投影侧设备创建多个子进程分别处理与每一个设备之间的双向数据传输。
(2)屏幕数据传输
连接建立后，投影侧设备根据连接建立时创建的进程服务，利用底层的Wireless链路，将当前屏幕视音频数据打包，结合RTP协议传输给所有的接收侧设备。其中，投影侧设备每隔预设时间(例如，30ms)抓取一次当前屏幕数据，打包成视音频流，并根据RTP协议将屏幕数据发送至接收侧设备。在另一个实施例中，投影侧设备间隔对屏幕进行截图，并根据屏幕投影区域 的大小对每帧截图进行裁剪，仅保留屏幕投影区域的图像，然后将裁剪后的截图制成音/视频流，发送给外部设备。
接收侧设备主要负责显示投影侧设备传输的屏幕数据。接收侧设备将接收到的包含屏幕数据的媒体数据流进行缓存处理并显示。参见图7，屏幕数据开始传输后，设备B、C和D接收设备A的屏幕数据并进行显示。
在本发明实施例中，投影侧设备对建立连接的设备列表进行管理，以保证信息安全，以及防止无关设备加入，还可管理中途新设备的加入或链路中设备的退出。
本发明实施例的多屏投影控制方法，可实现一对多的屏幕投影和分享，通过WFD网络，可减少对地点的依赖；可应用于多媒体会议室或视听功能教室等特定需求的场景中，快速组建WFD网络，实现资源共享。
实施例4
参见图8，为本发明实施例给出的一种终端设备结构框图，包括：连接模块11、确定模块12以及传输模块13，其中，
连接模块11，设置为建立移动终端与外部设备之间的通信连接。
应理解，移动终端相当于投影侧设备，外部设备相当于接收侧设备。在一定的条件下，移动终端可转换为外部设备即转换为接收侧设备，外部设备可转换为移动终端即转换为投影侧设备，在本实施例中，投影侧设备支持分屏功能，而对接收侧设备不做限制。
投影侧设备和接收侧设备可以通过Wi-Fi direct直接相互连接，而无需使用无线局域网络(WLAN)接入点(AP)等。投影侧设备发现接收侧设备。在设备发现期间，投影侧设备在预定义的信道上发送探查请求帧(probe request frame)。探查请求帧包括诸如对等(P2P)信息元素(IE)、P2P通配符SSID、通配符SSID、目的地地址、设备类型和设备ID之类的信息。接收侧设备在预定义的信道上听取探查请求帧。每个设备确定探查请求帧中的信息匹配搜索标准。如果发现匹配，则接收侧设备将具有设备描述的探查请求帧发送到投影侧设备。
确定模块12，设置为确定所述移动终端屏幕的投影区域。
在投影侧设备通过WFD进入正常的连接投影后，投影侧设备默认将整个屏幕连接到接收侧设备，同时在投影侧设备显示可选择投影的投影区域选择框，该投影区域选择框的位置可根据投影侧设备的桌面情况进行调整，该投影区域选择框默认等于或小于当前桌面应用图标大小，用户可手动调整该投影区域选择框的大小。根据投影侧设备的分屏设计情况，显示投影区域选择框的形式可以包括：投影侧设备只支持上下分屏，则投影区域选择框以高度为参考值，进行显示；投影侧设备只支持左右分屏，则投影区域选择框以宽度为参考值，进行显示；投影侧设备支持自由选择投影区域，则投影区域选择框可以为屏幕的任意位置，进行显示。
在本实施例中，投影侧设备设置触发投影区域选择框显示或隐藏开关，如在显示时，可设置在投影区域选择框长按时间t，且T<t，则关闭投影区域选择框，投影侧设备进行全屏投影。在投影进行时，可在投影侧设备设置长按某区域时间t，且T<t，则显示投影区域选择框。同理，根据投影侧设备情况，设置触发投影区域选择框的触压按钮或按键等。
传输模块13，设置为生成所述投影区域的媒体数据流，并传送给外部设备。
投影侧设备根据连接建立时创建的连接，利用底层的Wireless链路，将当前屏幕视音频数据打包，结合RTP协议传输给相应的接收侧设备。投影侧设备每隔预设时间(例如，30ms)抓取一次当前屏幕数据，打包成视音频流，并根据RTP协议将屏幕数据发送至接收侧设备。接收侧设备主要负责投影侧设备传输的屏幕数据的显示。接收侧设备将接收到的包含屏幕数据的媒体数据流进行缓存处理。在另一个实施例中，投影侧设备间隔对屏幕进行截图，并根据屏幕投影区域的大小对每帧截图进行裁剪，仅保留屏幕投影区域的图像，然后将裁剪后的截图制成音/视频流，发送给外部设备。
为了使得投影侧设备中投影区域能够自适应接收侧设备屏幕大小显示投影内容，接收侧设备将投影侧设备的投影区域的横坐标转换为横坐标与第一预设值的比值，将投影区域的纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。例如，投影侧设备的投影区域的宽度为W0，高度为H0， 一坐标点为(X0，Y0)，则将其转换为(X0/W0，Y0/H0)，即其被转换成了所占移动终端的投影区域在宽度方向和长度方向上的比例。此外，也可按照其他方式进行转换。若接收侧设备的屏幕的宽度为W1，高度为H1，接收到的坐标为(X0/W0，Y0/H0)，则接收侧设备的该点的坐标对应于投影侧设备的坐标为((X0/W0)×W1，(Y0/H0)×H1)。
应理解，上述实施例1至3所述的实现原理和细节均适用于该实施例。
本发明实施例的一种终端设备，可实现一对一的屏幕投影和分享，通过WFD网络，可减少对地点的依赖，可应用于多媒体会议室或视听功能教室等特定需求的场景中，实现快速组建WFD网络，实现资源共享。基于移动设备中Wi-Fi Display与分屏功能，可对投影侧设备进行快速设置自定义投影区域，达到快速选择需共享给其他设备的桌面区域。该方法的实现，克服当前Wi-Fi Display功能将整个投影端桌面投影到接收端，影响用户使用体验。同时，可很好体现出移动终端的人性化设计理念。
实施例5
本发明实施例还提供一种终端设备，其具有如图1所示的硬件结构。该终端设备包括：连接模块，设置为建立移动终端与外部设备之间的通信连接；确定模块，设置为调整所述移动终端的分屏，确定屏幕的投影区域；传输模块，设置为根据所述确定的投影区域，进行与外部设备间的屏幕数据传输并显示。
参见图9，在本发明实施例中，终端设备可作为投影侧设备，也可作为接收侧设备。当打开屏幕投影功能时，用户可通过显示单元看到如图9左边所示的交互界面。当用户通过移动终端投影区域选择“投影画面”时，交互界面跳转为右边上侧的界面，该终端设备即作为投影侧设备，执行设备发现步骤，寻找支持Wi-Fi Display的相邻外部其它设备。当其它设备被发现时，即显示设备列表，根据用户的选择，与选择的用户设备建立连接，利用RTSP进行交换能力并且执行协商。连接建立后，终端设备通过RTSP播放命令后，将投影侧设备的屏幕数据直接发送到接收侧设备；当接收到接收侧的响应时，开始用于镜像的音频/视频(AV)流，将投影侧的屏幕数据通过流类型发送到接收侧设备。
当用户通过移动终端投影区域选择“接收画面”时，终端设备作为接收侧设备，等待投影方发起邀请，当接收到邀请，即与投影方建立连接后，即可接收投影方发送的屏幕数据。
应理解，上述实施例1至3所述的实现原理和细节均适用于该实施例。
本发明实施例的一种终端设备，可实现一对一的屏幕投影和分享，通过WFD网络，可减少对地点的依赖，可应用于多媒体会议室或视听功能教室等特定需求的场景中，实现快速组建WFD网络，实现资源共享。基于移动设备中Wi-Fi Display与分屏功能，可对投影侧设备进行快速设置自定义投影区域，达到快速选择需共享给其他设备的桌面区域，且可实现多屏互动，通过角色切换，任一设备均可进行分享，提升了用户使用体验。
实施例6
参见图10，本发明实施例还提供一种投影***。该***包括：
移动终端701，设置为建立与外部设备之间的通信连接，确定所述移动终端的屏幕投影区域，生成所述屏幕投影区域的音/视频流，并传送给所述外部设备；
所述一个或多个外部设备702，设置为发送响应于已接收到的发现请求的发现响应，与所述移动终端建立连接后显示所述音/视频流。
移动终端相当于投影侧设备，如手机、PAD(平板电脑)等，外部设备相当于接收侧设备，所述外设备包括显示屏或屏幕，如手机、电视机、投影仪等。在一定的条件下，移动终端可转换为外部设备即转换为接收侧设备，外部设备可转换为移动终端即转换为投影侧设备，在本实施例中，投影侧设备支持分屏功能，而对接收侧设备不做限制。
移动终端701还设置为发送WFD连接请求，以建立与一个或多个外部设备间的WFD连接。
移动终端701还设置为调整分屏，确定屏幕的投影区域，并根据所述确定的投影区域，进行与外部设备间的屏幕数据传输。其中，所述确定屏幕的投影区域包括：
当移动终端支持上下分屏时，则投影区域选择框以高度为参考值，进行显示；
当移动终端支持左右分屏时，则投影区域选择框以宽度为参考值，进行显示；
当移动终端支持自由分屏时，则投影区域选择框可以为屏幕的任意位置，进行显示。
在本实施例中，投影侧设备设置触发投影区域选择框显示或隐藏开关，如在显示时，可设置在投影区域选择框长按时间t，且T<t，则关闭投影区域选择框，投影侧设备进行全屏投影。在投影进行时，可在投影侧设备设置长按某区域时间t，且T<t，则显示投影区域选择框。同理，根据投影侧设备情况，设置触发投影区域选择框的触压按钮或按键等。
一个或多个外部设备702，设置为接收并显示接收到的屏幕数据。
所述外部设备702还设置为将确定投影区域的横坐标转换为横坐标与第一预设值的比值，将纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。
为了使得投影侧设备中投影区域能够自适应接收侧设备屏幕大小显示投影内容，接收侧设备将投影侧设备的投影区域的横坐标转换为横坐标与第一预设值的比值，将投影区域的纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。例如，投影侧设备的投影区域宽度为W0，高度为H0，一坐标点为(X0，Y0)，则将其转换为(X0/W0，Y0/H0)，即其被转换成了所占移动终端投影区域在宽度方向和长度方向上的比例。此外，也可按照其他方式进行转换。若接收侧设备屏幕为宽度为W1，高度为H1，接收到的坐标为(X0/W0，Y0/H0)，则接收侧设备的该点的坐标对应于投影侧设备的坐标为((X0/W0)×W1，(Y0/H0)×H1)。
移动终端701包括一显示屏且显示屏包括第一显示区域和第二显示区域；一个或多个外部设备702包括一显示屏，并根据所述移动终端确定的投影区 域进行投影显示。
在本实施例中，移动终端支持分屏功能，而对外部设备不做限制。应理解，上述实施例1至3所述的实现原理和细节均适用于该实施例。
本发明实施例的一种设备分屏投影***，可实现一对一或一对多的屏幕投影和分享，通过WFD网络，可减少对地点的依赖，可应用于多媒体会议室或视听功能教室等特定需求的场景中，实现快速组建WFD网络，实现资源共享。基于移动设备中Wi-Fi Display与分屏功能，可对投影侧设备进行快速设置自定义投影区域，达到快速选择需共享给其他设备的桌面区域。该方法的实现，克服当前Wi-Fi Display功能将整个投影端桌面投影到接收端，影响用户使用体验。而且，可很好体现出移动终端的人性化设计理念。
实施例7
参见图11，本发明实施例的移动终端包括：输入设备、处理器903、显示屏904、无线通信单元905、音频单元906。在一个实施例中，输入设备为触摸屏2010。触摸屏2010包括触摸面板901和触摸控制器902。此外，输入设备还可为非触摸式输入设备(例如，红外输入设备等)等。
无线通信单元905可以包括一个短程通信模块(如，WiFi芯片)，用于移动终端建立与外部设备之间的通信连接。
触摸控制器902可以是单个专用集成电路(ASIC)，其可以包括一个或多个处理器子***，处理器子***可以包括一个或多个ARM处理器或者其它具有类似功能和性能的处理器。
触摸控制器902主要用于接收产生于触摸面板901的触摸信号，并进行处理后传输给移动终端的处理器903。这种处理例如，为将物理输入信号进行模数转换、处理得到触摸点坐标、处理得到触摸持续时间等，从而可以确定移动终端屏幕的投影区域。
处理器903接收触摸控制器902的输出，进行处理后基于该输出执行动作。所述动作包括但不限于，在预设周期(例如，30ms)内捕捉投影区域的图像信息，对每一帧图像以时间顺序打包从而形成音/视频流，并传送给所述外部设备，等等。
处理器903还与显示屏904连接。显示屏904用于向设备的用户提供UI。
音频单元906用于将处理器903生成的屏幕投影区域音/视频流转换音频信号并且输出为声音。
在一些实施例中，处理器903可以是与触摸控制器902分开的部件。在其它实施例中，处理器903可以与触摸控制器902为一合成的部件。
在一个实施例中，触摸面板901设置有分立的电容性传感器、电阻性传感器、力传感器、光学传感器或类似传感器等。
触摸面板901内包括有由导电材料制成横向和纵向的电极阵列。对于一个M行和N列电极阵列的单点触摸屏(仅能确定单点触摸的坐标)，触摸控制器902采用自电容扫描，则分别扫描M行和N列后就可以根据每一行和每一列信号来进行计算，定位手指在触摸屏上的坐标。扫描次数为M+N次。
对于一个M行和N列电极阵列的多触点触摸屏(能检测并解析多点的坐标，即多点触控)，触摸控制器902采用多触点互电容扫描，对行和列的交叉点扫描，由此，扫描次数为M×N次。
当用户的手指触摸面板，触摸面板产生触摸信号(为电信号)发送给触摸控制器902。触摸控制器902通过扫描可以得到触摸点的坐标。在一个实施例中，触摸屏2010的触摸面板901在物理上是一套独立的坐标定位***，每次触摸的触摸点坐标上报到处理器903后，由处理器903转换为适应于显示屏904的像素坐标，以正确识别输入操作。
在本申请的描述中，需要理解的是，术语“第一”、“第二”等仅用于描述目的，而不能理解为指示或暗示相对重要性。此外，在本申请的描述中，除非另有说明，“多个”的含义是两个或两个以上。
应理解，本发明实施例的终端设备、移动终端和外部设备均可以以各种形式来实施。例如，本申请中描述的设备可以包括诸如手机、移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动设备以及诸如数字TV、台式计算机等等的固定设备。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、***、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理单元的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
上面结合附图对本申请实施例进行了描述，但是本申请并不局限于上述的实施方式，上述的实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，这些均属于本申请的保护之内。
工业实用性
本申请实施例提供一种移动终端投影方法、终端设备及***，克服当前Wi-Fi Display功能将整个投影端桌面投影到接收端，影响用户使用体验，而且，可很好体现出移动终端的人性化设计理念。

Claims (20)

  1. 一种移动终端投影方法，用于将媒体数据流投送给外部设备，所述外部设备包括显示屏或屏幕，所述移动终端投影方法包括以下步骤：
    移动终端建立与外部设备之间的通信连接；
    确定所述移动终端屏幕的投影区域；
    生成所述投影区域的媒体数据流，并传送给所述外部设备。
  2. 根据权利要求1所述的移动终端投影方法，其中，所述移动终端建立与外部设备之间的通信连接，包括以下步骤：
    移动终端发送无线网显示WFD连接请求；
    在所述移动终端处接收发现响应，其中，所述发现响应是外部设备响应于已接收到的发现请求而发送的；
    所述移动终端建立与所述外部设备之间的WFD连接。
  3. 根据权利要求2所述的移动终端投影方法，其中，所述确定移动终端屏幕的投影区域，包括：
    当WFD连接成功后，所述移动终端进行投影的同时显示一投影区域选择框，根据所述投影区域选择框的位置，确定投影区域。
  4. 根据权利要求3所述的移动终端投影方法，所述移动终端投影方法还包括：
    所述移动终端接收输入信号，其中，所述输入信号用于控制所述投影区域选择框显示或关闭，当所述投影区域选择框显示时对所述投影区域选择框内的内容投影，当所述投影区域选择框关闭时进行全屏投影。
  5. 根据权利要求4所述的移动终端投影方法，其中，
    当所述移动终端支持上下分屏时，则所述投影区域选择框以高度为参考值，进行显示；
    当所述移动终端支持左右分屏时，则所述投影区域选择框以宽度为参考值，进行显示；
    当所述移动终端支持自由分屏时，则所述投影区域选择框可以为屏幕的任意位置，进行显示。
  6. 根据权利要求3所述的移动终端投影方法，其中，所述生成所述投影区域的媒体数据流，包括：
    所述移动终端在预设周期内捕捉所述投影区域的图像信息，对每一帧图像以时间顺序打包从而形成音/视频流。
  7. 根据权利要求1所述的移动终端投影方法，其中，所述生成所述投影区域的媒体数据流，并传送给所述外部设备，包括：
    将所述移动终端确定投影区域的坐标点发送给所述外部设备；
    由所述外部设备将确定投影区域的横坐标转换为横坐标与第一预设值的比值，将确定投影区域的纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。
  8. 一种终端设备，包括：
    连接模块，设置为建立移动终端与外部设备之间的通信连接；
    确定模块，设置为确定所述移动终端屏幕的投影区域；
    传输模块，设置为生成所述投影区域的媒体数据流，并传送给所述外部设备。
  9. 根据权利要求8所述的终端设备，其中，所述连接模块设置为发送WFD连接请求；
    在所述移动终端处接收发现响应，其中，所述发现响应是外部设备响应于已接收到的发现请求而发送的；
    建立所述移动终端与外部设备之间的WFD连接。
  10. 根据权利要求9所述的终端设备，其中，所述确定模块设置为当WFD连接成功后，在所述移动终端进行投影的同时显示一投影区域选择框，根据所述投影区域选择框的位置，确定投影区域。
  11. 根据权利要求10所述的终端设备，其中，所述确定模块还设置为 接收输入信号，其中，所述输入信号用于控制所述投影区域选择框显示或关闭，当所述投影区域选择框显示时对所述投影区域选择框内的内容投影，当所述投影区域选择框关闭时进行全屏投影。
  12. 根据权利要求11所述的终端设备，其中，
    当所述移动终端支持上下分屏时，则所述投影区域选择框以高度为参考值，进行显示；
    当所述移动终端支持左右分屏时，则所述投影区域选择框以宽度为参考值，进行显示；
    当所述移动终端支持自由分屏时，则所述投影区域选择框可以为屏幕的任意位置，进行显示。
  13. 根据权利要求8所述的终端设备，其中，所述传输模块设置为通过以下方式生成所述投影区域的媒体数据流：
    在所述移动终端在预设周期内捕捉投影区域的图像信息，对每一帧图像以时间顺序打包从而形成音/视频流。
  14. 根据权利要求8所述的终端设备，其中，所述传输模块设置为将所述移动终端确定投影区域的坐标点发送给所述外部设备；
    由所述外部设备将确定投影区域的横坐标转换为横坐标与第一预设值的比值，将确定投影区域的纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。
  15. 一种投影***，包括移动终端和一个或多个外部设备，其中，
    所述移动终端，设置为建立与外部设备之间的通信连接，确定所述移动终端屏幕的投影区域，生成所述投影区域的媒体数据流，并传送给所述外部设备；
    所述一个或多个外部设备，设置为发送响应于已接收到的发现请求的发现响应，与所述移动终端建立连接后显示所述媒体数据流。
  16. 根据权利要求15所述的投影***，其中，所述外部设备还设置为将 移动终端确定投影区域的横坐标转换为横坐标与第一预设值的比值，将纵坐标转换为纵坐标与第二预设值的比值；其中，所述第一预设值为移动终端投影区域的宽度，所述第二预设值为移动终端投影区域的高度。
  17. 根据权利要求15所述的投影***，其中，所述移动终端还设置为接收输入信号，其中，所述输入信号用于控制所述投影区域选择框显示或关闭，当所述投影区域选择框显示时对所述投影区域选择框内的内容投影，当所述投影区域选择框关闭时进行全屏投影；
    其中，当所述移动终端支持上下分屏时，则所述投影区域选择框以高度为参考值，进行显示；
    当所述移动终端支持左右分屏时，则所述投影区域选择框以宽度为参考值，进行显示；
    当所述移动终端支持自由分屏时，则所述投影区域选择框可以为屏幕的任意位置，进行显示。
  18. 一种移动终端，包括：输入设备、处理器、无线通信单元以及显示屏；
    所述无线通信单元配置为建立移动终端与外部设备之间的通信连接；
    所述输入设备配置为接收输入信号，并传输给所述处理器；
    所述处理器配置为根据所述输入信号，确定显示屏的投影区域，生成所述投影区域的媒体数据流，并传送给所述外部设备。
  19. 根据权利要求18所述的移动终端，所述移动终端还包括：音频单元，配置为将所述处理器生成的所述投影区域的媒体数据流转换成音频信号并输出。
  20. 根据权利要求18所述的移动终端，其中，所述输入设备为触摸屏。
PCT/CN2016/112410 2016-01-27 2016-12-27 一种移动终端投影方法、终端设备及*** WO2017128913A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610054576.5A CN105739937B (zh) 2016-01-27 2016-01-27 一种移动终端投影方法、终端设备及***
CN201610054576.5 2016-01-27

Publications (1)

Publication Number Publication Date
WO2017128913A1 true WO2017128913A1 (zh) 2017-08-03

Family

ID=56246809

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/112410 WO2017128913A1 (zh) 2016-01-27 2016-12-27 一种移动终端投影方法、终端设备及***

Country Status (2)

Country Link
CN (1) CN105739937B (zh)
WO (1) WO2017128913A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112165520A (zh) * 2020-09-24 2021-01-01 Tcl海外电子（惠州）有限公司 投屏控制方法、投屏接收端及存储介质
CN114501119A (zh) * 2020-10-27 2022-05-13 Oppo广东移动通信有限公司 互动显示方法、装置、电子设备、***及存储介质
EP3982246A4 (en) * 2019-07-23 2022-08-17 Huawei Technologies Co., Ltd. DISPLAY METHOD AND ASSOCIATED APPARATUS

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105578227B (zh) * 2015-12-07 2019-08-16 努比亚技术有限公司 多屏投影控制方法、***及终端设备
CN105739937B (zh) * 2016-01-27 2020-03-17 努比亚技术有限公司 一种移动终端投影方法、终端设备及***
CN106293711B (zh) * 2016-07-29 2019-10-22 宇龙计算机通信科技(深圳)有限公司 一种推送消息的显示方法、装置及终端
CN106325798A (zh) * 2016-08-23 2017-01-11 努比亚技术有限公司 一种实现多屏内容显示的方法及装置
CN106453538A (zh) * 2016-09-29 2017-02-22 努比亚技术有限公司 屏幕共享装置和方法
CN106453542A (zh) * 2016-09-29 2017-02-22 努比亚技术有限公司 屏幕共享装置和方法
TWI604376B (zh) * 2016-10-17 2017-11-01 緯創資通股份有限公司 電子系統、電子裝置及其延伸螢幕設定方法、投影設備
CN106507185A (zh) * 2016-10-31 2017-03-15 努比亚技术有限公司 一种信息处理方法及投影终端
CN106455124B (zh) * 2016-10-31 2019-08-30 努比亚技术有限公司 信息处理方法及移动终端
CN106648263B (zh) * 2016-11-11 2022-01-04 珠海格力电器股份有限公司 终端设备及其操控***、操控方法和装置
CN106648505A (zh) * 2016-11-29 2017-05-10 努比亚技术有限公司 一种移动终端操控方法及移动终端
CN107390972B (zh) * 2017-07-06 2021-09-07 努比亚技术有限公司 一种终端录屏方法、装置及计算机可读存储介质
CN107391064A (zh) * 2017-07-07 2017-11-24 上海青橙实业有限公司 投影内容分屏显示的方法、装置和终端
CN108124172B (zh) * 2017-12-08 2021-01-22 北京奇艺世纪科技有限公司 云投影的方法、装置及***
CN108958684A (zh) * 2018-06-22 2018-12-07 维沃移动通信有限公司 投屏方法及移动终端
CN111752508A (zh) * 2019-03-29 2020-10-09 上海擎感智能科技有限公司 移动终端及其投影多个车载屏幕的方法和车载投影***
CN112367422B (zh) * 2020-10-30 2022-07-01 北京数秦科技有限公司 移动终端设备与显示***的互动方法、装置及存储介质
CN112295221B (zh) * 2020-11-12 2023-03-24 腾讯科技（深圳）有限公司 人机交互的处理方法、装置及电子设备
CN112860208A (zh) * 2021-04-25 2021-05-28 深圳乐播科技有限公司 基于投屏的软件共享方法、装置、设备及存储介质
US20220350366A1 (en) 2021-05-03 2022-11-03 Asustek Computer Inc. All-in-one computer

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103312804A (zh) * 2013-06-17 2013-09-18 华为技术有限公司 屏幕分享方法和相关设备及通信***
US20140089847A1 (en) * 2012-09-21 2014-03-27 Samsung Electronics Co. Ltd. Method of displaying data in display device using mobile communication terminal, the display device, and the mobile communication terminal
CN104427381A (zh) * 2013-08-27 2015-03-18 中兴通讯股份有限公司 播放方法及装置
CN105068774A (zh) * 2015-07-24 2015-11-18 福州瑞芯微电子股份有限公司 一种基于wfd的影像分享方法和***
CN105224270A (zh) * 2014-06-30 2016-01-06 纬创资通股份有限公司 分享显示画面的方法及装置
CN105739937A (zh) * 2016-01-27 2016-07-06 努比亚技术有限公司 一种移动终端投影方法、终端设备及***

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB201001728D0 (en) * 2010-02-03 2010-03-24 Skype Ltd Screen sharing
KR101335247B1 (ko) * 2012-02-21 2013-11-29 주식회사 팬택 원격의 싱크 장치를 표시하는 방법, 이를 위한 소스 장치 및 시스템
CN104090735B (zh) * 2014-06-30 2017-12-12 小米科技有限责任公司 一种图片的投影方法及装置
CN104836915A (zh) * 2015-05-19 2015-08-12 努比亚技术有限公司 屏幕投影显示的处理方法、装置及移动终端

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140089847A1 (en) * 2012-09-21 2014-03-27 Samsung Electronics Co. Ltd. Method of displaying data in display device using mobile communication terminal, the display device, and the mobile communication terminal
CN103312804A (zh) * 2013-06-17 2013-09-18 华为技术有限公司 屏幕分享方法和相关设备及通信***
CN104427381A (zh) * 2013-08-27 2015-03-18 中兴通讯股份有限公司 播放方法及装置
CN105224270A (zh) * 2014-06-30 2016-01-06 纬创资通股份有限公司 分享显示画面的方法及装置
CN105068774A (zh) * 2015-07-24 2015-11-18 福州瑞芯微电子股份有限公司 一种基于wfd的影像分享方法和***
CN105739937A (zh) * 2016-01-27 2016-07-06 努比亚技术有限公司 一种移动终端投影方法、终端设备及***

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3982246A4 (en) * 2019-07-23 2022-08-17 Huawei Technologies Co., Ltd. DISPLAY METHOD AND ASSOCIATED APPARATUS
US12039144B2 (en) 2019-07-23 2024-07-16 Huawei Technologies Co., Ltd. Display information interaction method and related apparatus
CN112165520A (zh) * 2020-09-24 2021-01-01 Tcl海外电子（惠州）有限公司 投屏控制方法、投屏接收端及存储介质
CN112165520B (zh) * 2020-09-24 2022-06-07 茂佳科技(广东)有限公司 投屏控制方法、投屏接收端及存储介质
CN114501119A (zh) * 2020-10-27 2022-05-13 Oppo广东移动通信有限公司 互动显示方法、装置、电子设备、***及存储介质
CN114501119B (zh) * 2020-10-27 2023-04-07 Oppo广东移动通信有限公司 互动显示方法、装置、电子设备、***及存储介质

Also Published As

Publication number Publication date
CN105739937B (zh) 2020-03-17
CN105739937A (zh) 2016-07-06

Similar Documents

Publication Publication Date Title
WO2017128913A1 (zh) 一种移动终端投影方法、终端设备及***
WO2017097088A1 (zh) 多屏投影控制方法、***、终端设备及计算机存储介质
US20200159486A1 (en) Control method and control apparatus for apparatus including short range wireless communication module
US9913301B2 (en) Content sharing method and device
EP2858322B1 (en) Method and terminal for sharing media stream
TWI489371B (zh) 用以執行無線顯示控制之方法與裝置
US9317247B2 (en) Screen sharing system, screen sharing method, and storage medium
US10021180B2 (en) Universal environment extender
JP6096998B2 (ja) インスタントメッセージング方法、装置、プログラム及び記録媒体
US9473233B2 (en) Method and apparatus for transmitting data using relay device
WO2021098738A1 (zh) 控制电视横竖屏操作的方法、装置和存储介质
US20120069132A1 (en) Transmission terminal and method of transmitting display data
CN113556588B (zh) 反向控制方法、装置、计算机设备和存储介质
US20240053944A1 (en) Display apparatus and method for controlling screen projections from multiple devices to same screen
JP2017531974A (ja) ネットワーク接続方法、機器、システム、プログラム及び記録媒体
CN105704110B (zh) 一种媒体传输方法、媒体控制方法及装置
CN113194197A (zh) 交互方法、终端及存储介质
WO2015080589A1 (en) Method and device for processing content for display
TWI502486B (zh) 投影機、影像輸出裝置及其控制方法
CN112770078B (zh) 一种视频会议终端融合方法、装置及可读存储介质
TW201427463A (zh) 多媒體串流的播放系統與方法
CN108012167B (zh) 投影服务、请求方法及装置
JP6391219B2 (ja) システム
US8914831B2 (en) Communication controller and communication control method
WO2024001535A1 (zh) 一种显示设备、播放设备、控制设备和数据传输方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16887784

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16887784

Country of ref document: EP

Kind code of ref document: A1