WO2014169581A1 - 远程无线屏幕共享方法、装置及*** - Google Patents

远程无线屏幕共享方法、装置及*** Download PDF

Info

Publication number
WO2014169581A1
WO2014169581A1 PCT/CN2013/084515 CN2013084515W WO2014169581A1 WO 2014169581 A1 WO2014169581 A1 WO 2014169581A1 CN 2013084515 W CN2013084515 W CN 2013084515W WO 2014169581 A1 WO2014169581 A1 WO 2014169581A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
display device
capability
remote
remote device
Prior art date
Application number
PCT/CN2013/084515
Other languages
English (en)
French (fr)
Inventor
梁洁辉
赵发杰
周煜申
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to US14/907,116 priority Critical patent/US9696866B2/en
Priority to JP2016537077A priority patent/JP6208361B2/ja
Priority to EP13882436.2A priority patent/EP3041183B1/en
Publication of WO2014169581A1 publication Critical patent/WO2014169581A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/2866—Architectures; Arrangements
    • H04L67/30—Profiles
    • H04L67/303—Terminal profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827—Network arrangements for conference optimisation or adaptation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1083—In-session procedures
    • H04L65/1086—In-session procedures session scope modification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/04—Protocols specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/148—Migration or transfer of sessions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/24—Negotiation of communication capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W8/00—Network data management
    • H04W8/22—Processing or transfer of terminal data, e.g. status or physical capabilities
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2350/00—Solving problems of bandwidth in display systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
    • G09G2370/042—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/16—Use of wireless transmission of display information

Definitions

  • the present invention relates to the field of communications, and in particular to a remote wireless screen sharing method, apparatus, and system.
  • BACKGROUND OF THE INVENTION In September 2012, the WIFI Alliance began to conduct wireless screen sharing (Miracast) certification based on the WIFI display standard. Miracast-compatible devices can seamlessly share screen content without being limited to applications and media content formats on the device.
  • Miracast technology uses WIFI direct connection and requires two types of devices: a source device and a sink device, which limits Miracast's ability to allow wireless screen sharing between two devices, and the two devices The distance between them must be within 100 meters, because the coverage of the WIFI direct connection is about 100 meters.
  • Miracast supports display resolutions from 640x360 to 1920x1080, frame rates from 30 frames/second to 60 frames/second, and the video uses the International Telecommunication Union-Telecommunication standardization sector (ITU-T).
  • ITU-T International Telecommunication Union-Telecommunication standardization sector
  • Two configurations of H264 encoding Constrained Baseline Profile (CBP) and Constrained High Profile (CHP), ranging from 3.1 to 4.2, audio forced support for dual 16-bit 48kHZ sampling Linear Pulse-code Modulation (LPCM) coding, optionally supporting Advanced Audio coding (AAC) and Audio coding-3 (AC3 coding).
  • Extensible Messaging and Presence Protocol is an open communication protocol based on XML protocol. It is mainly used for instant messaging, presence notification, contact list management, event publishing.
  • Embodiments of the present invention provide a remote wireless screen sharing method, apparatus, and system to solve at least the above problems.
  • a remote wireless screen sharing method including: establishing a wireless screen sharing session with a display device, acquiring capability information of the display device; establishing a connection with the remote device, acquiring the remote device Capability information and network information of the remote device; determining display capabilities of the display device and the remote device according to capability information of the display device, capability information of the remote device, and network information of the remote device Intersecting; receiving screen content of the display device through the Miracast session, and sharing screen content of the display device to the remote device according to the display capability intersection.
  • receiving the screen content of the display device by the wireless screen sharing session, and sharing the screen content of the display device to the remote device according to the display capability intersection comprises: receiving the display device by using the The screen content of the display device sent by the Miracast session; processing the screen content of the display device according to the display capability intersection, and transmitting the processed screen content of the display device to the remote device.
  • the capability information of the display device or the capability information or the display capability intersection of the remote device includes at least one of the following: video information, an audio encoding format, where the video information includes a video encoding format and/or Maximum resolution.
  • the network information includes at least one of the following: a network connection type, a bandwidth, where the network connection type includes a peer-to-peer connection P2P mode, and a network address translation NAT session traversal application (Session Traversal Utilities for NAT, STUN) Traversal using Relay NAT (TURN) TURN mode.
  • a network connection type includes a peer-to-peer connection P2P mode
  • a network address translation NAT session traversal application Session Traversal Utilities for NAT, STUN
  • TURN Traversal using Relay NAT
  • determining, according to the capability information of the display device, the capability information of the remote device, and the network information of the remote device, the display capability intersection of the display device and the remote device includes at least one of the following: In the case where the network connection type is the P2P mode, an audio format whose compression ratio is greater than the first compression ratio threshold is selected as the audio of the display capability intersection according to the capability information of the display device and the capability information of the remote device.
  • An encoding format, a resolution greater than the first resolution threshold is selected as the resolution of the display capability intersection; in a case where the network connection type is the STUN mode, according to the capability information of the display device and the remote The capability information of the device selects an audio format whose compression ratio is smaller than the first compression ratio threshold than the second compression ratio threshold as an audio coding format of the display capability intersection, and selects less than the first resolution threshold and is greater than the second Resolution of the resolution threshold as the resolution of the display capability intersection; in the network A case where the connection type is a TURN mode, according to the display capability information of the device and the remote device The capability information of the backup selects an audio format whose compression ratio is smaller than the second compression ratio threshold as an audio coding format of the display capability intersection, and selects a resolution smaller than the second resolution threshold as the intersection of the display capabilities Resolution.
  • determining, according to the capability information of the display device, the capability information of the remote device, and the network information of the remote device, the display capability intersection of the display device and the remote device further includes at least one of the following: When the bandwidth is greater than the first bandwidth threshold, selecting CHP as the video coding format of the display capability intersection; if the bandwidth is less than the first bandwidth threshold, selecting CBP as the intersection of the display capabilities Video encoding format.
  • determining, according to the capability information of the display device, the capability information of the remote device, and the network information of the remote device, the display capability intersection of the display device and the remote device comprises: at the display device If the capability information and the capability information of the remote device do not intersect, acquiring an intersection of the display capability of the display device and the display device, and interfacing the capability of the self with the display device as the display device and the remote device
  • the display capabilities of the devices intersect.
  • establishing a connection with the remote device by using the XMPP protocol includes: accessing an XMPP server by using a first access point, where the first access point accesses the XMPP server by using the XMPP protocol; The XMPP server establishes a connection with the remote device.
  • the wireless screen sharing session is a Miracast session.
  • a remote wireless screen sharing apparatus including: an acquiring module, configured to establish a wireless screen sharing session with a display device, acquire capability information of the display device, and establish with the remote device Connecting, obtaining capability information of the remote device and network information of the remote device; and determining, configured to determine, according to capability information of the display device, capability information of the remote device, and network information of the remote device The display device and the display capability of the remote device intersect; the sharing module is configured to receive the screen content of the display device through the wireless screen sharing session, and divide the screen content of the display device according to the display capability intersection Shared to the remote device.
  • the sharing module is further configured to receive screen content of the display device sent by the display device through the wireless screen sharing session, process screen content of the display device according to the display capability intersection, and process the The screen content of the latter display device is transmitted to the remote device.
  • a remote wireless screen sharing system comprising: the transmitting device of the remote wireless screen sharing device according to the above item 9 or 10; the display device is configured to pass the wireless device a screen sharing session sends capability information of the display device and a screen of the display device to the sending device a remote device, configured to send capability information of the remote device to the sending device, and receive screen content of the display device after the transmitting device is processed according to the display capability.
  • the method is: establishing a wireless screen sharing session with the display device, acquiring capability information of the display device, establishing a connection with the remote device, acquiring capability information of the remote device, and network information of the remote device;
  • the capability information, the capability information of the remote device, and the network information of the remote device determine the display capability of the display device and the remote device, and solve the problem that the device compatibility is poor when the remote wireless screen is shared, thereby achieving The effect of improving device compatibility when sharing remote wireless screens.
  • FIG. 1 is a flowchart of a remote wireless screen sharing method according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a remote wireless screen sharing apparatus according to an embodiment of the present invention
  • 4 is a flow diagram of a remote wireless screen sharing method in accordance with a preferred embodiment of the present invention
  • FIG. 1 is a flowchart of a remote wireless screen sharing method according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a remote wireless screen sharing apparatus according to an embodiment of the present invention
  • 4 is a flow diagram of a remote wireless screen sharing method in accordance with a preferred embodiment of the present invention
  • FIG. 1 is a flowchart of a remote wireless screen sharing method according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps: Step S102, and display The device establishes a wireless screen sharing session, and acquires capability information of the display device.
  • Step S104 Establish a connection with the remote device, acquire capability information of the remote device, and network information of the remote device.
  • Step S106 determining, according to the capability information of the display device, the capability information of the remote device, and the network information of the remote device, the display capability intersection of the display device and the remote device;
  • Step S108 by using the wireless device
  • the screen sharing session receives screen content of the display device and shares screen content of the display device to the remote device according to the display capability intersection.
  • the manner in which the screen content of the display device is received through the wireless screen sharing session, and the screen content of the display device is shared to the remote device according to the display capability intersection may be various. For example, after the display capability intersection is determined, the display capability intersection is sent to the display device and the remote device, and after receiving the screen content of the display device, the screen content is directly forwarded to the remote device, and the remote device intersects according to the final display capability. Process the received screen content and display it.
  • the remote wireless screen sharing may also be implemented by: receiving the screen content of the display device sent by the display device through the wireless screen sharing session, and according to the display capability intersection processing The screen content of the display device is displayed, and then the processed screen content of the display device is transmitted to the remote device.
  • the capability information of the display device or the capability information of the remote device or the display capability intersection may include at least one of the following: video information, an audio encoding format, where the video information may include a video encoding format and/or Or maximum resolution.
  • the display capability intersection may include other information, such as transmission mode information, in addition to the above information.
  • the transmission mode information refers to what protocol is used for transmission, for example, using the RTP protocol for transmission.
  • the network information includes at least one of the following: a network connection type, a bandwidth, where the network connection type includes a peer-to-peer connection P2P mode, and the user datagram of the network address translation is simply traversed by the STUN mode or the TURN mode.
  • the network information is not limited thereto.
  • the network information may further include information such as a transmission rate.
  • the type of network connection may also include other connection methods. Among them, there are many ways to determine the intersection of display capabilities.
  • the method may be as follows: determining, according to capability information of the display device, capability information of the remote device, and network information of the remote device, an intersection of display capabilities of the display device and the remote device, including the following At least one of: in a case where the network connection type is the P2P mode, selecting an audio format whose compression ratio is greater than a first compression ratio threshold according to capability information of the display device and capability information of the remote device as the Audio showing the intersection of capabilities An encoding format, a resolution greater than the first resolution threshold is selected as the resolution of the display capability intersection; in a case where the network connection type is the STUN mode, according to the capability information of the display device and the remote The capability information of the device selects an audio format whose compression ratio is smaller than the first compression ratio threshold than the second compression ratio threshold as an audio coding format of the display capability intersection, and selects less than the first resolution threshold and is greater than the second a resolution of the resolution threshold as a resolution of the display capability intersection; in a case where the network connection type is the TUR
  • the method further includes: selecting, in the case that the bandwidth is greater than the first bandwidth threshold, a CHP as a video coding format of the display capability intersection; and if the bandwidth is less than the first bandwidth threshold, selecting a CBP As the video coding format of the display capability intersection.
  • Determining, according to the capability information of the display device, the capability information of the remote device, and the network information of the remote device, the display capability intersection of the display device and the remote device may include: at the display device If the capability information and the capability information of the remote device do not intersect, acquiring an intersection of the display capability of the display device and the display device, and interfacing the capability of the self with the display device as the display device and the remote device The display capabilities of the devices intersect.
  • the establishing a connection with the remote device by using the XMPP protocol may include: accessing an XMPP server by using a first access point, where the first access point accesses the XMPP server by using the XMPP protocol;
  • the XMPP server establishes a connection with the remote device.
  • the wireless screen sharing session is a Miracast session.
  • the embodiment of the present invention further provides a remote wireless screen sharing device.
  • FIG. 2 is a schematic structural diagram of a remote wireless screen sharing device according to an embodiment of the present invention. As shown in FIG.
  • the device includes an acquiring module 202, which is set to Establishing a wireless screen sharing session with the display device, acquiring capability information of the display device, and establishing a connection with the remote device, acquiring capability information of the remote device and network information of the remote device; determining module 204, configured to The capability information of the display device, the capability information of the remote device, and the network information of the remote device determine an intersection of display capabilities of the display device and the remote device;
  • the sharing module 206 is configured to receive screen content of the display device through the wireless screen sharing session, and share screen content of the display device to the remote device according to the display capability intersection.
  • the sharing module 206 is further configured to receive screen content of the display device sent by the display device through the wireless screen sharing session, process the screen content of the display device according to the display capability intersection, and The processed screen content of the display device is transmitted to the remote device.
  • the embodiment of the present invention further provides a remote wireless screen sharing system.
  • FIG. 3 is a schematic structural diagram of a remote screen sharing system according to an embodiment of the present invention. As shown in FIG. 3, the apparatus includes a transmitting device 302, including the implementation. The remote wireless screen sharing device provided by the example.
  • FIG. 4 is a flowchart of a remote wireless screen sharing method according to a preferred embodiment of the present invention. As shown in FIG. 4, the method includes the following steps: Step S402: Establish a WIFI direct connection. The sending device establishes a WIFI direct connection with the display device. In the related art, Miracast specifies that the transmitting device and the display device must support WIFI direct connection. In step S404, the Miracast device is found.
  • the sending device searches for a compatible Miracast device through the Link Layer Service Discovery (L2SD) protocol.
  • the display device is assumed to be a compatible Miracast device.
  • Step S406 establishing a Miracast session.
  • the sending device and the display device use Miracast's Real Time Stream Protocol (RTSP) to establish a Miracast session, ready to start wireless screen sharing.
  • Step S408, the sending device logs in to the XMPP server.
  • the sending device can register an account on the XMPP server before performing remote wireless screen sharing, and then use the registered account to log in to the XMPP server. There are many ways for the sending device to log in to the XMPP server.
  • Step S410 the remote device logs in to the XMPP server.
  • the remote device can log in to the XMPP server with the same account as the sending device.
  • the reason why the remote device uses the same account as the sending device is because the XMPP server can immediately notify the remote device and the transmitting device to present information according to the same account. That is to say, after the remote device completes the login by using the same account as the sending device, the sending device can know that the remote device is online through the presence notification of the server.
  • the remote device and the sending device can also log in with different accounts, as long as the account of the remote device and the sending device are associated with the XMPP server in advance.
  • the display device sends the capability information of the display device.
  • the display device carries the capability information of the display device in the Session Description Protocol (SDP) through the RTSP advertisement message.
  • the capability information of the display device includes video information and/or an audio encoding format.
  • the video information includes a video encoding format supported by the display device, and the maximum resolution information supported by the display device.
  • the capability information of the display device may also include a transmission mode such as a Real-time Transmission Protocol (RTP) identifier.
  • RTP Real-time Transmission Protocol
  • the RTP identifier indicates that the transmission mode is real-time transmission, that is, the RTP protocol is used for transmission.
  • Step S414 a session initiation message.
  • the sending device sends a session initiation message to the XMPP server requesting to share the screen with the remote device.
  • the sending device carries the capability information of the display device in the session initiation message, in order to find the best display capability intersection of the display device and the remote device that matches the display device, where the capability of the display device is
  • the information may include an audio encoding format, a video encoding format, and an RTP identifier.
  • Step S416 forwarding the session initiation message.
  • the XMPP server After receiving the session initiation message sent by the sending device, the XMPP server acknowledges the session initiation message and forwards it to the remote device. Step S418, the remote device sends a session accept message. After receiving the session initiation message from the XMPP server, the remote device parses the capability information of the display device from the session initiation message. The remote device compares the capability information of the display device with the capability information of the remote device to determine whether there is an intersection between the two. Then, a session accept message is sent to the XMPP, the session accept message contains the capability information of the remote device, and whether there is an identity of the intersection. Step S420, forwarding the session accept message.
  • the server receives the session accept message of the remote device, confirms the session accept message, and then forwards the session accept message to the sending device.
  • Step S422 obtaining network information.
  • the sending device starts detecting the network connection with the remote device and obtains the network information of the remote device. For example, the sending device sends a probe packet to the TURN server to detect a network connection between the sending device and the remote device.
  • the network information may include a network connection type and/or a bandwidth, and is used to finally determine an intersection of display capabilities of the sending device and the remote device, that is, based on the capability information of the display device and the capability information of the remote device, according to the network connection type. And/or bandwidth ultimately determines which resolution video format and audio format to use.
  • Step S424 the remote device performs network detection.
  • the remote device sends a probe packet to the sending device through the TURN server for the above three network connection types. If the response is received, the remote device considers that the network between the remote device and the sending device is connected under the current network connection type, thereby confirming the network connection type. At the same time, remote devices can also perform upstream and downstream bandwidth estimation.
  • the remote device notifies the XMPP server of the network information of the remote device through the XMPP message.
  • the XMPP server After receiving the network information of the remote device, the XMPP server confirms the message carrying the network information of the remote device and forwards the message to the sending device. Step S430, determining an intersection of display capabilities.
  • the sending device After receiving the message that the server forwards the network information of the remote device, the sending device parses the network information of the remote device from the message. The network information is compared with the network information acquired in step S422 to determine the network information of the final remote device. At this point, the sending device acquires the capability information of the display device, the remote device Capability information, as well as network information for remote devices. Based on the information obtained above, an intersection of display capabilities of the display device and the remote device can be determined.
  • the capability information of the sending device itself may be obtained on the basis of obtaining the foregoing information, thereby determining the intersection of display capabilities of the three devices of the display device, the sending device, and the remote device.
  • the network connection type is the P2P mode
  • an audio format with a compression ratio greater than a first compression ratio threshold is selected as the intersection of the display capabilities according to the capability information of the display device and the capability information of the remote device.
  • the audio encoding format, the resolution greater than the first resolution threshold is selected as the resolution of the display capability intersection; in the case that the network connection type is the STUN mode, according to the capability information of the display device and the The capability information of the remote device selects an audio format whose compression ratio is smaller than the first compression ratio threshold and greater than the second compression ratio threshold as an audio coding format of the display capability intersection, and selects less than the first resolution threshold and is greater than the first a resolution of the two resolution thresholds as a resolution of the display capability intersection; in a case where the network connection type is the TURN mode, selecting the location information according to the capability information of the display device and the capability information of the remote device An audio format having a compression ratio smaller than the second compression ratio threshold as an audio of the display capability intersection Code format, resolution is less than said second selected threshold value as the resolution capability of the display resolution of the intersection.
  • the audio encoding format can be selected as the LPCM format; if the network connection type is STUN mode, the medium resolution can be transmitted.
  • Video, the audio encoding format can be AAC format; if the network connection type is TURN mode, the lower resolution video can be transmitted, and the audio encoding mode can be AC3 format; if the capability information of the sending device and the remote device does not intersect or does not match
  • the connection pre-condition between the transmitting device and the remote device may be the intersection of the display capability between the transmitting device and the display device as the intersection of the display capabilities of the remote device and the transmitting device.
  • Step S432 notifying the display device of the display capability intersection determined by the display device.
  • the sending device notifies the display device of the last determined display capability intersection through the RTSP advertisement message, that is, the device capability intersection of the sending device, the remote device, or the device capability intersection of the sending device, the display device, and the remote device.
  • Step S434 notifying the XMPP server of the display capability intersection determined by the XMPP server.
  • the sending device notifies the XMPP server of the display capability intersection determined by the XMPP message, that is, the device capability intersection of the sending device, the remote device, or the device capability of the sending device, the display device, and the remote device.
  • Step S436 forwarding the determined display capability intersection.
  • the server acknowledges the XMPP message carrying the intersection of the display capabilities and forwards the message to the remote device.
  • the RTP transmission starts between the sending device and the display device, that is, the Miracast session is successfully established, and the Miracast screen sharing is started between the transmitting device and the display device.
  • the transmitting device processes the screen content received from the display device according to the determined display capability intersection, and transmits the screen content of the processed display device to the remote device based on the RTP protocol. Specifically, after receiving the screen content sent by the display device, the sending device performs transcoding processing on the received screen content according to the video format and/or audio format of the display capability intersection, and transcodes the screen content.
  • the sending device is ready to end the wireless screen sharing, the Miracast session is terminated by the RTSP control protocol, and the RTP transmission between the sending device and the display device is stopped; the sending device simultaneously sends a session termination message to the server through the XMPP protocol, and the server confirms the session termination message. And forwarded to the remote device to end remote wireless screen sharing.
  • FIG. 5 is a network topology diagram of a remote wireless screen sharing system according to a preferred embodiment of the present invention.
  • the system includes a display device 502, a transmitting device 504, a remote device 506, and an access point A. , access point B, XMPP server 508, TURN server 510.
  • the transmitting device 504 and the display device 502 have WIFI direct connection capability and can perform Miracast screen sharing.
  • the transmitting device 504 accesses the XMPP server 508 through the access point A, and the remote device 506 communicates with the XMPP server 508 through the access point B.
  • the capability information of the display device and the capability information of the remote device are acquired.
  • the capability information of the display device and/or the capability information of the remote device include at least one of the following: video information, audio format information.
  • the video information includes a resolution and/or a video encoding format.
  • the sending device 504 and the display device 502 discover each other through the L2SD protocol, and the sending device 504 and the remote device 506 can use the presence information to discover each other by using the same account to log in on different devices.
  • the remote device 506 can be in the same local area network as the display device 502, or can be located in a network with IP address and port restrictions.
  • the system further includes a TURN server 510 to assist in detecting the sending device 504 and the remote device 506.
  • Network connection type There are three types of network connections between the sending device 504 and the remote device 506: P2P mode, STUN mode, and TURN mode.
  • P2P mode the sending device 504 and the remote device 506 can directly transmit, they are in the local area network of the same network segment; in the STUN mode, the sending device 504 and the remote device 506 are located in different local area network local area networks, There is no firewall to limit the IP address and port; in the TURN mode, the sending device 504 and the remote device 506 are each in an IP address and port restricted type network, and need to pass through the TURN server 510 for transmission.
  • the sending device 504 determines the final display capability intersection, such as the last selected resolution, video encoding, in combination with the type of network connection between the transmitting device 504 and the remote device 506.
  • Format and audio and video encoding format are included in the video resolution supported by Miracast.
  • the video resolution supported by Miracast ranges from 640x360 to 1920x1080.
  • the audio encoding format and the video encoding format also have multiple formats, which are related to the Wi-Fi direct connection network connection, so the transmitting device 504 is established between the remote device 506 and the remote device 506.
  • the transmitting device 504 When the remote wireless screen is shared, it is necessary to detect the type and/or bandwidth of the network connection between them, and finally, based on the capability information of the transmitting device and the capability information of the remote device, the transmitting device 504 is determined according to the network connection type and/or bandwidth. Intersecting with the display capabilities of the remote device 506, the display capability intersection includes video information and an audio encoding format, wherein the video information includes a resolution and/or a video encoding format. The transmitting device 504 notifies the display device 502 and the remote device 506 through respective session negotiation protocols, thereby implementing remote wireless screen sharing. From the above description, it can be seen that the embodiment of the present invention achieves the following technical effects: The compatibility of the device when sharing the remote wireless screen is improved.
  • modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明提供了一种远程屏幕共享方法、装置及***，该方法包括：与显示设备建立屏幕共享会话，获取上述显示设备的能力信息；与远程设备建立连接，获取上述远程设备的能力信息以及上述远程设备的网络信息；根据上述显示设备的能力信息、上述远程设备的能力信息，以及上述远程设备的网络信息确定上述显示设备和上述远程设备的显示能力交集；通过上述屏幕共享会话接收上述显示设备的屏幕内容，并根据上述显示能力交集将上述显示设备的屏幕内容共享给上述远程设备。本发明解决了远程屏幕共享时存在的设备兼容性不好的问题，具有提高远程屏幕共享时设备的兼容性的效果。

Description

远程无线屏幕共享方法、 装置及***
技术领域 本发明涉及通信领域， 具体而言， 涉及一种远程无线屏幕共享方法、装置及***。 背景技术 2012年 9月， WIFI联盟在 WIFI显示标准的基础上开始进行无线屏幕共享 (Miracast) 认证。 兼容 Miracast的设备可以无缝地共享屏幕内容， 而不受限于设备上的应用程序 和媒体内容格式。
Miracast技术采用 WIFI 直连， 需要有两种设备类型： 发送（Source)设备和显示 (Sink)设备，这限制了 Miracast只能允许在两个设备之间进行无线屏幕共享， 并且这两 个设备之间的距离必须在百米之内， 因为 WIFI直连的覆盖范围为大约 100米。
Miracast支持的显示分辨率从 640x360到 1920x1080，帧率从 30帧 /秒到 60帧 /秒， 视频采用国际电联-通信标准部限制型基线配置 （ International Telecommunication Union-Telecommunication standardization sector, ITU-T) H264编码的两种配置： 限制 型高级配置 （Constrained Baseline Profile, 简称为 CBP) 禾 B (Constrained High Profile, 简称为 CHP)， 级别范围从 3.1至 4.2， 音频强制支持双声道 16位 48kHZ采样的线性 脉冲编码调制 （Linear pulse-code Modulation, 简称为 LPCM) 编码， 可选支持高级音 频编码 （Advanced Audio coding, 简称为 AAC)和音频编码 3 (Audio coding-3,简称为 AC3编码）。 可扩展的消息和呈现协议 (Extensible Messaging and Presence Protocol, 简称为 XMPP)是一种以 XML协议为基础的开放式通信协议， 主要用于即时消息通信、 呈现 信息通知、 联系人列表管理， 事件发布和订阅、 实时语音通信、 实时视频通信和文件 传输。 XMPP结合 ICE机制可以进行有效的网络检测，在地址和端口非受限的网络下， 进行 P2P传输。 相关技术中， 由于设备的兼容性存在问题， 远程无线屏幕共享时通常采用基于截 屏的图片压缩方式来实现， 无法提供类似 Miracast的流式无线屏幕共享功能。 针对相关技术中远程无线屏幕共享时存在的设备兼容性不好的问题， 目前尚未提 出有效的解决方案。 发明内容 本发明实施例提供了一种远程无线屏幕共享方法、 装置及***， 以至少解决上述 问题。 根据本发明实施例的一个方面， 提供了一种远程无线屏幕共享方法， 包括： 与显 示设备建立无线屏幕共享会话， 获取所述显示设备的能力信息； 与远程设备建立连接， 获取所述远程设备的能力信息以及所述远程设备的网络信息； 根据所述显示设备的能 力信息、 所述远程设备的能力信息， 以及所述远程设备的网络信息确定所述显示设备 和所述远程设备的显示能力交集； 通过所述 Miracast会话接收所述显示设备的屏幕内 容， 并根据所述显示能力交集将所述显示设备的屏幕内容共享给所述远程设备。 优选地， 通过所述无线屏幕共享会话接收所述显示设备的屏幕内容， 并根据所述 显示能力交集将所述显示设备的屏幕内容共享给所述远程设备包括： 接收所述显示设 备通过所述 Miracast会话发送的所述显示设备的屏幕内容； 根据所述显示能力交集处 理所述显示设备的屏幕内容， 并将处理后的所述显示设备的屏幕内容传送给所述远程 设备。 优选地， 所述显示设备的能力信息或所述远程设备的能力信息或所述显示能力交 集包括以下至少之一： 视频信息， 音频编码格式， 其中， 所述视频信息包括视频编码 格式和 /或最大分辨率。 优选地， 所述网络信息包括以下至少之一： 网络连接类型， 带宽， 其中， 所述网 络连接类型包括对等连接 P2P 方式， 网络地址转换的 NAT 的会话穿越应用程序 (Session Traversal Utilities for NAT, STUN) 方式或 NAT的使用中继穿越 （Traversal using Relay NAT, TURN) TURN方式。 优选地， 根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及与所述 远程设备的网络信息确定所述显示设备和所述远程设备的显示能力交集包括以下至少 之一： 在所述网络连接类型是所述 P2P方式的情况下， 根据所述显示设备的能力信息 和所述远程设备的能力信息选择压缩比大于第一压缩比阈值的音频格式作为所述显示 能力交集的音频编码格式， 选择大于第一分辨率阈值的分辨率作为所述显示能力交集 的分辨率； 在所述网络连接类型是所述 STUN方式的情况下， 根据所述显示设备的能 力信息和所述远程设备的能力信息选择所述压缩比小于所述第一压缩比阈值大于第二 压缩比阈值的音频格式作为所述显示能力交集的音频编码格式， 选择小于所述第一分 辨率阈值且大于第二分辨率阈值的分辨率作为所述显示能力交集的分辨率； 在所述网 络连接类型是所述 TURN方式的情况下， 根据所述显示设备的能力信息和所述远程设 备的能力信息选择所述压缩比小于所述第二压缩比阈值的音频格式作为所述显示能力 交集的音频编码格式， 选择小于所述第二分辨率阈值的分辨率作为所述显示能力交集 的分辨率。 优选地， 根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及与所述 远程设备的网络信息确定所述显示设备和所述远程设备的显示能力交集还包括以下至 少之一： 在所述带宽大于第一带宽阈值的情况下， 选择 CHP作为所述显示能力交集的 视频编码格式； 在所述带宽小于所述第一带宽阈值的情况下， 选择 CBP作为所述显示 能力交集的视频编码格式。 优选地， 根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及所述远 程设备的网络信息确定所述显示设备和所述远程设备的显示能力交集包括： 在所述显 示设备的能力信息和所述远程设备的能力信息没有交集的情况下， 获取自身与所述显 示设备的显示能力交集， 并将所述自身与所述显示设备的能力交集作为所述显示设备 和所述远程设备的显示能力交集。 优选地， 通过所述 XMPP协议与所述远程设备建立连接包括： 通过第一接入点接 入 XMPP服务器， 其中， 所述第一接入点通过所述 XMPP协议接入所述 XMPP服务 器； 通过所述 XMPP服务器与所述远程设备建立连接。 优选地， 所述无线屏幕共享会话是 Miracast会话。 根据本发明实施例的另一方面， 提供了一种远程无线屏幕共享装置， 包括： 获取 模块， 设置为与显示设备建立无线屏幕共享会话， 获取所述显示设备的能力信息， 并 与远程设备建立连接， 获取所述远程设备的能力信息以及所述远程设备的网络信息； 确定模块， 设置为根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及所 述远程设备的网络信息确定所述显示设备和所述远程设备的显示能力交集；共享模块， 设置为通过所述无线屏幕共享会话接收所述显示设备的屏幕内容， 并根据所述显示能 力交集将所述显示设备的屏幕内容共享给所述远程设备。 优选地， 所述共享模块还设置为接收所述显示设备通过所述无线屏幕共享会话发 送的所述显示设备的屏幕内容，根据所述显示能力交集处理所述显示设备的屏幕内容， 并将处理后的所述显示设备的屏幕内容传送给所述远程设备。 根据本发明实施例的又一方面， 提供了一种远程无线屏幕共享***， 包括上述第 九项或第十项所述的远程无线屏幕共享装置的发送设备； 显示设备， 设置为通过所述 无线屏幕共享会话向所述发送设备发送所述显示设备的能力信息和所述显示设备的屏 幕内容； 远程设备， 设置为向所述发送设备发送所述远程设备的能力信息并接收所述 发送设备根据所述显示能力交集处理后的所述显示设备的屏幕内容。 通过本发明实施例， 采用： 与显示设备建立无线屏幕共享会话， 获取上述显示设 备的能力信息； 与远程设备建立连接， 获取上述远程设备的能力信息以及上述远程设 备的网络信息； 根据上述显示设备的能力信息、 上述远程设备的能力信息， 以及上述 远程设备的网络信息确定上述显示设备和上述远程设备的显示能力交集， 解决了远程 无线屏幕共享时存在的设备兼容性不好的问题， 进而达到了提高远程无线屏幕共享时 设备的兼容性的效果。 附图说明 此处所说明的附图用来提供对本发明的进一步理解， 构成本申请的一部分， 本发 明的示意性实施例及其说明用于解释本发明， 并不构成对本发明的不当限定。 在附图 中- 图 1是根据本发明实施例的远程无线屏幕共享方法的流程图； 图 2是根据本发明实施例的远程无线屏幕共享装置的结构示意图； 图 3是根据本发明实施例的远程无线屏幕共享***的结构示意图； 图 4是根据本发明优选实施例的远程无线屏幕共享方法的流程图； 以及 图 5是根据本发明优选实施例的远程无线屏幕共享***的网络拓扑图。 具体实施方式 下文中将参考附图并结合实施例来详细说明本发明。 需要说明的是， 在不冲突的 情况下， 本申请中的实施例及实施例中的特征可以相互组合。 本发明实施例了提供了一种远程无线屏幕共享方法， 图 1是根据本发明实施例的 远程无线屏幕共享方法的流程图， 如图 1所示， 该方法包括以下步骤： 步骤 S102， 与显示设备建立无线屏幕共享会话， 获取所述显示设备的能力信息； 步骤 S104， 与远程设备建立连接， 获取所述远程设备的能力信息以及所述远程设 备的网络信息； 步骤 S106， 根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及所述 远程设备的网络信息确定所述显示设备和所述远程设备的显示能力交集； 步骤 S108， 通过所述无线屏幕共享会话接收所述显示设备的屏幕内容， 并根据所 述显示能力交集将所述显示设备的屏幕内容共享给所述远程设备。 通过上述步骤， 解决了无线屏幕共享和目前远程桌面存在的设备不兼容的问题， 在无线屏幕共享时， 通过显示设备、 远程设备的能力信息以及远程设备的网络信息确 定显示设备和远程设备的显示能力交集， 从而将无线屏幕共享扩展到远程设备， 进而 使得无线屏幕共享不再受限于两设备之间的距离和网络连接方式， 显示设备的屏幕内 容能够同时共享到第三个设备即远程设备。 其中， 通过所述无线屏幕共享会话接收所述显示设备的屏幕内容， 并根据所述显 示能力交集将所述显示设备的屏幕内容共享给所述远程设备的方式可以有很多种。 比 如在确定了显示能力交集之后， 将显示能力交集发送给显示设备和远程设备， 并在接 收到显示设备的屏幕内容后， 将该屏幕内容直接转发给远程设备， 远程设备根据最终 的显示能力交集处理所接收到的屏幕内容并显示。 除上述方式之外， 还可以通过以下 优选地方式实现远程无线屏幕共享： 接收所述显示设备通过所述无线屏幕共享会话发 送的所述显示设备的屏幕内容， 并根据所述显示能力交集处理所述显示设备的屏幕内 容， 然后将处理后的所述显示设备的屏幕内容传送给所述远程设备。 其中， 所述显示设备的能力信息或所述远程设备的能力信息或所述显示能力交集 可以包括以下至少之一： 视频信息， 音频编码格式， 其中， 所述视频信息可以包括视 频编码格式和 /或最大分辨率。 所述显示能力交集除了可以包括上述信息之外， 还可以 包括其他信息， 比如传输方式信息。 其中传输方式信息是指采用什么协议进行传输， 例如采用 RTP协议进行传输。 其中， 所述网络信息包括以下至少之一： 网络连接类型， 带宽， 其中， 所述网络 连接类型包括对等连接 P2P方式， 网络地址转换的用户数据报的简单穿越 STUN方式 或 TURN方式。 当然， 网络信息不限于此， 比如， 网络信息还可以包括传输速率等信 息。 网络连接类型也可能包括其他的连接方式。 其中， 确定显示能力交集的途径可以有很多种。 优选地， 可以通过以下方式： 根 据所述显示设备的能力信息、 所述远程设备的能力信息， 以及与所述远程设备的网络 信息确定所述显示设备和所述远程设备的显示能力交集包括以下至少之一： 在所述网 络连接类型是所述 P2P方式的情况下， 根据所述显示设备的能力信息和所述远程设备 的能力信息选择压缩比大于第一压缩比阈值的音频格式作为所述显示能力交集的音频 编码格式， 选择大于第一分辨率阈值的分辨率作为所述显示能力交集的分辨率； 在所 述网络连接类型是所述 STUN方式的情况下， 根据所述显示设备的能力信息和所述远 程设备的能力信息选择所述压缩比小于所述第一压缩比阈值大于第二压缩比阈值的音 频格式作为所述显示能力交集的音频编码格式， 选择小于所述第一分辨率阈值且大于 第二分辨率阈值的分辨率作为所述显示能力交集的分辨率； 在所述网络连接类型是所 述 TURN方式的情况下， 根据所述显示设备的能力信息和所述远程设备的能力信息选 择所述压缩比小于所述第二压缩比阈值的音频格式作为所述显示能力交集的音频编码 格式， 选择小于所述第二分辨率阈值的分辨率作为所述显示能力交集的分辨率。 优选 地， 还可以包括： 在所述带宽大于第一带宽阈值的情况下， 选择 CHP作为所述显示能 力交集的视频编码格式； 在所述带宽小于所述第一带宽阈值的情况下， 选择 CBP作为 所述显示能力交集的视频编码格式。通过上述步骤，可以选择出最佳的显示能力交集， 进而可以更好地实现远程无线屏幕共享。 其中， 根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及所述远程 设备的网络信息确定所述显示设备和所述远程设备的显示能力交集可以包括： 在所述 显示设备的能力信息和所述远程设备的能力信息没有交集的情况下， 获取自身与所述 显示设备的显示能力交集， 并将所述自身与所述显示设备的能力交集作为所述显示设 备和所述远程设备的显示能力交集。 通过上述步骤， 解决了显示设备和远程设备之间 不存在显示能力交集的情况下， 如何实现远程无线屏幕共享的问题。 其中， 通过所述 XMPP协议与所述远程设备建立连接可以包括： 通过第一接入点 接入 XMPP服务器， 其中， 所述第一接入点通过所述 XMPP协议接入所述 XMPP服 务器； 通过所述 XMPP服务器与所述远程设备建立连接。 当然， 与远程设备建立连接 的方式可能有很多种， 比如可能是直接与远程设备建立连接， 还可能是通过多个中间 网元与远程设备连接。 在本发明的另外一个实施例中， 所述无线屏幕共享会话是 Miracast会话。 本发明实施例了还提供了一种远程无线屏幕共享装置， 图 2是根据本发明实施例 的远程无线屏幕共享装置的结构示意图， 如图 2所示， 该装置包括- 获取模块 202， 设置为与显示设备建立无线屏幕共享会话， 获取所述显示设备的 能力信息， 并与远程设备建立连接， 获取所述远程设备的能力信息以及所述远程设备 的网络信息； 确定模块 204， 设置为根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及所述远程设备的网络信息确定所述显示设备和所述远程设备的显示能力交集； 共享模块 206， 设置为通过所述无线屏幕共享会话接收所述显示设备的屏幕内容， 并根据所述显示能力交集将所述显示设备的屏幕内容共享给所述远程设备。 优选地， 所述共享模块 206还设置为接收所述显示设备通过所述无线屏幕共享会 话发送的所述显示设备的屏幕内容， 根据所述显示能力交集处理所述显示设备的屏幕 内容， 并将处理后的所述显示设备的屏幕内容传送给所述远程设备。 本发明实施例了还提供了一种远程无线屏幕共享***， 图 3是根据本发明实施例 的远程屏幕共***的结构示意图， 如图 3所示， 该装置包括- 发送设备 302， 包括本实施例提供的远程无线屏幕共享装置。 显示设备 304， 设置为通过所述无线屏幕共享会话向所述发送设备发送所述显示 设备的能力信息和所述显示设备的屏幕内容； 远程设备 306， 设置为向所述发送设备发送所述远程设备的能力信息并接收所述 发送设备根据所述显示能力交集处理后的所述显示设备的屏幕内容。 优选实施例一 图 4是根据本发明优选实施例的远程无线屏幕共享方法的流程图， 如图 4所示， 该方法包括以下步骤： 步骤 S402， 建立 WIFI直连。 发送设备与显示设备建立 WIFI直连。相关技术中， Miracast规定发送设备和显示 设备必须支持 WIFI直连。 步骤 S404， 发现 Miracast设备。 发送设备通过链路层业务发现 （Link Layer Service Discovery, 简称为 L2SD) 协 议搜索兼容的 Miracast设备， 本实施例中假设显示设备为兼容的 Miracast设备。 步骤 S406， 建立 Miracast会话。 发送设备与显示设备采用 Miracast的实时流协议 （Real Time Stream Protocol, 简 称为 RTSP) 建立 Miracast会话， 准备开始无线屏幕共享。 步骤 S408， 发送设备登录 XMPP服务器。 为了能够与远程设备进行无线屏幕共享， 发送设备在进行远程无线屏幕共享之前 可以在 XMPP服务器上注册账号， 然后使用该注册账号登录 XMPP服务器。发送设备 登录 XMPP服务器的方式有很多种， 比如可以先与接入点建立连接， 然后通过该接入 点登录 XMPP服务器。 步骤 S410， 远程设备登录 XMPP服务器。 远程设备可以采用与发送设备相同的账号登录 XMPP服务器。远程设备之所以采 用与发送设备相同的账号， 是由于 XMPP服务器可以根据相同的账号即时通知远程设 备和发送设备呈现信息。 也就是说， 当远程设备采用与发送设备相同的账号完成登录 后， 发送设备通过服务器的呈现通知， 能够知道远程设备已经在线。 当然， 远程设备 和发送设备也可以采用不同的账号登录， 只要预先将远程设备和发送设备的账号在 XMPP服务器上关联即可。 步骤 S412， 显示设备发送显示设备的能力信息。 显示设备通过 RTSP通告消息， 在会话描述协议 （Session Description Protocol, SDP) 中携带显示设备的能力信息。 其中， 所述显示设备的能力信息包括视频信息和 / 或音频编码格式。 其中， 视频信息包括显示设备支持的视频编码格式， 显示设备支持 的最大分辨率信息。 当然， 显示设备的能力信息还可以包括传输方式比如， 实时传输 协议 （Real-time Transmission Protocol, 简称为 RTP) 标识。 其中， RTP标识表示传输 方式是实时传输， 即表示传输时采用 RTP协议。 步骤 S414， 会话发起消息。 发送设备向 XMPP服务器发送会话发起消息， 请求与远程设备共享屏幕。 发送设 备为了寻找与所述显示设备匹配的最佳的所述显示设备和所述远程设备的显示能力交 集， 在会话发起消息中携带所述显示设备的能力信息， 其中， 所述显示设备的能力信 息可以包括音频编码格式、 视频编码格式以及 RTP标识。 步骤 S416， 转发会话发起消息。 XMPP服务器接收到发送设备发送的会话发起消息后，对此会话发起消息进行确 认， 并将其转发给远程设备。 步骤 S418， 远程设备发送会话接受消息。 远程设备从 XMPP服务器接收到会话发起消息后， 从会话发起消息中解析出显示 设备的能力信息。 远程设备比较显示设备的能力信息和远程设备的能力信息， 确定二 者是否存在交集。 然后， 向 XMPP发送会话接受消息， 该会话接受消息中包含远程设 备的能力信息， 及是否存在交集的标识。 步骤 S420， 转发会话接受消息。 服务器接收远程设备的会话接受消息， 并对该会话接受消息进行确认， 然后将此 会话接受消息转发给发送设备。 步骤 S422， 获取网络信息。 发送设备开始检测与远程设备的网络连接， 获取远程设备的网络信息。 比如， 发 送设备向 TURN服务器发送探测报文， 探测发送设备与远程设备的网络连接。 其中， 该网络信息可以包括网络连接类型和 /或带宽， 用于最终决定发送设备和远程设备的显 示能力交集， 即在显示设备的能力信息和远程设备的能力信息的基础上， 根据网络连 接类型和 /或带宽最终决定采用哪一种分辨率的视频格式和音频格式。 其中， 发送设备 与远程设备之间的网络连接类型主要有三种： P2P方式， STUN方式和 TURN方式。 步骤 S424， 远程设备进行网络检测。 远程设备针对上述三种网络连接类型通过 TURN 服务器向发送设备发送探测报 文， 如果得到响应， 则认为当前网络连接类型下远程设备和发送设备之间的网络是连 通的， 从而确认网络连接类型。 同时， 远程设备还可以进行上行和下行带宽估算。 步骤 S426， 通告网络信息。 远程设备通过 XMPP消息向 XMPP服务器通告远程设备的网络信息。 步骤 S428， 转发网络信息。
XMPP服务器接收到远程设备的网络信息后，对承载远程设备的网络信息的消息 进行确认， 并将其转发到发送设备。 步骤 S430， 确定显示能力交集。 发送设备接收到服务器转发的承载远程设备的网络信息的消息后， 从该消息中解 析出远程设备的网络信息。将此网络信息与步骤 S422获取的网络信息进行比较，确定 最终的远程设备的网络信息。 至此， 发送设备获取到显示设备的能力信息、 远程设备 的能力信息、 以及远程设备的网络信息。 根据上述得到的信息， 可以确定所述显示设 备和所述远程设备的显示能力交集。 当然， 也可以在获取前述信息的基础上， 获取发 送设备自身的能力信息， 从而确定显示设备、 发送设备和远程设备三个设备的显示能 力交集。 在所述网络连接类型是所述 P2P方式的情况下， 根据所述显示设备的能力信息和 所述远程设备的能力信息选择压缩比大于第一压缩比阈值的音频格式作为所述显示能 力交集的音频编码格式， 选择大于第一分辨率阈值的分辨率作为所述显示能力交集的 分辨率； 在所述网络连接类型是所述 STUN方式的情况下， 根据所述显示设备的能力 信息和所述远程设备的能力信息选择所述压缩比小于所述第一压缩比阈值大于第二压 缩比阈值的音频格式作为所述显示能力交集的音频编码格式， 选择小于所述第一分辨 率阈值且大于第二分辨率阈值的分辨率作为所述显示能力交集的分辨率； 在所述网络 连接类型是所述 TURN方式的情况下， 根据所述显示设备的能力信息和所述远程设备 的能力信息选择所述压缩比小于所述第二压缩比阈值的音频格式作为所述显示能力交 集的音频编码格式， 选择小于所述第二分辨率阈值的分辨率作为所述显示能力交集的 分辨率。 比如， 如果显示设备与远程设备的网络连接类型为 P2P方式， 则可以传输较 高分辨率的视频， 音频编码格式可以选择为 LPCM格式； 如果网络连接类型为 STUN 方式， 则可以传输中等分辨率的视频， 音频编码格式可以为 AAC 格式； 如果网络连 接类型为 TURN方式， 则可以传输较低分辨率的视频， 音频编码方式可以为 AC3格 式； 如果发送设备和远程设备的能力信息没有交集或者不符合发送设备与远程设备之 间的连接预置条件， 则可以将发送设备与显示设备之间的显示能力交集作为远程设备 和发送设备的显示能力交集。 步骤 S432， 通知显示设备所确定的显示能力交集。 发送设备通过 RTSP通告消息通知显示设备最后确定的显示能力交集， 即发送设 备、远程设备的设备能力交集， 或者发送设备、显示设备与远程设备的设备能力交集。 步骤 S434， 通知 XMPP服务器所确定的显示能力交集。 发送设备通过 XMPP消息通知 XMPP服务器所确定的显示能力交集，即发送设备、 远程设备的设备能力交集， 或者发送设备、 显示设备与远程设备的设备能力交集。 步骤 S436， 转发所确定的显示能力交集。 服务器对承载显示能力交集的 XMPP消息进行确认，并将该消息转发给远程设备。 步骤 S438， Miracast屏幕共享。 发送设备与显示设备之间开始进行 RTP传输，也就是说， Miracast会话成功建立， 发送设备与显示设备之间开始进行 Miracast屏幕共享。 步骤 S440， 远程无线屏幕共享。 发送设备根据所确定的显示能力交集处理从显示设备接收的屏幕内容， 并将处理 后的显示设备的屏幕内容基于 RTP协议发送给远程设备。 具体地说， 发送设备接收到 显示设备发送的屏幕内容后， 根据显示能力交集中的视频格式、 和 /或音频格式对所接 收到的屏幕内容进行转码处理， 并将转码后的屏幕内容实时发送给远程设备。 通过上述步骤， 无线屏幕共享可以扩展到任意位置的远程设备， 如果还有其它设 备需要加入无线屏幕共享， 则可以继续重复上述步骤 S408-440。 步骤 S442~S446， 结束远程无线屏幕共享。 发送设备准备结束无线屏幕共享时， 通过 RTSP控制协议结束 Miracast会话， 停 止发送设备和显示设备之间的 RTP传输；发送设备同时通过 XMPP协议向服务器发送 会话终止消息， 服务器对会话终止消息进行确认， 并转发给远程设备以便结束远程无 线屏幕共享。 优选实施例二 图 5是根据本发明优选实施例的远程无线屏幕共享***的网络拓扑图， 如图 5所 示， 该***包括显示设备 502、 发送设备 504,、 远程设备 506、 接入点 A、 接入点 B、 XMPP服务器 508、 TURN服务器 510。 发送设备 504和显示设备 502具有 WIFI直连能力， 并可以进行 Miracast屏幕共 享。 发送设备 504通过接入点 A接入 XMPP服务器 508， 而远程设备 506通过接入点 B与 XMPP服务器 508连通。 发送设备 504分别和显示设备 502、 远程设备 508建立 连接之后， 获取显示设备的能力信息和远程设备的能力信息。 其中， 显示设备的能力 信息和 /或远程设备的能力信息包括以下至少之一： 视频信息， 音频格式信息。 其中， 视频信息包括分辨率和 /或视频编码格式。发送设备 504和显示设备 502之间通过 L2SD 协议相互发现， 而发送设备 504和远程设备 506可以通过同一账号在不同设备上登录 的方式利用呈现信息来相互发现。 远程设备 506可以与显示设备 502处于同一局域网中，也可以位于 IP地址和端口 限制的网络中， 在后一种情况下， 该***还包括 TURN服务器 510来辅助检测发送设 备 504与远程设备 506的网络连接类型。 发送设备 504与远程设备 506之间的网络连接类型主要有如下三种： P2P方式、 STUN方式和 TURN方式。 其中， 在 P2P方式下， 发送设备 504与远程设备 506之间 可以直接进行传输， 它们处于同一网段的局域网中； 在 STUN方式下， 发送设备 504 与远程设备 506位于不同网段的局域网，它们之间没有防火墙对 IP地址和端口进行限 制； 在 TURN方式下， 发送设备 504与远程设备 506各自处于 IP地址和端口限制型 的网络中， 它们之间需要通过 TURN服务器 510才能进行传输。 发送设备 504在得到显示设备的能力信息和远程设备的能力信息后， 结合发送设 备 504和远程设备 506之间的网络连接类型， 决定最终的显示能力交集， 比如最后选 定的分辨率、 视频编码格式以及音视频编码格式。 Miracast支持的视频分辨率范围从 640x360到 1920x1080， 音频编码格式和视频编码格式也有多种格式， 这都跟 Wi-Fi直 连的网络连接方式相关， 因此发送设备 504在建立与远程设备 506之间的远程无线屏 幕共享时， 需要检测它们之间的网络连接类型和 /或带宽， 最终在发送设备的能力信息 和远程设备的能力信息的基础上， 根据网络连接类型和 /或带宽决定发送设备 504与远 程设备 506的显示能力交集， 该显示能力交集包括视频信息和音频编码格式， 其中视 频信息包括分辨率和 /或视频编码格式。 发送设备 504分别通过各自的会话协商协议通知显示设备 502和远程设备 506， 从而实现远程无线屏幕共享。 从以上的描述中， 可以看出， 本发明实施例实现了如下技术效果： 提高了远程无 线屏幕共享时设备的兼容性。 显然， 本领域的技术人员应该明白， 上述的本发明的各模块或各步骤可以用通用 的计算装置来实现， 它们可以集中在单个的计算装置上， 或者分布在多个计算装置所 组成的网络上， 可选地， 它们可以用计算装置可执行的程序代码来实现， 从而， 可以 将它们存储在存储装置中由计算装置来执行， 并且在某些情况下， 可以以不同于此处 的顺序执行所示出或描述的步骤， 或者将它们分别制作成各个集成电路模块， 或者将 它们中的多个模块或步骤制作成单个集成电路模块来实现。 这样， 本发明不限制于任 何特定的硬件和软件结合。 以上所述仅为本发明的优选实施例而已， 并不用于限制本发明， 对于本领域的技 术人员来说， 本发明可以有各种更改和变化。 凡在本发明的精神和原则之内， 所作的 任何修改、 等同替换、 改进等， 均应包含在本发明的保护范围之内。

Claims

权 利 要 求 书
1. 一种远程无线屏幕共享方法， 包括：
与显示设备建立无线屏幕共享会话， 获取所述显示设备的能力信息； 与远程设备建立连接， 获取所述远程设备的能力信息以及所述远程设备的 网络信息；
根据所述显示设备的能力信息、 所述远程设备的能力信息， 以及所述远程 设备的网络信息确定所述显示设备和所述远程设备的显示能力交集；
通过所述无线屏幕共享会话接收所述显示设备的屏幕内容， 并根据所述显 示能力交集将所述显示设备的屏幕内容共享给所述远程设备。
2. 根据权利要求 1所述的方法， 其中， 通过所述无线屏幕共享会话接收所述显示 设备的屏幕内容， 并根据所述显示能力交集将所述显示设备的屏幕内容共享给 所述远程设备包括：
接收所述显示设备通过所述无线屏幕共享会话发送的所述显示设备的屏幕 内容；
根据所述显示能力交集处理所述显示设备的屏幕内容， 并将处理后的所述 显示设备的屏幕内容传送给所述远程设备。
3. 根据权利要求 1所述的方法， 其中， 所述显示设备的能力信息或所述远程设备 的能力信息或所述显示能力交集包括以下至少之一：视频信息，音频编码格式， 其中， 所述视频信息包括视频编码格式和 /或最大分辨率。
4. 根据权利要求 3所述的方法， 其中， 所述网络信息包括以下至少之一： 网络连 接类型， 带宽， 其中， 所述网络连接类型包括对等连接 P2P方式， NAT的会话 穿越应用程序 STUN方式或 NAT的使用中继穿越 TURN方式。
5. 根据权利要求 4所述的方法， 其中， 根据所述显示设备的能力信息、 所述远程 设备的能力信息， 以及与所述远程设备的网络信息确定所述显示设备和所述远 程设备的显示能力交集包括以下至少之一：
在所述网络连接类型是所述 P2P方式的情况下， 根据所述显示设备的能力 信息和所述远程设备的能力信息选择压缩比大于第一压缩比阈值的音频格式作 为所述显示能力交集的音频编码格式， 选择大于第一分辨率阈值的分辨率作为 所述显示能力交集的分辨率；
在所述网络连接类型是所述 STUN方式的情况下， 根据所述显示设备的能 力信息和所述远程设备的能力信息选择所述压缩比小于所述第一压缩比阈值大 于第二压缩比阈值的音频格式作为所述显示能力交集的音频编码格式， 选择小 于所述第一分辨率阈值且大于第二分辨率阈值的分辨率作为所述显示能力交集 的分辨率；
在所述网络连接类型是所述 TURN方式的情况下，根据所述显示设备的能 力信息和所述远程设备的能力信息选择所述压缩比小于所述第二压缩比阈值的 音频格式作为所述显示能力交集的音频编码格式， 选择小于所述第二分辨率阈 值的分辨率作为所述显示能力交集的分辨率。
6. 根据权利要求 5所述的方法， 其中， 根据所述显示设备的能力信息、 所述远程 设备的能力信息， 以及与所述远程设备的网络信息确定所述显示设备和所述远 程设备的显示能力交集还包括以下至少之一：
在所述带宽大于第一带宽阈值的情况下，选择 CHP作为所述显示能力交集 的视频编码格式；
在所述带宽小于所述第一带宽阈值的情况下，选择 CBP作为所述显示能力 交集的视频编码格式。
7. 根据权利要求 1所述的方法， 其中， 根据所述显示设备的能力信息、 所述远程 设备的能力信息， 以及所述远程设备的网络信息确定所述显示设备和所述远程 设备的显示能力交集包括： 在所述显示设备的能力信息和所述远程设备的能力 信息没有交集的情况下， 获取自身与所述显示设备的显示能力交集， 并将所述 自身与所述显示设备的能力交集作为所述显示设备和所述远程设备的显示能力 交集。
8. 根据权利要求 1所述的方法， 其中， 通过所述 XMPP协议与所述远程设备建立 连接包括：
通过第一接入点接入 XMPP服务器，其中，所述第一接入点通过所述 XMPP 协议接入所述 XMPP服务器；
通过所述 XMPP服务器与所述远程设备建立连接。
9. 根据权利要求 1 至 8 中任一项所述的方法， 其中， 所述无线屏幕共享会话是 Miracast会话。
10. 一种远程无线屏幕共享装置， 包括：
获取模块， 设置为与显示设备建立无线屏幕共享会话， 获取所述显示设备 的能力信息， 并通过 XMPP协议与远程设备建立连接， 获取所述远程设备的能 力信息以及所述远程设备的网络信息；
确定模块， 设置为根据所述显示设备的能力信息、 所述远程设备的能力信 息， 以及所述远程设备的网络信息确定所述显示设备和所述远程设备的显示能 力交集；
共享模块， 设置为通过所述无线屏幕共享会话接收所述显示设备的屏幕内 容，并根据所述显示能力交集将所述显示设备的屏幕内容共享给所述远程设备。
11. 根据权利要求 10所述的装置，其中，所述共享模块还设置为接收所述显示设备 通过所述无线屏幕共享会话发送的所述显示设备的屏幕内容， 根据所述显示能 力交集处理所述显示设备的屏幕内容， 并将处理后的所述显示设备的屏幕内容 传送给所述远程设备。
12. 一种远程无线屏幕共享***， 包括：
发送设备， 包括权利要求 10或 11所述的远程无线屏幕共享装置； 显示设备， 设置为通过所述无线屏幕共享会话向所述发送设备发送所述显 示设备的能力信息和所述显示设备的屏幕内容；
远程设备， 设置为向所述发送设备发送所述远程设备的能力信息并接收所 述发送设备根据所述显示能力交集处理后的所述显示设备的屏幕内容。
PCT/CN2013/084515 2013-08-29 2013-09-27 远程无线屏幕共享方法、装置及*** WO2014169581A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US14/907,116 US9696866B2 (en) 2013-08-29 2013-09-27 Remote wireless screen sharing method, device and system
JP2016537077A JP6208361B2 (ja) 2013-08-29 2013-09-27 遠隔地無線画面共有方法、装置及びシステム
EP13882436.2A EP3041183B1 (en) 2013-08-29 2013-09-27 Remote wireless screen sharing method, device and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310386058.XA CN104426870B (zh) 2013-08-29 2013-08-29 远程无线屏幕共享方法、装置及***
CN201310386058.X 2013-08-29

Publications (1)

Publication Number Publication Date
WO2014169581A1 true WO2014169581A1 (zh) 2014-10-23

Family

ID=51730734

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/084515 WO2014169581A1 (zh) 2013-08-29 2013-09-27 远程无线屏幕共享方法、装置及***

Country Status (5)

Country Link
US (1) US9696866B2 (zh)
EP (1) EP3041183B1 (zh)
JP (1) JP6208361B2 (zh)
CN (1) CN104426870B (zh)
WO (1) WO2014169581A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018133807A (ja) * 2014-12-26 2018-08-23 古野電気株式会社 無線ｌａｎアクセスポイント、表示データ転送方法、表示データ転送プログラム
CN111263217A (zh) * 2020-02-18 2020-06-09 深圳市炬力北方微电子有限公司 无线投屏方法、无线投屏***及其计算机可读存储介质

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10652385B2 (en) * 2014-10-06 2020-05-12 Mitel Networks Corporation Method and system for viewing available devices for an electronic communication
KR102433879B1 (ko) * 2015-08-21 2022-08-18 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
US9986499B1 (en) 2016-11-07 2018-05-29 Microsoft Technology Licensing, Llc Location-based determination of channel for initiating peer-to-peer session
US10455632B2 (en) 2016-11-30 2019-10-22 Microsoft Technology Licensing, Llc Dynamic identification of network connection preferences
US10602557B2 (en) 2016-11-30 2020-03-24 Microsoft Technology Licensing, Llc Discovering and protecting data streams in multi-path communication environments
US10984411B1 (en) 2016-12-16 2021-04-20 Wells Fargo Bank, N.A. Sending secure proxy elements with mobile wallets
US11178528B2 (en) * 2017-02-06 2021-11-16 Hewlett-Packard Development Company, L.P. Media content control of source devices on sink devices
KR102341301B1 (ko) * 2017-03-27 2021-12-20 삼성전자 주식회사 전자 장치 및 전자 장치의 화면 공유 방법
US10586071B2 (en) * 2017-11-24 2020-03-10 International Business Machines Corporation Safeguarding confidential information during a screen share session
CN108184133B (zh) * 2017-12-07 2020-09-25 西安万像电子科技有限公司 一种网络显卡及图像数据传输方法
CN107908386A (zh) * 2017-12-21 2018-04-13 联想(北京)有限公司 信息处理方法及电子设备
CN108366044B (zh) * 2017-12-30 2023-12-12 深圳市潮流网络技术有限公司 一种VoIP远程音视频共享方法
CN109327728B (zh) * 2018-11-23 2021-10-15 深圳市鹰硕技术有限公司 一种一对多同屏方法、装置和***、同屏设备及存储介质
KR20200084587A (ko) * 2019-01-03 2020-07-13 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
CN110597473A (zh) * 2019-07-30 2019-12-20 华为技术有限公司 一种投屏方法与电子设备
CN112394894A (zh) * 2019-08-19 2021-02-23 中兴通讯股份有限公司 显示数据处理、显示方法、装置、终端及可读存储介质
CN111741353A (zh) * 2020-07-22 2020-10-02 深圳Tcl新技术有限公司 设备协同工作的方法、终端设备及可读存储介质
US11474690B2 (en) * 2020-08-14 2022-10-18 VTouch Co., Ltd. Method, system and non-transitory computer-readable recording medium for non-contact control
CN114827098A (zh) * 2021-01-28 2022-07-29 华为技术有限公司 合拍的方法、装置、电子设备和可读存储介质
CN113490037A (zh) * 2021-07-01 2021-10-08 读书郎教育科技有限公司 一种远程视频投屏的***及方法
KR102515372B1 (ko) * 2022-11-22 2023-03-30 불곰소프트 주식회사 원격 화면 출력을 구현하는 전자 서비스 제공 시스템, 방법, 프로그램, 컴퓨터 판독 가능한 기록매체

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1811695A (zh) * 2005-01-24 2006-08-02 微软公司 收集和报告协作会话的出席者的屏幕分辨率的***和方法
CN101237327A (zh) * 2007-02-01 2008-08-06 ***助在线信息技术有限公司 一种在线帮助平台***及其实现方法
US20120173622A1 (en) * 2011-01-04 2012-07-05 Samsung Electronics Co., Ltd. Social screen casting
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04246956A (ja) * 1991-01-31 1992-09-02 Fujitsu Ltd 複数通信端末装置の通信モード決定方式
US6390371B1 (en) * 1998-02-13 2002-05-21 Micron Technology, Inc. Method and system for displaying information uniformly on tethered and remote input devices
JP2004110567A (ja) * 2002-09-19 2004-04-08 Fuji Xerox Co Ltd 通信制御方法および装置
JP2011100270A (ja) * 2009-11-05 2011-05-19 Mitsubishi Electric Corp 画面共有システム及び画面共有サーバ
CN102223201B (zh) * 2010-04-15 2014-01-01 中兴通讯股份有限公司 一种编解码器能力协商方法及终端
US9367635B2 (en) * 2011-02-12 2016-06-14 International Business Machines Corporation Contact center co-browsing for a mobile device
JP5903835B2 (ja) * 2011-04-28 2016-04-13 株式会社リコー 伝送端末、画像表示制御方法、画像表示制御プログラム、記録媒体、および伝送システム
JP6089454B2 (ja) * 2012-06-07 2017-03-08 株式会社リコー 画像配信装置、表示装置及び画像配信システム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1811695A (zh) * 2005-01-24 2006-08-02 微软公司 收集和报告协作会话的出席者的屏幕分辨率的***和方法
CN101237327A (zh) * 2007-02-01 2008-08-06 ***助在线信息技术有限公司 一种在线帮助平台***及其实现方法
US20120173622A1 (en) * 2011-01-04 2012-07-05 Samsung Electronics Co., Ltd. Social screen casting
CN102883135A (zh) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 屏幕共享及控制方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3041183A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018133807A (ja) * 2014-12-26 2018-08-23 古野電気株式会社 無線ｌａｎアクセスポイント、表示データ転送方法、表示データ転送プログラム
CN111263217A (zh) * 2020-02-18 2020-06-09 深圳市炬力北方微电子有限公司 无线投屏方法、无线投屏***及其计算机可读存储介质

Also Published As

Publication number Publication date
CN104426870A (zh) 2015-03-18
US9696866B2 (en) 2017-07-04
EP3041183A1 (en) 2016-07-06
US20160179295A1 (en) 2016-06-23
JP2016534458A (ja) 2016-11-04
EP3041183A4 (en) 2016-08-31
JP6208361B2 (ja) 2017-10-04
EP3041183B1 (en) 2018-04-04
CN104426870B (zh) 2019-03-15

Similar Documents

Publication Publication Date Title
WO2014169581A1 (zh) 远程无线屏幕共享方法、装置及***
US11671651B2 (en) Methods and systems for enabling communications between devices
CN108289187B (zh) 网络直播接入视频会议方法及***
US9191415B2 (en) Method and system for providing virtual gateway services
AU2013207642B2 (en) Wireless communication system for offline participation in a display session
EP2353261B1 (en) Iptv service provision method and system for fixed and mobile devices
WO2014019357A1 (zh) 实现多屏互动的方法和装置
WO2011017982A1 (zh) 媒体业务处理***、方法及终端
CN107006054B (zh) 用于音频-视频中继的无线对接方法和***
CN102215276A (zh) 一种视频监控***及媒体穿越网络地址转换设备的方法
WO2014183540A1 (zh) 一种视频监控的内容适配方法、***及中心服务器、装置
WO2014187295A1 (zh) 一种通信方法、终端及通信***
KR20170063423A (ko) 멀티미디어 공유 방법, 등록 방법, 서버 및 프록시 서버
CN112352438B (zh) 家长控制监视***及方法
CN105812909A (zh) 一种视频传输方法及装置
US20130107697A1 (en) Network Connection System of Network Electronic Device and Method to Solve Terminal Device Unable to Reach Electronic Device Caused by Router Not Supporting NAT Loopback
KR101528268B1 (ko) 콘텐츠를 원격 위치들에 스트리밍하기 위한 시스템과 방법
US11218523B2 (en) Method of providing information to an audio/video receiver device and corresponding apparatus
EP3357249B1 (en) Methods and systems for enabling communications between devices
KR20160096941A (ko) 이기종망을 통한 iptv 방송 서비스 제공 방법, 전송 서버 및 시스템
WO2014127620A1 (zh) Ngn和ims间进行多媒体会议通知服务的方法及***

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13882436

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016537077

Country of ref document: JP

Kind code of ref document: A

REEP Request for entry into the european phase

Ref document number: 2013882436

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2013882436

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 14907116

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE