WO2016070372A1 - Method for implementing synchronous display between mobile terminal and web terminal - Google Patents

Method for implementing synchronous display between mobile terminal and web terminal Download PDF

Info

Publication number
WO2016070372A1
WO2016070372A1 PCT/CN2014/090424 CN2014090424W WO2016070372A1 WO 2016070372 A1 WO2016070372 A1 WO 2016070372A1 CN 2014090424 W CN2014090424 W CN 2014090424W WO 2016070372 A1 WO2016070372 A1 WO 2016070372A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
terminal
web
web terminal
server
Prior art date
Application number
PCT/CN2014/090424
Other languages
French (fr)
Chinese (zh)
Inventor
姜天鹏
Original Assignee
北京安奇智联科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京安奇智联科技有限公司 filed Critical 北京安奇智联科技有限公司
Priority to PCT/CN2014/090424 priority Critical patent/WO2016070372A1/en
Publication of WO2016070372A1 publication Critical patent/WO2016070372A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications

Definitions

  • the present invention generally relates to the field of mobile communications, and in particular, to a method and system for interconnecting between a mobile terminal and a web terminal and for enabling simultaneous display therebetween.
  • a conventional method of synchronizing display between a mobile electronic device and a personal computer connects a personal computer to an electronic device using a data line, a video/audio line, etc., and is implemented by running specific software. But these methods are very cumbersome and the user experience is very bad. For example, the way of the data line makes the user need to prepare additional hardware, which is inconvenient for the user. In addition, many additional drivers are required to implement more complex functions than transferring files.
  • the connection of the data cable also has special requirements for the hardware interface of the device. For example, the commonly used HDMI interface is only configured on a relatively new computer device, and the slightly old model is not configured, so that the connection cannot be realized.
  • WiFi technology provides simultaneous display and transmission between mobile electronic devices and personal computers.
  • an access point AP
  • the access point acts as a wireless network relay between the mobile electronic device and the personal computer, and the personal computer and the mobile device must be connected to the wireless network relay at the same time to achieve interconnection.
  • AP access point
  • Short-range near-field communication technologies such as Bluetooth technology are now increasingly being used to transfer data between mobile electronic devices for synchronized display.
  • Bluetooth technology often does not provide high speed data transfer speeds.
  • personal computers are usually not equipped with Bluetooth modules. Blocks, making bidirectional connection communication impossible.
  • An object of the present invention is to provide a method for synchronous display between a mobile device and a web terminal, wherein the mobile terminal and the web terminal are respectively connected to a server end located in the cloud through a network, and the method includes the following steps: a) issuing, by the web terminal, a request for synchronous display to the server; b) the server forwards the synchronous display request to the mobile terminal; c) the mobile terminal receives the request, triggering generation of a long a connection address; d) the mobile terminal transmitting the long connection address to the web terminal; e) the web terminal transmitting a response confirmation to establish establishment of a long connection to the mobile terminal; f) the mobile terminal receiving a response confirmation Afterwards, the triggering starts to perform a screen capture operation at a specific time interval; g) the mobile terminal sequentially sends the screen capture images to the web terminal in the time sequence of interception; and h) the web terminal sequentially displays the received in the received time sequence The screen shot to.
  • the long connection in the step c is an http long connection.
  • the long connection address is transited by the server and then sent to the web terminal.
  • the screen capture operation time interval in the step f is to intercept the screen once every 1/10-1/2 seconds.
  • the screen capture operation time interval is to intercept the screen once every 1/4 second.
  • the mobile terminal stores the intercepted screen image in a first-in-first-out queue manner, and then takes out the screen capture image in the queue from the queue according to a specific time interval, and sends the screen capture image to the web terminal.
  • the mobile terminal sends the address information of the intercepted screen to the web terminal, and the web terminal accesses the screenshot image required for the address download.
  • the transmission of the screen shot image is performed by a relay of the server end.
  • the web terminal stores the received screenshot in a first-in, first-out queue manner. Slices, pop-up screen images from the queue in turn for display.
  • the connection between the web terminal and the mobile terminal is established by the following steps: a01) issuing a connection request by the web terminal to the server end; a02) the server end Transmitting two-dimensional code information to the web terminal; a03) scanning the two-dimensional code information by the mobile terminal; a04) in response to the operation of scanning the two-dimensional code, the mobile terminal and the web terminal respectively
  • the server sends its own network connection status; a05) the server obtains the network status of the mobile terminal and the web terminal respectively connected to the server, and determines whether the network connection between the mobile terminal and the web terminal is Under the same local area network, and setting the network status identifiers to different states according to whether they are in the same local area network; a06) the server end respectively sends a connection establishment permission to the mobile terminal and the web terminal, where the mobile terminal and the mobile terminal Establish a connection between the web terminals.
  • a user can implement a synchronous, high-speed, stable, and user-friendly interactive display scheme between a mobile electronic device and a web terminal having a web interface.
  • FIG. 1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
  • Fig. 2 schematically shows an interaction flow diagram for interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
  • FIG. 3a schematically illustrates a connection interface of an exemplary mobile terminal 110 in accordance with one embodiment of the present invention.
  • FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention.
  • FIG. 4 is a flow chart diagrammatically showing a method of synchronous display between web terminal 120 and mobile terminal 110 in accordance with the present invention.
  • 5a-5c schematically illustrate exemplary screen shot images displayed on web terminal 120 in accordance with the method of FIG. 4, respectively.
  • FIG. 1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
  • 1a schematically shows a system block diagram for interconnection between a mobile terminal and a web terminal by means of a server side according to the present invention
  • FIG. 1b shows a system block diagram including a specific architecture and composition of the server side.
  • system 100 includes at least one mobile terminal 110, at least one web terminal 120, and a remotely located server side 130 for enabling interconnection between mobile terminal 110 and web terminal 120 for interactive communication. .
  • the mobile terminal 110 and the web terminal 120 are respectively connected to the server side 130 through the first network 140, and the mobile terminal 110 and the web terminal 120 are connected to each other through the second network 150.
  • FIG. 1 shows only one mobile terminal 110 and one web terminal 120.
  • system 100 can include more mobile terminals 110 and/or more web terminals 120.
  • each mobile terminal 110 has a unique web terminal 120 that uniquely corresponds to it.
  • the mobile terminal 110 and the web terminal 120 can communicate bidirectionally with the server side 130 via any type of first network 140, respectively.
  • the first network 140 is, for example, selected from a local area network ("LAN") such as an intranet and a wide area network ("WAN") such as the Internet.
  • the first network 140 can be configured to support the transmission of information using a plurality of protocol setting formats. Additionally, the first network 140 can be a public network, a private network, or a combination thereof.
  • the first network 140 can also be implemented using any one or more types of physical media, including wired communication paths and wireless communication paths associated with multiple service providers. Wireless communication methods such as WiFi or WLAN, GPRS, cellular networks, such as GSM networks, 3G networks, LTE networks, or CDMA networks.
  • a direct network connection can also be established between the mobile terminal 110 and the web terminal 120, and two-way communication is performed through the second network 150.
  • the protocol mode adopted by the second network 150 is, for example, a manner in which http polling is combined with WebSocket direct connection.
  • the mobile terminal 110 can be a smart phone, a personal digital assistant (PDA), a tablet, a multi-function mobile terminal, or any other mobile device that includes computing functionality and data communication capabilities.
  • the mobile terminal 110 includes an app interface application 111 (shown in FIG. 1b) and a screen capture unit 112 included therein.
  • the App application 111 is, for example, a custom application (app) for two-way communication with web-enabled applications.
  • the screen capture unit 112 is configured to intercept the currently displayed page of the app application according to a specific time interval, and send the intercepted page to the web terminal 120 for display.
  • the specific screen capture method steps will be described in detail below when describing the method flow of the present invention.
  • the web terminal 120 can be any terminal device that supports a web protocol, such as a desktop computer, a laptop computer, a notebook computer, a tablet computer, a game console, a smart TV, and the like.
  • the web terminal 120 includes a web interface 121 (as shown in Figure 1b).
  • the web interface 121 is, for example, a web browser.
  • the respective web terminal 120 includes a browser application for requesting, parsing, displaying, executing a web page, and executing an application included in the web page.
  • Browser application 128 may be any application that allows a user to search, browse, and/or use resources (eg, web pages and web services) identified by a URL (Uniform Resource Locator) or URI (Uniform Resource Identifier).
  • URL Uniform Resource Locator
  • URI Uniform Resource Identifier
  • URL is used herein to mean the network address or location of a document.
  • document refers to any document or content in any format that can be used by a web browser or other application, including but not limited to: word processing documents, spreadsheet documents, presentation documents, drawings, web pages, text, images. , audio, video, etc.
  • the mobile terminal 110 includes one or more computing devices that can receive input from a user and can present an output, such that the mobile terminal 110 further includes an I/O interface (input/output interface) 112 that can receive one Or multiple inputs and present the output.
  • the input interface can include one or more of a camera, a touchpad, a touch screen, a stylus, and a microphone.
  • an output can be presented through the output interface to output a user's control operation instructions or feedback information from other users, and the like.
  • the output interface includes one or more of a display screen, one or more speakers, and a tactile interface.
  • Figure 1b shows a system block diagram containing the specific architecture and composition of the server side.
  • the server side 130 includes a two-dimensional code module 131, a network access module 132, a network status identifier 133, and an address generation module 134.
  • the two-dimensional code module 131 is configured to generate a two-dimensional code for scanning by the mobile terminal 110.
  • the two-dimensional code contains a Universally Unique Identifier (UUID), which is a unique identification code.
  • UUID Universally Unique Identifier
  • the mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
  • the network access module 132 is configured to determine the network connection status of the mobile terminal 110 and the web terminal 120 after the corresponding mobile terminal 110 scans the two-dimensional code, so as to perform appropriate connection between the mobile terminal 110 and the web terminal 120 for different network connection conditions.
  • the connections are made to establish a connection between the mobile terminal 110 and the web terminal 120.
  • the established connection is an http long connection.
  • the connection can continuously send multiple data packets. If there is no data packet transmission during the connection hold period, in order to ensure that the two terminals remain connected, the detection data packet (ie, heartbeat packet) is sent within a predetermined interval, the mobile terminal 110 and the web. A detection packet needs to be sent between the terminals 120 to maintain the connection.
  • the network access module 132 obtains the network status that the mobile terminal 110 and the web terminal 120 are respectively connected to the server end 130, and determines whether the network connection of the mobile terminal 110 and the web terminal 120 are under the same network.
  • the same network according to the present invention means that the same network segment can be directly connected under the same router without going through the external network.
  • the network status indicator 133 is set to a different state depending on whether it is in the same local area network. For example, if it is in the same network, an identifier, such as the number 1, is set in the network status indicator 133; if not in the same network, the identifier is not set in the network status indicator 133, or another different identifier is set, for example The number is 0.
  • the network access module 132 periodically acquires the network status of each of the mobile terminal 110 and the web terminal 120 connected to the server to determine whether the network connection of the mobile terminal 110 and the web terminal 120 is under the same local area network. Whether the status changes and updates the network status indicator 133 for the changed network status.
  • the frequency of the periodic acquisition may be, for example, once every 30 seconds.
  • the periodically transmitted signal is also referred to as a "heartbeat signal" and can also be used to detect whether the mobile terminal 110 and the web terminal 120 are still connected to the server side 130. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130.
  • the network status indicator 133 is used to store an identification of the adaptive connection between the mobile terminal 110 and the web terminal 120 due to different network connection conditions. For example, the mobile terminal 110 and the web terminal 120 are in the same network, and an identifier is set in the network status identifier 133; if not in the same network, another different identifier is set.
  • An address generation module 134 configured to generate at the mobile terminal 110 and the web terminal 120 The file address transferred between. After the connection is established between the mobile terminal 110 and the web terminal 120 in accordance with the method of the present invention, the user may select to upload a file to the web terminal 120 via the mobile terminal 110 or download the file from the web terminal 120 to the mobile terminal 110. When the user issues such a request to move the file, the address generation module 134 generates a network-based address, such as a URL, for the transmitted file, to the mobile terminal 110 or web terminal 120 that needs to download the file, the mobile terminal 110 and the web terminal 120. Simply access the address to download the file to transfer the file.
  • a network-based address such as a URL
  • FIG. 2 shows a flow chart of a method for a user to interact with the web terminal 120 via the server terminal 130 via the mobile terminal 110. as shown in picture 2,
  • the user sends a connection request to the server side 130 via the web terminal 120.
  • the user can send a connection request by launching a browser on the web terminal 120 and entering address information of www.****.cc in the browser address bar.
  • the server 130 sends the QR code information to the web terminal 120 in response to the connection request sent by the web terminal 120, and presents the two-dimensional code information on the web terminal 120 in step 220.
  • the two-dimensional code information includes a universal unique identification code (UUID), and the UUID is a unique identification code.
  • UUID universal unique identification code
  • the mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
  • the user scans the two-dimensional code information on the web terminal 120 through the mobile terminal 110.
  • scanning is performed by a camera carried on the mobile terminal 110.
  • the user activates the app software on the mobile terminal 110, and the app software prompts the user to scan the two-dimensional code to implement the connection.
  • the mobile terminal 110 and the web terminal 120 initiate a connection request to the server side in steps 230a and 230b, respectively, and transmit their own network connection status to the server side 130.
  • the network connection status is a network connection to the server end.
  • the server side 130 determines whether the network connection of the mobile terminal 110 and the web terminal 120 is under the same local area network by acquiring the network status of the mobile terminal 110 and the web terminal 120 respectively connected to the server, and whether the network connection is in the same local area network.
  • the network status indicator sets a different status. For example, if it is in the same network, an identifier is set in the network status indicator 133, such as the number 1; if not in the same network, it is not An identifier is set in the network status indicator 133, or another different identifier is set, such as the number 0.
  • the server side 130 transmits a connection establishment permission to the mobile terminal 110 and the web terminal 120 in steps 240a and 240b, respectively, thereby establishing a connection between the mobile terminal 110 and the web terminal 120.
  • a http long connection is established.
  • FIG. 3a schematically illustrates a connection interface of an exemplary mobile terminal 110 in accordance with one embodiment of the present invention.
  • the presentation interface of the mobile terminal 110 is divided into an item column 301 located at the top of the interface and a file example column 302 located below the item column 301.
  • files that can be synchronously transferred are schematically classified into items such as "photograph”, “gallery”, “music”, “video”, “document”, and the like, and the user can switch between different items.
  • items are merely exemplary, and new items can be added or reduced according to different needs.
  • the files belonging to the item will be displayed according to different sorting methods such as time and file size, preferably by thumbnail, file name, file icon, and the like.
  • more synchronization information between the mobile terminal 110 and the web terminal 120 may be further displayed after step 245.
  • the statistical information of the file to be synchronously transmitted by the mobile terminal 110 is transmitted to the server side 130, and then the information is forwarded to the web terminal 120 via the server side 130 in step 255.
  • the synchronization statistics information includes the number of files to be transferred by the synchronous connection, the file type, and the number of files of each category.
  • Some basic information of the mobile terminal 110 such as an operating system model, mobile phone user basic information, a version model, and the like, may also be included.
  • FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention.
  • the navigation bar 303 located on the left side of the interface and the file statistics column 304 located on the right side of the navigation bar 303 are divided.
  • files that can be synchronously transmitted are schematically classified into "photograph”, “gallery”, “music”, “video”, “document”, “sms", “folder”, “application”, and the like. Project, users can switch between different projects.
  • the number of various files is displayed in the file statistics column 304 according to the type of the file. For example, the exemplary music map in Figure 3b Mark 305a, and the number of music (39) icons 305b below it.
  • some basic information of the transmitted mobile terminal 110 such as the storage capacity information of the mobile terminal 110 presented at 306 below in the file statistics column 304, may also be presented to facilitate the user managing the mobile terminal 110 through the web terminal 120.
  • the disconnection can be achieved by closing the web interface of the web terminal 120 (e.g., a browser) or by closing either or both of the app.
  • the server 130 may also pass to the mobile terminal 110 and the web terminal. 120 sends a heartbeat signal to verify if the connection is still maintained. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130. The server side 130 can then disconnect the connection between the mobile terminal 110 and the web terminal 120.
  • the server 130 determines that the mobile terminal 110 or the web terminal 120 has disconnected from the server 130, the server 130 sends a command to the web terminal 120, and the web terminal 120 returns to the initial unconnected state, for example, The page state of the QR code.
  • the server side 130 also simultaneously sends a command to the mobile terminal 110 such that the mobile terminal 110 also returns to the initially unconnected state. That is, when the server side 130 detects that any one of the mobile terminal 110 or the web terminal 120 is disconnected, the other party is immediately disconnected at the same time to ensure the security of the information.
  • the server end 120 when the mobile terminal 110 or the web terminal 120 is connected to the server side 130 in a mobile network manner (for example, GPRS, 3G, 4G, etc.), the server end 120 can simultaneously detect the mobile terminal when detecting the heartbeat signal. 110 or mobile network cell condition in which web terminal 120 is located. When the cell connected by any one of the mobile terminal 110 or the web terminal 120 is switched, it can be determined that the mobile terminal 110 or the web terminal 120 has left the other party for a physical distance. In order to ensure the security of file transfer, it may be set to disconnect the connection between the mobile terminal 110 and the web terminal 120 after leaving a certain distance.
  • a mobile network manner for example, GPRS, 3G, 4G, etc.
  • FIG. 4 shows a flow chart of a method for synchronous display between web terminal 120 and mobile terminal 110. As shown in Figure 4,
  • the user sends a request to the server 130 via the web terminal 120.
  • the step shows the request.
  • the user can trigger this operational request by clicking on any button on the web terminal 120. For example, click on the "Start" button 306 in Figure 3b.
  • the server 130 forwards the request for synchronization display to the mobile terminal 110.
  • the mobile terminal 110 receives the request and triggers the generation of a long connection address.
  • the long connection is a http long connection.
  • the mobile terminal 415 sends the long connection address to the web terminal 120.
  • the long connection address may be transited by the server 130 and sent to the web terminal 120.
  • the web terminal 120 sends a response confirmation to the mobile terminal 110 establishing a long connection, thereby establishing a long connection with the mobile terminal 110 at the web terminal 120. That is, the web terminal 120 can periodically access the long connection address to maintain the connection with the mobile terminal 110.
  • the response confirmation may be transmitted to the mobile terminal 110 after being relayed by the server 130.
  • the mobile terminal 120 triggers the start of the screen capture operation at a specific time interval.
  • the screen capture operation intercepts an image displayed by the current application running on the mobile terminal 120.
  • the time interval can be arbitrarily set, for example, the screen is intercepted once every 1/10-1/2 second. Preferably, the screen is intercepted once every 1/4 second.
  • the time interval of the screen shot can also be set according to the network condition, for example, when the network condition is good, the time between the adjacent two screen shots is shortened.
  • Step 435 the mobile terminal 110 sequentially sends the screen capture images to the web terminal 120 in the time sequence of interception.
  • step 440 the web terminal 120 sequentially displays the received screenshot images in the received chronological order.
  • the mobile terminal 110 may store the intercepted screen image in a "first in, first out” queue manner, and then take out the screen capture image in the queue from the queue according to a specific time interval, and send it to the web terminal 120.
  • the time interval for taking a screen shot image from the queue may be equal to the time interval of the screen capture operation in step 430.
  • the mobile terminal 110 may not store the intercepted screen image, but send one piece to the web terminal 120 every time one is intercepted. In this way, the connection quality between the mobile terminal 110 and the web terminal 120, especially the drop rate, is higher than that of the previous embodiment.
  • the web terminal 120 may acquire a screen shot image in a manner of accessing the long connection address of the mobile terminal 110. Specifically, the mobile terminal 110 may transmit the address information of the intercepted screen to the web terminal 120, and the web terminal 120 accesses the address to download the required screenshot image.
  • the transmission of the screen shot image may also be performed by the relay of the server side 130.
  • the mobile terminal 110 may first transmit the screen capture image to the storage area opened by the server end 130, and then the server side 130 may sequentially send the screen capture image to the web terminal 120 in the received order.
  • the server 130 can also transfer the storage address of the screenshot image to the web terminal 120, and the web terminal 120 can access the screen capture image according to the address.
  • the web terminal 120 may also open a queue for storing the received screen capture object, and pop-up the screen capture images from the queue in a "first in, first out" manner for display.
  • FIG. 5a-5c schematically illustrate exemplary screen shot images displayed on web terminal 120 in accordance with the method of FIG. 4, respectively.
  • Figure 5a shows the screen display presented when the user selects the "Gallery” item
  • Figure 5b shows the screen display that is presented when the user switches to the "Music” item by swiping the screen to the left
  • Figure 5c shows Is the screen display that is presented when the user switches to the Music item.
  • the user can experience a coherent display effect when the web terminal 120 is displayed. Even the intermediate effect presented by the user during the process of switching screens (as in Figure 5b) will be fully presented to the web terminal 120 by means of screencast transmission. Therefore, the effect of presentation is as if the user directly operated the web terminal 120 through the mobile terminal 110.
  • a user can implement a synchronous, high-speed, stable, and user-friendly interactive display scheme between the mobile electronic device and the web terminal having the web interface.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Provided in the present invention is a method for implementing synchronous display between a mobile terminal and a web terminal, the mobile terminal and the web terminal respectively communicating via a network with a cloud-based server, the method comprising the following steps: a) sending a synchronous display request to the server by means of the web terminal; b) the server forwarding the synchronous display request to the mobile terminal; c) the mobile terminal receiving the request, triggering the generation of a long connection address; d) the mobile terminal sends the long connection address to the web terminal; e) the web terminal sends a long address establishment acknowledgement to the mobile terminal; f) after receiving the acknowledgement, the mobile terminal triggers the start of the implementation of a screenshot operation at specific time intervals; g) the mobile terminal sequentially sends to the web terminal the screenshot images ordered according to the time of acquisition; and h) the web terminal sequentially displays the received screenshot images ordered according to the time of receipt.

Description

用于在移动设备和web终端之间进行同步显示的方法Method for synchronous display between a mobile device and a web terminal 技术领域Technical field
本发明总体上涉及移动通信领域,特别地,涉及一种在移动终端和web终端之间进行互连以及实现二者之间同步显示的方法和***。The present invention generally relates to the field of mobile communications, and in particular, to a method and system for interconnecting between a mobile terminal and a web terminal and for enabling simultaneous display therebetween.
背景技术Background technique
目前,例如移动电话、平板电脑、移动媒体播放器的移动电子设备已经在人们日常生活中越来越流行使用。移动设备已经有逐渐取代传统个人电脑的趋势,成为个人信息的存储中心。然而,个人电脑在很多应用领域中,凭借其大幅的显示屏幕、便利的输入方式以及更为多样的软件和操作***仍然有其不可替代的作用。因此人们在日常生活中,经常需要在移动设备和个人电脑之间进行信息的传递、同步显示和交互。Currently, mobile electronic devices such as mobile phones, tablets, and mobile media players have become increasingly popular in people's daily lives. Mobile devices have gradually replaced traditional PCs and become the storage center for personal information. However, personal computers still have an irreplaceable role in many applications, with their large display screens, convenient input methods, and a wider variety of software and operating systems. Therefore, in daily life, people often need to transfer information, synchronize display and interaction between mobile devices and personal computers.
传统的在移动电子设备和个人电脑之间同步显示的方法例如使用数据线、视频/音频线等将个人电脑与电子设备连接,并通过运行特定的软件来实现。但这些方法是非常麻烦的,用户的体验十分不好。例如,数据线的方式使得用户需要额外准备硬件,为用户带来不便。另外,很多时候需要额外安装驱动程序才能实现除了传输文件之外的其他更为复杂的功能。数据线的连接还会对设备的硬件接口有特殊的要求,例如常用的HDMI接口,只在比较新的电脑设备上才进行配置,稍微陈旧的型号均没有配置,使得连接无法实现。A conventional method of synchronizing display between a mobile electronic device and a personal computer, for example, connects a personal computer to an electronic device using a data line, a video/audio line, etc., and is implemented by running specific software. But these methods are very cumbersome and the user experience is very bad. For example, the way of the data line makes the user need to prepare additional hardware, which is inconvenient for the user. In addition, many additional drivers are required to implement more complex functions than transferring files. The connection of the data cable also has special requirements for the hardware interface of the device. For example, the commonly used HDMI interface is only configured on a relatively new computer device, and the slightly old model is not configured, so that the connection cannot be realized.
此外,WiFi技术可以提供移动电子设备和个人电脑之间的同步显示和传输。然而,在以往常规的用WiFi技术实现同步显示的方案中,通常需要接入点(AP)。接入点用作在移动电子设备和个人电脑之间的无线网络中继,个人电脑和移动设备必须同时连接到该无线网络中继上才能实现互连。在由AP为主导形成的网络中,如果断开AP,那会破坏整个网络,同时也会破坏移动设备和个人电脑之间的连接。In addition, WiFi technology provides simultaneous display and transmission between mobile electronic devices and personal computers. However, in the conventional conventional scheme of implementing synchronous display using WiFi technology, an access point (AP) is usually required. The access point acts as a wireless network relay between the mobile electronic device and the personal computer, and the personal computer and the mobile device must be connected to the wireless network relay at the same time to achieve interconnection. In a network dominated by APs, if the AP is disconnected, it will destroy the entire network and also damage the connection between the mobile device and the personal computer.
蓝牙技术等短距离近场通信技术现在也已经越来越多被用来实现在移动电子设备之间传输数据从而实现同步的显示。然而,蓝牙技术通常无法提供高速的数据传输速度。另外,个人电脑通常并不是都配备有蓝牙模 块,从而使得双向连接通信无法实现。Short-range near-field communication technologies such as Bluetooth technology are now increasingly being used to transfer data between mobile electronic devices for synchronized display. However, Bluetooth technology often does not provide high speed data transfer speeds. In addition, personal computers are usually not equipped with Bluetooth modules. Blocks, making bidirectional connection communication impossible.
另外,由于智能手机的多功能性和便携性,用户经常通过智能手机拍摄照片、录制音乐、视频等,而受限于智能手机较小的屏幕,用户时常需要在个人电脑或其他大屏幕显示器上展示或观看手机上的内容,例如手机上存储的照片等。因此如何能够在移动电子设备和个人电脑互连的基础上稳定高速地同步显示这些文件,也是本领域亟待解决的一个问题。In addition, due to the versatility and portability of smartphones, users often take photos, record music, videos, etc. through their smartphones, which are limited by the smaller screen of the smartphone, and users often need to be on a personal computer or other large-screen display. Show or watch content on your phone, such as photos stored on your phone. Therefore, how to stably and simultaneously display these files on the basis of the interconnection of mobile electronic devices and personal computers is also an urgent problem to be solved in the art.
因此,需要一种在移动电子设备和个人电脑之间实现可靠、高速的同步显示方案,从而解决现有技术中的上述问题。Therefore, there is a need for a reliable, high speed synchronous display scheme between a mobile electronic device and a personal computer to solve the above problems in the prior art.
发明内容Summary of the invention
本发明的目的在于提供一种用于在移动设备和web终端之间进行同步显示的方法,所述移动终端和web终端通过网络分别与位于云端的服务器端通信连接,所述方法包括以下步骤:a)通过所述web终端向所述服务器端发出同步显示的请求;b)所述服务器端向所述移动终端转发该同步显示的请求;c)所述移动终端收到该请求,触发生成长连接地址;d)所述移动终端将该长连接地址发送给所述web终端;e)所述web终端向所述移动终端发送建立长连接的应答确认;f)所述移动终端收到应答确认后,触发开始按特定的时间间隔进行截屏操作;g)所述移动终端将截屏图像按截取的时间顺序依次发送给web终端;和h)所述web终端按接收到的时间顺序依次显示所接收到的截屏图像。An object of the present invention is to provide a method for synchronous display between a mobile device and a web terminal, wherein the mobile terminal and the web terminal are respectively connected to a server end located in the cloud through a network, and the method includes the following steps: a) issuing, by the web terminal, a request for synchronous display to the server; b) the server forwards the synchronous display request to the mobile terminal; c) the mobile terminal receives the request, triggering generation of a long a connection address; d) the mobile terminal transmitting the long connection address to the web terminal; e) the web terminal transmitting a response confirmation to establish establishment of a long connection to the mobile terminal; f) the mobile terminal receiving a response confirmation Afterwards, the triggering starts to perform a screen capture operation at a specific time interval; g) the mobile terminal sequentially sends the screen capture images to the web terminal in the time sequence of interception; and h) the web terminal sequentially displays the received in the received time sequence The screen shot to.
优选地,所述步骤c中的长连接为http长连接。Preferably, the long connection in the step c is an http long connection.
优选地,所述步骤d中该长连接地址通过服务器端进行中转后发送给web终端。Preferably, in the step d, the long connection address is transited by the server and then sent to the web terminal.
优选地,所述步骤f中的截屏操作时间间隔为每1/10-1/2秒截取屏幕一次。Preferably, the screen capture operation time interval in the step f is to intercept the screen once every 1/10-1/2 seconds.
优选地,所述截屏操作时间间隔为每1/4秒截取屏幕一次。Preferably, the screen capture operation time interval is to intercept the screen once every 1/4 second.
优选地,所述移动终端将截取的屏幕图像以先进先出的队列方式进行存储,再按照特定的时间间隔从队列中取出队列中的截屏图像,发送给所述web终端。Preferably, the mobile terminal stores the intercepted screen image in a first-in-first-out queue manner, and then takes out the screen capture image in the queue from the queue according to a specific time interval, and sends the screen capture image to the web terminal.
优选地,所述移动终端将所截取屏幕的地址信息发送给web终端,所述web终端访问该地址下载所需的截屏图像。Preferably, the mobile terminal sends the address information of the intercepted screen to the web terminal, and the web terminal accesses the screenshot image required for the address download.
优选地,所述截屏图像的传输经过所述服务器端的中转来进行。Preferably, the transmission of the screen shot image is performed by a relay of the server end.
优选地,所述web终端以先进先出的队列方式存储收到的截屏图 片,从队列中依次弹出截屏图像进行显示。Preferably, the web terminal stores the received screenshot in a first-in, first-out queue manner. Slices, pop-up screen images from the queue in turn for display.
优选地,在所述步骤a)之前,所述web终端和所述移动终端之间通过下列步骤建立连接:a01)由所述web终端向所述服务器端发出连接请求;a02)所述服务器端向所述web终端发送二维码信息;a03)通过所述移动终端扫描所述二维码信息;a04)响应于所述扫描二维码的操作,所述移动终端和所述web终端分别向所述服务器端发送自身的网络连接状况;a05)所述服务器端获取所述移动终端和所述web终端各自连接到服务器端的网络状况,判断所述移动终端和所述web终端的网络连接是否处于同一局域网下,并针对是否处于同一局域网络将网络状况标志符设置不同的状态;a06)所述服务器端分别向所述移动终端和所述web终端发送连接建立许可,在所述移动终端和所述web终端之间建立连接。Preferably, before the step a), the connection between the web terminal and the mobile terminal is established by the following steps: a01) issuing a connection request by the web terminal to the server end; a02) the server end Transmitting two-dimensional code information to the web terminal; a03) scanning the two-dimensional code information by the mobile terminal; a04) in response to the operation of scanning the two-dimensional code, the mobile terminal and the web terminal respectively The server sends its own network connection status; a05) the server obtains the network status of the mobile terminal and the web terminal respectively connected to the server, and determines whether the network connection between the mobile terminal and the web terminal is Under the same local area network, and setting the network status identifiers to different states according to whether they are in the same local area network; a06) the server end respectively sends a connection establishment permission to the mobile terminal and the web terminal, where the mobile terminal and the mobile terminal Establish a connection between the web terminals.
根据本发明的方法和***,用户可以在移动电子设备和具有web接口的web终端之间实现可靠、高速、稳定、用户交互体验更好的同步显示方案。According to the method and system of the present invention, a user can implement a synchronous, high-speed, stable, and user-friendly interactive display scheme between a mobile electronic device and a web terminal having a web interface.
应当理解,前述大体的描述和后续详尽的描述均为示例性说明和解释,并不应当用作对本发明所要求保护内容的限制。It is to be understood that the foregoing general descriptions
附图说明DRAWINGS
参考随附的附图,本发明更多的目的、功能和优点将通过本发明实施方式的如下描述得以阐明,其中:Further objects, features, and advantages of the present invention will be made apparent by the following description of the embodiments of the invention.
图1a和图1b示意性示出根据本发明的在移动终端和web终端之间借助服务器端进行互连的***框图。1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
图2示意性示出了根据本发明的在移动终端和web终端之间借助服务器端进行互连的交互流程图。Fig. 2 schematically shows an interaction flow diagram for interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
图3a示意性地示出了根据本发明一个实施例的示例性移动终端110的连接界面。FIG. 3a schematically illustrates a connection interface of an exemplary mobile terminal 110 in accordance with one embodiment of the present invention.
图3b示意性地示出了根据本发明一个实施例的示例性web终端120的连接呈现界面。FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention.
图4示意性地示出了根据本发明在web终端120和移动终端110之间进行同步显示的方法流程图。4 is a flow chart diagrammatically showing a method of synchronous display between web terminal 120 and mobile terminal 110 in accordance with the present invention.
图5a-图5c分别示意性地示出了根据图4的方法在web终端120上显示的示例性截屏图像。 5a-5c schematically illustrate exemplary screen shot images displayed on web terminal 120 in accordance with the method of FIG. 4, respectively.
具体实施方式detailed description
通过参考示范性实施例,本发明的目的和功能以及用于实现这些目的和功能的方法将得以阐明。然而,本发明并不受限于以下所公开的示范性实施例;可以通过不同形式来对其加以实现。说明书的实质仅仅是帮助相关领域技术人员综合理解本发明的具体细节。Objects and functions of the present invention, and methods for achieving the objects and functions will be clarified by referring to the exemplary embodiments. However, the invention is not limited to the exemplary embodiments disclosed below; it can be implemented in various forms. The essence of the description is merely to assist those skilled in the relevant art to understand the specific details of the invention.
在下文中,将参考附图描述本发明的实施例。在附图中,相同的附图标记代表相同或类似的部件,或者相同或类似的步骤。Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the figures, the same reference numerals are used to refer to the same or similar parts, or the same or similar steps.
***概述System Overview
图1a和图1b示意性示出根据本发明的在移动终端和web终端之间借助服务器端进行互连的***框图。其中图1a示意性示出根据本发明的在移动终端和web终端之间借助服务器端进行互连的***框图,图1b示出了包含服务器端的具体架构和组成的***框图。如图1a所示,***100包括至少一个移动终端110、至少一个web终端120,以及用于实现在移动终端110和web终端120之间进行互连以实现交互式通信的位于远程的服务器端130。移动终端110和web终端120分别通过第一网络140与服务器端130连接,移动终端110和web终端120彼此之间通过第二网络150连接。出于示意性的目的,图1仅示出了一个移动终端110和一个web终端120。然而,可以理解的是在其他实施方式中,***100可以包括更多的移动终端110和/或更多的web终端120。在根据本发明的一个实施方式中,当***100具有多个移动终端110和多个web终端120时,每个移动终端110都有唯一的web终端120与其唯一相对应。1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention. 1a schematically shows a system block diagram for interconnection between a mobile terminal and a web terminal by means of a server side according to the present invention, and FIG. 1b shows a system block diagram including a specific architecture and composition of the server side. As shown in FIG. 1a, system 100 includes at least one mobile terminal 110, at least one web terminal 120, and a remotely located server side 130 for enabling interconnection between mobile terminal 110 and web terminal 120 for interactive communication. . The mobile terminal 110 and the web terminal 120 are respectively connected to the server side 130 through the first network 140, and the mobile terminal 110 and the web terminal 120 are connected to each other through the second network 150. For illustrative purposes, FIG. 1 shows only one mobile terminal 110 and one web terminal 120. However, it will be appreciated that in other embodiments, system 100 can include more mobile terminals 110 and/or more web terminals 120. In one embodiment in accordance with the present invention, when system 100 has multiple mobile terminals 110 and multiple web terminals 120, each mobile terminal 110 has a unique web terminal 120 that uniquely corresponds to it.
移动终端110和web终端120可分别经过任意类型的第一网络140与服务器端130之间进行双向通信。所述第一网络140例如选自诸如内联网之类的局域网(“LAN”)和诸如互联网之类的广域网(“WAN”)。第一网络140可被配置为支持利用多种协议设置格式的信息的传输。另外,第一网络140可以是公共网络、专用网络或其组合。第一网络140还可以利用任何一种或多种类型的物理介质来实现,其中包括与多个服务提供商相关联的有线通信路径和无线通信路径。无线通信方式例如WiFi或WLAN、GPRS、蜂窝网络,例如GSM网络、3G网络、LTE网络或CDMA网络。 The mobile terminal 110 and the web terminal 120 can communicate bidirectionally with the server side 130 via any type of first network 140, respectively. The first network 140 is, for example, selected from a local area network ("LAN") such as an intranet and a wide area network ("WAN") such as the Internet. The first network 140 can be configured to support the transmission of information using a plurality of protocol setting formats. Additionally, the first network 140 can be a public network, a private network, or a combination thereof. The first network 140 can also be implemented using any one or more types of physical media, including wired communication paths and wireless communication paths associated with multiple service providers. Wireless communication methods such as WiFi or WLAN, GPRS, cellular networks, such as GSM networks, 3G networks, LTE networks, or CDMA networks.
移动终端110和web终端120之间也可以之间建立直接的网络连接,通过第二网络150进行双向通信。所述第二网络150采用的协议方式例如是http轮询结合WebSocket直连的方式。A direct network connection can also be established between the mobile terminal 110 and the web terminal 120, and two-way communication is performed through the second network 150. The protocol mode adopted by the second network 150 is, for example, a manner in which http polling is combined with WebSocket direct connection.
移动终端110可以是智能电话、个人数字助理(PDA)、平板电脑、多功能移动终端或者包括计算功能和数据通信能力的任何其他移动设备。移动终端110包括app接口应用111(如图1b所示)及其包含的截屏单元112。App应用111例如定制应用(app),用于与具备web能力的应用进行双向通信。The mobile terminal 110 can be a smart phone, a personal digital assistant (PDA), a tablet, a multi-function mobile terminal, or any other mobile device that includes computing functionality and data communication capabilities. The mobile terminal 110 includes an app interface application 111 (shown in FIG. 1b) and a screen capture unit 112 included therein. The App application 111 is, for example, a custom application (app) for two-way communication with web-enabled applications.
截屏单元112用于按照特定的时间间隔截取app应用当前显示的页面,并将所截取的页面发送给web终端120进行显示。具体的截屏方法步骤将在下文描述本发明的方法流程时详细介绍。The screen capture unit 112 is configured to intercept the currently displayed page of the app application according to a specific time interval, and send the intercepted page to the web terminal 120 for display. The specific screen capture method steps will be described in detail below when describing the method flow of the present invention.
web终端120可以是台式计算机、膝上型计算机、笔记本电脑、平板电脑、游戏机、智能电视等任何支持web协议的终端设备。web终端120包括web接口121(如图1b所示)。web接口121例如web浏览器。在一些实施例中,相应web终端120包括用于请求、解析、显示、执行网页以及执行包括在网页中的应用的浏览器应用。浏览器应用128可以是允许用户搜索、浏览和/或使用URL(统一资源定位符)或URI(统一资源标识符)所识别的资源(例如,网页和web服务)的任何应用。“URL”在本文用来意指文档的网络地址或位置。在该情形下,“文档”指可以由web浏览器或其他应用使用的任何格式的任何文档或内容,包括但不限于:字处理文档、电子表格文档、演示文档、绘图、网页、文本、图像、音频、视频等。The web terminal 120 can be any terminal device that supports a web protocol, such as a desktop computer, a laptop computer, a notebook computer, a tablet computer, a game console, a smart TV, and the like. The web terminal 120 includes a web interface 121 (as shown in Figure 1b). The web interface 121 is, for example, a web browser. In some embodiments, the respective web terminal 120 includes a browser application for requesting, parsing, displaying, executing a web page, and executing an application included in the web page. Browser application 128 may be any application that allows a user to search, browse, and/or use resources (eg, web pages and web services) identified by a URL (Uniform Resource Locator) or URI (Uniform Resource Identifier). "URL" is used herein to mean the network address or location of a document. In this context, "document" refers to any document or content in any format that can be used by a web browser or other application, including but not limited to: word processing documents, spreadsheet documents, presentation documents, drawings, web pages, text, images. , audio, video, etc.
移动终端110包括一个或多个计算设备,该一个或多个计算设备可以从用户接收输入,并可呈现输出,因此移动终端110还包括I/O接口(输入/输出接口)112,可接收一个或多个输入并呈现输出。例如,输入接口可包括摄像头、触摸板、触摸屏、触屏笔、麦克风中的一个或多个。另外,通过输出接口可呈现输出,以输出用户的控制操作指令或来自其他用户的反馈信息等。输出接口包括显示屏、一个或多个扬声器和触觉接口中的一个或多个。The mobile terminal 110 includes one or more computing devices that can receive input from a user and can present an output, such that the mobile terminal 110 further includes an I/O interface (input/output interface) 112 that can receive one Or multiple inputs and present the output. For example, the input interface can include one or more of a camera, a touchpad, a touch screen, a stylus, and a microphone. In addition, an output can be presented through the output interface to output a user's control operation instructions or feedback information from other users, and the like. The output interface includes one or more of a display screen, one or more speakers, and a tactile interface.
图1b示出了包含服务器端的具体架构和组成的***框图。如图1b所示,服务器端130包括二维码模块131、网络接入模块132、网络状况标志符133和地址生成模块134。Figure 1b shows a system block diagram containing the specific architecture and composition of the server side. As shown in FIG. 1b, the server side 130 includes a two-dimensional code module 131, a network access module 132, a network status identifier 133, and an address generation module 134.
二维码模块131用于生成供移动终端110扫描的二维码。根据本发 明的一个实施例,二维码包含了通用唯一识别码(UUID),UUID是唯一标识码。移动终端110通过扫描该二维码表应的UUID连接到服务器端130以请求获取唯一的连接地址和会话(session)。The two-dimensional code module 131 is configured to generate a two-dimensional code for scanning by the mobile terminal 110. According to this issue In one embodiment of the invention, the two-dimensional code contains a Universally Unique Identifier (UUID), which is a unique identification code. The mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
网络接入模块132用于相应移动终端110扫描二维码成功后判断移动终端110和web终端120各自的网络连接状况,以针对不同的网络连接状况进行移动终端110和web终端120之间的适配性连接,从而建立移动终端110和web终端120之间的连接。优选地,所建立的连接为http长连接。该连接可以连续发送多个数据包,在连接保持期间,如果没有数据包发送,为了确保两个终端保持连接,会在规定间隔时间内发送检测数据包(即心跳包),移动终端110和web终端120之间需要发送检测数据包以维持此连接。The network access module 132 is configured to determine the network connection status of the mobile terminal 110 and the web terminal 120 after the corresponding mobile terminal 110 scans the two-dimensional code, so as to perform appropriate connection between the mobile terminal 110 and the web terminal 120 for different network connection conditions. The connections are made to establish a connection between the mobile terminal 110 and the web terminal 120. Preferably, the established connection is an http long connection. The connection can continuously send multiple data packets. If there is no data packet transmission during the connection hold period, in order to ensure that the two terminals remain connected, the detection data packet (ie, heartbeat packet) is sent within a predetermined interval, the mobile terminal 110 and the web. A detection packet needs to be sent between the terminals 120 to maintain the connection.
具体地,网络接入模块132获取移动终端110和web终端120各自连接到服务器端130的网络状态,判断移动终端110和web终端120的网络连接是否处于同一网络下。根据本发明的同一网络是指在同一个路由器下同一网段能直接连接,而不需要经过外网。Specifically, the network access module 132 obtains the network status that the mobile terminal 110 and the web terminal 120 are respectively connected to the server end 130, and determines whether the network connection of the mobile terminal 110 and the web terminal 120 are under the same network. The same network according to the present invention means that the same network segment can be directly connected under the same router without going through the external network.
并针对是否处于同一局域网络将网络状况标志符133设置不同的状态。例如,若处于同一网络内,则在网络状况标志符133中设置一标识,例如数字1;若不处于同一网络,则不在网络状况标志符133中设置标识,或者设置另一不同的标识,例如数字0。The network status indicator 133 is set to a different state depending on whether it is in the same local area network. For example, if it is in the same network, an identifier, such as the number 1, is set in the network status indicator 133; if not in the same network, the identifier is not set in the network status indicator 133, or another different identifier is set, for example The number is 0.
根据本发明的一个实施例,网络接入模块132会定期地获取移动终端110和web终端120各自连接到服务器的网络状态,以判断移动终端110和web终端120的网络连接是否处于同一局域网下的状态是否发生变化,并针对变化了的网络状态更新网络状况标志符133。所述定期获取的频率例如可以是每30秒一次。该定期发送的信号也被称为“心跳信号”,该信号还可以用来检测移动终端110和web终端120是否仍连接到服务器端130。例如当未接收到移动终端110或web终端120反馈的心跳响应信号超过一定的次数,服务器端130即可判断移动终端110或web终端120已经断开与服务器端130的连接。According to an embodiment of the present invention, the network access module 132 periodically acquires the network status of each of the mobile terminal 110 and the web terminal 120 connected to the server to determine whether the network connection of the mobile terminal 110 and the web terminal 120 is under the same local area network. Whether the status changes and updates the network status indicator 133 for the changed network status. The frequency of the periodic acquisition may be, for example, once every 30 seconds. The periodically transmitted signal is also referred to as a "heartbeat signal" and can also be used to detect whether the mobile terminal 110 and the web terminal 120 are still connected to the server side 130. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130.
网络状况标志符133用于存储移动终端110和web终端120之间由于不同的网络连接状况而产生适配性连接的标识。例如,移动终端110和web终端120处于同一网络内,网络状况标志符133中设置一标识;若不处于同一网络,则设置另一不同的标识。The network status indicator 133 is used to store an identification of the adaptive connection between the mobile terminal 110 and the web terminal 120 due to different network connection conditions. For example, the mobile terminal 110 and the web terminal 120 are in the same network, and an identifier is set in the network status identifier 133; if not in the same network, another different identifier is set.
地址生成模块134,用于生成需要在移动终端110和web终端120 之间传送的文件地址。当移动终端110和web终端120之间根据本发明的方法建立了连接之后,用户可以选择通过移动终端110上传文件至Web终端120,或者从Web终端120下载文件到移动终端110上。当用户发出此类移动文件的请求时,地址生成模块134为所传送的文件生成基于网络的地址,例如URL,传送给需要下载文件的移动终端110或web终端120,移动终端110和web终端120只需访问该地址即可下载到该文件,从而实现文件的传送。An address generation module 134, configured to generate at the mobile terminal 110 and the web terminal 120 The file address transferred between. After the connection is established between the mobile terminal 110 and the web terminal 120 in accordance with the method of the present invention, the user may select to upload a file to the web terminal 120 via the mobile terminal 110 or download the file from the web terminal 120 to the mobile terminal 110. When the user issues such a request to move the file, the address generation module 134 generates a network-based address, such as a URL, for the transmitted file, to the mobile terminal 110 or web terminal 120 that needs to download the file, the mobile terminal 110 and the web terminal 120. Simply access the address to download the file to transfer the file.
交互方式interactive mode
图2示出了用户通过移动终端110借助服务器端130与web终端120进行交互连接的方法流程图。如图2所示,2 shows a flow chart of a method for a user to interact with the web terminal 120 via the server terminal 130 via the mobile terminal 110. as shown in picture 2,
在步骤205,用户通过web终端120向服务器端130发出连接请求。具体地,用户可以通过启动web终端120上的浏览器,并在浏览器地址栏中输入www.****.cc的地址信息来发送连接请求。At step 205, the user sends a connection request to the server side 130 via the web terminal 120. Specifically, the user can send a connection request by launching a browser on the web terminal 120 and entering address information of www.****.cc in the browser address bar.
接着,在步骤210,服务器端130会应web终端120发出的连接请求发送二维码信息给web终端120,并在步骤220中在web终端120上呈现该二维码信息。所述二维码信息包含了通用唯一识别码(UUID),UUID是唯一标识码。移动终端110通过扫描该二维码表应的UUID连接到服务器端130以请求获取唯一的连接地址和会话(session)。Next, in step 210, the server 130 sends the QR code information to the web terminal 120 in response to the connection request sent by the web terminal 120, and presents the two-dimensional code information on the web terminal 120 in step 220. The two-dimensional code information includes a universal unique identification code (UUID), and the UUID is a unique identification code. The mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
接下来,在步骤225,用户通过移动终端110扫描web终端120上的二维码信息。例如,通过移动终端110上带有的摄像头进行扫描。具体地,用户启动移动终端110上的app软件,app软件会提示用户扫描二维码从而实现连接。Next, at step 225, the user scans the two-dimensional code information on the web terminal 120 through the mobile terminal 110. For example, scanning is performed by a camera carried on the mobile terminal 110. Specifically, the user activates the app software on the mobile terminal 110, and the app software prompts the user to scan the two-dimensional code to implement the connection.
接着,响应于用户扫描二维码的操作,移动终端110和web终端120分别在步骤230a和步骤230b向服务器端发起连接请求,并将自身的网络连接状况发送给服务器端130。具体的,所述网络连接状况为通过何种网络连接至服务器端。Next, in response to the user's operation of scanning the two-dimensional code, the mobile terminal 110 and the web terminal 120 initiate a connection request to the server side in steps 230a and 230b, respectively, and transmit their own network connection status to the server side 130. Specifically, the network connection status is a network connection to the server end.
在步骤235,服务器端130通过获取的移动终端110和web终端120各自连接到服务器的网络状况,判断移动终端110和web终端120的网络连接是否处于同一局域网下,并针对是否处于同一局域网络将网络状况标志符设置不同的状态。例如,若处于同一网络内,则在网络状况标志符133中设置一标识,例如数字1;若不处于同一网络,则不在 网络状况标志符133中设置标识,或者设置另一不同的标识,例如数字0。In step 235, the server side 130 determines whether the network connection of the mobile terminal 110 and the web terminal 120 is under the same local area network by acquiring the network status of the mobile terminal 110 and the web terminal 120 respectively connected to the server, and whether the network connection is in the same local area network. The network status indicator sets a different status. For example, if it is in the same network, an identifier is set in the network status indicator 133, such as the number 1; if not in the same network, it is not An identifier is set in the network status indicator 133, or another different identifier is set, such as the number 0.
接着,服务器端130分别在步骤240a和步骤240b向移动终端110和web终端120发送连接建立许可,从而在移动终端110和web终端120之间建立连接。优选地,建立http长连接。Next, the server side 130 transmits a connection establishment permission to the mobile terminal 110 and the web terminal 120 in steps 240a and 240b, respectively, thereby establishing a connection between the mobile terminal 110 and the web terminal 120. Preferably, a http long connection is established.
接着,在步骤245,在移动终端110呈现连接后的界面。图3a示意性地示出了根据本发明一个实施例的示例性移动终端110的连接界面。如图3a所示,移动终端110的呈现界面中,分为位于界面顶部的项目栏301和位于项目栏301下方的文件示例栏302。在项目栏301中,将可以同步传输的文件示意性地分为“照片”、“图库”、“音乐”、“视频”、“文档”等项目,用户可以在不同项目之间进行切换。本领域技术人员可以理解的是,上述项目仅仅是示例性的,可以根据不同需求增加或减少新的项目。在每个选中的项目下,会按照时间、文件大小等不同的分类排序方式对属于该项目的文件进行展示,优选以缩略图、文件名、文件图标等方式进行展示。Next, at step 245, the connected interface is presented at the mobile terminal 110. FIG. 3a schematically illustrates a connection interface of an exemplary mobile terminal 110 in accordance with one embodiment of the present invention. As shown in FIG. 3a, the presentation interface of the mobile terminal 110 is divided into an item column 301 located at the top of the interface and a file example column 302 located below the item column 301. In the item column 301, files that can be synchronously transferred are schematically classified into items such as "photograph", "gallery", "music", "video", "document", and the like, and the user can switch between different items. Those skilled in the art can understand that the above items are merely exemplary, and new items can be added or reduced according to different needs. Under each selected item, the files belonging to the item will be displayed according to different sorting methods such as time and file size, preferably by thumbnail, file name, file icon, and the like.
根据本发明的一个实施例,在步骤245之后还可以进一步显示更多的移动终端110和web终端120之间的同步信息。如图2所示,在步骤250,将移动终端110要进行同步传送的文件的统计信息发送至服务器端130,再在步骤255中经服务器端130将这些信息转发至web终端120。优选地,所述同步统计信息包括要进行同步连接传送的文件数目、文件种类、每个种类各自的文件数目。还可以包括移动终端110的一些基本信息,如操作***型号、手机用户基本信息、版本型号等等。According to an embodiment of the present invention, more synchronization information between the mobile terminal 110 and the web terminal 120 may be further displayed after step 245. As shown in FIG. 2, in step 250, the statistical information of the file to be synchronously transmitted by the mobile terminal 110 is transmitted to the server side 130, and then the information is forwarded to the web terminal 120 via the server side 130 in step 255. Preferably, the synchronization statistics information includes the number of files to be transferred by the synchronous connection, the file type, and the number of files of each category. Some basic information of the mobile terminal 110, such as an operating system model, mobile phone user basic information, a version model, and the like, may also be included.
接着在步骤260,在web终端120呈现连接后的界面,并同时呈现经服务器端130转发的同步统计信息。图3b示意性地示出了根据本发明一个实施例的示例性web终端120的连接呈现界面。如图3b所示,在web终端120的呈现界面中,分为位于界面左侧的导航栏303和位于导航栏303右侧的文件统计栏304。在导航栏303中,将可以同步传输的文件示意性地分为“照片”、“图库”、“音乐”、“视频”、“文档”、“短信”、“文件夹”、“应用”等项目,用户可以在不同项目之间进行切换。还可以增加“主页”项目以浏览总体的文件统计信息。本领域技术人员可以理解的是,上述项目仅仅是示例性的,可以根据不同需求增加或减少新的项目。在“主页”项目下,在文件统计栏304中会按照文件的类型展示各种文件的数量。例如图3b中示例性的音乐图 标305a,以及其下方的音乐数量(39)图标305b。另外,还可以呈现所传送的移动终端110的一些基本信息,例如在文件统计栏304中下方的306处呈现的移动终端110的存储容量信息,以便于用户通过web终端120管理移动终端110。Next, at step 260, the connected interface is presented at the web terminal 120, and the synchronization statistics forwarded by the server 130 are simultaneously presented. FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention. As shown in FIG. 3b, in the presentation interface of the web terminal 120, the navigation bar 303 located on the left side of the interface and the file statistics column 304 located on the right side of the navigation bar 303 are divided. In the navigation bar 303, files that can be synchronously transmitted are schematically classified into "photograph", "gallery", "music", "video", "document", "sms", "folder", "application", and the like. Project, users can switch between different projects. You can also add a Home page item to view overall file statistics. Those skilled in the art can understand that the above items are merely exemplary, and new items can be added or reduced according to different needs. Under the "Home" item, the number of various files is displayed in the file statistics column 304 according to the type of the file. For example, the exemplary music map in Figure 3b Mark 305a, and the number of music (39) icons 305b below it. In addition, some basic information of the transmitted mobile terminal 110, such as the storage capacity information of the mobile terminal 110 presented at 306 below in the file statistics column 304, may also be presented to facilitate the user managing the mobile terminal 110 through the web terminal 120.
当用户需要将web终端120和移动终端110断开连接时,可以通过关闭web终端120的web接口(例如浏览器)或者关闭app应用任意一者或二者来实现断开。When the user needs to disconnect the web terminal 120 and the mobile terminal 110, the disconnection can be achieved by closing the web interface of the web terminal 120 (e.g., a browser) or by closing either or both of the app.
根据本发明的另一实施例,当用户未主动断开连接时,或者用户断开移动终端110或web终端120任意一者的网络连接时,服务器端130也可以通过向移动终端110和web终端120发送心跳信号来检验是否仍然保持连接。例如,当未接收到移动终端110或web终端120反馈的心跳响应信号超过一定的次数,服务器端130即可判断移动终端110或web终端120已经断开与服务器端130的连接。服务器端130于是可以断开移动终端110和web终端120之间的连接。具体地,当服务器端130判断出移动终端110或web终端120已经断开与服务器端130的连接后,服务器端130向web终端120发送命令,web终端120返回到初始未连接的状态,例如,呈现二维码的页面状态。服务器端130同时还向移动终端110发送命令,使得移动终端110也返回至初始未连接的状态。也即,当服务器端130检测到移动终端110或web终端120其中任意一者断开连接时,会立即同时断开另一者,以确保信息的安全。According to another embodiment of the present invention, when the user does not actively disconnect, or the user disconnects the network connection of any of the mobile terminal 110 or the web terminal 120, the server 130 may also pass to the mobile terminal 110 and the web terminal. 120 sends a heartbeat signal to verify if the connection is still maintained. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130. The server side 130 can then disconnect the connection between the mobile terminal 110 and the web terminal 120. Specifically, when the server 130 determines that the mobile terminal 110 or the web terminal 120 has disconnected from the server 130, the server 130 sends a command to the web terminal 120, and the web terminal 120 returns to the initial unconnected state, for example, The page state of the QR code. The server side 130 also simultaneously sends a command to the mobile terminal 110 such that the mobile terminal 110 also returns to the initially unconnected state. That is, when the server side 130 detects that any one of the mobile terminal 110 or the web terminal 120 is disconnected, the other party is immediately disconnected at the same time to ensure the security of the information.
根据本发明的一个实施例,当移动终端110或web终端120以移动网络方式(例如GPRS、3G、4G等)连接到服务器端130时,服务器端120可以在检测心跳信号时,同时检测移动终端110或web终端120所处的移动网络小区状况。当移动终端110或web终端120其中任意一者所连接的小区发生切换时,可以判断出移动终端110或web终端120已经离开另一者一段物理距离。为了确保文件传送的安全性,可以设定在移动终端110和web终端120两者离开特定的距离后,断开两者之间的连接。According to an embodiment of the present invention, when the mobile terminal 110 or the web terminal 120 is connected to the server side 130 in a mobile network manner (for example, GPRS, 3G, 4G, etc.), the server end 120 can simultaneously detect the mobile terminal when detecting the heartbeat signal. 110 or mobile network cell condition in which web terminal 120 is located. When the cell connected by any one of the mobile terminal 110 or the web terminal 120 is switched, it can be determined that the mobile terminal 110 or the web terminal 120 has left the other party for a physical distance. In order to ensure the security of file transfer, it may be set to disconnect the connection between the mobile terminal 110 and the web terminal 120 after leaving a certain distance.
同步显示方式Synchronous display mode
图4示出了在web终端120和移动终端110之间进行同步显示的方法流程图。如图4所示,FIG. 4 shows a flow chart of a method for synchronous display between web terminal 120 and mobile terminal 110. As shown in Figure 4,
在步骤405,用户通过web终端120向服务器端130发出请求同 步显示的请求。根据本发明的一个实施例,用户可以通过点击web终端120上的任意按钮来触发这一操作请求。例如,点击图3b中的“开始”按钮306。At step 405, the user sends a request to the server 130 via the web terminal 120. The step shows the request. According to one embodiment of the invention, the user can trigger this operational request by clicking on any button on the web terminal 120. For example, click on the "Start" button 306 in Figure 3b.
在步骤410,基于用户发出的请求,服务器端130向移动终端110转发该同步显示的请求。At step 410, based on the request issued by the user, the server 130 forwards the request for synchronization display to the mobile terminal 110.
在步骤415,移动终端110收到该请求,触发生成长连接地址。优选地,该长连接为http长连接。At step 415, the mobile terminal 110 receives the request and triggers the generation of a long connection address. Preferably, the long connection is a http long connection.
在步骤420,移动终端415将该长连接地址发送给web终端120。根据本发明的一个实施例,该长连接地址可以通过服务器端130进行中转后发送给web终端120。At step 420, the mobile terminal 415 sends the long connection address to the web terminal 120. According to an embodiment of the present invention, the long connection address may be transited by the server 130 and sent to the web terminal 120.
在步骤425,web终端120向移动终端110发送建立长连接的应答确认,从而在web终端120建立了与移动终端110之间的长连接。即,web终端120可以定期访问该长连接地址从而保持与移动终端110的连接。根据本发明的一个实施例,该应答确认可以通过服务器端130进行中转后发送给移动终端110。At step 425, the web terminal 120 sends a response confirmation to the mobile terminal 110 establishing a long connection, thereby establishing a long connection with the mobile terminal 110 at the web terminal 120. That is, the web terminal 120 can periodically access the long connection address to maintain the connection with the mobile terminal 110. According to an embodiment of the present invention, the response confirmation may be transmitted to the mobile terminal 110 after being relayed by the server 130.
在步骤430,移动终端120在收到应答确认后,触发开始按特定的时间间隔进行截屏操作。所述截屏操作即截取移动终端120上运行的当前应用所显示的图像。根据本发明的一个实施例,可以任意设定该时间间隔,例如每1/10-1/2秒截取屏幕一次。优选地,每1/4秒截取屏幕一次。截屏的时间间隔也可以根据网络状况来设定,例如在网络状况良好的情况下,缩短相邻两次截屏之间间隔的时间。At step 430, after receiving the response confirmation, the mobile terminal 120 triggers the start of the screen capture operation at a specific time interval. The screen capture operation intercepts an image displayed by the current application running on the mobile terminal 120. According to an embodiment of the present invention, the time interval can be arbitrarily set, for example, the screen is intercepted once every 1/10-1/2 second. Preferably, the screen is intercepted once every 1/4 second. The time interval of the screen shot can also be set according to the network condition, for example, when the network condition is good, the time between the adjacent two screen shots is shortened.
步骤435,移动终端110将截屏图像按截取的时间顺序依次发送给web终端120。Step 435, the mobile terminal 110 sequentially sends the screen capture images to the web terminal 120 in the time sequence of interception.
步骤440,web终端120按接收到的时间顺序依次显示所接收到的截屏图像。In step 440, the web terminal 120 sequentially displays the received screenshot images in the received chronological order.
根据本发明的一个实施例,移动终端110可以将截取的屏幕图像以“先进先出”的队列方式进行存储,再按照特定的时间间隔从队列中取出队列中的截屏图像,发送给web终端120。优选地,从队列中取截屏图像的时间间隔可以等于步骤430中截屏操作的时间间隔。According to an embodiment of the present invention, the mobile terminal 110 may store the intercepted screen image in a "first in, first out" queue manner, and then take out the screen capture image in the queue from the queue according to a specific time interval, and send it to the web terminal 120. . Preferably, the time interval for taking a screen shot image from the queue may be equal to the time interval of the screen capture operation in step 430.
根据本发明的另一实施例,移动终端110可以不存储截取的屏幕图像,而是每截取一张即刻发送一张给web终端120。这种方式对移动终端110和web终端120之间连接网络质量,特别是掉线率的要求较上一种实施方式更高。 According to another embodiment of the present invention, the mobile terminal 110 may not store the intercepted screen image, but send one piece to the web terminal 120 every time one is intercepted. In this way, the connection quality between the mobile terminal 110 and the web terminal 120, especially the drop rate, is higher than that of the previous embodiment.
根据本发明的另一实施例,web终端120可以以访问移动终端110长连接地址的方式来获取截屏图像。具体地,移动终端110可以将所截取屏幕的地址信息发送给web终端120,web终端120访问该地址,下载所需的截屏图像。According to another embodiment of the present invention, the web terminal 120 may acquire a screen shot image in a manner of accessing the long connection address of the mobile terminal 110. Specifically, the mobile terminal 110 may transmit the address information of the intercepted screen to the web terminal 120, and the web terminal 120 accesses the address to download the required screenshot image.
根据本发明的另一实施例,截屏图像的传输也可以经过服务器端130的中转来进行。具体地,移动终端110可以将截屏图像先传输至服务器端130为其开辟的存储区域中,然后服务器端130再将截屏图像按照收到的顺序依次发送给web终端120。或者,服务器端130也可以中转截屏图像的存储地址给web终端120,web终端120再按照该地址访问去下载所需的截屏图像。According to another embodiment of the present invention, the transmission of the screen shot image may also be performed by the relay of the server side 130. Specifically, the mobile terminal 110 may first transmit the screen capture image to the storage area opened by the server end 130, and then the server side 130 may sequentially send the screen capture image to the web terminal 120 in the received order. Alternatively, the server 130 can also transfer the storage address of the screenshot image to the web terminal 120, and the web terminal 120 can access the screen capture image according to the address.
根据本发明的另一实施例,web终端120也可以开辟存储收到的截屏对象的队列,以“先进先出”的方式从队列中依次弹出截屏图像,进行显示。According to another embodiment of the present invention, the web terminal 120 may also open a queue for storing the received screen capture object, and pop-up the screen capture images from the queue in a "first in, first out" manner for display.
图5a-图5c分别示意性地示出了根据图4的方法在web终端120上显示的示例性截屏图像。其中图5a显示的是当用户选择“图库”项目时呈现的屏幕显示,图5b显示的是当用户在移动终端110通过向左滑动屏幕向“音乐”项目切换时呈现的屏幕显示,图5c显示的是用户切换到“音乐”项目时呈现的屏幕显示。根据图4中描述的方法,由于本发明设定的特定截屏和显示时间间隔,因此在web终端120显示时,用户可以体验连贯的显示效果。即使是用户在切换屏幕的过程中呈现的中间效果(如图5b),也将通过截屏传输的方式完整地呈现在web终端120。因此,呈现的效果就像是用户通过移动终端110来直接操作web终端120一样。5a-5c schematically illustrate exemplary screen shot images displayed on web terminal 120 in accordance with the method of FIG. 4, respectively. Figure 5a shows the screen display presented when the user selects the "Gallery" item, and Figure 5b shows the screen display that is presented when the user switches to the "Music" item by swiping the screen to the left, Figure 5c shows Is the screen display that is presented when the user switches to the Music item. According to the method described in FIG. 4, due to the specific screen shot and display time interval set by the present invention, the user can experience a coherent display effect when the web terminal 120 is displayed. Even the intermediate effect presented by the user during the process of switching screens (as in Figure 5b) will be fully presented to the web terminal 120 by means of screencast transmission. Therefore, the effect of presentation is as if the user directly operated the web terminal 120 through the mobile terminal 110.
根据本发明的方法和***,用户可以在移动电子设备和具备web接口的web终端之间实现可靠、高速、稳定、用户交互体验更好的同步显示方案。According to the method and system of the present invention, a user can implement a synchronous, high-speed, stable, and user-friendly interactive display scheme between the mobile electronic device and the web terminal having the web interface.
结合这里披露的本发明的说明和实践,本发明的其他实施例对于本领域技术人员都是易于想到和理解的。说明和实施例仅被认为是示例性的,本发明的真正范围和主旨均由权利要求所限定。 Other embodiments of the invention will be apparent to those skilled in the <RTIgt; The description and the examples are to be considered as illustrative only, and the true scope and spirit of the invention are defined by the claims.

Claims (10)

  1. 一种用于在移动设备和web终端之间进行同步显示的方法,所述移动终端和web终端通过网络分别与位于云端的服务器端通信连接,所述方法包括以下步骤:A method for synchronous display between a mobile device and a web terminal, wherein the mobile terminal and the web terminal are respectively connected to a server end located in the cloud through a network, and the method comprises the following steps:
    a)通过所述web终端向所述服务器端发出同步显示的请求;a) issuing a request for synchronous display to the server by the web terminal;
    b)所述服务器端向所述移动终端转发该同步显示的请求;b) the server end forwards the synchronous display request to the mobile terminal;
    c)所述移动终端收到该请求,触发生成长连接地址;c) the mobile terminal receives the request, triggering generation of a long connection address;
    d)所述移动终端将该长连接地址发送给所述web终端;d) the mobile terminal sends the long connection address to the web terminal;
    e)所述web终端向所述移动终端发送建立长连接的应答确认;e) the web terminal sends a response confirmation to establish establishment of a long connection to the mobile terminal;
    f)所述移动终端收到应答确认后,触发开始按特定的时间间隔进行截屏操作;f) after the mobile terminal receives the response confirmation, the trigger starts to perform the screen capture operation at a specific time interval;
    g)所述移动终端将截屏图像按截取的时间顺序依次发送给web终端;和g) the mobile terminal sequentially transmits the screen capture images to the web terminal in the time sequence of interception; and
    h)所述web终端按接收到的时间顺序依次显示所接收到的截屏图像。h) The web terminal sequentially displays the received screenshot images in the received chronological order.
  2. 如权利要求1所述的方法,其中所述步骤c中的长连接为http长连接。The method of claim 1 wherein said long connection in step c is an http long connection.
  3. 如权利要求1所述的方法,其中所述步骤d中该长连接地址通过服务器端进行中转后发送给web终端。The method of claim 1, wherein the long connection address in the step d is relayed by the server and sent to the web terminal.
  4. 如权利要求1所述的方法,其中所述步骤f中的截屏操作时间间隔为每1/10-1/2秒截取屏幕一次。The method of claim 1, wherein the screen capture operation time interval in step f is to intercept the screen once every 1/10-1/2 seconds.
  5. 如权利要求4所述的方法,其中所述截屏操作时间间隔为每1/4秒截取屏幕一次。The method of claim 4 wherein said screen shot operation time interval intercepts the screen once every 1/4 second.
  6. 如权利要求1所述的方法,其中所述移动终端将截取的屏幕图像以先进先出的队列方式进行存储,再按照特定的时间间隔从队列中取出队列中的截屏图像,发送给所述web终端。The method of claim 1, wherein the mobile terminal stores the intercepted screen image in a first-in, first-out queue manner, and then takes out the screen capture image in the queue from the queue at a specific time interval and sends the screen image to the web. terminal.
  7. 如权利要求1所述的方法,其中所述移动终端将所截取屏幕的地址信息发送给web终端,所述web终端访问该地址下载所需的截屏图像。The method of claim 1, wherein said mobile terminal transmits address information of the intercepted screen to a web terminal, said web terminal accessing a screen shot image required for the address download.
  8. 如权利要求1所述的方法,其中所述截屏图像的传输经过所述服务器端的中转来进行。 The method of claim 1 wherein the transmission of the screen shot image is performed via a relay of the server side.
  9. 如权利要求1所述的方法,其中所述web终端以先进先出的队列方式存储收到的截屏图片,从队列中依次弹出截屏图像进行显示。The method of claim 1, wherein the web terminal stores the received screen capture image in a first-in, first-out queue manner, and pop-up screen images are sequentially popped from the queue for display.
  10. 如权利要求1所述的方法,其中在所述步骤a)之前,所述web终端和所述移动终端之间通过下列步骤建立连接:The method of claim 1 wherein prior to said step a), the connection is established between said web terminal and said mobile terminal by the following steps:
    a01)由所述web终端向所述服务器端发出连接请求;A01) issuing, by the web terminal, a connection request to the server end;
    a02)所述服务器端向所述web终端发送二维码信息;A02) the server sends the two-dimensional code information to the web terminal;
    a03)通过所述移动终端扫描所述二维码信息;A03) scanning the two-dimensional code information by using the mobile terminal;
    a04)响应于所述扫描二维码的操作,所述移动终端和所述web终端分别向所述服务器端发送自身的网络连接状况;A04) in response to the operation of scanning the two-dimensional code, the mobile terminal and the web terminal respectively send their own network connection status to the server end;
    a05)所述服务器端获取所述移动终端和所述web终端各自连接到服务器端的网络状况,判断所述移动终端和所述web终端的网络连接是否处于同一局域网下,并针对是否处于同一局域网络将网络状况标志符设置不同的状态;A05) The server obtains a network status that the mobile terminal and the web terminal are respectively connected to the server, and determines whether the network connection between the mobile terminal and the web terminal is under the same local area network, and whether the network connection is in the same local area network. Set the network status indicator to a different state;
    a06)所述服务器端分别向所述移动终端和所述web终端发送连接建立许可,在所述移动终端和所述web终端之间建立连接。 A06) The server side sends a connection establishment permission to the mobile terminal and the web terminal, respectively, and establishes a connection between the mobile terminal and the web terminal.
PCT/CN2014/090424 2014-11-06 2014-11-06 Method for implementing synchronous display between mobile terminal and web terminal WO2016070372A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/090424 WO2016070372A1 (en) 2014-11-06 2014-11-06 Method for implementing synchronous display between mobile terminal and web terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/090424 WO2016070372A1 (en) 2014-11-06 2014-11-06 Method for implementing synchronous display between mobile terminal and web terminal

Publications (1)

Publication Number Publication Date
WO2016070372A1 true WO2016070372A1 (en) 2016-05-12

Family

ID=55908389

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/090424 WO2016070372A1 (en) 2014-11-06 2014-11-06 Method for implementing synchronous display between mobile terminal and web terminal

Country Status (1)

Country Link
WO (1) WO2016070372A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112463891A (en) * 2021-01-28 2021-03-09 北京梦天门科技股份有限公司 Data synchronization method, data synchronization equipment, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101467133A (en) * 2006-05-30 2009-06-24 戴尔产品有限公司 Mirroring of activity between electronic devices
CN103064647A (en) * 2012-12-24 2013-04-24 珠海市君天电子科技有限公司 Method and device for mobile device screen quick display of computer
CN103248939A (en) * 2012-02-03 2013-08-14 海尔集团公司 Method and system for achieving synchronous display of multiple screens
CN103501310A (en) * 2013-07-11 2014-01-08 广东工业大学 Method for controlling computer desktop sharing based on video phone
CN103744763A (en) * 2013-12-25 2014-04-23 广东明创软件科技有限公司 Mobile terminal synchronous control method of PC (personal computer) end in automated testing
CN104320491A (en) * 2014-11-06 2015-01-28 北京安奇智联科技有限公司 Method for synchronous display between mobile device and web terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101467133A (en) * 2006-05-30 2009-06-24 戴尔产品有限公司 Mirroring of activity between electronic devices
CN103248939A (en) * 2012-02-03 2013-08-14 海尔集团公司 Method and system for achieving synchronous display of multiple screens
CN103064647A (en) * 2012-12-24 2013-04-24 珠海市君天电子科技有限公司 Method and device for mobile device screen quick display of computer
CN103501310A (en) * 2013-07-11 2014-01-08 广东工业大学 Method for controlling computer desktop sharing based on video phone
CN103744763A (en) * 2013-12-25 2014-04-23 广东明创软件科技有限公司 Mobile terminal synchronous control method of PC (personal computer) end in automated testing
CN104320491A (en) * 2014-11-06 2015-01-28 北京安奇智联科技有限公司 Method for synchronous display between mobile device and web terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112463891A (en) * 2021-01-28 2021-03-09 北京梦天门科技股份有限公司 Data synchronization method, data synchronization equipment, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
US10257463B2 (en) Multifunctional conferencing systems and methods
US9231902B2 (en) Method and electronic device for content sharing
US9438697B2 (en) User interface content state synchronization across devices
US11134113B2 (en) User interface content state synchronization across devices
CN104394200B (en) The method shown for synchronizing preview between mobile device and web terminals
US9584566B2 (en) Method and system for synchronizing duplicated contents in multiple terminals
US10111263B2 (en) Method and system for network interconnection between devices
CN104320491A (en) Method for synchronous display between mobile device and web terminal
CN104333598A (en) Two-dimension code and network adaption based mobile terminal and web terminal interconnection method
WO2016070373A1 (en) Method for implementing synchronous preview display between mobile terminal and web terminal
TW201837687A (en) Instant messaging method and system, electronic device and server
WO2017143676A1 (en) Information interaction method and apparatus
WO2014056427A1 (en) Method and apparatus for displaying multiple images, home network system and mobile terminal
US20180091602A1 (en) Method and system for operating and controlling data, and user terminal
CN104378425B (en) The method of interconnection and synchronous communication information between mobile terminal and web terminal
WO2024017113A1 (en) Data synchronization method and apparatus, and electronic device
WO2016070372A1 (en) Method for implementing synchronous display between mobile terminal and web terminal
WO2014180436A1 (en) Inter-terminal communication method, and terminal
US20220321629A1 (en) User Interface Content State Synchronization Across Devices
WO2016070371A1 (en) Method for mobile terminal and web terminal interconnection and streaming and streaming media playback
JP2012156726A (en) Information processor, information processing method, and program
WO2013016949A1 (en) User interface content state synchronization across devices
JP5920829B2 (en) Method for sharing display of application window, information terminal device, and computer program
WO2016070374A1 (en) Method for interaction and synchronous communication of information between mobile terminal and web terminal
WO2016070370A1 (en) Method for mobile terminal and web terminal interconnection based on two-dimensional code and network adaptation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14905410

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05/09/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 14905410

Country of ref document: EP

Kind code of ref document: A1