WO2021072974A1 - 终端控制方法、***、装置、计算机设备和存储介质 - Google Patents

终端控制方法、***、装置、计算机设备和存储介质 Download PDF

Info

Publication number
WO2021072974A1
WO2021072974A1 PCT/CN2019/128460 CN2019128460W WO2021072974A1 WO 2021072974 A1 WO2021072974 A1 WO 2021072974A1 CN 2019128460 W CN2019128460 W CN 2019128460W WO 2021072974 A1 WO2021072974 A1 WO 2021072974A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
terminal
controlled terminal
control
touch
Prior art date
Application number
PCT/CN2019/128460
Other languages
English (en)
French (fr)
Inventor
许仁
赵宁
周枫
李可峰
吴畅
王伟
Original Assignee
维达力实业(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维达力实业(深圳)有限公司 filed Critical 维达力实业(深圳)有限公司
Priority to US17/769,521 priority Critical patent/US20240152266A1/en
Publication of WO2021072974A1 publication Critical patent/WO2021072974A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup

Definitions

  • This application relates to the field of communications, in particular to a terminal control method, system, device, computer equipment and storage medium.
  • a higher integrated processor chip can be used in each functional module of the terminal to improve the efficiency of data processing and transmission; or, to optimize the design of the communication algorithm to reduce Data transmission error rate, increase transmission rate and save storage space.
  • the terminal has the problems of large weight and volume, and poor portability.
  • a terminal control method including:
  • the first touch response interface is an interface displayed after the controlled terminal performs a touch response
  • a second touch response interface is displayed; the second touch response interface matches the first touch response interface of the controlled terminal.
  • the controlling the controlled terminal to perform a touch response according to the touch operation includes:
  • the touch operation data of the controlled terminal is used to perform a touch operation on the first interaction interface of the controlled terminal;
  • the establishing a connection with the controlled terminal includes:
  • the establishing a connection with the controlled terminal further includes:
  • the acquiring the first interactive interface of the controlled terminal includes:
  • the interactive interface screenshot data is data obtained by taking a screenshot of the first interactive interface of the controlled terminal
  • the interactive interface screenshot data is processed to obtain processed interactive interface screenshot data; the processed interactive interface screenshot data is used to display the second interactive interface.
  • the acquiring the first touch response interface of the controlled terminal includes:
  • the response interface screenshot data is data obtained by taking a screenshot of the first touch response interface of the controlled terminal
  • the response interface screenshot data is processed to obtain processed response interface screenshot data; the processed response interface screenshot data is used to display the second touch response interface.
  • a terminal control method further including:
  • the control center is configured to control the controlled terminal to perform a touch response according to the touch operation;
  • the first touch response interface is the interface displayed after the controlled terminal performs a touch response;
  • a second touch response interface is displayed; the second touch response interface matches the first touch response interface of the controlled terminal.
  • the establishing a connection with the control center includes:
  • the establishing a connection with the control center further includes:
  • the identity code is sent to the control center, and the identity code is forwarded to the controlled terminal via the control center for the controlled terminal to establish a connection after successfully verifying the identity code.
  • the obtaining the first interactive interface of the controlled terminal through the control center includes:
  • the controlled terminal manipulation request is used by a user to request manipulation of the controlled terminal;
  • control center access the control center to obtain the first interactive interface of the controlled terminal.
  • the obtaining the first interactive interface of the controlled terminal through the control center further includes:
  • the interactive interface screenshot data is data obtained by screenshot of the first interactive interface of the controlled terminal;
  • the interactive interface screenshot data is processed to obtain processed interactive interface screenshot data; the interactive interface screenshot data after passing through the control center is used to display the second interactive interface.
  • the obtaining the first touch response interface of the controlled terminal through the control center includes:
  • response interface screenshot data through the control center; the response interface screenshot data is data obtained by screenshot of the first touch response interface of the controlled terminal;
  • the response interface screenshot data is processed to obtain processed response interface screenshot data; the processed response interface screenshot data is used to display the second touch response interface.
  • a terminal control method further including:
  • the sending the first interactive interface of the controlled terminal to the control terminal includes:
  • the sending the first touch response interface to the control terminal includes:
  • a terminal control method further including:
  • the sending the first interactive interface of the controlled terminal to the control terminal through the control center includes:
  • the sending the first touch response interface to the control terminal through the control center includes:
  • a terminal control system includes: a control terminal and a controlled terminal; the controlled terminal displays a first interactive interface;
  • the control terminal is used to establish a connection with the controlled terminal
  • the controlled terminal is configured to send the first interactive interface to the control terminal;
  • the control terminal is configured to display a second interactive interface that matches the first interactive interface
  • the control terminal is configured to receive a touch operation performed by a user on the second interactive interface
  • the control terminal is configured to control the controlled terminal to perform a touch response according to the touch operation
  • the controlled terminal is configured to send the first touch response interface to the control terminal;
  • the control terminal is configured to display a second touch response interface matching the first touch response interface of the controlled terminal.
  • a terminal control system including: a control terminal, a control center, and a controlled terminal;
  • the control center is used to establish a connection with the control terminal, and is used to establish a connection with the controlled terminal;
  • the controlled terminal is configured to send the first interactive interface to the control center;
  • the control center is configured to forward the first interactive interface of the controlled terminal to the control terminal;
  • the control terminal is configured to display a second interactive interface that matches the first interactive interface
  • the control terminal is configured to receive a touch operation performed by a user on the second interactive interface
  • the control terminal is configured to send the touch operation to the control center
  • the control center is configured to control the controlled terminal to perform a touch response according to the touch operation
  • the controlled terminal is configured to send the first touch response interface to the control center;
  • the control center is configured to forward the first touch response interface of the controlled terminal to the control terminal;
  • the control terminal is configured to display a second touch response interface matching the first touch response interface.
  • a terminal including: a wireless communication interface, a touch screen and a processor;
  • the wireless communication interface is used to establish a connection with the controlled terminal through wireless communication
  • the touch display screen is used to display a second interaction interface; the second interaction interface matches the first interaction interface of the controlled terminal;
  • the touch display screen is configured to receive a touch operation performed by a user on the second interactive interface
  • the processor is configured to control the controlled terminal to perform a touch response to display a first touch response interface according to the touch operation;
  • the touch display screen is used to display a second touch response interface; the second touch response interface matches the first touch response interface.
  • a terminal control device includes:
  • connection establishment module is used to establish a connection with the controlled terminal
  • the first obtaining module is configured to obtain the first interactive interface of the controlled terminal
  • the first display module is configured to display a second interactive interface; the second interactive interface matches the first interactive interface of the controlled terminal;
  • a receiving module configured to receive a touch operation performed by a user on the second interactive interface
  • the control module is configured to control the controlled terminal to perform a touch response according to the touch operation
  • the second acquisition module is configured to acquire the first touch response interface of the controlled terminal;
  • the first touch response interface is the interface displayed after the controlled terminal performs a touch response;
  • the second display module is configured to display a second touch response interface; the second touch response interface matches the first touch response interface of the controlled terminal.
  • a terminal control device includes:
  • connection establishment module is used to establish a connection with the control center; establish a connection between the control center and the controlled terminal;
  • the first obtaining module is configured to obtain the first interactive interface of the controlled terminal through the control center;
  • the first display module is configured to display a second interactive interface; the second interactive interface matches the first interactive interface of the controlled terminal;
  • a receiving module configured to receive a touch operation performed by a user on the second interactive interface
  • the control module is configured to send the touch operation to the control center; the control center is configured to control the controlled terminal to perform a touch response according to the touch operation;
  • the second acquisition module is configured to acquire the first touch response interface of the controlled terminal through the control center; the first touch response interface is the interface displayed after the controlled terminal performs a touch response;
  • the second display module is configured to display a second touch response interface; the second touch response interface matches the first touch response interface of the controlled terminal.
  • a computer device includes a memory, a processor, and a computer program that is stored on the memory and can run on the processor, and the processor is used to implement the terminal control method when the computer program is executed.
  • a computer-readable storage medium has a computer program stored thereon, and the computer program is used to implement the terminal control method when the computer program is executed by a processor.
  • the control terminal by establishing a connection between the control terminal and the controlled terminal, the control terminal obtains the first interactive interface of the controlled terminal, and displays the second interactive interface according to the first interactive interface.
  • the interactive interface because the second interactive interface matches the first interactive interface, can comprehensively display the information of the first interactive interface, and performing a touch operation on the second interactive interface is equivalent to performing a touch operation on the first interactive interface.
  • a second touch response interface matching the touch response of the controlled terminal is displayed on the control terminal, which can fully display the touch response result of the controlled terminal.
  • This method replaces the direct operation of the control terminal with the interaction between the control terminal and the controlled terminal, avoids the execution of complex data processing procedures on the control terminal, reduces the storage space of the control terminal and the weight and volume of the data processing module. This solves the problems of large terminal weight and volume and poor portability in traditional communication systems.
  • FIG. 1 is a schematic flowchart of a terminal control method in an embodiment
  • Figure 2 is an application environment diagram of a terminal control method in an embodiment
  • FIG. 3 is a schematic diagram of controlling a controlled terminal to perform a touch response in an embodiment
  • FIG. 4 is a schematic diagram of displaying a second touch response interface in an embodiment
  • FIG. 5 is a schematic flowchart of another terminal control method in an embodiment
  • Figure 6 is an application environment diagram of another terminal control method in an embodiment
  • FIG. 7 is a schematic diagram of the software architecture of a terminal control method in an embodiment
  • FIG. 8 is a schematic diagram of controlling a controlled terminal to perform a touch response through a control center in an embodiment
  • FIG. 9 is a schematic diagram of displaying a second touch response interface through the control center in an embodiment
  • FIG. 10 is a schematic flowchart of a terminal control method in an embodiment
  • FIG. 11 is a schematic flowchart of a terminal control method in an embodiment
  • Figure 12 is a schematic diagram of a terminal control system in an embodiment
  • FIG. 13 is a sequence diagram of a terminal control process in an embodiment
  • Figure 14 is a schematic diagram of another terminal control system in an embodiment
  • FIG. 15 is a sequence diagram of another terminal control process in an embodiment
  • Figure 16 is a product structure diagram of a control terminal in an embodiment
  • Figure 17 is a structural block diagram of a terminal control device in an embodiment
  • Fig. 18 is a structural block diagram of another terminal control device in an embodiment.
  • a terminal control method is provided.
  • the terminal control method provided in this embodiment can be applied to the application environment as shown in FIG. 2.
  • a control terminal 202 and a controlled terminal 204 are included.
  • the control terminal 202 has touch and display functions.
  • the touch function is for the user to control the operation interface by touching or writing with a pen on the touch screen.
  • the display function includes a display operation interface and a touch response interface.
  • the touch response interface displays the corresponding touch response after the touch operation. interface.
  • the controlled terminal 204 is a terminal controlled by the control terminal 202.
  • the controlled terminal 204 transmits the operation interface to the control terminal 202 through a wireless link, and responds to the touch operation of the control terminal 202 through the wireless
  • the link transmits the touch response interface to the control terminal 202.
  • the foregoing terminal control method which is applied to the control terminal 202 in FIG. 2 as an example, may include the following steps:
  • control terminal 202 is assigned an identity code in advance, and the identity code is used to distinguish different control terminals 202. Both the control terminal 202 and the controlled terminal 204 are installed with specific software for establishing a connection between the two.
  • the control terminal 202 sends its own identity code to the controlled terminal 204 via Wi-Fi, Bluetooth or a custom wireless protocol.
  • the controlled terminal 204 reads the identity code, records the identity code in the data table, and establishes it with the control terminal 202 connection.
  • control terminal 202 sends the identity code "001" to the controlled terminal 204, and the controlled terminal 204 reads the identity code and records "001" in the data table. After establishing a connection with the control terminal 202, it can know that the controlled terminal The terminal 204 establishes a connection with the control terminal whose identity code is "001".
  • the first interactive interface is an operation interface displayed on the controlled terminal 204.
  • the operation interface image of the controlled terminal 204 may be intercepted, and the operation interface image may be used as the first interactive interface, or the screen UI (User Interface) data, screen size, resolution, etc. of the controlled terminal 204 may be intercepted Data, based on these data to get the first interactive interface.
  • the screen UI User Interface
  • a screenshot operation can be performed on its entire operation interface, and the screenshot result can be used as the first interactive interface.
  • the software icon such as the WeChat icon
  • S106 Display a second interactive interface.
  • the second interaction interface is a first interaction interface displayed according to the interface of the control terminal 202, that is, the second interaction interface matches the first interaction interface of the controlled terminal 204.
  • the screen UI data, screen size, resolution and other data of the first interactive interface can be packaged in a communication protocol and sent to the control terminal 202, and the first interactive interface data can be scaled according to the resolution of the control terminal 202 interface. Scaling to obtain the second interactive interface.
  • the first interactive interface can be scaled in an equal proportion, and then operations such as intercepting or filling are performed according to the scaling result to obtain The second interactive interface, and the second interactive interface is displayed.
  • the first interactive interface can be scaled down to 50% of the original to obtain the second interactive interface;
  • the interface resolution of the terminal 202 is 1024 ⁇ 800 pixels.
  • the first interactive interface can be scaled down to 50% of the original, and displayed at the center of the control terminal 202 interface, and then the blank part is filled with black to obtain the second interactive interface.
  • S108 Receive a touch operation performed by the user on the second interactive interface.
  • the touch operation is an operation that the user controls the operation interface by touching or writing with a pen on the second interactive interface.
  • the user can open the software by clicking the software icon on the second interactive interface with a finger or a stylus, and click various controls in the software after the software is opened, or perform touch operations by writing in the operation interface after the software is opened.
  • the control terminal 202 receives the aforementioned touch operation.
  • S110 Control the controlled terminal to perform a touch response according to the touch operation.
  • the touch response is the response of the controlled terminal 204 according to the touch operation.
  • control terminal 202 After the control terminal 202 obtains the touch operation, it extracts the touch operation data from the touch operation, and then can process the touch operation data according to the ratio of the first interactive interface and the second interactive interface.
  • the subsequent touch operation data is sent to the controlled terminal 204, and the controlled terminal 204 performs a touch response according to the processed touch data.
  • the touch response includes information such as screen UI data and sound after the response.
  • FIG. 3 is a schematic diagram of controlling a controlled terminal to perform a touch response according to an embodiment.
  • the figure includes a smart palm 302 and a tablet computer 304, where the smart palm 302 is a control terminal, and the tablet 304 is a controlled terminal.
  • the resolution of the first interactive interface of the tablet 304 is 2048 ⁇ 1536 pixels
  • the resolution of the second interactive interface of the smart handpad 302 is 1024 ⁇ 768 pixels.
  • the coordinates of the second interactive interface are Click the WeChat icon at (800,300), and according to the ratio of the first interactive interface to the second interactive interface, the touch operation data is transformed into a click operation at the coordinates (1600,600) of the first interactive interface, and then the touch operation The data is sent to the tablet computer 304 via the network, and the tablet computer 304 performs a touch response at the first interactive interface (1600, 600).
  • S112 Acquire a first touch response interface of the controlled terminal.
  • the first touch response interface is an interface displayed after the controlled terminal 204 performs a touch response.
  • the touch response interface image of the controlled terminal 204 may be intercepted, and the touch response interface image may be used as the first touch response interface, or the resolution, color, and resolution of the touch response interface of the controlled terminal 204 may be read. Based on information such as text, the first touch response interface is obtained.
  • a screenshot operation can be performed on the entire touch response interface thereof, and the screenshot result is used as the first touch response interface.
  • read the touch response interface information of the controlled terminal 204 including the resolution of 2048 ⁇ 1536 pixels, the text content and position displayed by the touch response, the image color and position displayed by the touch response, etc., according to the above touch
  • the first touch response interface is obtained by responding to the interface information.
  • the second touch response interface is an interface that matches the first touch response interface of the controlled terminal 204.
  • the first touch response interface can be scaled proportionally according to the resolution of the control terminal 202 interface to obtain the second touch response interface.
  • the resolution of the control terminal 202 interface is not proportional to the resolution of the first touch response interface
  • the first touch response interface may be scaled in an equal proportion, and then operations such as intercepting or filling according to the zoom result may be performed to obtain the second touch response interface, and then the second touch response interface may be displayed.
  • FIG. 4 is a schematic diagram showing a second touch response interface according to an embodiment.
  • the figure includes a smart handpad 402 and a tablet computer 404, where the smart handpad 402 is a control terminal, and the tablet computer 404 is a controlled terminal.
  • the tablet 404 after receiving the WeChat opening operation, the tablet 404 performs a touch response to obtain the WeChat opening interface, that is, the first touch response interface of the controlled terminal.
  • the first touch corresponding interface is sent to the smart handpad 402 via the network.
  • the resolution of the first touch response interface is 2048 ⁇ 1536 pixels. If the resolution of the smart handpad 402 interface is 1024 ⁇ 768 pixels, the first touch response interface can be scaled down to 50% of the original to get the second touch response.
  • the first touch response interface can be scaled down to 50% of the original, displayed in the center of the smart handpad 402 interface, and then filled with black in the undisplayed part , Get the second touch response interface. After that, the smart handpad 402 displays the second touch response interface.
  • the control terminal by establishing a connection between the control terminal and the controlled terminal, the control terminal obtains the first interactive interface of the controlled terminal, and displays the second interactive interface according to the first interactive interface. Matching with the first interactive interface can fully display the information of the first interactive interface, and performing a touch operation on the second interactive interface is equivalent to performing a touch operation on the first interactive interface.
  • a second touch response interface matching the touch response of the controlled terminal is displayed on the control terminal, which can fully display the touch response result of the controlled terminal.
  • This method replaces the direct operation of the control terminal with the interaction between the control terminal and the controlled terminal, avoids the execution of complex data processing procedures on the control terminal, reduces the storage space of the control terminal and the weight and volume of the data processing module. This solves the problems of large terminal weight and volume and poor portability in traditional communication systems.
  • step S110 may specifically include:
  • the touch operation data is the data of the user performing the touch operation on the control terminal 202, including data such as the position and time of the touch operation.
  • the touch operation data of the controlled terminal is the touch operation data obtained by processing the touch operation data, and the obtained touch operation data is for the controlled terminal 204.
  • control terminal 202 After the control terminal 202 obtains the touch operation, it extracts the touch operation data from the touch operation, and then can process the touch operation data according to the ratio of the first interactive interface and the second interactive interface to obtain the received
  • the control terminal touch operation data sends the controlled terminal touch operation data to the controlled terminal 204, and the controlled terminal 204 performs a touch response according to the controlled terminal touch operation data. Since the processing procedure of step S110 has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the control terminal obtains touch operation data according to the touch operation, and then transforms the touch operation data to obtain the controlled terminal touch operation data for the first interactive interface of the controlled terminal.
  • the touch operation data of the controlled terminal is obtained by transforming the touch operation data of the controlled terminal, and the two match, and the touch operation can be accurately realized on the controlled terminal.
  • the controlled terminal performs a touch response according to the touch operation data of the controlled terminal to obtain the first touch response interface. Since the first touch response interface matches the second touch response interface of the control terminal, the control terminal does not need to be complicated.
  • the touch response information can be obtained, which reduces the storage space of the control terminal and the weight and volume of the data processing module, thereby solving the problem of large weight and volume and poor portability of the terminal in the traditional communication system.
  • the above step S102 may specifically include: establishing a connection with the controlled terminal through Wi-Fi, Bluetooth or a custom wireless protocol.
  • the communication distance between the control terminal 202 and the controlled terminal 204 is within the communication range of Wi-Fi or Bluetooth, and the two realize data transmission through Wi-Fi, Bluetooth or a custom wireless protocol.
  • the above step S102 may further include: obtaining an identity code; sending the identity code to the controlled terminal, so that the controlled terminal can establish a connection after successfully verifying the identity code.
  • the identity code is the identity information of the control terminal 202.
  • control terminal 202 is assigned an identity code in advance. After the control terminal 202 obtains its own identity code, it sends the identity code to the controlled terminal 204 through Wi-Fi, Bluetooth or a custom wireless protocol, and the controlled terminal 204 reads the identity code. The identity code is taken and the identity code is verified. When the verification is passed, the identity code is recorded in the data table to establish a connection with the control terminal 202.
  • control terminal 202 sends the identity code "001" to the controlled terminal 204, and the controlled terminal 204 reads the identity code and verifies the identity code.
  • the verification result is that the connection is allowed to be established, it records "001" in the data In the table, a connection is established with the control terminal 202.
  • the above step S104 may specifically include: acquiring interactive interface screenshot data; processing the interactive interface screenshot data to obtain processed interactive interface screenshot data.
  • the screenshot data of the interactive interface is data obtained by taking a screenshot of the first interactive interface of the controlled terminal 204.
  • the processed interactive interface screenshot data is the processing of the interactive interface screenshot data, and is used to display the screenshot data of the second interactive interface.
  • control terminal 202 can capture the operation interface image of the controlled terminal 204 to obtain the interactive interface screenshot data.
  • the screen UI data, screen size, resolution, etc. can be obtained.
  • the screenshot data of the interactive interface is scaled, intercepted, or filled to obtain the processed interactive interface screenshot data.
  • the second interaction can be displayed interface. Since the processing procedure of step S104 has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method processes the screenshot data of the interactive interface so that the displayed second interactive interface matches the first interactive interface, and can fully display the information of the first interactive interface, and touch the second interactive interface.
  • the control operation is equivalent to the touch operation on the first interactive interface, which avoids the complicated data processing process in the control terminal, reduces the storage space of the control terminal and the weight and volume of the data processing module, and solves the problem of the terminal in the traditional communication system. The problem of large weight and volume, and poor portability.
  • the above step S112 may specifically include: obtaining response interface screenshot data; processing the response interface screenshot data to obtain the processed response interface screenshot data.
  • the screenshot data of the response interface is data obtained by taking a screenshot of the first touch response interface of the controlled terminal 204.
  • the processed screenshot data of the response interface is the processing of the screenshot data of the response interface, and is used to display the screenshot data of the second touch response interface.
  • control terminal 202 can capture the first touch response interface image of the controlled terminal 204 to obtain the response interface screenshot data, and the screen UI data, screen size, resolution, etc. can be obtained from the response interface screenshot data. Then, according to the size of the first touch response interface and the second touch response interface, the response interface screenshot data is scaled, intercepted, or filled to obtain the processed response interface screenshot data. According to the processed response interface screenshot data, you can The second touch response interface is displayed. Since the processing procedure of step S112 has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method processes the screenshot data of the response interface so that the displayed second touch response interface matches the first touch response interface, and can fully display the information of the first touch response interface.
  • the second touch response interface performs a touch operation, which is equivalent to a touch operation on the first touch response interface, which avoids performing complex data processing procedures on the control terminal, and reduces the storage space of the control terminal and the weight of the data processing module And volume, it solves the problem of large terminal weight and volume and poor portability in the traditional communication system.
  • FIG. 5 another terminal control method is provided.
  • the terminal control method provided in this embodiment can be applied to the application environment as shown in FIG. 6.
  • a control terminal 602 In this application environment, a control terminal 602, a control center 604, and a controlled terminal 606 are included.
  • control center is used to forward data between the control terminal and the controlled terminal, and may be a cloud computing server, etc.
  • the terminal control method specifically includes the following steps:
  • S508 Receive a touch operation performed by the user on the second interactive interface.
  • S514 Display a second touch response interface.
  • the controlled terminal 606 establishes a connection with the control center 604 in advance, and the controlled terminal 606 can back up data in the control center 604 in advance and set it to an accessible state, or enable the controlled terminal to use pre-installed software.
  • 606 is in a controllable state.
  • the control terminal 602 sends its own identity code to the control center 604, and the control center 604 establishes a connection with the control terminal 602 after receiving the identity code.
  • the control terminal 602 obtains the first interactive interface of the controlled terminal 606 through the control center 604, obtains the second interactive interface after processing the first interactive interface, and displays the second interactive interface. The user performs touch operations on the second interactive interface.
  • the control terminal 602 is preset with a browser portal and other software for receiving user touch operations.
  • the control terminal 602 receives touch operations, collects touch operation data, and performs touch operations. After the data is processed, it is forwarded to the controlled terminal 606 through the control center 604.
  • the controlled terminal 606 responds to the touch operation to obtain the first touch response interface, and sends the data of the first touch response interface to the control terminal 602 through the control center 604.
  • the control terminal 602 obtains the second touch response after processing the first touch response interface, and displays the second touch response.
  • FIG. 7 is a schematic diagram of the software architecture of a terminal control method according to an embodiment.
  • the figure includes a smart prototype 702, a cloud computing server 704, and a tablet 706.
  • the smart prototype 702 is the control terminal
  • the cloud computing server 704 is the control center.
  • the tablet 706 is a controlled terminal.
  • the cloud computing server 704 includes a message middleware 708, a front end 710, a back end 712, and a database 714.
  • the tablet computer 706 runs software for block screen UI and touch event data, via the 4G/5G network, carries private protocol data through the TCP/IP protocol, and establishes a connection with the cloud computing server 704.
  • the message middleware 708 efficiently distributes data, the back end 712 and the front end 710 communicate bidirectionally through the Websocket protocol.
  • the cloud computing server 704 efficiently transmits the screen capture data of the interactive interface or the screen capture data of the touch response interface.
  • the cloud computing server 704 efficiently receives the request of the smart prototype 702 to receive the touch operation data of the front-end 710, and send it to the message middleware 708 via TCP/IP, and the message middleware 708 efficiently distributes the data,
  • the data is encapsulated by using the TCP/IP protocol to carry the private protocol and forwarded to the tablet computer 706.
  • the smart prototype 702 accesses the web services provided by the front-end 710 and the back-end 712 through HTTP or RESTful (REpresentational State Transfer) interfaces, and can operate the tablet 706 and efficiently forward the touch operation data through the cloud computing server 704 For the tablet computer 706, network operation and calculation are realized.
  • FIG. 8 is a schematic diagram of a control center controlling a controlled terminal to perform a touch response according to an embodiment.
  • the figure includes a smart hand board 802, a cloud computing server 804, and a tablet computer 806.
  • the resolution of the first interactive interface of the tablet 806 is 2048 ⁇ 1536 pixels
  • the resolution of the second interactive interface of the smart handpad 802 is 1024 ⁇ 768 pixels.
  • the coordinates of the second interactive interface are Click the WeChat icon at (800,300), and according to the ratio of the first interactive interface to the second interactive interface, the touch operation data is transformed into a click operation at the coordinates (1600,600) of the first interactive interface, and then the touch operation
  • the data is sent to the tablet computer 304 through the cloud computing server 804, and the tablet computer 304 performs a touch response at the first interactive interface (1600, 600).
  • FIG. 9 is a schematic diagram of displaying a second touch response interface through a control center according to an embodiment.
  • the figure includes a smart hand panel 902, a cloud computing server 904, and a tablet computer 906.
  • the tablet computer 906 performs a touch response after receiving the WeChat opening operation, and obtains the WeChat opening interface, that is, the first touch response interface of the controlled terminal.
  • the tablet computer 906 sends the first touch corresponding interface to the smart handpad 902.
  • the resolution of the first touch response interface is 2048 ⁇ 1536 pixels. If the interface resolution of the smart handpad 902 is 1024 ⁇ 768 pixels, the first touch response interface can be scaled down to 50% of the original to get the second touch response.
  • the first touch response interface can be scaled down to 50% of the original, displayed at the center of the smart handpad 902 interface, and then filled with black in the undisplayed part , Get the second touch response interface. After that, the smart hand board 902 displays the second touch response interface.
  • a connection is established between the control terminal, the control center, and the controlled terminal.
  • the control terminal obtains the first interaction interface of the controlled terminal, and displays the second interaction according to the first interaction interface.
  • Interface since the second interactive interface matches the first interactive interface, the information of the first interactive interface can be fully displayed, and the touch operation on the second interactive interface is equivalent to the touch operation on the first interactive interface.
  • the touch operation data is forwarded through the control center, and after the controlled terminal responds to the touch operation according to the touch operation, a second touch response interface that matches the touch response of the controlled terminal is displayed on the control terminal, which can fully display the control The touch response result of the terminal.
  • This method interacts between the control terminal and the controlled terminal through the control center, instead of directly operating the control terminal, avoids performing complex data processing procedures on the control terminal, and solves the problem of the large weight and volume of the terminal in the traditional communication system , The problem of poor portability. Further, through the forwarding of the control center, the demand for long-distance communication can be met. Further, the future development prospects of the communication system can be maximized, and the complex problems caused by the existing terminal brands and operator configuration thresholds can be reduced.
  • the above step S502 may specifically include: establishing a connection with the control center through a 3G/4G/5G network or Wi-Fi.
  • the communication distance between the control terminal 602 and the control center 604 can be within the Wi-Fi communication range or within the communication range of the 3G/4G/5G network.
  • the control terminal 602 and the control center 604 pass through 3G /4G/5G network or Wi-Fi realizes data transmission.
  • the above method not only uses the Wi-Fi universal platform to allow any controlled terminal to develop application software at any time, but also uses wireless communication networks such as 3G/4G/5G networks, which can ensure communication quality when the transmission distance is long. Further meet the increasingly complex and diverse functional requirements of communication products.
  • step S502 may further include: obtaining an identity code; sending the identity code to the control center, and the identity code is forwarded to the controlled terminal via the control center for the receiving The control terminal establishes a connection after successfully verifying the identity code.
  • control terminal 602 is assigned an identity code in advance. After the control terminal 602 obtains its own identity code, it sends the identity code to the controlled terminal 606 through the control center 604 through the 3G/4G/5G network or Wi-Fi. The controlled terminal 606 reads the identity code and verifies the identity code. When the verification is passed, the identity code is recorded in the data table, and a connection is established with the control terminal 602 through the control center 604. Since the processing procedure of step S502 has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method After obtaining the identity code of the control terminal 602, the above method establishes a connection between the control terminal 602 and the controlled terminal 606 through the control center 604 according to the identity code, which can ensure the reliability of connection establishment and improve the accuracy of subsequent data transmission .
  • the above step S504 may specifically include: receiving a controlled terminal manipulation request; according to the controlled terminal manipulation request, accessing the control center to obtain the first interactive interface of the controlled terminal.
  • the controlled terminal manipulation request is a user's manipulation request for the controlled terminal 606.
  • the control terminal 602 when a user requests to manipulate the controlled terminal 606, the control terminal 602 receives the user's controlled terminal manipulation request, and according to the controlled terminal manipulation request, the control terminal 602 accesses the control center 604 to obtain the first interactive interface of the controlled terminal
  • the first interactive interface of the controlled terminal may be controlled terminal data pre-stored in the control center 604, or controlled terminal data obtained by accessing the interface data between the control terminal 602 and the control center 604. Since the processing process of step S504 has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method accesses the control center according to the control request of the controlled terminal, which can avoid performing complex data processing procedures on the control terminal, reduce the storage space of the control terminal and the volume of the data processing module, and solve the problem of the large weight and volume of the terminal in traditional communication systems The problem of poor portability.
  • the above step S504 may further include: obtaining interactive interface screenshot data through the control center; processing the interactive interface screenshot data to obtain processed interactive interface screenshot data.
  • the control terminal 602 intercepts the operation interface image of the controlled terminal 606 to obtain screenshot data of the interactive interface.
  • the screenshot data of the interactive interface is scaled, intercepted, or filled to obtain the processed interactive interface screenshot data.
  • the second interactive interface can be displayed. Since the processing process of step S504 has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method processes the screenshot data of the interactive interface after acquiring the screenshot data of the interactive interface. Since the second interactive interface matches the first interactive interface, the first interactive interface can be controlled by touching the second interactive interface, thus avoiding the control
  • the terminal performs a complex data processing process, reduces the storage space of the control terminal and the weight and volume of the data processing module, and solves the problem of large weight and volume and poor portability of the terminal in the traditional communication system.
  • the above step S512 may specifically include: obtaining response interface screenshot data through the control center; processing the response interface screenshot data to obtain the processed response interface screenshot data.
  • the control terminal 602 can intercept the first touch response interface image of the controlled terminal 606 to obtain screenshot data of the response interface. According to the size of the first touch response interface and the second touch response interface, the screenshot data of the response interface is scaled, intercepted or filled to obtain the processed response interface screenshot data. According to the processed response interface screenshot data, the second touch response interface can be displayed. Two touch response interface. Since the processing procedure of step S512 has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method processes the response interface screenshot data after acquiring the response interface screenshot data. Since the second touch response interface matches the first touch response interface, the first touch response interface can be controlled by touching the second touch response interface.
  • the control response interface avoids the implementation of complex data processing procedures on the control terminal, reduces the storage space of the control terminal and the weight and volume of the data processing module, and solves the problem of large terminal weight and volume and poor portability in traditional communication systems. problem.
  • S1004 Send the first interactive interface of the controlled terminal to the control terminal;
  • S1006 Perform a touch response according to the touch operation to obtain the first touch response interface
  • the controlled terminal 204 after establishing a connection with the control terminal 202, the controlled terminal 204 obtains the first interactive interface and sends the first interactive interface to the control terminal 202.
  • the user performs touch operations on the control terminal 202, and the control terminal 202 is The touch operation is processed and sent to the controlled terminal 204, and the controlled terminal 204 performs a touch response according to the touch operation to obtain the first touch response interface, and then sends the first touch response interface to the control terminal 202. Since the processing process of the above method has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method sends the first interactive interface of the controlled terminal to the control terminal by establishing a connection between the controlling terminal and the controlled terminal. Since the second interactive interface obtained at the controlling terminal can fully display the information of the first interactive interface, The control terminal performs touch response according to the touch operation, and the first touch response interface sent to the control terminal can fully display the touch response result of the controlled terminal.
  • This method replaces the direct operation of the control terminal with the interaction between the control terminal and the controlled terminal, avoids the execution of complex data processing procedures on the control terminal, reduces the storage space of the control terminal and the weight and volume of the data processing module. This solves the problems of large terminal weight and volume and poor portability in traditional communication systems.
  • the above step S1004 may specifically include: taking a screenshot of the first interactive interface of the controlled terminal to obtain the interactive interface screenshot data; and sending the interactive interface screenshot data to the control terminal.
  • the controlled terminal 204 takes a screenshot of the first interactive interface of the controlled terminal to obtain the interactive interface screenshot data. From the interactive interface screenshot data, the screen UI data, screen size, resolution, etc. can be obtained. Then, the controlled terminal 204 sends the screenshot data of the interactive interface to the control terminal 202. Since the processing process of the above method has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method takes a screenshot of the first interactive interface of the controlled terminal, and sends the screenshot data of the interactive interface to the control terminal, which avoids performing complex data processing procedures on the control terminal, and reduces the storage space of the control terminal and the weight and weight of the data processing module.
  • the volume solves the problems of large terminal weight and volume and poor portability in traditional communication systems.
  • the above step S1008 may specifically include: taking a screenshot of the first touch response interface to obtain the screenshot data of the response interface; and sending the screenshot data of the response interface to the control terminal.
  • the controlled terminal 204 takes a screenshot of the first touch response interface of the controlled terminal to obtain the response interface screenshot data, and the screen UI data, screen size, resolution, etc. can be obtained from the response interface screenshot data. Then, the controlled terminal 204 sends the response interface screenshot data to the control terminal 202. Since the processing process of the above method has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method takes a screenshot of the first touch response interface of the controlled terminal, and sends the screenshot data of the response interface to the control terminal, which avoids performing complex data processing procedures on the control terminal, and reduces the storage space of the control terminal and the cost of the data processing module.
  • the weight and volume solve the problems of large terminal weight and volume and poor portability in traditional communication systems.
  • S1104 Send the first interactive interface of the controlled terminal to the control terminal through the control center;
  • S1106 Perform a touch response according to the touch operation to obtain the first touch response interface
  • S1108 Send the first touch response interface to the control terminal through the control center.
  • the controlled terminal 606 establishes a connection with the control center 604 in advance.
  • the controlled terminal 606 obtains the first interactive interface and sends the first interactive interface through the control center 604
  • the user performs a touch operation on the control terminal 602
  • the control terminal 602 processes the touch operation and sends it to the controlled terminal 606, and the controlled terminal 606 responds with touch according to the touch operation to obtain the first touch Respond to the interface, and then send the first touch response interface to the control terminal 602 through the control center 604. Since the processing process of the above method has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method establishes a connection between the control terminal, the control center, and the controlled terminal, and sends the first interactive interface of the controlled terminal to the control terminal through the control center.
  • the second interactive interface obtained from the control terminal can fully display the first interactive interface.
  • the controlled terminal performs touch response according to the touch operation, and the first touch response interface sent to the control terminal through the control center can fully display the touch response result of the controlled terminal.
  • This method replaces the direct operation of the control terminal with the interaction between the control terminal and the controlled terminal, avoids the execution of complex data processing procedures on the control terminal, reduces the storage space of the control terminal and the weight and volume of the data processing module. This solves the problems of large terminal weight and volume and poor portability in traditional communication systems. Further, through the forwarding of the control center, the demand for long-distance communication can be met. Further, the future development prospects of the communication system can be maximized, and the complex problems caused by the existing terminal brands and operator configuration thresholds can be reduced.
  • the above step S1104 may specifically include: taking a screenshot of the first interactive interface of the controlled terminal to obtain the screenshot data of the interactive interface; and sending the screenshot data of the interactive interface to the control center through the control center. ⁇ Control terminal.
  • the controlled terminal 606 takes a screenshot of the first interactive interface of the controlled terminal to obtain the interactive interface screenshot data. From the interactive interface screenshot data, the screen UI data, screen size, resolution, etc. can be obtained. Then, through the control center 604, the controlled terminal 606 sends the screenshot data of the interactive interface to the control terminal 602. Since the processing process of the above method has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method takes a screenshot of the first interactive interface of the controlled terminal, and sends the screenshot data of the interactive interface to the control terminal through the control center, which avoids the execution of complex data processing procedures on the control terminal and reduces the storage space and data processing modules of the control terminal
  • the weight and volume of the traditional communication system solve the problem of large weight and volume and poor portability of the terminal in the traditional communication system.
  • the above step S1108 may specifically include: taking a screenshot of the first touch response interface to obtain the screenshot data of the response interface; sending the screenshot data of the response interface to the control center through the control center terminal.
  • the controlled terminal 606 takes a screenshot of the first touch response interface of the controlled terminal to obtain the response interface screenshot data, and the screen UI data, screen size, resolution, etc. can be obtained from the response interface screenshot data. Then, through the control center 604, the controlled terminal 606 sends the response interface screenshot data to the control terminal 602. Since the processing process of the above method has been described in detail in the foregoing embodiment, it will not be repeated here.
  • the above method takes a screenshot of the first touch response interface of the controlled terminal, and sends the screenshot data of the response interface to the control terminal through the control center, which avoids performing complex data processing procedures on the control terminal and reduces the storage space and data of the control terminal
  • the weight and volume of the processing module solves the problem of large terminal weight and volume and poor portability in traditional communication systems.
  • a terminal control system 1200 which includes a control terminal 1210 and a controlled terminal 1220.
  • FIG. 13 is a sequence diagram of the terminal control process of the terminal control system 1200. Referring to FIG. 13, the terminal control process may include the following steps:
  • the control terminal 1210 establishes a connection with the controlled terminal 1220;
  • the controlled terminal 1220 sends the first interactive interface to the control terminal 1210;
  • the control terminal 1210 receives a touch operation performed by the user on the second interactive interface
  • control terminal 1210 controls the controlled terminal 1220 to perform a touch response
  • the controlled terminal 1220 sends the first touch response interface to the control terminal 1210;
  • the control terminal 1210 displays a second touch response interface matching the first touch response interface of the controlled terminal 1220.
  • FIG. 15 is a sequence diagram of another terminal control process of the terminal control system 1400.
  • the terminal control process may include the following steps:
  • control center 1420 establishes a connection with the control terminal 1410, and is used to establish a connection with the controlled terminal 1430;
  • the controlled terminal 1430 sends the first interactive interface to the control center 1420;
  • the control center 1420 forwards the first interactive interface of the controlled terminal 1430 to the control terminal 1410;
  • S1508 Control the terminal 1410 to display a second interactive interface matching the first interactive interface
  • the control terminal 1410 receives a touch operation performed by the user on the second interactive interface
  • the control terminal 1410 sends the touch operation to the control center 1420;
  • the control center 1420 controls the controlled terminal 1430 to perform a touch response according to the touch operation;
  • the controlled terminal 1430 sends the first touch response interface to the control center 1420;
  • the control center 1420 forwards the first touch response interface of the controlled terminal 1430 to the control terminal 1410;
  • S1520 Control the terminal 1410 to display a second touch response interface matching the first touch response interface.
  • a terminal is provided.
  • the terminal is a control terminal and includes:
  • the wireless communication interface 1616 is used to establish a connection with the controlled terminal through wireless communication
  • the touch screen 1602 is used to display the second interactive interface
  • the touch display screen 1602 is configured to receive a touch operation performed by a user on the second interactive interface
  • the processor 1606 is configured to control the controlled terminal to perform a touch response to display a first touch response interface according to the touch operation;
  • the touch screen 1602 is used to display the second touch response interface.
  • the wireless communication interface 1616 can be a 3G/4G/5G network or Wi-Fi antenna interface
  • the touch screen 1602 can be an OLED (Organic Light-Emitting Diode) and a glass (or sapphire) cover.
  • the processor 1606 is equipped with Qualcomm APQ8053 on PCBA (Printed Circuit Board+Assembly).
  • the terminal also includes a partition 1604, a battery 1608 (capacity 1000mAh, 1.0mm), a USB interface 1610 (Type C), a stainless steel middle frame 1612 and a rear cover 1614.
  • the rear cover 1614 can be made of OLED and glass (or sapphire). ) Cover plate. Since there are no components such as microphones and cameras, the dialogue function can be realized by a Bluetooth headset, and photography can be realized by a watch.
  • the terminal thickness can be 4mm.
  • 5-6 inch screens can be used for hand-board terminals such as network mobile phones, network video terminals, game terminals and various extensions of smart watches (such as biological detection); for home management boards, reading boards, game boards, WeChat boards, and social boards
  • Smart home terminals such as homework boards and homework boards can use a 7-14-inch screen; for teaching boards, textbook boards, examination boards, conference boards, aviation boards, high-speed rail boards, and one-way confidential information boards, such as smart teaching, conference, aviation and high-speed rail
  • the terminal can also use a 7-14 inch screen; for desk boards, projection display boards, ordering boards, bus stop boards, household appliances boards, smart furniture boards, bar interactive boards, outdoor natural scene film and television interactive boards, and concerts Smart surface terminals such as competitive sports focus boards can use 5-105-inch screens.
  • the above-mentioned terminal can ensure the good realization of touch and display functions, and realize functions such as data processing and storage through the controlled terminal and/or control center, and functionally separate touch and display from other functions. Since there is no need to implement functions such as data processing and storage, compared with traditional terminals, the above-mentioned terminals can achieve various complex functions with lighter weight, smaller volume and thinner thickness, which solves the weight of terminals in traditional communication systems. And the problem of large size and poor portability.
  • an open communication platform due to the use of an open communication platform, it is possible to communicate directly through an open platform such as a wireless communication network or cloud without relying on any mobile phone brand or operator’s permission, avoiding existing terminal brands and operators. Complex problems caused by configuration thresholds.
  • a terminal control device including:
  • connection establishment module 1702 is used to establish a connection with the controlled terminal
  • the first obtaining module 1704 is configured to obtain the first interactive interface of the controlled terminal
  • the first display module 1706 is configured to display a second interactive interface; the second interactive interface matches the first interactive interface of the controlled terminal;
  • the receiving module 1708 is configured to receive a touch operation performed by the user on the second interactive interface
  • the control module 1710 is configured to control the controlled terminal to perform a touch response according to the touch operation
  • the second acquiring module 1712 is configured to acquire the first touch response interface of the controlled terminal; the first touch response interface is the interface displayed after the controlled terminal performs a touch response;
  • the second display module 1714 is configured to display a second touch response interface; the second touch response interface matches the first touch response interface of the controlled terminal.
  • the control terminal by establishing a connection between the control terminal and the controlled terminal, the control terminal obtains the first interaction interface of the controlled terminal, and displays the second interaction interface according to the first interaction interface. Matching an interactive interface can fully display the information of the first interactive interface, and performing a touch operation on the second interactive interface is equivalent to performing a touch operation on the first interactive interface.
  • a second touch response interface matching the touch response of the controlled terminal is displayed on the control terminal, which can fully display the touch response result of the controlled terminal.
  • This method replaces the direct operation of the control terminal with the interaction between the control terminal and the controlled terminal, avoids the execution of complex data processing procedures on the control terminal, reduces the storage space of the control terminal and the weight and volume of the data processing module. This solves the problems of large terminal weight and volume and poor portability in traditional communication systems.
  • another terminal control device including:
  • connection establishment module 1802 is used to establish a connection with the control center; establish a connection between the control center and the controlled terminal;
  • the first obtaining module 1804 is configured to obtain the first interactive interface of the controlled terminal through the control center;
  • the first display module 1806 is configured to display a second interactive interface; the second interactive interface matches the first interactive interface of the controlled terminal;
  • the receiving module 1808 is configured to receive a touch operation performed by a user on the second interactive interface
  • the control module 1810 is configured to send the touch operation to the control center; the control center is configured to control the controlled terminal to perform a touch response according to the touch operation;
  • the second acquisition module 1812 is configured to acquire the first touch response interface of the controlled terminal through the control center; the first touch response interface is the interface displayed after the controlled terminal performs a touch response ;
  • the second display module 1814 is configured to display a second touch response interface; the second touch response interface matches the first touch response interface of the controlled terminal.
  • the above terminal control device establishes a connection between the control terminal, the control center, and the controlled terminal.
  • the control terminal obtains the first interactive interface of the controlled terminal, and displays the second interactive interface according to the first interactive interface, Since the second interactive interface matches the first interactive interface, the information of the first interactive interface can be fully displayed, and the touch operation on the second interactive interface is equivalent to the touch operation on the first interactive interface.
  • the touch operation data is forwarded through the control center, and after the controlled terminal responds to the touch operation according to the touch operation, a second touch response interface that matches the touch response of the controlled terminal is displayed on the control terminal, which can fully display the control The touch response result of the terminal.
  • This method interacts between the control terminal and the controlled terminal through the control center, instead of directly operating the control terminal, avoids performing complex data processing procedures on the control terminal, and solves the problem of the large weight and volume of the terminal in the traditional communication system , The problem of poor portability. Further, through the forwarding of the control center, the demand for long-distance communication can be met. Further, the future development prospects of the communication system can be maximized, and the complex problems caused by the existing terminal brands and operator configuration thresholds can be reduced.
  • a computer device including a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the above terminal control method.
  • the steps of the terminal control method may be the steps in the terminal control method of each of the foregoing embodiments.
  • a computer-readable storage medium which stores a computer program, and when the computer program is executed by a processor, the processor causes the processor to execute the steps of the above-mentioned terminal control method.
  • the steps of the terminal control method may be the steps in the terminal control method of each of the foregoing embodiments.
  • Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

提供了一种终端控制方法、***、装置、计算机设备和存储介质。该方法包括:与受控终端建立连接(S102);获取受控终端的第一交互界面(S104);显示第二交互界面(S106);第二交互界面与受控终端的第一交互界面相匹配;接收用户针对第二交互界面进行的触控操作(S108);根据触控操作,控制受控终端进行触控响应(S110);获取受控终端的第一触控响应界面(S112);第一触控响应界面为受控终端进行触控响应后所显示的界面;显示第二触控响应界面(S114);第二触控响应界面与受控终端的第一触控响应界面相匹配。采用该方法,可以降低无线通信终端的重量和体积,提高终端设备的便携性。

Description

终端控制方法、***、装置、计算机设备和存储介质 技术领域
本申请涉及通信领域,特别是涉及一种终端控制方法、***、装置、计算机设备和存储介质。
背景技术
随着通信技术的发展,人们对于通信产品的需求日益复杂化和多样化,这就对通信***在传输速率、存储容量和信号处理能力等方面提出了更高的要求。在此基础之上,随着可穿戴设备和智能手表等技术的出现,通信***中的终端设备逐渐趋于小型化,在实现复杂多样的功能之余,还需要尽可能减小各个功能模块的重量和体积,以利于实现便携性。
传统上,为了降低终端的复杂度,提高便携性,可以在终端各个功能模块中使用具有更高集成度的处理器芯片,提高数据处理和传输的效率;或者,对通信算法进行优化设计,降低数据传输错误率,提高传输速率,节省存储空间。
然而,随着人们需求的不断增加,上述方法对于终端复杂度的改进效果有限,终端设备在发展过程中始终需要面对重量和体积不断增大、不便于携带的问题。
因此,终端存在重量和体积较大、便携性较差的问题。
发明内容
基于此,有必要针对通信终端重量和体积较大、便携性较差的问题,提供一种终端控制方法、***、装置、计算机设备和存储介质。
一种终端控制方法,包括:
与受控终端建立连接;
获取所述受控终端的第一交互界面;
显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
接收用户针对所述第二交互界面进行的触控操作;
根据所述触控操作,控制所述受控终端进行触控响应;
获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
在其中一个实施例中,所述根据所述触控操作,控制所述受控终端进行触控响应,包括:
根据所述触控操作,得到触控操作数据;
根据所述触控操作数据,得到受控终端触控操作数据;所述受控终端触控操作数据用于针对所述受控终端的第一交互界面进行触控操作;
将所述受控终端触控操作数据发送至所述受控终端,供所述受控终端根据所述受控终端触控操作数据进行触控响应,得到所述受控终端的第一触控响应界面。
在其中一个实施例中,所述与受控终端建立连接,包括:
通过Wi-Fi、蓝牙或自定义无线协议与所述受控终端建立连接。
在其中一个实施例中,所述与受控终端建立连接,还包括:
获取身份代码;
发送所述身份代码至所述受控终端,供所述受控终端在验证所述身份代码成功后建立连接。
在其中一个实施例中,所述获取所述受控终端的第一交互界面,包括:
获取交互界面截屏数据;所述交互界面截屏数据为对所述受控终端的第一交互界面进行截屏得到的数据;
对所述交互界面截屏数据进行处理,得到处理后交互界面截屏数据;所述处理后交互界面截屏数据用于显示所述第二交互界面。
在其中一个实施例中,所述获取所述受控终端的第一触控响应界面,包括:
获取响应界面截屏数据;所述响应界面截屏数据为对所述受控终端的第一触控响应界面进行截屏得到的 数据;
对所述响应界面截屏数据进行处理,得到处理后响应界面截屏数据;所述处理后响应界面截屏数据用于显示所述第二触控响应界面。
一种终端控制方法,还包括:
与控制中心建立连接;所述控制中心与受控终端之间建立连接;
通过所述控制中心获取所述受控终端的第一交互界面;
显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
接收用户针对所述第二交互界面进行的触控操作;
将所述触控操作发送至所述控制中心;所述控制中心用于根据所述触控操作,控制所述受控终端进行触控响应;
通过所述控制中心获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
在其中一个实施例中,所述与控制中心建立连接,包括:
通过3G/4G/5G网络或Wi-Fi与所述控制中心建立连接。
在其中一个实施例中,所述与控制中心建立连接,还包括:
获取身份代码;
发送所述身份代码至所述控制中心,所述身份代码经所述控制中心转发至所述受控终端,供所述受控终端在验证所述身份代码成功后建立连接。
在其中一个实施例中,所述通过所述控制中心获取所述受控终端的第一交互界面,包括:
接收受控终端操控请求;所述受控终端操控请求用于用户请求操控所述受控终端;
根据所述受控终端操控请求,访问所述控制中心,得到所述受控终端的第一交互界面。
在其中一个实施例中,所述通过所述控制中心获取所述受控终端的第一交互界面,还包括:
通过所述控制中心获取交互界面截屏数据;所述交互界面截屏数据为对所述受控终端的第一交互界面进行截屏得到的数据;
对所述交互界面截屏数据进行处理,得到处理后交互界面截屏数据;所述通过所述控制中心后交互界面截屏数据用于显示所述第二交互界面。
在其中一个实施例中,所述通过所述控制中心获取所述受控终端的第一触控响应界面,包括:
通过所述控制中心获取响应界面截屏数据;所述响应界面截屏数据为对所述受控终端的第一触控响应界面进行截屏得到的数据;
对所述响应界面截屏数据进行处理,得到处理后响应界面截屏数据;所述处理后响应界面截屏数据用于显示所述第二触控响应界面。
一种终端控制方法,还包括:
与控制终端建立连接;
将所述受控终端的第一交互界面发送至所述控制终端;
根据所述触控操作进行触控响应,得到所述第一触控响应界面;
将所述第一触控响应界面发送至所述控制终端。
在其中一个实施例中,所述将所述受控终端的第一交互界面发送至所述控制终端,包括:
对所述受控终端的第一交互界面进行截屏,得到所述交互界面截屏数据;
发送所述交互界面截屏数据至所述控制终端。
在其中一个实施例中,所述将所述第一触控响应界面发送至所述控制终端,包括:
对所述第一触控响应界面进行截屏,得到所述响应界面截屏数据;
发送所述响应界面截屏数据至所述控制终端。
一种终端控制方法,还包括:
与控制中心建立连接;所述控制中心与控制终端之间建立连接;
通过所述控制中心发送所述受控终端的第一交互界面至所述控制终端;
根据所述触控操作进行触控响应,得到所述第一触控响应界面;
通过所述控制中心发送所述第一触控响应界面至所述控制终端。
在其中一个实施例中,所述通过所述控制中心发送所述受控终端的第一交互界面至所述控制终端,包括:
对所述受控终端的第一交互界面进行截屏,得到所述交互界面截屏数据;
通过所述控制中心发送所述交互界面截屏数据至所述控制终端。
在其中一个实施例中,所述通过所述控制中心发送所述第一触控响应界面至所述控制终端,包括:
对所述第一触控响应界面进行截屏,得到所述响应界面截屏数据;
通过所述控制中心发送所述响应界面截屏数据至所述控制终端。
一种终端控制***,包括:控制终端和受控终端;所述受控终端显示有第一交互界面;
所述控制终端,用于与所述受控终端建立连接;
所述受控终端,用于将所述第一交互界面发送至所述控制终端;
所述控制终端,用于显示与所述第一交互界面相匹配的第二交互界面;
所述控制终端,用于接收用户针对所述第二交互界面进行的触控操作;
所述控制终端,用于根据所述触控操作,控制所述受控终端进行触控响应;
所述受控终端,用于将所述第一触控响应界面发送至所述控制终端;
所述控制终端,用于显示与所述受控终端的第一触控响应界面相匹配的第二触控响应界面。
一种终端控制***,包括:控制终端、控制中心和受控终端;
所述控制中心,用于与所述控制终端建立连接,并且,用于与所述受控终端建立连接;
所述受控终端,用于将所述第一交互界面发送至所述控制中心;
所述控制中心,用于将所述受控终端的所述第一交互界面转发至所述控制终端;
所述控制终端,用于显示与所述第一交互界面相匹配的第二交互界面;
所述控制终端,用于接收用户针对所述第二交互界面进行的触控操作;
所述控制终端,用于将所述触控操作发送至所述控制中心;
所述控制中心,用于根据所述触控操作,控制所述受控终端进行触控响应;
所述受控终端,用于将所述第一触控响应界面发送至所述控制中心;
所述控制中心,用于将所述受控终端的所述第一触控响应界面转发至所述控制终端;
所述控制终端,用于显示与所述第一触控响应界面相匹配的第二触控响应界面。
一种终端,包括:无线通信接口、触控显示屏和处理器;
所述无线通信接口,用于通过无线通信的方式与受控终端建立连接;
所述触控显示屏,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
所述触控显示屏,用于接收用户针对所述第二交互界面进行的触控操作;
所述处理器,用于根据所述触控操作,控制所述受控终端进行触控响应以显示第一触控响应界面;
所述触控显示屏,用于显示第二触控响应界面;所述第二触控响应界面与所述第一触控响应界面相匹配。
一种终端控制装置,所述装置包括:
连接建立模块,用于与受控终端建立连接;
第一获取模块,用于获取所述受控终端的第一交互界面;
第一显示模块,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
接收模块,用于接收用户针对所述第二交互界面进行的触控操作;
控制模块,用于根据所述触控操作,控制所述受控终端进行触控响应;
第二获取模块,用于获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
第二显示模块,用于显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
一种终端控制装置,所述装置包括:
连接建立模块,用于与控制中心建立连接;所述控制中心与受控终端之间建立连接;
第一获取模块,用于通过所述控制中心获取所述受控终端的第一交互界面;
第一显示模块,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
接收模块,用于接收用户针对所述第二交互界面进行的触控操作;
控制模块,用于将所述触控操作发送至所述控制中心;所述控制中心用于根据所述触控操作,控制所述受控终端进行触控响应;
第二获取模块,用于通过所述控制中心获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
第二显示模块,用于显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时用于实现所述终端控制方法。
一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时用于实现所述终端控制方法。
上述终端控制方法、***、装置、计算机设备和存储介质,通过在控制终端与受控终端之间建立连接,由控制终端获取受控终端的第一交互界面,并根据第一交互界面显示第二交互界面,由于第二交互界面与第一交互界面相匹配,可以全面展示第一交互界面的信息,对第二交互界面进行触控操作,相当于对第一交互界面进行触控操作。受控终端根据触控操作进行触控响应后,在控制终端上显示与受控终端的触控响应相匹配的第二触控响应界面,可以全面展示受控终端的触控响应结果。此种方法用控制终端与被控终端之间交互代替对控制终端直接进行操作,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
附图说明
图1为一个实施例中一种终端控制方法的流程示意图;
图2为一个实施例中一种终端控制方法的应用环境图;
图3为一个实施例中一种控制受控终端进行触控响应的示意图;
图4为一个实施例中一种显示第二触控响应界面的示意图;
图5为一个实施例中另一种终端控制方法的流程示意图;
图6为一个实施例中另一种终端控制方法的应用环境图;
图7为一个实施例中一种终端控制方法的软件架构示意图;
图8为一个实施例中一种通过控制中心控制受控终端进行触控响应的示意图;
图9为一个实施例中一种通过控制中心显示第二触控响应界面的示意图;
图10为一个实施例中一种终端控制方法的流程示意图;
图11为一个实施例中一种终端控制方法的流程示意图;
图12为一个实施例中一种终端控制***的示意图;
图13为一个实施例中一种终端控制流程的时序图;
图14为一个实施例中另一种终端控制***的示意图;
图15为一个实施例中另一种终端控制流程的时序图;
图16为一个实施例中一种控制终端的产品结构图;
图17为一个实施例中一种终端控制装置的结构框图;
图18为一个实施例中另一种终端控制装置的结构框图。
具体实施方式
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。
在一个实施例中,如图1所示,提供了一种终端控制方法。本实施例提供的终端控制方法,可以应用于如图2所示的应用环境中。在该应用环境中,包括有控制终端202和受控终端204。
其中,控制终端202具有触控和显示功能。触控功能为用户在触控屏上通过触摸或书写笔书写来控制操作界面,显示功能包括显示操作界面和触控响应界面,触控响应界面为触控操作之后,显示相应的触控响应的界面。
其中,受控终端204为控制终端202所控制的终端,受控终端204将操作界面通过无线链路传输给控制 终端202,并对于控制终端202的触控操作,做出触控响应,通过无线链路将触控响应界面传输给控制终端202。
上述终端控制方法,以应用于图2中的控制终端202为例进行说明,可以包括以下步骤:
S102,与受控终端建立连接。
具体实现中,预先为控制终端202分配身份代码,身份代码用来区分不同的控制终端202。控制终端202与受控终端204都安装有特定的软件,用于两者建立连接。控制终端202通过Wi-Fi、蓝牙或自定义无线协议将自身的身份代码发送至受控终端204,受控终端204读取身份代码,将身份代码记录在数据表中,然后与控制终端202建立连接。
例如,控制终端202将身份代码“001”发送给受控终端204,受控终端204读取身份代码,将“001”记录在数据表中,在与控制终端202建立连接后,可以知道受控终端204与身份代码为“001”的控制终端建立了连接。
S104,获取所述受控终端的第一交互界面。
其中,第一交互界面为受控终端204上所显示的操作界面。
具体实现中,可以截取受控终端204的操作界面图像,将该操作界面图像作为第一交互界面,或者,截取受控终端204屏幕UI(User Interface,用户界面)数据、屏幕尺寸、分辨率等数据,根据这些数据得到第一交互界面。
例如,对于受控终端204,可以对其整个操作界面进行截屏操作,将截屏结果作为第一交互界面。或者,读取受控终端204的操作界面参数,得到分辨率2048×1536像素,当操作界面左上角为坐标原点时,软件图标(例如微信图标)位于坐标(1600,600)像素处,根据分辨率、图标类型和图标位置,可以得到第一交互界面。
S106,显示第二交互界面。
其中,第二交互界面为根据控制终端202界面来进行显示的第一交互界面,即第二交互界面与受控终端204的第一交互界面相匹配。
具体实现中,可以将第一交互界面的屏幕UI数据、屏幕尺寸、分辨率等数据打包在通信协议中发送给控制终端202,根据控制终端202界面的分辨率对第一交互界面数据进行等比例缩放得到第二交互界面,当控制终端202界面与第一交互界面的分辨率不成等比例时,可以先对第一交互界面进行等比例缩放,然后,根据缩放结果进行截取或填充等操作,得到第二交互界面,并对第二交互界面进行显示。
例如,第一交互界面分辨率为2048×1536像素,若控制终端202界面分辨率为1024×768像素,可以将第一交互界面等比例缩小到原来的50%,得到第二交互界面;若控制终端202界面分辨率为1024×800像素,可以先将第一交互界面等比例缩小到原来的50%,显示在控制终端202界面的中心处,然后在空白部分填充黑色,得到第二交互界面。
S108,接收用户针对所述第二交互界面进行的触控操作。
其中,触控操作为用户在第二交互界面上通过触摸或书写笔书写来控制操作界面的操作。
具体实现中,用户可以通过手指或书写笔在第二交互界面上点击软件图标打开软件,在软件打开之后点击软件中的各个控件,或者在软件打开之后的操作界面中通过书写进行触控操作。
例如,在第二交互界面坐标为(1600,600)像素的位置有微信图标,用户可以点击微信图标,在打开的微信中点击各个控件,或者在微信对话框中输入文字。在执行上述触控操作后,控制终端202接收上述触控操作。
S110,根据所述触控操作,控制所述受控终端进行触控响应。
其中,触控响应为受控终端204根据触控操作所进行的响应。
具体实现中,控制终端202在得到触控操作后,从触控操作中提取触控操作数据,然后,可以根据第一交互界面和第二交互界面比例,对触控操作数据进行处理,将处理后的触控操作数据发送至受控终端204,受控终端204根据处理后触控数据进行触控响应,触控响应包括响应后的屏幕UI数据和声音等信息。
图3是一个实施例的一种控制受控终端进行触控响应的示意图,图中包括有智能手板302和平板电脑304,其中智能手板302为控制终端,平板电脑304为受控终端。参考图3,平板电脑304的第一交互界面分辨率为2048×1536像素,智能手板302的第二交互界面分辨率为1024×768像素,当用户需要开启微信时,在第二交互界面坐标为(800,300)处点击微信图标,根据第一交互界面与第二交互界面的比例,将触 控操作数据变换为对第一交互界面坐标(1600,600)处的点击操作,然后将该触控操作数据通过网络发送给平板电脑304,平板电脑304在第一交互界面(1600,600)处进行触控响应。
S112,获取所述受控终端的第一触控响应界面。
其中,第一触控响应界面为受控终端204进行触控响应后所显示的界面。
具体实现中,可以截取受控终端204的触控响应界面图像,将该触控响应界面图像作为第一触控响应界面,或者,读取受控终端204触控响应界面的分辨率、颜色和文字等信息,根据这些信息得到第一触控响应界面。
例如,对于受控终端204,可以对其整个触控响应界面进行截屏操作,将截屏结果作为第一触控响应界面。或者,读取受控终端204的触控响应界面信息,包括分辨率2048×1536像素,触控响应所显示的文字内容和位置,触控响应所显示的图像颜色和位置等,根据上述触控响应界面信息得到第一触控响应界面。
S114,显示第二触控响应界面。
其中,第二触控响应界面为与受控终端204的第一触控响应界面相匹配的界面。
具体实现中,可以根据控制终端202界面的分辨率对第一触控响应界面进行等比例缩放得到第二触控响应界面,当控制终端202界面与第一触控响应界面的分辨率不成等比例时,可以先对第一触控响应界面进行等比例缩放,然后,根据缩放结果进行截取或填充等操作,得到第二触控响应界面,然后对第二触控响应界面进行显示。
图4是一个实施例的一种显示第二触控响应界面的示意图,图中包括有智能手板402和平板电脑404,其中智能手板402为控制终端,平板电脑404为受控终端。参考图4,平板电脑404在接收到微信开启操作后,进行触控响应,得到微信开启界面,即受控终端的第一触控响应界面。通过网络将第一触控相应界面发送至智能手板402。第一触控响应界面分辨率为2048×1536像素,若智能手板402界面分辨率为1024×768像素,可以将第一触控响应界面等比例缩小到原来的50%,得到第二触控响应界面;若智能手板402界面分辨率为700×384像素,可以先将第一触控响应界面等比例缩小到原来的50%,显示在智能手板402界面的中心处,然后在未显示部分填充黑色,得到第二触控响应界面。之后,智能手板402对第二触控响应界面进行显示。
上述的终端控制方法中,通过在控制终端与受控终端之间建立连接,由控制终端获取受控终端的第一交互界面,并根据第一交互界面显示第二交互界面,由于第二交互界面与第一交互界面相匹配,可以全面展示第一交互界面的信息,对第二交互界面进行触控操作,相当于对第一交互界面进行触控操作。受控终端根据触控操作进行触控响应后,在控制终端上显示与受控终端的触控响应相匹配的第二触控响应界面,可以全面展示受控终端的触控响应结果。此种方法用控制终端与被控终端之间交互代替对控制终端直接进行操作,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S110,可以具体包括:
根据所述触控操作,得到触控操作数据;根据所述触控操作数据,得到受控终端触控操作数据;将所述受控终端触控操作数据发送至所述受控终端,供所述受控终端根据所述受控终端触控操作数据进行触控响应,得到所述受控终端的第一触控响应界面。
其中,触控操作数据为用户在控制终端202上执行触控操作的数据,包括触控操作位置、时间等数据。
其中,受控终端触控操作数据为对触控操作数据进行处理,所得到的针对于受控终端204的触控操作数据。
具体实现中,控制终端202在得到触控操作后,从触控操作中提取触控操作数据,然后,可以根据第一交互界面和第二交互界面比例,对触控操作数据进行处理,得到受控终端触控操作数据,将受控终端触控操作数据发送至受控终端204,受控终端204根据受控终端触控操作数据进行触控响应。由于步骤S110的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述的终端控制方法,在控制终端根据触控操作,得到触控操作数据,然后对触控操作数据进行变换,得到针对受控终端的第一交互界面的受控终端触控操作数据,由于受控终端的触控操作数据为对受控终端的触控操作数据进行变换得到,两者相匹配,可以在受控终端上准确实现触控操作。受控终端根据受控终端触控操作数据进行触控响应,得到第一触控响应界面,由于第一触控响应界面与控制终端的第二触控响应界面相匹配,控制终端不需要进行复杂的数据处理过程,就可以得到触控响应信息,减少了控制终端的存储空间 以及数据处理模块的重量和体积,进而可以解决传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S102,可以具体包括:通过Wi-Fi、蓝牙或自定义无线协议与所述受控终端建立连接。
具体实现中,控制终端202与受控终端204之间的通信距离在Wi-Fi或蓝牙通信范围内,两者通过Wi-Fi、蓝牙或自定义无线协议实现数据的传输。
上述方法中由于使用的是Wi-Fi或蓝牙这样的通用平台,或者使用自定义无线协议,可以保持完全开放的操作环境,允许任何受控终端随时开发应用软件,能够满足通信产品日益复杂多样的功能需求。
在一个实施例中,上述步骤S102,可以还包括:获取身份代码;发送所述身份代码至所述受控终端,供所述受控终端在验证所述身份代码成功后建立连接。
其中,身份代码为控制终端202的身份信息。
具体实现中,预先为控制终端202分配身份代码,控制终端202在获取自身的身份代码后,通过Wi-Fi、蓝牙或自定义无线协议将身份代码发送至受控终端204,受控终端204读取身份代码,并对身份代码进行验证,当验证通过时,将身份代码记录在数据表中,与控制终端202建立连接。
例如,控制终端202将身份代码“001”发送给受控终端204,受控终端204读取身份代码,并对身份代码进行验证,当验证结果为准许建立连接时,将“001”记录在数据表中,与控制终端202建立连接。
上述方法在获取控制终端202的身份代码后,根据身份代码在控制终端202和受控终端204之间建立连接,可以确保连接建立的可靠性,提高后续数据传输的准确性。
在一个实施例中,上述步骤S104,可以具体包括:获取交互界面截屏数据;对所述交互界面截屏数据进行处理,得到处理后交互界面截屏数据。
其中,交互界面截屏数据为对受控终端204的第一交互界面进行截屏得到的数据。
其中,处理后交互界面截屏数据为对交互界面截屏数据进行处理,用于显示第二交互界面的截屏数据。
具体实现中,控制终端202可以截取受控终端204的操作界面图像,得到交互界面截屏数据,由交互界面截屏数据可以得到屏幕UI数据、屏幕尺寸、分辨率等。然后,根据第一交互界面和第二交互界面的尺寸,对交互界面截屏数据进行缩放、截取或填充等处理,得到处理后交互界面截屏数据,根据处理后交互界面截屏数据,可以显示第二交互界面。由于步骤S104的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法在获取交互界面截屏数据后,对交互界面截屏数据进行处理,使得显示的第二交互界面与第一交互界面相匹配,可以全面展示第一交互界面的信息,对第二交互界面进行触控操作,相当于对第一交互界面进行触控操作,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S112,可以具体包括:获取响应界面截屏数据;对所述响应界面截屏数据进行处理,得到处理后响应界面截屏数据。
其中,响应界面截屏数据为对受控终端204的第一触控响应界面进行截屏得到的数据。
其中,处理后响应界面截屏数据为对响应界面截屏数据进行处理,用于显示第二触控响应界面的截屏数据。
具体实现中,控制终端202可以截取受控终端204的第一触控响应界面图像,得到响应界面截屏数据,由响应界面截屏数据可以得到屏幕UI数据、屏幕尺寸、分辨率等。然后,根据第一触控响应界面和第二触控响应界面的尺寸,对响应界面截屏数据进行缩放、截取或填充等处理,得到处理后响应界面截屏数据,根据处理后响应界面截屏数据,可以显示第二触控响应界面。由于步骤S112的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法在获取响应界面截屏数据后,对响应界面截屏数据进行处理,使得显示的第二触控响应界面与第一触控响应界面相匹配,可以全面展示第一触控响应界面的信息,对第二触控响应界面进行触控操作,相当于对第一触控响应界面进行触控操作,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,如图5所示,提供了另一种终端控制方法。本实施例提供的终端控制方法,可以应用于如图6所示的应用环境中。在该应用环境中,包括有控制终端602、控制中心604和受控终端606。
其中,控制中心用于在控制终端和受控终端之间进行数据转发,可以为云计算服务器等。
参照图5,该终端控制方法具体包括如下步骤:
S502,与控制中心建立连接;
S504,通过所述控制中心获取所述受控终端的第一交互界面;
S506,显示第二交互界面;
S508,接收用户针对所述第二交互界面进行的触控操作;
S510,将所述触控操作发送至所述控制中心;
S512,通过所述控制中心获取所述受控终端的第一触控响应界面;
S514,显示第二触控响应界面。
具体实现中,受控终端606预先与控制中心604建立连接,受控终端606可以预先将数据备份在控制中心604,且将其设置为可访问状态,或者,通过预先安装的软件使受控终端606处于可控状态。控制终端602向控制中心604发送自身的身份代码,控制中心604在接收身份代码后与控制终端602建立连接。控制终端602通过控制中心604获取受控终端606的第一交互界面,在对第一交互界面进行处理后得到第二交互界面,并对第二交互界面进行显示。用户针对第二交互界面进行触控操作,控制终端602中预先设置有浏览器入口等用于接收用户触控操作的软件,控制终端602接收触控操作,采集触控操作数据,对触控操作数据进行处理后,通过控制中心604转发至受控终端606。受控终端606对于触控操作进行响应,得到第一触控响应界面,并将第一触控响应界面的数据通过控制中心604发送至控制终端602。控制终端602对第一触控响应界面进行处理后得到第二触控响应,并对第二触控响应进行显示。
图7是一个实施例的一种终端控制方法的软件架构示意图,图中包括有智能手板702、云计算服务器704和平板电脑706,其中智能手板702为控制终端,云计算服务器704为控制中心,平板电脑706为受控终端。其中,云计算服务器704包括消息中间件708、前端710、后端712和数据库714。
参考图7,平板电脑706上运行街区屏幕UI和touch(触摸)事件等数据的软件,经由4G/5G网络,通过TCP/IP协议承载私有协议数据,与云计算服务器704建立连接。云计算服务器704中,消息中间件708高效分发数据,后端712与前端710通过Websocket协议进行双向通信,在平板电脑706侧,云计算服务器704高效传递交互界面截屏数据或触控响应界面截屏数据渲染前端710;在智能手板702侧,云计算服务器704高效接收智能手板702的请求接收前端710的触控操作数据,通过TCP/IP发送给消息中间件708,消息中间件708高效分发数据,将数据用TCP/IP协议承载私有协议进行数据封装,转发给平板电脑706。智能手板702通过HTTP或RESTful(REpresentational State Transfer,表现层状态转化)接口访问前端710和后端712提供的Web服务,可对平板电脑706进行操作并通过云计算服务器704将触控操作数据高效转发给平板电脑706,实现操作和计算的网络化。
图8是一个实施例的一种通过控制中心控制受控终端进行触控响应的示意图,图中包括有智能手板802、云计算服务器804和平板电脑806。参考图8,平板电脑806的第一交互界面分辨率为2048×1536像素,智能手板802的第二交互界面分辨率为1024×768像素,当用户需要开启微信时,在第二交互界面坐标为(800,300)处点击微信图标,根据第一交互界面与第二交互界面的比例,将触控操作数据变换为对第一交互界面坐标(1600,600)处的点击操作,然后将该触控操作数据通过云计算服务器804发送给平板电脑304,平板电脑304在第一交互界面(1600,600)处进行触控响应。
图9是一个实施例的一种通过控制中心显示第二触控响应界面的示意图,图中包括有智能手板902、云计算服务器904和平板电脑906。参考图9,通过云计算服务器904,平板电脑906在接收到微信开启操作后,进行触控响应,得到微信开启界面,即受控终端的第一触控响应界面。通过云计算服务器904,平板电脑906将第一触控相应界面发送至智能手板902。第一触控响应界面分辨率为2048×1536像素,若智能手板902界面分辨率为1024×768像素,可以将第一触控响应界面等比例缩小到原来的50%,得到第二触控响应界面;若智能手板902界面分辨率为700×384像素,可以先将第一触控响应界面等比例缩小到原来的50%,显示在智能手板902界面的中心处,然后在未显示部分填充黑色,得到第二触控响应界面。之后,智能手板902对第二触控响应界面进行显示。
上述的终端控制方法中,在控制终端、控制中心和受控终端之间建立连接,通过控制中心的转发,控制终端获取受控终端的第一交互界面,并根据第一交互界面显示第二交互界面,由于第二交互界面与第一交互界面相匹配,可以全面展示第一交互界面的信息,对第二交互界面进行触控操作,相当于对第一交互界面进行触控操作。经由控制中心转发触控操作数据,受控终端根据触控操作进行触控响应后,在控制终端上显示与受控终端的触控响应相匹配的第二触控响应界面,可以全面展示受控终端的触控响应结果。该方法在控制 终端与被控终端之间通过控制中心进行交互,代替了对控制终端直接进行操作,避免了在控制终端执行复杂的数据处理过程,解决了传统通信***中终端重量和体积较大、便携性较差的问题。进一步地,通过控制中心的转发,可以满足较远距离通信的需求。进一步地,可以最大化通信***的未来发展前景,降低由于现有终端品牌和运营商配置门槛引起的复杂问题。
在一个实施例中,上述步骤S502,可以具体包括:通过3G/4G/5G网络或Wi-Fi与所述控制中心建立连接。
具体实现中,控制终端602与控制中心604之间的通信距离可以在Wi-Fi通信范围内,也可以在3G/4G/5G网络的通信范围内,控制终端602与控制中心604之间通过3G/4G/5G网络或Wi-Fi实现数据的传输。
上述方法中不但使用了Wi-Fi通用平台,允许任何受控终端随时开发应用软件,而且使用了3G/4G/5G网络等无线通信网络,在传输距离较远的情况下能够确保通信质量,能够进一步满足通信产品日益复杂多样的功能需求。
在一个实施例中,上述步骤S502,可以还包括:获取身份代码;发送所述身份代码至所述控制中心,所述身份代码经所述控制中心转发至所述受控终端,供所述受控终端在验证所述身份代码成功后建立连接。
具体实现中,预先为控制终端602分配身份代码,控制终端602在获取自身的身份代码后,通过3G/4G/5G网络或Wi-Fi,通过控制中心604将身份代码发送至受控终端606,受控终端606读取身份代码,并对身份代码进行验证,当验证通过时,将身份代码记录在数据表中,通过控制中心604与控制终端602建立连接。由于步骤S502的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法在获取控制终端602的身份代码后,根据身份代码,通过控制中心604,在控制终端602和受控终端606之间建立连接,可以确保连接建立的可靠性,提高后续数据传输的准确性。
在一个实施例中,上述步骤S504,可以具体包括:接收受控终端操控请求;根据所述受控终端操控请求,访问所述控制中心,得到所述受控终端的第一交互界面。
其中,受控终端操控请求为用户对于受控终端606的操控请求。
具体实现中,当用户请求操控受控终端606时,控制终端602接收用户的受控终端操控请求,根据受控终端操控请求,控制终端602访问控制中心604,得到受控终端的第一交互界面,其中,受控终端的第一交互界面可以为预先存储在控制中心604的受控终端数据,或者是通过访问控制终端602与控制中心604之间的接口数据,得到的受控终端数据。由于步骤S504的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法根据受控终端操控请求访问控制中心,可以避免在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间和数据处理模块体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S504,可以还包括:通过所述控制中心获取交互界面截屏数据;对所述交互界面截屏数据进行处理,得到处理后交互界面截屏数据。
具体实现中,通过控制中心604,控制终端602截取受控终端606的操作界面图像,得到交互界面截屏数据。根据第一交互界面和第二交互界面的尺寸,对交互界面截屏数据进行缩放、截取或填充等处理,得到处理后交互界面截屏数据,根据处理后交互界面截屏数据,可以显示第二交互界面。由于步骤S504的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法在获取交互界面截屏数据后,对交互界面截屏数据进行处理,由于第二交互界面与第一交互界面相匹配,可以通过触控第二交互界面来控制第一交互界面,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S512,可以具体包括:通过所述控制中心获取响应界面截屏数据;对所述响应界面截屏数据进行处理,得到处理后响应界面截屏数据。
具体实现中,通过控制中心604,控制终端602可以截取受控终端606的第一触控响应界面图像,得到响应界面截屏数据。根据第一触控响应界面和第二触控响应界面的尺寸,对响应界面截屏数据进行缩放、截取或填充等处理,得到处理后响应界面截屏数据,根据处理后响应界面截屏数据,可以显示第二触控响应界面。由于步骤S512的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法在获取响应界面截屏数据后,对响应界面截屏数据进行处理,由于第二触控响应界面与第一触控响应界面相匹配,可以通过触控第二触控响应界面来控制第一触控响应界面,避免了在控制终端执行复杂 的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
如图10所示,在一个实施例中,以应用于图2中的受控终端204为例进行说明,可以包括以下步骤:
S1002,与控制终端建立连接;
S1004,将所述受控终端的第一交互界面发送至所述控制终端;
S1006,根据所述触控操作进行触控响应,得到所述第一触控响应界面;
S1008,将所述第一触控响应界面发送至所述控制终端。
具体实现中,在与控制终端202建立连接后,受控终端204得到第一交互界面,并将第一交互界面发送至控制终端202,用户在控制终端202进行触控操作,控制终端202在对触控操作进行处理后发送至受控终端204,受控终端204根据触控操作进行触控响应,得到第一触控响应界面,然后将第一触控响应界面发送至控制终端202。由于上述方法的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法通过在控制终端与受控终端之间建立连接,将受控终端的第一交互界面发送至控制终端,由于在控制终端得到的第二交互界面可以全面展示第一交互界面的信息,受控终端根据触控操作进行触控响应,发送至控制终端的第一触控响应界面可以全面展示受控终端的触控响应结果。此种方法用控制终端与被控终端之间交互代替对控制终端直接进行操作,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S1004,可以具体包括:对所述受控终端的第一交互界面进行截屏,得到所述交互界面截屏数据;发送所述交互界面截屏数据至所述控制终端。
具体实现中,受控终端204对受控终端的第一交互界面进行截屏,得到交互界面截屏数据,由交互界面截屏数据可以得到屏幕UI数据、屏幕尺寸、分辨率等。然后,受控终端204将交互界面截屏数据发送至控制终端202。由于上述方法的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法对受控终端的第一交互界面进行截屏,将交互界面截屏数据发送至控制终端,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S1008,可以具体包括:对所述第一触控响应界面进行截屏,得到所述响应界面截屏数据;发送所述响应界面截屏数据至所述控制终端。
具体实现中,受控终端204对受控终端的第一触控响应界面进行截屏,得到响应界面截屏数据,由响应界面截屏数据可以得到屏幕UI数据、屏幕尺寸、分辨率等。然后,受控终端204将响应界面截屏数据发送至控制终端202。由于上述方法的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法对受控终端的第一触控响应界面进行截屏,将响应界面截屏数据发送至控制终端,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
如图11所示,在一个实施例中,以应用于图6中的受控终端606为例进行说明,可以包括以下步骤:
S1102,与控制中心建立连接;所述控制中心与控制终端之间建立连接;
S1104,通过所述控制中心发送所述受控终端的第一交互界面至所述控制终端;
S1106,根据所述触控操作进行触控响应,得到所述第一触控响应界面;
S1108,通过所述控制中心发送所述第一触控响应界面至所述控制终端。
具体实现中,受控终端606预先与控制中心604建立连接,当控制终端602也与控制中心604建立连接时,受控终端606获取第一交互界面,并将第一交互界面通过控制中心604发送至控制终端602,用户在控制终端602进行触控操作,控制终端602对触控操作进行处理后发送至受控终端606,受控终端606根据触控操作进行触控响应,得到第一触控响应界面,然后将第一触控响应界面通过控制中心604发送至控制终端602。由于上述方法的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法通过在控制终端、控制中心和受控终端之间建立连接,将受控终端的第一交互界面通过控制中心发送至控制终端,由于在控制终端得到的第二交互界面可以全面展示第一交互界面的信息,受控终端根据触控操作进行触控响应,通过控制中心发送至控制终端的第一触控响应界面可以全面展示受控终端的触控响应结果。此种方法用控制终端与被控终端之间交互代替对控制终端直接进行操作,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终 端重量和体积较大、便携性较差的问题。进一步地,通过控制中心的转发,可以满足较远距离通信的需求。进一步地,可以最大化通信***的未来发展前景,降低由于现有终端品牌和运营商配置门槛引起的复杂问题。
在一个实施例中,上述步骤S1104,可以具体包括:对所述受控终端的第一交互界面进行截屏,得到所述交互界面截屏数据;通过所述控制中心发送所述交互界面截屏数据至所述控制终端。
具体实现中,受控终端606对受控终端的第一交互界面进行截屏,得到交互界面截屏数据,由交互界面截屏数据可以得到屏幕UI数据、屏幕尺寸、分辨率等。然后,通过控制中心604,受控终端606将交互界面截屏数据发送至控制终端602。由于上述方法的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法对受控终端的第一交互界面进行截屏,通过控制中心将交互界面截屏数据发送至控制终端,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
在一个实施例中,上述步骤S1108,可以具体包括:对所述第一触控响应界面进行截屏,得到所述响应界面截屏数据;通过所述控制中心发送所述响应界面截屏数据至所述控制终端。
具体实现中,受控终端606对受控终端的第一触控响应界面进行截屏,得到响应界面截屏数据,由响应界面截屏数据可以得到屏幕UI数据、屏幕尺寸、分辨率等。然后,通过控制中心604,受控终端606将响应界面截屏数据发送至控制终端602。由于上述方法的处理过程在前述实施例中已有详细说明,在此不再赘述。
上述方法对受控终端的第一触控响应界面进行截屏,通过控制中心将响应界面截屏数据发送至控制终端,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
如图12所示,在一个实施例中,提供了一种终端控制***1200,包括控制终端1210和受控终端1220。图13为终端控制***1200的终端控制流程的时序图。参考图13,终端控制流程可以包括以下步骤:
S1302,控制终端1210与受控终端1220建立连接;
S1304,受控终端1220将第一交互界面发送至控制终端1210;
S1306,控制终端1210显示与第一交互界面相匹配的第二交互界面;
S1308,控制终端1210接收用户针对第二交互界面进行的触控操作;
S1310,控制终端1210根据触控操作,控制受控终端1220进行触控响应;
S1312,受控终端1220将第一触控响应界面发送至控制终端1210;
S1314,控制终端1210显示与受控终端1220的第一触控响应界面相匹配的第二触控响应界面。
应该理解的是,虽然上述的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,上述的流程图中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些子步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。
如图14所示,在一个实施例中,提供了另一种终端控制***1400,包括控制终端1410、控制中心1420和受控终端1430。图15为另一种终端控制***1400的终端控制流程的时序图。参考图15,终端控制流程可以包括以下步骤:
S1502,控制中心1420与控制终端1410建立连接,并且,用于与受控终端1430建立连接;
S1504,受控终端1430将第一交互界面发送至控制中心1420;
S1506,控制中心1420将受控终端1430的第一交互界面转发至控制终端1410;
S1508,控制终端1410显示与第一交互界面相匹配的第二交互界面;
S1510,控制终端1410接收用户针对第二交互界面进行的触控操作;
S1512,控制终端1410将触控操作发送至控制中心1420;
S1514,控制中心1420根据触控操作,控制受控终端1430进行触控响应;
S1516,受控终端1430将第一触控响应界面发送至控制中心1420;
S1518,控制中心1420将受控终端1430的第一触控响应界面转发至控制终端1410;
S1520,控制终端1410显示与第一触控响应界面相匹配的第二触控响应界面。
应该理解的是,虽然上述的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,上述的流程图中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些子步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。
如图16所示,在一个实施例中,提供了一种终端,该终端为控制终端,包括:
无线通信接口1616,用于通过无线通信的方式与受控终端建立连接;
触控显示屏1602,用于显示第二交互界面;
触控显示屏1602,用于接收用户针对所述第二交互界面进行的触控操作;
处理器1606,用于根据所述触控操作,控制所述受控终端进行触控响应以显示第一触控响应界面;
触控显示屏1602,用于显示第二触控响应界面。
参考图16,无线通信接口1616可以为3G/4G/5G网络或Wi-Fi天线接口,触控显示屏1602可以为OLED(Organic Light-Emitting Diode,有机发光二极管)和玻璃(或蓝宝石)盖板,处理器1606在PCBA(Printed Circuit Board+Assembly,印刷电路板装配)上装配有高通APQ8053。此外,终端还包括有隔板1604,电池1608(容量1000mAh,1.0mm),USB接口1610(Type C),不锈钢中框1612和后盖板1614,后盖板1614可以为OLED和玻璃(或蓝宝石)盖板。由于未设计话筒和摄像头等部件,对话功能可以通过蓝牙耳麦来实现,摄影可以由腕表来实现。
终端厚度可以为4mm。对于网络手机、网络视屏终端、游戏终端和智能手表的各种延展(例如生物检测)等手板终端,可以采用5-6吋屏;对于家居管理板、读书板、游戏板、微信板、社交板和作业板等智能家居终端,可以采用7-14吋屏;对于教学板、课本板、考试板、会议板、航空板、高铁板和单向保密信息板等智能教学、会议、航空和高铁类终端,也可以采用7-14吋屏;对于办公桌板、投影显示板、点餐板、公交车站板、家用电器板、智能家具板、酒吧互动板、户外天然场景影视互动板和演唱会竞技运动聚焦板等智能表面终端,可以采用5-105吋屏。
上述终端可以确保触控和显示功能的良好实现,通过受控终端和/或控制中心来实现数据处理和存储等功能,在功能上将触控和显示与其他功能相剥离。由于不需要实现数据处理和存储等功能,相比于传统终端,上述终端可以以较轻的重量、较小的体积和较薄的厚度实现各种复杂的功能,解决了传统通信***中终端重量和体积较大、便携性较差的问题。
进一步地,由于使用开放式的通讯平台,可以不依托于任何一家手机品牌,也无需得到运营商许可,直接通过无线通信网络或云等开放平台来进行通信,避免了现有终端品牌和运营商配置门槛引起的复杂问题。
如图17所示,在一个实施例中,提供了一种终端控制装置,包括:
连接建立模块1702,用于与受控终端建立连接;
第一获取模块1704,用于获取所述受控终端的第一交互界面;
第一显示模块1706,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
接收模块1708,用于接收用户针对所述第二交互界面进行的触控操作;
控制模块1710,用于根据所述触控操作,控制所述受控终端进行触控响应;
第二获取模块1712,用于获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
第二显示模块1714,用于显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
上述终端控制装置,通过在控制终端与受控终端之间建立连接,由控制终端获取受控终端的第一交互界面,并根据第一交互界面显示第二交互界面,由于第二交互界面与第一交互界面相匹配,可以全面展示第一交互界面的信息,对第二交互界面进行触控操作,相当于对第一交互界面进行触控操作。受控终端根据触控操作进行触控响应后,在控制终端上显示与受控终端的触控响应相匹配的第二触控响应界面,可以全面展示受控终端的触控响应结果。此种方法用控制终端与被控终端之间交互代替对控制终端直接进行操作,避免了在控制终端执行复杂的数据处理过程,减少了控制终端的存储空间以及数据处理模块的重量和体积,解决了 传统通信***中终端重量和体积较大、便携性较差的问题。
如图18所示,在一个实施例中,提供了另一种终端控制装置,包括:
连接建立模块1802,用于与控制中心建立连接;所述控制中心与受控终端之间建立连接;
第一获取模块1804,用于通过所述控制中心获取所述受控终端的第一交互界面;
第一显示模块1806,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
接收模块1808,用于接收用户针对所述第二交互界面进行的触控操作;
控制模块1810,用于将所述触控操作发送至所述控制中心;所述控制中心用于根据所述触控操作,控制所述受控终端进行触控响应;
第二获取模块1812,用于通过所述控制中心获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
第二显示模块1814,用于显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
上述终端控制装置,在控制终端、控制中心和受控终端之间建立连接,通过控制中心的转发,控制终端获取受控终端的第一交互界面,并根据第一交互界面显示第二交互界面,由于第二交互界面与第一交互界面相匹配,可以全面展示第一交互界面的信息,对第二交互界面进行触控操作,相当于对第一交互界面进行触控操作。经由控制中心转发触控操作数据,受控终端根据触控操作进行触控响应后,在控制终端上显示与受控终端的触控响应相匹配的第二触控响应界面,可以全面展示受控终端的触控响应结果。该方法在控制终端与被控终端之间通过控制中心进行交互,代替了对控制终端直接进行操作,避免了在控制终端执行复杂的数据处理过程,解决了传统通信***中终端重量和体积较大、便携性较差的问题。进一步地,通过控制中心的转发,可以满足较远距离通信的需求。进一步地,可以最大化通信***的未来发展前景,降低由于现有终端品牌和运营商配置门槛引起的复杂问题。
在一个实施例中,提供了一种计算机设备,包括存储器和处理器,存储器存储有计算机程序,计算机程序被处理器执行时,使得处理器执行上述终端控制方法的步骤。此处终端控制方法的步骤可以是上述各个实施例的终端控制方法中的步骤。
在一个实施例中,提供了一种计算机可读存储介质,存储有计算机程序,计算机程序被处理器执行时,使得处理器执行上述终端控制方法的步骤。此处终端控制方法的步骤可以是上述各个实施例的终端控制方法中的步骤。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。
以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。

Claims (25)

  1. 一种终端控制方法,其特征在于,包括:
    与受控终端建立连接;
    获取所述受控终端的第一交互界面;
    显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
    接收用户针对所述第二交互界面进行的触控操作;
    根据所述触控操作,控制所述受控终端进行触控响应;
    获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
    显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
  2. 根据权利要求1所述的方法,其特征在于,所述根据所述触控操作,控制所述受控终端进行触控响应,包括:
    根据所述触控操作,得到触控操作数据;
    根据所述触控操作数据,得到受控终端触控操作数据;所述受控终端触控操作数据用于针对所述受控终端的第一交互界面进行触控操作;
    将所述受控终端触控操作数据发送至所述受控终端,供所述受控终端根据所述受控终端触控操作数据进行触控响应,得到所述受控终端的第一触控响应界面。
  3. 根据权利要求1所述的方法,其特征在于,所述与受控终端建立连接,包括:
    通过Wi-Fi、蓝牙或自定义无线协议与所述受控终端建立连接。
  4. 根据权利要求1所述的方法,其特征在于,所述与受控终端建立连接,还包括:
    获取身份代码;
    发送所述身份代码至所述受控终端,供所述受控终端在验证所述身份代码成功后建立连接。
  5. 根据权利要求1所述的方法,其特征在于,所述获取所述受控终端的第一交互界面,包括:
    获取交互界面截屏数据;所述交互界面截屏数据为对所述受控终端的第一交互界面进行截屏得到的数据;
    对所述交互界面截屏数据进行处理,得到处理后交互界面截屏数据;所述处理后交互界面截屏数据用于显示所述第二交互界面。
  6. 根据权利要求1所述的方法,其特征在于,所述获取所述受控终端的第一触控响应界面,包括:
    获取响应界面截屏数据;所述响应界面截屏数据为对所述受控终端的第一触控响应界面进行截屏得到的数据;
    对所述响应界面截屏数据进行处理,得到处理后响应界面截屏数据;所述处理后响应界面截屏数据用于显示所述第二触控响应界面。
  7. 一种终端控制方法,其特征在于,还包括:
    与控制中心建立连接;所述控制中心与受控终端之间建立连接;
    通过所述控制中心获取所述受控终端的第一交互界面;
    显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
    接收用户针对所述第二交互界面进行的触控操作;
    将所述触控操作发送至所述控制中心;所述控制中心用于根据所述触控操作,控制所述受控终端进行触控响应;
    通过所述控制中心获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
    显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
  8. 根据权利要求7所述的方法,其特征在于,所述与控制中心建立连接,包括:
    通过3G/4G/5G网络或Wi-Fi与所述控制中心建立连接。
  9. 根据权利要求7所述的方法,其特征在于,所述与控制中心建立连接,还包括:
    获取身份代码;
    发送所述身份代码至所述控制中心,所述身份代码经所述控制中心转发至所述受控终端,供所述受控终端在验证所述身份代码成功后建立连接。
  10. 根据权利要求7所述的方法,其特征在于,所述通过所述控制中心获取所述受控终端的第一交互界面,包括:
    接收受控终端操控请求;所述受控终端操控请求用于用户请求操控所述受控终端;
    根据所述受控终端操控请求,访问所述控制中心,得到所述受控终端的第一交互界面。
  11. 根据权利要求7所述的方法,其特征在于,所述通过所述控制中心获取所述受控终端的第一交互界面,还包括:
    通过所述控制中心获取交互界面截屏数据;所述交互界面截屏数据为对所述受控终端的第一交互界面进行截屏得到的数据;
    对所述交互界面截屏数据进行处理,得到处理后交互界面截屏数据;所述通过所述控制中心后交互界面截屏数据用于显示所述第二交互界面。
  12. 根据权利要求7所述的方法,其特征在于,所述通过所述控制中心获取所述受控终端的第一触控响应界面,包括:
    通过所述控制中心获取响应界面截屏数据;所述响应界面截屏数据为对所述受控终端的第一触控响应界面进行截屏得到的数据;
    对所述响应界面截屏数据进行处理,得到处理后响应界面截屏数据;所述处理后响应界面截屏数据用于显示所述第二触控响应界面。
  13. 一种终端控制方法,其特征在于,还包括:
    与控制终端建立连接;
    将所述受控终端的第一交互界面发送至所述控制终端;
    根据所述触控操作进行触控响应,得到所述第一触控响应界面;
    将所述第一触控响应界面发送至所述控制终端。
  14. 根据权利要求13所述的方法,其特征在于,所述将所述受控终端的第一交互界面发送至所述控制终端,包括:
    对所述受控终端的第一交互界面进行截屏,得到所述交互界面截屏数据;
    发送所述交互界面截屏数据至所述控制终端。
  15. 根据权利要求13所述的方法,其特征在于,所述将所述第一触控响应界面发送至所述控制终端,包括:
    对所述第一触控响应界面进行截屏,得到所述响应界面截屏数据;
    发送所述响应界面截屏数据至所述控制终端。
  16. 一种终端控制方法,其特征在于,还包括:
    与控制中心建立连接;所述控制中心与控制终端之间建立连接;
    通过所述控制中心发送所述受控终端的第一交互界面至所述控制终端;
    根据所述触控操作进行触控响应,得到所述第一触控响应界面;
    通过所述控制中心发送所述第一触控响应界面至所述控制终端。
  17. 根据权利要求16所述的方法,其特征在于,所述通过所述控制中心发送所述受控终端的第一交互界面至所述控制终端,包括:
    对所述受控终端的第一交互界面进行截屏,得到所述交互界面截屏数据;
    通过所述控制中心发送所述交互界面截屏数据至所述控制终端。
  18. 根据权利要求16所述的方法,其特征在于,所述通过所述控制中心发送所述第一触控响应界面至所述控制终端,包括:
    对所述第一触控响应界面进行截屏,得到所述响应界面截屏数据;
    通过所述控制中心发送所述响应界面截屏数据至所述控制终端。
  19. 一种终端控制***,其特征在于,包括:控制终端和受控终端;所述受控终端显示有第一交互界面;
    所述控制终端,用于与所述受控终端建立连接;
    所述受控终端,用于将所述第一交互界面发送至所述控制终端;
    所述控制终端,用于显示与所述第一交互界面相匹配的第二交互界面;
    所述控制终端,用于接收用户针对所述第二交互界面进行的触控操作;
    所述控制终端,用于根据所述触控操作,控制所述受控终端进行触控响应;
    所述受控终端,用于将所述第一触控响应界面发送至所述控制终端;
    所述控制终端,用于显示与所述受控终端的第一触控响应界面相匹配的第二触控响应界面。
  20. 一种终端控制***,其特征在于,包括:控制终端、控制中心和受控终端;
    所述控制中心,用于与所述控制终端建立连接,并且,用于与所述受控终端建立连接;
    所述受控终端,用于将所述第一交互界面发送至所述控制中心;
    所述控制中心,用于将所述受控终端的所述第一交互界面转发至所述控制终端;
    所述控制终端,用于显示与所述第一交互界面相匹配的第二交互界面;
    所述控制终端,用于接收用户针对所述第二交互界面进行的触控操作;
    所述控制终端,用于将所述触控操作发送至所述控制中心;
    所述控制中心,用于根据所述触控操作,控制所述受控终端进行触控响应;
    所述受控终端,用于将所述第一触控响应界面发送至所述控制中心;
    所述控制中心,用于将所述受控终端的所述第一触控响应界面转发至所述控制终端;
    所述控制终端,用于显示与所述第一触控响应界面相匹配的第二触控响应界面。
  21. 一种终端,其特征在于,包括:无线通信接口、触控显示屏和处理器;
    所述无线通信接口,用于通过无线通信的方式与受控终端建立连接;
    所述触控显示屏,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
    所述触控显示屏,用于接收用户针对所述第二交互界面进行的触控操作;
    所述处理器,用于根据所述触控操作,控制所述受控终端进行触控响应以显示第一触控响应界面;
    所述触控显示屏,用于显示第二触控响应界面;所述第二触控响应界面与所述第一触控响应界面相匹配。
  22. 一种终端控制装置,其特征在于,所述装置包括:
    连接建立模块,用于与受控终端建立连接;
    第一获取模块,用于获取所述受控终端的第一交互界面;
    第一显示模块,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
    接收模块,用于接收用户针对所述第二交互界面进行的触控操作;
    控制模块,用于根据所述触控操作,控制所述受控终端进行触控响应;
    第二获取模块,用于获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
    第二显示模块,用于显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
  23. 一种终端控制装置,其特征在于,所述装置包括:
    连接建立模块,用于与控制中心建立连接;所述控制中心与受控终端之间建立连接;
    第一获取模块,用于通过所述控制中心获取所述受控终端的第一交互界面;
    第一显示模块,用于显示第二交互界面;所述第二交互界面与所述受控终端的第一交互界面相匹配;
    接收模块,用于接收用户针对所述第二交互界面进行的触控操作;
    控制模块,用于将所述触控操作发送至所述控制中心;所述控制中心用于根据所述触控操作,控制所述受控终端进行触控响应;
    第二获取模块,用于通过所述控制中心获取所述受控终端的第一触控响应界面;所述第一触控响应界面为所述受控终端进行触控响应后所显示的界面;
    第二显示模块,用于显示第二触控响应界面;所述第二触控响应界面与所述受控终端的第一触控响应界面相匹配。
  24. 一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至18中任一项所述方法的步骤。
  25. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至18中任一项所述的方法的步骤。
PCT/CN2019/128460 2019-10-16 2019-12-25 终端控制方法、***、装置、计算机设备和存储介质 WO2021072974A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/769,521 US20240152266A1 (en) 2019-10-16 2019-12-25 Terminal control method, system and apparatus, computer device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910984145.2 2019-10-16
CN201910984145.2A CN110851049A (zh) 2019-10-16 2019-10-16 终端控制方法、***、装置、计算机设备和存储介质

Publications (1)

Publication Number Publication Date
WO2021072974A1 true WO2021072974A1 (zh) 2021-04-22

Family

ID=69596403

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/128460 WO2021072974A1 (zh) 2019-10-16 2019-12-25 终端控制方法、***、装置、计算机设备和存储介质

Country Status (3)

Country Link
US (1) US20240152266A1 (zh)
CN (1) CN110851049A (zh)
WO (1) WO2021072974A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120030570A1 (en) * 2010-07-30 2012-02-02 Migos Charles J Device, Method, and Graphical User Interface for Copying Formatting Attributes
US20130212629A1 (en) * 2012-02-15 2013-08-15 Li Tv Taiwan Inc. Television system operated with remote touch control
CN106161735A (zh) * 2015-03-26 2016-11-23 联想(北京)有限公司 一种信息处理方法及电子设备
CN106293037A (zh) * 2015-06-12 2017-01-04 联想(北京)有限公司 一种交互方法及电子设备
CN106610784A (zh) * 2016-10-18 2017-05-03 广州视源电子科技股份有限公司 多***触控屏的控制方法和***
CN109946990A (zh) * 2019-04-19 2019-06-28 北京远鼎科技有限公司 一种交互方法、交互终端及智能家居***

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106572139B (zh) * 2015-10-13 2020-08-11 阿里巴巴集团控股有限公司 多终端控制方法、终端、服务器和***
CN106227433A (zh) * 2016-07-08 2016-12-14 深圳埃蒙克斯科技有限公司 一种基于移动终端控制pc的方法、移动终端
CN107341015B (zh) * 2017-06-30 2021-02-09 百度在线网络技术(北京)有限公司 终端间数据同步方法、装置、终端及存储介质
CN110069207B (zh) * 2019-04-24 2024-03-19 努比亚技术有限公司 触控操作响应方法、装置、移动终端及可读存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120030570A1 (en) * 2010-07-30 2012-02-02 Migos Charles J Device, Method, and Graphical User Interface for Copying Formatting Attributes
US20130212629A1 (en) * 2012-02-15 2013-08-15 Li Tv Taiwan Inc. Television system operated with remote touch control
CN106161735A (zh) * 2015-03-26 2016-11-23 联想(北京)有限公司 一种信息处理方法及电子设备
CN106293037A (zh) * 2015-06-12 2017-01-04 联想(北京)有限公司 一种交互方法及电子设备
CN106610784A (zh) * 2016-10-18 2017-05-03 广州视源电子科技股份有限公司 多***触控屏的控制方法和***
CN109946990A (zh) * 2019-04-19 2019-06-28 北京远鼎科技有限公司 一种交互方法、交互终端及智能家居***

Also Published As

Publication number Publication date
CN110851049A (zh) 2020-02-28
US20240152266A1 (en) 2024-05-09

Similar Documents

Publication Publication Date Title
CN111309226B (zh) 基于通信质量的终端控制方法、装置、终端和计算机设备
CN111290695B (zh) 基于优先级控制的终端控制方法、装置和终端
US20240053879A1 (en) Object Drag Method and Device
US9485465B2 (en) Picture control method, terminal, and video conferencing apparatus
US20130262687A1 (en) Connecting a mobile device as a remote control
CN111314441B (zh) 基于多区域控制的终端控制方法、装置和终端
US20110066971A1 (en) Method and apparatus for providing application interface portions on peripheral computing devices
CN111273850B (zh) 终端控制方法、装置、计算机设备和存储介质
CN111324248A (zh) 终端控制方法、装置、终端、计算机设备和存储介质
US11054987B1 (en) Sidebar interaction method, device, and computer-readable storage medium
KR20150018770A (ko) 스크린 공유 방법, 관련 장치, 및 통신 시스템
CN104238986A (zh) 传屏显示方法和装置
KR20140027835A (ko) 휴대 단말기 및 메신저 영상 서비스 운용 방법
US9083849B2 (en) Transmission terminal, transmission system, and non-transitory computer readable storage medium
US11947998B2 (en) Display method and device
US20230138804A1 (en) Enhanced video call method and system, and electronic device
US20230333803A1 (en) Enhanced Screen Sharing Method and System, and Electronic Device
JP2018525744A (ja) アプリケーション及びデータをタッチスクリーンコンピュータ間で相互共有する方法並びにこの方法を実施するコンピュータプログラム
WO2021104162A1 (zh) 显示方法及电子设备
CN111314442B (zh) 基于分时控制的终端控制方法、装置、终端和计算机设备
WO2021072974A1 (zh) 终端控制方法、***、装置、计算机设备和存储介质
CN115623255A (zh) 一种显示设备、终端设备及镜像投屏反控方法
CN111263004B (zh) 终端控制方法、装置、计算机设备和存储介质
WO2017107543A1 (zh) 信息输入方法及装置
CN109981571B (zh) 视联网接入方法、装置、电子设备及计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19949137

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19949137

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 17769521

Country of ref document: US