CN111314442A - Terminal control method and device based on time-sharing control, terminal and computer equipment - Google Patents

Terminal control method and device based on time-sharing control, terminal and computer equipment Download PDF

Info

Publication number
CN111314442A
CN111314442A CN202010070600.0A CN202010070600A CN111314442A CN 111314442 A CN111314442 A CN 111314442A CN 202010070600 A CN202010070600 A CN 202010070600A CN 111314442 A CN111314442 A CN 111314442A
Authority
CN
China
Prior art keywords
terminal
control
interface
touch
touch operation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010070600.0A
Other languages
Chinese (zh)
Other versions
CN111314442B (en
Inventor
赵宁
许仁
周枫
王伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
VDL Industry Shenzhen Co Ltd
Original Assignee
VDL Industry Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by VDL Industry Shenzhen Co Ltd filed Critical VDL Industry Shenzhen Co Ltd
Priority to CN202010070600.0A priority Critical patent/CN111314442B/en
Publication of CN111314442A publication Critical patent/CN111314442A/en
Application granted granted Critical
Publication of CN111314442B publication Critical patent/CN111314442B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q9/00Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application relates to a terminal control method, a terminal control device, a terminal, computer equipment and a storage medium based on time-sharing control, wherein the method comprises the following steps: the method comprises the steps of obtaining an interactive interface of a controlled terminal, displaying the interactive interface, wherein the interactive interface is an interface which is currently controlled by at least two control terminals, responding to touch operation of a user on the interactive interface to obtain touch operation data, the touch operation data comprises touch operation time, sending the touch operation data to the controlled terminal, obtaining a touch response interface of the controlled terminal, and displaying the touch response interface, wherein the touch response interface is generated by the controlled terminal sequentially responding to each touch operation data according to the touch operation time. The application also provides a terminal control method and device based on time-sharing control, computer equipment and a storage medium. According to the scheme, a user does not need to carry the controlled terminal, and the operation is carried out on the interactive interface of the control terminal, so that the remote control of the controlled terminal is realized, the convenience is improved, and the occurrence of operation conflict can be reduced.

Description

Terminal control method and device based on time-sharing control, terminal and computer equipment
Technical Field
The present application relates to the field of communications technologies, and in particular, to a terminal control method and apparatus based on time-sharing control, a terminal, a computer device, and a storage medium.
Background
With the rapid development of internet technology, the remote control of the terminal is more and more popular. The current popular smart home is embodied in an internet of things under the influence of the internet. The intelligent home realizes remote control, namely the control terminal sends the operation information to the Internet of things intelligent gateway, and then the Internet of things intelligent gateway operates the Internet of things intelligent terminal to realize remote control.
At present, portability of communication terminals such as smart phones has been a necessary trend. But currently there are few remote control techniques for communication terminals. If a user needs to operate the smart phone when going out, the user still needs to carry the host body of the smart phone, and if more communication terminals need to be operated, the user is more inconvenient.
Therefore, the development of the communication terminal device still faces the problem of low convenience due to inconvenient carrying.
Disclosure of Invention
In view of the above, it is desirable to provide a terminal control method, apparatus, terminal, computer device, and storage medium based on time-sharing control that can improve convenience.
A terminal control method based on time-sharing control comprises the following steps:
acquiring an interactive interface of a controlled terminal, and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
responding to touch operation of a user on the interactive interface to obtain touch operation data, wherein the touch operation data comprises touch operation time;
sending the touch operation data to a controlled terminal;
and acquiring a touch response interface of the controlled terminal, and displaying the touch response interface, wherein the touch response interface is generated by the controlled terminal sequentially responding to each touch operation data according to the touch operation time.
In one embodiment, acquiring an interactive interface of a controlled terminal, and displaying the interactive interface includes:
and acquiring a plurality of interactive interfaces of the controlled terminal, and displaying the interactive interfaces in a split screen mode, wherein the interactive interfaces are the interfaces of the controlled terminal which are independently controlled by the control terminals at present.
In one embodiment, before obtaining the interactive interface of the controlled terminal, the method further includes:
sending an operation request to a controlled terminal, wherein the operation request carries identity authentication information;
and receiving the connection permission message fed back by the controlled terminal according to the identity authentication information, and establishing connection with the controlled terminal.
In one embodiment, acquiring the interactive interface of the controlled terminal comprises:
acquiring program operation window data of a controlled terminal;
processing the program operation window data to obtain interactive interface configuration data;
and configuring the corresponding interactive interface according to the interactive interface configuration data.
In one embodiment, acquiring a touch response interface of a controlled terminal includes:
acquiring touch response window data displayed after the controlled terminal responds to the touch operation data;
processing the touch response window data to obtain touch response interface configuration data;
and configuring the touch response interface according to the touch response interface configuration data.
In one embodiment, the displayed interactive interface and the displayed touch response interface are matched with the screen size of the control terminal.
In one embodiment, further comprising:
the control center is connected with the controlled terminal and used for forwarding the data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
A terminal control device based on time-sharing control comprises:
the first interface display module is used for acquiring the interactive interface of the controlled terminal and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
the touch operation response module is used for responding to the touch operation of the user on the interactive interface to obtain touch operation data, and the touch operation data comprises touch operation time;
the touch operation data sending module is used for sending the touch operation data to the controlled terminal;
and the second interface display module is used for acquiring a touch response interface of the controlled terminal and displaying the touch response interface, and the touch response interface is generated by the controlled terminal sequentially responding to each touch operation data according to the touch operation time.
A terminal, comprising: the touch display device comprises a communication module, a touch display module and a processor;
the communication module is connected with the controlled terminal, the processor acquires an interactive interface of the controlled terminal and sends the interactive interface to the touch display module, the touch display module receives and displays the interactive interface, the touch operation of a user on the interactive interface is responded, touch operation data are obtained and sent to the processor, the touch operation data comprise touch operation time, the processor acquires and sends the touch operation data to the controlled terminal, a touch response interface of the controlled terminal is acquired and sent to the touch display module, and the touch display module receives and displays the touch response interface, wherein the touch response interface is generated by the controlled terminal sequentially responding to the touch operation data according to the touch operation time.
A computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the terminal control method based on time-sharing control when executing the computer program.
A computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps in the above-described time-sharing control-based terminal control method.
According to the terminal control method, the terminal control device, the terminal, the computer equipment and the storage medium based on time-sharing control, connection between a plurality of control terminals and one controlled terminal is established, the control terminals acquire an interactive interface of the controlled terminal and display the interactive interface, touch operation data carrying touch operation time is sent to the controlled terminal by responding to touch operation of a user on the interactive interface, and a touch response interface generated after the controlled terminal sequentially performs touch response according to the touch operation time is acquired. According to the scheme, the controlled terminal does not need to be carried, so that a user can operate the interactive interfaces of the control terminals, the many-to-one remote control of the controlled terminal can be realized, and the convenience is improved.
A terminal control method based on time-sharing control comprises the following steps:
acquiring a control request of a control terminal, wherein the control request carries identity authentication information of the control terminal;
when the identity authentication of the control terminal is completed according to the identity authentication information, sending an interactive interface to the control terminal, wherein the interactive interface is an interface currently controlled by at least two control terminals;
receiving touch operation data of a user aiming at each interactive interface, which is sent by each control terminal, wherein the touch operation data comprises touch operation time;
and sequentially responding each touch operation data according to the touch operation time, and generating and sending a corresponding touch response interface to each control terminal.
In one embodiment, after sending the corresponding touch response interface to each control terminal, the method further includes:
and sending operator information to each control terminal, wherein the operator information comprises a data sender for generating touch operation data of the corresponding touch response interface.
In one embodiment, the receiving touch operation data of the user for each interactive interface sent by each control terminal includes:
and when touch operation data of a user aiming at the interactive interface, which are sent by any control terminal, are received, the unique operation authority of the control terminal on the interactive interface in the current time period is locked.
A terminal control device based on time-sharing control comprises:
the control request acquisition module is used for acquiring a control request of the control terminal, and the control request carries identity authentication information of the control terminal;
the data sending module is used for establishing connection with each control terminal and sending an interactive interface to the control terminals when the identity authentication of the control terminals is completed according to the identity authentication information, wherein the interactive interface is an interface currently controlled by at least two control terminals;
the data receiving module is used for receiving touch operation data, which are sent by each control terminal and aim at each interactive interface, of a user, wherein the touch operation data comprise touch operation time;
and the data response module is used for sequentially responding each touch operation data according to the touch operation time, and generating and sending a corresponding touch response interface to each control terminal.
A computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the terminal control method based on time-sharing control when executing the computer program.
A computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps in the above-described time-sharing control-based terminal control method.
In the terminal control method, the terminal control device, the computer equipment and the storage medium based on time-sharing control, when the identity authentication of the control terminal is completed according to the identity authentication information, an interactive interface is sent to the control terminal, touch operation data carrying touch operation time sent by each control terminal is received, each touch response operation data is sequentially responded according to the touch operation time, and each control terminal of the corresponding touch response interface is generated and sent. According to the scheme, the controlled terminal responds according to the touch operation time, the occurrence of operation conflict is reduced, a user does not need to carry the controlled terminal, the operation is carried out on the interactive interfaces of the control terminals, the many-to-one remote control of the controlled terminal is realized, and the convenience is improved.
Drawings
Fig. 1 is an application environment diagram of a terminal control method based on time-sharing control in an embodiment;
fig. 2 is a schematic flowchart of a terminal control method based on time-sharing control in an embodiment;
FIG. 3 is a diagram illustrating an application scenario in which a plurality of control terminals control a controlled terminal according to an embodiment;
fig. 4 is a schematic flowchart of a terminal control method based on time-sharing control in another embodiment;
fig. 5 is an application environment diagram of a terminal control method based on time-sharing control in another embodiment;
FIG. 6 is a diagram illustrating the software architecture of a terminal control method based on time-sharing control according to an embodiment;
fig. 7 is a flowchart illustrating a terminal control method based on time-sharing control in another embodiment;
fig. 8 is a block diagram of a terminal in one embodiment;
fig. 9 is a detailed configuration block diagram of a terminal in another embodiment;
FIG. 10 is a block diagram showing a configuration of a terminal control apparatus based on time-sharing control according to an embodiment;
fig. 11 is a block diagram showing a configuration of a terminal control apparatus based on time-sharing control in another embodiment;
fig. 12 is a block diagram showing a configuration of a terminal control apparatus based on time-sharing control in another embodiment;
FIG. 13 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The terminal control method based on time-sharing control can be applied to the application environment shown in fig. 1. In the application environment, a control terminal 202 and a controlled terminal 204 are included. The control terminal 202 has touch and display functions. The touch control function is that a user controls an operation interface by touching or writing with a writing pen on a touch screen, the display function comprises a display operation interface and a touch control response interface, and the touch control response interface is an interface for displaying corresponding touch control response after touch control operation. The number of the control terminals 202 is multiple, the controlled terminal 204 is a terminal controlled by the multiple control terminals 202, the controlled terminal 204 performs wireless communication with the control terminals 202, the controlled terminal 204 transmits an operation interface to the control terminals 202 through a wireless link, and makes a touch response to the touch operation of the control terminals 202, and transmits the touch response interface to the control terminals 202 through the wireless link. The control terminal 202 and the controlled terminal 204 may be, but are not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.
In one embodiment, as shown in fig. 2, a terminal control method based on time-sharing control is provided, which is described by taking the method as an example applied to the control terminal 202 in fig. 1, and includes the following steps:
and S200, acquiring the interactive interface of the controlled terminal, and displaying the interactive interface, wherein the interactive interface is the interface currently controlled by at least two control terminals.
In practical applications, the number of the control terminals 202 is at least two, and a remote control system or a remote operation application program is preset in both the control terminals 202 and the controlled terminals 204, and the control of the controlled terminals can be realized through the operation system/application program. The control terminal 202 and the controlled terminal 204 may establish a connection through a Wireless communication mode such as 3G, 4G, 2.4G, 5G, Wi-Fi (Wireless Fidelity) communication or bluetooth communication.
The interactive interface may be an operation interface displayed on the controlled terminal 204 and shared by at least two control terminals 202, or may be a background interface that the controlled terminal 204 enters a "security mode" similar to a computer by running a corresponding remote operation process after authorizing remote operation of each control terminal 202, or may be an operation interface of an application program running in the background of the controlled terminal 204 being controlled by each control terminal 202, for example, an operation window interface of a WeChat application program running in the background of the controlled terminal 204 is controlled by the control terminal A, and an operation window interface of a QQ application program running in the background of the controlled terminal 204 is controlled by the control terminal B. Further, the background interface is not displayed on the current interface of the controlled terminal 204, so that the user of the controlled terminal 204 can perform autonomous operation unaffected while the controlled terminal 204 is remotely controlled by the controlled terminal 202. Further, the interactive interface can also be an interface which is generated by control and comprises the information of each control terminal for controlling the controlled terminal. In specific implementation, an operation Interface image of the controlled terminal 204 may be captured and used as an interactive Interface, or data such as User Interface (UI) data, screen size, resolution and the like of the screen of the controlled terminal 204 may be captured and the interactive Interface may be obtained according to the data. For example, the controlled terminal 204 may perform a screen capture operation on the entire operation interface thereof, and take the screen capture result as an interactive interface. Or reading the operation interface parameters of the controlled terminal 204 to obtain 2048 × 1536 pixels of resolution, when the upper left corner of the operation interface is the origin of coordinates, the software icon (e.g., WeChat icon) is located at the pixel of coordinates (1600,600), and according to the resolution, the type of the icon, and the position of the icon, the interactive interface can be obtained. After the interactive interface of the controlled terminal 204 is obtained, the interactive interface may be directly displayed, or the interactive interface may be subjected to certain processing such as scaling, capturing, filling, and the like or rendering processing according to the screen resolution and the screen size to obtain an interactive interface matched with the screen size data of the control terminal 202, and then the interactive interface matched with the screen size data of the control terminal 202 is displayed. Further, the user may resize each displayed interactive interface.
And S400, responding to the touch operation of the user on the interactive interface to obtain touch operation data.
The touch operation is an operation of controlling an operation interface by a user through touching or writing with a writing pen on an interactive interface of the control terminal 202. In specific implementation, a user may click a software icon on an interactive interface of the control terminal 202 through a finger or a stylus to open the software, click each control in the software after the software is opened, or perform a touch operation by writing in an operation interface after the software is opened, where the touch operation may include clicking, long-pressing, sliding, zooming, multi-point touch, and other operations. For example, a WeChat icon is arranged at the position with the coordinate of (1600,600) pixel in the interactive interface of the control terminal 202, and a user can click on the WeChat icon and click on each control in the running WeChat or input characters in a WeChat dialog box. After the touch operation is executed, the control terminal 202 receives the touch operation, and records the touch operation time, the touch point coordinates, the touch duration, the touch pressure information, and the like of the user to obtain touch operation data. For example, if the smart tablet is the control terminal 202, the tablet is the controlled terminal 204. The first interactive interface resolution of the tablet computer is 2048 × 1536 pixels, the second interactive interface resolution of the smart hand board 302 is 1024 × 768 pixels, when a user needs to start the WeChat, the WeChat icon is clicked at the second interactive interface coordinate (500,200), touch operation data are converted into click operation at the first interactive interface coordinate (1000,400) according to the proportion of the first interactive interface to the second interactive interface, then the touch operation data are sent to the tablet computer through a network, and the tablet computer performs touch response at the first interactive interface (1000,400).
Step S600, sending the touch operation data to the controlled terminal.
After obtaining the touch operation data carrying the touch operation time, each control terminal 202 may send the touch operation data to the controlled terminal 204 in real time, so that the controlled terminal 204 performs time-sharing control according to the touch operation time and sequentially responds to the touch operation data.
And step S800, acquiring a touch response interface of the controlled terminal, and displaying the touch response interface, wherein the touch response interface is generated by the controlled terminal sequentially responding to each touch operation data according to the touch operation time.
The touch response interface may be an interface generated by the controlled terminal 204 in real time after sequentially performing touch response on the touch operation data according to the touch operation time. In another embodiment, the touch response interface of the controlled terminal 204 may be a final touch response interface obtained after all touch operation data are responded, or may be a plurality of touch response interfaces obtained by responding touch operation data each time and sent in real time. In a specific implementation, the touch response interface may be obtained by capturing a touch response interface image of the controlled terminal 204, and using the touch response interface image as the first touch response interface, or by reading information such as resolution, color, and text of the touch response interface of the controlled terminal 204, and obtaining the first touch response interface according to the information. For example, for the controlled terminal 204, a screen capture operation may be performed on the entire touch response interface thereof, and the screen capture result is taken as the first touch response interface. Or, the touch response interface information of the controlled terminal 204, including the resolution of 2048 × 1536 pixels, the text content and the position displayed by the touch response, the color and the position of the image displayed by the touch response, and the like, is read, and the first touch response interface is obtained according to the touch response interface information. After the first touch response interface is obtained, the first touch response interface may be scaled in an equal proportion according to the resolution of the interface of the control terminal 202 to obtain a second touch response interface. For example, when the resolutions of the interface of the control terminal 202 and the first touch response interface are not in equal proportion, the first touch response interface may be scaled in equal proportion, then operations such as interception or filling are performed according to the scaling result to obtain a second touch response interface, and then the second touch response interface is displayed; if the resolutions are in equal proportion, the first touch response interface can be directly zoomed into an interface matched with the size of the screen to obtain a second touch response interface, and then the second touch response interface is displayed in the corresponding split screen area. Referring to fig. 3, a user may adjust the size of each touch response interface. If the user wants to continue the operation of the controlled terminal 204, the touch operation can be performed on the touch response interface again, then the touch operation data is sent to the controlled terminal 204 again through the control terminal 202, and the touch response interface sent by the controlled terminal 204 is received again (different from the previous touch response interface), which is similar to the way in which the user normally performs the touch operation on a mobile terminal such as a mobile phone to perform the operation.
The following description is made with reference to an example, where the control terminal displays a touch response interface, and it is assumed that the smart tablet is the control terminal and the tablet computer is the controlled terminal. After receiving the wechat start operation, the tablet computer performs touch response to obtain a wechat start interface, namely a first touch response interface of the controlled terminal. And sending the first touch response interface to the intelligent hand board through the network. The resolution of the first touch response interface is 2048 × 1536 pixels, and if the resolution of the interface of the smart hand board is 1024 × 768 pixels, the first touch response interface can be reduced to 50% of the original interface in equal proportion to obtain a second touch response interface; if the resolution of the smart hand panel interface is 700 × 384 pixels, the first touch response interface may be scaled down to 50% of the original first touch response interface, the first touch response interface is displayed in the center of the smart hand panel interface, and then black is filled in the non-displayed portion, so as to obtain the second touch response interface. And then, the intelligent hand board displays the second touch response interface. If the user wants to continue the operation of the controlled terminal, the touch operation can be performed on the touch response interface again, then the touch operation data is sent to the controlled terminal 204 again through the control terminal 202, and the touch response interface sent by the controlled terminal 204 is received again (different from the previous touch response interface), which is similar to the operation mode of the user performing the touch operation on a mobile terminal such as a mobile phone normally.
In the terminal control method based on time-sharing control, connection between a plurality of control terminals and one controlled terminal is established, the control terminals acquire an interactive interface of the controlled terminal and display the interactive interface, touch operation data carrying touch operation time is sent to the controlled terminal by responding to touch operation of a user on the interactive interface, and a touch response interface after the controlled terminal sequentially responds to touch response according to the touch operation time is acquired. According to the scheme, the controlled terminal does not need to be carried, direct operation on the control terminal is replaced by interaction between the control terminal and the controlled terminal, so that a user can operate on the interaction interfaces of the control terminals, many-to-one remote control on the controlled terminal is realized, convenience is improved, and the occurrence of the phenomenon of operation conflict can be reduced.
In an embodiment, as shown in fig. 4, before acquiring the interactive interface of the controlled terminal, the method further includes: step S100, sending a control request to the controlled terminal, wherein the control request carries identity authentication information, receiving a connection permission message fed back by the controlled terminal according to the identity authentication information, and establishing connection with the controlled terminal.
In specific implementation, the process of establishing the connection between the control terminal 202 and the controlled terminal 204 may be: the control terminal 202 can select a specific controlled terminal that needs to be connected, for example, a smart device such as a mobile phone, a computer, and a smart band. The intelligent device may be an intelligent device in a history that the control terminal 202 has been connected or remotely controlled before, or may be a new terminal device.
In practical application, the control terminal 202 may be powered on to enter a display interface, a user opens a history connection device record, and selects a specific controlled terminal to be connected to connect, or searches a currently connectable controlled terminal, and then selects a specific controlled terminal to be connected to connect through touch operation, at this time, the control terminal 202 responds to the touch operation of the user, and sends an operation request carrying identity authentication information thereof to the controlled terminal 204, the controlled terminal 204 receives the request, reads the identity authentication information in the request, and performs identity authentication or pairing authentication based on the identity authentication information, and if the authentication is passed, sends a connection permission message to the control terminal 202 to establish connection with the control terminal 202. Specifically, the verification method includes, but is not limited to, character string password verification, fingerprint verification, face verification, iris verification, or the like. After receiving the correct authentication information, the controlled terminal 204 may automatically send the interactive interface to the control terminal 202 without the user clicking to confirm.
Further, the controlled terminal 204 may also set the control authority of the control terminal 202, and for some operations related to privacy sensitivity or importance, the control terminal 202 needs to be authenticated again, or different access authorities are needed to be accessible. Specifically, the connection with the controlled terminal can be established through 3G, 4G, 5G, 2.4G, Wi-Fi, Bluetooth or a custom wireless protocol. In a specific implementation, the communication distance between the control terminal 202 and the controlled terminal 204 is within a Wi-Fi or bluetooth communication range, and the two realize data transmission through Wi-Fi, bluetooth or a custom wireless protocol. Due to the fact that a general platform such as Wi-Fi or Bluetooth is used or a user-defined wireless protocol is used, a completely open operating environment can be kept, any controlled terminal is allowed to develop application software at any time, and increasingly complex and diversified functional requirements of communication products can be met. In this embodiment, the connection is allowed to be established only after the controlled terminal is authenticated, so that the standardization and the security of the remote operation can be ensured.
In one embodiment, as shown in fig. 4, acquiring an interactive interface of a controlled terminal, and displaying the interactive interface includes: step S220, acquiring a plurality of interactive interfaces of the controlled terminal, and displaying the interactive interfaces in a split screen mode, wherein the interactive interfaces are the interfaces of the controlled terminal which are independently controlled by the control terminals currently.
The split-screen display processing means that a split-screen technology is adopted to divide a screen of the control terminal into a plurality of split-screen areas, and then the acquired interactive interface of the controlled terminal is displayed in the corresponding split-screen area, so that the control interface of each control terminal can be comprehensively viewed through the screen of the control terminal. In this embodiment, the control terminal currently used by the user may be a control terminal with a higher operation authority, and the control terminal can view or operate the control interfaces of other control terminals. Further, the control terminal with higher operation authority may also select one or more interactive interfaces sent by the controlled terminal 202 to perform a sharing operation or an interactive interface for viewing. In addition, the control interfaces of the control terminal 202 to the controlled terminal 204 except the terminal itself are all interfaces that are controlled independently, for example, the control terminal a controls the running window interface (interactive interface a) of the WeChat application running in the background of the controlled terminal 204, and the control terminal B controls the running window interface (interactive interface B) of the QQ application running in the background of the controlled terminal 204.
In specific implementation, the split-screen display processing may be to obtain a screenshot of a plurality of operation interfaces that the controlled terminal 204 is being independently controlled by the other control terminals 202, use the screenshot as an interactive interface (regarded as a first interactive interface), then obtain data such as screen UI data, screen size, resolution, and the like of the interactive interface captured by the controlled terminal, perform scaling or rendering on the interactive interface in an equal proportion based on the data and the screen resolution thereof to obtain a second interactive interface, and then display the second interactive interface in a corresponding split-screen area. Specifically, fig. 3 is a schematic diagram of the split-screen display. More specifically, when the resolution of the control terminal 202 is not equal to the resolution of the first interactive interface, the first interactive interface may be scaled in an equal proportion, and then operations such as interception or filling are performed according to the scaling result to obtain a second interactive interface, so as to display the second interactive interface; if the resolution ratio is in equal proportion, the first interactive interface can be directly zoomed into an interface matched with the size of the split screen area to obtain a second interactive interface; if the resolutions are just matched, the first interactive interface can be directly used as a second interactive interface, and then the second interactive interface is displayed in the corresponding split screen area. For example, the resolution of the first interactive interface is 2048 × 1536 pixels, and if the resolution of the control terminal 202 is 1024 × 768 pixels, the first interactive interface can be scaled down to 50% of the original value to obtain a second interactive interface; if the interface resolution of the control terminal 202 is 1024 × 800 pixels, the first interactive interface may be reduced to 50% of the original interface in equal proportion, and then displayed in the center of the interface of the control terminal 202, and then black is filled in the blank portion, so as to obtain the second interactive interface. Further, in order to facilitate the user to visually check which controlled terminal corresponds to the second interactive interface displayed on which split screen area, the identity of the controlled terminal may be displayed on the split screen area, for example, a word such as "interface that you are operating XXX (identity information)" may be displayed. In another embodiment, the interactive interfaces may be displayed in a split-screen manner, or in a sliding manner, and each interactive interface may be switched by a sliding operation.
In one embodiment, the split-screen display processing of each interactive interface includes: the method comprises the steps of obtaining the number of interactive interfaces and the identification information of each control terminal, determining the number of split screen areas according to the number of the interactive interfaces, dividing a screen into split screen areas corresponding to the number of the split screen areas, and displaying each interactive interface in each split screen area according to the identification information of the control terminal.
In practical application, to ensure the accuracy of split-screen display, the split-screen display processing on the interactive interface may be: counting the number of interactive interfaces (interactive interfaces correspond to each Control terminal) sent by the controlled terminal 204 or the number of Control terminals operating the controlled terminal except for the controlled terminal, acquiring identification information (including device numbers, Media Access Control (MAC) addresses and other information capable of uniquely identifying the controlled terminal) of the Control terminals except for the controlled terminal, then determining the number of split screen areas according to the number of interactive interfaces or the number of other controlled terminals 204 operating the controlled terminal, dividing the screen into split screen areas corresponding to the number of split screen areas, and if the number of received interactive interfaces or the number of Control terminals operating the controlled terminal is 2,3 or 4, correspondingly dividing the screen into 1 × 2, 1 × 3 and 2 × 2. And after the screen splitting is finished, displaying each interactive interface in the corresponding split screen area according to the identity identification information of the control terminal. Specifically, the corresponding relationship between the identity identifier and the split screen area may be preset, for example, the split screen area 1 (for example, coordinates (0,0) -coordinates (512,384) are the split screen area 1) corresponds to the control terminal a, the split screen area 2 corresponds to the control terminal B, the distribution display of each interactive interface is completed according to the relationship and the identity identifier information carried by each interactive interface, or the split screen display may be performed in sequence according to the sequence of receiving the interactive interfaces, so as to obtain the corresponding relationship between the split screen area and the controlled terminal (that is, the corresponding relationship between the control terminal and the coordinate range). After the corresponding relationship between the split screen area and the control terminal 202 is obtained, the corresponding relationship between the split screen area and the control terminal 202 can be sent to other control terminals, so that the other control terminals can determine which coordinate range interval the split screen area specifically corresponds to.
In addition, a user may touch a plurality of split screen areas during one touch operation in the touch operation process, for example, if a large sliding operation is performed and the action position of the user involves a plurality of split screens, the user may perform the following two methods: firstly, a control terminal can preset that one touch operation can only control one split screen at the same time, when multiple screen operations exist, the split screen which is acted by the touch action at the earliest time can be selected, the split screen is taken as the operated split screen, and other split screens are not processed; if the second control terminal is not limited, all related split screens can be used as action objects of touch operation, and processing can be performed according to touch time. In this embodiment, the split-screen display of the interactive interface is completed through the number of other control terminals or interactive interfaces and the identification information of other control terminals, and the split-screen display can be flexibly and accurately performed according to different situations.
In one embodiment, acquiring the interactive interface of the controlled terminal comprises: acquiring program operation window data of the controlled terminal, processing the program operation window data to obtain a plurality of interactive interface configuration data, and configuring corresponding interactive interfaces according to the interactive interface configuration data.
In a specific implementation, the acquisition of the interactive interface may be to acquire screenshot data of a currently displayed interface sent by the controlled terminal 204, or to acquire current program running window data of the controlled terminal 204 or program running window data being controlled by another control terminal, where the program running window data includes page information of an operation interface of an application program currently displayed by the controlled terminal 204 or being run in a background, and includes various attribute information and configuration data of the page, screen UI data, screen size, resolution, and the like, to the control terminal 202. Then, the control terminal 202 may perform processing such as scaling, capturing, or filling on the program operating window data according to the size of the split screen area or the screen size to obtain the interactive interface configuration data, configure a corresponding interactive interface according to the interactive interface configuration data, and further display the interactive interface. In this embodiment, the interactive interface of the controlled terminal 204 may be page configuration data other than the screen capture data, and the corresponding interactive interface of the controlled terminal 204 can be accurately configured and displayed.
In one embodiment, acquiring a touch response interface of a controlled terminal includes: and acquiring touch response window data displayed after the corresponding controlled terminal responds to the touch operation data, processing the touch response window data to obtain touch response interface configuration data, and configuring a touch response interface according to the touch response interface configuration data.
After the controlled terminal 204 sequentially performs touch response on the touch operation data according to the touch operation time, a touch response interface may be correspondingly generated and sent to each control terminal 202, specifically, screenshot data of the touch response interface may be sent, or touch response window data, that is, page information of the operation interface displayed after the controlled terminal 204 performs touch response, including various attribute information and configuration data of the page, screen UI data, screen size, resolution, and the like, may be sent to the control terminal 202. Then, the control terminal 202 may perform processing such as scaling, capturing, or filling on the touch response window data according to the size of the split screen area or the screen size to obtain touch response interface configuration data, configure a corresponding touch response interface according to the touch response interface configuration data, and further display the touch response interface. In this embodiment, the touch response interface of the controlled terminal 204 may be page configuration data other than the screen capture data, and the touch response interface of the controlled terminal 204 can be accurately configured and displayed.
In one embodiment, the displayed interactive interface and the displayed touch response interface are matched with the size of the corresponding split screen area.
In specific implementation, each split screen area (split screen interface) correspondingly displays an interactive interface and a touch response interface of the controlled terminal 204. For example, there are 3 controlled terminals connected to the control terminal 202, which are respectively a controlled terminal a, a controlled terminal B, and a controlled terminal C, and the control terminal also has 3 split screen interfaces, which are respectively a split screen a, a split screen B, and a split screen B, where the interactive interface a displayed on the split screen a is an interface obtained by rendering the initial interactive interface of the controlled terminal a, and the interface is matched with the size of the split screen area, the interactive interface B displayed on the split screen B is an interface obtained by rendering the initial interactive interface of the controlled terminal B, and the interface is matched with the size of the split screen area, and the interactive interface C displayed on the split screen C is an interface obtained by rendering the initial interactive interface of the controlled terminal C, and the interface is matched with the size of the split screen area. Specifically, the rendered action may be performed by the controlled terminal or the control terminal. In the embodiment, the interface is rendered into the interface matched with the size of the split screen area, so that the interface data can be more reasonably displayed, and the use feeling of a user is improved.
In one embodiment, further comprising: the control center is connected with the controlled terminal and used for forwarding the data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
As shown in fig. 5, in the terminal control method based on time-sharing control provided in the present application, the controlled terminal 204 and the plurality of control terminals 202 may also be in communication via the control center 206, that is, the control center 206 is used for forwarding data between the control terminal and the controlled terminal, the control center 206 may be a server, a cloud (cloud computing server), a computer host, or the like, there may be a plurality of control centers 206, each control center 206 operates independently, the control centers 206 may be independent of each other or connected to each other, and each control center 206 may also be implemented by an independent server or a server cluster formed by a plurality of servers.
In a specific implementation, the controlled terminal 204 may be connected to the control center 206 in advance, the controlled terminal 204 may backup the data in the control center 206 in advance and set the data to be in an accessible state, or the controlled terminal 204 may be in a controllable state through a preinstalled remote operation application/operating system. The control terminal 202 may send its own identity code to the control center 206, and the control center 206 establishes a connection with the control terminal 202 after receiving and completing the verification of the identity code. The control terminal 202 obtains one or more interactive interfaces sent by the controlled terminal 202 through the control center 206, and then performs display or split screen display processing on the corresponding interactive interfaces. The user performs touch operation on the displayed interactive interface, software such as a browser portal and the like for receiving the touch operation of the user is preset in the control terminal 202, the control terminal 202 receives the touch operation of the user on the specific interactive interface, records information such as user touch operation time, touch coordinates, touch duration, touch pressure and the like, obtains touch operation data, and forwards the touch operation data to the controlled terminal 204 through the control center 206. The controlled terminal 202 generates a touch response interface after performing touch response according to the received touch operation data, and sends the touch response interface to the control terminal 202 through the control center 206. In the embodiment, the control center establishes connection with the controlled terminal, so that the data storage space can be reduced, and remote control can be performed on the basis of data backed up by the controlled terminal in the control center.
Fig. 6 is a schematic software architecture diagram of a terminal control method based on time-sharing control according to an embodiment, which includes an intelligent hand board 702, a cloud computing server 704 and a tablet computer 706, where the intelligent hand board 702 is a control terminal, the cloud computing server 704 is a control center, and the tablet computer 706 is a controlled terminal. The cloud computing server 704 includes, among other things, message middleware 708, front-end services 710, back-end services 712, and a database 714.
Referring to fig. 6, software for running data such as a neighborhood screen UI and touch events on the tablet pc 706 carries private Protocol data through a TCP (Transmission Control Protocol)/IP (internet Protocol Address) via a 4G/5G network, and establishes a connection with the cloud computing server 704. In the cloud computing server 704, the message middleware 708 efficiently distributes data, and the back-end service 712 and the front-end service 710 perform bidirectional communication through a Websocket protocol. Specifically, when the cloud computing server 704 performs information transmission with the smart tablet 702 and the tablet 706, specifically, the cloud computing server 704 communicates with the tablet 706 through a TCP/IP protocol by using the message middleware 708, receives an operation interface (including an interactive interface and a touch response interface) sent by the tablet 706, the message middleware 708 transmits the operation interface to the back-end service 712 through the TCP/IP protocol, the back-end service 712 transmits the operation interface to the front-end service 710 through the Websocket protocol, the front-end service 710 performs rendering processing on the operation interface according to the resolution, the size of the operation interface, and the like of the smart tablet 702, so that the rendered image is adapted to the smart tablet 702, the smart tablet 702 actively obtains the rendered image from the front-end service 710 through the HTTP protocol, and the cloud computing server 704 receives the touch operation, including touch time, touch response time, and the like, which are obtained by performing touch operation on the interface displayed by the tablet by a user and sent by the smart tablet 702 through the HTTP or, The backend service 712 encapsulates the touch operation data, such as the touch coordinate, the touch pressure, and the touch duration, with a TCP/IP protocol-based private protocol through the message middleware 708, and forwards the encapsulated touch operation data to the tablet pc 706. Then, the backend service 712 sends the received touch response interface sent by the tablet computer 706 to the smart tablet 702 through the message middleware 708.
In one embodiment, as shown in fig. 7, the present application further provides a terminal control method based on time-sharing control, which can still be applied to the application environment diagram shown in fig. 1. Taking the example that the method is applied to the controlled terminal 204 in fig. 1 as an example, the method includes the following steps:
step S300, acquiring a control request of the control terminal, wherein the control request carries identity authentication information of the control terminal;
step S500, when the identity authentication of the control terminal is completed according to the identity authentication information, sending an interactive interface to the control terminal, wherein the interactive interface is an interface currently controlled by at least two control terminals;
step S700, receiving touch operation data of a user for each interactive interface, which is sent by each control terminal, wherein the touch operation data comprises touch operation time;
and S900, sequentially responding to each touch operation data according to the touch operation time, and generating and sending a corresponding touch response interface to each control terminal.
During specific implementation, a control request carrying identity authentication information and sent by the control terminal A is received, and when pairing authentication or identity authentication of the control terminal A is completed according to the identity authentication information, an interactive interface which is being controlled by at least two control terminals is sent to the control terminal A. It can be understood that the control terminal that establishes the connection with the controlled terminal 204 before the control terminal a obtains the interactive interface sent by the controlled terminal 204 in the same manner. Similarly, several representations of the interactive interface have been described in detail in the foregoing embodiments, and are not described in detail herein. Each control terminal responds to touch operation of a user on an interactive interface displayed by the control terminal to generate touch operation data, the touch operation data carries touch operation time, then the touch operation data is sent to the controlled terminal 204, the controlled terminal 204 receives one or more touch operation data, responds to each touch operation data in sequence according to the touch operation time, executes corresponding operation according to information such as touch coordinates, touch duration, touch pressure and the like in the touch operation data, updates an operation interface (program operation window) corresponding to the control terminal, generates a corresponding touch response interface, and sends the touch response interface to each control terminal, so that each control terminal can receive the latest operation interface synchronously. Specifically, the touch response interface generated by the controlled terminal 204 may be a final touch response interface obtained after all the touch operation data are responded, or may be a plurality of touch response interfaces obtained by responding the touch operation data one by one and sent in real time. And after the touch response operation is finished, synchronously updating the self interactive interface. The pairing authentication or the identity authentication is not limited to the verification modes such as character string password verification, fingerprint verification, face verification, iris verification and the like.
In particular, the response to the touch operation includes various situations. The following description will be given by taking the sorted touch operations as touch operation 1, touch operation 2, touch operation 3, and touch operation n … in sequence as an example:
in case 1, if no conflict between the received touch operations is detected, sequentially executing touch operations 1 to n according to a sequence, and taking a final interface n generated after the touch operation n is executed as a first touch response interface; or the interfaces generated by each touch operation (i.e. interface 1 and interface 2 …, interface n) are all used as touch response interfaces and are sequentially sent to each control terminal;
and 2, if the received touch operations are detected to have conflicts, responding to only the touch operation 1 with the earliest touch time, and taking the generated interface 1 as a touch response interface. Or responding to the former operations without conflict, and generating a response interface, for example, the former 1-5 operations without conflict and conflict generated when the touch operation 6 is reached, and only responding to the touch operations 1-5 at this time. Before the current control terminal a has not sent the touch operation data, the controlled terminal 204 may receive the touch operations of other control terminals in real time, and respond, and send the interface after the response to the control terminal a as a touch response interface.
In the terminal control method based on time-sharing control, when the identity authentication of the control terminal is completed according to the identity authentication information, an interactive interface is sent to the control terminal, touch operation data which are sent by the control terminals and carry touch operation time are received, the touch response operation data are sequentially responded according to the touch operation time, and the corresponding control terminals of the touch response interface are generated and sent. According to the scheme, the controlled terminal does not need to be carried, direct operation on the control terminal is replaced by interaction between the control terminal and the controlled terminal, so that a user can operate on the interaction interfaces of the control terminals, many-to-one remote control on the controlled terminal is realized, and convenience is improved.
In one embodiment, after sending the corresponding touch response interface to each control terminal, the method further includes: and sending operator information to each control terminal, wherein the operator information comprises a data sender for generating touch operation data of the corresponding touch response interface.
In practical applications, in addition to sending the corresponding touch response interface to the control terminal, the control terminal may also send operator information, where the operator information includes a data sender generating touch operation data of the corresponding touch response interface, so that each control terminal knows which related operations have been performed by each control terminal. In addition, the identity information of the control terminal that sends the touch operation data in the current time period (i.e., the identity information of the current other control terminals) may also be sent, so that each control terminal can know that the other control terminals that are currently operating the controlled terminal 202 except for itself.
In one embodiment, the receiving touch operation data of the user for each interactive interface sent by each control terminal includes: and when touch operation data of a user aiming at the interactive interface, which are sent by any control terminal, are received, the unique operation authority of the control terminal on the interactive interface in the current time period is locked.
In practical application, for receiving touch operation on the same interactive interface sent by a plurality of different control terminals in a short time, in order to reduce the conflict of touch operation data, when receiving the touch operation data of a user on a certain interactive interface sent by any control terminal, the unique operation authority of the control terminal on the interactive interface in the current time period is locked, the receiving of the touch operation data sent by other control terminals is stopped, further, an operation prohibition message can be sent to other control terminals, so that the users of other control terminals stop operating the interactive interface, when the user stops the touch operation on the interactive interface, the unique operation authority is released, the touch operation data sent by other control terminals are allowed to be received, further, an operation permission message can be sent to other control terminals, so that the users of other control terminals can operate in time. In the embodiment, by locking the operation permission, the conflict of touch operation data can be reduced, and the fluency of data interaction is ensured.
It should be understood that although the steps in the flowcharts of fig. 2, 4 and 7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2, 4 and 7 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 8, there is provided a terminal including: communication module 510, touch display module 520 and processor 530, wherein:
the communication module 510 is connected with a controlled terminal, the processor 530 acquires an interactive interface of the controlled terminal and sends the interactive interface to the touch display module 520, the touch display module 520 receives and displays the interactive interface, touch operation data is obtained by responding to touch operation of a user on the interactive interface and sent to the processor 530, the touch operation data comprises touch operation time, the processor 530 acquires and sends the touch operation data to the controlled terminal, a touch response interface of the controlled terminal is acquired and sent to the touch display module 520, and the touch display module 520 receives and displays the touch response interface, wherein the touch response interface is generated by the controlled terminal sequentially responding to the touch operation data according to the touch operation time.
In another embodiment, as shown in fig. 9, the communication module 510 includes a wireless communication interface 1616, and the touch display module 520 may be a touch display screen 1602. Specifically, referring to fig. 11, the wireless communication interface 1616 may be a 3G/4G/5G network or Wi-Fi antenna interface, the touch display screen 1602 may be an OLED (Organic Light-Emitting Diode) and glass (or sapphire) cover plate, and the processor may be equipped with a high-pass APQ8053 on a PCBA (Printed Circuit Board Assembly). In addition, the terminal includes a partition 1604, a battery 1608 (capacity 1000mAh, 1.0mm), a USB interface 1610(Type C), a stainless steel bezel 1612 and a back cover 1614, the back cover 1614 can be an OLED and glass (or sapphire) cover. Because components such as a microphone, a camera and the like are not designed, the conversation function can be realized through the Bluetooth headset, and the shooting can be realized through the wristwatch.
More specifically, the thickness of the terminal may be 4mm, the former period may use Wi-Fi and BT (Bit Torrent) communication interfaces for interaction, and the later period may use an autonomous protocol for interaction. 5-6 inches of screen can be adopted for various extension (such as biological detection) hand board terminals of network mobile phones, network video terminals, game terminals and intelligent watches; for intelligent home terminals such as a home management board, a reading board, a game board, a WeChat board, a social contact board, an operation board and the like, a 7-14 inch screen can be adopted; for intelligent teaching, meeting, aviation and high-speed rail terminals such as a teaching board, a textbook board, a test board, a meeting board, an aviation board, a high-speed board, a one-way confidential information board and the like, a 7-14 inch screen can also be adopted; for intelligent surface terminals such as office table boards, projection display boards, food ordering boards, bus station boards, household appliance boards, intelligent furniture boards, bar interactive boards, outdoor natural scene interactive boards, movie and television interactive boards, concert sports focusing boards and the like, 5-105 inches screens can be adopted.
The terminal can ensure good realization of touch and display functions, realizes functions of data processing, data storage and the like through the controlled terminal and/or the control center, and functionally separates touch and display from other functions. Because the functions of data processing, data storage and the like do not need to be realized, compared with the traditional terminal, the terminal can realize various complex functions by light weight, small volume and thin thickness, and the problems of large weight and volume and poor portability of the terminal in the traditional communication system are solved.
Furthermore, because the terminal uses an open communication platform, the terminal can directly communicate through the open platforms such as a wireless communication network or a cloud without depending on any mobile phone brand and obtaining permission of an operator, and the complex problem caused by the existing terminal brand and operator configuration threshold is avoided.
In one embodiment, as shown in fig. 10, there is provided a terminal control apparatus based on time-sharing control, including: a first interface display module 610, a touch operation response module 620, a touch operation data sending module 630 and a second interface display module 640, wherein:
the first interface display module 610 is configured to acquire an interactive interface of the controlled terminal, and display the interactive interface, where the interactive interface is an interface currently controlled by at least two control terminals;
a touch operation response module 620, configured to respond to a touch operation performed on the interactive interface by a user to obtain touch operation data, where the touch operation data includes touch operation time;
a touch operation data sending module 630, configured to send touch operation data to the controlled terminal;
the second interface display module 640 is configured to obtain a touch response interface of the controlled terminal, and display the touch response interface, where the touch response interface is generated by the controlled terminal sequentially responding to each touch operation data according to the touch operation time.
In an embodiment, the first interface display module 610 is further configured to obtain a plurality of interactive interfaces of the controlled terminal, and perform split-screen display on each interactive interface, where the interactive interfaces are interfaces of the controlled terminal that are currently controlled by each control terminal independently.
In an embodiment, as shown in fig. 11, the apparatus further includes a data connection module 650, configured to send a control request to the controlled terminal, where the control request carries identity authentication information, receive a connection permission message fed back by the controlled terminal according to the identity authentication information, and establish a connection with the controlled terminal.
In an embodiment, as shown in fig. 11, the apparatus further includes an interface configuration module 660, configured to obtain program running window data of the controlled terminal, process the program running window data to obtain multiple interactive interface configuration data, and configure a corresponding interactive interface according to each interactive interface configuration data.
In an embodiment, the configuration module 660 is further configured to obtain touch response window data displayed after the corresponding controlled terminal responds to the touch operation data, process the touch response window data to obtain touch response interface configuration data, and configure the touch response interface according to the touch response interface configuration data.
In an embodiment, the data connection module 650 is further configured to establish a connection with the controlled terminal through a control center, where the control center is configured to forward data transmitted by the control terminal to the controlled terminal and forward data transmitted by the controlled terminal to the control terminal, so as to implement communication between the control terminal and the controlled terminal.
For specific limitations of the terminal control device based on time-sharing control, reference may be made to the above limitations of the terminal control method based on time-sharing control, and details thereof are not repeated here. All or part of each module in the terminal control device based on time-sharing control can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, as shown in fig. 12, there is provided a terminal control apparatus based on time-sharing control, including: a control request obtaining module 710, a data sending module 720, a data receiving module 730, and a data responding module 740, wherein:
the control request obtaining module 710 is configured to obtain a control request of the control terminal, where the control request carries identity authentication information of the control terminal;
the data sending module 720 is configured to establish connection with each control terminal and send an interactive interface to the control terminal when the identity authentication of the control terminal is completed according to the identity authentication information, where the interactive interface is an interface currently controlled by at least two control terminals;
the data receiving module 730 is configured to receive touch operation data, which is sent by each control terminal and is specific to each interactive interface by a user, where the touch operation data includes touch operation time;
the data response module 740 is configured to sequentially respond to each touch operation data according to the touch operation time, and generate and send a corresponding touch response interface to each control terminal.
In one embodiment, the data sending module 720 is further configured to send operator information to each control terminal, where the operator information includes a data sender generating touch operation data of a corresponding touch response interface.
In one embodiment, the data response module 740 is further configured to lock the unique operation right of the control terminal to the interactive interface in the current time period when receiving touch operation data, sent by any control terminal, of the user for the interactive interface.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 13. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a terminal control method based on time-sharing control. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 12 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, which includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the terminal control method based on time-sharing control when executing the computer program.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps in the time-sharing control-based terminal control method described above.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (15)

1. A terminal control method based on time-sharing control comprises the following steps:
acquiring an interactive interface of a controlled terminal, and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
responding to touch operation of a user on the interactive interface to obtain touch operation data, wherein the touch operation data comprises touch operation time;
sending the touch operation data to the controlled terminal;
and acquiring a touch response interface of the controlled terminal, and displaying the touch response interface, wherein the touch response interface is generated by the controlled terminal sequentially responding to each touch operation data according to the touch operation time.
2. The method according to claim 1, wherein the obtaining of the interactive interface of the controlled terminal, and the displaying of the interactive interface comprises:
the method comprises the steps of obtaining a plurality of interactive interfaces of a controlled terminal, and displaying the interactive interfaces in a split screen mode, wherein the interactive interfaces are the interfaces of the controlled terminal which are independently controlled by each control terminal currently.
3. The method according to claim 1, wherein before acquiring the interactive interface of the controlled terminal, the method further comprises:
sending an operation request to the controlled terminal, wherein the operation request carries identity authentication information;
and receiving a connection permission message fed back by the controlled terminal according to the identity authentication information, and establishing connection with the controlled terminal.
4. The method according to claim 1, wherein the acquiring the interactive interface of the controlled terminal comprises:
acquiring program operation window data of the controlled terminal;
processing the program operation window data to obtain interactive interface configuration data;
and configuring the corresponding interactive interface according to the interactive interface configuration data.
5. The method according to claim 1, wherein the acquiring the touch response interface of the controlled terminal comprises:
acquiring touch response window data displayed after the controlled terminal responds to the touch operation data;
processing the touch response window data to obtain touch response interface configuration data;
and configuring the touch response interface according to the touch response interface configuration data.
6. The method according to any one of claims 1 to 5, wherein the displayed interactive interface and the displayed touch response interface match a screen size of the control terminal.
7. The method of any one of claims 1 to 5, further comprising:
and establishing connection with the controlled terminal through a control center, wherein the control center is used for forwarding data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
8. A terminal control method based on time-sharing control comprises the following steps:
acquiring a control request of a control terminal, wherein the control request carries identity authentication information of the control terminal;
when the identity authentication of the control terminal is completed according to the identity authentication information, sending an interactive interface to the control terminal, wherein the interactive interface is an interface which is currently controlled by at least two control terminals;
receiving touch operation data, which are sent by each control terminal and aim at each interactive interface, of a user, wherein the touch operation data comprise touch operation time;
and sequentially responding each touch operation data according to the touch operation time, and generating and sending a corresponding touch response interface to each control terminal.
9. The method according to claim 8, wherein the receiving touch operation data of the user for the interactive interface sent by each control terminal comprises:
and when touch operation data of a user aiming at the interactive interface, which are sent by any control terminal, are received, the unique operation authority of the control terminal on the interactive interface in the current time period is locked.
10. The method of claim 8, wherein after sending the corresponding touch response interface to each control terminal, further comprising:
and sending operator information to each control terminal, wherein the operator information comprises a data sender for generating touch operation data of the corresponding touch response interface.
11. A terminal control apparatus based on time-sharing control, the apparatus comprising:
the first interface display module is used for acquiring an interactive interface of the controlled terminal and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
the touch operation response module is used for responding to the touch operation of the user on the interactive interface to obtain touch operation data, and the touch operation data comprises touch operation time;
the touch operation data sending module is used for sending the touch operation data to the controlled terminal;
and the second interface display module is used for acquiring a touch response interface of the controlled terminal and displaying the touch response interface, and the touch response interface is generated by the controlled terminal sequentially responding to each touch operation data according to the touch operation time.
12. A terminal control apparatus based on time-sharing control, the apparatus comprising:
the control request acquisition module is used for acquiring a control request of the control terminal, wherein the control request carries identity authentication information of the control terminal;
the data sending module is used for sending an interactive interface to the control terminal when the identity authentication of the control terminal is completed according to the identity authentication information, wherein the interactive interface is an interface which is currently controlled by at least two control terminals;
the data receiving module is used for receiving touch operation data, which are sent by each control terminal and are aimed at each interactive interface by a user, wherein the touch operation data comprise touch operation time;
and the data response module is used for sequentially responding each touch operation data according to the touch operation time, and generating and sending a corresponding touch response interface to each control terminal.
13. A terminal, comprising: the touch display device comprises a communication module, a touch display module and a processor;
the communication module is connected with the controlled terminals, the processor acquires the interactive interface of each controlled terminal and sends the interactive interface to the touch display module, the touch control display module receives and displays the interactive interface, responds to the touch control operation of the user on the interactive interface to obtain touch control operation data, and sending touch operation data to the processor, the touch operation data including touch operation time, the processor acquires and sends the touch operation data to the controlled terminal, acquires a touch response interface of the controlled terminal and sends the touch response interface to the touch display module, the touch display module receives and displays the touch response interface, and the touch response interface is generated by the controlled terminal responding to each touch operation data according to the touch operation time.
14. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 10 are implemented by the processor when executing the computer program.
15. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 10.
CN202010070600.0A 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment Active CN111314442B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010070600.0A CN111314442B (en) 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010070600.0A CN111314442B (en) 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment

Publications (2)

Publication Number Publication Date
CN111314442A true CN111314442A (en) 2020-06-19
CN111314442B CN111314442B (en) 2023-07-18

Family

ID=71148210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010070600.0A Active CN111314442B (en) 2020-01-21 2020-01-21 Terminal control method and device based on time-sharing control, terminal and computer equipment

Country Status (1)

Country Link
CN (1) CN111314442B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113923633A (en) * 2021-09-29 2022-01-11 湖北亿咖通科技有限公司 Intelligent cabin control method, system and equipment integrating mobile terminal

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120246592A1 (en) * 2011-03-24 2012-09-27 Acer Incorporated Method for customizing user interface and electronic device thereof
CN103561220A (en) * 2013-10-28 2014-02-05 三星电子(中国)研发中心 Television terminal and multi-screen display and control method thereof
CN106572139A (en) * 2015-10-13 2017-04-19 阿里巴巴集团控股有限公司 Multi-terminal control method and system, terminal, and server
US20170269822A1 (en) * 2015-05-15 2017-09-21 Boe Technology Group Co., Ltd. Display processing method, display processing apparatus and electronic device
CN108401453A (en) * 2017-12-27 2018-08-14 深圳前海达闼云端智能科技有限公司 A kind of method, apparatus and intelligent terminal of control display screen
CN108668153A (en) * 2017-03-28 2018-10-16 Lg 电子株式会社 Intelligent control device and its control method
CN109583178A (en) * 2018-10-09 2019-04-05 阿里巴巴集团控股有限公司 A kind of meeting collaboration participatory approaches and system
CN109698853A (en) * 2017-10-20 2019-04-30 北京仁光科技有限公司 Long-range control method, device, equipment, system and computer readable storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120246592A1 (en) * 2011-03-24 2012-09-27 Acer Incorporated Method for customizing user interface and electronic device thereof
CN103561220A (en) * 2013-10-28 2014-02-05 三星电子(中国)研发中心 Television terminal and multi-screen display and control method thereof
US20170269822A1 (en) * 2015-05-15 2017-09-21 Boe Technology Group Co., Ltd. Display processing method, display processing apparatus and electronic device
CN106572139A (en) * 2015-10-13 2017-04-19 阿里巴巴集团控股有限公司 Multi-terminal control method and system, terminal, and server
CN108668153A (en) * 2017-03-28 2018-10-16 Lg 电子株式会社 Intelligent control device and its control method
CN109698853A (en) * 2017-10-20 2019-04-30 北京仁光科技有限公司 Long-range control method, device, equipment, system and computer readable storage medium
CN108401453A (en) * 2017-12-27 2018-08-14 深圳前海达闼云端智能科技有限公司 A kind of method, apparatus and intelligent terminal of control display screen
CN109583178A (en) * 2018-10-09 2019-04-05 阿里巴巴集团控股有限公司 A kind of meeting collaboration participatory approaches and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113923633A (en) * 2021-09-29 2022-01-11 湖北亿咖通科技有限公司 Intelligent cabin control method, system and equipment integrating mobile terminal
CN113923633B (en) * 2021-09-29 2024-05-24 亿咖通(湖北)技术有限公司 Intelligent cabin control method, system and equipment integrating mobile terminal

Also Published As

Publication number Publication date
CN111314442B (en) 2023-07-18

Similar Documents

Publication Publication Date Title
CN111290695B (en) Terminal control method and device based on priority control and terminal
CN111314441B (en) Terminal control method and device based on multi-region control and terminal
US10911670B2 (en) Image management system, image management method, and computer program product
CN111309226B (en) Terminal control method and device based on communication quality, terminal and computer equipment
CN111324248A (en) Terminal control method, terminal control device, terminal, computer equipment and storage medium
US11146695B2 (en) Communication management system, communication system, communication control method, and recording medium
TWI673679B (en) Method,apparatus and computer-readable storage media for user interface
CN111273850B (en) Terminal control method and device, computer equipment and storage medium
CN113015263B (en) Image sharing method and electronic equipment
US10420011B2 (en) Communication system, transmission terminal, communication method, and medium
CN109639569B (en) Social communication method and terminal
US11394757B2 (en) Communication terminal, communication system, and method of sharing data
US20150249696A1 (en) Transmission terminal, transmission system, transmission method, and recording medium storing transmission control program
US11947998B2 (en) Display method and device
CN111314442B (en) Terminal control method and device based on time-sharing control, terminal and computer equipment
CN107924298A (en) For the interactive sharing application between touch screen computer and data method and be used for realization the computer program of this method
US20150249695A1 (en) Transmission terminal, transmission system, transmission method, and recording medium storing transmission control program
CN112163200A (en) Picture processing method and device and electronic equipment
CN111263004B (en) Terminal control method and device, computer equipment and storage medium
WO2021072974A1 (en) Terminal control method, system and apparatus, computer device, and storage medium
JP2019159423A (en) Information processing device, data display method, program, communication system, communication method, and registration information management device
CN114826800B (en) Information acquisition method, device, terminal and storage medium
CN113158085B (en) Information switching processing method and device, electronic equipment and storage medium
CN116017086A (en) Interactive processing method and device, electronic equipment and storage medium
JP2021124771A (en) Communication device, communication system, display method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant