CN116633904A

CN116633904A - Remote control method, device, storage medium, and program product

Info

Publication number: CN116633904A
Application number: CN202210125323.8A
Authority: CN
Inventors: 张凯; 朱秀峰; 杨磊新; 罗万鹏; 翟阳斌; 阮联政; 朱卫卫; 陈远超
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2022-02-10
Filing date: 2022-02-10
Publication date: 2023-08-22

Abstract

The embodiment of the application provides a remote control method, remote control equipment, a storage medium and a program product, and relates to the technical field of Internet. The method comprises the following steps: in the case of participating in the multi-person online conference, and the first client starts a screen sharing function, transmitting screen content to at least one other client participating in the multi-person online conference; establishing remote control connection with a second client in an interaction way, wherein the second client is a client participating in a multi-person online conference; after the remote control connection is established, receiving remote control information from the second client, wherein the remote control information is used for controlling the first client to execute target operation; and performing a target operation corresponding to the remote control information. The technical scheme provided by the embodiment of the application can improve the convenience of remote control connection.

Description

Remote control method, device, storage medium, and program product

Technical Field

The embodiment of the application relates to the technical field of Internet, in particular to a remote control method, remote control equipment, a storage medium and a program product.

Background

With the development of internet technology, more and more communication and interaction between people can be completed online.

In the related art, two terminals are respectively provided with remote control software, the control terminal sends a link to the controlled terminal, and after a user of the controlled terminal clicks the link, the two terminals can establish remote control connection, namely, the control terminal can control the controlled terminal.

In the related art, the establishment of the remote control connection requires the installation of dedicated remote control software, which is inconvenient.

Disclosure of Invention

The embodiment of the application provides a remote control method, remote control equipment, a storage medium and a program product, which can improve the convenience of establishing remote control connection. The technical scheme is as follows:

according to an aspect of an embodiment of the present application, there is provided a remote control method including:

transmitting screen content to at least one other client participating in the multi-person online conference under the condition that the first client starts a screen sharing function;

establishing remote control connection with a second client in an interaction manner, wherein the second client is a client participating in the multi-person online conference;

after the remote control connection is established, receiving remote control information from the second client, wherein the remote control information is used for controlling the first client to execute target operation;

And executing the target operation corresponding to the remote control information.

displaying screen content provided by a first client under the condition that the first client participates in a multi-person online conference and the screen sharing function is started; wherein the first client is a client participating in the multi-person online conference;

establishing remote control connection with the first client in an interaction way;

and after the remote control connection is established, responding to remote control operation, and sending remote control information to the first client, wherein the remote control information is used for controlling the first client to execute target operation.

in the process of the multi-person online conference, screen content of a first client participating in the multi-person online conference is sent to at least one other client participating in the multi-person online conference;

establishing remote control connection between the first client and a second client, wherein the second client is a client participating in the multi-person online conference;

and sending the remote control information to the first client.

According to an aspect of an embodiment of the present application, there is provided a remote control apparatus including:

the content sending module is used for sending screen content to at least one other client side participating in the multi-person online conference under the condition that the first client side starts a screen sharing function;

the connection establishment module is used for interactively establishing remote control connection with a second client, and the second client is a client participating in the multi-person online conference;

the information receiving module is used for receiving remote control information from the second client after the remote control connection is established, and the remote control information is used for controlling the first client to execute target operation;

and the operation execution module is used for executing the target operation corresponding to the remote control information.

The content display module is used for displaying screen content provided by the first client under the condition that the first client participates in the multi-person online conference and the screen sharing function is started; wherein the first client is a client participating in the multi-person online conference;

the connection establishment module is used for interactively establishing remote control connection with the first client;

and the information sending module is used for responding to the remote control operation after the remote control connection is established and sending remote control information to the first client, wherein the remote control information is used for controlling the first client to execute target operation.

the content sending module is used for sending the screen content of a first client participating in the multi-person online conference to at least one other client participating in the multi-person online conference in the process of the multi-person online conference;

the connection establishment module is used for establishing remote control connection between the first client and a second client, wherein the second client is a client participating in the multi-person online conference;

and the information sending module is used for sending the remote control information to the first client.

According to an aspect of an embodiment of the present application, there is provided a computer apparatus including a processor and a memory, in which at least one instruction, at least one program, a code set, or an instruction set is stored, the at least one instruction, the at least one program, the code set, or the instruction set being loaded and executed by the processor to implement the above remote control method.

According to an aspect of an embodiment of the present application, there is provided a computer-readable storage medium having stored therein at least one instruction, at least one program, a code set, or an instruction set, which is loaded and executed by a processor to implement the above-described remote control method.

According to an aspect of embodiments of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions so that the computer device performs the above-described remote control method.

The technical scheme provided by the embodiment of the application can have the following beneficial effects:

in the multi-user online conference, under the condition that one client opens a screen sharing function, the client can establish remote control connection with the other client in the multi-user online conference, so that the other client can control the client to execute target operation, remote control between the two clients/terminals can be realized through the multi-user online conference, a software program special for remote control is not required to be additionally installed, and convenience of remote control is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application as claimed.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic illustration of an implementation environment provided by one embodiment of the present application;

FIG. 2 is a flow chart of a remote control method provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of conference control provided by one embodiment of the present application;

FIG. 4 is a schematic screen view of an embodiment of the present application;

FIG. 5 is a flow chart of a remote control method according to another embodiment of the present application;

FIG. 6 is a schematic view of a screen provided by another embodiment of the present application;

FIG. 7 is a schematic view of a screen provided by another embodiment of the present application;

FIG. 8 is a flow chart of a remote control method according to another embodiment of the present application;

FIG. 9 is a flow chart of a remote control method according to another embodiment of the present application;

FIG. 10 is a schematic diagram of a remote control system provided in one embodiment of the present application;

FIG. 11 is a flow chart of a remote control method according to another embodiment of the present application;

FIG. 12 is a block diagram of a remote control device provided in one embodiment of the present application;

FIG. 13 is a block diagram of a remote control device according to another embodiment of the present application;

FIG. 14 is a block diagram of a remote control device according to another embodiment of the present application;

FIG. 15 is a block diagram of a terminal provided by one embodiment of the present application;

fig. 16 is a block diagram of a server provided by an embodiment of the present application.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of methods consistent with aspects of the application as detailed in the accompanying claims.

Remote control (Remote control) means that a terminal to be controlled is connected by means of Remote dialing through a computer network or both access to the Internet (Internet) and the like in different places, display content of the controlled terminal is displayed on a main control terminal, and the main control terminal can execute operations such as application program installation, system setting and the like on the controlled terminal through Remote control. In an online conference scene, a remote control needs a control party to control screen contents such as a controlled form, a demonstration document and the like.

Referring to FIG. 1, a schematic diagram of an implementation environment provided by one embodiment of the present application, which may be implemented as a remote control system, is shown. As shown in fig. 1, the system 10 may include: a first terminal 11, a second terminal 12 and a server 13.

The first terminal 11 and the second terminal 12 have a target application program installed and run therein, such as a client of the target application program. Optionally, the client has a user account logged in. The terminal is an electronic device with data computing, processing and storage capabilities. The terminal may be a smart phone, a tablet computer, a PC (Personal Computer ), a wearable device, etc., which is not limited by the embodiment of the present application. The target application may be an online conferencing application. The target application may also be any application that supports multi-person online conferencing and remote control functions, such as instant messaging applications, mail applications, gaming applications, social applications, payment applications, video applications, music applications, shopping applications, news applications, and the like. In the method provided by the embodiment of the present application, the execution body of the terminal corresponding step may be a client thereof, such as a first client running in the first terminal 11 and a second client running in the second terminal 12.

In some embodiments, the server 13 establishes a communication connection (e.g., a network connection) with the first terminal 11 and the second terminal 12, respectively, and the server 13 is configured to provide background services for the target application. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud computing service.

In some embodiments, the server 13 has the following several systems running therein:

(1) Remote control system

The remote control system mainly manages remote control functions, and when screen sharing is performed in a conference, the functions of initiating remote control, stopping remote control, suspending remote control, distributing check information (such as first check information and second check information), remote control authority check, remote control message pushing and the like are realized. And the remote control system can also receive the security alarm of the security management system and send the security alarm to the first client or the second client, or directly interrupt the remote control connection in progress, thereby guaranteeing the security of users.

The remote control related information is managed through the remote control system, and the remote control information of all conferences is stored in the redis cache. After the remote control is established successfully, the remote control system sends information of the successful establishment of the remote control to part or all of the participating clients in the conference, and sends screen contents of the controlled party to other clients, so that users corresponding to the other clients can see real-time remote control operation processes.

In some embodiments, both parties (i.e., the primary and the secondary) may terminate control at any time during the remote control process. In some embodiments, the moderator in the meeting may terminate or pause the remote control as desired. The remote control information of the conference is synchronized to the security management module by means of kafka.

(2) Conference control system

The conference control system comprises a conference management system and has the functions of conference management, message pushing and the like. The conference control system is mainly used for managing multi-person online conferences, user access conferences, user status, related data change notification and the like. The conference control system also has the right to control the remote control connection.

(3) Safety monitoring system

The safety monitoring system is mainly used for monitoring risks of meetings and users in the meetings, and when meetings or participants with risks are found, safety alarms are timely sent out. The security monitoring system may obtain information about the successful establishment of the remote control connection from kafka, obtain the conference ID (Identity Document, identity) and the participant information (i.e., information about the user account number participating in the conference) from the information, and manage the security risk of the conference ID and the participant information. When the security monitoring system detects that the conference or the participant has security risk, the security monitoring system can call an interface provided by the remote control system to send security alarm information. And the remote control system judges whether to interrupt the current remote control according to the risk level.

In some embodiments, the system 10 further includes a third terminal 14, the third terminal 14 having a target application installed and running therein, such as a third client of the target application. Optionally, after a remote control connection is established between the first client and the second client through the server 13, the second client may control the terminal where the first client is located, and the third client may receive and display a controlled screen of the first terminal.

The technical scheme of the application is described and illustrated by the following examples.

Referring to fig. 2, a flowchart of a remote control method according to an embodiment of the application is shown. In this embodiment, the method is applied to the remote control system described above for illustration. The method may comprise the following steps (201-205):

in step 201, in a case where the first client participates in the multi-person online conference and the first client turns on the screen sharing function, the first client transmits screen content to at least one other client participating in the multi-person online conference.

In some embodiments, clients of the plurality of target applications participate in a multi-person online conference in which a first client opens a screen sharing function to share screen content of a first terminal where the first client is located for viewing by users corresponding to other clients. In some embodiments, the multi-person online conference is a video conference. Optionally, when the multi-person online conference is a voice conference, if the first client shares the screen content of the first terminal where the first client is located to other clients in the multi-person online conference, the multi-person online conference is changed from the voice conference to the video conference.

In some embodiments, during the multiplayer online conference, the first client first sends screen content to the server, which sends screen content of the first client participating in the multiplayer online conference to at least one other client participating in the multiplayer online conference.

In some embodiments, the conference control system in the server mainly plays a role of whether a remote control of the multi-person online conference is available (equivalent to a remote control switch for controlling the multi-person online conference). As shown in fig. 3, the client 15 sends a conference creation request for applying for creating a multi-person online conference to the conference control system 16; the conference control system 16 sends a permission query request to the account management system 17; after inquiring the authority information of the user account corresponding to the client 15, the account management system 17 sends the authority information to the conference control system 16; the conference control system 16 sends a switch instruction of the remote control to the client 15 according to the authority information. If it is found that the user account corresponding to the client 15 does not have the authority for remote control according to the authority information, the switch instruction sent to the client 15 is used for closing the remote control functions of all clients in the multi-user online conference, for example, the remote control displayed by the client cannot be triggered; if it is found that the user account corresponding to the client 15 has the authority of remote control according to the authority information, the switch instruction sent to the client 15 is used for starting the remote control functions of all clients in the multi-user online conference, for example, the remote control displayed by the client is triggerable.

In step 202, the second client displays screen content provided by the first client.

In some embodiments, the at least one other client includes a second client such that the second client (the second terminal at which it resides) can display screen content provided by the first client.

In step 203, the first client interacts with a second client to establish a remote control connection, the second client being a client participating in the multiplayer online conference.

In some embodiments, the interaction between the first client and the second client is achieved by the first client issuing a controlled request, or by the second client issuing a control request, and a remote control connection is established. In some embodiments, a remote control connection between the first client and the second client is established by a server.

In some embodiments, the second client may control the first client through a remote control connection, i.e., the second client may control the first terminal in which the first client is located, such as controlling setup information in the first terminal, controlling clients of various applications in the first terminal, controlling files in the first terminal, controlling movement of a cursor in a screen in the first terminal, and so on.

In some embodiments, after the first client interactively establishes the remote control connection with the second client, the method further comprises the steps of: the server receives screen content from the first client; the server eliminates the content which is not authorized to be displayed by the second client in the screen content according to the display authority information of the second client, so as to obtain the processed screen content; the display permission information is used for indicating the content which is authorized or not authorized to be displayed by the second client; and the server sends the processed screen content to the second client.

In some embodiments, the first client corresponds to a first screen and the second client corresponds to a second screen. In the above embodiment, the server acquires the display authority information of the second client, which may indicate which screen contents can be displayed in the second screen and which screen contents cannot be displayed in the second screen, among the screen contents included in the first screen.

In some embodiments, the server may identify, according to the display permission information of the second client, the content that the second client has no right to display through an image identification technology. In some embodiments, the manner in which the content that the second client does not have access to display is eliminated may be by using a masking picture to mask the portion of the screen content that the second client does not have access to display.

In some embodiments, the content that the second client has no rights to display may be a folder, a file, an identifier of a communication application (such as an icon, a text identifier), an identifier of a communication interface of the communication application (such as contact information, a chat interface, mail content, etc.), an identifier of an entertainment application (such as a game application, a live application, a video application, etc.), a client interface of the entertainment application, etc., and the content that the second client has no rights to display may also include other types of display content, which is not limited in particular by the embodiments of the present application.

In some embodiments, the content that the second client does not have the right to display is set by the first client or the server.

In addition, the above method steps for eliminating the content that the second client has no authority to display may be executed by the first client or the second client, which is not limited in particular in the embodiment of the present application.

In step 204, after the remote control connection is established, the second client sends remote control information to the first client in response to the remote control operation, where the remote control information is used to control the first client to perform the target operation.

In some embodiments, after the remote control connection is established and the second client recognizes the remote control operation, the second client generates remote control information and sends the remote control information to the server; after receiving the remote control information from the second client, the server sends the remote control information to the first client. Optionally, the remote control information includes a control instruction that can be identified and responded by the first terminal where the first client is located. The first terminal can respond to the control instruction contained in the remote control information, namely, the terminal executes the target operation.

In some embodiments, the second client sends the remote control information to the server, which in turn sends the remote control information to the first client.

In some embodiments, after the server receives the remote control information sent by the second client, the method further includes the following steps: under the condition that the first client and the second client run in different operating systems, the server converts the remote control information to obtain converted remote control information; the converted remote control information is information which can be identified by an operating system operated by the first client; and the server sends the converted remote control information to the first client.

In some embodiments, the first client and the second client run in different operating systems, and due to the difference of the operating systems, after the first client receives part of the control information sent by the second client, the first terminal where the first client is located cannot identify or respond to the control information, so that the operation fails. In the above embodiment, the server may identify the operating systems to which the first client and the second client are respectively attached, and after identifying that the remote control information sent by the second client is information that cannot be responded by the operating system in which the first client is located, convert the remote control information into information that can be identified by the operating system operated by the first client, so as to obtain converted remote control information; after the server sends the converted remote control information to the first client, the first client can identify and respond to the remote control information, namely, the target operation corresponding to the remote control information is realized. Through the embodiment, the probability of remote operation of the second client (namely the main control party) in the remote control process caused by the difference of the operating systems is reduced, and the compatibility of the client of the target application program to different operating systems is improved; further, as the user corresponding to the second client (i.e. the main control party) does not need to adjust operation habits in order to adapt to different operation systems, the efficiency and convenience of remote control are further improved.

The method steps of converting the remote control information to obtain the converted remote control information may be executed by the first client or the second client, which is not limited in the embodiment of the present application.

After the remote control connection is established, the first client displays a prompt 18, as shown in fig. 4, for prompting the second client that the first client is being controlled.

In step 205, the first client performs a target operation corresponding to the remote control information.

In some embodiments, the first client receives the remote control information and controls the first terminal to perform the target operation according to the remote control information. For example, when the remote control operation corresponding to the remote control information is to double-click an icon of a folder, the first client controls the corresponding first screen to display the content contained in the folder, that is, controls the first terminal to open the folder. For another example, when the remote control operation corresponding to the remote control information is to move a cursor (such as a cursor controlled by a mouse) from the first display position to the second display position, the cursor in the first screen corresponding to the first client control is also moved from the first display position to the second display position.

In some embodiments, the method further comprises the steps of: the first client acquires operation authority information of the second client, wherein the authority information is used for indicating that the second client is authorized to perform remote control operation; under the condition that the target operation belongs to the operation that the second client is authorized to perform remote control, the first client executes the target operation corresponding to the remote control information; in the case where the target operation belongs to an operation for which the second client is not authorized to perform remote control, the first client does not perform the target operation corresponding to the remote control information.

In some embodiments, after the remote control connection is established between the first client and the second client, the second client only has the right to perform part of the operations with respect to the terminal in which the first client is located, and the second client cannot fully control the first terminal in which the first client is located.

In some embodiments, only a partial region in the first screen corresponding to the first client can be controlled by the second client. In some embodiments, the display area in the first screen corresponding to the first client includes a remote control area and a non-remote control area. The remote control area refers to an area allowing the second client to perform remote control, and the non-remote control area refers to an area not allowing the second client to perform remote control. That is, through a remote control operation performed by the second client with respect to the remote control area, the first client/first terminal may receive the corresponding remote control information and respond to the remote control information (i.e., perform the corresponding target operation); the first client/first terminal receives no corresponding remote control information or receives but does not respond to the remote control information through a remote control operation performed by the second client with respect to the non-remote control area.

In some embodiments, the first screen displays a remote control area and a non-remote control area, the first client only sends the screen content of the remote control area to the server, and then the server sends the screen content only including the remote control area to the second client; or the first client sends the screen contents of the remote control area and the non-remote control area to the server, and the server only sends the screen contents of the remote control area to the second client after removing the screen contents of the non-remote control area. Thus, the remote control area is displayed in the second screen corresponding to the second client, and the non-remote control area is not displayed.

In some embodiments, the first screen has a remote control area and a non-remote control area displayed therein, and the first client transmits screen contents of both the remote control area and the non-remote control area to the server, and the server transmits screen contents of both the remote control area and the non-remote control area to the second client. Thus, the remote control area and the non-remote control area are displayed in the second screen corresponding to the second client. But the non-remote control area can only be displayed in the second screen and the second client cannot control the non-remote control area.

In summary, in the technical solution provided in the embodiments of the present application, in a multi-person online conference, under the condition that one client opens a screen sharing function, the client may establish a remote control connection with another client that is in the multi-person online conference, so that the other client controls the client to execute a target operation, thereby implementing remote control between two clients/terminals through the multi-person online conference, without installing a client dedicated for remote control, and improving convenience of remote control.

As shown in fig. 5, in some embodiments, step 203 in the embodiment of fig. 2 described above further includes the following sub-steps (501-506):

in step 501, the first client sends a controlled request to the server in response to the controlled operation, where the controlled request is used to invite the second client to remotely control the first client.

In some embodiments, the first client is a controlled party, and actively invites another person (i.e., the second client) to remotely control the first client (i.e., control the terminal at which the first client is located).

In some embodiments, as shown in fig. 6, after the first client sends the controlled request to the server, the first client displays a prompt 19 for confirming that the controlled request is sent. In some embodiments, the prompt 19 includes a cancel control 20 and an invite control 21. The cancel control 20 is used to cancel the transmission of the controlled request, and the invite control 21 is used to confirm the transmission of the controlled request.

In some embodiments, after receiving the controlled request sent by the first client, the server further includes the following steps: the server detects whether the first client is authorized to establish remote control connection in the multi-person online conference; in the case that the first client has the right to establish a remote control connection in a multi-person online meeting, the server performs the step of sending a controlled confirmation request to the second client.

Wherein detecting whether the first client is authorized to establish a remote control connection in the multi-person online meeting comprises at least one of: detecting whether the first client has the authority of establishing the remote control connection or not, and detecting whether other remote control connections exist in the multi-person online conference or not.

In some embodiments, the server, after receiving the controlled request, needs to detect the sender of the controlled request (i.e., the first client).

In some embodiments, the target application allows only a portion of the clients to establish the remote control connection, i.e., only a portion of the clients have the right to establish the remote control connection. Optionally, the first client has a condition of permission to establish the remote control connection, including but not limited to at least one of: the user account logged in the first client is an account with remote authority, and the performance of the first terminal corresponding to the first client meets the requirement of remote operation. In some embodiments, if the security monitoring system in the server detects that the first client or the user account logged in to the first client has a risk of fraud or crime, the first client does not have the right to establish the remote control connection. In some embodiments, the requirement of participating in remote control (whether the controlled party or the master party) on the performance of the device is high, so for the terminal device with performance which cannot meet the requirement of remote control, even if an account number with remote authority logs in a client running in the terminal device, the client cannot establish remote control connection, i.e. the client does not have the authority of establishing remote control connection, thereby saving time wasted due to unsmooth remote control connection and improving the communication efficiency of the multi-person online conference.

In some embodiments, a multi-person online conference allows only one remote control connection to exist at the same time, and thus, the first client has no right to establish a remote control connection in the multi-person online conference if the multi-person online conference already has other remote control connections established.

In some embodiments, if the user account corresponding to the initiating client of the multi-person online conference is an account without remote authority, any remote control connection cannot be established in the multi-person online conference, so that the first client also has no right to establish remote control connection in the multi-person online conference.

Step 502, the server sends a controlled acknowledgement request to the second client based on the controlled request.

In some embodiments, the server generates a controlled acknowledgement request based on the controlled request sent by the first client and sends the controlled acknowledgement request to the second client. Wherein the controlled confirmation request is used for requesting the second client to confirm whether the controlled request is approved.

In step 503, the second client sends a controlled acknowledgement response to the server in response to the consent operation for the controlled acknowledgement request.

Wherein the controlled acknowledgement response is used to indicate that the second client agrees to the controlled acknowledgement request.

In some embodiments, as shown in fig. 7, after the second client receives the controlled confirmation request, the prompt message 22 corresponding to the controlled confirmation request is displayed; responding to the consent operation for the controlled confirmation request, such as clicking a first control 23 in prompt information 22 corresponding to the controlled confirmation request, to indicate that the second client agrees with the controlled confirmation request; and then the second client generates a controlled confirmation response according to the controlled confirmation request and sends the controlled confirmation response to the server.

The server sends a controlled response to the first client, step 504.

In some embodiments, the server generates a controlled response from the controlled acknowledgement response and sends the controlled response to the first client.

The controlled response comprises first check information, and the first check information is used for carrying out validity check on the first client.

In some embodiments, the first verification information is encrypted information generated using a first encryption algorithm based on the control identity information of the first client and the identity of the first client. The control identity information is used for indicating whether the client is a controller or a controlled; the identification of the client is uniquely determined according to the user account number in the client login and the terminal where the client is located.

In some embodiments, the server, after receiving the controlled response sent by the second client, detects whether the second client is entitled to establish a remote control connection in the multiplayer online conference. Wherein detecting whether the second client is authorized to establish a remote control connection in the multi-person online meeting comprises at least one of: detecting whether the second client has the authority of establishing the remote control connection or not, and detecting whether other remote control connections exist in the multi-person online conference or not. In the case where the second client has the right to establish a remote control connection in the multiplayer online conference, the step of sending a controlled response to the first client is performed.

The description of whether the second client is authorized to establish the remote control connection in the multi-person online conference can be referred to the upper explanation of whether the first client is authorized to establish the remote control connection in the multi-person online conference, which is not repeated here. In the case where the second client has the right to establish a remote control connection in the multiplayer online conference, the step of sending a controlled response to the first client is performed.

In step 505, the server sends second verification information to the second client.

The second verification information is used for verifying the validity of the second client.

In some embodiments, the second verification information is encrypted information generated using a second encryption algorithm based on the control identity information of the second client and the identity of the second client.

Alternatively, the first encryption algorithm and the second encryption algorithm may be the same or different.

Step 506, based on the first verification information and the second verification information, a remote control connection is established between the first client and the second client.

In some embodiments, after the server verifies that the first verification information and the second verification information pass, a remote control connection is established between the first client and the second client.

In the above embodiment, the slave (i.e., the first client) invites the master (i.e., the second client) to control the first client, and in this process, the server further confirms the remote control rights of the first client and the second client in the multi-person online conference, so as to confirm whether the remote control connection is allowed to be established, thereby improving the security of remote control.

As shown in fig. 8, in some embodiments, step 203 in the embodiment of fig. 2 described above further includes the following sub-steps (801-806):

in step 801, a second client sends a control request to a server in response to a control operation, where the control request is used to request remote control of a first client.

In some embodiments, the second client is a master, and actively requests remote control of the first client (i.e., requests remote control of the terminal in which the first client is located).

In some embodiments, after receiving the control request sent by the second client, the server further includes the following steps: the server detects whether the second client is authorized to establish remote control connection in the multi-person online conference; in case the second client is entitled to set up a remote control connection in a multi-person online conference, the server performs the step of sending a control confirmation request to the first client.

Wherein detecting whether the second client is authorized to establish a remote control connection in the multi-person online meeting comprises at least one of: detecting whether the second client has the authority of establishing the remote control connection or not, and detecting whether other remote control connections exist in the multi-person online conference or not.

For the reception of detecting whether the second client is authorized to establish a remote control connection in the multi-person online conference, reference may be made to the above-mentioned embodiment of fig. 5, which is not repeated here.

Step 802, the server sends a control confirmation request to the first client based on the control request.

In some embodiments, after receiving the control request sent by the second client, the server generates a control acknowledgement request according to the control request. Wherein the control confirmation request is used for requesting the first client to confirm whether to approve the control request.

In step 803, the first client sends a control confirmation response to the server in response to the consent operation for the control confirmation request.

Wherein the control acknowledge response is used to instruct the first client to agree to the control request.

In some embodiments, after receiving the control confirmation request, the first client displays a prompt message corresponding to the control confirmation request; responding to the consent operation aiming at the control confirmation request, such as clicking a second control in prompt information corresponding to the control confirmation request, and indicating that the first client agrees with the control confirmation request; and then the first client generates a control confirmation response according to the control confirmation request and sends the control confirmation response to the server.

Step 804, the server sends a control response to the second client, where the control response includes second verification information, and the second verification information is used to perform validity verification on the second client.

In some embodiments, the server generates a control response from the control acknowledge response and sends the control response to the first client.

In some embodiments, the server detects, after receiving the control confirmation response sent by the first client, whether the first client has authority to establish a remote control connection in the multi-person online conference. Wherein detecting whether the first client is authorized to establish a remote control connection in the multi-person online meeting comprises at least one of: detecting whether the first client has the authority of establishing the remote control connection or not, and detecting whether other remote control connections exist in the multi-person online conference or not. In the case that the first client has the right to establish a remote control connection in a multi-person online meeting, the step of sending a control response to the second client is performed.

In step 805, the server sends first verification information to the first client.

The first verification information is used for verifying the validity of the first client.

In some embodiments, the first verification information is encrypted information generated using a first encryption algorithm based on the control identity information of the first client and the identity of the first client.

Step 806, based on the first verification information and the second verification information, the first client and thus the second client establish a remote control connection therebetween.

In the above embodiment, the master (i.e., the second client) actively requests to the slave (i.e., the first client) to control the first client, and in this process, the server further confirms the remote control rights of the first client and the second client in the multi-person online conference, so as to confirm whether the remote control connection is allowed to be established, thereby improving the security of remote control.

As shown in fig. 9, in some embodiments, based on the first verification information and the second verification information, the first client and, thus, the second client establish a remote control connection therebetween, including the following steps:

in step 901, a first client sends a first connection establishment request to a server.

In some embodiments, the first connection establishment request is used for requesting to establish a remote control connection with the second client, where the first connection establishment request includes first check information, control identity information of the first client, and an identifier of the first client, and the control identity information is used for indicating whether the client is a controller or a controlled party.

In step 902, the server verifies the first verification information based on the control identity information of the first client and the identifier of the first client.

In some embodiments, the server generates third verification information by using a first encryption algorithm according to the control identity information of the first client and the identification of the first client, and compares the third verification information with the first verification information. If the third check information is the same as the first check information, the first connection establishment request is a legal request; if the third check information is different from the first check information, the first connection establishment request is an illegal request, and the remote control connection between the first client and the second client cannot be established.

In step 903, the second client sends a second connection establishment request to the server.

In some embodiments, the second connection establishment request is used for requesting to establish a remote control connection with the second client, where the second connection establishment request includes second verification information, control identity information of the second client, and an identifier of the second client, where the control identity information is used to indicate whether the client is a controlling party or a controlled party.

Step 904, the server verifies the second verification information based on the control identity information of the second client and the identifier of the second client.

In some embodiments, the server generates fourth verification information by using a second encryption algorithm according to the control identity information of the second client and the identifier of the second client, and compares the fourth verification information with the second verification information. If the fourth check information is the same as the second check information, the second connection establishment request is a legal request; if the fourth check information and the second check information are different, the second connection establishment request is an illegal request, and the remote control connection cannot be established between the first client and the second client.

In step 905, the server sends a first connection establishment response to the first client and sends a second connection establishment response to the second client, if both the first check information and the second check information pass the check.

In some embodiments, the first connection setup response and the second connection setup response are used to indicate that the remote control connection has been successfully established.

In the above embodiment, by checking the first check information sent by the first client and the second check information sent by the second client, it is confirmed whether the first connection establishment request and the second connection establishment request are legal requests or illegal requests, so that malicious requests for the server, such as malicious codes carried in the connection establishment request, and connection establishment requests (from the connection establishment request) from the same client or the same IP (Internet Protocol Address ) are prevented from being excessively high-frequency, thereby improving security of remote control.

In some embodiments, as shown in FIG. 10, a remote control system may also be implemented as system 100. The system 100 includes: a remote control media service (pere) 27, a protocol conversion service (XMPP, extensible Messaging and Presence Protocol) 28, a session control core service (center) 29, a message service (Kafka) 30, and a remote control session control service 31. Wherein the remote control media service 27 is used to support remote control between clients; the protocol conversion service 28 is used for performing signaling format conversion; the conference control core service 29 is used for supporting a conference control system; the message service 30 is used for distributing and pushing messages; the remote control session control service 31 is used to establish a remote control connection.

In some embodiments, as shown in fig. 11, the system 100 may further include: a security service (safe_server) 33, a meeting status query service (meeting_query) 34, and an identification service (id_server) 35. Wherein the security service 33 is used for security management; the conference state query service 34 is used for querying conference states; the identification service 35 is used to assign an ID to the remote control connection.

The following are examples of the apparatus of the present application that may be used to perform the method embodiments of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the method of the present application.

Referring to fig. 12, a block diagram of a remote control device according to an embodiment of the application is shown. The device has the function of realizing the remote control method example, and the function can be realized by hardware or can be realized by executing corresponding software by hardware. The apparatus 1200 may be the first terminal described above, or may be disposed on the first terminal. The apparatus 1200 may include:

a content sending module 1210, configured to send screen content to at least one other client participating in the multiplayer online conference when the first client starts a screen sharing function;

a connection establishment module 1220, configured to interactively establish a remote control connection with a second client, where the second client is a client participating in the multi-person online conference;

an information receiving module 1230, configured to receive remote control information from the second client after the remote control connection is established, where the remote control information is used to control the first client to perform a target operation;

an operation execution module 1240 for executing the target operation corresponding to the remote control information.

In an exemplary embodiment, the connection establishment module 1220 is configured to:

responding to a controlled operation, and sending a controlled request to a server, wherein the controlled request is used for inviting the second client to remotely control the first client;

receiving a controlled response sent by the server, wherein the controlled response is sent under the condition that the second client agrees to the controlled request, and the controlled response contains first check information, and the first check information is used for carrying out validity check on the first client;

and establishing the remote control connection between the first verification information and the second client.

receiving a control request sent by a server, wherein the control request is initiated by the second client and used for remotely controlling the first client;

in response to the consent operation for the control request, sending a control confirmation response to the server, wherein the control confirmation response is used for indicating the first client to consent the control request;

receiving first check information sent by the server, wherein the first check information is used for carrying out validity check on the first client;

a first connection establishment request is sent to the server, wherein the first connection establishment request is used for requesting to establish the remote control connection with the second client, the first connection establishment request comprises the first verification information, control identity information of the first client and an identifier of the first client, and the control identity information is used for indicating whether the client is a control party or a controlled party;

receiving a first connection establishment response sent by the server, wherein the first connection establishment response is used for indicating that the remote control connection is successfully established; the first connection establishment response is sent by the server under the condition that the first verification information is verified and passed based on the control identity information of the first client and the identifier of the first client.

In summary, in the technical solution provided in the embodiments of the present application, in a multi-person online conference, under the condition that one client opens a screen sharing function, the client may establish a remote control connection with another client that is in the multi-person online conference, so that the other client controls the client to execute a target operation, thereby implementing remote control between two clients/terminals through the multi-person online conference, without installing a software program dedicated for remote control, and improving convenience of remote control.

Referring to fig. 13, a block diagram of a remote control device according to another embodiment of the application is shown. The device has the function of realizing the remote control method example, and the function can be realized by hardware or can be realized by executing corresponding software by hardware. The apparatus 1300 may be the second terminal described above, or may be provided on the second terminal. The apparatus 1300 may include:

a content display module 1310, configured to display screen content provided by a first client when the first client participates in a multi-person online conference and the first client opens a screen sharing function; wherein the first client is a client participating in the multi-person online conference;

a connection establishment module 1320, configured to interactively establish a remote control connection with the first client;

and the information sending module 1330 is configured to send, in response to a remote control operation, remote control information to the first client after the remote control connection is established, where the remote control information is used to control the first client to perform a target operation.

In an exemplary embodiment, the connection establishment module 1320 is configured to:

receiving a controlled request sent by a server, wherein the controlled request is initiated by the first client and used for inviting the second client to remotely control the first client;

Responsive to an agreement operation for the controlled request, sending a controlled response to the server, the controlled response being for instructing the second client to agree to the controlled request;

receiving second verification information sent by the server, wherein the second verification information is used for verifying the validity of the second client;

the remote control connection is established between the first client and the second client based on the second verification information.

responding to control operation, and sending a control request to a server, wherein the control request is used for requesting to remotely control the first client;

receiving a control response sent by the server, wherein the control response is sent under the condition that the first client agrees with the control request, and the control response contains second check information, and the second check information is used for carrying out validity check on the second client;

a second connection establishment request is sent to the server, wherein the second connection establishment request is used for requesting to establish the remote control connection with the second client, the second connection establishment request comprises second verification information, control identity information of the second client and identification of the second client, and the control identity information is used for indicating whether the client is a control party or a controlled party;

Receiving a second connection establishment response sent by the server, wherein the second connection establishment response is used for indicating that the remote control connection is successfully established; the second connection establishment response is sent by the server under the condition that the second verification information passes verification based on the control identity information of the second client and the identifier of the second client.

Referring to fig. 14, a block diagram of a remote control device according to another embodiment of the application is shown. The device has the function of realizing the remote control method example, and the function can be realized by hardware or can be realized by executing corresponding software by hardware. The apparatus 1400 may be a server as described above, or may be provided on a server. The apparatus 1400 may include:

A content sending module 1410, configured to send, during a multi-person online conference, screen content of a first client participating in the multi-person online conference to at least one other client participating in the multi-person online conference;

a connection establishment module 1420 configured to establish a remote control connection between the first client and the second client;

an information receiving module 1430 for receiving remote control information from the second client after the remote control connection is established, the remote control information being for controlling the first client to perform a target operation;

an information sending module 1440, configured to send the remote control information to the first client.

In an exemplary embodiment, the connection establishment module 1420 is configured to:

receiving a controlled request sent by the first client, wherein the controlled request is used for inviting the second client to remotely control the first client;

based on the controlled request, sending a controlled confirmation request to the second client, wherein the controlled confirmation request is used for requesting the second client to confirm whether to approve the controlled request;

receiving a controlled confirmation response sent by the second client, wherein the controlled confirmation response is used for indicating the second client to agree with the controlled request;

A controlled response is sent to the first client, wherein the controlled response comprises first check information, and the first check information is used for carrying out validity check on the first client;

and sending second verification information to the second client, wherein the second verification information is used for carrying out validity verification on the second client.

receiving a control request sent by the second client, wherein the control request is used for requesting to remotely control the first client;

based on the control request, sending a control confirmation request to the first client, wherein the control confirmation request is used for requesting the first client to confirm whether to approve the control request;

receiving a control confirmation response sent by the first client, wherein the control confirmation response is used for indicating the first client to agree with the control request;

sending a control response to the second client, wherein the control response comprises second verification information, and the second verification information is used for verifying the validity of the second client;

and sending first check information to the first client, wherein the first check information is used for carrying out validity check on the first client.

In an exemplary embodiment, the apparatus 1400 is further configured to:

receiving a first connection establishment request sent by the first client, wherein the first connection establishment request is used for requesting to establish the remote control connection with the second client, the first connection establishment request comprises the first verification information, control identity information of the first client and an identifier of the first client, and the control identity information is used for indicating whether the client is a control party or a controlled party;

verifying the first verification information based on the control identity information of the first client and the identification of the first client;

receiving a second connection establishment request sent by the second client, wherein the second connection establishment request is used for requesting to establish the remote control connection with the second client, and the second connection establishment request comprises the second verification information, the control identity information of the second client and the identifier of the second client;

verifying the second verification information based on the control identity information of the second client and the identifier of the second client;

and under the condition that the first verification information and the second verification information pass verification, sending a first connection establishment response to the first client and sending a second connection establishment response to the second client, wherein the first connection establishment response and the second connection establishment response are used for indicating that the remote control connection is successfully established.

In an exemplary embodiment, the connection establishment module 1420 is further configured to:

detecting whether the first client is authorized to establish the remote control connection in the multi-person online conference according to the controlled request;

wherein said detecting whether said first client is entitled to establish said remote control connection in said multi-person online meeting comprises at least one of: detecting whether the first client has the authority of establishing remote control connection or not, and detecting whether remote control connection exists in the multi-person online conference or not;

sending the controlled request to the second client under the condition that the first client is authorized to establish the remote control connection in the multi-person online conference;

detecting whether the second client is authorized to establish the remote control connection in the multi-person online conference according to the control response;

wherein detecting whether the second client is authorized to establish the remote control connection in the multiplayer online conference comprises at least one of: detecting whether the second client has the authority of establishing remote control connection or not, and detecting whether remote control connection exists in the multi-person online conference or not.

detecting whether the second client is authorized to establish the remote control connection in the multi-person online conference according to the control request;

wherein detecting whether the second client is authorized to establish the remote control connection in the multiplayer online conference comprises at least one of: detecting whether the second client has the authority of establishing remote control connection or not, and detecting whether remote control connection exists in the multi-person online conference or not;

sending the control request to the first client if the second client is authorized to establish the remote control connection in the multi-person online conference;

detecting whether the first client is authorized to establish the authority of the remote control connection in the multi-person online conference according to the control confirmation response;

wherein said detecting whether said first client is entitled to establish said remote control connection in said multi-person online meeting comprises at least one of: detecting whether the first client has the authority of establishing remote control connection or not, and detecting whether remote control connection exists in the multi-person online conference or not.

In an exemplary embodiment, the apparatus 1400 is further configured to:

receiving screen content from the first client;

according to the display authority information of the second client, eliminating the content which is not authorized to be displayed by the second client in the screen content to obtain the processed screen content; the display permission information is used for indicating the content which is authorized or not authorized to be displayed by the second client;

and sending the processed screen content to the second client.

In an exemplary embodiment, the apparatus 1400 is further configured to:

under the condition that the first client and the second client run in different operating systems, converting the remote control information to obtain converted remote control information; the converted remote control information is information which can be identified by an operating system operated by the first client.

The information sending module 1440 is configured to:

and sending the converted remote control information to the first client.

It should be noted that, in the apparatus provided in the foregoing embodiment, when implementing the functions thereof, only the division of the foregoing functional modules is used as an example, in practical application, the foregoing functional allocation may be implemented by different functional modules, that is, the internal structure of the device is divided into different functional modules, so as to implement all or part of the functions described above. In addition, the apparatus and the method embodiments provided in the foregoing embodiments belong to the same concept, and specific implementation processes of the apparatus and the method embodiments are detailed in the method embodiments and are not repeated herein.

Referring to fig. 15, a block diagram of a terminal 1500 according to an embodiment of the present application is shown. The terminal 1500 may be an electronic device such as a cell phone, tablet computer, game console, electronic book reader, multimedia playing device, wearable device, PC, etc. The terminal 1500 is configured to implement the above-described remote control method on the first client side or the remote control method on the second client side. The terminal may be the first terminal 11 or the second terminal 12 in the implementation environment shown in fig. 1. Specifically, the present application relates to a method for manufacturing a semiconductor device.

In general, the terminal 1500 includes: a processor 1501 and a memory 1502.

The processor 1501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1501 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 1501 may also include a main processor, which is a processor for processing data in an awake state, also called a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1501 may be integrated with a GPU (Graphics Processing Unit, image processor) for rendering and rendering of content required to be displayed by the display screen. In some embodiments, the processor 1501 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.

Memory 1502 may include one or more computer-readable storage media, which may be non-transitory. Memory 1502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1502 is used to store at least one instruction, at least one piece of program, set of codes, or set of instructions, and is configured to be executed by one or more processors to implement the first client-side remote control method or the second client-side remote control method described above.

In some embodiments, the terminal 1500 may further optionally include: a peripheral interface 1503 and at least one peripheral device. The processor 1501, memory 1502 and peripheral interface 1503 may be connected by a bus or signal lines. The individual peripheral devices may be connected to the peripheral device interface 1503 via a bus, signal lines, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1504, a display 1505, audio circuitry 1507, and a power supply 1509.

Those skilled in the art will appreciate that the structure shown in fig. 15 is not limiting and that more or fewer components than shown may be included or certain components may be combined or a different arrangement of components may be employed.

Referring to fig. 16, a block diagram of a server according to an embodiment of the present application is shown. The server is used for implementing the server-side remote control method provided in the above embodiment. Specifically, the present application relates to a method for manufacturing a semiconductor device.

The server 1600 includes a CPU (Central Processing Unit ) 1601, a system Memory 1604 including a RAM (Random Access Memory ) 1602 and a ROM (Read-Only Memory) 1603, and a system bus 1605 connecting the system Memory 1604 and the central processing unit 1601. The server 1600 also includes a basic I/O (Input/Output) system 1606 to facilitate the transfer of information between the various devices within the computer, and a mass storage device 1607 for storing an operating system 1613, application programs 1614, and other program modules 1615.

The basic input/output system 1606 includes a display 1608 for displaying information and an input device 1609, such as a mouse, keyboard, etc., for user input of information. Wherein the display 1608 and the input device 1609 are both coupled to the central processing unit 1601 by way of an input output controller 1610 coupled to the system bus 1605. The basic input/output system 1606 may also include an input/output controller 1610 for receiving and processing input from a keyboard, mouse, or electronic stylus, among a plurality of other devices. Similarly, the input-output controller 1610 also provides output to a display screen, printer, or other type of output device.

The mass storage device 1607 is connected to the central processing unit 1601 by a mass storage controller (not shown) connected to the system bus 1605. The mass storage device 1607 and its associated computer-readable media provide non-volatile storage for the server 1600. That is, the mass storage device 1607 may include a computer readable medium (not shown) such as a hard disk or CD-ROM (Compact Disc Read-Only Memory) drive.

The computer readable medium may include computer storage media and communication media without loss of generality. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory, erasable programmable read-only memory), flash memory or other solid state memory, CD-ROM, DVD (Digital Video Disc, high density digital video disc) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will recognize that the computer storage medium is not limited to the one described above. The system memory 1604 and mass storage 1607 described above may be collectively referred to as memory.

The server 1600 may also operate through a network, such as the internet, connected to remote computers on the network, in accordance with various embodiments of the present application. That is, the server 1600 may be connected to the network 1612 through a network interface unit 1611 coupled to the system bus 1605, or the network interface unit 1611 may be used to connect to other types of networks or remote computer systems (not shown).

In an exemplary embodiment, a computer readable storage medium is also provided, in which at least one instruction, at least one program, a set of codes or a set of instructions is stored, which when executed by a processor, implement the above-mentioned remote control method on the first client side.

Alternatively, the computer-readable storage medium may include: ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives, solid State disk), optical disk, or the like. The random access memory may include ReRAM (Resistance Random Access Memory, resistive random access memory) and DRAM (Dynamic Random Access Memory ), among others.

In an exemplary embodiment, a computer readable storage medium is also provided, in which at least one instruction, at least one program, a set of codes or a set of instructions is stored, which when executed by a processor, implement the above-mentioned second client-side remote control method.

In an exemplary embodiment, a computer readable storage medium is also provided, in which at least one instruction, at least one program, a set of codes or a set of instructions is stored, which when executed by a processor, implement the above-mentioned server-side remote control method.

In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the remote control method on the first client side described above.

In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the remote control method on the second client side described above.

In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions so that the computer device performs the above-described server-side remote control method.

It will be appreciated that in the specific embodiments of the present application, related data such as user information is involved, and when the above embodiments of the present application are applied to specific products or technologies, user permissions or agreements need to be obtained, and the collection, use and processing of related data need to comply with related laws and regulations and standards of related countries and maps.

It should be understood that references herein to "a plurality" are to two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.

The foregoing description of the exemplary embodiments of the application is not intended to limit the application to the particular embodiments disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the application.

Claims

1. A method of remote control, the method performed by a first client, the method comprising:

2. The method of claim 1, wherein the interacting with the second client to establish the remote control connection comprises:

3. The method of claim 1, wherein the interacting with the second client to establish the remote control connection comprises:

4. A method according to claim 2 or 3, wherein said establishing said remote control connection between said second client and said first verification information comprises:

5. The method of claim 1, wherein after receiving the remote control information from the second client, further comprising:

acquiring operation authority information of the second client, wherein the authority information is used for indicating that the second client is authorized to perform remote control operation;

executing the target operation corresponding to the remote control information under the condition that the target operation belongs to the operation that the second client is authorized to perform remote control;

and if the target operation belongs to an operation that the second client does not have the right to perform remote control, not executing the target operation corresponding to the remote control information.

6. A method of remote control, the method performed by a second client, the method comprising:

7. The method of claim 6, wherein the interacting with the first client to establish a remote control connection comprises:

8. The method of claim 6, wherein the interacting with the first client to establish a remote control connection comprises:

9. The method according to claim 7 or 8, wherein said establishing the remote control connection with the first client based on the second verification information comprises:

10. A remote control method, the method being performed by a server, the method comprising:

and sending the remote control information to the first client.

11. The method of claim 10, wherein the establishing a remote control connection between the first client and a second client comprises:

12. The method of claim 10, wherein the establishing a remote control connection between the first client and a second client comprises:

13. The method according to claim 11 or 12, characterized in that the method further comprises:

14. The method of claim 11, wherein after receiving the controlled request sent by the first client, further comprising:

detecting whether the first client is authorized to establish the remote control connection in the multi-person online conference; wherein said detecting whether said first client is entitled to establish said remote control connection in said multi-person online meeting comprises at least one of: detecting whether the first client has the authority to establish the remote control connection or not, and detecting whether other remote control connections exist in the multi-person online conference or not;

executing the step of sending a controlled confirmation request to the second client under the condition that the first client is authorized to establish the remote control connection in the multi-person online conference;

After receiving the controlled confirmation response sent by the second client, the method further comprises the following steps:

detecting whether the second client is authorized to establish the remote control connection in the multi-person online conference; wherein detecting whether the second client is authorized to establish the remote control connection in the multiplayer online conference comprises at least one of: detecting whether the second client has the authority to establish the remote control connection or not, and detecting whether other remote control connections exist in the multi-person online conference or not;

and executing the step of sending a controlled response to the first client in the case that the second client has the right to establish the remote control connection in the multi-person online conference.

15. The method of claim 12, wherein after receiving the control request sent by the second client, further comprising:

Executing the step of sending a control confirmation request to the first client in case the second client is authorized to establish the remote control connection in the multi-person online conference;

after receiving the control confirmation response sent by the first client, the method further comprises the following steps:

the step of sending a control response to the second client is performed in case the first client has the right to establish the remote control connection in the multiplayer online conference.

16. The method of claim 10, wherein after the establishing the remote control connection between the first client and the second client, further comprising:

receiving screen content from the first client;

and sending the processed screen content to the second client.

17. The method of claim 10, wherein after receiving the remote control information from the second client, further comprising:

under the condition that the first client and the second client run in different operating systems, converting the remote control information to obtain converted remote control information; the converted remote control information is information which can be identified by an operating system operated by the first client;

the sending the remote control information to the first client includes:

and sending the converted remote control information to the first client.

18. A computer device comprising a processor and a memory having stored therein at least one instruction, at least one program, code set or instruction set, the at least one instruction, at least one program, code set or instruction set being loaded and executed by the processor to implement the remote control method of any of claims 1 to 17.

19. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, the at least one instruction, the at least one program, the set of codes, or the set of instructions being loaded and executed by a processor to implement the remote control method of any one of claims 1 to 17.

20. A computer program product or computer program, characterized in that it comprises computer instructions stored in a computer-readable storage medium, from which a processor reads and executes the computer instructions to implement the remote control method according to any one of claims 1 to 17.