WO2022116033A1

WO2022116033A1 - Collaborative operation method and apparatus, and terminal and storage medium

Info

Publication number: WO2022116033A1
Application number: PCT/CN2020/133288
Authority: WO
Inventors: 吴卓恒; 孙晓飞
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2020-12-02
Filing date: 2020-12-02
Publication date: 2022-06-09
Also published as: CN114930279A

Abstract

Provided are a collaborative operation method and apparatus, and a terminal and a storage medium. The method comprises: displaying a first collaborative interface that includes first data of each remote terminal and second data of a local terminal; adding the local terminal to a first group, and converting the first collaborative interface into a third collaborative interface, wherein the third collaborative interface is a collaborative interface corresponding to the first group; displaying a first whiteboard interface in the third collaborative interface; displaying a first writing trajectory in the first whiteboard interface; sending the first writing trajectory to the remote terminal in the first group, such that the remote terminal displays the first writing trajectory in a second whiteboard interface thereof; receiving a second writing trajectory sent by the remote terminal in the first group; and displaying the second writing trajectory in the first whiteboard interface. By using the method, the technical problem in some techniques whereby in a network conference scenario, the process of sharing written content is complex and the written content can only be shared by all participants can be solved.

Description

协同操作方法、装置、终端及存储介质Collaborative operation method, device, terminal and storage medium

技术领域technical field

本申请实施例涉及网络会议技术领域，尤其涉及一种协同操作方法、装置、终端及存储介质。The embodiments of the present application relate to the technical field of network conferences, and in particular, to a collaborative operation method, device, terminal, and storage medium.

背景技术Background technique

网络会议，是指位于两个或多个地点的人们，通过通信设备和网络，实现交谈的会议。随着互联网技术的发展，视频会议已经成为一种常见的网络会议方式。现有的视频会议场景下，与会者可以共享自身的视频画面，还可以共享自身的桌面画面。发明人在实现本申请的过程中，发现一些技术存在如下缺陷：当与会者需要书写内容并共享时，需要先将视频会议的界面切换至后台运行，并在桌面中开启相关书写应用程序进行书写，书写完成后再前台运行视频会议的界面并共享自身的桌面画面，以实现共享桌面画面中书写应用程序的书写内容，这样大大增加了共享书写内容的复杂度、降低了视频会议的会议效率。并且，在共享过程中，有些与会者不需要接收共享的书写内容，但是，一些技术中只能将书写内容共享给视频会议中的全部与会者，此时，不接收共享书写内容的与会者需要离开视频会议或者重新创建不包含前述与会者的视频会议，这样使得与会者的会议体验非常差。A web conference is a conference in which people at two or more locations communicate through communication devices and networks. With the development of Internet technology, video conferencing has become a common way of network conferencing. In an existing video conference scenario, participants can share their own video images and also share their own desktop images. In the process of realizing this application, the inventor found that some technologies have the following defects: when a participant needs to write and share the content, it is necessary to switch the interface of the video conference to run in the background, and open the relevant writing application on the desktop to write. After writing, run the interface of the video conference in the foreground and share its own desktop screen, so as to share the writing content of the writing application on the desktop screen, which greatly increases the complexity of sharing the writing content and reduces the meeting efficiency of the video conference. In addition, during the sharing process, some participants do not need to receive the shared writing content. However, in some technologies, the writing content can only be shared with all participants in the video conference. At this time, the participants who do not receive the shared writing content need to Leaving a video conference or re-creating a video conference without the aforementioned participants makes the conference experience for the participants very poor.

综上，如何在网络会议场景下，使共享书写内容的过程更加简单且可以只对部分与会者进行书写内容的共享，成为了亟需解决的技术问题。To sum up, how to make the process of sharing written content simpler and only share the written content with some participants in a network conference scenario has become a technical problem that needs to be solved urgently.

发明内容SUMMARY OF THE INVENTION

本申请实施例提供了一种协同操作方法、装置、终端及存储介质，以解决一些技术中网络会议场景下共享书写内容过程复杂且只能面向全部与会者进行共享的技术问题。Embodiments of the present application provide a collaborative operation method, device, terminal, and storage medium, to solve the technical problem that in some technologies, the process of sharing written content in a network conference scenario is complicated and can only be shared for all participants.

第一方面，本申请实施例提供了一种协同操作方法，包括：In a first aspect, an embodiment of the present application provides a collaborative operation method, including:

显示第一协同界面，所述第一协同界面中显示有参与协同的每个异地终端的第一数据和本地终端的第二数据，每个所述异地终端中显示有第二协同界面，所述第一数据和所述第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种；A first collaboration interface is displayed, the first data of each remote terminal participating in the collaboration and the second data of the local terminal are displayed, and each of the remote terminals is displayed with a second collaboration interface, the Both the first data and the second data include at least one of video picture data, audio data and identification data;

接收第一分组指令，所述第一分组指令用于指示本地终端加入第一小组；所述第一小组包括所述本地终端以及至少一个所述异地终端；receiving a first grouping instruction, where the first grouping instruction is used to instruct a local terminal to join a first group; the first group includes the local terminal and at least one of the remote terminals;

响应于所述第一分组指令，将所述第一协同界面变换为第三协同界面，所述第三协同界面中显示有所述第二数据、共享白板控件、所述第一小组内每个异地终端的第一数据，所述第一小组内的每个所述异地终端将所述第二协同界面变换为第四协同界面；In response to the first grouping instruction, the first collaboration interface is transformed into a third collaboration interface, and the third collaboration interface displays the second data, the shared whiteboard control, and each of the first group. The first data of the remote terminal, each of the remote terminals in the first group transforms the second collaboration interface into a fourth collaboration interface;

接收作用于所述共享白板控件的第一控制操作；receiving a first control operation acting on the shared whiteboard control;

响应于所述第一控制操作，在所述第三协同界面中显示第一白板界面，并指示所述第一小组内的异地终端在所述第四协同界面中显示第二白板界面；In response to the first control operation, displaying a first whiteboard interface in the third collaboration interface, and instructing remote terminals in the first group to display a second whiteboard interface in the fourth collaboration interface;

接收作用于所述第一白板界面的第二控制操作；receiving a second control operation acting on the first whiteboard interface;

响应于所述第二控制操作，在所述第一白板界面中显示对应的第一书写轨迹；In response to the second control operation, displaying a corresponding first writing track in the first whiteboard interface;

将所述第一书写轨迹发送至所述第一小组内的异地终端，以使所述异地终端在所述第二白板界面中显示所述第一书写轨迹；sending the first writing track to the remote terminal in the first group, so that the remote terminal displays the first writing track in the second whiteboard interface;

接收所述第一小组内的异地终端发送的第二书写轨迹，所述第二书写轨迹显示在所述异地终端对应的第二白板界面中；receiving a second writing track sent by a remote terminal in the first group, where the second writing track is displayed on a second whiteboard interface corresponding to the remote terminal;

在所述第一白板界面中显示所述第二书写轨迹。The second writing track is displayed in the first whiteboard interface.

第二方面，本申请实施例还提供了一种协同操作装置，包括：In a second aspect, an embodiment of the present application also provides a collaborative operation device, including:

第一显示模块，用于显示第一协同界面，所述第一协同界面中显示有参与协同的每个异地终端的第一数据和本地终端的第二数据，每个所述异地终端中显示有第二协同界面，所述第一数据和所述第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种；The first display module is used to display a first collaboration interface, in which the first data of each remote terminal participating in the collaboration and the second data of the local terminal are displayed, and each of the remote terminals is displayed with a second collaboration interface, wherein both the first data and the second data include at least one of video picture data, audio data, and identification data;

第一接收模块，用于接收第一分组指令，所述第一分组指令用于指示本地终端加入第一小组，所述第一小组包括所述本地终端以及至少一个所述异地终端；a first receiving module, configured to receive a first grouping instruction, where the first grouping instruction is used to instruct a local terminal to join a first group, where the first group includes the local terminal and at least one of the remote terminals;

第二显示模块，用于响应于所述第一分组指令，将所述第一协同界面变换为第三协同界面，所述第三协同界面中显示有所述第二数据、共享白板控件、所述第一小组内每个异地终端的第一数据，所述第一小组内的每个所述异地终端将所述第二协同界面变换为第四协同界面；A second display module, configured to transform the first collaboration interface into a third collaboration interface in response to the first grouping instruction, where the third collaboration interface displays the second data, shared whiteboard controls, all first data of each remote terminal in the first group, and each remote terminal in the first group converts the second collaboration interface into a fourth collaboration interface;

第二接收模块，用于接收作用于所述共享白板控件的第一控制操作；a second receiving module, configured to receive a first control operation acting on the shared whiteboard control;

第三显示模块，用于响应于所述第一控制操作，在所述第三协同界面中显示第一白板界面，并指示所述第一小组内的异地终端在所述第四协同界面中显示第二白板界面；A third display module, configured to display the first whiteboard interface in the third collaboration interface in response to the first control operation, and instruct the remote terminals in the first group to display it in the fourth collaboration interface The second whiteboard interface;

第三接收模块，用于接收作用于所述第一白板界面的第二控制操作；a third receiving module, configured to receive a second control operation acting on the first whiteboard interface;

第四显示模块，用于响应于所述第二控制操作，在所述第一白板界面中显示对应的第一书写轨迹；a fourth display module, configured to display a corresponding first writing track in the first whiteboard interface in response to the second control operation;

第一共享模块，用于将所述第一书写轨迹发送至所述第一小组内的异地终端，以使所述异地终端在所述第二白板界面中显示所述第一书写轨迹；a first sharing module, configured to send the first writing track to a remote terminal in the first group, so that the remote terminal displays the first writing track in the second whiteboard interface;

第四接收模块，用于接收所述第一小组内的异地终端发送的第二书写轨迹，所述第二书写轨迹显示在所述异地终端对应的第二白板界面中；a fourth receiving module, configured to receive a second writing track sent by a remote terminal in the first group, where the second writing track is displayed on a second whiteboard interface corresponding to the remote terminal;

第五显示模块，用于在所述第一白板界面中显示所述第二书写轨迹。A fifth display module, configured to display the second writing track in the first whiteboard interface.

第三方面，本申请实施例还提供了一种协同操作终端，包括：In a third aspect, an embodiment of the present application further provides a collaborative operation terminal, including:

显示屏，用于显示第一协同界面；a display screen for displaying the first collaboration interface;

一个或多个处理器；one or more processors;

存储器，用于存储一个或多个程序；memory for storing one or more programs;

当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如第一方面所述的协同操作方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the cooperative operation method described in the first aspect.

第四方面，本申请实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如第一方面所述的协同操作方法。In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the cooperative operation method described in the first aspect.

上述协同操作方法、装置、终端及存储介质，通过显示包含每个异地终端第一数据和本地终端第二数据的第一协同界面，之后，根据接收的第一分组指令将本地终端加入第一小组，并将第一协同界面变化为第三协同界面，同时，将第一小组内异地终端的第二协同界面变化为第四协同界面，其中，第三协同界面中显示有共享白板控件，当接收到作用于共享白板控件的第一控制操作时，在第三协同界面中显示第一白板界面，并指示第一小组内的异地终端在第四协同界面中显示第二白板界面，之后，根据作用于第一白板界面的第二控制操作，在第一白板界面中显示对应的第一书写轨迹，并将第一书写轨迹发送至第一小组内的异地终端，以使异地终端在第二白板界面中实时显示第一书写轨迹，同时，接收第一小组内的异地终端发送的第二书写轨迹并在本地第一白板界面中显示第二书写轨迹的技术手段，可以解决一些技术中网络会议场景下共享书写内容过程复杂且只能面向全部与会者进行共享的技术问题。通过将本地终端加入第一小组，可实现协同过程中的小组讨论，扩大了协同操作的适用场景，如在会议、教会、比赛等需要小组讨论的场景下均可使用。通过在第三协同界面中显示启动共享白板功能的控件，并通过调用电子白板应用程序的方式实现在第三协同界面中快速启动电子白板功能，且通过与第一小组内异地终端进行数据通信方式，实现仅在小组内的共享白板功能，无需退出第三协同界面，简化了启动流程，保证了协同效率，提高了参与协同人员的使用体验。并且，当启动第一白板界面和第二白板界面后，除了共享本地的第一书写轨迹外，还可以共享第一小组内异地终端的第二书写轨迹，即实现协同过程中小组内的书写轨迹共享，进一步丰富了共享白板功能，简化了共享白板流程，提高了协同体验。The above-mentioned collaborative operation method, device, terminal and storage medium, by displaying the first collaborative interface including the first data of each remote terminal and the second data of the local terminal, and then adding the local terminal to the first group according to the received first grouping instruction , and change the first collaboration interface to a third collaboration interface, and at the same time, change the second collaboration interface of the remote terminal in the first group to a fourth collaboration interface, wherein the third collaboration interface displays a shared whiteboard control. At the time of the first control operation acting on the shared whiteboard control, the first whiteboard interface is displayed in the third collaboration interface, and the remote terminals in the first group are instructed to display the second whiteboard interface in the fourth collaboration interface, and then, according to the function In the second control operation on the first whiteboard interface, the corresponding first writing track is displayed on the first whiteboard interface, and the first writing track is sent to the remote terminals in the first group, so that the remote terminals can be displayed on the second whiteboard interface. The technical means of displaying the first writing track in real time in the first group, and at the same time, receiving the second writing track sent by the remote terminal in the first group and displaying the second writing track on the local first whiteboard interface can solve some technical problems in the network conference scenario. The technical problem of sharing written content is complex and can only be shared with all participants. By adding the local terminal to the first group, group discussions in the collaborative process can be realized, which expands the applicable scenarios of collaborative operations, such as conferences, churches, competitions and other scenarios that require group discussions. By displaying the controls for starting the shared whiteboard function in the third collaborative interface, and by calling the electronic whiteboard application program, the electronic whiteboard function can be quickly started in the third collaborative interface, and by means of data communication with remote terminals in the first group , to realize the shared whiteboard function only within the group, without exiting the third collaboration interface, simplifying the start-up process, ensuring collaboration efficiency, and improving the use experience of participants in collaboration. Moreover, when the first whiteboard interface and the second whiteboard interface are activated, in addition to sharing the local first writing track, the second writing track of the remote terminal in the first group can also be shared, that is, to realize the writing track within the group during the collaboration process. Sharing further enriches the shared whiteboard function, simplifies the shared whiteboard process, and improves the collaborative experience.

附图说明Description of drawings

图1为本申请一个实施例提供的一种协同操作方法的流程图；FIG. 1 is a flowchart of a collaborative operation method provided by an embodiment of the present application;

图2为本申请另一个实施例提供的一种协同操作方法的流程图；2 is a flowchart of a collaborative operation method provided by another embodiment of the present application;

图3为本申请实施例提供的一种协同界面示意图；3 is a schematic diagram of a collaboration interface provided by an embodiment of the present application;

图4为本申请实施例提供的另一种协同界面示意图；4 is a schematic diagram of another collaboration interface provided by an embodiment of the present application;

图5为本申请实施例提供的又一种协同界面示意图；5 is another schematic diagram of a collaboration interface provided by an embodiment of the present application;

图6为本申请又一个实施例提供的一种协同操作方法的流程图；FIG. 6 is a flowchart of a collaborative operation method provided by another embodiment of the present application;

图7为本申请实施例提供的再一种协同界面示意图；7 is a schematic diagram of yet another collaboration interface provided by an embodiment of the present application;

图8为本申请一个实施例提供的一种协同操作装置的结构示意图；FIG. 8 is a schematic structural diagram of a collaborative operation device provided by an embodiment of the present application;

图9为本申请一个实施例提供的一种协同操作终端的结构示意图。FIG. 9 is a schematic structural diagram of a collaborative operation terminal according to an embodiment of the present application.

具体实施方式Detailed ways

下面结合附图和实施例对本申请作详细说明。可以理解的是，此处所描述的具体实施例用于解释本申请，而非对本申请的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本申请相关的部分而非全部结构。The present application will be described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all the structures related to the present application.

需要说明的是，在本文中，诸如第一和第二之类的关系术语仅仅用来将一个实体或操作或对象与另一个实体或操作或对象区分开来，而不一定要求或者暗示这些实体或操作或对象之前存在任何这种实际的关系或顺序。例如，第一控制操作和第二控制操作的“第一”和“第二”用来区分两个不同的控制操作。It should be noted that, in this document, relational terms such as first and second are only used to distinguish one entity or operation or object from another entity or operation or object, and do not necessarily require or imply these entities Or any such actual relationship or order exists before the operation or object. For example, "first" and "second" of the first control operation and the second control operation are used to distinguish two different control operations.

本申请实施例中提供的协同操作方法可以由协同操作终端执行，该协同操作终端可以通过软件和/或硬件的方式实现，该协同操作终端可以是两个或多个物理实体构成，也可以是一个物理实体构成。协同操作终端可以是台式机、手机、笔记本、平板电脑或交互智能平板等终端。The cooperative operation method provided in the embodiment of the present application may be performed by a cooperative operation terminal, and the cooperative operation terminal may be implemented by means of software and/or hardware. The cooperative operation terminal may be composed of two or more physical entities, or may be A physical entity constitutes. The collaborative operation terminal may be a terminal such as a desktop computer, a mobile phone, a notebook, a tablet computer or an interactive smart tablet.

为了便于理解，实施例中以交互智能平板为协同操作终端进行示例性描述。其中，交互智能平板可以是通过触控技术对显示在显示平板上的内容进行操控和实现人机交互操作的一体化设备，其集成了投影机、电子白板、幕布、音响、电视机以及视频会议终端等一种或多种功能。For ease of understanding, in the embodiments, an interactive smart tablet is used as a collaborative operation terminal for exemplary description. Among them, the interactive smart panel can be an integrated device that controls the content displayed on the display panel and realizes human-computer interaction through touch technology. One or more functions such as terminal.

一般而言，交互智能平板包括至少一块显示屏。可以理解，交互智能平板配置的显示屏指具有触控功能的触摸屏、触控屏、触控面板，是一种感应式液晶显示装置。按照触摸的工作原理和传输信息的介质，可以把触摸方式分为四类：电阻式、电容感应式、电磁感应式以及红外感应式。当用户使用手指或触控笔触摸显示屏时，检测对应触控位置的电器元件所采集的参数会发生变化，交互智能平板根据参数变化情况生成操作数据，并处理该操作数据，以实现对触摸操作的响应。实施例中，显示屏可以集成单一或组合触摸方式，其中，组合触摸方式是指包含至少两种触摸方式，例如，显示屏采用红外感应式+电磁感应式、电磁感应式和电容感应式等组合方式。Generally speaking, an interactive smart tablet includes at least one display screen. It can be understood that the display screen configured by the interactive smart tablet refers to a touch screen, a touch screen, and a touch panel with a touch function, and is an inductive liquid crystal display device. According to the working principle of touch and the medium for transmitting information, touch methods can be divided into four categories: resistive, capacitive, electromagnetic and infrared. When the user touches the display screen with a finger or a stylus, the parameters collected by the electrical components that detect the corresponding touch position will change. The interactive smart tablet generates operation data according to the parameter changes, and processes the operation data to realize the touch control. The response of the operation. In the embodiment, the display screen may integrate a single or combined touch mode, wherein the combined touch mode refers to including at least two touch modes, for example, the display screen adopts a combination of infrared induction type + electromagnetic induction type, electromagnetic induction type and capacitive induction type, etc. Way.

在一实施例中，交互智能平板安装有至少一类操作***，其中，操作***包括但不限定于安卓***、Linux***及Windows***。在此基础上，交互智能平板可以基于操作***安装至少一个应用程序。例如，交互智能平板中安装有电子白板应用程序，以实现电子白板功能。再如，交互智能平板中安装有协同应用程序，以实现协同功能，其中，协同功能是指多个地点的设备通过协同应用程序进行视频、语音等交流，还可以在交流过程中共享桌面内容、文件等，即由多个地点的交互智能平板相互配合共同完成一个事件。实施例中，以网络会议作为协同功能的应用场景进行描述，相应的，协同应用程序可理解为进行网络会议的应用程序。可理解，该应用程序可以为操作***自带的应用程序，也可以为从第三方设备或者服务器中下载的应用程序。协同操作终端也可以为应用程序本身。此时，可以由一个应用程序实现协同操作方法或由多个应用程序协同实现协同操作方法。In one embodiment, at least one type of operating system is installed on the interactive smart tablet, wherein the operating system includes but is not limited to Android system, Linux system and Windows system. On this basis, the interactive smart tablet can install at least one application based on the operating system. For example, an electronic whiteboard application is installed in the interactive smart tablet to realize the electronic whiteboard function. Another example is that a collaborative application is installed in the interactive smart tablet to realize the collaborative function. The collaborative function refers to the communication between devices in multiple locations through the collaborative application, such as video and voice, and can also share desktop content, Documents, etc., that is, an event is completed by the cooperation of interactive smart tablets in multiple locations. In the embodiment, the description is given by taking a web conference as an application scenario of a collaboration function. Correspondingly, a collaborative application program may be understood as an application program for conducting a web conference. It can be understood that the application program may be an application program provided by the operating system, or may be an application program downloaded from a third-party device or server. The cooperating terminal can also be the application itself. At this time, the cooperative operation method can be realized by one application program or the cooperative operation method can be realized by a plurality of application programs.

图1为本申请一个实施例提供的一种协同操作方法的流程图。参考图1，该协同操作方法包括如下步骤：FIG. 1 is a flowchart of a collaborative operation method provided by an embodiment of the present application. Referring to Figure 1, the collaborative operation method includes the following steps:

步骤110、显示第一协同界面，第一协同界面中显示有参与协同的每个异地终端的第一数据和本地终端的第二数据，每个异地终端中显示有第二协同界面，第一数据和第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种。Step 110: Display a first collaboration interface, where the first data of each remote terminal participating in the collaboration and the second data of the local terminal are displayed, and each remote terminal is displayed with a second collaboration interface, the first data and the second data each include at least one of video picture data, audio data and identification data.

实施例中，网络会议场景下，通过多个协同操作终端协同实现网络会议。其中，将位于本地的协同操作终端记为本地终端，将其他非本地的协同操作终端记为异地终端。可理解，异地终端一般为多个。需说明，本地终端和异地终端均为当前参与协同的协同操作终端，其为相对的概念，且当前参与协同的每个协同操作终端可以由参与协同的一个人员使用或由多个人员共同使用。In the embodiment, in a network conference scenario, a network conference is implemented collaboratively through a plurality of cooperative operation terminals. Wherein, the local cooperative operation terminal is recorded as a local terminal, and other non-local cooperative operation terminals are recorded as a remote terminal. Understandably, there are generally multiple remote terminals. It should be noted that both the local terminal and the remote terminal are cooperative operation terminals currently participating in the collaboration, which are relative concepts, and each cooperative operation terminal currently participating in the collaboration can be used by one person participating in the collaboration or jointly used by multiple personnel.

协同界面是协同功能下供各协同操作终端的使用人员观看及操作的界面，实施例中，协同界面为各协同操作终端显示的会议界面。在一实施例中，将本地终端进入网络会议后(即开始协同操作后)显示的协同界面为第一协同界面，将异地终端进入网络会议后(即开始协同操作后)显示的协同界面记为第二协同界面。其中，每个异地终端对应显示一个第二协同界面。The collaboration interface is an interface under the collaboration function for users of each collaborative operation terminal to view and operate. In the embodiment, the collaboration interface is a conference interface displayed by each collaborative operation terminal. In one embodiment, the collaboration interface displayed after the local terminal enters the network conference (that is, after starting the collaborative operation) is the first collaboration interface, and the collaboration interface displayed after the remote terminal enters the network meeting (that is, after starting the collaborative operation) is recorded as The second collaboration interface. Wherein, each remote terminal correspondingly displays a second collaboration interface.

第一协同界面的显示内容可以根据实际情况设定。实施例中，第一协同界面显示有参与网络会议(即参与协同)的每个协同操作终端对应的显示数据，并且，为了便于区分，将本地终端的显示数据记为第二数据，异地终端的显示数据记为第一数据。第一数据和第二数据的具体类型可以根据实际应用选择，实施例中，第一数据和第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种。其中，视频画面数据是指拍摄参与协同的人员时得到的视频数据，每个协同操作终端对应一个视频画面数据。实施例中视频画面数据具体为拍摄与会者时得到的视频数据。可选的，协同操作终端中还设置有摄像头，并由摄像头进行拍摄以得到实时的视频画面数据。还可选的，协同操作终端与外置摄像头建立连接，并由协同操作终端指示外置摄像头进行拍摄以获取所拍摄的视频画面数据。音频数据是指采集协同操作终端周边声音后得到的数据，每个协同操作终端对应一个音频数据。实施例中音频数据具体为采集参与网络会议的人员声音时得到的数据。可选的，协同操作终端中还设置有麦克风，并由麦克风采集音频数据。还可选的，协同操作终端与外置麦克风建立连接，并由协同操作终端指示外置麦克风采集音频数据。身份标识数据是指表明参与协同的人员身份的数据，实施例中身份标识数据具体为表面参与网络会议的人员身份的数据。身份标识数据包括但不限定于：头像、昵称、姓名等。当开启协同应用程序后，使用协同操作终端的人员可以设置、注册或登录对应的身份标识数据。可选的，同一协同界面中，第一数据和第二数据的类型可以不同，例如，第一协同界面中，某个第一数据为音频数据和身份标识数据，剩余第一数据和第二数据为音频数据和视频画面数据。需说明，第一协同界面和各第二协同界面可以相同也可以不同。例如，当网络会议中存在主持人(即协同操作时充当管理者的人员)时，主持人对应的协同界面与其他的协同界面不同，此时，相比于其他的协同界面，主持人对应的协同界面中还显示有用于管理网络会议的控件，如用于剔除其他协同操作终端的剔除控件、用于对各协同操作终端进行分组的分组讨论控件等控件。再如，当网络会议中不存在主持人时，各协同界面相同。The display content of the first collaboration interface can be set according to the actual situation. In the embodiment, the first collaboration interface displays the display data corresponding to each collaborative operation terminal participating in the network conference (that is, participating in the collaboration), and, in order to facilitate the distinction, the display data of the local terminal is recorded as the second data, and the display data of the remote terminal is recorded as the second data. The displayed data is recorded as the first data. The specific types of the first data and the second data can be selected according to actual applications. In the embodiment, the first data and the second data each include at least one of video picture data, audio data and identification data. Wherein, the video picture data refers to the video data obtained when the personnel participating in the collaboration are photographed, and each collaborative operation terminal corresponds to one piece of video picture data. In the embodiment, the video picture data is specifically video data obtained when a participant is photographed. Optionally, a camera is also provided in the collaborative operation terminal, and the camera shoots to obtain real-time video image data. Optionally, the cooperative operation terminal establishes a connection with the external camera, and the cooperative operation terminal instructs the external camera to shoot to obtain the captured video image data. The audio data refers to the data obtained after collecting the surrounding sound of the cooperative operation terminal, and each cooperative operation terminal corresponds to one piece of audio data. In the embodiment, the audio data is specifically data obtained when the voices of persons participating in the network conference are collected. Optionally, a microphone is further provided in the collaborative operation terminal, and audio data is collected by the microphone. Optionally, the cooperative operation terminal establishes a connection with the external microphone, and the cooperative operation terminal instructs the external microphone to collect audio data. The identity identification data refers to data indicating the identity of the person participating in the collaboration. In the embodiment, the identity identification data is specifically the data of the identity of the person participating in the network conference on the surface. The identification data includes, but is not limited to: avatars, nicknames, names, etc. When the collaborative application program is started, the person using the collaborative operation terminal can set, register or log in the corresponding identification data. Optionally, in the same collaborative interface, the types of the first data and the second data may be different. For example, in the first collaborative interface, a certain first data is audio data and identification data, and the remaining first data and second data are. For audio data and video picture data. It should be noted that the first cooperation interface and each of the second cooperation interfaces may be the same or different. For example, when there is a moderator (that is, a person who acts as a manager during collaborative operation) in the network conference, the moderator's corresponding collaboration interface is different from other collaborative interfaces. At this time, compared with other collaborative interfaces, the moderator's corresponding interface The collaboration interface also displays controls for managing the network conference, such as controls for removing other cooperative operation terminals, and group discussion controls for grouping each cooperative operation terminal. For another example, when there is no moderator in the network conference, each collaboration interface is the same.

在一实施例中，开启协同功能后，本地终端获取第二数据并获取每个异地终端发送的第一数据，之后，显示包含第一数据和第二数据的第一协同界面，同时，每个异地终端获取自身的第一数据以及其他异地终端发送的第一数据和本地终端发送的第二数据，并显示包含第一数据和第二数据的第二协同界面。第一数据和第二数据在第一协同界面和第二协同界面中的显示区域以及位置关系实施例不做限定。In one embodiment, after the collaboration function is enabled, the local terminal obtains the second data and obtains the first data sent by each remote terminal, and then displays the first collaboration interface including the first data and the second data, and at the same time, each The remote terminal acquires its own first data, the first data sent by other remote terminals and the second data sent by the local terminal, and displays a second collaboration interface including the first data and the second data. The embodiment does not limit the display area and positional relationship of the first data and the second data in the first collaboration interface and the second collaboration interface.

其中，开启协同功能的具体实现方式实施例不做限定。实施例中，以本地终端加入网络会议为例对开启协同功能进行描述，例如，在协同应用程序启动后，接收本地参与协同的人员输入的网络会议序号，并根据网络会议序号加入对应的网络会议以进入网络会议。再如，在协同应用程序启动后，创建新的网络会议，并在创建成功后确定进入网络会议，之后，显示网络会议序号，以使本地参与协同的人员通知异地参与协同的人员，进而使异地参与协同的人员通过网络会议号控制对应的异地终端加入网络会议。其中，网络会议序号可以认为是网络标识，其具体生成方式实施例不做限定。通过网络会议序号可以使各人员准确加入唯一的网络会议中。可理解，一个协同操作终端加入网络会议后，可以明确网络会议中已加入的协同操作终端，并可以使已加入的协同操作终端明确新加入的协同操作终端，以便于后续网络会议中各协同操作终端之间进行数据通信。The specific implementation manner of enabling the collaboration function is not limited in the embodiment. In the embodiment, the enabling of the collaboration function is described by taking the local terminal joining the network conference as an example. For example, after the collaboration application program is started, the network meeting serial number input by the local person participating in the collaboration is received, and the corresponding network meeting is joined according to the network meeting serial number. to enter the web conference. For another example, after the collaborative application is started, a new web conference is created, and after the creation is successful, it is determined to enter the web conference, and then the sequence number of the web conference is displayed, so that the local personnel participating in the collaboration notify the personnel participating in the collaboration in other places, so that the remote personnel can participate in the collaboration. The personnel participating in the collaboration control the corresponding remote terminal to join the network conference through the network conference number. Wherein, the network conference serial number may be considered as a network identifier, and the specific generation manner thereof is not limited in the embodiment. Through the network conference serial number, each person can accurately join the unique network conference. It is understandable that after a collaborative operation terminal joins a network conference, it can identify the collaborative operation terminals that have joined in the network conference, and can make the joined collaborative operation terminals identify the newly added collaborative operation terminals, so as to facilitate the collaborative operation of subsequent network conferences. Data communication between terminals.

步骤120、接收第一分组指令，第一分组指令用于指示本地终端加入第一小组，第一小组包括本地终端以及至少一个异地终端。Step 120: Receive a first grouping instruction, where the first grouping instruction is used to instruct the local terminal to join the first group, where the first group includes the local terminal and at least one remote terminal.

分组指令为用于指示协同操作终端加入小组的指令。实施例中，将本地终端当前接收到的分组指令记为第一分组指令，并将本地终端当前应加入的小组记为第一小组。可理解，第一小组中，除了包含本地终端外，还应包含至少一个异地终端。此外，未加入第一小组的异地终端可以根据对应的分组指令加入对应的小组。The grouping instruction is an instruction for instructing the cooperative operation terminal to join the group. In the embodiment, the grouping instruction currently received by the local terminal is recorded as the first grouping instruction, and the group that the local terminal should currently join is recorded as the first group. It is understandable that, in addition to the local terminal, the first group should also include at least one remote terminal. In addition, the remote terminal that has not joined the first group can join the corresponding group according to the corresponding grouping instruction.

一个实施例中，以网络会议为例，且网络会议中存在主持人，该主持人可以创建网络会议，并可对各协同操作终端进行管理、分组以及对各小组进行管理等。将主持人使用的协同操作终端记为管理终端，该管理终端可以为本地终端也可以为异地终端。当存在管理终端时，第一分组指令由管理终端发送至本地终端，且第一分组指令可以包含第一小组的标识(如小组名称和/或小组编号等表明目标小组身份的信息)。本地终端根据第一分组指令中携带的标识加入对应的第一小组。需说明，管理终端生成第一分组指令的方式实施例不做限定。可选的，本地终端接收第一分组指令后自动加入第一小组。还可选的，本地终端有权选择是否加入第一小组，此时，本地终端接收到第一分组指令后，可以在第一协同界面中弹出提示，以提示本地的人员是否加入第一小组，并在本地的人员确定加入时生成一确定指令，并反馈至管理终端，以使管理终端根据确定指令确定本地终端加入第一小组。若本地人员确定不加入，则本地终端生成一拒绝指令，并反馈至管理终端，以使管理终端将拒绝指令反馈给主持人，进而使主持人为本地终端重新选择第一小组。In one embodiment, a web conference is taken as an example, and there is a moderator in the web conference, the moderator can create a web conference, and can manage, group, and manage each group of cooperative operation terminals. The cooperative operation terminal used by the moderator is recorded as a management terminal, and the management terminal may be a local terminal or a remote terminal. When there is a management terminal, the first grouping instruction is sent by the management terminal to the local terminal, and the first grouping instruction may include the identification of the first group (such as group name and/or group number and other information indicating the identity of the target group). The local terminal joins the corresponding first group according to the identifier carried in the first grouping instruction. It should be noted that the embodiment of the manner in which the management terminal generates the first grouping instruction is not limited. Optionally, the local terminal automatically joins the first group after receiving the first grouping instruction. Optionally, the local terminal has the right to choose whether to join the first group. At this time, after receiving the first grouping instruction, the local terminal may pop up a prompt in the first collaboration interface to prompt the local personnel whether to join the first group. And when the local personnel determines to join, a confirmation instruction is generated and fed back to the management terminal, so that the management terminal determines that the local terminal joins the first group according to the determination instruction. If the local person decides not to join, the local terminal generates a rejection instruction and feeds it back to the management terminal, so that the management terminal feeds back the rejection instruction to the moderator, so that the moderator can reselect the first group for the local terminal.

另一实施例中，以网络会议为例，且网络会议中存在主持人此时，本地终端接收管理终端发送的用于自由选择小组的指令，并根据该指令提示本地的人员选择第一小组。此时，第一协同界面中显示自由组队提示以及各小组的标识，以使本地的人员根据标识选择加入的第一小组。之后，本地终端将选择的第一小组反馈至管理终端，以使管理终端根据反馈结果明确分组情况。其中，本地的人员选择第一小组时发出的指令便可以记为第一分组指令。可选的，本地的人员选择第一小组的方式可以根据实际情况设定，如本地终端显示各小组的标识后，若接收到针对某个标识的点击操作，则确认接收到第一分组指令，并将第一分组指令选择的标识所对应的小组确定为第一小组，之后，将第一小组反馈至管理终端。In another embodiment, taking a network conference as an example, and there is a moderator in the network conference, the local terminal receives an instruction sent by the management terminal for freely selecting a group, and prompts local personnel to select the first group according to the instruction. At this time, a prompt for free team formation and the identification of each group are displayed in the first collaboration interface, so that local personnel can select the first group to join according to the identification. After that, the local terminal feeds back the selected first group to the management terminal, so that the management terminal can clarify the grouping situation according to the feedback result. Wherein, the instruction issued when the local personnel selects the first group can be recorded as the first group instruction. Optionally, the way for the local personnel to select the first group can be set according to the actual situation. For example, after the local terminal displays the identification of each group, if a click operation for a certain identification is received, the first grouping instruction is confirmed to be received, The group corresponding to the identifier selected by the first grouping instruction is determined as the first group, and then the first group is fed back to the management terminal.

又一实施例中，以网络会议为例，且不设置网络会议的主持人，此时，任一参与的人员均可以充当主持人的角色，并按照上述所述的方式实现分组。In yet another embodiment, a network conference is taken as an example, and no moderator of the online conference is set. In this case, any participant can play the role of moderator, and grouping is implemented in the above-mentioned manner.

步骤130、响应于第一分组指令，将第一协同界面变换为第三协同界面，第三协同界面中显示有第二数据、共享白板控件、第一小组内每个异地终端的第一数据，第一小组内的每个异地终端将第二协同界面变换为第四协同界面。Step 130: In response to the first grouping instruction, transform the first collaboration interface into a third collaboration interface, and the third collaboration interface displays the second data, the shared whiteboard control, and the first data of each remote terminal in the first group, Each remote terminal in the first group transforms the second collaboration interface into a fourth collaboration interface.

在一实施例中，接收第一分组指令后，本地终端只接收第一小组内的异地终端发送的第一数据。此时，需要显示的第一数据的数量变少，因此，需要调整当前的第一协同界面，以得到适应于小组讨论的协同界面，实施例中，将调整后的协同界面记为第三协同界面。其中，第三协同界面中显示有第一小组内每个异地终端的第一数据和本地终端的第二数据。一个实施例中，第三协同界面还显示有共享白板控件。其中，共享白板控件用于启动共享白板功能，共享白板功能是指将本地终端的电子白板上的内容共享至其他的异地终端上，以使其他的人员明确电子白板上的内容。当本地终端加入第一小组后，共享白板控件用于启动第一小组内的共享白板功能。可理解，第一小组内异地终端同步调整当前的第二协同界面，以得到适应于小组讨论的协同界面，实施例中，将异地终端调整后的协同界面记为第四协同界面，可理解，第四协同界面显示第一小组内每个异地终端的第一数据和本地终端的第二数据以及共享白板控件，并且，第二协同界面变换为第四协同界面的过程与第一协同界面变换为第三协同界面的过程相同。In an embodiment, after receiving the first grouping instruction, the local terminal only receives the first data sent by the remote terminals in the first group. At this time, the number of the first data to be displayed is reduced, therefore, the current first collaboration interface needs to be adjusted to obtain a collaboration interface suitable for group discussion. In the embodiment, the adjusted collaboration interface is recorded as the third collaboration interface interface. The third collaboration interface displays the first data of each remote terminal in the first group and the second data of the local terminal. In one embodiment, the third collaboration interface further displays a shared whiteboard control. The shared whiteboard control is used to activate the shared whiteboard function, and the shared whiteboard function refers to sharing the content on the electronic whiteboard of the local terminal to other remote terminals, so that other personnel can clarify the content on the electronic whiteboard. After the local terminal joins the first group, the shared whiteboard control is used to activate the shared whiteboard function in the first group. It is understandable that the remote terminals in the first group adjust the current second collaborative interface synchronously to obtain a collaborative interface suitable for group discussions. In the embodiment, the adjusted collaborative interface of the remote terminals is recorded as the fourth collaborative interface. The fourth collaboration interface displays the first data of each remote terminal in the first group, the second data of the local terminal and the shared whiteboard control, and the process of transforming the second collaboration interface into the fourth collaboration interface and the first collaboration interface are transformed into The process for the third collaboration interface is the same.

可理解，实际应用中，第三协同界面中还可以显示用于启动其他功能的控件，实施例对此不做限定。例如，第三协同界面中还显示有麦克风控件，该麦克风控件用于启动或关闭通话功能，再如，第三协同界面中还显示有摄像头控件，该摄像头控件用于启动或关闭获取视频画面数据。还如，第三协同界面中还显示有列表控件，该列表控件用于显示或隐藏小组列表，该小组列表为第一小组中本地终端和异地终端的列表。可选的，第三协同界面显示的各控件可以集中显示在一控件栏中，该控件栏可以位于第三协同界面的一侧，如位于第三协同界面的下方。控件栏中各控件的排列顺序以及排列方式实施例不做限定。在一实施例中，控件栏可隐藏或唤出在第三协同界面中，举例而言，显示第三协同界面时同步显示控件栏，之后，本地的人员可以将控件栏向第三协同界面的边缘滑动，以隐藏控件栏，还可以由第三协同界面的边缘向内滑动，以唤出控件栏。需说明，第四协同界面中也可显示上述控件栏，并在控件栏中显示上述控件。一个实施例中，变化前的第一协同界面和第二协同界面同样可以显示有上述控件，且在变化到第三协同界面和第四协同界面时保留上述控件。此时，控件栏中的各控件不在局限于小组，例如，共享白板控件用于将本地终端电子白板上的内容分享给每个异地终端，列表控件用于显示或隐藏包含本地终端和各异地终端的列表。It can be understood that, in practical applications, controls for activating other functions may also be displayed in the third collaboration interface, which is not limited in the embodiment. For example, a microphone control is also displayed in the third cooperation interface, and the microphone control is used to enable or disable the call function. For another example, a camera control is also displayed in the third cooperation interface, and the camera control is used to enable or disable the acquisition of video image data. . For another example, a list control is also displayed in the third collaboration interface, and the list control is used to display or hide a group list, where the group list is a list of local terminals and remote terminals in the first group. Optionally, the controls displayed on the third collaboration interface may be collectively displayed in a control bar, and the control bar may be located on one side of the third collaboration interface, such as below the third collaboration interface. The arrangement order and arrangement manner of the controls in the control bar are not limited in the embodiment. In one embodiment, the control bar can be hidden or called out in the third collaboration interface. For example, the control bar is displayed synchronously when the third collaboration interface is displayed. Slide the edge to hide the control bar, and you can slide inward from the edge of the third collaborative interface to call out the control bar. It should be noted that, the above-mentioned control bar may also be displayed in the fourth collaboration interface, and the above-mentioned controls may be displayed in the control bar. In one embodiment, the first cooperation interface and the second cooperation interface before the change can also display the above-mentioned controls, and the above-mentioned controls are retained when changing to the third cooperation interface and the fourth cooperation interface. At this time, the controls in the control bar are not limited to groups. For example, the shared whiteboard control is used to share the content on the electronic whiteboard of the local terminal to each remote terminal, and the list control is used to display or hide the local terminal and various remote terminals. list of.

可选的，第三协同界面中还可以增加与分组讨论有关的控件，如显示有小组管理控件，小组管理控件用于对各小组进行管理。可选的，若分组讨论中需要选择组长，则第三协同界面中还显示有是否成为组长的控件。实施例中，以本地的人员被选择为组长进行示例性说明，若本地的人员被选择为第一小组的组长，则本地的人员将是否成为组长的控件设置为“是”，以通知本地终端自身被选择为组长，此时，本地的人员通过第三协同界面中显示的小组管理控件管理第一小组，而第一小组内的异地终端无法操作小组管理控件，并且，当本地终端向第一小组内的异地终端授权后，异地终端可以操作小组管理控件。其中，授权方式实施例不做限定，例如，第一小组内的异地人员将异地终端内是否成为组长的控件设置为“是”后，异地终端向本地终端发送一通知，之后，本地终端显示通知，以提示本地的人员是否向异地人员进行授权，当本地的人员做出选择后，本地终端向异地终端通知授权结果。Optionally, controls related to group discussions may also be added to the third collaboration interface, for example, group management controls are displayed, and the group management controls are used to manage each group. Optionally, if the group leader needs to be selected in the group discussion, the third collaboration interface also displays a control for whether to become the group leader. In the embodiment, it is exemplified that a local person is selected as the group leader. If the local person is selected as the group leader of the first group, the local person will set the control of whether to become the group leader to "Yes" to Notify that the local terminal itself is selected as the group leader. At this time, the local personnel manage the first group through the group management control displayed in the third collaboration interface, and the remote terminals in the first group cannot operate the group management control, and when the local After the terminal authorizes the remote terminal in the first group, the remote terminal can operate the group management control. The embodiment of the authorization mode is not limited. For example, after the remote personnel in the first group sets the control of whether to become a group leader in the remote terminal to "Yes", the remote terminal sends a notification to the local terminal, and then the local terminal displays The notification is used to prompt the local personnel whether to authorize the remote personnel. When the local personnel makes a choice, the local terminal notifies the remote terminal of the authorization result.

需说明，各协同操作终端加入一小组后，无法同时加入其他的小组，只有退出当前的小组后才可以重新加入其他的小组。It should be noted that after each collaborative operation terminal joins a group, it cannot join other groups at the same time, and can only rejoin other groups after exiting the current group.

步骤140、接收作用于共享白板控件的第一控制操作。Step 140: Receive a first control operation acting on the shared whiteboard control.

实施例中，将作用于共享白板控件的控制操作记为第一控制操作。可理解，第一控制操作可为触摸操作，也可为通过外接设备(如鼠标)发出的操作。第一控制操作的操作形式可以根据实际情况设定。例如，检测到共享白板控件接收到单击操作时，确定接收到第一控制操作。In the embodiment, the control operation acting on the shared whiteboard control is recorded as the first control operation. It can be understood that the first control operation may be a touch operation, or may be an operation issued by an external device (such as a mouse). The operation form of the first control operation can be set according to the actual situation. For example, when it is detected that the shared whiteboard control receives a click operation, it is determined that the first control operation is received.

可选的，当前第一控制操作用于启动第一小组内共享白板功能。后续若再次接收到针对共享白板控件的第一控制操作，则确定第一控制操作用于结束第一小组内共享白板功能。还可选的，当前第一控制操作用于启动共享白板功能，且在启动后，在第三协同界面中增加用于停止共享白板功能的控件，并在第三协同界面中隐藏或删除共享白板控件。之后，若检测到针对用于停止共享白板功能控件的控制操作，则停止共享白板功能，并删除用于停止共享白板功能的控件以及恢复显示共享白板控件。Optionally, the current first control operation is used to activate the whiteboard sharing function within the first group. Subsequently, if the first control operation for the shared whiteboard control is received again, it is determined that the first control operation is used to end the shared whiteboard function within the first group. Optionally, the current first control operation is used to activate the shared whiteboard function, and after activation, a control for stopping the shared whiteboard function is added in the third collaboration interface, and the shared whiteboard is hidden or deleted in the third collaboration interface. controls. After that, if a control operation for the control for stopping the shared whiteboard function is detected, the shared whiteboard function is stopped, the control for stopping the shared whiteboard function is deleted, and the display of the shared whiteboard control is resumed.

步骤150、响应于第一控制操作，在第三协同界面中显示第一白板界面，并指示第一小组内的异地终端在第四协同界面中显示第二白板界面。Step 150: In response to the first control operation, display the first whiteboard interface in the third collaboration interface, and instruct the remote terminals in the first group to display the second whiteboard interface in the fourth collaboration interface.

示例性的，对第一控制操作进行响应，以实现共享白板功能。其中，在实现共享白板功能时，首先在第三协同界面中显示本地的电子白板界面，实施例中，将第三协同界面中显示的电子白板界面记为第一白板界面。第一白板界面在第三协同界面中的显示位置可以根据实际情况设定。可选的，显示第一白板界面时，可以调整第三协同界面的显示内容和布局，以使第三协同界面适应于第一白板界面。调整第三协同界面的显示内容和布局的具体规则可以根据实际情况设定，例如，删除第三协同界面中显示的第一数据，并将第二数据调整至边缘位置，以在空白位置显示第一白板界面。再如，缩小第三协同界面中显示的各第一数据和第二数据，以在空白位置显示第一白板界面。可理解，当前可以将本地终端认为是共享白板功能的发起端。实际应用中，第一小组内的其他异地终端也可以成为共享白板功能的发起端，此时，由发起端通知本地终端在第三协同界面中显示第一白板界面，相应的，在第三协同界面中仅保留发起端对应的第一数据，删除其他第一数据。Exemplarily, in response to the first control operation, a shared whiteboard function is implemented. Wherein, when implementing the shared whiteboard function, the local electronic whiteboard interface is first displayed in the third collaboration interface. In the embodiment, the electronic whiteboard interface displayed in the third collaboration interface is recorded as the first whiteboard interface. The display position of the first whiteboard interface in the third collaboration interface can be set according to the actual situation. Optionally, when the first whiteboard interface is displayed, the display content and layout of the third collaboration interface may be adjusted to adapt the third collaboration interface to the first whiteboard interface. The specific rules for adjusting the display content and layout of the third collaboration interface can be set according to the actual situation, for example, delete the first data displayed in the third collaboration interface, and adjust the second data to the edge position to display the first data in a blank position. A whiteboard interface. For another example, each of the first data and the second data displayed in the third collaboration interface is reduced to display the first whiteboard interface in a blank position. It can be understood that the local terminal can currently be regarded as the initiator of the shared whiteboard function. In practical applications, other remote terminals in the first group can also become the initiator of the shared whiteboard function. At this time, the initiator notifies the local terminal to display the first whiteboard interface in the third collaboration interface. Correspondingly, in the third collaboration interface Only the first data corresponding to the initiator is retained in the interface, and other first data is deleted.

可选的，显示第一白板界面后，第一白板界面可以固定在第三协同界面中，也可以由本地的人员结合自身需求调整第一白板界面在第三协同界面中的显示位置。在一实施例中，当共享白板功能结束时，第三协同界面恢复至显示第一白板界面前的显示内容以及布局。Optionally, after the first whiteboard interface is displayed, the first whiteboard interface may be fixed in the third collaboration interface, or the display position of the first whiteboard interface in the third collaboration interface may be adjusted by local personnel according to their own needs. In one embodiment, when the shared whiteboard function ends, the third collaboration interface returns to the display content and layout before displaying the first whiteboard interface.

在一实施例中，在显示第一白板界面时，若协同应用程序中自带电子白板功能，则自动启动自身的电子白板功能并显示第一白板界面，若协同应用程序中未自带电子白板功能，则由协同应用程序访问具有电子白板功能的应用程序，以对电子白板功能进行调用，其中，调用规则实施例不做限定。In one embodiment, when the first whiteboard interface is displayed, if the electronic whiteboard function is provided in the collaborative application, the electronic whiteboard function of the collaborative application is automatically activated and the first whiteboard interface is displayed. If the electronic whiteboard is not provided in the collaborative application function, the collaborative application program accesses the application program with the electronic whiteboard function to call the electronic whiteboard function, wherein the embodiment of the calling rule is not limited.

在一实施例中，本地终端响应第一控制操作时，向第一小组内的每个异地终端发送通知，以使每个异地终端同样开启共享白板功能，即在第一小组内的每个异地终端对应的第四协同界面中显示白板界面，实施例中，将异地终端显示的白板界面记为第二白板界面。可理解，第一小组内，异地终端显示第二白板界面的过程与本地终端显示第一白板界面的过程相同，在此不做赘述。一般而言，第二白板界面和第一白板界面的尺寸相同且与协同界面的相对位置相同。可理解，向第一小组内每个异地终端发出通知具体为协同应用程序向第一小组内每个异地终端的协同应用程序发送通知，以使异地终端的协同应用程序在第四协同界面中显示第二白板界面。其中，发送通知时采用的通信规则实施例不做限定。In one embodiment, when the local terminal responds to the first control operation, it sends a notification to each remote terminal in the first group, so that each remote terminal also enables the shared whiteboard function, that is, each remote terminal in the first group also enables the shared whiteboard function. A whiteboard interface is displayed in the fourth collaboration interface corresponding to the terminal. In the embodiment, the whiteboard interface displayed by the remote terminal is recorded as the second whiteboard interface. It can be understood that, in the first group, the process of displaying the second whiteboard interface by the remote terminal is the same as the process of displaying the first whiteboard interface by the local terminal, which is not repeated here. Generally speaking, the size of the second whiteboard interface and the first whiteboard interface are the same and the relative position to the collaboration interface is the same. It can be understood that sending a notification to each remote terminal in the first group is specifically that the collaborative application sends a notification to the collaborative application of each remote terminal in the first group, so that the collaborative application of the remote terminal is displayed in the fourth collaborative interface. The second whiteboard interface. The embodiment of the communication rule adopted when sending the notification is not limited.

步骤160、接收作用于第一白板界面的第二控制操作。Step 160: Receive a second control operation acting on the first whiteboard interface.

在一实施例中，第二控制操作为作用于第一白板界面的书写操作。可理解，第二控制操作可为触摸操作，也可为通过外接设备(如鼠标)发出的操作。当检测到作用于第一白板界面内的控制操作，且第一白板界面处于书写状态，则确定接收到第二控制操作。In one embodiment, the second control operation is a writing operation acting on the first whiteboard interface. It can be understood that the second control operation may be a touch operation, or may be an operation issued by an external device (such as a mouse). When a control operation acting on the first whiteboard interface is detected and the first whiteboard interface is in a writing state, it is determined that a second control operation is received.

步骤170、响应于第二控制操作，在第一白板界面中显示对应的第一书写轨迹。Step 170: In response to the second control operation, display the corresponding first writing track in the first whiteboard interface.

在一实施例中，接收第二控制操作，确定第二控制操作在第一白板界面中的坐标，之后，在该坐标处显示对应的书写轨迹。实施例中，将第二控制操作对应的书写轨迹记为第一书写轨迹。可理解，第一书写轨迹的线条粗细、线条颜色等可以根据实际情况，且可以由本地与会者结合自身实际情况进行修改。In one embodiment, the second control operation is received, the coordinates of the second control operation in the first whiteboard interface are determined, and then the corresponding writing track is displayed at the coordinates. In the embodiment, the writing track corresponding to the second control operation is recorded as the first writing track. It can be understood that the line thickness, line color, etc. of the first writing track can be modified according to the actual situation, and can be modified by the local participants in combination with their own actual situation.

需说明，本地与会者可以间隔多次写入多条书写轨迹，实施例中，只要检测到针对第一白板界面的书写操作，便认为接收到第二控制操作，并显示对应的第一书写轨迹。It should be noted that the local participant can write multiple writing tracks at intervals. In the embodiment, as long as the writing operation for the first whiteboard interface is detected, it is considered that the second control operation is received, and the corresponding first writing track is displayed. .

可理解，本地终端接收到第二控制操作时，将第二控制操作的坐标发送至电子白板应用程序，以由电子白板应用程序在第一白板界面中显示第一书写轨迹。其中，电子白板应用程序是指具备电子白板功能的应用程序。Understandably, when the local terminal receives the second control operation, it sends the coordinates of the second control operation to the electronic whiteboard application, so that the electronic whiteboard application displays the first writing track in the first whiteboard interface. Among them, the electronic whiteboard application refers to the application with electronic whiteboard function.

步骤180、将第一书写轨迹发送至第一小组内的异地终端，以使异地终端在第二白板界面中显示第一书写轨迹。Step 180: Send the first writing track to the remote terminal in the first group, so that the remote terminal displays the first writing track on the second whiteboard interface.

为了实现第一小组内的共享白板功能，实施例中，本地终端根据第二控制操作得到第一书写轨迹时，同步将第一书写轨迹实时发送至第一小组内的每个异地终端。异地终端接收到第一书写轨迹后，在第二白板界面中显示第一书写轨迹。在一实施例中，本地终端将第一书写轨迹实时发送至第一小组内的每个异地终端的过程是：发送第一书写轨迹对应的元数据，其中，元数据可以理解为显示第一书写轨迹的必要数据，如第一书写轨迹的线条颜色、线条粗细、坐标等。当接收到第二控制操作后，除了显示第一书写轨迹外，还获取第一书写轨迹的元数据，之后，将元数据发送至第一小组内的异地终端。异地终端接收到元数据时，根据元数据中的坐标在第二白板界面中确定对应的坐标，并在该坐标上根据元数据中的线条颜色和线条粗细显示第一书写轨迹。In order to realize the shared whiteboard function in the first group, in the embodiment, when the local terminal obtains the first writing track according to the second control operation, it synchronously sends the first writing track in real time to each remote terminal in the first group. After receiving the first writing track, the remote terminal displays the first writing track on the second whiteboard interface. In one embodiment, the process for the local terminal to send the first writing track in real time to each remote terminal in the first group is: sending metadata corresponding to the first writing track, wherein the metadata can be understood as displaying the first writing track. Necessary data of the track, such as the line color, line thickness, and coordinates of the first writing track. After receiving the second control operation, in addition to displaying the first writing track, the metadata of the first writing track is also acquired, and then the metadata is sent to the remote terminal in the first group. When the remote terminal receives the metadata, the corresponding coordinates are determined in the second whiteboard interface according to the coordinates in the metadata, and the first writing track is displayed on the coordinates according to the line color and line thickness in the metadata.

可理解，实施例中，第一白板界面和第二白板界面具有相同的坐标系，且坐标范围一致。例如，第一白板界面和第二白板界面的坐标范围为1280×1024，且坐标系的原点位于第一白板界面的左上顶点。实际应用中，第一白板界面和第二白板界面的坐标系和坐标范围可以不同，此时，当本地终端通知异地终端启动第二白板界面时同步发送自身第一白板界面的坐标系和坐标范围，以使异地终端结合第二白板界面的坐标系和坐标范围确定坐标映射关系，之后，当接收到第一书写轨迹的坐标后，便可以根据坐标映射关系确定第二白板界面中对应的坐标。It can be understood that, in the embodiment, the first whiteboard interface and the second whiteboard interface have the same coordinate system and have the same coordinate range. For example, the coordinate range of the first whiteboard interface and the second whiteboard interface is 1280×1024, and the origin of the coordinate system is located at the upper left vertex of the first whiteboard interface. In practical applications, the coordinate system and coordinate range of the first whiteboard interface and the second whiteboard interface may be different. In this case, when the local terminal notifies the remote terminal to start the second whiteboard interface, the coordinate system and coordinate range of its own first whiteboard interface are sent synchronously. , so that the remote terminal determines the coordinate mapping relationship based on the coordinate system and coordinate range of the second whiteboard interface, and then, after receiving the coordinates of the first writing track, can determine the corresponding coordinates in the second whiteboard interface according to the coordinate mapping relationship.

在一实施例中，电子白板应用程序显示第一书写轨迹时，获取第一书写轨迹的元数据，并将元数据通过协同应用程序提供的软件开发工具包发送至协同应用程序，以由协同应用程序将元数据发送至第一小组内每个异地终端的协同应用程序，之后，第一小组内每个异地终端的协同应用程序将元数据发送至第二白板界面对应的电子白板应用程序，以使第二白板界面对应的电子白板应用程序在第二白板界面中显示第一书写轨迹。可选的，发送第一书写轨迹时，可以将第一书写轨迹和第二数据混合后进行发送，以节省网络资源，其中，混合规则实施例不做限定。据此，限定本步骤具体包括步骤181-步骤184：In one embodiment, when the electronic whiteboard application displays the first writing track, the metadata of the first writing track is obtained, and the metadata is sent to the collaborative application through the software development kit provided by the collaborative application, so that the collaborative application can use the metadata to send the metadata to the collaborative application. The program sends the metadata to the collaborative application of each remote terminal in the first group, and then the collaborative application of each remote terminal in the first group sends the metadata to the electronic whiteboard application corresponding to the second whiteboard interface to The electronic whiteboard application program corresponding to the second whiteboard interface is caused to display the first writing track in the second whiteboard interface. Optionally, when the first writing track is sent, the first writing track and the second data may be mixed and sent to save network resources, wherein the embodiment of the mixing rule is not limited. Accordingly, it is defined that this step specifically includes steps 181-184:

步骤181、获取第一书写轨迹的元数据。Step 181: Obtain metadata of the first writing track.

在一实施例中，电子白板应用程序在显示第一书写轨迹时同步获取元数据。可理解，由于书写是一个持续的过程，那么，电子白板应用程序会持续接收第二控制操作，根据第二控制操作实时显示第一书写轨迹，并且，实时获取第一书写轨迹的元数据。In one embodiment, the electronic whiteboard application acquires metadata synchronously when displaying the first writing track. Understandably, since writing is a continuous process, the electronic whiteboard application will continue to receive the second control operation, display the first writing track in real time according to the second control operation, and obtain the metadata of the first writing track in real time.

步骤182、编码元数据，以得到编码数据。Step 182: Encode metadata to obtain encoded data.

电子白板应用程序根据内部协议对元数据进行编码。实施例中，将编码后的元数据记为编码数据。其中，电子白板应用程序的内部协议是电子白板应用程序开发时设置的协议，通过该协议对元数据进行编码后，可以进行传输。可理解，对实时获取的元数据进行实时编码，以实时得到编码数据。The electronic whiteboard application encodes the metadata according to an internal protocol. In the embodiment, the encoded metadata is recorded as encoded data. Among them, the internal protocol of the electronic whiteboard application is a protocol set during the development of the electronic whiteboard application, and after encoding the metadata through the protocol, it can be transmitted. It can be understood that the metadata acquired in real time is encoded in real time to obtain encoded data in real time.

步骤183、将编码数据和第二数据进行混合，得到数据包。Step 183: Mix the encoded data and the second data to obtain a data packet.

在一实施例中，电子白板应用程序通过调用协同应用程序的软件开发工具包实现向协同应用程序发送数据，实施例中，电子白板应用程序通过调用协同应用程序的软件开发工具包实现向协同应用程序发送编码数据。协同应用程序接收编码数据后，将编码数据和第二数据进行混合。在一实施例中，混合方式实施例不做限定，如生成数据包时将两个数据同时写入数据包中。混合后，可以得到用于数据通信的数据包。可理解，由于编码数据和第二数据均具有实时性，因此，得到的数据包也具有实时性，即每帧第二数据和对应的编码数据进行混合以得到对应帧的数据包。In one embodiment, the electronic whiteboard application realizes sending data to the collaborative application by calling the software development kit of the collaborative application. The program sends encoded data. After the cooperative application receives the encoded data, it mixes the encoded data with the second data. In an embodiment, the hybrid mode embodiment is not limited. For example, when a data packet is generated, two data are written into the data packet at the same time. After mixing, data packets for data communication can be obtained. It can be understood that since both the encoded data and the second data are real-time, the obtained data packets are also real-time, that is, the second data of each frame and the corresponding encoded data are mixed to obtain a data packet of the corresponding frame.

步骤184、将数据包发送至第一小组内的异地终端，以使异地终端通过数据包得到第二数据和编码数据并在第二白板界面中显示基于编码数据得到的第一书写轨迹。Step 184: Send the data packet to the remote terminal in the first group, so that the remote terminal obtains the second data and the encoded data through the data packet and displays the first writing track obtained based on the encoded data on the second whiteboard interface.

在一实施例中，生成数据包后，将数据包发送至第一小组内的每个异地终端中。此时第一小组内的每个异地终端的协同应用程序可以通过自身的软件开发工具包接收网络传输过来的数据包，并获取数据包中的第二数据和编码数据。之后，通过第二数据在第四协同界面进行显示，并通过调用电子白板应用程序将编码数据发送至电子白板应用程序，之后，电子白板应用程序利用内部协议进行解码，以得元数据，进而基于元数据在第二白板界面中显示第一书写轨迹。In one embodiment, after the data packet is generated, the data packet is sent to each remote terminal in the first group. At this time, the collaborative application program of each remote terminal in the first group can receive the data packet transmitted from the network through its own software development kit, and obtain the second data and encoded data in the data packet. After that, the second data is displayed on the fourth collaboration interface, and the encoded data is sent to the electronic whiteboard application by calling the electronic whiteboard application. After that, the electronic whiteboard application uses the internal protocol to decode to obtain metadata, and then based on The metadata displays the first writing track in the second whiteboard interface.

可选的，当结束共享白板功能时，本地终端通知第一小组内的异地终端结束共享白板功能，之后，本地终端和第一小组内的异地终端可对第一书写轨迹进行保存。或者是，弹出保存提示，并根据本地人员的选择确定是否保存第一书写轨迹。Optionally, when the shared whiteboard function is ended, the local terminal notifies the remote terminals in the first group to end the shared whiteboard function, and then the local terminal and the remote terminals in the first group can save the first writing track. Or, a saving prompt is popped up, and whether to save the first writing track is determined according to the selection of the local person.

实际应用中，除了在协同应用程序中设置共享白板功能外，还可以设置本地白板功能，其与共享白板功能的区别仅在于本地白板功能下只会在第三协同界面中显示白板界面，且不会将白板界面中内容共享至异地终端。此时，可以在第三协同界面中设置用于启动本地白板功能的本地白板控件，且在接收到作用于本地白板控件的控制操作时，在第三协同界面中显示白板界面，显示该白板界面时采用的技术手段与显示第一白板界面时采用的技术手段相同。可选的，还可以为共享白板控件设置不同的操作方式，例如，当检测到针对共享白板控件的单击操作时，确定启动共享白板功能。当检测到还对共享白板控件的长按操作时，确定启动本地白板功能。In practical applications, in addition to setting the shared whiteboard function in the collaborative application, you can also set the local whiteboard function. The only difference between this and the shared whiteboard function is that the local whiteboard function will only display the whiteboard interface in the third collaborative interface, and not The content in the whiteboard interface will be shared to remote terminals. At this time, a local whiteboard control for starting the local whiteboard function can be set in the third collaboration interface, and when a control operation acting on the local whiteboard control is received, the whiteboard interface is displayed in the third collaboration interface, and the whiteboard interface is displayed. The technical means used when displaying the first whiteboard interface are the same as those used when displaying the first whiteboard interface. Optionally, different operation modes can also be set for the shared whiteboard control, for example, when a click operation on the shared whiteboard control is detected, it is determined to start the shared whiteboard function. When a long-press operation also on the shared whiteboard control is detected, it is determined to start the local whiteboard function.

步骤190、接收第一小组内的异地终端发送的第二书写轨迹，第二书写轨迹显示在异地终端对应的第二白板界面中。Step 190: Receive the second writing track sent by the remote terminal in the first group, and display the second writing track on the second whiteboard interface corresponding to the remote terminal.

由于第一小组内共享白板功能是相互的，因此，第一小组内的异地终端也可以进行共享白板功能。实施例中，第一小组内的某个异地终端接收作用于第二白板界面的书写操作时，在第二白板界面中显示对应的书写轨迹，实施例中，将根据书写操作在第二白板界面中显示的书写轨迹记为第二书写轨迹。其中，在第二白板界面中显示第二书写轨迹时采用的技术手段与在第一白板界面中显示第一书写轨迹时采用的技术手段相同。之后，该异地终端将第二书写轨迹发送至本地终端以及第一小组内剩余的异地终端，其中，第二书写轨迹的发送方式与第一书写轨迹的发送方式相同。Since the whiteboard sharing function in the first group is mutual, the remote terminals in the first group can also perform the whiteboard sharing function. In the embodiment, when a certain remote terminal in the first group receives the writing operation acting on the second whiteboard interface, the corresponding writing track is displayed in the second whiteboard interface. The writing track shown in is denoted as the second writing track. The technical means used when displaying the second writing track in the second whiteboard interface are the same as those used when displaying the first writing track in the first whiteboard interface. After that, the remote terminal sends the second writing track to the local terminal and the remaining remote terminals in the first group, wherein the sending method of the second writing track is the same as the sending method of the first writing track.

步骤1100、在第一白板界面中显示第二书写轨迹。Step 1100: Display the second writing track in the first whiteboard interface.

本地终端接收到的第二书写轨迹后在第一白板界面中显示第二书写轨迹。可理解，在第一白板界面中显示第二书写轨迹时采用的技术手段与在第二白板界面中显示第一书写轨迹时采用的技术手段相同。可理解，第一书写轨迹和第二书写轨迹的线条颜色、线条粗细等可以相同或不同，实施例对此不做限定。After the second writing track received by the local terminal, the second writing track is displayed in the first whiteboard interface. It can be understood that the technical means used when displaying the second writing track on the first whiteboard interface are the same as those used when displaying the first writing track on the second whiteboard interface. It can be understood that the line color, line thickness, etc. of the first writing track and the second writing track may be the same or different, which is not limited in the embodiment.

可理解，本地终端向第一小组内异地终端发送第一书写轨迹和第一小组内异地终端向本地终端发送第二书写轨迹的顺序实施例不做限定。It can be understood that the embodiments of the sequence in which the local terminal sends the first writing track to the remote terminal in the first group and the remote terminal in the first group sends the second writing track to the local terminal are not limited.

上述，通过显示包含每个异地终端第一数据和本地终端第二数据的第一协同界面，之后，根据第一分组指令将本地终端加入第一小组，并将第一协同界面变化为第三协同界面，同时，将第一小组内的第二协同界面变化为第四协同界面，其中，第三协同界面中显示有共享白板控件，当接收到作用于共享白板控件的第一控制操作时，在第三协同界面中显示第一白板界面，并指示第一小组内的异地终端在第四协同界面中显示第二白板界面，之后，根据作用于第一白板界面的第二控制操作，在第一白板界面中显示对应的第一书写轨迹，并将第一书写轨迹发送至第一小组内的异地终端，以使异地终端在第二白板界面中实时显示第一书写轨迹，同时，接收第一小组内的异地终端发送的第二书写轨迹并在本地第一白板界面中显示第二书写轨迹的技术手段，可以解决一些技术中网络会议场景下共享书写内容过程复杂且只能面向全部与会者进行共享的技术问题。通过将本地终端加入第一小组，可实现协同过程中的小组讨论，扩大了协同操作的适用场景，如在会议、教会、比赛等需要小组讨论的场景下均可使用。通过在第三协同界面中显示启动共享白板功能的控件，并通过调用电子白板应用程序的方式实现在第三协同界面中快速启动电子白板功能，且通过与第一小组内异地终端进行数据通信方式，实现仅在小组内的共享白板功能，无需退出第三协同界面，简化了启动流程，保证了协同效率，提高了参与协同人员的使用体验。在一实施例中，向第一小组内的异地终端发送第一书写轨迹时，通过软件开发工具包获取第一书写轨迹对应的编码数据，并与第二数据混合后发送，可以有效利用网络资源。在一实施例中，当启动第一白板界面和第二白板界面后，除了共享本地的第一书写轨迹外，还可以共享第一小组内异地终端的第二书写轨迹，即实现协同过程中小组内的书写轨迹共享，进一步丰富了共享白板功能，简化了共享白板流程，提高了协同体验。In the above, by displaying the first collaboration interface including the first data of each remote terminal and the second data of the local terminal, after that, the local terminal is added to the first group according to the first grouping instruction, and the first collaboration interface is changed to a third collaboration interface interface, at the same time, the second collaboration interface in the first group is changed to a fourth collaboration interface, wherein the third collaboration interface displays a shared whiteboard control, when receiving the first control operation acting on the shared whiteboard control, in the The first whiteboard interface is displayed in the third collaboration interface, and the remote terminals in the first group are instructed to display the second whiteboard interface in the fourth collaboration interface. The corresponding first writing track is displayed on the whiteboard interface, and the first writing track is sent to the remote terminal in the first group, so that the remote terminal can display the first writing track in the second whiteboard interface in real time, and at the same time, receive the first writing track in the first group. The technical means of displaying the second writing track sent by the remote terminal in the remote terminal and displaying the second writing track in the local first whiteboard interface can solve the problem that the process of sharing writing content in the network conference scenario in some technologies is complicated and can only be shared for all participants. technical issues. By adding the local terminal to the first group, group discussions in the collaborative process can be realized, which expands the applicable scenarios of collaborative operations, such as conferences, churches, competitions and other scenarios that require group discussions. By displaying the controls for starting the shared whiteboard function in the third collaborative interface, and by calling the electronic whiteboard application program, the electronic whiteboard function can be quickly started in the third collaborative interface, and by means of data communication with remote terminals in the first group , to realize the shared whiteboard function only within the group, without exiting the third collaboration interface, simplifying the start-up process, ensuring collaboration efficiency, and improving the use experience of participants in collaboration. In one embodiment, when the first writing track is sent to the remote terminal in the first group, the encoded data corresponding to the first writing track is obtained through a software development kit, mixed with the second data and sent, so that network resources can be effectively utilized. . In one embodiment, after the first whiteboard interface and the second whiteboard interface are activated, in addition to sharing the local first writing track, the second writing track of the remote terminal in the first group can also be shared, that is, to realize the teamwork in the collaborative process. The writing track sharing within the system further enriches the shared whiteboard function, simplifies the shared whiteboard process, and improves the collaborative experience.

在上述实施例的基础上，任一协同操作终端加入对应的小组后，无法再加入其他的小组，只有退出小组后，才可以加入其他的小组。实施例中，以本地终端退出第一小组并加入其他小组为例进行描述。此时，在第一白板界面中显示第二书写轨迹之后，还包括：接收退出小组指令；响应于退出小组指令，将第三协同界面恢复至第一协同界面；接收第二分组指令，第二分组指令用于指示本地终端加入第二小组；响应于第二分组指令，将第一协同界面变换为第五协同界面，第五协同界面中显示有第二数据、共享白板控件、第二小组内每个异地终端的第一数据。On the basis of the above embodiment, after any collaborative operation terminal joins the corresponding group, it cannot join other groups, and can join other groups only after exiting the group. In the embodiment, description is made by taking the local terminal exiting the first group and joining other groups as an example. At this time, after displaying the second writing track in the first whiteboard interface, the method further includes: receiving an instruction to quit the group; in response to the instruction to quit the group, restoring the third collaboration interface to the first collaboration interface; receiving the second grouping instruction, the second The grouping instruction is used to instruct the local terminal to join the second group; in response to the second grouping instruction, the first collaboration interface is transformed into a fifth collaboration interface, and the fifth collaboration interface displays the second data, the shared whiteboard controls, and the second group The first data of each remote terminal.

示例性的，退出小组指令用于指示本地终端退出第一小组。一个实施例中，退出小组指令可以由本地的人员发出。相应的，第三协同界面中还显示有用于退出小组的退出控件，该退出控件可以是小组管理控件中的一个子控件，也可以是独立的控件。当检测到该退出控件接收到控制操作时，确定接收到退出小组指令。或者是，当检测到该退出控件接收到控制操作时，在第三协同界面弹出退出提示，并在退出提示中显示用于确认的控件，当检测到该控件接收到控制操作时，确定接收到的退出小组指令。另一个实施例中，存在主持人时，退出小组指令也可以由主持人所使用的管理终端向本地终端发送。管理终端的协同界面中显示有用于退出小组的退出控件。当检测到该退出控件接收到触控操作时，确定主持人选择的协同操作终端。其中，主持人先在协同界面中选择一协同操作终端(通过点击协同操作终端的第二数据的方式选择协同操作终端或者是在协同列表中选择协同操作终端)，之后，检测到该退出控件接收到控制操作时，生成退出小组指令，并将退出小组指令发送至所选择的协同操作终端(实施例为本地终端)。或者是，检测到该退出控件接收到控制操作后，提示主持人选择协同操作终端，并在检测到主持人选择协同操作终端后生成退出小组指令，并将退出小组指令发送至所选择的协同操作终端(实施例为本地终端)。本地终端接收到退出小组指令后进行响应，即退出第一小组。此时，本地终端由第三协同界面恢复为第一协同界面，即显示全部异地终端的第一数据。可选的，恢复第一协同界面时，可以保存第一白板界面中显示的全部内容(实施例中为第一书写轨迹和第二书写轨迹)。Exemplarily, the exit group instruction is used to instruct the local terminal to exit the first group. In one embodiment, the exit group instruction may be issued by local personnel. Correspondingly, an exit control for exiting the group is also displayed in the third collaboration interface, and the exit control may be a sub-control in the group management control, or may be an independent control. When it is detected that the exit control receives a control operation, it is determined that an exit group instruction is received. Or, when it is detected that the exit control receives a control operation, an exit prompt pops up in the third collaborative interface, and a control for confirmation is displayed in the exit prompt, and when it is detected that the control receives a control operation, it is determined that the control has been received. the exit group instruction. In another embodiment, when there is a moderator, the instruction to quit the group may also be sent to the local terminal by the management terminal used by the moderator. An exit control for exiting the group is displayed in the collaboration interface of the management terminal. When it is detected that the exit control receives a touch operation, the coordinated operation terminal selected by the moderator is determined. The moderator first selects a collaborative operation terminal in the collaborative interface (selects the collaborative operation terminal by clicking the second data of the collaborative operation terminal or selects the collaborative operation terminal in the collaborative list), and then detects that the exit control receives When it is time to control the operation, an instruction to quit the group is generated, and the instruction to quit the group is sent to the selected cooperative operation terminal (the embodiment is a local terminal). Or, after detecting that the exit control has received a control operation, it prompts the host to select a cooperative operation terminal, and after detecting that the host selects a cooperative operation terminal, a group exit instruction is generated, and the group exit instruction is sent to the selected cooperative operation. A terminal (in an embodiment, a local terminal). The local terminal responds after receiving the instruction to quit the group, that is, quits the first group. At this time, the local terminal is restored from the third collaboration interface to the first collaboration interface, that is, the first data of all remote terminals is displayed. Optionally, when restoring the first collaboration interface, all content displayed in the first whiteboard interface (in the embodiment, the first writing track and the second writing track) may be saved.

在一实施例中，第二分组指令为本地终端退出第一小组后接收到的分组指令。实施例中，将第二分组指令对应的小组记为第二小组。可理解，第二分组指令的生成方式和第一分组指令的生成方式、本地终端加入第二小组的方式和本地终端接入第一小组的方式均相同，在此不做赘述。在一实施例中，本地终端加入第二小组后，本地终端只接收第二小组内异地终端发送的第一数据。此时，调整当前的第一协同界面，以得到适应于小组讨论的协同界面，实施例中，将调整后的协同界面记为第五协同界面。可理解，第五协同界面和第三协同界面相似，区别在于第三协同界面显示第一小组内每个异地终端的第一数据，第五协同界面显示第二小组内每个异地终端的第一数据。In one embodiment, the second grouping instruction is a grouping instruction received after the local terminal exits the first group. In the embodiment, the group corresponding to the second grouping instruction is recorded as the second group. It can be understood that the generation method of the second grouping instruction is the same as the generation method of the first grouping instruction, the method for the local terminal to join the second group and the method for the local terminal to access the first group, which will not be repeated here. In one embodiment, after the local terminal joins the second group, the local terminal only receives the first data sent by the remote terminals in the second group. At this time, the current first collaboration interface is adjusted to obtain a collaboration interface suitable for group discussion. In the embodiment, the adjusted collaboration interface is recorded as the fifth collaboration interface. Understandably, the fifth collaboration interface is similar to the third collaboration interface, except that the third collaboration interface displays the first data of each remote terminal in the first group, and the fifth collaboration interface displays the first data of each remote terminal in the second group. data.

上述，通过退出小组指令可以将本地终端退出第一小组，并通过第二分组指令可以将本地终端重新加入新的第二小组，这样使得协同功能的分组过程更加灵活。In the above, the local terminal can be withdrawn from the first group through the exit group instruction, and the local terminal can be rejoined into a new second group through the second grouping instruction, which makes the grouping process of the coordination function more flexible.

在上述实施例的基础上，为了便于管理各协同操作终端实现协同功能，限定参与协同的人员中存在主持人。例如，网络会议场景下，主持人可以创建网络会议，并对各协同操作终端进行管理、分组以及进行管理各小组等操作。可选的，在协同操作的过程中可以结合实际情况更换主持人。例如，在第一协同界面中显示有是否为主持人的标识控件，当本地的人员被变更为主持人时，可以将该标识控件置到“是”的一侧，以使本地终端明确本地的人员为主持人。此时，原主持人的协同操作终端自动将标识控件置到“否”的一侧，以明确其对应的人员不再是主持人。同时，协同操作中的各协同操作终端均可明确主持人变更情况。On the basis of the above embodiment, in order to facilitate the management of each collaborative operation terminal to realize the collaborative function, it is limited that there is a moderator among the persons participating in the collaboration. For example, in a network conference scenario, the moderator can create a network conference, and manage, group, and manage each group of collaborative operation terminals. Optionally, the moderator may be changed according to the actual situation during the collaborative operation. For example, in the first collaboration interface, there is an identification control indicating whether the host is a moderator. When a local person is changed to a moderator, the identification control can be set to the "Yes" side, so that the local terminal can clearly identify the local The person is the moderator. At this time, the cooperating terminal of the original moderator automatically sets the identification control to the "No" side to make it clear that the corresponding person is no longer the moderator. At the same time, each cooperative operation terminal in the cooperative operation can specify the change of the moderator.

实施例中，以本地的人员为主持人对上述协同操作方法进行示例性描述。图2为本申请另一个实施例提供的一种协同操作方法的流程图。本实施例中，本地终端为主持人使用的终端，即本地终端为对参与协同的所有异地终端进行管理的管理终端。并且，第一协同界面还显示有分组讨论控件。其中，分组讨论控件用于启动分组功能，启动分组功能后，主持人可以对各异地终端进行分组。可选的，分组讨论控件可以显示在控件栏中。In the embodiment, the above-mentioned collaborative operation method is exemplarily described with a local person as the moderator. FIG. 2 is a flowchart of a cooperative operation method provided by another embodiment of the present application. In this embodiment, the local terminal is a terminal used by the moderator, that is, the local terminal is a management terminal that manages all remote terminals participating in the collaboration. In addition, the first collaboration interface also displays a group discussion control. Among them, the group discussion control is used to activate the grouping function. After the grouping function is activated, the moderator can group terminals in different places. Optionally, breakout controls can be displayed in the control bar.

参考图2，该视频会议实现方法还包括：Referring to Figure 2, the video conference implementation method further includes:

步骤210、接收作用于分组讨论控件的第四控制操作。Step 210: Receive a fourth control operation acting on the group discussion control.

可理解，初次显示第一协同界面到结束本次协同操作(实施例中为结束本次网络会议)之间的任一时刻下主持人均可以发出作用于分组讨论控件的控制操作。It is understandable that the moderator can issue a control operation acting on the group discussion controls at any time between the first display of the first collaboration interface and the end of this collaboration operation (in this embodiment, the end of this web conference).

实施例中，将作用于分组讨论控件的控制操作记为第四控制操作。可理解，第四控制操作可为触摸操作，也可为通过外接设备(如鼠标)发出的操作。第四控制操作的操作形式可以根据实际情况设定。例如，检测到分组讨论控件接收到单击操作时，确定接收到第四控制操作。In the embodiment, the control operation acting on the group discussion control is recorded as the fourth control operation. It can be understood that the fourth control operation may be a touch operation or an operation issued by an external device (eg, a mouse). The operation form of the fourth control operation can be set according to the actual situation. For example, when it is detected that the group discussion control receives a click operation, it is determined that a fourth control operation is received.

可选的，第二协同界面中也可以显示有分组讨论控件。当异地的人员存在分组讨论的请求时，可以启动异地终端的语音采集功能，并通过语音的方式向主持人说明分组请求。还可以操作(如单击)分组讨论控件，之后，异地终端检测到针对分组讨论控件的控制操作后，向管理终端发送分组请求，管理终端接收到分组请求后在第一协同界面中显示该请求，以使主持人根据该请求发出第四控制操作。还可选的，异地终端的第二协同界面中也可以不显示分组讨论控件，即分组讨论控件仅显示在管理终端对应的协同界面中。Optionally, a group discussion control may also be displayed in the second collaboration interface. When there is a request for group discussion among people in different places, the voice collection function of the remote terminal can be activated, and the group request can be explained to the host through voice. It is also possible to operate (such as clicking) the group discussion control. After that, after the remote terminal detects the control operation for the group discussion control, it sends a grouping request to the management terminal, and the management terminal displays the request in the first collaboration interface after receiving the grouping request. , so that the moderator can issue a fourth control operation according to the request. Optionally, the group discussion control may not be displayed in the second collaboration interface of the remote terminal, that is, the group discussion control is only displayed in the collaboration interface corresponding to the management terminal.

步骤220、响应于第四控制操作，将第一协同界面变换为第六协同界面，第六协同界面中显示有小组管理控件以及多个分组区域，每个分组区域对应一个小组，小组管理控件用于实现小组管理。Step 220: In response to the fourth control operation, transform the first collaboration interface into a sixth collaboration interface. The sixth collaboration interface displays a group management control and a plurality of grouping areas, each grouping area corresponds to a group, and the group management control uses for group management.

其中，第六协同界面为分组时供主持人管理的协同界面。第六协同界面中显示有小组管理控件，主持人可以通过小组管理控件对各小组进行管理。在一实施例中，小组管理控件可以包括一个总控件和多个子控件，其中，每个子控件对应一个功能，各功能的具体内容可以根据实际情况。如子控件包括但不限定于：用于搜索参与协同人员的搜索子控件、用于指示协同操作终端加入小组的加入子控件、用于将协同操作终端踢出小组的踢出子控件、用于退出小组的退出子控件、用于结束分组讨论的结束子控件、用于设置小组数的组数子控件、用于启动自由组队的自主组队子控件以及用于展示小组内白板界面或桌面的展示白板子控件、用于展示小组列表的小组列表子控件等至少一项。各子控件可以集成在一个区域内显示，该区域可以记为管理子控件区域。总控件用于显示或隐藏管理子控件区域。一般而言，总控件持续显示在第六协同界面中。当检测到总控件接收到控制操作(如单击操作)时，在第六协同界面中显示管理子控件区域。之后，当检测到总控件再次接收到控制操作(如单击操作)时，在第六协同界面中隐藏管理子控件区域。The sixth collaboration interface is a collaboration interface for the moderator to manage during grouping. A group management control is displayed in the sixth collaboration interface, and the moderator can manage each group through the group management control. In an embodiment, the group management control may include a general control and a plurality of sub-controls, wherein each sub-control corresponds to a function, and the specific content of each function may be based on the actual situation. For example, the sub-controls include, but are not limited to: a search sub-control for searching for cooperating personnel, a join sub-control for instructing the cooperative operation terminal to join the group, a kick-out sub-control for kicking the cooperative operation terminal out of the group, Exit sub-control for leaving the group, end sub-control for ending the group discussion, group number sub-control for setting the number of groups, self-group sub-control for starting free teaming, and for displaying the whiteboard interface or desktop in the group. Display at least one of the whiteboard sub-control, the group list sub-control used to display the group list, and so on. Each sub-control can be integrated and displayed in an area, which can be recorded as the area for managing sub-controls. The master control is used to show or hide the management sub-control area. Generally speaking, the total controls are continuously displayed in the sixth collaboration interface. When it is detected that the master control receives a control operation (such as a click operation), a management sub-control area is displayed in the sixth collaboration interface. After that, when it is detected that the master control receives a control operation (such as a click operation) again, the management sub-control area is hidden in the sixth collaboration interface.

第六协同界面中还显示有各分组区域，此时，每个分组区域代表一个小组，各分组区域可以按照由左至右、由上至下的方式排列在第六协同界面中。每个分组区域在第六协同界面中占用相同大小的区域。在一实施例中，管理终端中预先设置有显示第六协同界面时分组区域的初始数量，并按照初始数量显示各分组区域，之后，主持人可以通过组数子控件修改分组区域的数量，即修改小组数量。可选的，各分组区域在第六协同界面中显示区域的大小可以根据分组区域数量做适应性调整，如，当前分组区域数量较多时，可以适当缩小各分组区域的大小，以在第六协同界面中显示全部的分组区域。相应的，当前分组区域数量较少时，可适当增大各分组区域的大小，以提升第六协同界面的美观性。还可选的，各分组区域在第六协同界面中显示区域的大小不会随着分组区域数量做适应性调整，此时，若分组区域数量较多，则可以隐藏部分分组区域，之后，主持人可以通过滑动第六协同界面的方式将隐藏的分组区域显示出来，同时，隐藏已显示的分组区域。例如，隐藏的分组区域位于已显示分组区域的右侧，则主持人可以在第六协同界面中执行向左滑动的操作，以使第六协同界面向左整体移动分组区域，即显示右侧隐藏的分组区域并隐藏左侧已显示的分组区域。Each grouping area is also displayed in the sixth collaboration interface. In this case, each grouping area represents a group, and each grouping area can be arranged in the sixth collaboration interface in a left-to-right and top-to-bottom manner. Each grouping area occupies an area of the same size in the sixth collaboration interface. In one embodiment, the management terminal is preset with the initial number of grouping areas when displaying the sixth collaboration interface, and each grouping area is displayed according to the initial number. number of groups. Optionally, the size of the display area of each grouping area in the sixth collaboration interface can be adaptively adjusted according to the number of grouping areas. For example, when the current number of grouping areas is large, the size of each grouping area All grouping areas are displayed in the interface. Correspondingly, when the number of current grouping areas is small, the size of each grouping area may be appropriately increased to improve the aesthetics of the sixth collaboration interface. Optionally, the size of the display area of each grouping area in the sixth collaboration interface will not be adaptively adjusted with the number of grouping areas. At this time, if the number of grouping areas is large, part of the grouping area can be hidden, and then the host The person can display the hidden grouping area by sliding the sixth collaboration interface, and at the same time, hide the displayed grouping area. For example, if the hidden grouping area is located on the right side of the displayed grouping area, the moderator can perform the operation of swiping to the left in the sixth collaboration interface, so that the sixth collaboration interface moves the grouping area to the left as a whole, that is, the hidden right side is displayed. and hides the grouping area shown on the left.

一个实施例中，接收到第四控制操作后，自动显示多个分组区域以及小组管理控件的第六会议界面。此时，各分组区域内还没有协同操作终端加入，即当前仅由主持人创建了各自小组，因此，各分组区域中显示的内容可以仅包括小组名称和/或小组编号等。其中，小组名称和/或小组编号可以由管理终端按照默认的生成逻辑生成，还可以由主持人设定，实施例对此不做限定。In one embodiment, after receiving the fourth control operation, multiple grouping areas and the sixth conference interface of the group management control are automatically displayed. At this time, no collaborative operation terminal has joined in each grouping area, that is, currently only the moderator has created the respective group. Therefore, the content displayed in each grouping area may only include the group name and/or group number. The group name and/or group number may be generated by the management terminal according to the default generation logic, and may also be set by the moderator, which is not limited in the embodiment.

可选的，第六协同界面中还可以显示有第二数据。其中，第二数据在第六协同界面中的尺寸以及显示位置实施例不做限定。实际应用中，主持人还可以结合实际情况将第二数据更换为需要显示的第一数据。还可选的，第六协同界面中还可以保留显示第一协同界面的控件栏，以使主持人可以启动控件栏中各控件对应的功能。Optionally, second data may also be displayed in the sixth collaboration interface. The size and display position of the second data in the sixth collaboration interface are not limited in the embodiment. In practical applications, the moderator may also replace the second data with the first data to be displayed according to the actual situation. Optionally, a control bar for displaying the first collaboration interface may also be reserved in the sixth collaboration interface, so that the moderator can activate the functions corresponding to the controls in the control bar.

步骤230、向每个异地终端发送第三分组指令，以使异地终端根据第三分组指令加入相应的小组。Step 230: Send a third grouping instruction to each remote terminal, so that the remote terminal joins the corresponding group according to the third grouping instruction.

第三分组指令是由管理终端发出的分组指令。一个实施例中，由主持人规定各小组内的协同操作终端。此时，主持人可以通过管理子控件区域确定各协同操作终端需要加入的小组，之后，管理终端生成对应的第三分组指令并发送至对应的协同操作终端，以使协同操作终端明确加入的小组。其中，主持人对管理子控件区域的操作逻辑实施例不做限定，例如，主持人通过搜索子控件查找到一协同操作终端，之后，在各分组区域中通过控制操作(如单击操作)选择一目标分组区域作为协同操作终端需要加入的小组，之后，通过单击加入子控件的方式指示管理终端将该协同操作终端加入至对应的小组。此时，管理终端生成第三分组指令，该第三分组指令中可以包含小组的标识(如小组名称和/或小组编号)等表明小组身份的信息，每个协同操作终端对应一条第三分组指令，每条第三分组指令中包含表明协同操作终端对应的小组身份的信息。之后，管理终端将第三分组指令发送至对应的协同操作终端，协同操作终端接收到第三分组指令时确定需加入的小组。其中，协同操作终端加入对应小组的方式与本地终端加入第一小组的方式相同，在此不做赘述。另一个实施例中，协同操作终端可以自由组队，此时，主持人可以通过管理子控件区域中的自主组队子控件启动自由组队功能，相应的，管理终端生成第三分组指令，此时，第三分组指令用于指示协同操作终端自由选择小组。第三分组指令中可以包含各小组的标识(如小组名称和/或小组编号)以及自由组队的标识。之后，管理终端向各协同操作终端发送第三分组指令。每个协同操作终端接收到相同的第三分组指令。之后，各协同操作终端根据第三分组指令，在本地的第二协同界面中显示自由组队提示以及各小组的标识，以使协同操作终端的人员根据标识选择加入的小组。之后，协同操作终端将选择的小组反馈至管理终端，以使管理终端根据反馈结果明确分组情况。The third grouping instruction is a grouping instruction issued by the management terminal. In one embodiment, the moderator specifies the cooperating terminals within each group. At this time, the moderator can determine the group that each collaborative operation terminal needs to join through the management sub-control area, and then the management terminal generates a corresponding third grouping instruction and sends it to the corresponding collaborative operation terminal, so that the collaborative operation terminal can clearly join the group . The moderator does not limit the operation logic embodiment of the management sub-control area. For example, the moderator finds a collaborative operation terminal by searching the sub-control, and then selects a control operation (such as a single-click operation) in each grouping area. A target group area is used as a group that the cooperative operation terminal needs to join, and then the management terminal is instructed to add the cooperative operation terminal to the corresponding group by clicking the join sub-control. At this time, the management terminal generates a third grouping instruction, and the third grouping instruction may contain information indicating the group identity such as the group identifier (such as group name and/or group number), and each cooperative operation terminal corresponds to a third grouping instruction , and each third grouping instruction includes information indicating the group identity corresponding to the cooperative operation terminal. After that, the management terminal sends the third grouping instruction to the corresponding cooperative operation terminal, and the cooperative operation terminal determines the group to be joined when receiving the third grouping instruction. The manner in which the cooperative operation terminal joins the corresponding group is the same as the manner in which the local terminal joins the first group, which is not repeated here. In another embodiment, the collaborative operation terminal can form a team freely. At this time, the host can activate the free team formation function through the self-organizing team sub-control in the management sub-control area. Correspondingly, the management terminal generates a third grouping instruction, which is , the third grouping instruction is used to instruct the cooperative operation terminal to freely select a group. The third grouping instruction may include the identification of each group (eg group name and/or group number) and the identification of the free group. After that, the management terminal sends a third grouping instruction to each cooperative operation terminal. Each cooperative operation terminal receives the same third grouping instruction. After that, according to the third grouping instruction, each collaborative operation terminal displays a prompt for free team formation and the identification of each group in the local second collaboration interface, so that the personnel of the collaborative operation terminal can select a group to join according to the identification. After that, the cooperative operation terminal feeds back the selected group to the management terminal, so that the management terminal can clarify the grouping situation according to the feedback result.

可选的，分组完成后，各分组区域中可以显示加入的协同操作终端的第一数据。或者是，分组完成后，各分组区域中显示出加入的协同操作终端的数量。Optionally, after the grouping is completed, each grouping area may display the first data of the added cooperative operation terminal. Or, after the grouping is completed, each grouping area displays the number of the joined cooperative operation terminals.

可选的，管理终端通知各异地终端分组情况，以使各异地终端在小组讨论时，接收小组内每个异地终端传输的数据。还可选的，各异地终端进行数据通信时加入小组的标识，以保证异地终端只接收包含当前自身小组标识的数据。对于异地终端而言，加入相应的小组后，将第二协同界面变换为第四协同界面。一个实施例中，第四协同界面还可以显示小组管理控件，此时，小组管理控件中的管理子控件区域仅用于实现对自身的管理。可选的，各小组内的异地终端还可以与管理终端进行数据传输，以存在小组管理需求(如增加小组、共享白板等)时通知主持人进行小组管理。另一个实施例中，主持人可以为每个小组选择一个组长，其中，选择组长的方式实施例不做限定，例如，主持人选择一分组区域时，管理终端显示该分组区域内异地终端的协同列表或者是小组内异地终端的第一数据，其中，协同列表中还可以显示参与协同人员的姓名。之后，主持人可以在协同列表中选择一异地终端或者在各第一数据中选择一第一数据，之后，管理终端将主持人选择的异地终端确定为组长，并通知该异地终端。此时，异地终端确定被选择为组长，并通知自身小组内的其他异地终端。同时，作为组长的异地终端在自身的第四协同界面中除了显示同组的第一数据外还显示小组管理控件，以通过小组管理控件对组内成员进行管理。可选的，作为组长的异地终端可以与管理终端进行数据传输，以存在小组管理需求(如增加小组、白板共享等)时通知主持人进行小组管理。又一个实施例中，各小组成员可以自行选择组长，此时，各异地终端的第四协同界面中除了显示同组的第一数据外还显示是否成为组长的控件，若组内某一参与协同人员被选择为组长，则该参与协同人员将第四协同界面中是否成为组长的控件设置为“是”，此时，该异地终端确定自身被选择为组长，并在第四协同界面中显示小组管理控件，以通过小组管理控件对组内成员进行管理。可选的，作为组长的异地终端可以与管理终端进行数据传输，以存在小组管理需求(如增加小组、白板共享等)时通知主持人进行小组管理。再一个实施例中，第四协同界面中仅显示小组与会者列表，而不显示小组管理控件。Optionally, the management terminal notifies the grouping situation of the terminals in different places, so that the terminals in different places receive the data transmitted by each terminal in the different places in the group discussion. Optionally, terminals in different places add the group identification when performing data communication, so as to ensure that the remote terminals only receive data including the current identification of their own group. For remote terminals, after joining a corresponding group, the second collaboration interface is transformed into a fourth collaboration interface. In one embodiment, the fourth collaboration interface may also display a group management control. In this case, the management sub-control area in the group management control is only used to manage itself. Optionally, the remote terminals in each group can also perform data transmission with the management terminal, so as to notify the host to perform group management when there is a group management requirement (such as adding a group, sharing a whiteboard, etc.). In another embodiment, the moderator may select a group leader for each group, wherein the method for selecting the group leader is not limited. For example, when the moderator selects a grouping area, the management terminal displays the remote terminals in the grouping area. The collaboration list of , or the first data of the remote terminals in the group, wherein the collaboration list can also display the names of the personnel participating in the collaboration. After that, the moderator can select a remote terminal in the collaboration list or select a first data from each first data, and then the management terminal determines the remote terminal selected by the moderator as the group leader and notifies the remote terminal. At this time, the remote terminal is determined to be selected as the group leader, and notifies other remote terminals in its own group. At the same time, the remote terminal serving as the group leader displays the group management control in addition to the first data of the same group in its own fourth collaboration interface, so as to manage the members in the group through the group management control. Optionally, the remote terminal serving as the group leader can perform data transmission with the management terminal, so as to notify the moderator to perform group management when there is a group management requirement (such as adding a group, whiteboard sharing, etc.). In yet another embodiment, each group member can choose the group leader by himself. At this time, in addition to displaying the first data of the same group, the fourth collaboration interface of the terminals in different places also displays the control of whether to become the group leader. If the cooperating person is selected as the group leader, the participating cooperating person sets the control on whether to become the group leader in the fourth collaboration interface to "Yes". The group management control is displayed in the collaboration interface, so that members in the group can be managed through the group management control. Optionally, the remote terminal serving as the group leader can perform data transmission with the management terminal, so as to notify the moderator to perform group management when there is a group management requirement (such as adding a group, whiteboard sharing, etc.). In yet another embodiment, only the group participant list is displayed in the fourth collaboration interface, but the group management controls are not displayed.

可理解，主持人也可以将自身的管理终端加入需要加入的小组。It is understandable that the moderator can also add his own management terminal to the group to be joined.

还可选的，小组讨论时，各小组内可以共享白板或桌面，此时，其他小组不会观看到共享白板的内容或共享桌面的内容。如果某个小组内共享白板的内容或共享桌面的内容需要在其他小组中进行展示，那么，对应的异地终端通过管理终端通知主持人，以使主持人通过展示白板子控件确定展示该小组的共享白板内容或共享桌面内容，此时，其他小组可以观看到共享白板内容或共享桌面内容。其中，其他与会者通知主持人的方式实施例不作限定。Optionally, during group discussion, each group can share the whiteboard or desktop, and at this time, other groups will not watch the content of the shared whiteboard or the content of the shared desktop. If the content of the shared whiteboard or the shared desktop in a group needs to be displayed in other groups, the corresponding remote terminal will notify the moderator through the management terminal, so that the moderator can determine the sharing of the group by displaying the whiteboard sub-control. Whiteboard content or shared desktop content, at this time, other groups can watch the shared whiteboard content or shared desktop content. The embodiment of the manner in which other participants notify the host is not limited.

一个实施例中，主持人可以查看任一小组的协同界面。此时，协同操作方法中，向每个异地终端发送第三分组指令，以使异地终端根据第三分组指令加入相应的小组之后，还包括：接收针对于第一目标分组区域的第五控制操作；响应于第五控制操作，在第六协同界面中显示第一目标分组区域对应小组的协同界面。In one embodiment, the moderator can view the collaboration interface of any group. At this time, in the cooperative operation method, after sending a third grouping instruction to each remote terminal, so that the remote terminal joins the corresponding group according to the third grouping instruction, the method further includes: receiving a fifth control operation for the first target grouping area ; in response to the fifth control operation, displaying the collaboration interface of the group corresponding to the first target grouping area in the sixth collaboration interface.

第五控制操作用于在第六协同界面中显示小组内的协同界面。第五控制操作的触发方式可以根据实际情况设定，如当检测到某一分组区域接收到长按或双击操作时，确定接收到第五控制操作，并将分组区域作为第五控制操作所选择的第一目标分组区域。之后，确定第一目标分组区域对应的小组，获取该小组对应的协同界面。可理解，该小组对应的协同界面只显示该小组内各异地终端的第二数据，当白板共享功能开启后，还显示有小组内的白板界面。获取该小组对应的协同界面可以是获取小组内一异地终端(可小组推荐或由主持人选择异地终端)当前的第四协同界面。之后，在第六协同界面中显示该小组对应的协同界面，即显示第一目标分组区域对应的协同界面。以此，实现主持人对各小组的协同界面的查看。可理解，显示小组对应的协同界面后，同步显示退出界面控件，当检测到退出界面控件接收到控制操作时，取消在第六协同界面中显示小组对应的协同界面，以便于主持人的灵活管理。实际应用中，管理终端选择第一目标分组区域后，除了显示对应的协同界面外，主持人还可以通过管理终端与第一目标分组区域对应的小组进行语音通话。The fifth control operation is used to display the collaboration interface within the group in the sixth collaboration interface. The triggering mode of the fifth control operation can be set according to the actual situation. For example, when a long press or double-click operation is detected in a certain grouping area, it is determined that the fifth control operation is received, and the grouping area is selected as the fifth control operation. the first target grouping area. Afterwards, a group corresponding to the first target grouping area is determined, and a collaboration interface corresponding to the group is obtained. It is understandable that the collaboration interface corresponding to the group only displays the second data of the terminals in different places in the group, and when the whiteboard sharing function is enabled, the whiteboard interface in the group is also displayed. Obtaining the collaboration interface corresponding to the group may be obtaining the current fourth collaboration interface of a remote terminal in the group (which can be recommended by the group or selected by the host). After that, the collaboration interface corresponding to the group is displayed in the sixth collaboration interface, that is, the collaboration interface corresponding to the first target grouping area is displayed. In this way, the moderator can view the collaboration interface of each group. It is understandable that after displaying the collaboration interface corresponding to the group, the exit interface controls are displayed synchronously. When it is detected that the exit interface control receives a control operation, the display of the collaboration interface corresponding to the group in the sixth collaboration interface is canceled, so as to facilitate the flexible management of the host. . In practical applications, after the management terminal selects the first target grouping area, in addition to displaying the corresponding collaboration interface, the host can also conduct a voice call with the group corresponding to the first target grouping area through the management terminal.

一个实施例中，主持人还可以将某个小组的协同界面共享给至少一个其他小组。此时，协同操作方法中，向每个异地终端发送第三分组指令，以使异地终端根据第三分组指令加入相应的小组之后，还包括：接收针对于第二目标分组区域的第六控制操作和针对于第三目标分组区域的第七控制操作；响应于第六控制操作和第七控制操作，将第二目标分组区域对应小组的协同界面，发送到第三目标分组区域对应小组的协同界面进行显示。In one embodiment, the moderator may also share the collaboration interface of a certain group with at least one other group. At this time, in the cooperative operation method, after sending a third grouping instruction to each remote terminal, so that the remote terminal joins the corresponding group according to the third grouping instruction, the method further includes: receiving a sixth control operation for the second target grouping area and the seventh control operation for the third target grouping area; in response to the sixth control operation and the seventh control operation, the second target grouping area corresponding to the group's collaborative interface is sent to the third target grouping area corresponding to the group's collaborative interface to display.

第六控制操作和第七控制操作为关联操作，关联操作用于将第六控制操作所选择的分组区域对应的协同界面发送给第七控制操作所选择的分组区域内的各异地终端，以使得各异地终端在第四协同界面中显示所接收的协同界面。实施例中，将第六控制操作所选择的分组区域记为第二目标分组区域，将第七控制操作所选择的分组区域记为第三目标分组区域，可理解第三目标分组区域可以为一个或多个，实施例中，以第三目标分组区域为一个进行示例性描述。第六控制操作和第七控制操作的触发形式实施例不作限定，如在第六协同界面中显示协同界面共享控件，当检测到该控件被触发后，提示主持人选择两个分组区域，其中，选择第一个分组区域的操作为第六控制操作并将选择的分组区域记为第二目标分组区域，选择第二个分组区域的操作记为第七控制操作并将选择的分组区域记为第三目标分组区域。再如，如当检测到某一分组区域接收到长按或双击操作时，提示主持人是否选择另一分组区域，并当确认主持人选择另一分组区域时，确定接收到第六控制操作并将当前选择的分组区域记为第二目标分组区域，之后，检测到另一分组区域接收到长按或双击操作时，确定接收到第七控制操作，并将当前选择分组区域记为第三目标分组区域。之后，管理终端获取第二目标分组区域内的协同界面，并发送至第三目标分组区域对应小组的各异地终端中，以在各异地终端的第四协同界面中进行显示。可理解，实际应用中，还可以由管理终端通知第二目标分组区域和第三目标分组区域对应的小组，以使第二目标分组区域中的一异地终端(随机选择或由组内人员推选)将其第四协同界面发送至第三目标分组区域对应的小组，以使该小组内的各异地终端在第四协同界面中显示接收到的另一小组第四协同界面。其中，第三目标分组区域对应的协同界面显示第二目标分组区域对应的协同界面时采用的方式与第六协同界面中显示第一目标分组区域对应的协同界面时采用的方式相同，在此不做赘述。The sixth control operation and the seventh control operation are associated operations, and the associated operation is used to send the coordination interface corresponding to the grouping area selected by the sixth control operation to the terminals in different places in the grouping area selected by the seventh control operation, so that the The terminals in different places display the received collaboration interface in the fourth collaboration interface. In the embodiment, the grouping area selected by the sixth control operation is recorded as the second target grouping area, and the grouping area selected by the seventh control operation is recorded as the third target grouping area. It can be understood that the third target grouping area may be a Or more, in the embodiment, the third target grouping area is taken as one for exemplary description. The trigger forms of the sixth control operation and the seventh control operation are not limited in the embodiment. For example, a collaborative interface sharing control is displayed in the sixth collaborative interface, and when it is detected that the control is triggered, the host is prompted to select two grouping areas, wherein, The operation of selecting the first grouping area is the sixth control operation and the selected grouping area is recorded as the second target grouping area, and the operation of selecting the second grouping area is recorded as the seventh control operation and the selected grouping area is recorded as the first control operation. Three target grouping areas. For another example, when it is detected that a long press or double-click operation is received in a certain grouping area, the moderator is prompted whether to select another grouping area, and when it is confirmed that the moderator selects another grouping area, it is determined that the sixth control operation is received and The currently selected grouping area is recorded as the second target grouping area, and after it is detected that another grouping area receives a long-press or double-click operation, it is determined that the seventh control operation is received, and the currently selected grouping area is recorded as the third target. grouping area. Afterwards, the management terminal acquires the collaboration interface in the second target grouping area, and sends it to the terminals in different places of the group corresponding to the third target grouping area, so as to be displayed on the fourth collaboration interface of the terminals in the different places. It can be understood that in practical applications, the management terminal can also notify the groups corresponding to the second target grouping area and the third target grouping area, so that a remote terminal in the second target grouping area (randomly selected or selected by the personnel in the group) Send its fourth collaboration interface to the group corresponding to the third target grouping area, so that terminals in different places in the group display the received fourth collaboration interface of another group in the fourth collaboration interface. The manner in which the collaboration interface corresponding to the third target grouping area displays the collaboration interface corresponding to the second target grouping area is the same as the manner in which the collaboration interface corresponding to the first target grouping area is displayed in the sixth collaboration interface. Do repeat.

下面对本实施例提供的技术方案进行示例性描述，例如，图3为本申请实施例提供的一种协同界面示意图，其为管理终端的第一协同界面示意图。参考图3，第一协同界面中包括六个第一数据(对应于图3中第一数据21-第一数据26)、第二数据27以及控件栏28，其中，控件栏28中包括本地白板控件2801、共享白板控件2802、麦克风控件2803、摄像头控件2804、分组讨论控件2805、协同列表控件2806。检测到针对分组讨论控件2805的第四控制操作后，将图3的第一协同界面变为图4的第六协同界面。图4为本申请实施例提供的另一种协同界面示意图。参考图4，当前分组区域为4个，且各分组区域对应的小组分别为小组A、小组B、小组C和小组D。第六协同界面中还显示有小组管理控件，且该小组管理控件包括总控件2901和多个子控件，多个子控件位于管理子控件区域2902中，且多个子控件包括搜索子控件2903、加入子控件2904、踢出子控件2905、退出子控件2906、结束子控件2907、展示白板子控件2908、组数子控件2909、自主组队子控件29010。可理解，由于第六协同界面中控件栏28的全部控件无法完全显示，因此，可以隐藏部分控件，并当主持人点击隐藏区域时显示出隐藏的控件。在一实施例中，第六协同界面中还显示有第二数据27，实际应用中，可以将第二数据27切换为其他的第一数据。可理解，图4中示出了每个小组可以加入的异地终端的最大数量为4人(每组4个人物图标)。实际应用中，也可以不示出可加入的最大数量，而是当一异地终端加入小组时，显示一人物图标，此时，图4中的人物图标可以表示已加入的异地终端数量。可选的，若检测到小组A接收到第五控制操作时，在图4所示的第六协同界面中显示小组A对应的协同界面。此时，图4的第六协同界面变换为图5。图5为本申请实施例提供的又一种协同界面示意图，参加图5，在第六协同界面中显示了小组A对应的协同界面21001，该协同界面21001中包含白板界面。The technical solution provided by this embodiment is exemplarily described below. For example, FIG. 3 is a schematic diagram of a collaboration interface provided by an embodiment of the present application, which is a schematic diagram of a first collaboration interface of a management terminal. Referring to FIG. 3 , the first collaboration interface includes six first data (corresponding to the first data 21 to the first data 26 in FIG. 3 ), the second data 27 and the control bar 28 , wherein the control bar 28 includes a local whiteboard Control 2801, Shared Whiteboard Control 2802, Microphone Control 2803, Camera Control 2804, Group Discussion Control 2805, Collaboration List Control 2806. After the fourth control operation on the group discussion control 2805 is detected, the first collaboration interface in FIG. 3 is changed into the sixth collaboration interface in FIG. 4 . FIG. 4 is a schematic diagram of another collaboration interface provided by an embodiment of the present application. Referring to FIG. 4 , there are currently four grouping areas, and the groups corresponding to each grouping area are group A, group B, group C, and group D, respectively. A group management control is also displayed in the sixth collaboration interface, and the group management control includes a general control 2901 and a plurality of sub-controls, the plurality of sub-controls are located in the management sub-control area 2902, and the plurality of sub-controls include a search sub-control 2903, a join sub-control 2904, kick out sub-control 2905, exit sub-control 2906, end sub-control 2907, display whiteboard sub-control 2908, group number sub-control 2909, self-group sub-control 29010. It can be understood that since all the controls in the control bar 28 in the sixth collaboration interface cannot be completely displayed, some controls can be hidden, and the hidden controls can be displayed when the moderator clicks on the hidden area. In one embodiment, second data 27 is also displayed in the sixth collaboration interface. In practical applications, the second data 27 can be switched to other first data. Understandably, FIG. 4 shows that the maximum number of remote terminals that each group can join is 4 people (4 person icons in each group). In practical applications, the maximum number that can be added may not be shown, but a character icon will be displayed when a remote terminal joins the group. At this time, the character icon in FIG. 4 may represent the number of remote terminals that have joined. Optionally, if it is detected that the group A receives the fifth control operation, the collaboration interface corresponding to the group A is displayed in the sixth collaboration interface shown in FIG. 4 . At this time, the sixth collaboration interface in FIG. 4 is transformed into FIG. 5 . FIG. 5 is a schematic diagram of another collaboration interface provided by an embodiment of the present application. Referring to FIG. 5 , a collaboration interface 21001 corresponding to group A is displayed in the sixth collaboration interface, and the collaboration interface 21001 includes a whiteboard interface.

上述，通过分组讨论控件实现在协同操作中进行分组讨论，且通过小组管理控件可以实现对各小组的管理，便于主持人对分组情况的全局掌控，丰富了协同功能，且分组时形式灵活多样，提升了参加协同人员的使用体验。As mentioned above, the group discussion in collaborative operation is realized through the group discussion control, and the management of each group can be realized through the group management control, which facilitates the overall control of the grouping situation by the host, enriches the collaboration function, and the forms of grouping are flexible and diverse. Improves the user experience of the participating collaborators.

在上述实施例的基础上，图6为本申请又一个实施例提供的一种协同操作方法的流程图。本实施例对分组讨论的场景进行具体化说明。本实施例中对于是否存在主持人不做限定。参考图6，该视频会议实现方法具体包括：On the basis of the foregoing embodiment, FIG. 6 is a flowchart of a collaborative operation method provided by another embodiment of the present application. This embodiment specifically describes the scenario of group discussion. In this embodiment, there is no limitation on whether there is a moderator. Referring to Figure 6, the video conference implementation method specifically includes:

步骤310、显示第一协同界面，第一协同界面中显示有参与协同的每个异地终端的第一数据和本地终端的第二数据，每个异地终端中显示有第二协同界面，第一数据和述第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种。Step 310: Display a first collaboration interface, where the first data of each remote terminal participating in the collaboration and the second data of the local terminal are displayed, and each remote terminal is displayed with a second collaborative interface, the first data Both the second data and the second data include at least one of video picture data, audio data and identification data.

步骤320、接收第一分组指令，第一分组指令用于指示本地终端加入第一小组，第一小组包括本地终端以及至少一个异地终端。Step 320: Receive a first grouping instruction, where the first grouping instruction is used to instruct the local terminal to join the first group, where the first group includes the local terminal and at least one remote terminal.

步骤330、响应于第一分组指令，将第一协同界面变换为第三协同界面，第三协同界面中显示有第二数据、共享白板控件、第一小组内每个异地终端的第一数据，第一小组内的每个异地终端将第二协同界面变换为第四协同界面。Step 330: In response to the first grouping instruction, transform the first collaboration interface into a third collaboration interface, and the third collaboration interface displays the second data, the shared whiteboard control, and the first data of each remote terminal in the first group, Each remote terminal in the first group transforms the second collaboration interface into a fourth collaboration interface.

步骤340、接收作用于共享白板控件的第一控制操作。Step 340: Receive a first control operation acting on the shared whiteboard control.

步骤350、响应于第一控制操作，在第三协同界面中显示第一白板界面，并指示第一小组内的异地终端在第四协同界面中显示第二白板界面。Step 350: In response to the first control operation, display the first whiteboard interface in the third collaboration interface, and instruct the remote terminals in the first group to display the second whiteboard interface in the fourth collaboration interface.

举例而言，图7为本申请实施例提供的再一种协同界面示意图，其为第三协同界面示意图。参考图7，当前第三协同界面中显示有第一白板界面31、第一小组内异地终端的小组列表32以及控件栏33。其中，控件栏33中显示有停止共享白板功能的控件3301，且隐藏了部分控件。第三会议界面中还显示有当前讲话人的数据34。可理解，若本地的人员为当前讲话人，则数据34具体为第二数据，若第一小组内的任一异地终端的人员为当前讲话人，则数据34具体为第一数据。For example, FIG. 7 is a schematic diagram of still another collaboration interface provided by an embodiment of the present application, which is a schematic diagram of a third collaboration interface. Referring to FIG. 7 , the current third collaboration interface displays a first whiteboard interface 31 , a group list 32 of remote terminals in the first group, and a control bar 33 . Among them, a control 3301 for stopping the whiteboard sharing function is displayed in the control bar 33, and some controls are hidden. The data 34 of the current speaker is also displayed in the third conference interface. It can be understood that if the local person is the current speaker, the data 34 is the second data, and if the person in any remote terminal in the first group is the current speaker, the data 34 is the first data.

步骤360、接收作用于第一白板界面的第二控制操作。Step 360: Receive a second control operation acting on the first whiteboard interface.

步骤370、响应于第二控制操作，在第一白板界面中显示对应的第一书写轨迹。Step 370: In response to the second control operation, display the corresponding first writing track in the first whiteboard interface.

步骤380、将第一书写轨迹发送至第一小组内的异地终端，以使异地终端在第二白板界面中显示第一书写轨迹。Step 380: Send the first writing track to the remote terminal in the first group, so that the remote terminal displays the first writing track on the second whiteboard interface.

步骤390、接收第一小组内的异地终端发送的第二书写轨迹，第二书写轨迹显示在异地终端对应的第二白板界面中。Step 390: Receive the second writing track sent by the remote terminal in the first group, and display the second writing track on the second whiteboard interface corresponding to the remote terminal.

步骤3100、在第一白板界面中显示第二书写轨迹。Step 3100: Display the second writing track in the first whiteboard interface.

步骤3110、接收结束小组指令。Step 3110: Receive an instruction to end the group.

结束小组指令是指用于结束本次分组讨论的指令。一个实施例中，第一小组内的本地终端及异地终端均可使用小组管理控件时，第一小组内的每个参与协同的人员都可以控制分组讨论结束，实施例中，以本地的人员结束分组讨论为例进行描述，在分组讨论完成后，本地终端若检测到结束子控件接收到点击操作，则确定接收到结束小组指令，并向第一小组内的异地终端发送结束小组指令。或者是，第一小组内只有组长对应的终端可以控制分组讨论结束，若本地终端为组长使用的终端，则本地终端显示有小组管理控件，且当检测到结束子控件接收到点击操作时，确定接收到结束小组指令，并向第一小组内异地终端发送结束小组指令。另一个实施例中，当存在主持人时，由主持人结束小组讨论。主持人可以通过管理终端中显示的结束子控件发出结束小组指令，之后，管理终端将该结束小组指令发送至本地终端和第一小组内的异地终端，以使本地终端和第一小组内的异地终端接收到结束小组指令。The end group instruction refers to the instruction used to end the group discussion. In one embodiment, when both the local terminal and the remote terminal in the first group can use the group management control, each person participating in the collaboration in the first group can control the group discussion to end. In the embodiment, the local person ends. The group discussion is described as an example. After the group discussion is completed, if the local terminal detects that the end sub-control receives a click operation, it determines that the end group instruction is received, and sends the end group instruction to the remote terminal in the first group. Alternatively, only the terminal corresponding to the group leader in the first group can control the end of the group discussion. If the local terminal is the terminal used by the group leader, the local terminal displays the group management control, and when it is detected that the end sub-control receives a click operation , determine that the instruction to end the group is received, and send the instruction to end the group to the remote terminal in the first group. In another embodiment, when there is a moderator, the moderator ends the group discussion. The moderator can issue an instruction to end the group through the end sub-control displayed in the management terminal, and then the management terminal sends the instruction to end the group to the local terminal and the remote terminal in the first group, so that the local terminal and the remote terminal in the first group can be terminated. The terminal receives an instruction to end the group.

可理解，接收结束小组指令可以在本地终端加入第一小组后任一时刻进行。It can be understood that receiving the instruction to end the group can be performed at any moment after the local terminal joins the first group.

步骤3120、响应于结束小组指令，将第三协同界面恢复为第一协同界面。Step 3120: In response to the instruction to end the group, restore the third collaboration interface to the first collaboration interface.

在一实施例中，根据结束小组指令退出小组讨论，此时，将第三协同界面恢复为第一协同界面，即恢复显示全部异地终端的第一数据。相应的，组内异地终端同样由第四协同界面恢复为第二协同界面。可理解，若其他小组仍在进行小组讨论，则其他小组还是只显示其小组内的协同界面。若存在主持人，则当某一小组结束小组讨论后，主持人的管理终端在第六协同界面中对该小组对应的分组区域进行区分显示，或者是，删除第六协同界面中该小组对应的分组区域，以提示主持人小组讨论已经结束。在一实施例中，当全部小组讨论均结束后，主持人所使用的管理终端可将第六协同界面恢复为第一协同界面，或者是，在第六协同界面中提示是否将第六协同界面恢复至第一协同界面，并在主持人选择“是”时将第六协同界面恢复至第一协同界面。In one embodiment, the group discussion is exited according to the instruction to end the group. At this time, the third collaboration interface is restored to the first collaboration interface, that is, the display of the first data of all remote terminals is resumed. Correspondingly, the remote terminals in the group are also restored from the fourth collaboration interface to the second collaboration interface. Understandably, if other groups are still having group discussions, other groups still only display the collaboration interface within their groups. If there is a moderator, when a group ends the group discussion, the moderator's management terminal will differentiate and display the grouping area corresponding to the group in the sixth collaboration interface, or delete the group corresponding to the group in the sixth collaboration interface. Breakout area to alert the moderator that the group discussion has ended. In one embodiment, after all group discussions are over, the management terminal used by the moderator can restore the sixth collaboration interface to the first collaboration interface, or, in the sixth collaboration interface, prompt whether to restore the sixth collaboration interface. Restore to the first collaboration interface, and restore the sixth collaboration interface to the first collaboration interface when the host selects "Yes".

实施例中，由于接收结束小组指令时，第三协同界面的第一白板界面中还显示有第一书写轨迹和第二书写轨迹。因此，将第三协同界面恢复至第一协同界面时，还应结束第一小组内的共享白板功能，并保存第一白板界面的内容，以便于后续查询和使用。此时，响应于结束小组指令时，还包括：保存第一白板界面内的第一界面内容。需说明，第一界面内容包含当前第一白板界面中的第一书写轨迹和第二书写轨迹。若在第一白板界面中***了图片、文档、音频、视频等内容，则第一界面内容中还包括***的内容。第一界面内容的保存格式实施例不做限定。可选的，保存第一界面内容可以由电子白板应用程序执行，并且协同应用程序可以结合自身情况调用保存的第一界面内容。可理解，第一小组内的异地终端同样可以保存第一界面内容。In the embodiment, when the instruction to end the group is received, the first whiteboard interface of the third collaboration interface also displays the first writing track and the second writing track. Therefore, when restoring the third collaboration interface to the first collaboration interface, the shared whiteboard function in the first group should also be terminated, and the content of the first whiteboard interface should be saved for subsequent query and use. At this time, when responding to the instruction to end the group, the method further includes: saving the first interface content in the first whiteboard interface. It should be noted that the content of the first interface includes the first writing track and the second writing track in the current first whiteboard interface. If content such as pictures, documents, audios, videos, etc. is inserted into the first whiteboard interface, the content of the first interface also includes the inserted content. The embodiment of the storage format of the first interface content is not limited. Optionally, the saving of the first interface content may be performed by an electronic whiteboard application, and the collaborative application may call the saved first interface content according to its own situation. It can be understood that the remote terminals in the first group can also save the content of the first interface.

实施例中，第一小组内的第一界面内容还可以共享至其他小组中，此时，协同操作方法中响应于第一控制操作，在第三协同界面中显示第一白板界面之后，还包括：接收组间白板共享指令；响应于组间白板共享指令，将第一白板界面的第一界面内容发送至第一小组外的异地终端，以使异地终端在对应的第二白板界面中显示所述第一界面内容。In the embodiment, the content of the first interface in the first group may also be shared with other groups. In this case, in response to the first control operation in the collaborative operation method, after displaying the first whiteboard interface in the third collaborative interface, the method further includes: : Receive the whiteboard sharing instruction between groups; in response to the whiteboard sharing instruction between groups, send the first interface content of the first whiteboard interface to the remote terminal outside the first group, so that the remote terminal can display all the information on the corresponding second whiteboard interface. Describe the content of the first interface.

在一实施例中，组间白板共享指令是指用于将第一小组内的第一白板界面共享至其他至少一个小组的异地终端中。实施例中，以本地终端作为白板内容共享的发起者并向其他组进行共享为例进行描述。一种可选方式，在小组讨论时，本地终端显示有小组管理控件，且小组管理控件中存在用于展示小组内白板界面的展示白板子控件，当检测到展示白板子控件接收到控制操作(如单击操作)时，确定接收到组间白板共享指令，并通知其他小组的全部异地终端，以使异地终端明确需要对本地终端的第一界面内容进行接收并展示。此时，本地终端可以先确认分组情况(其中，确定分组情况的手段实施例不做限定，如向全部其他小组发送一用于查询所属分组的请求，并接收其他小组根据该请求反馈的所属分组的标识，之后，根据该标识明确分组情况，再如向主持人所在的管理终端发送一用于查询分组情况的请求，并接收管理终端根据该请求反馈的分组信息，其中，分组信息中可以包括小组的标识以及组内包含的异地终端，本地终端可以根据分组信息明确分组情况)，之后，再由本地人员根据分组情况选择共享的小组。可理解，本地的人员可以在小组讨论过程中发出组间白板共享指令，也可以在小组讨论结束后发出组间白板共享指令。可选的，当小组讨论结束后，若当前协同界面还显示有小组管理控件，则本地的人员可以通过展示白板子控件发出组间白板共享指令。若当前会议界面未显示有小组管理控件，则本地的人员可以在恢复第一协同界面后先启动共享白板功能，之后，通过在第一白板界面中显示已保存的第一界面内容的方式实现共享，此时，在第一白板界面中显示第一界面内容的指令可以认为是组间白板共享指令。另一种可选方式，视频会议存在主持人时，本地终端可以与管理终端进行数据通信，以使管理终端通知主持人当前存在共享白板的需求，之后，主持人在管理终端中选择第一小组所在的分组区域，并针对展示白板子控件发出控制操作，此时，管理终端根据主持人的操作通知本地终端已经同意进行共享白板的需求，当前，已经同意进行共享白板需求的通知可以认为是组间白板共享指令。相应的，主持人通知需要显示第一白板内容的小组内的全部异地终端(可通过选择分组区域的方式确定需要显示第一白板内容的小组)，以使异地终端明确需要对本地终端的第一白板内容进行接收并展示。In one embodiment, the whiteboard sharing instruction between groups refers to sharing the first whiteboard interface in the first group to the remote terminals of at least one other group. In the embodiment, description is given by taking the local terminal as an initiator of whiteboard content sharing and sharing with other groups as an example. In an optional way, during the group discussion, the local terminal displays the group management control, and there is a display whiteboard sub-control for displaying the whiteboard interface in the group in the group management control. When it is detected that the display whiteboard sub-control receives a control operation ( For example, when the operation is clicked), it is determined that the whiteboard sharing instruction between groups is received, and all remote terminals of other groups are notified, so that the remote terminals clearly need to receive and display the content of the first interface of the local terminal. At this time, the local terminal can first confirm the grouping situation (wherein, the means for determining the grouping situation is not limited in the embodiment, such as sending a request for inquiring the belonging group to all other groups, and receiving the belonging grouping feedback from other groups according to the request) After that, the grouping situation is clarified according to the identification, and another example is to send a request for querying the grouping situation to the management terminal where the host is located, and receive the grouping information fed back by the management terminal according to the request, wherein the grouping information may include The identification of the group and the remote terminals included in the group, the local terminal can specify the grouping situation according to the grouping information), and then the local personnel will select the shared group according to the grouping situation. It is understandable that local personnel can issue an inter-group whiteboard sharing instruction during the group discussion, or issue an inter-group whiteboard sharing instruction after the group discussion ends. Optionally, after the group discussion is over, if the current collaboration interface also displays a group management control, local personnel can issue an inter-group whiteboard sharing instruction by displaying the whiteboard sub-control. If there is no group management control displayed on the current conference interface, local personnel can start the shared whiteboard function after restoring the first collaboration interface, and then realize sharing by displaying the saved first interface content in the first whiteboard interface. , at this time, the instruction for displaying the content of the first interface in the first whiteboard interface may be regarded as an instruction for sharing whiteboards between groups. In another optional way, when there is a moderator in the video conference, the local terminal can perform data communication with the management terminal, so that the management terminal notifies the moderator that there is a current need to share the whiteboard. After that, the moderator selects the first group in the management terminal. It is located in the grouping area, and sends out control operations for the display whiteboard sub-control. At this time, the management terminal notifies the local terminal that it has agreed to share the whiteboard according to the operation of the host. Currently, the notification that has agreed to share the whiteboard can be considered as a group. share instructions between whiteboards. Correspondingly, the host notifies all remote terminals in the group that need to display the content of the first whiteboard (the group that needs to display the content of the first whiteboard can be determined by selecting the grouping area), so that the remote terminal clearly needs to display the first whiteboard content of the local terminal. Whiteboard content is received and displayed.

示例性的，对组间白板共享指令进行响应的过程为：将第一界面内容发送至所选择的其他小组的异地终端，以使异地终端在其第二白板界面中进行显示。可选的，若异地终端处于小组讨论的状态，则本地终端可以将第一界面内容发送至其他小组内的某一异地终端，相应的，接收到第一界面内容的异地终端在其小组内启动共享白板功能，以在组内分享第一界面内容。可理解，若共享第一书写内容时，异地终端未显示第二白板界面，则先显示第二白板界面，之后再显示共享的第一界面内容。Exemplarily, the process of responding to the inter-group whiteboard sharing instruction is: sending the content of the first interface to the remote terminals of other selected groups, so that the remote terminals can display in their second whiteboard interface. Optionally, if the remote terminal is in a group discussion state, the local terminal can send the first interface content to a certain remote terminal in another group, and correspondingly, the remote terminal that receives the first interface content starts in its group. Share the whiteboard function to share the first interface content within the group. It can be understood that if the remote terminal does not display the second whiteboard interface when sharing the first written content, the second whiteboard interface is displayed first, and then the shared first interface content is displayed.

需说明，接收共享的异地终端仅显示第一界面内容，而无法进行操作。It should be noted that the remote terminal receiving the sharing only displays the content of the first interface and cannot perform operations.

可理解，除了第一小组向其他小组共享第一界面内容外，其他小组也可以将其对应的界面内容共享给第一小组和/或其他的至少一个小组。实施例中，以其他小组将其对应的界面内容共享给第一小组为例进行描述，此时，协同操作方法还包括：接收第三小组发送的第二界面内容，第二界面内容为第三小组中共享的白板界面内容；在第一白板界面中显示第二界面内容。It can be understood that, in addition to the first group sharing the first interface content with other groups, other groups may also share their corresponding interface content with the first group and/or at least one other group. In the embodiment, other groups share their corresponding interface content with the first group as an example for description. In this case, the collaborative operation method further includes: receiving the second interface content sent by the third group, and the second interface content is the third interface content. The whiteboard interface content shared in the group; the second interface content is displayed in the first whiteboard interface.

在一实施例中，将向第一小组发起共享界面内容的小组记为第三小组。第三小组共享的界面内容记为第二界面内容。第三小组中任一异地终端(可由第三小组内的人员讨论确定)可以作为共享的发起端。第三小组对第二界面内容进行共享的过程与第一小组对第一界面内容进行共享的过程相同，在此不做赘述。实施例中，以本地终端接收第二界面内容为例进行描述，此时，本地终端在第一白板界面中显示第二界面内容。In one embodiment, the group that initiates sharing of interface content to the first group is recorded as the third group. The interface content shared by the third group is recorded as the second interface content. Any remote terminal in the third group (which can be determined by the personnel in the third group) can be used as the initiating end of sharing. The process of the third group sharing the second interface content is the same as the process of the first group sharing the first interface content, which is not repeated here. In the embodiment, the local terminal receives the second interface content as an example for description. At this time, the local terminal displays the second interface content in the first whiteboard interface.

上述，在讨论结束后，可以保存第一白板界面，以便于后续查看和使用。在一实施例中，还可以将小组内电子白板中的内容共享至非小组内的异地终端中进行展示，便于异地的人员明确小组讨论情况，增加了电子白板共享的灵活性。As mentioned above, after the discussion is over, the first whiteboard interface can be saved for subsequent viewing and use. In one embodiment, the content in the electronic whiteboard in the group can also be shared to the remote terminal outside the group for display, which facilitates the personnel in different places to clarify the group discussion situation and increases the flexibility of electronic whiteboard sharing.

在上述实施例的基础上，除了组内共享第一书写轨迹外，还可以组内共享任一终端的桌面。实施例中，以共享本地终端为例进行描述。此时，所述第三协同界面中还显示有桌面共享控件；在第三协同界面中显示第一白板界面之后之后，还包括：接收作用于桌面共享控件的第三控制操作；响应于第三控制操作，将第三协同界面更换为本地桌面；将本地桌面发送至第一小组内的异地终端，以使异地终端将对应的第四协同界面更换为本地桌面。On the basis of the above embodiment, in addition to sharing the first writing track within the group, the desktop of any terminal can also be shared within the group. In the embodiment, the sharing of the local terminal is taken as an example for description. At this time, the desktop sharing control is also displayed in the third cooperation interface; after the first whiteboard interface is displayed in the third cooperation interface, the method further includes: receiving a third control operation acting on the desktop sharing control; responding to the third The control operation is to replace the third collaboration interface with a local desktop; the local desktop is sent to the remote terminal in the first group, so that the remote terminal replaces the corresponding fourth collaborative interface with the local desktop.

其中，桌面共享控件用于实现共享桌面功能。桌面共享控件的显示位置可以根据实际情况设定，例如桌面共享控件集成在共享白板控件所在的控件栏中。实施例中将作用于桌面共享控件的控制操作记为第三控制操作，第三控制操作用于启动共享桌面功能，第三控制操作可为触摸操作，也可为通过外接设备(如鼠标)发出的操作。可选的，启动共享桌面功能后，若再次接收到针对桌面共享控件的第三控制操作，则确定第三控制操作用于结束共享桌面功能功能。还可选的，启动共享桌面功能后，将桌面共享控件变为停止共享控件，其中，停止共享控件用于结束共享桌面功能。本地终端若检测到针对停止共享控件的操作时，确定结束共享桌面功能。Among them, the desktop sharing control is used to realize the function of sharing the desktop. The display position of the desktop sharing control can be set according to the actual situation. For example, the desktop sharing control is integrated in the control bar where the shared whiteboard control is located. In the embodiment, the control operation acting on the desktop sharing control is recorded as the third control operation, the third control operation is used to start the shared desktop function, and the third control operation can be a touch operation, or can be issued through an external device (such as a mouse). operation. Optionally, after starting the shared desktop function, if a third control operation for the desktop sharing control is received again, it is determined that the third control operation is used to end the shared desktop function. Optionally, after the desktop sharing function is started, the desktop sharing control is changed to a stop sharing control, wherein the stop sharing control is used to end the sharing desktop function. If the local terminal detects an operation for stopping the sharing of controls, it determines to end the sharing desktop function.

在一实施例中，启动共享桌面功能时，将第三协同界面切换至后台，并显示出本地桌面。之后，对本地桌面(即显示屏的显示内容)进行录制，并将录制后的数据发送至第一小组内的每个异地终端。其中，录制手段实施例不另做描述。在录制过程中，本地的人员可以在桌面中进行操作，且操作过程同样会被本地终端录制。可理解，将录制后的数据发送至第一小组内的每个异地终端的过程相当于将本地桌面发送至第一小组内异地终端的过程。In one embodiment, when the shared desktop function is activated, the third collaboration interface is switched to the background, and the local desktop is displayed. After that, record the local desktop (that is, the display content of the display screen), and send the recorded data to each remote terminal in the first group. The embodiment of the recording means will not be described otherwise. During the recording process, local personnel can operate on the desktop, and the operation process will also be recorded by the local terminal. It can be understood that the process of sending the recorded data to each remote terminal in the first group is equivalent to the process of sending the local desktop to the remote terminals in the first group.

异地终端接收到本地桌面后，在第四协同界面中显示出一块用于显示本地桌面的子界面。一个实施例中，该子界面与第二白板界面所在的区域相同，即显示子界面时第四协同界面的变化过程与在第四协同界面中显示第二白板界面时的变化过程相同。在一实施例中，显示子界面后，在子界面中显示接收到的本地桌面，以实现组内共享桌面功能。After receiving the local desktop, the remote terminal displays a sub-interface for displaying the local desktop in the fourth collaborative interface. In one embodiment, the sub-interface is located in the same area as the second whiteboard interface, that is, the change process of the fourth collaboration interface when the sub-interface is displayed is the same as the change process when the second whiteboard interface is displayed in the fourth collaboration interface. In one embodiment, after the sub-interface is displayed, the received local desktop is displayed in the sub-interface, so as to realize the function of sharing the desktop within the group.

由于当前本地终端处于小组讨论的状态，因此，共享桌面功能具体为在第一小组内共享桌面。实际应用中，若本地终端并未处于小组讨论的状态，则共享桌面功能还可以是在参与协同的全部异地终端中共享桌面，该过程与第一小组内共享桌面的过程相同。Since the current local terminal is in a state of group discussion, the desktop sharing function is specifically to share the desktop in the first group. In practical applications, if the local terminal is not in the state of group discussion, the desktop sharing function may also be to share the desktop among all remote terminals participating in the collaboration, and the process is the same as the process of sharing the desktop in the first group.

在一实施例中，结束共享桌面功能后，本地终端将第三协同界面切换回前台进行显示。第一小组内的异地终端在第四协同界面中删除子区域，并恢复至显示子区域之间的内容。In one embodiment, after the desktop sharing function ends, the local terminal switches the third collaboration interface back to the foreground for display. The remote terminals in the first group delete the sub-areas in the fourth collaboration interface, and restore to display the content between the sub-areas.

需说明，接收作用于所述桌面共享控件的第三控制操作的操作也可以在将所述第一协同界面变换为第三协同界面之后执行。实施例对此不作限定。It should be noted that the operation of receiving the third control operation acting on the desktop sharing control may also be performed after the first cooperation interface is transformed into a third cooperation interface. The embodiment does not limit this.

上述，通过共享桌面控件实现了小组讨论时组内共享本地桌面，丰富了协同功能性，提升了参加协同人员的使用体验。As mentioned above, through the shared desktop control, the local desktop is shared within the group during group discussions, which enriches the collaboration functionality and improves the use experience of the participants in the collaboration.

图8为本申请一个实施例提供的一种协同操作装置的结构示意图。参考图8，该协同操作装置包括：第一显示模块401、第一接收模块402、第二显示模块403、第二接收模块404、第三显示模块405、第三接收模块406、第四显示模块407、第一共享模块408、第四接收模块409、第五显示模块4010。FIG. 8 is a schematic structural diagram of a cooperative operation apparatus according to an embodiment of the present application. 8 , the cooperative operation device includes: a first display module 401, a first receiving module 402, a second display module 403, a second receiving module 404, a third display module 405, a third receiving module 406, and a fourth display module 407 , a first sharing module 408 , a fourth receiving module 409 , and a fifth display module 4010 .

其中，第一显示模块401，用于显示第一协同界面，所述第一协同界面中显示有参与协同的每个异地终端的第一数据和本地终端的第二数据，每个所述异地终端中显示有第二协同界面，所述第一数据和所述第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种；第一接收模块402，用于接收第一分组指令，所述第一分组指令用于指示本地终端加入第一小组，所述第一小组包括所述本地终端以及至少一个所述异地终端；第二显示模块403，用于响应于所述第一分组指令，将所述第一协同界面变换为第三协同界面，所述第三协同界面中显示有所述第二数据、共享白板控件、所述第一小组内每个异地终端的第一数据，所述第一小组内的每个所述异地终端将所述第二协同界面变换为第四协同界面；第二接收模块404，用于接收作用于所述共享白板控件的第一控制操作；第三显示模块405，用于响应于所述第一控制操作，在所述第三协同界面中显示第一白板界面，并指示所述第一小组内的异地终端在所述第四协同界面中显示第二白板界面；第三接收模块406，用于接收作用于所述第一白板界面的第二控制操作；第四显示模块407，用于响应于所述第二控制操作，在所述第一白板界面中显示对应的第一书写轨迹；第一共享模块408，用于将所述第一书写轨迹发送至所述第一小组内的异地终端，以使所述异地终端在所述第二白板界面中显示所述第一书写轨迹；第四接收模块409，用于接收所述第一小组内的异地终端发送的第二书写轨迹，所述第二书写轨迹显示在所述异地终端对应的第二白板界面中；第五显示模块4010，用于在所述第一白板界面中显示所述第二书写轨迹。Wherein, the first display module 401 is used to display a first collaboration interface, wherein the first collaboration interface displays the first data of each remote terminal participating in the collaboration and the second data of the local terminal, each of the remote terminals A second collaboration interface is displayed in the , and the first data and the second data include at least one of video picture data, audio data and identification data; the first receiving module 402 is used to receive the first grouping instruction , the first grouping instruction is used to instruct the local terminal to join the first group, and the first group includes the local terminal and at least one of the remote terminals; the second display module 403 is used to respond to the first grouping instruction to transform the first collaboration interface into a third collaboration interface, and the third collaboration interface displays the second data, the shared whiteboard control, and the first data of each remote terminal in the first group, Each of the remote terminals in the first group transforms the second collaboration interface into a fourth collaboration interface; the second receiving module 404 is configured to receive the first control operation acting on the shared whiteboard control; Three display modules 405, configured to display the first whiteboard interface in the third collaboration interface in response to the first control operation, and instruct the remote terminals in the first group to display the fourth collaboration interface The second whiteboard interface; the third receiving module 406, for receiving the second control operation acting on the first whiteboard interface; the fourth display module 407, for responding to the second control operation, in the first The corresponding first writing track is displayed on the whiteboard interface; the first sharing module 408 is configured to send the first writing track to the remote terminals in the first group, so that the remote terminals can be displayed on the second whiteboard. The first writing track is displayed on the interface; the fourth receiving module 409 is configured to receive the second writing track sent by the remote terminal in the first group, and the second writing track is displayed on the first writing track corresponding to the remote terminal. In the second whiteboard interface; the fifth display module 4010 is configured to display the second writing track in the first whiteboard interface.

在上述实施例的基础上，还包括：第五接收模块，用于接收结束小组指令；第六显示模块，用于响应于所述结束小组指令，将所述第三协同界面恢复为所述第一协同界面。On the basis of the above-mentioned embodiment, the method further includes: a fifth receiving module, configured to receive an instruction to end the group; and a sixth display module, configured to restore the third collaboration interface to the first group in response to the instruction to end the group a collaborative interface.

在上述实施例的基础上，还包括：保存模块，用于响应于所述结束小组指令时，保存所述第一白板界面内的第一界面内容。On the basis of the above-mentioned embodiment, the method further includes: a saving module, configured to save the first interface content in the first whiteboard interface in response to the instruction for ending the group.

在上述实施例的基础上，还包括：第六接收模块，用于在所述第一白板界面中显示所述第二书写轨迹之后，接收退出小组指令；第七显示模块，用于响应于所述退出小组指令，将所述第三协同界面恢复至所述第一协同界面；第七接收模块，用于接收第二分组指令，所述第二分组指令用于指示本地终端加入第二小组；第八显示模块，用于响应于所述第二分组指令，将所述第一协同界面变换为第五协同界面，所述第五协同界面中显示有所述第二数据、共享白板控件、所述第二小组内每个所述异地终端的第一数据。On the basis of the above-mentioned embodiment, it also includes: a sixth receiving module, for receiving an instruction to exit the group after displaying the second writing track in the first whiteboard interface; a seventh display module, for responding to the the exiting group instruction, restoring the third collaboration interface to the first collaboration interface; a seventh receiving module, for receiving a second grouping instruction, the second grouping instruction being used to instruct the local terminal to join the second group; An eighth display module, configured to transform the first collaboration interface into a fifth collaboration interface in response to the second grouping instruction, and the fifth collaboration interface displays the second data, shared whiteboard controls, all the first data of each of the remote terminals in the second group.

在上述实施例的基础上，还包括：第八接收模块，用于响应于所述第一控制操作，在所述第三协同界面中显示第一白板界面之后，接收组间白板共享指令；第二共享模块，用于响应于所述组间白板共享指令，将所述第一白板界面的第一界面内容发送至所述第一小组外的异地终端，以使所述异地终端在对应的第二白板界面中显示所述第一界面内容。On the basis of the above embodiment, the method further includes: an eighth receiving module, configured to receive an inter-group whiteboard sharing instruction after displaying the first whiteboard interface in the third collaboration interface in response to the first control operation; The second sharing module is configured to send the first interface content of the first whiteboard interface to the remote terminal outside the first group in response to the whiteboard sharing instruction between the groups, so that the remote terminal is in the corresponding second The first interface content is displayed on the second whiteboard interface.

在上述实施例的基础上，还包括：第九接收模块，用于接收所述第三小组发送的第二界面内容，所述第二界面内容为所述第三小组中共享的白板界面内容；第九显示模块，用于在所述第一白板界面中显示所述第二界面内容。Based on the above embodiment, the method further includes: a ninth receiving module, configured to receive the second interface content sent by the third group, where the second interface content is the whiteboard interface content shared by the third group; A ninth display module, configured to display the second interface content in the first whiteboard interface.

在上述实施例的基础上，所述第三协同界面中还显示有桌面共享控件，还包括：第十接收模块，用于在所述第三协同界面中显示第一白板界面之后，接收作用于所述桌面共享控件的第三控制操作；第十显示模块，用于响应于所述第三控制操作，将所述第三协同界面更换为本地桌面；第三共享模块，用于将所述本地桌面发送至所述第一小组内的异地终端，以使所述异地终端将对应的第四协同界面更换为所述本地桌面。On the basis of the above-mentioned embodiment, the third collaboration interface also displays a desktop sharing control, and further includes: a tenth receiving module, configured to receive the action on the third collaboration interface after the first whiteboard interface is displayed in the third collaboration interface. a third control operation of the desktop sharing control; a tenth display module, used for replacing the third collaboration interface with a local desktop in response to the third control operation; a third sharing module, used to display the local desktop The desktop is sent to the remote terminal in the first group, so that the remote terminal replaces the corresponding fourth collaboration interface with the local desktop.

在上述实施例的基础上，所述本地终端为对参与协同的所有所述异地终端进行管理的管理终端，所述第一协同界面中还显示有分组讨论控件；还包括：第十一接收模块，用于接收作用于所述分组讨论控件的第四控制操作；第十一显示模块，用于响应于所述第四控制操作，将所述第一协同界面变换为第六协同界面，所述第六协同界面中显示有小组管理控件以及多个分组区域，每个所述分组区域对应一个小组，所述小组管理控件用于实现小组管理；第一发送模块，用于向每个所述异地终端发送第三分组指令，以使所述异地终端根据所述第三分组指令加入相应的小组。On the basis of the above embodiment, the local terminal is a management terminal that manages all the remote terminals participating in the collaboration, and the first collaboration interface also displays a group discussion control; further comprising: an eleventh receiving module , for receiving the fourth control operation acting on the group discussion control; the eleventh display module, for transforming the first collaboration interface into a sixth collaboration interface in response to the fourth control operation, the The sixth collaboration interface displays a group management control and a plurality of grouping areas, each of the grouping areas corresponds to a group, and the group management control is used to implement group management; the first sending module is used to send each remote The terminal sends a third grouping instruction, so that the remote terminal joins the corresponding group according to the third grouping instruction.

在上述实施例的基础上，还包括：第十二接收模块，用于向每个所述异地终端发送第三分组指令，以使所述异地终端根据所述第三分组指令加入相应的小组之后，接收针对于第一目标分组区域的第五控制操作；第十二显示模块，用于响应于所述第五控制操作，在所述第六协同界面中显示所述第一目标分组区域对应小组的协同界面。On the basis of the above embodiment, the method further includes: a twelfth receiving module, configured to send a third grouping instruction to each of the remote terminals, so that the remote terminals join the corresponding group according to the third grouping instruction. , receiving a fifth control operation for the first target grouping area; a twelfth display module, configured to display the group corresponding to the first target grouping area in the sixth collaboration interface in response to the fifth control operation collaboration interface.

在上述实施例的基础上，还包括：第十三接收模块，用于向每个所述异地终端发送第三分组指令，以使所述异地终端根据所述第三分组指令加入相应的小组之后，接收针对于第二目标分组区域的第六控制操作和针对于第三目标分组区域的第七控制操作；第二发送模块，用于响应于所述第六控制操作和所述第七控制操作，将所述第二目标分组区域对应小组的协同界面，发送到所述第三目标分组区域对应小组的协同界面进行显示。On the basis of the above embodiment, the method further includes: a thirteenth receiving module, configured to send a third grouping instruction to each of the remote terminals, so that the remote terminals join the corresponding group according to the third grouping instruction. , receiving a sixth control operation for the second target grouping area and a seventh control operation for the third target grouping area; a second sending module for responding to the sixth control operation and the seventh control operation , sending the collaboration interface of the group corresponding to the second target grouping area to the collaboration interface of the group corresponding to the third target grouping area for display.

在上述实施例的基础上，第一共享模块408包括：元数据获取单元，用于获取所述第一书写轨迹的元数据；数据编码单元，用于编码所述元数据，以得到编码数据；数据混合单元，用于将所述编码数据和所述第二数据进行混合，得到数据包；数据发送单元，用于将所述数据包发送至所述第一小组内的异地终端，以使所述异地终端通过所述数据包得到所述第二数据和所述编码数据并在所述第二白板界面中显示基于所述编码数据得到的第一书写轨迹。On the basis of the above-mentioned embodiment, the first sharing module 408 includes: a metadata acquisition unit for acquiring metadata of the first writing track; a data encoding unit for encoding the metadata to obtain encoded data; a data mixing unit, configured to mix the encoded data and the second data to obtain a data packet; a data sending unit, configured to send the data packet to the remote terminal in the first group, so that all The remote terminal obtains the second data and the encoded data through the data packet, and displays the first writing track obtained based on the encoded data on the second whiteboard interface.

上述提供的协同操作装置集成在协同操作终端中，可用于执行上述任意实施例提供的协同操作方法涉及的操作，具备相应的功能和有益效果。The cooperative operation device provided above is integrated in a cooperative operation terminal, and can be used to perform the operations involved in the cooperative operation method provided in any of the foregoing embodiments, and has corresponding functions and beneficial effects.

值得注意的是，上述协同操作装置的实施例中，所包括的各个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限制本申请的保护范围。It is worth noting that in the above embodiments of the cooperative operation device, the units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; The specific names of the functional units are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application.

图9为本申请一个实施例提供的一种协同操作终端的结构示意图。如图9所示，该协同操作终端以交互智能平板为例进行描述，此时协同操作终端10包括至少一个处理器11、至少一个网络接口12、用户接口13、存储器14以及至少一个通信总线15。FIG. 9 is a schematic structural diagram of a collaborative operation terminal according to an embodiment of the present application. As shown in FIG. 9 , the collaborative operation terminal is described by taking an interactive smart tablet as an example. At this time, the collaborative operation terminal 10 includes at least one processor 11 , at least one network interface 12 , user interface 13 , memory 14 and at least one communication bus 15 .

其中，通信总线15用于实现这些组件之间的连接通信。Among them, the communication bus 15 is used to realize the connection and communication between these components.

其中，用户接口13包括显示屏、摄像头，可选用户接口13还可以包括标准的有线接口、无线接口。显示屏可以显示第一协同界面，并根据处理器11的控制更新显示。The user interface 13 includes a display screen and a camera, and the optional user interface 13 may also include a standard wired interface and a wireless interface. The display screen can display the first collaboration interface, and the display can be updated according to the control of the processor 11 .

其中，网络接口12可选包括标准的有线接口、无线接口(如Wi-Fi接口)。Wherein, the network interface 12 may optionally include a standard wired interface and a wireless interface (eg, a Wi-Fi interface).

其中，处理器11可以包括一个或多个处理核心。处理器11利用各种接口和线路连接整个协同操作终端10内的各个部分，通过运行或执行存储在处理器11内的指令、程序、代码集或指令集，以及调用存储在存储器14内的数据，执行协同操作终端10的各种功能和处理数据。可选的，处理器11可以采用数字信号处理(Digital Signal Processing，DSP)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)、可编程逻辑阵列(Programmable logic arrays，PLA)中的至少一种硬件形式来实现。处理器11可集成中央处理器(Central Processing Unit，CPU)、图像处理器(Graphics Processing Unit，GPU)和调制解调器等中的一种或几种的组合。其中，CPU主要处理操作***、用户界面和应用程序等；GPU用于负责显示屏所需要显示的内容的渲染和绘制；调制解调器用于处理无线通信。可以理解的是，上述调制解调器也可以不集成到处理器11中，单独通过一块芯片进行实现。The processor 11 may include one or more processing cores. The processor 11 uses various interfaces and lines to connect various parts in the entire cooperative operation terminal 10, by running or executing the instructions, programs, code sets or instruction sets stored in the processor 11, and calling the data stored in the memory 14. , perform various functions of the cooperative operation terminal 10 and process data. Optionally, the processor 11 may adopt at least one of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable logic arrays, PLA). A hardware form is implemented. The processor 11 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processor (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the display screen; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 11, and is implemented by a single chip.

其中，存储器14可以包括随机存储器(Random Access Memory，RAM)，也可以包括只读存储器(Read-Only Memory)。可选的，该存储器14包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器14可用于存储指令、程序、代码、代码集或指令集。存储器14可包括存储程序区和存储数据区，其中，存储程序区可存储用于实现操作***的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现上述各个方法实施例的指令等；存储数据区可存储上面各个方法实施例中涉及到的数据等。存储器14可选的还可以是至少一个位于远离前述处理器11的存储装置。如图9所示，作为一种计算机存储介质的存储器14中可以包括操作***、网络通信模块、用户接口模块以及协同操作终端的操作应用程序。The memory 14 may include a random access memory (Random Access Memory, RAM), or may include a read-only memory (Read-Only Memory). Optionally, the memory 14 includes a non-transitory computer-readable storage medium. Memory 14 may be used to store instructions, programs, codes, sets of codes or sets of instructions. The memory 14 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like used to implement the above method embodiments; the storage data area may store the data and the like involved in the above method embodiments. The memory 14 can optionally also be at least one storage device located away from the aforementioned processor 11 . As shown in FIG. 9 , the memory 14 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an operation application program of the cooperative operation terminal.

在图9所示的协同操作终端10中，用户接口13主要用于为用户提供输入的接口，获取用户输入的数据；而处理器11可以用于调用存储器14中存储的协同操作终端的操作应用程序，并具体执行上述实施例中协同操作方法中的相关操作。In the collaborative operation terminal 10 shown in FIG. 9 , the user interface 13 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 11 can be used to call the operation application of the collaborative operation terminal stored in the memory 14 program, and specifically execute the relevant operations in the cooperative operation method in the above-mentioned embodiment.

上述协同操作终端，可用于执行上述任意实施例提供的协同操作方法，具备相应的功能和有益效果。The above cooperative operation terminal can be used to execute the cooperative operation method provided by any of the above embodiments, and has corresponding functions and beneficial effects.

此外，本申请实施例还提供一种包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行本申请任意实施例所提供的协同操作方法中的相关操作，且具备相应的功能和有益效果。In addition, the embodiments of the present application also provide a storage medium containing computer-executable instructions, when executed by a computer processor, the computer-executable instructions are used to perform relevant operations in the cooperative operation method provided by any embodiment of the present application , and has corresponding functions and beneficial effects.

本领域内的技术人员应明白，本申请的实施例可提供为方法、***、或计算机程序产品。As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product.

因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。本申请是参照根据本申请实施例的方法、设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flows of the flowcharts and/or the block or blocks of the block diagrams. These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

在一个示例性配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。存储器可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。In one exemplary configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带，磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括暂存电脑可读媒体(transitorymedia)，如调制的数据信号和载波。Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or inherent to such a process, method, article of manufacture or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture or apparatus that includes the element.

注意，上述仅为本申请的较佳实施例及所运用技术原理。本领域技术人员会理解，本申请不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本申请的保护范围。因此，虽然通过以上实施例对本申请进行了较为详细的说明，但是本申请不仅仅限于以上实施例，在不脱离本申请构思的情况下，还可以包括更多其他等效实施例，而本申请的范围由所附的权利要求范围决定。Note that the above are only preferred embodiments of the present application and applied technical principles. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application. The scope is determined by the scope of the appended claims.

Claims

一种协同操作方法，其中，包括：A collaborative operation method, which includes:

显示第一协同界面，所述第一协同界面中显示有参与协同的每个异地终端的第一数据和本地终端的第二数据，每个所述异地终端中显示有第二协同界面，所述第一数据和所述第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种；A first collaboration interface is displayed, the first data of each remote terminal participating in the collaboration and the second data of the local terminal are displayed, and each of the remote terminals is displayed with a second collaboration interface, the Both the first data and the second data include at least one of video picture data, audio data and identification data;

接收第一分组指令，所述第一分组指令用于指示本地终端加入第一小组，所述第一小组包括所述本地终端以及至少一个所述异地终端；receiving a first grouping instruction, where the first grouping instruction is used to instruct a local terminal to join a first group, where the first group includes the local terminal and at least one of the remote terminals;

响应于所述第一分组指令，将所述第一协同界面变换为第三协同界面，所述第三协同界面中显示有所述第二数据、共享白板控件、所述第一小组内每个异地终端的第一数据，所述第一小组内的每个所述异地终端将所述第二协同界面变换为第四协同界面；In response to the first grouping instruction, the first collaboration interface is transformed into a third collaboration interface, and the third collaboration interface displays the second data, the shared whiteboard control, and each of the first group. The first data of the remote terminal, each of the remote terminals in the first group transforms the second collaboration interface into a fourth collaboration interface;

接收作用于所述共享白板控件的第一控制操作；receiving a first control operation acting on the shared whiteboard control;

响应于所述第一控制操作，在所述第三协同界面中显示第一白板界面，并指示所述第一小组内的异地终端在所述第四协同界面中显示第二白板界面；In response to the first control operation, displaying a first whiteboard interface in the third collaboration interface, and instructing remote terminals in the first group to display a second whiteboard interface in the fourth collaboration interface;

接收作用于所述第一白板界面的第二控制操作；receiving a second control operation acting on the first whiteboard interface;

响应于所述第二控制操作，在所述第一白板界面中显示对应的第一书写轨迹；In response to the second control operation, displaying a corresponding first writing track in the first whiteboard interface;

将所述第一书写轨迹发送至所述第一小组内的异地终端，以使所述异地终端在所述第二白板界面中显示所述第一书写轨迹；sending the first writing track to the remote terminal in the first group, so that the remote terminal displays the first writing track in the second whiteboard interface;

接收所述第一小组内的异地终端发送的第二书写轨迹，所述第二书写轨迹显示在所述异地终端对应的第二白板界面中；receiving a second writing track sent by a remote terminal in the first group, where the second writing track is displayed on a second whiteboard interface corresponding to the remote terminal;

在所述第一白板界面中显示所述第二书写轨迹。The second writing track is displayed in the first whiteboard interface.
根据权利要求1所述的协同操作方法，其中，还包括：The collaborative operation method according to claim 1, further comprising:

接收结束小组指令；receive instructions to end the group;

响应于所述结束小组指令，将所述第三协同界面恢复为所述第一协同界面。In response to the ending group instruction, the third collaboration interface is restored to the first collaboration interface.
根据权利要求1所述的协同操作方法，其中，所述响应于所述结束小组指令时，还包括：The cooperative operation method according to claim 1, wherein the responding to the instruction to end the group further comprises:

保存所述第一白板界面内的第一界面内容。The first interface content in the first whiteboard interface is saved.
根据权利要求1所述的协同操作方法，其中，所述在所述第一白板界面中显示所述第二书写轨迹之后，包括：The collaborative operation method according to claim 1, wherein after displaying the second writing track in the first whiteboard interface, the method comprises:

接收退出小组指令；receive instructions to leave the group;

响应于所述退出小组指令，将所述第三协同界面恢复至所述第一协同界面；In response to the exit group instruction, restoring the third collaboration interface to the first collaboration interface;

接收第二分组指令，所述第二分组指令用于指示本地终端加入第二小组；receiving a second grouping instruction, where the second grouping instruction is used to instruct the local terminal to join the second group;

响应于所述第二分组指令，将所述第一协同界面变换为第五协同界面，所述第五协同界面中显示有所述第二数据、共享白板控件、所述第二小组内每个所述异地终端的第一数据。In response to the second grouping instruction, the first collaboration interface is transformed into a fifth collaboration interface, and the fifth collaboration interface displays the second data, the shared whiteboard control, and each of the second group. The first data of the remote terminal.
根据权利要求1所述的协同操作方法，其中，所述响应于所述第一控制操作，在所述第三协同界面中显示第一白板界面之后，还包括：The collaborative operation method according to claim 1, wherein after displaying the first whiteboard interface in the third collaborative interface in response to the first control operation, the method further comprises:

接收组间白板共享指令；Receive whiteboard sharing instructions between groups;

响应于所述组间白板共享指令，将所述第一白板界面的第一界面内容发送至所述第一小组外的异地终端，以使所述异地终端在对应的第二白板界面中显示所述第一界面内容。In response to the inter-group whiteboard sharing instruction, the first interface content of the first whiteboard interface is sent to the remote terminal outside the first group, so that the remote terminal displays all the information in the corresponding second whiteboard interface. Describe the content of the first interface.
根据权利要求5所述的协同操作方法，其中，还包括：The collaborative operation method according to claim 5, further comprising:

接收所述第三小组发送的第二界面内容，所述第二界面内容为所述第三小组中共享的白板界面内容；receiving second interface content sent by the third group, where the second interface content is the whiteboard interface content shared by the third group;

在所述第一白板界面中显示所述第二界面内容。The second interface content is displayed in the first whiteboard interface.
根据权利要求1所述的协同操作方法，其中，所述第三协同界面中还显示有桌面共享控件；The collaborative operation method according to claim 1, wherein a desktop sharing control is further displayed in the third collaborative interface;

所述在所述第三协同界面中显示第一白板界面之后，还包括：After displaying the first whiteboard interface in the third collaboration interface, the method further includes:

接收作用于所述桌面共享控件的第三控制操作；receiving a third control operation acting on the desktop sharing control;

响应于所述第三控制操作，将所述第三协同界面更换为本地桌面；In response to the third control operation, replacing the third collaboration interface with a local desktop;

将所述本地桌面发送至所述第一小组内的异地终端，以使所述异地终端将对应的第四协同界面更换为所述本地桌面。The local desktop is sent to the remote terminal in the first group, so that the remote terminal replaces the corresponding fourth collaboration interface with the local desktop.
根据权利要求1所述的协同操作方法，其中，所述本地终端为对参与协同的所有所述异地终端进行管理的管理终端，所述第一协同界面中还显示有分组讨论控件；The collaborative operation method according to claim 1, wherein the local terminal is a management terminal that manages all the remote terminals participating in the collaboration, and a group discussion control is also displayed in the first collaboration interface;

还包括：Also includes:

接收作用于所述分组讨论控件的第四控制操作；receiving a fourth control operation acting on the group discussion control;

响应于所述第四控制操作，将所述第一协同界面变换为第六协同界面，所述第六协同界面中显示有小组管理控件以及多个分组区域，每个所述分组区域对应一个小组，所述小组管理控件用于实现小组管理；In response to the fourth control operation, the first collaboration interface is transformed into a sixth collaboration interface, and the sixth collaboration interface displays group management controls and a plurality of grouping areas, each of which corresponds to a group , the group management control is used to implement group management;

向每个所述异地终端发送第三分组指令，以使所述异地终端根据所述第三分组指令加入相应的小组。A third grouping instruction is sent to each of the remote terminals, so that the remote terminals join the corresponding group according to the third grouping instruction.
根据权利要求8所述的协同操作方法，其中，所述向每个所述异地终端发送第三分组指令，以使所述异地终端根据所述第三分组指令加入相应的小组之后，还包括：The collaborative operation method according to claim 8, wherein after the sending a third grouping instruction to each of the remote terminals, so that the remote terminals join the corresponding group according to the third grouping instruction, the method further comprises:

接收针对于第一目标分组区域的第五控制操作；receiving a fifth control operation for the first target packet area;

响应于所述第五控制操作，在所述第六协同界面中显示所述第一目标分组区域对应小组的协同界面。In response to the fifth control operation, the collaboration interface of the group corresponding to the first target grouping area is displayed in the sixth collaboration interface.
根据权利要求8所述的协同操作方法，其中，所述向每个所述异地终端发送第三分组指令，以使所述异地终端根据所述第三分组指令加入相应的小组之后，还包括：The collaborative operation method according to claim 8, wherein after the sending a third grouping instruction to each of the remote terminals, so that the remote terminals join the corresponding group according to the third grouping instruction, the method further comprises:

接收针对于第二目标分组区域的第六控制操作和针对于第三目标分组区域的第七控制操作；receiving a sixth control operation for the second target grouping area and a seventh control operation for the third target grouping area;

响应于所述第六控制操作和所述第七控制操作，将所述第二目标分组区域对应小组的协同界面，发送到所述第三目标分组区域对应小组的协同界面进行显示。In response to the sixth control operation and the seventh control operation, the collaboration interface of the group corresponding to the second target grouping area is sent to the collaboration interface of the group corresponding to the third target grouping area for display.
根据权利要求1所述的协同操作方法，其中，所述将所述第一书写轨迹发送至所述第一小组内的异地终端，以使所述异地终端在所述第二白板界面中显示所述第一书写轨迹包括：The collaborative operation method according to claim 1, wherein the sending the first writing track to a remote terminal in the first group enables the remote terminal to display all the writing on the second whiteboard interface. The first writing track includes:

获取所述第一书写轨迹的元数据；obtaining metadata of the first writing track;

编码所述元数据，以得到编码数据；encoding the metadata to obtain encoded data;

将所述编码数据和所述第二数据进行混合，得到数据包；Mixing the encoded data and the second data to obtain a data packet;

将所述数据包发送至所述第一小组内的异地终端，以使所述异地终端通过所述数据包得到所述第二数据和所述编码数据并在所述第二白板界面中显示基于所述编码数据得到的第一书写轨迹。Send the data packet to the remote terminal in the first group, so that the remote terminal obtains the second data and the encoded data through the data packet, and displays the data based on the data in the second whiteboard interface. The first writing track obtained from the encoded data.
一种协同操作装置，其中，包括：A cooperative operation device, comprising:

第一显示模块，用于显示第一协同界面，所述第一协同界面中显示有参与协同的每个异地终端的第一数据和本地终端的第二数据，每个所述异地终端中显示有第二协同界面，所述第一数据和所述第二数据均包括视频画面数据、音频数据以及身份标识数据中的至少一种；The first display module is used to display a first collaboration interface, in which the first data of each remote terminal participating in the collaboration and the second data of the local terminal are displayed, and each of the remote terminals is displayed with a second collaboration interface, wherein both the first data and the second data include at least one of video picture data, audio data, and identification data;

第一接收模块，用于接收第一分组指令，所述第一分组指令用于指示本地终端加入第一小组，所述第一小组包括所述本地终端以及至少一个所述异地终端；a first receiving module, configured to receive a first grouping instruction, where the first grouping instruction is used to instruct a local terminal to join a first group, where the first group includes the local terminal and at least one of the remote terminals;

第二显示模块，用于响应于所述第一分组指令，将所述第一协同界面变换为第三协同界面，所述第三协同界面中显示有所述第二数据、共享白板控件、所述第一小组内每个异地终端的第一数据，所述第一小组内的每个所述异地终端将所述第二协同界面变换为第四协同界面；A second display module, configured to transform the first collaboration interface into a third collaboration interface in response to the first grouping instruction, where the third collaboration interface displays the second data, shared whiteboard controls, all first data of each remote terminal in the first group, and each remote terminal in the first group converts the second collaboration interface into a fourth collaboration interface;

第二接收模块，用于接收作用于所述共享白板控件的第一控制操作；a second receiving module, configured to receive a first control operation acting on the shared whiteboard control;

第三显示模块，用于响应于所述第一控制操作，在所述第三协同界面中显示第一白板界面，并指示所述第一小组内的异地终端在所述第四协同界面中显示第二白板界面；A third display module, configured to display the first whiteboard interface in the third collaboration interface in response to the first control operation, and instruct the remote terminals in the first group to display it in the fourth collaboration interface The second whiteboard interface;

第三接收模块，用于接收作用于所述第一白板界面的第二控制操作；a third receiving module, configured to receive a second control operation acting on the first whiteboard interface;

第四显示模块，用于响应于所述第二控制操作，在所述第一白板界面中显示对应的第一书写轨迹；a fourth display module, configured to display a corresponding first writing track in the first whiteboard interface in response to the second control operation;

第一共享模块，用于将所述第一书写轨迹发送至所述第一小组内的异地终端，以使所述异地终端在所述第二白板界面中显示所述第一书写轨迹；a first sharing module, configured to send the first writing track to a remote terminal in the first group, so that the remote terminal displays the first writing track in the second whiteboard interface;

第四接收模块，用于接收所述第一小组内的异地终端发送的第二书写轨迹，所述第二书写轨迹显示在所述异地终端对应的第二白板界面中；a fourth receiving module, configured to receive a second writing track sent by a remote terminal in the first group, where the second writing track is displayed on a second whiteboard interface corresponding to the remote terminal;

第五显示模块，用于在所述第一白板界面中显示所述第二书写轨迹。A fifth display module, configured to display the second writing track in the first whiteboard interface.
一种协同操作终端，其中，包括：A collaborative operation terminal, comprising:

显示屏，用于显示第一协同界面；a display screen for displaying the first collaboration interface;

一个或多个处理器；one or more processors;

存储器，用于存储一个或多个程序；memory for storing one or more programs;

当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-11中任一所述的协同操作方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the cooperative operation method according to any one of claims 1-11.
一种计算机可读存储介质，其上存储有计算机程序，其中，该程序被处理器执行时实现如权利要求1-11中任一所述的协同操作方法。A computer-readable storage medium on which a computer program is stored, wherein when the program is executed by a processor, the cooperative operation method according to any one of claims 1-11 is implemented.