CN115134577A

CN115134577A - Information interaction method, first terminal and computer readable storage medium

Info

Publication number: CN115134577A
Application number: CN202210751747.5A
Authority: CN
Inventors: 文立家; 王剑飞; 许刚; 赵忠生
Original assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Current assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Priority date: 2019-11-30
Filing date: 2019-11-30
Publication date: 2022-09-30
Also published as: CN110891167A

Abstract

The embodiment of the disclosure provides an information interaction method, a first terminal and a computer-readable storage medium. The information interaction method is used for a first terminal, and comprises the following steps: sending a connection request to a server, wherein the connection request is used for requesting to establish real-time communication connection with a second terminal group for synchronously displaying a target space image so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal, and the second terminal group comprises at least one second terminal; receiving first operation data sent by any second terminal in the second terminal group and forwarded by a server, wherein the first operation data indicates a first operation executed on any second terminal aiming at the target space image; and responding to the received first operation data, and executing the first operation on the target space image displayed on the first terminal so as to display the target space image corresponding to the first operation.

Description

Information interaction method, first terminal and computer readable storage medium

The application is a divisional application of a patent application with the application number of 2019112085376, the application date of 2019, 11 and 30, and the patent name of 'an information interaction method, a first terminal and a computer readable storage medium'.

Technical Field

Embodiments of the present disclosure relate to the field of information communication technologies, and in particular, to an information interaction method, a first terminal, and a computer-readable storage medium.

Background

Currently, Virtual Reality (VR) technology is an emerging practical technology, and the VR technology generates a Virtual scene in a three-dimensional space by using computer simulation, provides simulation of senses such as vision, hearing, touch and the like for a user, and enables the user to personally observe objects in the three-dimensional space. With the continuous development of social productivity and scientific technology, VR technology is increasingly required in various fields. For example, the VR technology can be applied to a space (e.g., building) display system, and a realistic three-dimensional model of a building can be constructed based on the VR technology, so that the internal and external structures and functions of the building can be displayed in an all-around manner, and thus, a user can roam in the three-dimensional model of the building through a network, feel the building and the surrounding environment thereof personally on the scene, and quickly and conveniently realize remote house watching and room selection.

However, the current communication method based on the virtual reality technology is difficult to meet the information interaction requirements between terminals, and especially cannot meet the requirements of performing real-time synchronous display and interactive operation on respective display contents between terminals, especially between one terminal and a plurality of terminals.

Disclosure of Invention

In order to solve the above technical problem, according to an aspect of the present disclosure, there is provided an information interaction method for a first terminal, the method including: sending a connection request to a server, wherein the connection request is used for requesting to establish real-time communication connection with a second terminal group for synchronously displaying a target space image so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal, and the second terminal group comprises at least one second terminal; receiving first operation data sent by any second terminal in the second terminal group and forwarded by a server, wherein the first operation data indicate first operations executed on the any second terminal aiming at the target space image; and responding to the received first operation data, and executing the first operation on the target space image displayed on the first terminal so as to display the target space image corresponding to the first operation.

According to some embodiments of the present disclosure, the receiving, by the server, the first operation data sent by any one of the second terminals in the second terminal group includes: and receiving first operation data which is forwarded by the server and is based on a second graph drawing tool, wherein the first operation data is obtained by monitoring the first operation by using the configured second graph drawing tool by the second terminal.

According to some embodiments of the present disclosure, wherein the performing the first operation on the target space image displayed on the first terminal in response to the received first operation data to display a target space image corresponding to the first operation comprises: setting the state of a first graphic drawing tool configured in the first terminal according to the first operation data so as to display a target space image corresponding to the first operation; wherein the first and second graphical drawing tools are the same graphical drawing tool.

According to some embodiments of the present disclosure, wherein the connection request comprises a voice connection request and a data synchronization request.

According to some embodiments of the disclosure, the sending the connection request to the server comprises: sending a voice connection request to the server so as to establish real-time voice communication with the second terminal group; and sending the data synchronization request to the server, and acquiring a target space image identifier of a target space image synchronously displayed on the second terminal group through the server so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal.

According to some embodiments of the disclosure, the sending the connection request to the server comprises: sending a voice connection request and a data synchronization request to the server; and acquiring a target space image identifier of a target space image synchronously displayed on a second terminal group through the server so as to establish real-time voice communication with the second terminal group and display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal.

According to some embodiments of the disclosure, wherein the real-time communication connection is established over a long connection channel of WebRTC, and the first operational data is received by at least one of: receiving the first operation data from the server through a long connection channel or receiving the first operation data from the server through a data channel of WebRTC.

According to some embodiments of the present disclosure, the first operation data indicates at least one of a coordinate transformation, a display angle transformation, a field of view transformation, and a display scene switching of the target aerial image.

According to some embodiments of the disclosure, wherein the method further comprises: receiving, by the server, first media data sent by one or more second terminals in the second terminal group; presenting information corresponding to the first media data in response to the received first media data.

According to another aspect of the present disclosure, there is provided a first terminal including: the connection unit is configured to send a connection request to a server, wherein the connection request is used for requesting to establish real-time communication connection with a second terminal group which synchronously displays a target space image, so that the target space image synchronously displayed on each second terminal in the second terminal group is displayed on the first terminal, and the second terminal group comprises at least one second terminal; a receiving unit, configured to receive first operation data sent by any one of the second terminals in the second terminal group and forwarded by a server, where the first operation data indicates a first operation performed on the any one of the second terminals for the target space image; an operation unit configured to perform the first operation on the target space image displayed on the first terminal in response to the received first operation data to display a target space image corresponding to the first operation.

According to some embodiments of the present disclosure, the receiving unit receives first operation data forwarded by a server and based on a second graphic drawing tool, where the first operation data is obtained by the second terminal by using a configured second graphic drawing tool to monitor the first operation.

According to some embodiments of the present disclosure, the operating unit sets a state of a first graphic drawing tool configured in the first terminal according to the first operation data to show a target space image corresponding to the first operation; wherein the first and second graphical drawing tools are the same graphical drawing tool.

According to some embodiments of the present disclosure, the connection unit sends a voice connection request to the server to establish real-time voice communication with the second terminal group; and sending the data synchronization request to the server, and acquiring a target space image identifier of a target space image synchronously displayed on the second terminal group through the server so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal.

According to some embodiments of the present disclosure, wherein the connection unit transmits a voice connection request and a data synchronization request to the server; and acquiring the target space image identifier of the target space image synchronously displayed on the second terminal group through the server so as to establish real-time voice communication with the second terminal group and display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal.

According to some embodiments of the disclosure, wherein the real-time communication connection is established through a long connection channel of WebRTC, and the receiving unit receives the first operation data from the server through the long connection channel or receives the first operation data from the server through a data channel of WebRTC.

According to some embodiments of the present disclosure, the operating unit receives, by the server, first media data sent by one or more second terminals in the second terminal group; presenting information corresponding to the first media data in response to the received first media data.

According to another aspect of the present disclosure, there is provided a first terminal including: one or more processors; and one or more memories in which computer program instructions are stored, wherein the information interaction method as described in any of the previous embodiments is performed when the computer program instructions are executed by the one or more processors.

According to another aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon instructions, which, when executed by a processor, cause the processor to perform the information interaction method according to any one of the preceding embodiments.

According to the information interaction method, the first terminal and the computer readable storage medium, synchronous display and real-time interaction operation of the target space graph between the first terminal and the second terminal group can be further achieved on the basis that real-time communication connection is established between the first terminal and the second terminal group through the server, time difference of content display and interaction operation is reduced, use experience of a user is improved, and therefore remote display is more convenient and fast.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments of the present disclosure will be briefly introduced below, and it is apparent that the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without inventive efforts.

FIG. 1 shows a flow diagram of the information interaction method 100;

FIG. 2 shows a hardware architecture system diagram for implementing the method of an embodiment of the present disclosure;

FIG. 3A shows a schematic diagram of a two-dimensional house view, and FIG. 3B shows a schematic diagram of a three-dimensional house view, according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram illustrating a specific structure of a first terminal and a second terminal set according to an embodiment of the present disclosure;

fig. 5 shows a block diagram of a first terminal according to an embodiment of the disclosure;

fig. 6 shows a block diagram of a first terminal according to an embodiment of the disclosure;

fig. 7 shows a schematic structural diagram of a first terminal of an embodiment of the present disclosure;

fig. 8 is a schematic diagram of a storage medium according to an embodiment of the disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described below clearly and completely with reference to the accompanying drawings of the embodiments of the present disclosure. It is to be understood that the described embodiments are only a few embodiments of the present disclosure, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the disclosure without any inventive step, are within the scope of protection of the disclosure.

Unless otherwise defined, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The use of "first," "second," and the like in this disclosure is not intended to indicate any order, quantity, or importance, but rather is used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used only to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly. To maintain the following description of the embodiments of the present disclosure clear and concise, a detailed description of some known functions and components have been omitted from the present disclosure.

Flowcharts are used in this disclosure to illustrate the steps of methods according to embodiments of the disclosure. It should be understood that the preceding and following steps are not necessarily performed in the exact order in which they are performed. Rather, various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to or removed from these processes.

VR technology based applications, such as VR technology based house display systems, currently only support a single user (buyer or seller) to independently view a VR scene of a house, but do not support multiple users (e.g., one or more buyers and one or more sellers) to share the same VR scene perspective, thereby resulting in inaccurate interaction among the multiple users, e.g., when one user (e.g., one or more sellers) turns the VR scene perspective in a certain direction for interpretation, or details a certain room in a set of houses, another user (e.g., one or more buyers) cannot timely switch to the corresponding perspective or the corresponding room. Therefore, the house display system can cause the problems of untimely and inaccurate information exchange among a plurality of users, and the like.

At least one embodiment of the present disclosure provides an information interaction method, a first terminal, and a computer-readable storage medium. Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to these specific embodiments.

An information interaction method according to an embodiment of the present disclosure is described below with reference to fig. 1, and the method may be applied to a first terminal, that is, the first terminal may implement information interaction with a second terminal group by executing the method. It should be noted that the first terminal, the second terminals in the second terminal group are only for distinction and do not indicate any order, number or importance. Similarly, the first terminal may also be located in a first terminal group, where the first terminal group includes one or more second terminals, and each second terminal in the second terminal group may also implement information interaction with the first terminal group where the first terminal is located by performing the method, which is not limited herein. Fig. 1 shows a flow chart of the information interaction method 100. Fig. 2 shows a system diagram of a hardware architecture for implementing the method of an embodiment of the present disclosure. According to the embodiment of the present disclosure, as shown in fig. 2, the method shown in fig. 1 may be implemented by a system including a first terminal, a second terminal group consisting of two second terminals, and a server. In the information interaction method provided by the embodiment of the disclosure, the first terminal and the second terminal group can simultaneously view the same target space image through real-time communication connection and corresponding operation interaction, so that information can be transmitted more timely and fed back more accurately, the product experience is improved, the product performance is improved, and the interest of space display is increased.

As shown in fig. 1, in step S101, a connection request is sent to a server, where the connection request is used to request that a real-time communication connection is established with a second terminal group that synchronously displays a target spatial image, so as to display the target spatial image synchronously displayed on each second terminal in the second terminal group on the first terminal, where the second terminal group includes at least one second terminal.

In the embodiment of the present disclosure, the first terminal establishes a real-time communication connection with the second terminal group through the server, and the real-time communication connection may include a multimedia real-time communication connection, which may be a real-time audio connection or a real-time video connection, for example. In an embodiment of the present disclosure, the second group of terminals may include one or more second terminals.

In the embodiment of the present disclosure, each of the first terminal and the second terminal in the second terminal group may be various mobile terminals, fixed terminals, and the like, for example, the first terminal and each of the second terminals may include an application (App) of the mobile terminal. The application may be, for example, "live guest," "58 city," etc. The mobile terminal can be a mobile phone, a tablet computer and the like. The fixed terminal may be a desktop computer or the like.

As an example, the real-time communication connection may enable data transmission by way of a wired network and/or a wireless network. The wired network may perform data transmission by using twisted pair, coaxial cable, or optical fiber transmission, for example, and the wireless network may perform data transmission by using 3G/4G/5G mobile communication network, bluetooth, Zigbee, or WiFi, for example. For example, the Real-Time Communication connection may be established between the first terminal and each second terminal in the second terminal group via a server through a Web Real-Time audio/video technology (WebRTC). After the real-time communication connection is established, real-time interactive transmission of various data (such as operation data and media data (such as video data and audio data) and the like) can be realized between the first terminal and each second terminal in the second terminal group through the server.

In the embodiment of the present disclosure, while the first terminal establishes the real-time communication connection with the second terminal group, the target space image synchronously displayed on each second terminal in the second terminal group is also displayed on the first terminal. In one example, if the initial target space image displayed by the first terminal is different from the initial target space images displayed by the second terminals in the second terminal group, the initial target space image displayed by the first terminal and the initial target space images displayed by the second terminals in the second terminal group need to be synchronized, so that the target space image displayed by the first terminal is the same as the target space image displayed by the second terminals in the second terminal group.

In one example, the target space may be a physical space, which may include, for example, an indoor space and an outdoor space. Alternatively, the indoor space may include a house, an office, etc., and the outdoor space may include an outdoor garden, a street, etc. The first terminal and the second terminal group may not be located in the target space, and both the first terminal and the second terminal group may be far away from the target space, that is, the first terminal and the second terminal group may remotely (e.g., in different places) view the target space image corresponding to the target space and roam within the display range of the target space image.

In another example, the target space may include one or more subspaces. For example, when the target space is a residence, the target space may include a living room subspace, a main lying subspace, a sub-lying subspace, a balcony subspace, a toilet subspace, a kitchen subspace, and the like. When the target space is an outdoor garden, the target space may include a subspace corresponding to a flower bed, a subspace corresponding to a sports facility, and the like. The above description of the target space and the corresponding target space image described later is merely an example, and the present disclosure includes but is not limited thereto.

According to one embodiment of the disclosure, the connection request sent by the first terminal to the second terminal group through the server may include a voice connection request or a video connection request, and may further include a data synchronization request, and the like. The voice connection request or the video connection request is used for requesting voice connection or video connection from the second terminal group through the server, and the data synchronization request is used for requesting synchronization of target space images displayed by the first terminal and the second terminal group. Alternatively, the data synchronization request may be used to request information for data synchronization from the second terminal group through the server, or to inform the second terminal group through the server of information of a target space image displayed by the first terminal as information for data synchronization. For example, the information for data synchronization may include an identifier (such as house identifier, serial number, and the like) of the target space image for synchronous display, and the like, to ensure that the display contents of the first terminal and the second terminal group are synchronized.

Optionally, the process of sending the connection request to the server by the first terminal may be a process of asynchronously sending the voice connection request and the data synchronization request, or a process of synchronously sending the voice connection request and the data synchronization request. In one example, sending the connection request to the server may include: sending a voice connection request to the server so as to establish real-time voice communication with the second terminal group; and sending the data synchronization request to the server, and acquiring a target space image identifier of a target space image synchronously displayed on the second terminal group through the server so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal. In another example, sending the connection request to the server may include: sending a voice connection request and a data synchronization request to the server; and acquiring a target space image identifier of a target space image synchronously displayed on a second terminal group through the server so as to establish real-time voice communication with the second terminal group and display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal.

Optionally, the connection request may be sent or received through a long connection channel, and when the real-time communication connection is established through WebRTC), the connection request may also be sent or received through a data channel of WebRTC. For example, when the connection request includes a voice connection request and a data synchronization request, the voice connection request and the data synchronization request may alternatively or collectively be transmitted or received via a long connection channel, or the voice connection request and the data synchronization request may alternatively or collectively be transmitted or received via a data channel of WebRTC. The above various information transmission modes are only examples of the embodiments of the present disclosure, and do not limit the specific embodiments of the present disclosure.

In step S102, first operation data sent by any second terminal in the second terminal group and forwarded by the server is received, where the first operation data indicates a first operation performed on the any second terminal for the target space image.

In the subsequent step S103, in response to the received first operation data, the first operation is performed on the target aerial image displayed on the first terminal to display a target aerial image corresponding to the first operation.

Alternatively, on any one of the second terminals in the second terminal group, a screen operation performed by a user on a screen of the second terminal, that is, the first operation, may be received to change the target space image displayed on the screen. After the second terminal detects the first operation, first operation data corresponding to the first operation may be acquired. After the screen operation is executed, the second terminal displays a target space image corresponding to the first operation. Subsequently, the second terminal may transmit the first operation data to the first terminal through the server, so that the first terminal synchronously performs the first operation on the target space image displayed by the first terminal based on the first operation data, so that the first terminal displays a target space image corresponding to the first operation. For example, after the first terminal receives first operation data transmitted by a server, the first terminal may synchronously perform the first operation on the target spatial image displayed by the first terminal based on the first operation data, so that the first terminal synchronously displays the target spatial image displayed by the second terminal.

In addition, the second terminal executing the first operation may also send the first operation data to the other second terminals in the second terminal group through the server at the same time, so that the other second terminals in the second terminal group synchronously execute operations similar to the first terminal, and finally, the first terminal and all the second terminals in the second terminal group all display the target space image after the first operation is executed.

According to the embodiment of the present disclosure, in combination with the foregoing description of the target space, the target space image is an image of a physical space, and the type of the target space image includes any one of the following types: a two-dimensional house view (alternatively referred to as a planar house view), a three-dimensional house view (alternatively referred to as a stereoscopic house view), and a panoramic image. For example, the two-dimensional house type map may be a two-dimensional house type map of a house, and the three-dimensional house type map may be a three-dimensional stereo model map of the house. Schematically, fig. 3A shows a schematic diagram of a two-dimensional house view according to an embodiment of the disclosure, and fig. 3B shows a schematic diagram of a three-dimensional house view according to an embodiment of the disclosure. As shown in fig. 3A and 3B, the two-dimensional and three-dimensional house views show various subspaces (e.g., a living room subspace, a main lying subspace, a sub-lying subspace, a balcony subspace, a toilet subspace, a kitchen subspace, etc.) of a house, a positional arrangement of the various subspaces, and the like.

For example, the panoramic image may be a panoramic image corresponding to, for example, a house generated based on a sky box or a sky dome, or referred to as a virtual reality presentation image. The target space image may be any two-dimensional image corresponding to the target space, for example, a map image showing a geographical position of the target space, a cell environment image corresponding to the target space, or the like, which is not limited herein.

In one example of the embodiment of the present disclosure, the first operation data indicates at least one of a coordinate transformation, a display angle transformation, a field of view transformation, and a display scene switching for the target aerial image. Optionally, when the real-time communication connection is established through a long link channel of WebRTC, the first operation data may be received from the server through the long link channel or through a data channel of WebRTC.

The first operation and the first operation data will be described below by taking the target space image as a two-dimensional floor plan as an example.

As shown in fig. 3A, the target space includes a plurality of subspaces, and the target space image includes a plurality of sub-images respectively corresponding to the plurality of subspaces. The subspaces may be individual rooms in a floor plan, such as a living room, a kitchen, a bedroom a, a bedroom B, etc. subspace. In this embodiment, the first operation is a selection operation of selecting any one of the plurality of subspaces on the target space image shown on the second terminal. For example, a user such as a user corresponding to the second terminal may operate a screen of the second terminal in a touch manner to select one subspace in the target space. For example, in the case where the graph shown in fig. 3A is a target aerial image, the selection operation may be an operation of clicking a living room subspace in the target aerial image, that is, selecting the living room. After the user selects the hall subspace, the second terminal may present a sub-image corresponding to the subspace (i.e., the hall subspace) selected by the selection operation.

In response to detecting a selection operation performed on the first image of the target space presented on the second terminal, the second terminal may acquire selection operation data corresponding to the selection operation. Through the selection operation, the image displayed on the screen of the second terminal can be switched from the two-digit house type graph to the image corresponding to the living room subspace. Then, the second terminal may transmit the selection operation data to the first terminal through the server, so that the first terminal performs the selection operation on the target space image displayed by the first terminal based on the selection operation data in synchronization, so that the first terminal displays a target space image corresponding to the selection operation, that is, an image corresponding to a living room subspace. Through the above process, the display contents viewed by the second terminal in the first terminal group and the second terminal group can be kept consistent, namely, screen sharing is realized.

Similarly, operations corresponding to the first operation data, such as coordinate transformation, display angle transformation, and view range transformation of the target space image, are similar to the aforementioned display scene switching operation, and a description thereof is not repeated here.

Optionally, the receiving, by the first terminal, the first operation data sent by any one of the second terminals in the second terminal group and forwarded by the server may include: and receiving first operation data which is forwarded by the server and is based on a second graph drawing tool, wherein the first operation data is obtained by monitoring the first operation by using the configured second graph drawing tool by the second terminal. Optionally, the performing, in response to the received first operation data, the first operation on the target space image displayed on the first terminal to display a target space image corresponding to the first operation may include: setting the state of a first graphic drawing tool configured in the first terminal according to the first operation data so as to display a target space image corresponding to the first operation; wherein the first and second graphical drawing tools are the same graphical drawing tool.

As one example, the first graphics rendering tool may be a canvas for implementing graphics rendering, with listening operations implemented by scripts (such as JavaScript). After listening to the operation, the canvas will acquire operation data corresponding to the operation and draw an image based on the acquired operation data. For example, when the first operation is a zoom-in operation, the second terminal may monitor the zoom-in operation by using the canvas, acquire operation data such as a zoom magnification corresponding to the zoom-in operation, and perform graphic rendering based on the operation data to display an image obtained by zooming in the displayed target space image at the zoom magnification.

Then, the second terminal may send the first operation data acquired by the canvas to the first terminal through the server in real time. After the first terminal receives the first operation data sent by the second terminal, the received first operation data is provided to a canvas configured in the first terminal, so that the canvas draws a graph based on the first operation data, for example, the zoom-in operation is executed, so as to synchronously display an image obtained after being zoomed in according to the zoom-in magnification. In this example, the first and second graphical drawing tools are the same graphical drawing tool.

In other examples according to the present disclosure, the method may further comprise: receiving, by the server, first media data sent by one or more second terminals in the second terminal group; presenting information corresponding to the first media data in response to the received first media data. For example, the first media data may be video data or audio data, and the first terminal may present information corresponding to the first media data to a user corresponding to the first terminal in response to the first media data. For example, the first terminal may acquire and parse the first media data to obtain audio data, and cause the audio data to be played, so that a user corresponding to the first terminal receives information corresponding to the first media data.

Furthermore, according to another example of the present disclosure, the first terminal may not only transmit a connection request to the second terminal group through the server and receive the first operation data to establish a real-time communication connection and synchronize the target space image; the server may also receive a connection request sent by one or more second terminals in the second terminal group, and send second operation data generated by the first terminal to the one or more second terminals to establish a real-time communication connection and synchronize the target space image. In this example, the process of sending and receiving connection request/operation data is similar to that described above and will not be described again.

According to another embodiment of the present disclosure, information sent by any second terminal in the first terminal/second terminal group to the server may be judged and processed by the server, and the information type and the sending object may be determined according to the corresponding judgment result. For example, the connection request sent by the first terminal to the server may be determined by the server through a logic layer, for example, a voice connection request and a data synchronization request contained therein, and the data synchronization request may be sent to the second terminal group through a long chain, for example, to perform audio-related processing on the voice connection request. And the server can judge the first operation request sent by any second terminal in the second terminal group to the server through a logic layer, and after the type of the information is determined, the first operation request is forwarded to the first terminal through a long chain.

In the process of the server performing judgment and forwarding processing on the information, in order to ensure the basic timing of forwarding, a specific operation may be performed on a plurality of operation data. For example, the corresponding operation data for the synchronous space image can be received and sent by using a separate queue, and the processing time can be reduced as much as possible by using one or more threads in the thread pool to send asynchronously, so that the data throughput is ensured. In addition, specific rooms (room) are set for the first terminal and the second terminal group which have established communication connection, and unique room identifiers (roomid) can be constructed, so that information corresponding to each roomid can be forwarded through one or more threads in the same thread pool, and basic consistency of information transmission is guaranteed. Further, a sequence number may be set in each forwarded message to ensure the message forwarding order. For example, a self-increasing sequence number may be set for each piece of information, so that the receiving side judges the arrangement order of the information according to the sequence number corresponding to the received information, and avoids an error in information reception.

Fig. 4 is a schematic structural diagram illustrating a specific structure of the first terminal and the second terminal group according to an embodiment of the present disclosure. As shown in fig. 4, the first terminal 410 may include a first page 11a, a first operation processing module 11b, a first media module 11c, other modules 11d, a transmission module 10a, and the like. The second terminal 420 may include a second page 12a, a second operation processing module 12b, a second media module 12c, other modules 12d, and a transmission module 10b, etc. Another second terminal 430 for forming a second terminal group with the second terminal 420 may include a third page 13a, a third operation processing module 13b, a third media module 13c, an other module 13d, and a transmission module 10c, etc. The other modules 11b, 12b, 13b may be word processing modules or the like. The transmission modules 10a, 10b, 10c and the other modules 11b, 12b, 13b may be implemented in software.

For example, the pages (e.g., windows) executed by the first page 11a, the second page 12a, and the third page 13a may each be a Web page (Web page, e.g., HTML5 page, etc.), an Application (APP), or an applet (e.g., an applet running in a WeChat or Payment treasures), or the like. The respective modules in the first terminal 410 and the

second terminals

420 and 430 may perform the respective processes of the aforementioned information interaction method, and the information interacted therewith is forwarded through the server 400. Specifically, the first operation processing module 11b, the second operation processing module 12b, and the third operation processing module 13b may perform, through their corresponding transmission modules (10a, 10b, 10c) and through the server, transceiving processing of operation information such as first operation information and second operation information, and generate or change the first page 11a, the second page 12a, and the third page 13 a; the first media module 11c, the second media module 12c and the third media module 13c can perform media interaction processing such as audio or video through their corresponding transmission modules (10a, 10b, 10c) and through the server; the other modules 11b, 12b, 13b can perform the processing of other operations by their respective transmission modules (10a, 10b, 10c) and by the server. The detailed operation is not described again.

According to the information interaction method provided by the disclosure, the synchronous display and the real-time interaction operation of the target space graph between the first terminal and the second terminal group can be further realized on the basis that the server establishes the real-time communication connection between the first terminal and the second terminal group, the time difference between the content display and the interaction operation is reduced, the use experience of a user is improved, and therefore the remote display is more convenient.

Next, a first terminal according to an embodiment of the present disclosure is described with reference to fig. 5. Fig. 5 shows a block diagram of a first terminal 500 according to an embodiment of the present disclosure. As shown in fig. 5, the first terminal 500 includes a connection unit 510, a reception unit 520, and an operation unit 530. The first terminal 500 may include other components in addition to these units, however, since these components are not related to the contents of the embodiments of the present disclosure, illustration and description thereof are omitted herein. In addition, since specific details of the following operations performed by the first terminal 500 according to an embodiment of the present disclosure are the same as those described above with reference to fig. 1 to 4, a repetitive description of the same details is omitted herein to avoid redundancy.

The connection unit 510 in fig. 5 sends a connection request to a server, where the connection request is used to request a real-time communication connection to be established with a second terminal group that synchronously displays a target space image, so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal, where the second terminal group includes at least one second terminal.

In the embodiment of the present disclosure, the first terminal establishes a real-time communication connection with the second terminal group through the server, and the real-time communication connection may include a multimedia real-time communication connection, for example, a real-time audio connection or a real-time video connection. In an embodiment of the present disclosure, the second group of terminals may include one or more second terminals.

As an example, the real-time communication connection may implement data transmission by way of a wired network and/or a wireless network. The wired network may perform data transmission by using twisted pair, coaxial cable, or optical fiber transmission, for example, and the wireless network may perform data transmission by using 3G/4G/5G mobile communication network, bluetooth, Zigbee, or WiFi, for example. For example, the Real-Time Communication connection may be established between the first terminal and each second terminal in the second terminal group via a server through a Web Real-Time audio/video technology (WebRTC). After the real-time communication connection is established, real-time interactive transmission of various data (such as operation data and media data (such as video data and audio data) and the like) can be realized between the first terminal and each second terminal in the second terminal group through the server.

In the embodiment of the disclosure, while the first terminal establishes the real-time communication connection with the second terminal group, the target space image synchronously displayed on each second terminal in the second terminal group is displayed on the first terminal. In one example, if the initial target space image displayed by the first terminal is different from the initial target space image displayed by each second terminal in the second terminal group, the initial target space image displayed by the first terminal and the initial target space image displayed by each second terminal in the second terminal group need to be synchronized, so that the target space image displayed by the first terminal is the same as the target space image displayed by each second terminal in the second terminal group.

According to one embodiment of the disclosure, the connection request sent by the first terminal to the second terminal group through the server may include a voice connection request or a video connection request, and may further include a data synchronization request, and the like. The voice connection request or the video connection request is used for requesting voice connection or video connection to the second terminal group through the server, and the data synchronization request is used for requesting synchronization of target space images displayed by the first terminal and the second terminal group. Alternatively, the data synchronization request may be used to request information for data synchronization from the second terminal group through the server, or to inform the second terminal group through the server of information of a target space image displayed by the first terminal as information for data synchronization. For example, the information for data synchronization may include an identifier (such as house identifier, serial number, etc.) of the target spatial image for synchronous display, etc., so as to ensure that the display contents of the first terminal and the second terminal group are synchronized.

Optionally, the process of sending the connection request to the server by the first terminal may be a process of asynchronously sending the voice connection request and the data synchronization request, or a process of synchronously sending the voice connection request and the data synchronization request. In one example, sending the connection request to the server may include: sending a voice connection request to the server so as to establish real-time voice communication with the second terminal group; and sending the data synchronization request to the server, and acquiring a target space image identifier of a target space image synchronously displayed on the second terminal group through the server so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal. In another example, sending the connection request to the server may include: sending a voice connection request and a data synchronization request to the server; and acquiring the target space image identifier of the target space image synchronously displayed on the second terminal group through the server so as to establish real-time voice communication with the second terminal group and display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal.

The receiving unit 520 receives first operation data sent by any one of the second terminals in the second terminal group and forwarded by the server, where the first operation data indicates a first operation performed on the any one of the second terminals with respect to the target space image.

In the operation unit 530, in response to the received first operation data, the first operation is performed on the target space image displayed on the first terminal to display a target space image corresponding to the first operation.

Alternatively, on any one of the second terminals in the second terminal group, a screen operation performed by a user on a screen of the second terminal, that is, the first operation, may be received to change the target space image displayed on the screen. After the second terminal detects the first operation, first operation data corresponding to the first operation may be acquired. After the screen operation is executed, the second terminal displays a target space image corresponding to the first operation. Subsequently, the second terminal may transmit the first operation data to the first terminal through the server, so that the first terminal synchronously performs the first operation on the target space image displayed by the first terminal based on the first operation data, so that the first terminal displays the target space image corresponding to the first operation. For example, after the first terminal receives first operation data transmitted by a server, the first terminal may synchronously perform the first operation on the target space image displayed by the first terminal based on the first operation data, so that the first terminal synchronously displays the target space image displayed by the second terminal.

As shown in fig. 3A, the target space includes a plurality of subspaces, and the target space image includes a plurality of sub-images respectively corresponding to the plurality of subspaces. The subspaces may be individual rooms in a house diagram, such as a living room, a kitchen, a bedroom a, a bedroom B, etc. In this embodiment, the first operation is a selection operation of selecting any one of the plurality of subspaces on the target space image shown on the second terminal. For example, a user such as a user corresponding to the second terminal may operate a screen of the second terminal in a touch manner to select one subspace in the target space. For example, in the case where the graph shown in fig. 3A is a target aerial image, the selection operation may be an operation of clicking a living room subspace in the target aerial image, that is, selecting the living room. After the user selects the hall subspace, the second terminal may present a sub-image corresponding to the subspace (i.e., the hall subspace) selected by the selection operation.

In response to detecting a selection operation performed on the first image of the target space presented on the second terminal, the second terminal may acquire selection operation data corresponding to the selection operation. Through the selection operation, the image displayed on the screen of the second terminal can be switched from the two-digit house type graph to the image corresponding to the living room subspace. Then, the second terminal may transmit the selection operation data to the first terminal through the server, so that the first terminal performs the selection operation on the target space image displayed by the first terminal based on the selection operation data in synchronization, so that the first terminal displays a target space image corresponding to the selection operation, that is, an image corresponding to a living room subspace. Through the above process, the display contents viewed by the second terminal in the first terminal and the second terminal group can be kept consistent, that is, screen sharing is realized.

Similarly, the operations corresponding to the first operation data of coordinate transformation, display angle transformation and view field transformation of the target space image are similar to the aforementioned display scene switching operation, and the description thereof is not repeated here.

Optionally, the receiving, by the first terminal, the first operation data sent by any one of the second terminals in the second terminal group and forwarded by the server may include: and receiving first operation data which is forwarded by the server and is based on a second graph drawing tool, wherein the first operation data is obtained by monitoring the first operation by using the configured second graph drawing tool by the second terminal. Optionally, the performing, in response to the received first operation data, the first operation on the target spatial image displayed on the first terminal to display a target spatial image corresponding to the first operation may include: setting the state of a first graphic drawing tool configured in the first terminal according to the first operation data so as to display a target space image corresponding to the first operation; wherein the first and second graphical drawing tools are the same graphical drawing tool.

As one example, the first graphics rendering tool may be a canvas for implementing graphics rendering, with listening operations implemented by scripts (such as JavaScript). After listening to the operation, the canvas will acquire operation data corresponding to the operation and draw an image based on the acquired operation data. For example, when the first operation is an enlargement operation, the second terminal may monitor the enlargement operation using the canvas, acquire operation data such as an enlargement magnification corresponding to the enlargement operation, and perform graphic rendering based on the operation data to display an image obtained by enlarging the displayed target space image at the enlargement magnification.

Then, the second terminal may send the first operation data acquired by the canvas to the first terminal through the server in real time. After the first terminal receives the first operation data sent by the second terminal, the received first operation data is provided to a canvas configured in the first terminal, so that the canvas draws a graph based on the first operation data, for example, the zoom-in operation is executed, so as to synchronously display an image obtained by zooming in according to the zoom-in magnification. In this example, the first and second graphical drawing tools are the same graphical drawing tool.

In other examples according to the present disclosure, the first terminal may further: receiving, by the server, first media data sent by one or more second terminals in the second terminal group; presenting information corresponding to the first media data in response to the received first media data. For example, the first media data may be video data or audio data, and the first terminal may present information corresponding to the first media data to a user corresponding to the first terminal in response to the first media data. For example, the first terminal may acquire and parse the first media data to obtain audio data, and cause the audio data to be played, so that a user corresponding to the first terminal receives information corresponding to the first media data.

Further, according to another example of the present disclosure, the first terminal may not only transmit a connection request to the second terminal group through the server and receive the first operation data to establish a real-time communication connection and synchronize the target space image; the server may also receive a connection request transmitted by one or more second terminals in the second terminal group, and transmit second operation data generated by the first terminal to the one or more second terminals to establish a real-time communication connection and synchronize the target space image. In this example, the process of sending and receiving connection request/operation data is similar to that described above and will not be described again.

In the process of the server performing judgment and forwarding processing on the information, in order to ensure the basic timing of forwarding, a specific operation may be performed on a plurality of operation data. For example, the corresponding operation data for the synchronous space image can be received and sent by using a separate queue, and the processing time can be reduced as much as possible by using one or more threads in the thread pool to send asynchronously, so that the data throughput is ensured. In addition, specific rooms (room) are set for the first terminal and the second terminal group which have established communication connection, and unique room identifiers (roomid) can be constructed, so that information corresponding to each roomid can be forwarded through one or more threads in the same thread pool, and basic consistency of information transmission is guaranteed. Further, a sequence number can be set in each forwarded message to ensure the message forwarding order. For example, a self-increasing sequence number may be set for each piece of information, so that the receiving side determines the arrangement order of the information according to the sequence number corresponding to the received information, thereby avoiding an error in information reception.

According to the first terminal provided by the disclosure, on the basis that the real-time communication connection is established between the first terminal and the second terminal group through the server, the synchronous display and the real-time interactive operation of the target space graph between the first terminal and the second terminal group are further realized, the time difference between content display and interactive operation is reduced, the use experience of a user is improved, and therefore the remote display is more convenient.

At least one embodiment of the present disclosure further provides a first terminal. Fig. 6 is a schematic diagram of a first terminal 600 according to an embodiment of the present disclosure.

For example, as shown in fig. 6, the first terminal 600 may include one or more memories 610 and one or more processors 620. It should be noted that the components of the first terminal 600 shown in fig. 6 are only exemplary and not limiting, and the first terminal 600 may have other components according to the practical application.

For example, memory 610 is used for non-transitory storage of computer program instructions; the processor 620 is configured to execute computer program instructions, and the computer program instructions, when executed by the processor 620, perform one or more steps of the information interaction method applied to the first terminal according to any of the above embodiments.

For example, the computer program instructions, when executed by the processor 620, may perform the following: sending a connection request to a server, wherein the connection request is used for requesting to establish real-time communication connection with a second terminal group synchronously displaying a target space image so as to display the target space image synchronously displayed on each second terminal in the second terminal group on the first terminal, and the second terminal group comprises at least one second terminal; receiving first operation data sent by any second terminal in the second terminal group and forwarded by a server, wherein the first operation data indicate first operations executed on the any second terminal aiming at the target space image; and responding to the received first operation data, and executing the first operation on the target space image displayed on the first terminal so as to display the target space image corresponding to the first operation.

For example, components such as processor 620 and memory 610 may communicate over a network connection. The network may include a wireless network, a wired network, and/or any combination of wireless and wired networks. The network may include a local area network, the Internet, a telecommunications network, an Internet of Things (Internet of Things) based on the Internet and/or a telecommunications network, and/or any combination thereof, and/or the like. The wired network may communicate by using twisted pair, coaxial cable, or optical fiber transmission, for example, and the wireless network may communicate by using 3G/4G/5G mobile communication network, bluetooth, Zigbee, or WiFi, for example. The present disclosure is not limited herein as to the type and function of the network.

For example, the processor 620 may control other components in the first terminal 600 to perform desired functions. The processor 620 may be a device having a data processing capability and/or a program execution capability, such as a Central Processing Unit (CPU), a Tensor Processor (TPU), or a Graphics Processing Unit (GPU). The Central Processing Unit (CPU) may be an X86 or ARM architecture, etc. The GPU may be separately integrated directly onto the motherboard, or built into the north bridge chip of the motherboard. The GPU may also be built into the Central Processing Unit (CPU).

For example, memory 610 may include any combination of one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory can include, for example, Random Access Memory (RAM), cache memory (or the like). The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, an Erasable Programmable Read Only Memory (EPROM), a portable compact disc read only memory (CD-ROM), USB memory, flash memory, and the like. On which one or more computer readable instructions may be stored and executed by the processor 620 to implement various functions of the first terminal 600. Various application programs and various data and the like can also be stored in the storage medium.

For example, the detailed description about the process of the first terminal 600 executing the information interaction method may refer to the related description in the embodiment of the information interaction method applied to the first terminal, and repeated parts are not described again.

Referring now to fig. 7, a block diagram of a first terminal 700 suitable for use in implementing embodiments of the present disclosure is shown. The first terminal in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a smart phone, a notebook computer, a PAD (tablet computer), etc., and a stationary terminal such as a desktop computer, etc. The first terminal shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 7, the first terminal 700 may include a processing device (e.g., a central processing unit, a graphic processor, etc.) 701, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)702 or a program loaded from a storage device 706 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data necessary for the operation of the first terminal 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

Generally, the following devices may be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, or the like; an output device 707 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; a storage device 706; and a communication device 709. The storage 706 may include various forms of program storage units as well as data storage units such as magnetic tape, hard disk, Read Only Memory (ROM), Random Access Memory (RAM), which can be used to store various data files used for computer processing and/or communications, as well as possible program instructions executed by 701. The communication means 709 may allow the first terminal 700 to communicate with other devices wirelessly or by wire to exchange data, e.g. to send and receive information and data. While fig. 7 illustrates the first terminal 700 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer program. The computer program comprises, for example, program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 709, or may be installed from the storage means 706, or may be installed from the ROM 702. The computer program, when executed by the processing device 701, performs the above-described functions defined in the remote presentation method of the embodiment of the present disclosure.

It should be noted that the first terminal provided in the embodiment of the present disclosure may adopt an Android (Android) system, an IOS system, a Linux system, a Windows system, and the like.

At least one embodiment of the present disclosure further provides a storage medium, and fig. 8 is a schematic diagram of a storage medium provided in an embodiment of the present disclosure.

For example, as shown in fig. 8, one or more computer readable instructions 801 may be stored non-temporarily on a storage medium 800. For example, the computer readable instructions 801, when executed by a computer, may perform one or more steps of the information interaction method applied to the first terminal according to the above.

For example, the storage medium 800 may be applied to the first terminal 600 described above, and may include the memory 610 in the first terminal 600, for example.

For example, for the description of the storage medium 800, reference may be made to the description of the memory in the embodiment of the first terminal 600, and repeated descriptions are omitted.

Various changes, substitutions and alterations to the techniques described herein may be made without departing from the techniques of the teachings as defined by the appended claims. Moreover, the scope of the claims of the present disclosure is not limited to the particular aspects of the process, machine, manufacture, composition of matter, means, methods and acts described above. Processes, machines, manufacture, compositions of matter, means, methods, or acts, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein may be utilized. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or acts.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims

1. An information interaction method is used for a first terminal, and the method comprises the following steps:

sending a connection request to a server, wherein the connection request is used for requesting to establish real-time communication connection with a second terminal group, so that the server acquires a target space image identifier of a first target space image synchronously displayed on each second terminal in the second terminal group according to the connection request and sends the target space image identifier to the first terminal, the second terminal group comprises at least one second terminal which needs to keep the target space image synchronization with the first terminal, and the first target space image of a target space is locally pre-stored and displayed by the at least one second terminal;

the first terminal acquires and displays the first target space image according to the target space image identifier;

receiving first operation data transmitted by any second terminal in the second terminal group and forwarded by a server based on the real-time communication connection, wherein the first operation data is acquired by the server from any second terminal in the second terminal group, and the first operation data indicates a first operation executed on any second terminal aiming at the displayed first target space image;

in response to the received first operation data, synchronously executing the first operation on the first target space image displayed on the first terminal to display a second target space image corresponding to the first operation;

the first operation data is further sent to the other second terminals except for any second terminal, so that the other second terminals synchronously execute the first operation on the first target space image displayed by the other second terminals, and a second target space image corresponding to the first operation is displayed.

2. The method of claim 1, wherein the receiving, by the server, the forwarded first operation data sent by any one of the second terminals in the second terminal group comprises:

and receiving first operation data which is forwarded by the server and is based on a second graph drawing tool, wherein the first operation data is obtained by monitoring the first operation by using the configured second graph drawing tool by the second terminal.

3. The method of claim 2, wherein the performing the first operation on the first target aerial image displayed on the first terminal in response to the received first operation data to display a second target aerial image corresponding to the first operation comprises:

setting the state of a first graphic drawing tool configured in the first terminal according to the first operation data so as to display a second target space image corresponding to the first operation; wherein the content of the first and second substances,

the first and second graphical drawing tools are the same graphical drawing tool.

4. The method of claim 1, wherein the first terminal acquiring and displaying the first target space image according to the target space image identifier comprises:

and according to the target space image identification, acquiring a first target space image from at least one target space image corresponding to a target space locally stored by the first terminal, and displaying the first target space image on the first terminal.

5. The method of claim 1, wherein the first operation data indicates at least one of a coordinate transformation, a display angle transformation, a field of view transformation, and a display scene change for the first target aerial image.

6. The method of any one of claims 1-5, wherein the method further comprises:

receiving, by the server, first media data sent by one or more second terminals in the second terminal group; presenting information corresponding to the first media data in response to the received first media data.

7. An information interaction method for a server, the method comprising:

receiving a connection request sent by a first terminal, wherein the connection request is used for requesting to establish real-time communication connection with a second terminal group, the second terminal group comprises at least one second terminal which needs to keep target space images synchronous with the first terminal, and the local of the at least one second terminal stores and displays a first target space image of a target space in advance;

according to the connection request, acquiring target space image identifiers of first target space images synchronously displayed on each second terminal in the second terminal group and sending the target space image identifiers to the first terminal, so that the first terminal acquires and displays the first target space images according to the target space image identifiers; and

acquiring first operation data of a first target space image synchronously displayed by any second terminal in the second terminal group, wherein the first operation data indicates a first operation executed on the any second terminal aiming at the displayed first target space image;

and sending the first operation data to the other second terminals except any one second terminal in the first terminal and the second terminal group, so that the first terminal and the other second terminals synchronously execute the first operation on the first target space image displayed on the first terminal and the other second terminals, and a second target space image corresponding to the first operation is displayed.

8. The method of claim 7, wherein the acquiring of the first operation data of the first target space image synchronously displayed by any second terminal in the second terminal group comprises:

receiving first operation data which is sent by any second terminal and is based on a second graph drawing tool, wherein the first operation data is obtained by monitoring the first operation by the any second terminal by using the configured second graph drawing tool;

correspondingly, sending the first operation data to the other second terminals except any one second terminal in the first terminal and the second terminal group, so that the first terminal and the other second terminals synchronously execute the first operation on the first target space image displayed thereon to display a second target space image corresponding to the first operation, including:

sending first operation data based on a second graph drawing tool to the first terminal and the rest of the second terminals, so that the first terminal and the rest of the second terminals respectively set the states of the respectively configured first graph drawing tools according to the first operation data to display a second target space image corresponding to the first operation;

wherein the first and second graphical drawing tools are the same graphical drawing tool.

9. A first terminal, comprising:

the connection unit is configured to send a connection request to a server, wherein the connection request is used for requesting real-time communication connection to be established with a second terminal group, so that the server obtains target space image identifiers of first target space images synchronously displayed on second terminals in the second terminal group according to the connection request and sends the target space image identifiers to the first terminal, the second terminal group comprises at least one second terminal which needs to keep target space image synchronization with the first terminal, and the first target space image of a target space is locally pre-stored and displayed by the at least one second terminal;

the display unit is configured to acquire and display the first target space image according to the target space image identifier;

a receiving unit, configured to receive, based on the real-time communication connection, first operation data sent by any one of the second terminals in the second terminal group and forwarded by a server, where the first operation data indicates a first operation performed on the any one of the second terminals for the displayed first target space image;

an operation unit configured to synchronously perform the first operation on the target space image displayed on the first terminal in response to the received first operation data to display a second target space image corresponding to the first operation;

the first operation data is also sent to the other second terminals except any one second terminal, so that the other second terminals synchronously execute the first operation on the first target space image displayed by the other second terminals, and a second target space image corresponding to the first operation is displayed.

10. A first terminal, comprising:

one or more processors; and

one or more memories having computer program instructions stored therein,

wherein the computer program instructions, when executed by the one or more processors, perform the method of information interaction of any of claims 1-6.

11. A server, comprising:

one or more processors; and

one or more memories having computer program instructions stored therein,

wherein the information interaction method of any one of claims 7-8 is performed when the computer program instructions are executed by the one or more processors.

12. A computer-readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to perform the information interaction method of any one of claims 1-8.