CN115509363A - Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium - Google Patents
Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN115509363A CN115509363A CN202211355993.5A CN202211355993A CN115509363A CN 115509363 A CN115509363 A CN 115509363A CN 202211355993 A CN202211355993 A CN 202211355993A CN 115509363 A CN115509363 A CN 115509363A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- reality terminal
- virtual object
- operation instruction
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure relates to a method and a device for cooperation of multiple augmented reality devices, an electronic device and a storage medium, wherein a multi-augmented reality device cooperation system comprises a first augmented reality terminal and a second augmented reality terminal, the method is used for the first augmented reality terminal, and the method comprises the following steps: enabling the virtual object to move according to a first preset movement posture according to the operation instruction; and sending the operation instruction to the second augmented reality terminal, wherein the second augmented reality terminal is used for determining a second preset motion posture of the virtual object in the second augmented reality terminal according to the operation instruction and enabling the virtual object to move in the second augmented reality terminal according to the second preset motion posture. The communication between the first augmented reality terminal and the second augmented reality terminal is realized, and the problem that a plurality of augmented reality terminals are asynchronous in cooperation among multiple persons due to communication of the plurality of augmented reality terminals through the server is avoided.
Description
The application is a divisional application, the application number of the original application is 201911070989.2, the application date is 2019, 11 and 05, and the name of the invention is 'cooperation method and device of multiple augmented reality devices, electronic device and storage medium'.
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for collaboration of multiple augmented reality devices, an electronic device, and a storage medium.
Background
With the development and progress of technologies, augmented Reality (Augmented Reality) technologies gradually start to be applied, and in some application scenarios, multiple users need to use multiple Augmented Reality devices to realize cooperative operation, that is, multiple Augmented Reality devices need to interact.
At present, interaction of a plurality of augmented reality devices needs to be realized through a server, and when the interaction of a plurality of augmented reality devices is carried out through the server, the interaction is asynchronous when a plurality of people cooperate due to reasons such as network delay.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The present disclosure aims to provide a method and an apparatus for multi-augmented reality device collaboration, an electronic device, and a storage medium, so as to overcome, at least to a certain extent, the problem of multi-user collaboration asynchronism caused by network delay when a plurality of augmented reality devices interact in the related art.
According to a first aspect of the present disclosure, there is provided a method for cooperation of multiple augmented reality devices, where a multiple augmented reality device cooperation system includes a first augmented reality terminal and a second augmented reality terminal, the method is used for the first augmented reality terminal, and the method includes:
enabling the virtual object to move according to a first preset movement posture according to the operation instruction;
and sending the operation instruction to the second augmented reality terminal, wherein the second augmented reality terminal is used for determining a second preset motion posture of the virtual object in the second augmented reality terminal according to the operation instruction and enabling the virtual object to move in the second augmented reality terminal according to the second preset motion posture.
According to a second aspect of the present disclosure, a method for cooperation of multiple augmented reality devices, a multiple augmented reality device cooperation system including a first augmented reality terminal and a second augmented reality terminal, is used for the second augmented reality terminal, and includes:
receiving an operation instruction, wherein the operation instruction is an operation instruction of a virtual object sent by the first augmented reality terminal;
determining a second preset motion posture of the virtual object according to the operation instruction;
and enabling the virtual object to move according to the second preset motion posture.
According to a third aspect of the present disclosure, there is provided a multi-augmented reality device cooperation apparatus, a multi-augmented reality device cooperation system including a first augmented reality terminal and a second augmented reality terminal, the apparatus being used for the first augmented reality terminal, the multi-augmented reality device cooperation apparatus including:
the first motion module is used for enabling the virtual object to move according to a first preset motion posture according to the operation instruction;
and the sending module is configured to send the operation instruction to the second augmented reality terminal, and the second augmented reality terminal is configured to determine a second preset motion posture of the virtual object in the second augmented reality terminal according to the operation instruction, and enable the virtual object to move in the second augmented reality terminal according to the second preset motion posture.
According to a fourth aspect of the present disclosure, there is provided a multi-augmented reality device cooperation apparatus, a multi-augmented reality device cooperation system includes a first augmented reality terminal and a second augmented reality terminal, the apparatus is used for the second augmented reality terminal, the multi-augmented reality device cooperation apparatus includes:
a receiving module, configured to receive an operation instruction, where the operation instruction is an operation instruction of a virtual object sent by the first augmented reality terminal;
the determining module is used for determining a second preset motion posture of the virtual object according to the operation instruction;
and the second motion module is used for enabling the virtual object to move according to the second preset motion posture.
According to a fifth aspect of the present disclosure, there is provided an electronic device comprising
A processor; and
a memory having computer readable instructions stored thereon which, when executed by the processor, implement a method according to any of the above.
According to a sixth aspect of the present disclosure, there is provided a computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, implements the method according to any one of the above.
According to the multi-augmented reality equipment cooperation method, the first preset motion gesture of the virtual object at the first augmented reality terminal is sent to the second augmented reality terminal, so that the communication between the first augmented reality terminal and the second augmented reality terminal is realized, and the problem of multi-user cooperation asynchronization caused by the communication of a plurality of augmented reality terminals through the server is avoided; and the motion posture of the virtual object is preset in the augmented reality terminal, so that the calculation amount and the transmitted data amount of the equipment during multi-person cooperation can be reduced, the first augmented reality terminal and the second augmented reality terminal can cooperate, and the response speed of interaction of multiple augmented reality devices is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The above and other features and advantages of the present disclosure will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings.
Fig. 1 is a flowchart of a first method for collaboration of multiple augmented reality devices according to an exemplary embodiment of the present disclosure;
fig. 2 is a flowchart of a second method for collaboration of multiple augmented reality devices according to an exemplary embodiment of the present disclosure;
fig. 3 is a flowchart of a third method for collaboration by multiple augmented reality devices according to an exemplary embodiment of the present disclosure;
fig. 4 is a flowchart of a fourth collaboration method for multiple augmented reality devices according to an exemplary embodiment of the present disclosure;
fig. 5 is a block diagram of a collaboration apparatus of a first multiple augmented reality device according to an exemplary embodiment of the present disclosure;
fig. 6 is a block diagram of a collaboration apparatus of a second multiple augmented reality device according to an exemplary embodiment of the present disclosure;
fig. 7 is a schematic diagram of a first electronic device provided in an exemplary embodiment of the disclosure;
fig. 8 is a schematic diagram of a first computer-readable storage medium provided in an exemplary embodiment of the disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus, a repetitive description thereof will be omitted.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the embodiments of the disclosure can be practiced without one or more of the specific details, or with other methods, components, materials, devices, steps, and the like. In other instances, well-known structures, methods, devices, implementations, materials, or operations are not shown or described in detail to avoid obscuring aspects of the disclosure.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, or in one or more software-hardened modules, or in different networks and/or processor devices and/or microcontroller devices.
The multi-augmented-device cooperation system comprises a first augmented reality terminal and a second augmented reality terminal. The first augmented reality terminal is provided with a first communication unit, the second augmented reality terminal is provided with a second communication unit, and the first communication unit and the second communication unit can be matched and communicate. The communication between the first communication unit and the second communication unit may be communication in a local area network, that is, the first communication unit and the second communication unit may communicate directly, for example, the first communication unit and the second communication unit may be connected by wire, or the first communication unit and the second communication unit may be connected wirelessly by bluetooth, infrared ray, wiFi, or the like.
An exemplary embodiment of the present disclosure first provides a method for multi-augmented reality device cooperation, where a multi-augmented reality device cooperation system includes a first augmented reality terminal and a second augmented reality terminal, and the method is used for the first augmented reality terminal, as shown in fig. 1, the method may include the following steps:
step S110, enabling the virtual object to move according to a first preset movement posture according to the operation instruction;
step S120, sending an operation instruction to a second augmented reality terminal, where the second augmented reality terminal is configured to determine a second preset motion posture of the virtual object in the second augmented reality terminal according to the operation instruction, and enable the virtual object to move in the second augmented reality terminal according to the second preset motion posture.
According to the cooperation method of the multiple augmented reality devices, the operation instruction received by the virtual object at the first augmented reality terminal is sent to the second augmented reality terminal, so that the communication between the first augmented reality terminal and the second augmented reality terminal is realized, and the problem of multi-user cooperation asynchronization caused by the communication of the multiple augmented reality terminals through the server is avoided; and the motion attitude of the virtual object is preset in the augmented reality terminal, so that the calculation amount and the transmitted data amount of the equipment during multi-person cooperation can be reduced, the first augmented reality terminal and the second augmented reality terminal can cooperate, and the response speed of multi-augmented reality equipment interaction is improved.
It should be noted that, in the embodiment of the present disclosure, the multi-augmented reality device cooperation system includes the first augmented reality terminal and the second augmented reality terminal, which is not a limitation on the number of augmented reality terminals in the multi-augmented reality device cooperation system, and is used only as a marker of the augmented reality terminal. In the embodiment of the present disclosure, the first augmented reality terminal is an information sending terminal in an interaction process, and the second augmented reality terminal is an information receiving terminal in the interaction process. The information sending end in the interaction process may include one or more augmented reality terminals, and the information receiving end may also include one or more augmented reality terminals, which is not specifically limited in this embodiment of the disclosure.
Further, as shown in fig. 2, the cooperation method of multiple augmented reality devices provided by the embodiment of the present disclosure further includes the following steps:
step S130, planning a motion posture of the virtual object, where the motion posture of the virtual object is displayed as a first preset motion posture on the first augmented reality terminal, and the motion posture of the virtual object is displayed as a second preset motion posture on the second augmented reality terminal.
The following describes in detail each step of the collaboration method of multiple augmented reality devices provided by the embodiment of the present disclosure:
in step S110, the virtual object may be moved in a first preset movement posture according to the operation instruction.
One or more preset motion gestures of the virtual object can be preset in the first augmented reality terminal. The preset motion gesture may include a start position and an end position when the virtual object moves. The preset motion gesture may further include a motion trajectory, a motion speed, and a gesture of the virtual object itself.
When the virtual object has a preset motion gesture, the operation instruction is a trigger instruction, and when a user inputs the operation instruction to the first augmented reality terminal, the virtual object is triggered and moves according to the preset motion gesture. When the virtual object has multiple preset motion gestures, the operation instruction is a selection trigger instruction, namely the operation instruction has the functions of selecting the preset motion gestures and triggering motion, and the virtual object moves according to the preset motion gestures selected by the operation instruction.
The first augmented reality terminal may include a first display device, and the virtual object may be displayed on the first display device. When the preset motion posture may include a start position and an end position when the virtual object moves, the first display device may display a posture of the virtual object at the start position and a posture of the end position when displaying the motion posture of the virtual object. When the motion trajectory of the virtual object and the posture of the virtual object itself may be further included, the motion trajectory of the virtual object and the change in the posture of the virtual object itself may be displayed on the first display device frame by frame.
In a possible embodiment, step S110 can be implemented as follows: and moving the virtual object from the preset initial position to the preset end position according to the operation instruction. In an application scenario focusing on the start position and the end position of the virtual object, in step S110, the first augmented reality terminal responds to the operation instruction, and the virtual object moves from the preset initial position to the preset end position. On this basis, the second preset motion posture of the virtual object in the second augmented reality terminal may also be a motion from the preset initial position to the preset end position.
In another possible embodiment, step S110 may be implemented as follows: and enabling the virtual object to move according to a preset track according to the operation instruction. The embodiment is applied to an application scene focusing on the starting position, the end position and the motion trail of the virtual object. And the first augmented reality terminal responds to the operation instruction to enable the virtual object to move along a preset motion track. On this basis, the second preset motion posture of the virtual object in the second augmented reality terminal may also be from the preset starting point to the preset ending point according to the preset track.
In step S120, an operation instruction may be sent to a second augmented reality terminal, where the second augmented reality terminal is configured to determine a second preset motion posture of the virtual object in the second augmented reality terminal according to the operation instruction, and move the virtual object in the second augmented reality terminal according to the second preset motion posture.
When the first augmented reality terminal responds to the operation instruction, the virtual object moves in a first preset movement posture, and meanwhile the first augmented reality terminal sends the operation instruction to the second augmented reality terminal. And the second augmented reality terminal responds to the received operation instruction, so that the virtual object moves in a second preset movement posture.
When multiple augmented reality devices cooperate, due to the fact that the positions of the multiple augmented reality terminals are different, the angle of the image displayed by the same virtual object in each augmented reality terminal is different. In order to ensure that different augmented reality terminals can accurately display images of virtual objects at corresponding viewing angles, display data of the virtual objects at each augmented reality terminal is generally calculated through coordinate transformation and the like, and then the display data is displayed. In order to reduce the amount of calculation in the embodiment of the present disclosure, the motion pose of the virtual object and the pose of the virtual object itself at each angle may be preset in each augmented reality terminal.
For example, the relative positions of the first augmented reality terminal and the second augmented reality terminal may be fixed, and at this time, when the virtual object is displayed in the first augmented reality terminal in the first preset motion posture, the second preset motion posture of the virtual object displayed in the second augmented reality terminal is also fixed. The first preset motion gesture is stored in the first augmented reality terminal, and the second preset motion gesture is stored in the second augmented reality terminal. Certainly, in practical application, because the relative position of the first augmented reality terminal and the second augmented reality terminal is fixed, the second preset motion attitude can be obtained by calculation from the first preset motion attitude, and the second preset motion attitude can be obtained by calculation in the second augmented reality terminal.
It should be noted that the cooperation method for multiple augmented reality devices provided by the embodiment of the present disclosure may be used in an application scenario not limited to two devices. The first augmented reality terminal is a transmitting terminal, and the second augmented reality terminal is a receiving terminal. In practical applications, the receiving end may have a plurality of first augmented reality terminals, and the receiving end may have a plurality of second augmented reality terminals. And the transmitting terminal and the receiving terminal can be interchanged, that is, the second augmented reality terminal can be used as the transmitting terminal, and the first augmented reality terminal can be used as the receiving terminal.
When the second augmented reality terminal receives the operation instruction, according to the relative position of the second augmented reality terminal and the first preset motion posture of the virtual object in the first augmented reality terminal under the operation instruction, the second preset motion posture of the virtual object in the second augmented reality terminal is determined, and the virtual object moves in the second preset motion posture in the second augmented reality terminal.
When the operation instruction is sent, the operation instruction can be sent to the second augmented reality terminal every preset time. And the second augmented reality terminal receives the operation instruction and refreshes the display once every preset time according to the operation instruction. For example, the operation command may be sent every 1/60 second, and the display may be refreshed every 1/60 second by the second augmented reality terminal.
In step S130, a motion gesture of the virtual object may be planned, the motion gesture of the virtual object being displayed as a first preset motion gesture on the first augmented reality terminal, and the motion gesture of the virtual object being displayed as a second preset motion gesture on the second augmented reality terminal.
For a virtual object that determines a motion mode, a motion pose of the virtual object may be planned. Planning the motion pose of the virtual object may include determining a start position, an end position, a motion velocity, a motion trajectory, and the like of the virtual object. A first preset motion pose and a second preset motion pose of the virtual object may be calculated based on the relative position of the first augmented reality terminal and the second augmented reality terminal. And storing the first preset motion gesture in the first augmented reality terminal, and storing the second preset motion gesture in the second augmented reality terminal. Of course, in practical application, the second preset motion gesture may also be obtained by calculating during the cooperation process of the second augmented reality terminal, and this is not specifically limited in the embodiment of the present disclosure.
Before multi-augmented reality device interaction is carried out, a first augmented reality terminal and a second augmented reality terminal can be connected. The first augmented reality terminal and the second augmented reality terminal can be connected in a wired mode or in a wireless mode. In order to ensure the safety of information, the first augmented reality terminal and the second augmented reality terminal need to perform communication authentication when being connected. For example, when the first augmented reality terminal and the second augmented reality terminal are connected by a wire, authentication is performed during communication after the first augmented reality terminal and the second augmented reality terminal are connected by the wire. Authentication may be performed by means of a password or the like. When the first augmented reality terminal and the second augmented reality terminal are wirelessly connected, authentication can be performed at the time of connection.
When first augmented reality terminal and second augmented reality terminal are wired connection, can set up connection interface on first augmented reality terminal and second augmented reality terminal, the connecting wire passes through connection interface and connects first augmented reality terminal and second augmented reality terminal. When the first augmented reality terminal and the second augmented reality terminal are wirelessly connected, a wireless transceiving unit, for example, a bluetooth transceiving unit, an infrared transceiving unit or a WiFi transceiving unit, may be disposed thereon.
According to the cooperation method of the multiple augmented reality devices, the operation instruction received by the virtual object at the first augmented reality terminal is sent to the second augmented reality terminal, so that the communication between the first augmented reality terminal and the second augmented reality terminal is realized, and the problem of multi-user cooperation asynchronization caused by the communication of the multiple augmented reality terminals through the server is avoided; and the motion posture of the virtual object is preset in the augmented reality terminal, so that the calculation amount and the transmitted data amount of the equipment during multi-person cooperation can be reduced, the first augmented reality terminal and the second augmented reality terminal can cooperate, and the response speed of interaction of multiple augmented reality devices is improved.
An exemplary embodiment of the present disclosure further provides a multi-augmented reality device cooperation method, where a multi-augmented reality device cooperation system includes a first augmented reality terminal and a second augmented reality terminal, and the method is applied to the second augmented reality terminal, and as shown in fig. 3, the method may include the following steps:
step S310, receiving an operation instruction, wherein the operation instruction is an operation instruction of a virtual object sent by a first augmented reality terminal;
step S320, determining a second preset motion posture of the virtual object according to the operation instruction;
step S330, the virtual object is moved according to a second preset motion posture.
According to the cooperation method of the multiple augmented reality devices, the operation instruction received by the virtual object at the first augmented reality terminal is sent to the second augmented reality terminal, so that the communication between the first augmented reality terminal and the second augmented reality terminal is realized, and the problem of multi-user cooperation asynchronization caused by the communication of the multiple augmented reality terminals through the server is avoided; and the motion attitude of the virtual object is preset in the augmented reality terminal, so that the calculation amount and the transmitted data amount of the equipment during multi-person cooperation can be reduced, the first augmented reality terminal and the second augmented reality terminal can cooperate, and the response speed of multi-augmented reality equipment interaction is improved.
Further, as shown in fig. 4, the cooperation method of multiple augmented reality devices provided by the embodiment of the present disclosure may further include:
step S340, displaying the virtual object on the display device of the second augmented reality terminal, wherein the display is refreshed once every preset time.
The following describes in detail the steps of the method for collaboration among multiple augmented reality devices provided in the embodiment of the present disclosure:
in step S310, an operation instruction may be received, where the operation instruction is an operation instruction of a virtual object sent by the first augmented reality terminal.
When the first augmented reality terminal receives an operation instruction for the virtual object, the first augmented reality terminal sends the operation instruction to the second augmented reality terminal, and the second augmented reality terminal receives the operation instruction.
In a possible embodiment, the first augmented reality terminal includes a plurality of first sub augmented reality terminals, and step S310 may be implemented by:
step S510, receiving a plurality of sub-operation instructions, wherein the sub-operation instructions are sub-operation instructions for the virtual object sent by the first sub-augmented reality terminal;
step S520, determining an operation instruction according to the plurality of sub-operation instructions.
In step S510, a plurality of sub-operation instructions may be received, where the sub-operation instructions are sub-operation instructions for the virtual object sent by the first sub-augmented reality terminal.
When the first augmented reality terminal includes a plurality of first sub augmented reality terminals, the motion mode of the virtual object may be determined by the plurality of first sub augmented reality terminals together. That is, the plurality of first sub augmented reality terminals respectively receive a sub operation instruction, and the plurality of sub operation instructions jointly complete the control of the virtual object. At this time, the second augmented reality terminal receives the sub-operation instructions transmitted by the plurality of first sub-augmented reality terminals.
In step S520, an operation instruction may be determined according to the plurality of sub-operation instructions.
The plurality of sub-operation instructions sent by the plurality of first sub-augmented devices operate the virtual object together, and after the second augmented reality terminal receives the plurality of sub-operation instructions, the plurality of sub-operation instructions can be integrated, so that a complete operation instruction is obtained. And the second augmented reality terminal moves according to the preset movement posture corresponding to the operation instruction.
In step S320, a second preset motion posture of the virtual object may be determined according to the operation instruction.
When the second augmented reality terminal receives the operation instruction, according to the relative position of the second augmented reality terminal and the first preset motion posture of the virtual object in the first augmented reality terminal under the operation instruction, the second preset motion posture of the virtual object in the second augmented reality terminal is determined, and the virtual object moves in the second preset motion posture in the second augmented reality terminal.
For example, the relative positions of the first augmented reality terminal and the second augmented reality terminal may be fixed, and at this time, when the virtual object is displayed in the first augmented reality terminal in the first preset motion posture, the second preset motion posture of the virtual object displayed in the second augmented reality terminal is also fixed. The first preset motion gesture is stored in the first augmented reality terminal, and the second preset motion gesture is stored in the second augmented reality terminal. Certainly, in practical applications, because the relative position of the first augmented reality terminal and the second augmented reality terminal is fixed, the second preset motion posture can be obtained by calculation from the first preset motion posture, and the second preset motion posture can be obtained by calculation in the second augmented reality terminal.
In step S330, the virtual object may be moved in accordance with a second preset motion posture.
A second preset motion posture of the virtual object is obtained through step S320, and at this time, the virtual object is driven to move according to the second preset motion posture. The motion of the virtual object is also virtual, and can be fused with the real scene to be displayed on the augmented reality terminal.
In step S340, the virtual object may be displayed on the display device of the second augmented reality terminal, wherein the display is refreshed at preset time intervals.
When the virtual object is displayed, the virtual object may be displayed frame by frame according to a second preset motion posture of the virtual object. The first augmented reality terminal sends an operation instruction to the second augmented reality terminal every other preset time, and after the second augmented reality terminal receives the operation instruction, the content displayed by the second augmented reality terminal is refreshed according to the operation instruction.
The preset time interval between the sending of the operation instruction from the first augmented reality terminal to the second augmented reality terminal and the preset time interval for refreshing and displaying by the second augmented reality terminal can be the same or different. In practical applications, in order to ensure timeliness of the second augmented reality terminal during displaying, the preset time interval for sending the operation command and the time interval for refreshing the display may be the same.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken into multiple step executions, etc.
The present disclosure further provides a multi-augmented reality device cooperation apparatus, a multi-augmented reality device cooperation system includes a first augmented reality terminal and a second augmented reality terminal, the apparatus is used for the first augmented reality terminal, as shown in fig. 5, the multi-augmented reality device cooperation apparatus 500 includes:
a first movement module 510, configured to, according to an operation instruction, move the virtual object according to a first preset movement posture;
a sending module 520, configured to send the first preset motion gesture to the second augmented reality terminal, where the second augmented reality terminal is configured to determine a second preset motion gesture of the virtual object in the second augmented reality terminal according to the first preset motion gesture, and enable the virtual object to move in the second augmented reality terminal according to the second preset motion gesture.
In an exemplary embodiment of the present disclosure, a multi-augmented reality device cooperation apparatus, a multi-augmented reality device cooperation system includes a first augmented reality terminal and a second augmented reality terminal, the apparatus is used for the second augmented reality terminal, as shown in fig. 6, the multi-augmented reality device cooperation apparatus 600 includes:
a receiving module 610, configured to receive a first preset motion gesture, where the first preset motion gesture is a motion performed by a virtual object sent by a first augmented reality terminal in response to an operation instruction;
a determining module 620, configured to determine a second preset motion posture of the virtual object according to the first preset motion posture;
and a second movement module 630, configured to move the virtual object according to a second preset movement posture.
The specific details of the collaboration device module of each of the multiple augmented reality devices have been described in detail in the corresponding virtual object transmission method, and therefore are not described herein again.
It should be noted that although in the above detailed description several modules or units of the cooperating means of the multi augmented reality device are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 700 according to such an embodiment of the invention is described below with reference to fig. 7. The electronic device 700 shown in fig. 7 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 7, electronic device 700 is in the form of a general purpose computing device. The components of the electronic device 700 may include, but are not limited to: the at least one processing unit 710, the at least one memory unit 720, a bus 730 connecting different system components (including the memory unit 720 and the processing unit 710), and a display unit 740.
Wherein the memory unit stores program code that may be executed by the processing unit 710 to cause the processing unit 710 to perform the steps according to various exemplary embodiments of the present invention described in the above section "exemplary method" of this specification.
The storage unit 720 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM) 7201 and/or a cache memory unit 7202, and may further include a read only memory unit (ROM) 7203.
The memory unit 720 may also include programs/utilities 7204 having a set (at least one) of program modules 7205, such program modules 7205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may comprise an implementation of a network environment.
The electronic device 700 may also communicate with one or more external devices 770 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 700, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 700 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 750. Also, the electronic device 700 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the internet) via the network adapter 760. As shown, the network adapter 740 communicates with the other modules of the electronic device 700 over the bus 730. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
In an exemplary embodiment of the present disclosure, there is also provided a computer readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above-mentioned "exemplary methods" section of the present description, when said program product is run on the terminal device.
Referring to fig. 8, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Furthermore, the above-described figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the terms of the appended claims.
Claims (12)
1. A multi-augmented reality device cooperation method is characterized in that a multi-augmented reality device cooperation system comprises a first augmented reality terminal and a second augmented reality terminal, and the method is used for the first augmented reality terminal and comprises the following steps:
enabling the virtual object to move according to a first preset movement posture according to the operation instruction;
and sending the operation instruction to the second augmented reality terminal, wherein the second augmented reality terminal is used for determining a second preset motion posture of the virtual object in the second augmented reality terminal according to the operation instruction and enabling the virtual object to move in the second augmented reality terminal according to the second preset motion posture.
2. The method for cooperation among multiple augmented reality devices according to claim 1, wherein the moving the virtual object according to the operation instruction in the first preset movement posture comprises:
and moving the virtual object from a preset initial position to a preset end position according to the operation instruction.
3. The method for cooperation among multiple augmented reality devices according to claim 2, wherein the moving the virtual object according to the operation instruction in a first preset movement posture further comprises:
and enabling the virtual object to move according to a preset track according to the operation instruction.
4. The method of collaboration of multiple augmented reality devices of claim 1, the method further comprising:
and planning the motion gesture of the virtual object, wherein the motion gesture of the virtual object is displayed as a first preset motion gesture on the first augmented reality terminal, and the motion gesture of the virtual object is displayed as a second preset motion gesture on the second augmented reality terminal.
5. The method for cooperation of multiple augmented reality devices according to claim 1, wherein sending the operation command to the second augmented reality terminal includes:
and sending the operation instruction to the second augmented reality terminal every preset time.
6. A multi-augmented reality device cooperation method is characterized in that a multi-augmented reality device cooperation system comprises a first augmented reality terminal and a second augmented reality terminal, the method is used for the second augmented reality terminal, and the method comprises the following steps:
receiving an operation instruction, wherein the operation instruction is an operation instruction of a virtual object sent by the first augmented reality terminal;
determining a second preset motion posture of the virtual object according to the operation instruction;
and enabling the virtual object to move according to the second preset motion posture.
7. The method for cooperation of multiple augmented reality devices according to claim 6, wherein the first augmented reality terminal includes a plurality of first sub-augmented reality terminals, and the receiving the operation instruction includes:
receiving a plurality of sub-operation instructions, wherein the sub-operation instructions are sub-operation instructions for the virtual object sent by the first sub-augmented reality terminal;
and determining the operation instruction according to the plurality of sub-operation instructions.
8. The method of collaboration of multiple augmented reality devices of claim 6, the method further comprising:
and displaying the virtual object on a display device of the second augmented reality terminal, wherein the display is refreshed once every preset time.
9. The utility model provides a cooperation device of many augmented reality equipment, characterized in that, many augmented reality equipment cooperation system includes first augmented reality terminal and second augmented reality terminal, the device is used for first augmented reality terminal, cooperation device of many augmented reality equipment includes:
the first motion module is used for enabling the virtual object to move according to a first preset motion posture according to the operation instruction;
and the sending module is configured to send the operation instruction to the second augmented reality terminal, and the second augmented reality terminal is configured to determine a second preset motion posture of the virtual object in the second augmented reality terminal according to the operation instruction, and enable the virtual object to move in the second augmented reality terminal according to the second preset motion posture.
10. The utility model provides a cooperation device of many augmented reality equipment, its characterized in that, many augmented reality equipment cooperation system includes first augmented reality terminal and second augmented reality terminal, the device is used for second augmented reality terminal, the cooperation device of many augmented reality equipment includes:
a receiving module, configured to receive an operation instruction, where the operation instruction is an operation instruction of a virtual object sent by the first augmented reality terminal;
the determining module is used for determining a second preset motion posture of the virtual object according to the operation instruction;
and the second motion module is used for enabling the virtual object to move according to the second preset motion posture.
11. An electronic device, comprising
A processor; and
a memory having computer readable instructions stored thereon which, when executed by the processor, implement the method of any of claims 1 to 8.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211355993.5A CN115509363A (en) | 2019-11-05 | 2019-11-05 | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211355993.5A CN115509363A (en) | 2019-11-05 | 2019-11-05 | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium |
| CN201911070989.2A CN110908509B (en) | 2019-11-05 | 2019-11-05 | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911070989.2A Division CN110908509B (en) | 2019-11-05 | 2019-11-05 | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115509363A true CN115509363A (en) | 2022-12-23 |
Family
ID=69816262
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211355993.5A Pending CN115509363A (en) | 2019-11-05 | 2019-11-05 | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium |
| CN201911070989.2A Active CN110908509B (en) | 2019-11-05 | 2019-11-05 | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911070989.2A Active CN110908509B (en) | 2019-11-05 | 2019-11-05 | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN115509363A (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114995649B (en) * | 2022-06-14 | 2023-12-29 | 北京新唐思创教育科技有限公司 | Role calling method, device, equipment and medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5832666B2 (en) * | 2011-12-20 | 2015-12-16 | インテル・コーポレーション | Augmented reality representation across multiple devices |
| CN106200944A (en) * | 2016-06-30 | 2016-12-07 | 联想(北京)有限公司 | The control method of a kind of object, control device and control system |
| CN106993181B (en) * | 2016-11-02 | 2019-03-05 | 大辅科技（北京）有限公司 | More VR/AR equipment collaboration systems and Synergistic method |
| CN107885334B (en) * | 2017-11-23 | 2021-10-22 | 联想(北京)有限公司 | Information processing method and virtual equipment |
| US20190253700A1 (en) * | 2018-02-15 | 2019-08-15 | Tobii Ab | Systems and methods for calibrating image sensors in wearable apparatuses |
| CN108479060B (en) * | 2018-03-29 | 2021-04-13 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN208461845U (en) * | 2018-06-05 | 2019-02-01 | 厦门蚂蚁特工网络科技有限公司 | A kind of more VR/AR equipment collaboration systems that data linkage transmission is smooth |
-
2019
- 2019-11-05 CN CN202211355993.5A patent/CN115509363A/en active Pending
- 2019-11-05 CN CN201911070989.2A patent/CN110908509B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110908509A (en) | 2020-03-24 |
| CN110908509B (en) | 2022-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110297550B (en) | Label display method and device, screen throwing equipment, terminal and storage medium | |
| CN107688791A (en) | display content control method and device, system, storage medium and electronic equipment | |
| CN108776544B (en) | Interaction method and device in augmented reality, storage medium and electronic equipment | |
| KR101639301B1 (en) | Online coding learning method, server and system thereof | |
| CN114564106B (en) | Method and device for determining interaction indication line, electronic equipment and storage medium | |
| CN110908509B (en) | Multi-augmented reality equipment cooperation method and device, electronic equipment and storage medium | |
| CN106681506B (en) | Interaction method for non-VR application in terminal equipment and terminal equipment | |
| US10198843B1 (en) | Conversion of 2D diagrams to 3D rich immersive content | |
| WO2024077872A1 (en) | Display position adjustment method and apparatus, storage medium, and electronic device | |
| WO2024077873A1 (en) | Virtual-scene scaling method and apparatus, and storage medium and electronic device | |
| CN112987924A (en) | Method, apparatus, device and storage medium for device interaction | |
| US7836461B2 (en) | Computer interface system using multiple independent hardware and virtual human-computer input devices and related enabling subroutines | |
| CN113769403A (en) | Virtual object moving method and device, readable storage medium and electronic equipment | |
| KR101162703B1 (en) | Method, terminal and computer-readable recording medium for remote control on the basis of 3d virtual space | |
| CN112714331B (en) | Information prompting method and device, storage medium and electronic equipment | |
| CN115562532A (en) | Mouse input data processing method and device, storage medium and electronic equipment | |
| CN113391737A (en) | Interface display control method and device, storage medium and electronic equipment | |
| CN110604918B (en) | Interface element adjustment method and device, storage medium and electronic equipment | |
| CN110162251B (en) | Image scaling method and device, storage medium and electronic equipment | |
| CN107122096A (en) | Based on the VR terminal method of toch control shown and terminal | |
| US20150350292A1 (en) | Site management platform | |
| CN114578966B (en) | Interaction method, interaction device, head-mounted display device, electronic device and medium | |
| KR102613390B1 (en) | Method for providing augmented reality and system thereof | |
| CN112546613B (en) | Equipment control method, device, equipment and storage medium | |
| CN108563335B (en) | Virtual reality interaction method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |