CN112394809A - Method, device and communication equipment for realizing augmented reality - Google Patents
Method, device and communication equipment for realizing augmented reality Download PDFInfo
- Publication number
- CN112394809A CN112394809A CN201910757254.0A CN201910757254A CN112394809A CN 112394809 A CN112394809 A CN 112394809A CN 201910757254 A CN201910757254 A CN 201910757254A CN 112394809 A CN112394809 A CN 112394809A
- Authority
- CN
- China
- Prior art keywords
- terminal
- target
- augmented reality
- target image
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 105
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000004891 communication Methods 0.000 title claims abstract description 13
- 238000004590 computer program Methods 0.000 claims description 17
- 238000004458 analytical method Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 12
- 238000004364 calculation method Methods 0.000 abstract description 5
- 230000008569 process Effects 0.000 description 15
- 238000009877 rendering Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 238000004422 calculation algorithm Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04802—3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a method, a device and a communication device for realizing augmented reality, wherein the method for realizing augmented reality comprises the following steps: acquiring a target image; sending the target image to a server; receiving target information sent by the server according to the target image; and performing augmented reality display on the object in the display picture of the terminal by using the target information. According to the embodiment of the invention, the target information acquired from the server can be utilized in real time to realize the augmented reality display of the object in the display picture of the terminal, so that a large amount of information for the augmented reality display is prevented from being stored in the terminal in advance, the calculation amount for realizing the augmented reality is reduced, the real-time display of the augmented reality is ensured, and the augmented reality effect is enhanced.
Description
Technical Field
The present invention relates to the field of augmented reality technologies, and in particular, to a method, an apparatus, and a communication device for implementing augmented reality.
Background
In an existing augmented reality display scheme, information for augmented reality display, such as three-dimensional metadata, generally needs to be stored in a terminal in advance. However, since three-dimensional metadata required for three-dimensional object recognition is extremely huge, on one hand, in practical application, there is no possibility that the three-dimensional metadata of a plurality of objects is cached locally, and augmented reality display of the plurality of objects cannot be realized, and on the other hand, if a lot of three-dimensional metadata are cached, the amount of computation complexity is increased rapidly, and real-time display of augmented reality is affected. Therefore, the display effect of the existing augmented reality display mode is poor.
Disclosure of Invention
The embodiment of the invention provides a method, a device and communication equipment for realizing augmented reality, and aims to solve the problem of poor display effect of the existing augmented reality display mode.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a method for implementing augmented reality, which is applied to a terminal, and includes:
acquiring a target image;
sending the target image to a server;
receiving target information sent by the server according to the target image;
and performing augmented reality display on the object in the display picture of the terminal by using the target information.
In a second aspect, an embodiment of the present invention provides a method for implementing augmented reality, which is applied to a server, and includes:
receiving a target image sent by a terminal;
analyzing the target image to obtain target information;
and sending the target information to the terminal so that the terminal utilizes the target information to perform augmented reality display on the object in the display picture of the terminal.
In a third aspect, an embodiment of the present invention provides an apparatus for implementing augmented reality, which is applied to a terminal, and includes:
the first acquisition module is used for acquiring a target image;
the first sending module is used for sending the target image to a server;
the first receiving module is used for receiving the target information sent by the server according to the target image;
and the display module is used for performing augmented reality display on the object in the display picture of the terminal by using the target information.
In a fourth aspect, an embodiment of the present invention provides an apparatus for implementing augmented reality, which is applied to a server, and includes:
the second receiving module is used for receiving the target image sent by the terminal;
the analysis module is used for analyzing the target image to obtain target information;
and the second sending module is used for sending the target information to the terminal so that the terminal can perform augmented reality display on the object in the display picture of the terminal by using the target information.
In a fifth aspect, an embodiment of the present invention provides a terminal, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the method for implementing augmented reality.
In a sixth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the method for implementing augmented reality described above.
In the embodiment of the invention, the target image is acquired, the target image is sent to the server, the target information sent by the server according to the target image is received, the target information is utilized to perform augmented reality display on the object in the display picture of the terminal, and the target information acquired from the server can be utilized in real time to realize the augmented reality display on the object in the display picture of the terminal, so that a large amount of information for the augmented reality display is prevented from being stored in the terminal in advance, the calculation amount for realizing the augmented reality is reduced, the real-time display of the augmented reality is ensured, and the augmented reality effect is enhanced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
Fig. 1 is a flowchart of a method for implementing augmented reality according to an embodiment of the present invention;
FIG. 2 is a second flowchart of a method for implementing augmented reality according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating user input operations in accordance with an embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating identification of a target object in an embodiment of the present invention;
FIG. 5 is a schematic illustration of an augmented reality display in an embodiment of the invention;
fig. 6 is a schematic structural diagram of an apparatus for implementing augmented reality according to an embodiment of the present invention;
FIG. 7 is a second schematic structural diagram of an apparatus for implementing augmented reality according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a communication device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a method for implementing augmented reality according to an embodiment of the present invention, where the method is applied to a terminal, and as shown in fig. 1, the method includes the following steps:
step 101: and acquiring a target image.
In this embodiment, the target image may be stored in the terminal in advance, or may be acquired in real time by means of user input operation. The step 101 may include: receiving input operation of a user on a terminal; and according to the input operation, screenshot is carried out on a display picture of the terminal to obtain a target image. Optionally, the input operation may be a pressing operation on an entity key in the terminal, or a clicking operation on a display interface of the terminal, and the like. The display picture of the terminal can be acquired in real time through a camera in the terminal.
Step 102: and sending the target image to a server.
Step 103: and receiving target information sent by the server according to the target image.
In this embodiment, the server may analyze the received target image, so as to provide information for augmented reality presentation, that is, the target information, for the terminal. The target information may be selected from three-dimensional metadata and rendering data of the object in the target image. The three-dimensional metadata can be understood as a combined structure (data packet) of feature values of an object, which are distributed in the shape of the surface of the object in space to form a spatial mesh structure, and each feature value is a vertex on the spatial mesh structure and contains a calculated feature point value. The rendering data may be selected as text, images, and the like.
Step 104: and performing augmented reality display on the object in the display picture of the terminal by using the target information.
After receiving the target information sent by the server, the terminal can directly utilize the target information to perform augmented reality display on the object in the display picture of the terminal.
According to the method for realizing augmented reality, the target image is acquired and sent to the server, the target information sent by the server according to the target image is received, the target information is utilized to carry out augmented reality display on the object in the display picture of the terminal, the target information acquired from the server can be utilized in real time to realize the augmented reality display on the object in the display picture of the terminal, so that a large amount of information for realizing the augmented reality display is prevented from being stored in the terminal in advance, the calculation amount for realizing the augmented reality is reduced, the real-time display of the augmented reality is ensured, and the augmented reality effect is enhanced.
In at least one embodiment of the present invention, since the display screen of the terminal may include a plurality of objects, and the user is only interested in the augmented reality content of one of the objects (i.e., the target object), in order to ensure the viewing experience of the user and reduce the calculation amount for implementing augmented reality, in the implementation of augmented reality, the terminal may only obtain the target information associated with the target object from the server, and perform augmented reality display on the target object in the display screen of the terminal by using the target information.
In one embodiment, when the target image is acquired according to an input operation of a user to the terminal, the input operation may be a selection operation of a target object in a display screen of the terminal, so as to perform augmented reality display on the target object subsequently. Such as clicking or double-clicking on the target object.
Further, when the input operation is a selection operation on a target object, the target information is information related to the target object. And after receiving the target information related to the target object, the terminal can utilize the target information to perform augmented reality display on the target object in the display picture of the terminal.
Optionally, in order to facilitate the terminal to obtain the target information related to the target object, after receiving the operation of the user for selecting the target object, the terminal may generate the position information indicating the position of the target object according to the operation, send the position information to the server, and receive the target information sent by the server according to the target image and the position information, that is, the information related to the target object.
For example, if the input operation is a click operation on the target object, the position information indicating the position of the target object may be selected as the position information of the click point corresponding to the click operation.
In one embodiment, in the case that the target information is three-dimensional metadata and rendering data of the target object, the process of performing augmented reality presentation using the target information may be: firstly, calculating and extracting a characteristic value of the surface of a target object in a terminal display picture (which can be acquired by a camera in real time), and comparing the characteristic value with received three-dimensional metadata of the target object to obtain a data packet corresponding to a matching characteristic value; then, calculating the shooting position of a terminal display picture, namely the spatial position of a camera relative to a target object, and calculating information such as the size and the position of rendering data according to the spatial position; and finally, loading the three-dimensional metadata and the rendering data through an augmented reality engine to perform augmented reality display.
Referring to fig. 2, fig. 2 is a flowchart of a method for implementing augmented reality according to an embodiment of the present invention, where the method is applied to a server, and as shown in fig. 2, the method includes the following steps:
step 201: and receiving the target image sent by the terminal.
In this embodiment, the target image may be stored in the terminal in advance, or may be acquired in real time by means of user input operation.
Step 202: and analyzing the target image to obtain target information.
Step 203: and sending the target information to the terminal so that the terminal utilizes the target information to perform augmented reality display on the object in the display picture of the terminal.
In the embodiment of the invention, the terminal can realize the augmented reality display of the object in the display picture of the terminal by utilizing the target information acquired from the server in real time, thereby avoiding pre-storing a large amount of information for the augmented reality display in the terminal, reducing the calculation amount for realizing the augmented reality, ensuring the real-time display of the augmented reality and enhancing the display effect.
Optionally, before step 202, the method further includes:
and receiving position information sent by the terminal, wherein the position information represents the position of a target object in the target image.
The step 202 may include:
identifying an object in the target image;
judging whether the identified object in the target image comprises the target object or not according to the position information;
in a case where the target object is included, the target information related to the target object is acquired.
When it is determined that the identified object in the target image does not include the target object, the server may determine that the process of acquiring the target information this time is an invalid process.
Optionally, when the server identifies the object in the target image, the server may identify the content of the target image through an image identification algorithm, such as a deep learning algorithm, to identify the object in the target image, or may perform accurate pixel-level segmentation on the target image through another identification detection algorithm, such as a semantic segmentation algorithm, to identify the object in the target image. Understandably, the objects in the identified target image are typically classified objects. When acquiring the target information related to the target object, the server may detect the target information related to the target object from the database by using a name, an identifier, and the like of the target object, such as three-dimensional metadata and rendering data.
The following describes a process for implementing augmented reality in an embodiment of the present invention with reference to fig. 3 to 5.
In the specific embodiment of the invention, when a user opens a camera in the terminal to browse a picture, if the user touches an interested target object and wants to perform augmented reality display, the user can click the target object in the display picture of the terminal so as to make the terminal perform screenshot on the display picture of the terminal to obtain a target image. For example, in the example where the target object is the doll shown in fig. 3 and the click point of the click operation is a dot shown in fig. 3, the corresponding target image may be as shown in fig. 3.
When the terminal obtains the target image, the terminal may also record position information of a click point of the user's click operation, that is, position information of a dot shown in fig. 3, which may indicate the position of the target doll. Further, the terminal may also upload the target image and the location information to the server, so that the server identifies classified objects in the target image through an image recognition algorithm, for example, the objects in the box in fig. 4 are identified objects. After the server identifies the object in the target image, it may determine whether the identified object includes the target object according to the received position information, for example, as shown in fig. 4, if the position of the click point overlaps with the position detection frame of the doll, it indicates that the doll includes the target object, and if it is determined that the doll does not include the target object, it indicates that the click operation is an invalid operation. And the server detects the three-dimensional metadata and rendering data of the target object doll from the database by means of the name of the doll under the condition that the target object is judged to be included, and packages and sends the three-dimensional metadata and the rendering data to the terminal. The terminal receives the three-dimensional metadata and rendering data of the target object doll sent by the server, and the three-dimensional metadata and the rendering data can be loaded through the augmented reality engine to perform augmented reality display on the doll, as shown in fig. 5, the surface characteristics of the doll in fig. 5 are realized based on the three-dimensional metadata, and characters, a facial makeup, shadows and the like are realized based on the rendering data.
Note that the terminal may wait for a response from the server after uploading the target image and the position information to the server. And if the corresponding data responded by the server is not received within the preset time, prompting the user to perform next click operation.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an apparatus for implementing augmented reality according to an embodiment of the present invention, which is applied to a terminal, and as shown in fig. 6, the apparatus 60 for implementing augmented reality includes:
a first obtaining module 61, configured to obtain a target image;
a first sending module 62, configured to send the target image to a server;
a first receiving module 63, configured to receive target information sent by the server according to the target image;
and the display module 64 is configured to perform augmented reality display on the object in the display screen of the terminal by using the target information.
Optionally, the first obtaining module 61 includes:
the receiving unit is used for receiving input operation of a user on the terminal;
and the processing unit is used for carrying out screenshot on the display picture of the terminal according to the input operation to obtain the target image.
Optionally, the input operation is a selection operation of a target object in a display screen of the terminal;
the target information is information related to the target object;
the display module 64 is specifically configured to:
and utilizing the target information to perform augmented reality display on the target object in the display picture of the terminal.
Optionally, the apparatus 60 for implementing augmented reality further includes:
a generating module, configured to generate, according to the selection operation, position information indicating a position of the target object;
the first sending module 62 is further configured to: sending the location information to the server;
the first receiving module 63 is specifically configured to: and receiving target information sent by the server according to the target image and the position information.
Optionally, the display picture of the terminal is acquired in real time through a camera in the terminal.
It can be understood that the apparatus 60 for implementing augmented reality in the embodiment of the present invention can implement each process of the method embodiment for implementing augmented reality shown in fig. 1, and can achieve the same technical effect, and for avoiding repetition, the details are not described here again.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an apparatus for implementing augmented reality according to an embodiment of the present invention, which is applied to a server, and as shown in fig. 7, the apparatus 70 for implementing augmented reality includes:
a second receiving module 71, configured to receive a target image sent by a terminal;
the analysis module 72 is configured to analyze the target image to obtain target information;
a second sending module 73, configured to send the target information to the terminal, so that the terminal performs augmented reality display on an object in a display screen of the terminal by using the target information.
Optionally, the apparatus 70 for implementing augmented reality further includes:
a third receiving module, configured to receive location information sent by the terminal, where the location information indicates a location of a target object in the target image;
the parsing module 72 is specifically configured to:
identifying an object in the target image;
judging whether the identified object in the target image comprises the target object or not according to the position information;
in a case where the target object is included, the target information related to the target object is acquired.
It can be understood that the apparatus 70 for implementing augmented reality in the embodiment of the present invention can implement the above-mentioned processes of the embodiment for implementing augmented reality shown in fig. 2, and can achieve the same technical effects, and for avoiding repetition, the details are not described here again.
In addition, an embodiment of the present invention further provides a communication device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, may implement each process of the method embodiment for implementing augmented reality shown in fig. 1, or implement each process of the method embodiment for implementing augmented reality shown in fig. 2, and may achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The communication device can be selected as a terminal or a server
Specifically, referring to fig. 8, an embodiment of the present invention further provides a communication device, which includes a bus 81, a transceiver 82, an antenna 83, a bus interface 84, a processor 85, and a memory 86.
In an embodiment of the present invention, the communication device further includes: a computer program stored on the memory 86 and executable on the processor 85.
Optionally, when the communication device is a terminal, the computer program may implement the following steps when executed by the processor 85:
acquiring a target image;
sending the target image to a server;
receiving target information sent by the server according to the target image;
and performing augmented reality display on the object in the display picture of the terminal by using the target information.
In a further embodiment, when being executed by the processor 85, the computer program can implement each process of the embodiment of the method for implementing augmented reality shown in fig. 1, and can achieve the same technical effect, and is not described herein again to avoid repetition.
Optionally, when the communication device is a server, the computer program may implement the following steps when executed by the processor 85:
receiving a target image sent by a terminal;
analyzing the target image to obtain target information;
and sending the target information to the terminal so that the terminal utilizes the target information to perform augmented reality display on the object in the display picture of the terminal.
In a further embodiment, when being executed by the processor 85, the computer program can implement each process of the embodiment of the method for implementing augmented reality shown in fig. 2, and can achieve the same technical effect, and is not described herein again to avoid repetition.
In FIG. 8, a bus architecture (represented by bus 81), bus 81 may include any number of interconnected buses and bridges, bus 81 linking together various circuits including one or more processors, represented by processor 85, and memory, represented by memory 86. The bus 81 may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface 84 provides an interface between the bus 81 and the transceiver 82. The transceiver 82 may be one element or may be multiple elements, such as multiple receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor 85 is transmitted over a wireless medium via the antenna 83, and further, the antenna 83 receives the data and transmits the data to the processor 85.
The processor 85 is responsible for managing the bus 81 and general processing, and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory 86 may be used to store data used by the processor 85 in performing operations.
Alternatively, the processor 85 may be a CPU, ASIC, FPGA or CPLD.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when being executed by a processor, the computer program may implement each process of the embodiment of the method for implementing augmented reality shown in fig. 1 or each process of the embodiment of the method for implementing augmented reality shown in fig. 2, and achieve the same technical effect, and in order to avoid repetition, the computer program is not described herein again.
Computer-readable media, which include both non-transitory and non-transitory, removable and non-removable media, may implement the information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (11)
1. A method for realizing augmented reality is applied to a terminal, and is characterized by comprising the following steps:
acquiring a target image;
sending the target image to a server;
receiving target information sent by the server according to the target image;
and performing augmented reality display on the object in the display picture of the terminal by using the target information.
2. The method of claim 1, wherein the acquiring a target image comprises:
receiving input operation of a user on the terminal;
and capturing a display picture of the terminal according to the input operation to obtain the target image.
3. The method according to claim 2, wherein the input operation is a selection operation of a target object in a display screen of the terminal;
the target information is information related to the target object;
the utilizing the target information to perform augmented reality display on the object in the display picture of the terminal comprises the following steps:
and utilizing the target information to perform augmented reality display on the target object in the display picture of the terminal.
4. The method according to claim 3, wherein after receiving the input operation of the terminal by the user, the method further comprises:
generating position information representing the position of the target object according to the selection operation;
sending the location information to the server;
the receiving of the target information sent by the server according to the target image includes:
and receiving target information sent by the server according to the target image and the position information.
5. The method according to claim 2, wherein the display of the terminal is acquired in real time by a camera in the terminal.
6. A method for realizing augmented reality is applied to a server, and is characterized by comprising the following steps:
receiving a target image sent by a terminal;
analyzing the target image to obtain target information;
and sending the target information to the terminal so that the terminal utilizes the target information to perform augmented reality display on the object in the display picture of the terminal.
7. The method of claim 6, wherein before parsing the target image to obtain target information, the method further comprises:
receiving position information sent by the terminal, wherein the position information represents the position of a target object in the target image;
the analyzing the target image to obtain the target information includes:
identifying an object in the target image;
judging whether the identified object in the target image comprises the target object or not according to the position information;
in a case where the target object is included, the target information related to the target object is acquired.
8. The utility model provides a realize augmented reality's device is applied to the terminal, its characterized in that includes:
the first acquisition module is used for acquiring a target image;
the first sending module is used for sending the target image to a server;
the first receiving module is used for receiving the target information sent by the server according to the target image;
and the display module is used for performing augmented reality display on the object in the display picture of the terminal by using the target information.
9. An apparatus for implementing augmented reality, applied to a server, comprising:
the second receiving module is used for receiving the target image sent by the terminal;
the analysis module is used for analyzing the target image to obtain target information;
and the second sending module is used for sending the target information to the terminal so that the terminal can perform augmented reality display on the object in the display picture of the terminal by using the target information.
10. A communication device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the computer program, when executed by the processor, implements the steps of a method of implementing augmented reality according to any one of claims 1 to 5 or implements the steps of a method of implementing augmented reality according to claim 6 or 7.
11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of implementing augmented reality of any one of claims 1 to 5, or the steps of the method of implementing augmented reality of claim 6 or 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910757254.0A CN112394809A (en) | 2019-08-16 | 2019-08-16 | Method, device and communication equipment for realizing augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910757254.0A CN112394809A (en) | 2019-08-16 | 2019-08-16 | Method, device and communication equipment for realizing augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112394809A true CN112394809A (en) | 2021-02-23 |
Family
ID=74602774
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910757254.0A Pending CN112394809A (en) | 2019-08-16 | 2019-08-16 | Method, device and communication equipment for realizing augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112394809A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023051739A1 (en) * | 2021-09-30 | 2023-04-06 | 中兴通讯股份有限公司 | Image display method and device, storage medium, and electronic device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101794642B1 (en) * | 2016-09-13 | 2017-12-01 | 네오컨버전스 주식회사 | Method and apparatus for providing augmented reality using recognized video |
| CN107493228A (en) * | 2017-08-29 | 2017-12-19 | 北京易讯理想科技有限公司 | A kind of social interaction method and system based on augmented reality |
| CN107767459A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | Methods of exhibiting, device and system based on augmented reality |
| CN108388637A (en) * | 2018-02-26 | 2018-08-10 | 腾讯科技（深圳）有限公司 | A kind of method, apparatus and relevant device for providing augmented reality service |
| CN108897573A (en) * | 2018-05-31 | 2018-11-27 | 广东美的制冷设备有限公司 | Display appliance method, terminal device and server |
| CN109062523A (en) * | 2018-06-14 | 2018-12-21 | 北京三快在线科技有限公司 | Methods of exhibiting, device, electronic equipment and the storage medium of augmented reality data |
-
2019
- 2019-08-16 CN CN201910757254.0A patent/CN112394809A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107767459A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | Methods of exhibiting, device and system based on augmented reality |
| KR101794642B1 (en) * | 2016-09-13 | 2017-12-01 | 네오컨버전스 주식회사 | Method and apparatus for providing augmented reality using recognized video |
| CN107493228A (en) * | 2017-08-29 | 2017-12-19 | 北京易讯理想科技有限公司 | A kind of social interaction method and system based on augmented reality |
| CN108388637A (en) * | 2018-02-26 | 2018-08-10 | 腾讯科技（深圳）有限公司 | A kind of method, apparatus and relevant device for providing augmented reality service |
| CN108897573A (en) * | 2018-05-31 | 2018-11-27 | 广东美的制冷设备有限公司 | Display appliance method, terminal device and server |
| CN109062523A (en) * | 2018-06-14 | 2018-12-21 | 北京三快在线科技有限公司 | Methods of exhibiting, device, electronic equipment and the storage medium of augmented reality data |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023051739A1 (en) * | 2021-09-30 | 2023-04-06 | 中兴通讯股份有限公司 | Image display method and device, storage medium, and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110458918B (en) | Method and device for outputting information | |
| WO2022007434A1 (en) | Visualization method and related device | |
| CN107944481B (en) | Method and apparatus for generating information | |
| CN109711508B (en) | Image processing method and device | |
| CN110852332B (en) | Training sample generation method and device, storage medium and electronic equipment | |
| CN111950056B (en) | BIM display method and related equipment for building informatization model | |
| CN110059623B (en) | Method and apparatus for generating information | |
| CN109118456B (en) | Image processing method and device | |
| CN112487871B (en) | Handwriting data processing method and device and electronic equipment | |
| CN109934142B (en) | Method and apparatus for generating feature vectors of video | |
| CN114881711B (en) | Method for carrying out exception analysis based on request behaviors and electronic equipment | |
| CN111597466A (en) | Display method and device and electronic equipment | |
| CN114550051A (en) | Vehicle loss detection method and device, computer equipment and storage medium | |
| CN110211017B (en) | Image processing method and device and electronic equipment | |
| CN110188782B (en) | Image similarity determining method and device, electronic equipment and readable storage medium | |
| CN112394809A (en) | Method, device and communication equipment for realizing augmented reality | |
| CN110197459B (en) | Image stylization generation method and device and electronic equipment | |
| CN116596748A (en) | Image stylization processing method, apparatus, device, storage medium, and program product | |
| CN115756461A (en) | Annotation template generation method, image identification method and device and electronic equipment | |
| CN115965520A (en) | Special effect prop, special effect image generation method, device, equipment and storage medium | |
| CN115761086A (en) | Asset model three-dimensional display method and device, storage medium and intelligent terminal | |
| CN111127310B (en) | Image processing method and device, electronic equipment and storage medium | |
| CN113705309A (en) | Scene type judgment method and device, electronic equipment and storage medium | |
| CN113837948B (en) | Image generation method, apparatus and storage medium | |
| CN113986850B (en) | Storage method, device, equipment and computer readable storage medium of electronic volume |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |