CN114328998A

CN114328998A - Display method and device, computer equipment and storage medium

Info

Publication number: CN114328998A
Application number: CN202111653406.6A
Authority: CN
Inventors: 田真; 李斌; 欧华富
Original assignee: Beijing Mianbaitang Intelligent Technology Co ltd
Current assignee: Beijing Mianbaitang Intelligent Technology Co ltd
Priority date: 2021-12-30
Filing date: 2021-12-30
Publication date: 2022-04-12

Abstract

The present disclosure provides a display method, apparatus, computer device and storage medium, wherein the method comprises acquiring a real scene image and identifying a target object in the real scene image; determining a target digital object corresponding to the target object based on the identified target object; and responding to the triggering of the projection display of the target digitalized article, controlling a projection device connected with the physical bearing object, and projecting and displaying the holographic image of the target digitalized article corresponding to the target virtual display content at the preset position of the physical bearing object.

Description

Display method and device, computer equipment and storage medium

Technical Field

The present disclosure relates to the field of Augmented Reality (AR) technologies, and in particular, to a display method, an apparatus, a computer device, and a storage medium.

Background

At present, after a user purchases a digital article, the user can only check the digital article in terminal equipment, so that the checking mode of the digital article is limited, and the display form of the digital article is single.

Disclosure of Invention

The embodiment of the disclosure at least provides a display method, a display device, computer equipment and a storage medium.

In a first aspect, an embodiment of the present disclosure provides a display method, where the display method includes: acquiring a real scene image and identifying a target object in the real scene image; determining a target digital object corresponding to the target object based on the identified target object; and responding to the triggering of the projection display of the target digitalized article, controlling a projection device connected with the physical bearing object, and projecting and displaying the holographic image of the target digitalized article corresponding to the target virtual display content at the preset position of the physical bearing object.

Therefore, by acquiring the real scene image and the projection display mode, the user can view the holographic image of the target digital article at the preset position of the physical bearing object, so that the viewing mode of the target digital article is enriched, and the display mode of the digital article is diversified.

In an alternative embodiment, the target object includes: character encoding of the digital article; the identifying a target object in the image of the real scene includes: performing Optical Character Recognition (OCR) processing on the real scene image to obtain a character code in the real scene image; the determining a target digital item corresponding to the target object based on the identified target object comprises: and matching the character codes with character codes respectively corresponding to at least one digital article, and determining the target digital article matched with the character codes in the real scene image from the at least one digital article.

Therefore, the character codes corresponding to the real scene images are obtained by carrying out optical character recognition on the real scene images, so that the target digital articles are quickly and accurately determined, and the target digital articles are displayed through the projection equipment subsequently.

In an alternative embodiment, the target object includes: a target identifier; the identifying a target object in the image of the real scene includes: carrying out target identification processing on the real scene image by using a neural network model to obtain target marker information in the real scene; the determining a target digital item corresponding to the target object based on the identified target object comprises: and determining the target digital item matched with the target identifier information based on the target identifier information and the predetermined association relationship between the marker information and the digital item.

In this way, the target digital article can be determined quickly and accurately by the acquired target identifier information and the predetermined association relationship between the marker information and the digital article.

In an optional embodiment, the acquiring the image of the real scene includes: controlling image acquisition equipment associated with the physical bearing object to acquire an image of a preset area of the physical bearing object to obtain an image of the real scene; wherein the preset area is provided with the target object; and receiving the real scene image sent by the image acquisition equipment.

Therefore, by controlling the image acquisition equipment associated with the physical bearing object, the image acquisition can be carried out on the preset area of the physical bearing object, and the display of the holographic image of the control target datamation article can be realized no matter where the control equipment is, so that the control of a user is facilitated.

In an optional implementation manner, the display method is applied to a terminal device; the step of controlling a projection device associated with a physical bearing object in response to triggering of projection display of the target digitalized article, and displaying a full-system image of target virtual display content corresponding to the target digitalized article in a projection manner at a preset position of the physical bearing object comprises the following steps: responding to the projection display of the target digital article triggered by the terminal equipment, and sending a display instruction to a server; the display instruction is used for the server to control the projection equipment to project and display the holographic image of the target virtual display content corresponding to the target digital object at the preset position of the physical bearing object.

In an optional embodiment, the display method is applied to a server; the response to the triggering of the projection display of the target digitalized article, controlling a projection device connected with a physical bearing object, and displaying the holographic image of the target digitalized article corresponding to the target virtual display content in the projection mode at the preset position of the physical bearing object, includes: receiving a display instruction of the projection display of the target digitalized object sent by the terminal equipment, and sending the projection instruction to the projection equipment; the projection instruction carries identification information of the target virtual display content; and the projection instruction is used for the projection equipment to project and display the holographic image of the target virtual display content corresponding to the target digital object at the preset position of the physical bearing object based on the identification information.

Therefore, the server can flexibly control the projection equipment to project and display the holographic image of the target virtual display content by receiving the display instruction of the target digitalized object for projection display sent by the terminal equipment.

In an optional embodiment, the method further comprises: and controlling the augmented reality AR environment of the terminal equipment, and displaying the AR special effect of the target virtual display content.

Therefore, the AR special effect of the target virtual display content is displayed in the terminal equipment by controlling the augmented reality AR environment of the terminal equipment, so that the digital articles can be displayed on the terminal equipment, and the display form is enriched.

In an optional embodiment, the method further comprises: responding to the operation of the target virtual display content in the terminal equipment, controlling the AR special effect displayed in the AR environment of the terminal equipment and the holographic image displayed in the projection mode at the preset position of the physical bearing object, and synchronously presenting an operation result corresponding to the operation instruction.

In an alternative embodiment, the operations include at least one of: zoom operation, shift operation, play operation, and angle adjustment operation.

Therefore, the AR special effect displayed in the terminal equipment and the holographic image projected and displayed at the preset position of the physical bearing object can synchronously present the operation result corresponding to the operation instruction through the operation of virtually displaying the content of the target in the terminal equipment, so that the target digital object can be viewed in multiple directions, and the flexibility of the viewing mode is enhanced.

In a second aspect, an embodiment of the present disclosure further provides a display device, including:

the processing module is used for acquiring a real scene image and identifying a target object in the real scene image; determining a target digital object corresponding to the target object based on the identified target object;

and the display module is used for responding to the triggering of projection display of the target digitalized article, controlling the projection equipment connected with the physical bearing object, and displaying the holographic image of the target digitalized article corresponding to the target virtual display content in the projection mode at the preset position of the physical bearing object.

In a third aspect, this disclosure also provides a computer device, a processor, and a memory, where the memory stores machine-readable instructions executable by the processor, and the processor is configured to execute the machine-readable instructions stored in the memory, and when the machine-readable instructions are executed by the processor, the machine-readable instructions are executed by the processor to perform the steps in the first aspect or any one of the possible implementations of the first aspect.

In a fourth aspect, this disclosure also provides a computer-readable storage medium having a computer program stored thereon, where the computer program is executed to perform the steps in the first aspect or any one of the possible implementation manners of the first aspect.

For the effect description of the above display apparatus, computer device, and computer-readable storage medium, reference is made to the description of the method for generating the three-dimensional model, which is not repeated herein.

In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.

FIG. 1 is a flow chart illustrating a presentation method provided by an embodiment of the present disclosure;

FIG. 2 is a schematic diagram illustrating a method for identifying a target digitized item using character encoding provided by an embodiment of the present disclosure;

FIG. 3 illustrates a schematic view of a target identifier provided by embodiments of the present disclosure;

FIG. 4 illustrates a schematic diagram of a target digitized item determination using a target identifier provided by an embodiment of the present disclosure;

fig. 5 illustrates a specific example of displaying a hologram on a showcase according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram illustrating an AR special effect in a terminal device according to an embodiment of the present disclosure;

fig. 7 illustrates a specific example of synchronously displaying a target digitalized article on a display case and a terminal device according to an embodiment of the present disclosure;

FIG. 8 is a schematic view of a display device provided by an embodiment of the present disclosure;

fig. 9 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of embodiments of the present disclosure, as generally described and illustrated herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the disclosure, as claimed, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.

The digitalized article is an article virtually expressed by a number without a physical property. Digital articles include, for example, digital collections, digital merchandise, and the like; digital collections include, for example: digitalizing the museum collection to obtain a digitalized object; the digital goods include, for example, digitized articles obtained by digitizing vendable goods.

Taking the digital collection as an example, when viewing the digital collection, since the digital collection is not an entity, and data corresponding to the digital collection, such as an inhomogeneous token (or called an irreplaceable token) in a blockchain, or a returned hash value, cannot intuitively express appearance features of a picture, an instrument, and the like corresponding to the digital collection, a virtual special effect corresponding to the digital collection is viewed by means of a graphical display interface on a mobile device, or AR glasses, and the like, thereby assisting a user in viewing, purchasing, and the like the digital collection.

Where NFT is an entry of a blockchain, which is a decentralized digital ledger technique for cryptocurrency. Because NFT maps unique serial numbers on blockchains, its non-tamper, inseparable, and irreplaceable nature is suitable for use as a carrier of digitized items in transactions such as purchases, NFT may be used to represent a unique digitized item. When the user purchases and acquires the ownership right of the digital article, the ownership record which is not erasable by the NFT corresponding to the digital article is acquired.

After a user successfully purchases a target digitalized article on a purchase platform of the digitalized article through the terminal device, the purchase platform can send an ownership right transfer request to the blockchain system, and after the blockchain system receives the authority right transfer request, the owner information of the NFT corresponding to the digitalized article in the blockchain is changed, and a response message is sent to the purchase platform. And after receiving the response message fed back by the block chain system, the purchasing platform determines the display authority of the user on the display content corresponding to the digital article.

The current display authority indicates that the user can view the display content of the digital article through the terminal equipment. That is, after the user purchases the digital article, the user can only check the display content of the digital article in the client of the purchased digital article, so that the checking mode of the digital article is limited, and the display form of the digital article is single.

Based on the research, the display method provided by the disclosure enables the holographic image of the target digital article to be displayed at the preset position of the physical bearing object by acquiring the real scene image and the projection display mode, so that the viewing mode of the target digital article is enriched, and the display mode of the digital article is diversified.

In the embodiment of the present disclosure, for example, the user may obtain the display right corresponding to the digital article through the above manner, where the display right includes both a right of displaying the digital article in the terminal device and a right of displaying the digital article at a preset position of the physical bearing object through a hologram manner.

The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.

To facilitate understanding of the present embodiment, first, a display method disclosed in the embodiments of the present disclosure is described in detail, where an execution subject of the display method provided in the embodiments of the present disclosure is generally a computer device with certain computing capability, and the computer device includes, for example: terminal equipment or servers or other processing devices. In some possible implementations, the presentation method may be implemented by a processor calling computer readable instructions stored in a memory.

The following is a detailed description of the display method provided by the embodiments of the present disclosure.

Referring to fig. 1, a flowchart of a display method provided in the embodiment of the present disclosure is shown, where the method includes steps S101 to S103, where:

s101: acquiring a real scene image and identifying a target object in the real scene image;

s102: determining a target digital article corresponding to the target object based on the identified target object;

s103: and responding to the trigger of the projection display of the target digitalized article, controlling a projection device connected with the physical bearing object, and projecting and displaying the holographic image of the target digitalized article corresponding to the target virtual display content at the preset position of the physical bearing object.

The following describes details of S101 to S103.

For the above S101: the real scene image may be acquired, for example, by an image acquisition device, which may include: cameras, webcams, and the like.

Wherein the image acquisition device may be associated with a physical support. Wherein the associating comprises: the image acquisition device is arranged at a fixed position of the physical bearing object or is arranged near the physical bearing object and can shoot at least part of the image of the physical bearing object. The region in which the target object is set can be photographed within a field of view of photographing by the image pickup apparatus. For example, the target object may be disposed on a physical support or other object in the vicinity of the physical support, such as a sign, a wall, etc.

The physical bearing object may be a physical object for bearing a holographic image of a target digitalized object for displaying, for example, including: showcases, tables, display stands, and the like.

In addition, the image acquisition device may also not be associated with a physical carrier, for example it may be a camera in a terminal device. The user can shoot a real scene by using the terminal equipment to obtain a real scene image. In this case, the target object may be set at any position desired by the user, such as an identification card corresponding to the digitalized product, on which the target object may be set. The digital display device is also arranged on a physical bearing object, a plurality of display positions are arranged on the physical bearing object, each display position is used for displaying different digital articles, and a target object is arranged near each display position.

In a specific embodiment, an embodiment of the present disclosure provides a specific way of acquiring an image of a real scene, including: controlling image acquisition equipment associated with the physical bearing object, and acquiring an image of a preset area of the physical bearing object to obtain a real scene image; wherein, the preset area is provided with a target object; and receiving the real scene image sent by the image acquisition equipment.

The predetermined area is determined, for example, according to the position of the target object on the physical support.

For example, since the target object needs to be identified and determined as a digital object, and the target object is disposed at a certain position of the physical carrier, such as an edge of a display stand, the preset area is an area including the edge of the display stand.

The control of the image acquisition equipment associated with the physical bearing object can be in any one of the following modes A-B:

a: aiming at the situation that the display method provided by the embodiment of the disclosure is executed in the server, the server controls the image acquisition equipment connected with the physical bearing object to acquire the image of the preset area of the physical bearing object.

The server establishes a connection relation with the image acquisition equipment associated with the physical bearing object; the server responds to a display request for the target digital goods sent by the terminal equipment, sends an image acquisition instruction to the image acquisition equipment, acquires a real scene image when the image acquisition equipment receives the image acquisition instruction, and sends the real scene image to the server.

B: aiming at the situation that the display method provided by the embodiment of the disclosure is executed in the terminal equipment, the terminal equipment can directly control the image acquisition equipment associated with the physical bearing object to acquire the image of the preset area of the physical bearing object. Any one of the following b 1-b 3 may be adopted:

b 1: the terminal device and the image acquisition device associated with the physical bearing object are located in the same Wireless local area network, and may be connected through Wireless Fidelity (Wi-Fi), for example. The terminal equipment can establish a communication relation with the image acquisition equipment through the wireless local area network, and the terminal equipment can control the image acquisition equipment connected with the physical bearing object to acquire an image of a preset area of the physical bearing object through the communication relation so as to obtain an image of a real scene.

b 2: and establishing a Bluetooth connection relation between the terminal equipment and the image acquisition equipment associated with the physical bearing object.

Based on the Bluetooth connection relation between the terminal equipment and the image acquisition equipment associated with the physical bearing object, the terminal equipment starts Bluetooth, the Bluetooth of the image acquisition equipment associated with the physical bearing object is paired, and the image acquisition equipment associated with the physical bearing object is controlled to acquire an image of a preset area of the physical bearing object by triggering an image acquisition button in the terminal equipment to obtain an image of a real scene.

b 3: the terminal equipment sends an image acquisition request to the server, and the server responds to the received image acquisition request, controls the image acquisition equipment to acquire a real scene image and receives the real scene image acquired by the image acquisition equipment. And the server sends the real scene image to the terminal equipment.

In another embodiment, the terminal device may directly respond to the trigger operation of the camera, control the camera installed on the terminal device to start, and acquire the image of the real scene.

The target object in the image of the real scene may include a character encoding of the digitized item, and/or a target identifier.

Character encoding of digitized articles includes, for example: number, english, symbol. The character code is stored in association with the target digitalized article, for example. The stage may determine the target digitized item by character encoding of the digitized item and the relationship stored by the association.

Target identifiers include, for example: marker images, two-dimensional codes, etc., where a Marker is typically a two-dimensional picture and therefore relatively simple to process. The target digitized item may be determined by identifying the target identifier based on the target identifier information and a predetermined correspondence between the marker information and the digitized item.

For the above S102:

in the case where the target object is a character code of a digital article, the specific manner of determining the target object includes, for example:

performing Optical Character Recognition (OCR) processing on the image of the real scene to obtain Character codes in the image of the real scene;

determining a target digitized item corresponding to the target object based on the identified target object, including:

and matching the character codes with the character codes respectively corresponding to the at least one digital object, and determining a target digital object matched with the character codes in the real scene image from the at least one digital object.

OCR refers to a process in which an electronic device (e.g., a scanner or a digital camera) examines characters on an image of a real scene, determines a shape thereof by detecting a dark and light pattern, and then translates the shape into computer characters by a character recognition method, i.e., generates character codes in the image of the real scene; for example, for print characters, characters in a paper document are optically converted into an image file with a black-and-white dot matrix, and the characters in the image are converted into a text format by recognition software for further editing and processing by word processing software.

Illustratively, character codes in the real scene image are obtained by performing OCR processing on the real scene image, based on the character codes, the server identifies the character codes, and searches a database for a digital article matching the character codes, that is, determines a target digital article matching the character codes in the real scene image.

For example, the physical load is a showcase; on the physical bearing object, a character code '8' is arranged. The position where the character code is set is shot, and a real scene image is obtained as shown in a in fig. 2. And then performing OCR recognition on the real scene image, and recognizing to obtain that the character code in the real scene image is '8'. The character codes stored in the database in the server are "2", "6", "8" and "10", wherein the digital article corresponding to "8" is a vase, and the target digital article is determined to be the vase shown as b in fig. 2.

In the case where the target object is a target identifier, the manner in which the target identifier determines the target object includes, for example: carrying out target identification processing on the real scene image by using the neural network model to obtain target marker information in the real scene; and determining a target digital item corresponding to the target object based on the identified target object, wherein the step of determining the target digital item matched with the target identifier information based on the target identifier information and the predetermined association relationship between the marker information and the digital item is included.

For example, when the target recognition processing is performed on the image of the real scene by using the neural network model, the neural network model is, for example, a pre-trained neural network capable of recognizing at least one target identifier. After a real scene image is acquired, the real scene image is input into a neural network model to obtain a recognition result of a target marker, wherein the recognition result comprises: whether at least one target marker capable of being identified by the neural network model exists in a real scene or not; in response to the existence of any target identifier in the image of the real scene, the target digital item can also be determined according to the association relationship between the target identifier and the target digital item.

For example, the target identifier information may be obtained by performing target identification processing on the real scene image by using a neural network model, where each of the identifier information and the digital item has a one-to-one association relationship, and based on the target identifier information and a predetermined association relationship between the identifier information and the digital item, the target digital item matching the target identifier information may be determined in the database.

Illustratively, referring to fig. 3, a schematic diagram of a target identifier is provided according to an embodiment of the present disclosure. In one possible case, the object identifier may be printed, for example, on a showcase, a ticket, a guide board, a display album, for example, the object identifier 31 is printed on the showcase in fig. 3.

Referring to FIG. 4, embodiments of the present disclosure provide a specific example of the determination of a target digitized item using a target identifier. Target identifier in this example, the physical load is a showcase; on the physical support, a target identifier 41 is provided. The position where the target marker is set is photographed, and a real scene image is acquired as shown in a in fig. 4. Then, the neural network is used to perform target identification processing on the real scene image, the target identifier 41 in the real scene image is obtained through identification, and the target digital article is determined to be the vehicle shown in b in fig. 4 based on the target identifier information and the predetermined association relationship between the marker information and the digital article.

For the above S103: for the case that the display method provided by the embodiment of the present disclosure is applied to a terminal device, a specific manner of performing projection display on a target digital article includes, for example:

responding to the projection display of the target digital article triggered by the terminal equipment, and sending a display instruction to a server;

the display instruction is used for controlling the projection equipment to project and display the full-system image of the target virtual display content corresponding to the target digital object at the preset position of the physical bearing object by the server.

The target virtual display content may be that the target digitalized article is displayed and includes other display contents such as introduction information of the target digitalized article, sound effects of the target digitalized article during display, and the like in addition to the target digitalized article.

Illustratively, by triggering projection display of the target digitalized article in the terminal device, the terminal device sends a display instruction to the server, where the display instruction is used to instruct the server to control the projection device to display the target digitalized article, where the instruction may include user information of the terminal device; the server analyzes the terminal equipment user information in the instruction after receiving the display instruction, determines whether the user of the terminal equipment has the viewing right to the target digitalized article, and controls the projection equipment to project and display the full-system image of the target virtual display content corresponding to the target digitalized article at the preset position of the physical bearing object under the condition that the user of the terminal equipment is determined to have the viewing right to the target digitalized article.

If the server receives the display instruction, it is determined that the user of the terminal device does not have the viewing right for the target digital article, for example: if the user who purchases the digital goods does not log in the terminal device or the user does not purchase the corresponding digital goods, failure of projection display can be prompted.

In another embodiment of the present disclosure, the presentation method may also be used for a server. In this case, the specific manner of performing the projection display on the target digitalized product includes, for example:

receiving a display instruction of projection display of a target digital article sent by a terminal device, and sending the projection instruction to a projection device; the projection instruction carries identification information of the target virtual display content; and the projection instruction is used for projecting and displaying the holographic image of the target virtual display content corresponding to the target digitalized article at the preset position of the physical bearing object by the projection equipment based on the identification information.

In specific implementation, after receiving a display instruction for projection display of a target digital article sent by a terminal device, a server generates a projection instruction based on identification information of target virtual display content carried in the display instruction, and sends the projection instruction to a projection device. In the storage device connected to the projection device, virtual display contents corresponding to a plurality of types of digital articles may be stored in advance. After receiving the projection instruction, the projection device acquires the target virtual display content from the storage device connected with the projection device based on the identification information of the target virtual display content carried in the projection instruction, and performs holographic projection display by using the acquired target virtual display content.

And the projection equipment receives the projection instruction sent by the server, and projects and displays the holographic image of the target virtual display content corresponding to the target digital object at the preset position of the physical bearing object.

The hologram is a three-dimensional image presented by utilizing a holographic technology, namely a technology for recording and reproducing a real three-dimensional image of an object by utilizing the interference and diffraction principle, the hologram is a hologram generated by processing procedures of development, fixation and the like through a negative film on which interference fringes are recorded, wherein each part of the hologram records optical information of each point on the object, so that each part of the hologram can reproduce the whole image of the original object in principle, and a plurality of different images can be recorded on the same negative film through multiple exposures and can be respectively displayed without mutual interference; secondly, the light wave information of the object is reproduced by utilizing the diffraction principle to generate a holographic image.

For example, by controlling the projection device, a holographic image showing the target digital article can be projected on the showcase, and a user can view the detail information of the target digital article corresponding to the holographic image of the target digital article on the showcase, so that the target digital article can be viewed from different angles.

Illustratively, referring to fig. 5, a specific example of displaying a hologram on a showcase according to an embodiment of the present disclosure is provided. In an example, the physical bearing object is a showcase, the target identifier is 41 in fig. 4, the target digital article is determined based on the target identifier and a predetermined association relationship between the marker information and the digital article, and then a hologram image of the target virtual display content corresponding to the target digital article is displayed in a projection manner at a preset position of the physical bearing object in response to triggering of the projection display of the target digital article.

In another embodiment, in response to triggering projection display of a target digital article through a terminal device, the terminal device sends a projection instruction to a projection device; the projection instruction carries identification information of the target virtual display content; and the projection instruction is used for projecting and displaying the holographic image of the target virtual display content corresponding to the target digitalized article at the preset position of the physical bearing object by the projection equipment based on the identification information.

Illustratively, by establishing the connection relationship between the terminal device and the projection device, the connection relationship may be established in any one of the following manners C to D:

c: and establishing a connection relation through a wireless local area network (Wi-Fi).

The method comprises the steps of positioning a terminal device and a projection device in the same wireless local area network, connecting the terminal device with Wi-Fi, sending a projection instruction to the projection device, and controlling the projection device to project and display a holographic image of a target virtual display content corresponding to a target digitalized object at a preset position of a physical bearing object.

D: and establishing a connection relation through Bluetooth.

The terminal device is matched with the Bluetooth of the projection device by starting the Bluetooth, and based on the successful connection between the terminal device and the Bluetooth of the projection device, a projection instruction is sent to the projection device to control the projection device to project and display the holographic image of the target virtual display content corresponding to the target digital object at the preset position of the physical bearing object.

In another embodiment, a specific example of displaying a target digital article in a terminal device is also provided, and the specific example includes controlling an Augmented Reality (AR) environment of the terminal device and displaying an AR special effect of target virtual display content.

The AR environment is a virtual three-dimensional presentation space in the AR device, generated using a real scene. The virtual three-dimensional display space and the display space of the real scene have a certain space conversion relation; the virtual model displayed in the AR environment can be overlaid with the display scene shot by the AR device and displayed in the graphical user interface of the AR device.

When the user triggers the display of the target digital article, the terminal device starts the AR environment, and displays the AR special effect corresponding to the target digital article in the AR environment.

The AR special effect may include, for example: pictures, videos, three-dimensional models, introductory information, etc. of the target digitized item.

Illustratively, when the terminal device sends an instruction to the server, the server returns a display permission instruction to the terminal device after receiving the display instruction sent by the terminal device, the display permission instruction is used for controlling an Augmented Reality (AR) environment of the terminal device, and the terminal device displays an AR special effect of the target virtual display content in the AR environment after receiving the display permission instruction.

Referring to fig. 6, a schematic diagram of an AR special effect for displaying target virtual display content in a terminal device according to an embodiment of the present disclosure is shown; taking the character code set on the showcase as "2" as an example, the AR special effect of the target virtual display content is displayed on the terminal device.

In another embodiment, after the terminal device displays the AR special effect of the target virtual content, the target virtual content may be projected at a preset position of the physical bearing object to display the hologram of the target digital article.

When the terminal equipment sends a display instruction to the server, the server analyzes the display instruction, wherein the display instruction can comprise a control instruction, and the identification of a control object carried by the control instruction is used for determining the control object; if the controlled object is a projection device, the server sends a projection instruction to the projection device, and a specific example is shown in fig. 5; if the controlled object is the terminal device, the server sends a display permission instruction to the terminal device, and a specific example is shown in fig. 6; if the controlled objects are the projection equipment and the terminal equipment, the server sends a projection instruction to the projection equipment, and simultaneously sends a display permission instruction to the terminal equipment, and the holographic image of the target digital article and the AR special effect of the target digital article are respectively displayed at the preset position of the physical bearing object.

Referring to fig. 7, a specific example of synchronously displaying a target digitalized article on a showcase and a terminal device is provided for the embodiment of the present disclosure. Taking the target marker as 41 as an example, the holographic image and the AR special effect of the target digitalized article corresponding to the target marker 41 are synchronously displayed in the preset position where the physical bearing object is a showcase and in the terminal device, respectively.

Under the conditions of synchronously displaying the target digitalized article in the terminal equipment and the preset position of the physical bearing object, a user can make the target digitalized article show different display states through the operation of the target virtual display content in the terminal equipment. Wherein the operation comprises at least one of: zoom operation, shift operation, play operation, and angle adjustment operation.

Illustratively, for the zooming operation, a user performs the zooming operation on the target virtual display content in the terminal device, and performs the zooming-out or zooming-in operation on the target virtual display content; and the terminal equipment responds to the reduction operation of the target virtual display content by the user, the AR special effect of the reduced target digital article is presented in the terminal equipment, and meanwhile, the holographic image of the reduced target digital article is synchronously presented at the preset position of the physical bearing object. And responding to the amplification operation of the target virtual display content by the user, presenting the AR special effect of the amplified target digital article in the terminal equipment, and synchronously presenting the holographic image of the amplified target digital article at the preset position of the physical bearing object.

Illustratively, for the shift operation, the user performs the shift operation on the target virtual display content in the terminal device, and the terminal device responds to the user to perform the shift operation on the target virtual display content, and then presents the AR special effect of the target digital article during the shift process and/or after the shift in the terminal device, and simultaneously presents the holographic image of the target digital article during the shift process and/or after the shift in the preset position of the physical bearing object.

Illustratively, for the playing operation, the user plays the target virtual display content in the terminal device, and the terminal device responds to the user to play the target virtual display content, and then plays the AR special effect of the target digital article in the terminal device, and simultaneously synchronously plays the holographic image of the target digital article at the preset position of the physical bearing object. In this example, the AR effect is, for example, an animation, a video, or the like effect.

For example, for the angle adjustment operation, the user performs an angle adjustment operation on the target virtual display content in the terminal device, for example, the target digital object is rotated by 45 degrees to be viewed, and the terminal device responds to the user rotating the target virtual display content by 45 degrees, so that the AR special effect of the target digital object after rotating by 45 degrees is presented in the terminal device, and meanwhile, the hologram of the target digital object after rotating by 45 degrees is synchronously presented at the preset position of the physical bearing object.

In a specific implementation, an embodiment of the present disclosure provides a specific manner for synchronously presenting an operation result corresponding to an operation instruction at a preset position of a terminal device and a physical bearing object, including:

responding to the operation of the target virtual display content in the terminal equipment, controlling the AR special effect displayed in the AR environment of the terminal equipment and projecting the displayed holographic image at the preset position of the physical bearing object, and synchronously presenting the operation result corresponding to the operation instruction.

For example, the terminal device performs a shift operation on the target virtual display content, that is, the display position of the AR special effect of the target digital article displayed on the terminal device moves, and the position of the hologram for projecting and displaying the target digital article also moves similarly.

When the operation of the target virtual display content in the terminal equipment directly displays the state of the corresponding target digital article of the operation instruction on the terminal equipment, and synchronously displays the state of the corresponding target digital article on the preset position of the physical bearing object, the state of the corresponding target digital article on the terminal equipment is the same as that of the corresponding target digital article on the terminal equipment, and any one of the following modes E-F can be adopted:

e: the terminal device sends the operation instruction to the server, the server responds to the received operation instruction and forwards the operation instruction to the projection device, and the projection device projects and displays the presenting state of the target digital article corresponding to the operation instruction after receiving the operation instruction.

For example, when the terminal device a performs a shift operation on the target virtual display content, a shift instruction corresponding to the shift operation is sent to the server b, the server b receives the shift instruction and forwards the shift instruction to the projection device c, and the projection device c receives the shift instruction and then projects and displays the hologram image obtained by performing the shift operation on the target virtual display content at the preset position of the physical bearing object.

F: the terminal device and the projection device are located in the same wireless local area network, and communication connection is established by using a router, a switch or Wi-Fi in the wireless local area network, or the terminal device and the projection device can directly establish communication connection, such as connection relations of Bluetooth connection and the like, and the holographic image displayed by projection at the preset position of the physical bearing object synchronously presents an operation result corresponding to the operation instruction.

Responding to the operation of the target virtual display content in the terminal equipment, directly communicating and connecting to send an operation instruction corresponding to the operation to the projection equipment, and controlling the projection equipment to project and display the holographic image after the operation is carried out on the target virtual display content at the preset position of the physical bearing object after the projection equipment receives the operation instruction.

For example, when the terminal device a performs a shift operation on the target virtual display content, a shift instruction is sent to the projection device c through the communication connection, and after receiving the shift instruction, the projection device c projects and displays the hologram image obtained by performing the shift operation on the target virtual display content at the preset position of the physical bearing object.

Through the process, the target digital article displayed in the terminal equipment can be synchronously controlled while the target digital article displayed in the terminal equipment is controlled through the terminal equipment, so that the requirement of a user on the display of the target digital article to other users is met.

It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.

Based on the same inventive concept, a display device corresponding to the display method is also provided in the embodiments of the present disclosure, and as the principle of solving the problem of the device in the embodiments of the present disclosure is similar to the display method described above in the embodiments of the present disclosure, the implementation of the device may refer to the implementation of the method, and repeated details are not repeated.

Referring to fig. 8, a schematic view of a display device provided in an embodiment of the present disclosure is shown, the device includes: a processing module 81, a display module 82; wherein the content of the first and second substances,

a processing module 81, configured to acquire a real scene image and identify a target object in the real scene image; determining a target digital object corresponding to the target object based on the identified target object;

and the display module 82 is used for responding to triggering projection display of the target digitalized article, controlling a projection device connected with the physical bearing object, and displaying a holographic image of the target digitalized article corresponding to the target virtual display content in a projection manner at a preset position of the physical bearing object.

In an alternative embodiment, the target object includes: character encoding of the digital article; the processing module 81 is configured to perform Optical Character Recognition (OCR) processing on the real scene image to obtain a character code in the real scene image when the target object in the real scene image is recognized;

and when the target digital object corresponding to the target object is determined based on the identified target object, the method is used for matching the character codes with the character codes respectively corresponding to at least one digital object, and determining the target digital object matched with the character codes in the real scene image from the at least one digital object.

In an alternative embodiment, the target object includes: a target identifier; the processing module 81 is configured to, when the target object in the real scene image is identified, perform target identification processing on the real scene image by using a neural network model to obtain target identifier information in the real scene; when the target digital item corresponding to the target object is determined based on the identified target object, the method is used for determining the target digital item matched with the target identifier information based on the target identifier information and the predetermined association relationship between the marker information and the digital item.

In an optional implementation manner, the processing module 81 is configured to control an image acquisition device associated with the physical bearing object when the real scene image is acquired, and perform image acquisition on a preset region of the physical bearing object to obtain the real scene image; wherein the preset area is provided with the target object; and receiving the real scene image sent by the image acquisition equipment.

In an optional implementation manner, the display method is applied to a terminal device; the processing module 81 is configured to, when the projection display of the target digitalized article is triggered in response to the triggering, control a projection device connected to the physical carrying object, and project and display a full-scale image of target virtual display content corresponding to the target digitalized article at a preset position of the physical carrying object, send a display instruction to a server in response to the projection display of the target digitalized article triggered by the terminal device; the display instruction is used for the server to control the projection equipment to project and display the full-system image of the target virtual display content corresponding to the target digitalized object at the preset position of the physical bearing object.

In an optional embodiment, the display method is applied to a server; the processing module 81 is configured to control a projection device connected to the physical carrying object when the response is made to trigger the projection display of the target digitalized article, and when the holographic image of the target virtual display content corresponding to the target digitalized article is displayed in the projection manner at the preset position of the physical carrying object, the processing module is configured to receive a display instruction sent by the terminal device for performing the projection display of the target digitalized article, and send the projection instruction to the projection device; the projection instruction carries identification information of the target virtual display content; and the projection instruction is used for the projection equipment to project and display the holographic image of the target virtual display content corresponding to the target digital object at the preset position of the physical bearing object based on the identification information.

In an optional implementation manner, the display module 82 is configured to control an augmented reality AR environment of the terminal device, and display an AR special effect of the target virtual display content.

In an optional implementation manner, the display module 82, in response to the operation on the target virtual display content in the terminal device, controls the AR special effect displayed in the AR environment of the terminal device and the hologram displayed in the projection manner at the preset position of the physical bearing object, and synchronously presents the operation result corresponding to the operation instruction.

The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.

An embodiment of the present disclosure further provides a computer device, as shown in fig. 9, which is a schematic structural diagram of the computer device provided in the embodiment of the present disclosure, and the computer device includes:

a processor 91 and a memory 92; the memory 92 stores machine-readable instructions executable by the processor 91, the processor 91 being configured to execute the machine-readable instructions stored in the memory 92, the processor 91 performing the following steps when the machine-readable instructions are executed by the processor 91:

acquiring a real scene image and identifying a target object in the real scene image;

determining a target digital object corresponding to the target object based on the identified target object;

and responding to the triggering of the projection display of the target digitalized article, controlling a projection device connected with the physical bearing object, and projecting and displaying the holographic image of the target digitalized article corresponding to the target virtual display content at the preset position of the physical bearing object.

The memory 92 includes a memory 921 and an external memory 922; the memory 921 is also referred to as an internal memory, and temporarily stores operation data in the processor 91 and data exchanged with an external memory 922 such as a hard disk, and the processor 91 exchanges data with the external memory 922 through the memory 91.

The specific execution process of the instruction may refer to the steps of the presentation method described in the embodiments of the present disclosure, and details are not described here.

The embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the presentation method described in the above method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.

The embodiments of the present disclosure also provide a computer program product, where the computer program product carries a program code, and instructions included in the program code may be used to execute the steps of the display method described in the foregoing method embodiments, which may be referred to specifically for the foregoing method embodiments, and are not described herein again.

The computer program product may be implemented by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.

The disclosure relates to the field of augmented reality, and aims to detect or identify relevant features, states and attributes of a target object by means of various visual correlation algorithms by acquiring image information of the target object in a real environment, so as to obtain an AR effect combining virtual and reality matched with specific applications. For example, the target object may relate to a face, a limb, a gesture, an action, etc. associated with a human body, or a marker, a marker associated with an object, or a sand table, a display area, a display item, etc. associated with a venue or a place. The vision-related algorithms may involve visual localization, SLAM, three-dimensional reconstruction, image registration, background segmentation, key point extraction and tracking of objects, pose or depth detection of objects, and the like. The specific application can not only relate to interactive scenes such as navigation, explanation, reconstruction, virtual effect superposition display and the like related to real scenes or articles, but also relate to special effect treatment related to people, such as interactive scenes such as makeup beautification, limb beautification, special effect display, virtual model display and the like. The detection or identification processing of the relevant characteristics, states and attributes of the target object can be realized through the convolutional neural network. The convolutional neural network is a network model obtained by performing model training based on a deep learning framework.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims

1. A display method, characterized in that the display method comprises:

2. The presentation method of claim 1, wherein the target object comprises: character encoding of the digital article;

the identifying a target object in the image of the real scene includes:

performing Optical Character Recognition (OCR) processing on the real scene image to obtain a character code in the real scene image;

the determining a target digital item corresponding to the target object based on the identified target object comprises:

and matching the character codes with character codes respectively corresponding to at least one digital article, and determining the target digital article matched with the character codes in the real scene image from the at least one digital article.

3. The presentation method of claim 1, wherein the target object comprises: a target identifier;

the identifying a target object in the image of the real scene includes:

carrying out target identification processing on the real scene image by using a neural network model to obtain target marker information in the real scene;

and determining the target digital item matched with the target identifier information based on the target identifier information and the predetermined association relationship between the marker information and the digital item.

4. The presentation method according to any one of claims 1 to 3, wherein the acquiring of the image of the real scene comprises:

controlling image acquisition equipment associated with the physical bearing object to acquire an image of a preset area of the physical bearing object to obtain an image of the real scene; wherein the preset area is provided with the target object;

and receiving the real scene image sent by the image acquisition equipment.

5. The display method according to any one of claims 1 to 4, wherein the display method is applied to a terminal device;

the response to the triggering of the projection display of the target digitalized article, controlling a projection device connected with a physical bearing object, and displaying the holographic image of the target digitalized article corresponding to the target virtual display content in the projection mode at the preset position of the physical bearing object, includes:

the display instruction is used for the server to control the projection equipment to project and display the full-system image of the target virtual display content corresponding to the target digitalized object at the preset position of the physical bearing object.

6. The presentation method according to any one of claims 1 to 4, wherein the presentation method is applied to a server;

receiving a display instruction of the projection display of the target digitalized object sent by the terminal equipment, and sending the projection instruction to the projection equipment; the projection instruction carries identification information of the target virtual display content;

and the projection instruction is used for the projection equipment to project and display the holographic image of the target virtual display content corresponding to the target digital object at the preset position of the physical bearing object based on the identification information.

7. The display method according to any one of claims 1 to 6, further comprising: and controlling the augmented reality AR environment of the terminal equipment, and displaying the AR special effect of the target virtual display content.

8. The display method according to any one of claims 1 to 7, further comprising:

responding to the operation of the target virtual display content in the terminal equipment, controlling the AR special effect displayed in the AR environment of the terminal equipment and the holographic image displayed in the projection mode at the preset position of the physical bearing object, and synchronously presenting an operation result corresponding to the operation instruction.

9. The method of claim 8, wherein the operation comprises at least one of:

zoom operation, shift operation, play operation, and angle adjustment operation.

10. A display device, comprising:

11. A computer device, comprising: a processor, a memory storing machine-readable instructions executable by the processor, the processor for executing the machine-readable instructions stored in the memory, the processor performing the steps of the demonstration method of any one of claims 1 to 9 when the machine-readable instructions are executed by the processor.

12. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when executed by a computer device, performs the steps of the presentation method as claimed in any one of claims 1 to 9.