CN114255333B - Digital content display method and device based on spatial anchor point and electronic equipment - Google Patents

Digital content display method and device based on spatial anchor point and electronic equipment Download PDF

Info

Publication number
CN114255333B
CN114255333B CN202210168925.1A CN202210168925A CN114255333B CN 114255333 B CN114255333 B CN 114255333B CN 202210168925 A CN202210168925 A CN 202210168925A CN 114255333 B CN114255333 B CN 114255333B
Authority
CN
China
Prior art keywords
anchor point
cloud server
digital content
spatial
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210168925.1A
Other languages
Chinese (zh)
Other versions
CN114255333A (en
Inventor
孔剑平
胡楠
王琪
李炳博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Weipian Technology Co ltd
Zhejiang Nanometer Technology Co ltd
Original Assignee
Zhejiang Weipian Technology Co ltd
Zhejiang Nanometer Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Weipian Technology Co ltd, Zhejiang Nanometer Technology Co ltd filed Critical Zhejiang Weipian Technology Co ltd
Priority to CN202210168925.1A priority Critical patent/CN114255333B/en
Publication of CN114255333A publication Critical patent/CN114255333A/en
Application granted granted Critical
Publication of CN114255333B publication Critical patent/CN114255333B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Graphics (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Remote Sensing (AREA)
  • Information Transfer Between Computers (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application provides a digital content display method, a digital content display device and electronic equipment based on spatial anchor points, wherein the method comprises the following steps: acquiring first image data captured by an image acquisition device in the first mobile device to image the first physical world location based on a first mobile device of a first user, and creating a spatial representation and a spatial anchor point of the first physical world location based on the first image data; sending the spatial representation and the attitude of the spatial anchor point from the first mobile device to a cloud server for cloud storage; and binding the virtual content related to the digital content with the spatial anchor point, wherein the virtual content related to the digital content comprises item information for describing an item displayed and ID information of a display device for displaying the item.

Description

Digital content display method and device based on spatial anchor point and electronic equipment
Technical Field
The present application relates to the field of computers, and in particular, to a method and an apparatus for displaying digital content based on spatial anchor points, and an electronic device.
Background
The AR technology is a technology for increasing the perception of a user to the real world through information provided by a computer system, applies virtual information to the real world, and superimposes virtual objects, scenes, or system prompt information generated by a computer to the real scene, thereby realizing the enhancement of reality. For example, AR technology may be applied to museums for cultural relic exhibition.
In particular, spatial anchor points are a visual anchor to the real world. The user sets an anchor point at a position in the real world through a mobile intelligent terminal or a head-wearing AR device such as a smart phone or a HoloLens, and associates virtual content such as a hologram with the anchor point.
In the prior art, in the process of displaying digital contents, whether the digital contents are used in compliance or not cannot be determined, and the compliance is difficult to ensure, so that the digital exhibition has risks. On the other hand, in some exhibitions, some precious digital contents are worth watching for a charge, but some watching charges are not charged for a charge, and management confusion is easily caused.
Disclosure of Invention
The embodiment of the application provides a digital content display method and device based on a space anchor point and electronic equipment, wherein different space anchor points can be created based on a physical environment where the display equipment is located according to the relation between the digital content and the display equipment, and the different space anchor points are bound with corresponding virtual content. The virtual content can prove the compliance of the digital content, and the postures of different space anchor points can be selected whether to be watched for a charge, so that the management is convenient.
In order to achieve the purpose, the following technical scheme is adopted in the application:
in a first aspect, a method for displaying digital content based on spatial anchor points is provided, the method comprising:
acquiring first image data captured by an image acquisition device in a first mobile device to image a first physical world location based on a first mobile device of a first user, and based on the first image data;
sending the spatial representation and the attitude of the spatial anchor point from the first mobile device to a cloud server for cloud storage;
and binding the virtual content related to the digital content with the spatial anchor point, wherein the virtual content related to the digital content comprises article information for describing an article to be displayed and ID information of a display device for displaying the article.
According to the method of the first aspect, the first user captures first image data imaged by a first physical world position based on a first mobile device to create a spatial representation and a spatial anchor point of the first physical world position, and performs cloud storage on the spatial representation and the spatial anchor point corresponding to the first physical world position, so that secondary query is convenient and the storage in a cloud space is not easy to lose, and the data security is ensured; the space anchor point of the first physical world position is bound with the virtual content related to the article, so that whether the space anchor point is the compliance digital content or not can be clearly judged when the space anchor point is obtained by scanning through the mobile equipment, the convenience of management and the safety of digital content display are improved, and the first user can be a manager of the digital content.
With reference to the first aspect, in a first possible implementation, a presentation device includes any one of a computing device or a computing system, the presentation device having a unique identification, including: at least one of a MAC address, a motherboard ID, a CPU ID, or a BIOS number.
In a second aspect, an embodiment of the present application provides a method for displaying digital content based on a spatial anchor point, where the method includes:
acquiring second image data for imaging a second physical world position and a space representation corresponding to the second image data captured by an image acquisition device in second mobile equipment based on second mobile equipment of a second user, and uploading the space representation corresponding to the second image to a cloud server;
judging whether a second mobile device of a second user receives a space anchor point returned by the cloud server;
if yes, the second mobile equipment acquires the ID information corresponding to the display equipment according to the received space anchor point and uploads the ID information to the cloud server; the cloud server side issues an instruction according to the ID information corresponding to the receiving display equipment so as to activate the articles displayed by the corresponding display equipment;
if not, the display equipment does not display the article.
According to the method in the second aspect, second image data imaged at a second physical world position are captured by a second mobile device carried by a second user, the second image data are matched with the first image data stored by the cloud server, if the second image data are successfully matched with the first image data, corresponding digital content in the display device is selected and activated according to ID information of the virtual content acquisition display device bound with the spatial anchor point, wherein part of the virtual content bound with the spatial anchor point can determine whether the virtual content is watched for payment, and the second user has an independent selection right by setting whether the virtual content bound with the spatial anchor point is paid or not, so that the user experience is improved, and the management convenience is also improved.
With reference to the second aspect, in a first possible implementation manner, the determining whether the second mobile device of the second user receives the spatial anchor point returned by the cloud server includes:
the cloud server judges whether the second image data is matched with the stored first image data;
if yes, the cloud server side returns a space anchor point with position information relative to the display equipment; the second mobile equipment of the second user receives the space anchor point sent by the cloud server;
and if not, the second mobile equipment of the second user does not receive the space anchor point.
With reference to the second aspect, in a second possible implementation manner, the issuing, by the cloud server, an instruction to activate an article displayed by a corresponding display device according to the ID information corresponding to the display device includes:
the cloud server receives ID information corresponding to the display equipment;
the cloud server sends a message to the second user to inquire whether to pay for watching;
if the inquiry result is yes, the second user pays the fee on the second mobile device, whether the fee is received or not is judged at the cloud service end, and if yes, the cloud service end issues an instruction to activate the article displayed by the corresponding display device.
With reference to the third aspect, in a third possible implementation manner, after the cloud server issues an instruction to activate an article displayed by a corresponding display device according to the ID information corresponding to the display device, the method further includes:
and judging whether the space distance between the second user and the current space anchor point exceeds a preset threshold value, if so, stopping displaying by the display equipment.
In a third aspect, an embodiment of the present application provides a digital content presentation apparatus based on spatial anchor points, where the apparatus includes:
a construction module for acquiring, based on a first mobile device of a first user, first image data captured via an image capture device in the first mobile device to image a first physical world location, and creating a spatial representation and a spatial anchor point of the first physical world location based on the first image data;
the first sending module is used for sending the spatial representation and the attitude of the spatial anchor point from the mobile equipment to a cloud server for cloud storage;
the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for binding virtual content related to digital content with a spatial anchor point, and the virtual content related to the digital content comprises article information used for describing an article to be displayed and ID information of a display device used for displaying the article.
In a fourth aspect, an embodiment of the present application provides an apparatus for displaying digital content based on spatial anchor points, where the apparatus includes: the second sending module is used for acquiring second image data for imaging a second physical world position and a space representation corresponding to the second image data captured by an image acquisition device in second mobile equipment based on second mobile equipment of a second user, and uploading the space representation corresponding to the second image to the cloud server;
the judging module is used for judging whether a second mobile device of a second user receives the space anchor point returned by the cloud server;
the second processing module is used for acquiring the ID information corresponding to the display equipment by the second mobile equipment according to the received space anchor point and uploading the ID information to the cloud server if the judgment result is yes; the cloud server side issues an instruction according to the ID information corresponding to the receiving display equipment so as to activate the article displayed by the corresponding display equipment;
if not, the display device does not display the digital content.
In a fifth aspect, an embodiment of the present application provides an electronic device, including: one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any one of the implementations of the first aspect or the second aspect.
In a sixth aspect, the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the method described in any one of the implementation manners of the first aspect or the second aspect.
In a seventh aspect, a computer program product is provided, which comprises a computer program or instructions, which when run on a computer causes the computer to perform the method according to any one of the possible implementations of the first to the X aspect.
Drawings
Fig. 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 2 is a first schematic flowchart of an exemplary process executed by a method for presenting digital content based on spatial anchor points according to an embodiment of the present application;
fig. 3 is a schematic diagram illustrating an exemplary process of performing a digital content presentation method based on spatial anchor points according to an embodiment of the present application;
FIG. 4 is an exemplary flowchart interaction diagram of a method for displaying digital content based on spatial anchor points according to an embodiment of the present application;
FIG. 5 is a first diagram illustrating an exemplary structure of a digital content presentation apparatus based on spatial anchor points according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a second exemplary digital content presentation apparatus based on spatial anchor points according to an embodiment of the present application.
Detailed Description
The technical solution in the present application is described below with reference to the accompanying drawings.
Referring to fig. 1, some possible embodiments of the present application provide an electronic device 10. The electronic device 10 may be a Personal Computer (PC), a tablet PC, a smart phone, a Personal Digital Assistant (PDA), or the like, or the electronic device 10 may be a web server, a database server, a cloud server, a server assembly composed of a plurality of sub-servers, or the like.
Further, the electronic device 10 may include: memory 111, communication interface 112, communication bus 113, and processor 114, wherein processor 114, communication interface 112, and memory 111 are connected by communication bus 113. The processor 114 is used to execute executable modules, such as computer programs, stored in the memory 111. The components and configurations of electronic device 10 shown in FIG. 1 are for example, and not for limitation, and electronic device 10 may have other components and configurations as desired.
The memory 111 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a Random Access Memory (RAM) or other types of dynamic storage devices that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to these. The memory 111 may be integrated with the processor 114, or may exist independently, and is coupled to the processor 114 through the communication interface 112, which is not specifically limited in this embodiment of the present application.
It will also be appreciated that the memory in the embodiments of the subject application can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The non-volatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of example, but not limitation, many forms of Random Access Memory (RAM) are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct bus RAM (DR RAM).
The communication bus 113 may be an ISA bus (Industry Standard Architecture), PCI bus (Peripheral Component Interconnect), EISA bus (Extended Industry Standard Architecture), or the like.
The processor 114 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 114. The Processor 114 may be a general-purpose Processor including a Central Processing Unit (CPU), a Network Processor (NP), and the like; the present invention may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component, which may implement or execute the methods, steps, and logic blocks disclosed in the embodiments of the present invention. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art.
The method performed by the apparatus defined by the embodiment of the present invention may be applied to the processor 114, or may be implemented by the processor 114. The processor 114 may execute the method for digital content presentation based on spatial anchor points by cooperating with other modules or components in the electronic device 10. The implementation of the digital content presentation method based on spatial anchor points will be described in detail below.
Referring to fig. 2 as a possible implementation manner, some possible embodiments of the present application provide a digital content presentation method based on spatial anchor points. The digital content presentation method based on the spatial anchor point can be executed by the electronic equipment, and comprises the following steps: s11, S12, and S13.
S11: acquiring first image data captured via an image capture device in a first mobile device for imaging a first physical world location based on a first mobile device of a first user, and creating a spatial representation of the first physical world location and a spatial anchor point based on the first image data;
s12: sending the spatial representation and the attitude of the spatial anchor point from the mobile device to a cloud server for cloud storage;
s13: and binding the virtual content related to the digital content with the spatial anchor point, wherein the virtual content related to the digital content comprises article information for describing an article displayed and ID information of a display device for displaying the article.
The specific execution flow of the method will be described in detail below.
S11: based on a first mobile device of a first user, first image data captured via an image capture device in the first mobile device to image a first physical world location is acquired, and a spatial representation of the first physical world location and a spatial anchor point are created based on the first image data.
With the vigorous development of the digitization technology and the block chain technology, the digital artwork greatly widens the traditional collection field and categories and becomes a new battlefield for collection of the artwork. At present, digital artwork display can be provided in museums or galleries containing digital artwork display devices by adding spatial anchors to a particular digital artwork display device, where spatial anchors are a visual anchor to the real world. It should be noted that the digital content is not limited to the category of digital art, but may be other digital content, and the specific type of the digital content is not limited herein.
In the embodiment of the application, the first user is used for representing a user person who manages and protects the right and the function of the exhibited article or the digital content. For example, assuming that the current application scenario is an exhibition of digital artwork in a museum, the first user refers to a exhibitor planning the exhibition of the book.
Optionally, the first user may image the physical environment through a camera, and define a spatial anchor point defining a position and/or orientation relative to the feature captured by the camera to create the spatial anchor point, wherein the camera may be a visible light camera, e.g., an RGB camera or a grayscale camera; anchor point generation is then performed by a computing device or computing system that includes a camera, a processor, and a memory that stores instructions executable by the processor, e.g., a mobile device such as a smartphone or a head-mounted device, etc. It should be noted that two or more cameras may also be used to capture image data, including a visible light camera and a depth camera.
In the embodiment of the application, a display physical environment of a display article is imaged based on a first mobile device of a first user, and first image data of a first physical world position captured by an image capture device in the first mobile device is acquired; and defining a position and/or orientation of a spatial anchor point relative to the camera-captured feature based on the first image data, creating a spatial representation of the first physical world location and the spatial anchor point.
Alternatively, the spatial representation may take the form of a sparse point cloud determined from image data, such as visible RGB image data. The points of the sparse point cloud may have position and/or orientation values relative to defined in the mobile device or its camera.
S12: and sending the spatial representation and the attitude of the spatial anchor point from the first mobile device to a cloud server for cloud storage.
Specifically, after the first user creates and defines the space representation and the space anchor point, the first mobile device of the first user sends the space representation and the posture of the space anchor point to the cloud server to perform cloud storage, that is, the placement information of the space anchor point, the space representation information of the physical world position, the ID of the article display device and the incidence relation among the three are stored in the cloud server accessible through the computer network, so that the cloud server ensures the safety of the space anchor point and the convenience of subsequent application of the space anchor point due to the strong operation storage capacity of the cloud server.
S13: and binding the virtual content related to the digital content with the spatial anchor point, wherein the virtual content related to the digital content comprises article information for describing an article to be displayed and ID information of a display device for displaying the article.
Specifically, in the cloud service end, verifying whether the article can be displayed on the corresponding display device; and if the equipment ID is confirmed, the equipment ID is associated with the displayed item, the equipment association related anchor point is bound with related virtual content of the item, and the virtual content has the equipment ID capable of displaying the item. The display device comprises any one of a computing device or a computing system, such as a display or a photo frame, and has a unique identification ID, which realizes one-to-one connection with the spatial anchor point, wherein the unique identification ID comprises: at least one of a MAC address, a motherboard ID, a CPU ID, or a BIOS number.
Having defined the position and/or orientation of the space as a result of step S11 above, the first user may bind the position and/or orientation of the virtual content with respect to the spatial anchor point. Alternatively, the virtual content may be the proprietary NFT of the digital art (non-homogenous certification); the virtual content may also be an introduction to the item or a proof that the presentation is allowed.
The above-described procedure is described based on the anchor setting procedure, and the following description will be made in detail based on the access anchor.
Referring to fig. 3 and 4 as a possible implementation manner, some possible embodiments of the present application provide a digital content presentation method based on spatial anchor points. The digital content presentation method based on the spatial anchor point can be executed by the electronic equipment, and comprises the following steps: s21, S22, and S23.
S21: acquiring second image data for imaging a second physical world position and a space representation corresponding to the second image data captured by an image acquisition device in second mobile equipment based on second mobile equipment of a second user, and uploading the space representation corresponding to the second image to a cloud server;
s22: judging whether a second mobile device of a second user receives a space anchor point returned by the cloud server;
s23: if yes, the second mobile equipment acquires the ID information corresponding to the display equipment according to the received space anchor point and uploads the ID information to the cloud server; the cloud server side issues an instruction according to the ID information corresponding to the receiving display equipment so as to activate the digital content displayed by the corresponding display equipment;
if not, the display device does not display the digital content.
The specific execution flow of the method will be described in detail below.
S21: second image data for imaging a second physical world position and a space representation corresponding to the second image data are captured by an image acquisition device in the second mobile equipment based on second mobile equipment of a second user, and the space representation corresponding to the second image is uploaded to a cloud server.
In an embodiment of the present application, the second user may be a visitor user who visits the exhibition. Specifically, when the second user visits the exhibition and moves to the vicinity of the displayed article, the AR/MR application on the second mobile device of the second user obtains the surrounding physical environment image of the article, and uploads the spatial representation of the physical space to the cloud server.
S22: and judging whether a second mobile device of a second user receives the space anchor point returned by the cloud server.
Specifically, the cloud server judges whether the second image data is matched with the stored first image data;
if yes, the cloud server side returns a space anchor point with position information relative to the display equipment; the second mobile device of the second user receives the space anchor point sent by the cloud server;
and if not, the second mobile equipment of the second user does not receive the space anchor point.
Determining whether the second user is currently located in a space anchor point range for receiving the article by judging whether second image data acquired by second mobile equipment of the second user is matched with first image data acquired by the first user and stored in a cloud server; if the space anchor points are matched with the display equipment, the cloud server returns the space anchor points with the position information relative to the display equipment; the second mobile device of the second user receives the space anchor point sent by the cloud server; if not, the second mobile device of the second user cannot receive the spatial anchor point.
S23: if yes, the second mobile equipment acquires the ID information corresponding to the display equipment according to the received space anchor point and uploads the ID information to the cloud server; the cloud server side issues an instruction according to the ID information corresponding to the receiving display equipment so as to activate the digital content displayed by the corresponding display equipment; if not, the display device does not display the digital content.
Specifically, the display device ID is obtained from the virtual content bound by the spatial anchor point, the AR/MR application on the second mobile device uploads the ID to the cloud server, and the cloud server activates the corresponding display device to display the article according to the device ID.
The cloud server sends an instruction to activate the article displayed by the corresponding display device according to the received ID information corresponding to the display device, and the method further comprises the following steps:
the cloud server receives ID information corresponding to the display equipment;
the cloud server sends a message to the second user to inquire whether to pay for watching;
if the inquiry result is yes, the second user pays the fee on the second mobile device, whether the fee is received or not is judged at the cloud service end, and if yes, the cloud service end issues an instruction to activate the digital content displayed by the corresponding display device.
After the cloud server issues an instruction to activate the article displayed by the corresponding display device according to the received ID information corresponding to the display device, the method further includes:
and judging whether the space distance between the second user and the current space anchor point exceeds a preset threshold value, if so, stopping displaying by the display equipment.
Referring to fig. 5, an embodiment of the present application provides a digital content display apparatus 20 based on spatial anchor points, the apparatus including:
a construction module 210, configured to, based on a first mobile device of a first user, acquire first image data captured via an image capture apparatus in the first mobile device to image a first physical world location, and create a spatial representation and a spatial anchor point of the first physical world location based on the first image data;
a first sending module 220, configured to send the spatial representation and the pose of the spatial anchor from the first mobile device to a cloud server for cloud storage;
the first processing module 230 is configured to bind virtual content related to the digital content with the spatial anchor point, where the virtual content related to the digital content includes item information describing an item displayed and ID information of a display device displaying the item.
Referring to fig. 6, as a possible implementation manner, an embodiment of the present application provides a digital content presentation apparatus 20 based on spatial anchor points, including:
a second sending module 240, configured to obtain, based on a second mobile device of a second user, second image data that is captured by an image capture apparatus in the second mobile device and that images a second physical world location and a spatial representation corresponding to the second image data, and upload the spatial representation corresponding to the second image to a cloud server;
a determining module 250, configured to determine whether a second mobile device of a second user receives a space anchor point returned by the cloud server;
the second processing module 260 is configured to, if yes, obtain, by the second mobile device, ID information corresponding to the display device according to the received spatial anchor point, and upload the ID information to the cloud server; the cloud server side issues an instruction according to the ID information corresponding to the receiving display equipment so as to activate the articles displayed by the corresponding display equipment; if not, the display equipment does not display the article.
In summary, the embodiment of the present application provides a method, an apparatus and an electronic device for displaying digital content based on spatial anchor points, where the method includes: acquiring first image data captured via an image capture device in a first mobile device for imaging a first physical world location based on a first mobile device of a first user, and creating a spatial representation of the first physical world location and a spatial anchor point based on the first image data; sending the spatial representation and the attitude of the spatial anchor point from the first mobile device to a cloud server for cloud storage; and binding the virtual content related to the digital content with the spatial anchor point, wherein the virtual content related to the digital content comprises article information for describing an article to be displayed and ID information of a display device for displaying the article.
It should be understood that the term "and/or" herein is merely one type of association relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone, wherein A and B can be singular or plural. In addition, the "/" in this document generally indicates that the former and latter associated objects are in an "or" relationship, but may also indicate an "and/or" relationship, which may be understood with particular reference to the former and latter text.
In this application, "at least one" means one or more, "a plurality" means two or more. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or multiple.
It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not imply any order of execution, and the order of execution of the processes should be determined by their functions and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a portable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, an optical disk, or other various media capable of storing program codes.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (6)

1. A digital content presentation method based on spatial anchor points is characterized by comprising the following steps:
acquiring second image data for imaging a second physical world position and a space representation corresponding to the second image data captured by an image acquisition device in second mobile equipment based on second mobile equipment of a second user, and uploading the space representation corresponding to the second image to a cloud server;
the cloud server judges whether the second image data is matched with the stored first image data; the first image data is obtained by capturing a first physical world position through an image acquisition device in first mobile equipment based on the first mobile equipment of a first user;
if yes, the cloud server returns a space anchor point with position information relative to the display equipment, and the second mobile equipment of the second user receives the space anchor point sent by the cloud server; creating, by the first mobile device, a spatial representation of a first physical world location and a spatial anchor point based on the first image data, and sending, from the first mobile device to the cloud server, a gesture of the spatial representation and the spatial anchor point for cloud storage, the cloud server binding virtual content related to digital content with the spatial anchor point, the virtual content related to digital content including item information describing a displayed item and ID information of a display device displaying the item;
the second mobile equipment acquires the ID information corresponding to the display equipment according to the received space anchor point and uploads the ID information to the cloud server; the cloud server side issues an instruction according to the ID information corresponding to the receiving display equipment so as to activate the digital content correspondingly displayed by the corresponding display equipment;
if not, the second mobile device of the second user does not receive the spatial anchor point, and the display device does not display the digital content.
2. The method for displaying digital content based on spatial anchor points according to claim 1, wherein the cloud server issues an instruction to activate an article displayed by a corresponding display device according to the ID information corresponding to the display device, further comprising:
the cloud server receives ID information corresponding to the display equipment;
the cloud server sends a message to the second user to inquire whether to pay for watching;
if the inquiry result is yes, the second user pays the fee on the second mobile device, whether the fee is received or not is judged at the cloud service end, and if yes, the cloud service end issues an instruction to activate the digital content displayed by the corresponding display device.
3. The method for displaying digital content based on spatial anchor points according to claim 1, wherein after the cloud server issues an instruction to activate an article displayed by a corresponding display device according to the ID information corresponding to the display device, the method further comprises:
and judging whether the space distance between the second user and the current space anchor point exceeds a preset threshold value, if so, stopping displaying by the display equipment.
4. An apparatus for digital content presentation based on spatial anchor points, the apparatus comprising:
the second sending module is used for acquiring second image data for imaging a second physical world position and a space representation corresponding to the second image data captured by an image acquisition device in second mobile equipment based on second mobile equipment of a second user, and uploading the space representation corresponding to the second image to the cloud server;
the judging module is used for judging whether the second image data is matched with the stored first image data; the first image data is obtained by capturing a first physical world position through an image acquisition device in first mobile equipment based on the first mobile equipment of a first user;
the second processing module is used for returning a spatial anchor point with position information relative to the display equipment during matching, and the second mobile equipment of the second user receives the spatial anchor point sent by the cloud server; creating, by the first mobile device, a spatial representation of a first physical world location and a spatial anchor point based on the first image data, and sending, from the first mobile device to the cloud server, a gesture of the spatial representation and the spatial anchor point for cloud storage, the cloud server binding virtual content related to digital content with the spatial anchor point, the virtual content related to digital content including item information describing a displayed item and ID information of a display device displaying the item; the second mobile equipment acquires the ID information corresponding to the display equipment according to the received space anchor point and uploads the ID information to the cloud server; the cloud server side issues an instruction according to the ID information corresponding to the receiving display equipment so as to activate the digital content correspondingly displayed by the corresponding display equipment;
and when the digital content is not matched with the spatial anchor point, the second mobile equipment of the second user does not receive the spatial anchor point, and the digital content is not displayed by the display equipment.
5. An electronic device, comprising: one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-3.
6. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 3.
CN202210168925.1A 2022-02-24 2022-02-24 Digital content display method and device based on spatial anchor point and electronic equipment Active CN114255333B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210168925.1A CN114255333B (en) 2022-02-24 2022-02-24 Digital content display method and device based on spatial anchor point and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210168925.1A CN114255333B (en) 2022-02-24 2022-02-24 Digital content display method and device based on spatial anchor point and electronic equipment

Publications (2)

Publication Number Publication Date
CN114255333A CN114255333A (en) 2022-03-29
CN114255333B true CN114255333B (en) 2022-06-24

Family

ID=80797010

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210168925.1A Active CN114255333B (en) 2022-02-24 2022-02-24 Digital content display method and device based on spatial anchor point and electronic equipment

Country Status (1)

Country Link
CN (1) CN114255333B (en)

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120130834A1 (en) * 2010-11-18 2012-05-24 Landry Lawrence B Method for remotely configuring a digital image display device
US10871934B2 (en) * 2017-05-04 2020-12-22 Microsoft Technology Licensing, Llc Virtual content displayed with shared anchor
US10304252B2 (en) * 2017-09-15 2019-05-28 Trimble Inc. Collaboration methods to improve use of 3D models in mixed reality environments
US20190088030A1 (en) * 2017-09-20 2019-03-21 Microsoft Technology Licensing, Llc Rendering virtual objects based on location data and image data
US11164380B2 (en) * 2017-12-05 2021-11-02 Samsung Electronics Co., Ltd. System and method for transition boundaries and distance responsive interfaces in augmented and virtual reality
WO2019159044A1 (en) * 2018-02-19 2019-08-22 ГИОРГАДЗЕ, Анико Тенгизовна Method for placing a virtual advertising object for display to a user
GB2572786B (en) * 2018-04-10 2022-03-09 Advanced Risc Mach Ltd Image processing for augmented reality
CN110873963B (en) * 2018-09-03 2021-09-14 广东虚拟现实科技有限公司 Content display method and device, terminal equipment and content display system
US10997776B2 (en) * 2019-02-23 2021-05-04 Microsoft Technology Licensing, Llc Connecting spatial anchors for augmented reality
CN111859199A (en) * 2019-04-30 2020-10-30 苹果公司 Locating content in an environment
CN113970888A (en) * 2020-07-07 2022-01-25 华为技术有限公司 Household equipment control method, terminal equipment and computer readable storage medium
CN112684894A (en) * 2020-12-31 2021-04-20 北京市商汤科技开发有限公司 Interaction method and device for augmented reality scene, electronic equipment and storage medium

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
Interactive annotation on mobile phones for real and virtual space registration;Hyejin Kim等;《2011 IEEE International Symposium on Mixed and Augmented Reality》;20111231;全文 *
博物馆线上线下数字展示技术应用情况研究;曲云鹏等;《自然科学博物馆研究》;20190225(第01期);全文 *
基于Hololens的可移动办税指引平台的研究;鄢鑫;《中国优秀硕士学位论文全文数据库 信息科技辑》;20210731;全文 *
浅谈虚拟现实技术在数字博物馆空间设计中的应用;苏燕等;《中国管理信息化》;20190615(第12期);全文 *

Also Published As

Publication number Publication date
CN114255333A (en) 2022-03-29

Similar Documents

Publication Publication Date Title
CN108830692B (en) Remote panoramic house-viewing method and device, user terminal, server and storage medium
US8681179B2 (en) Method and system for coordinating collisions between augmented reality and real reality
CN110933296A (en) Apparatus and method for providing content aware photo filter
CN108124093B (en) Method and system for preventing terminal photographing from counterfeiting
US20150325048A1 (en) Systems, methods, and computer-readable media for generating a composite scene of a real-world location and an object
US9600720B1 (en) Using available data to assist in object recognition
JP2014115957A (en) Augmented reality building simulation device
CN111696215A (en) Image processing method, device and equipment
CN109522503B (en) Tourist attraction virtual message board system based on AR and LBS technology
CN114153548A (en) Display method and device, computer equipment and storage medium
CN107832598B (en) Unlocking control method and related product
CN109840885A (en) Image interfusion method and Related product
KR102078969B1 (en) System for displaying and transacting digital art using AR and VR
CN113470112A (en) Image processing method, image processing device, storage medium and terminal
KR20230124878A (en) Real Estate Information Providing Method and the Application Performing thereof
TWM482797U (en) Augmented-reality system capable of displaying three-dimensional image
CN115660010A (en) Method, apparatus, electronic device, medium, and product for displaying information
CN109816628B (en) Face evaluation method and related product
CN109034214B (en) Method and apparatus for generating a mark
CN111767456A (en) Method and device for pushing information
CN114255333B (en) Digital content display method and device based on spatial anchor point and electronic equipment
JP6510116B2 (en) Customer grasping system using virtual object display system, customer grasping system program and customer grasping method
KR102078968B1 (en) System for transacting digital art using blockchain technology
CN108776959B (en) Image processing method and device and terminal equipment
JP2017182681A (en) Image processing system, information processing device, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant