WO2018014766A1 - 增强现实模块的生成方法及装置、生成***和存储介质 - Google Patents

增强现实模块的生成方法及装置、生成***和存储介质 Download PDF

Info

Publication number
WO2018014766A1
WO2018014766A1 PCT/CN2017/092670 CN2017092670W WO2018014766A1 WO 2018014766 A1 WO2018014766 A1 WO 2018014766A1 CN 2017092670 W CN2017092670 W CN 2017092670W WO 2018014766 A1 WO2018014766 A1 WO 2018014766A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
rendering
information
party
marker
Prior art date
Application number
PCT/CN2017/092670
Other languages
English (en)
French (fr)
Inventor
丁剑
刘骁
刘海龙
陈波
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2018014766A1 publication Critical patent/WO2018014766A1/zh
Priority to US16/202,196 priority Critical patent/US10732968B2/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/71Version control; Configuration management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/77Software metrics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/53Network services using third party service providers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Definitions

  • the present invention relates to the field of computers, and in particular, to a method for generating an augmented reality module, a device for generating an augmented reality module, and a system for generating an augmented reality module and a computer storage medium.
  • Augmented Reality is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D (Three Dimensional) models.
  • the goal of this technology is to set the virtual world on the screen. In the real world and interact. This technology was proposed in 1990. With the increase in CPU computing power of portable electronic products, the use of AR will become more and more widespread.
  • the architecture block diagram of the mobile client-based AR application development module provided in the prior art as shown in FIG. 1 is mainly for a more professional AR developer or development user, and each adopts a software development kit that only provides an AR core engine ( The Software Development Kit (SDK) is developed in a way that includes the most basic technologies in AR. After the AR developer gets the SDK, he or she needs to select the appropriate AR rendering engine. This difficulty is relatively large. Because the existing rendering engine and the provided interface require the developer to have a certain graphics foundation, some system parameters and posture information obtained by the AR core engine need to be transmitted to the AR rendering engine according to certain requirements, from the development. In terms of efficiency, it is not suitable for quickly developing an AR module in its own application, and the learning cost is high.
  • SDK Software Development Kit
  • the embodiment of the present invention is to provide a method for generating an augmented reality module, a device for generating an augmented reality module, and a computer storage medium, which at least partially solves the problem that the mobile application-based AR application development in the prior art is not efficient, and is not suitable for fast Develop an AR module in your own application to learn technical problems with higher costs.
  • a first aspect of the embodiments of the present invention discloses a method for generating an augmented reality module, including:
  • the third-party software development interface information is uniformly encapsulated with an AR core engine and an AR rendering engine, wherein the AR core engine is associated with System parameters and attitude information are passed to the AR rendering engine;
  • the second aspect of the embodiment of the present invention discloses an apparatus for generating an augmented reality module, including:
  • the interface information obtaining module is configured to obtain preset third-party software development interface information for mobile client augmented reality AR module development; the third-party software development interface information is uniformly encapsulated with an AR core engine and an AR rendering engine, wherein The system parameters and posture information associated with the AR core engine are transmitted to the AR rendering engine;
  • a generating module configured to generate an AR module of the mobile client according to the third-party software development interface information and a correspondingly configured document; wherein the corresponding configured document includes interface usage information of the AR core engine and the AR rendering engine.
  • a third aspect of the embodiments of the present invention discloses a system for generating an augmented reality module, including: an augmented reality AR mobile client and a third-party AR background service system, where
  • the third-party AR background service system is configured to provide an AR developer with a background management service including AR marker management, AR renderer management, and AR marker recognition;
  • the AR mobile client is configured to interact with the third-party AR background service system in the process of running the AR application including the AR module, and display the generated AR effect;
  • the AR module is an AR developer An AR module generated according to a preset third-party software development interface information for mobile client AR module development and a corresponding configuration document thereof; wherein the third-party software development interface information is uniformly encapsulated with an AR core engine and an AR rendering engine
  • the system parameter and the posture information associated with the AR core engine are transmitted to the AR rendering engine, and the corresponding configured document includes interface usage information of the AR core engine and the AR rendering engine.
  • a fourth aspect of the embodiments of the present invention discloses a computer storage medium, where the computer storage medium stores a program, and the program includes all the steps of the method for generating the augmented reality module in the first aspect of the embodiment of the present invention.
  • a fifth aspect of the embodiment of the present invention discloses a third-party AR back-end service system, one or more back-end servers;
  • a communication interface configured to exchange information with the AR mobile client
  • a processor connected to the communication interface, configured to execute the foregoing method for generating an augmented reality module.
  • the AR developer can directly develop the AR module of the mobile client according to the software development interface information, without selecting the AR rendering engine by itself.
  • the efficiency is not high, and it is not suitable for quickly developing an AR module in its own application, learning technical problems with high cost, shortening the development cycle, simplifying the development process, and greatly reducing the difficulty of developing an AR module.
  • FIG. 1 is a structural block diagram of a mobile client-based AR application development module provided in the prior art
  • FIG. 2 is a schematic structural diagram of a system for generating an augmented reality module according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a third-party AR background service system according to an embodiment of the present invention.
  • FIG. 4 is a schematic flowchart of a method for generating an augmented reality module according to an embodiment of the present invention
  • FIG. 5 is a schematic structural diagram of a device for generating an augmented reality module according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of another embodiment of a generating device of an augmented reality module provided by the present invention.
  • FIG. 7 is a schematic structural diagram of another embodiment of an apparatus for generating an augmented reality module provided by the present invention.
  • FIG. 2 is a schematic structural diagram of a system for generating an augmented reality module according to an embodiment of the present invention.
  • the augmented reality module generation system may include an AR mobile client and a third-party AR background service system. System, where:
  • the third-party AR background service system is for an AR developer, and the third-party AR background service system can provide an AR manager with a background management service including AR marker management, AR renderer management, and AR marker recognition;
  • the AR mobile client can be a mobile terminal with an AR application installed, and the AR application includes an AR module.
  • the AR mobile client runs the third-party AR background in the process of running the AR application including the AR module.
  • the service system interacts to obtain information about the AR rendering effect from the third-party AR background service system, and finally displays the generated AR effect.
  • the AR rendering object in the various embodiments of the present invention refers to adding in the screen reality.
  • the virtual object is the core of the AR, that is, the enhancement to the reality;
  • the AR marker refers to the scene marker in the AR where the AR effect is expected, the position of the marker determines the position of the AR renderer;
  • the development user refers to a developer who develops an AR module in a mobile application using the development system of the AR application.
  • the third-party AR background service system provides a multi-function background to the AR developer, which can meet the needs of the background management in use, the AR flag, the AR rendering service, and the AR marker identification.
  • Background services including image recognition, AR training file services, etc.
  • AR rendering processing format conversion management, compression, AR rendering geometry parameter management
  • the generating system of the augmented reality module of the embodiment of the present invention may further include an AR management platform, where the AR management platform may include:
  • An AR marker management module configured to manage AR marker image information uploaded by an AR developer; and upload the AR marker image information to the third-party AR background service system;
  • the AR renderer management module is configured to manage an AR renderer model file uploaded by the AR developer corresponding to the AR marker image information; and upload the AR renderer model file to the third-party AR background service system.
  • the AR renderer model file may be used to provide an original render parameter for the AR renderer; the original render parameter may include: pre-defining a relative positional relationship between the AR renderer and the AR marker, and the like.
  • the AR effect adjustment module is configured to receive an AR effect adjustment instruction input by the AR developer, and generate an adjusted AR rendering effect by using a pre-configured 3D rendering engine in real time; and upload the adjusted rendering parameter information to the third-party AR
  • the background service system performs save management.
  • the adjusted rendering parameter information herein includes at least: a relative positional relationship between the adjusted AR renderer and the AR marker.
  • the original rendering parameters or the adjusted rendering parameters before the adjustment are not limited to the relative positional relationship between the AR renderer and the AR marker, and may also include: a rendering mode, and a rendering effect required for rendering.
  • Rendering effects here may include: stereo (3D) effects, lighting effects, and/or shadow effects, and the like.
  • the AR management platform in various embodiments of the present invention may be an AR open platform website
  • the AR open platform website is a platform provided to the AR developer to manage its own AR marker, AR renderer, and perform AR effect adjustment. website.
  • the AR developer can log in to the AR open platform website, and upload the AR marker image information required by the AR, the AR renderer model file corresponding to the AR marker image information, etc., according to requirements, and can call the AR open platform website.
  • the 3D simulation display function, to view the simulated AR effect, the AR open platform website can simulate the AR rendering effect through the pre-configured 3D rendering engine; the AR developer can also provide adjustments on the AR open platform website according to requirements.
  • the AR effect is adjusted in the 3D simulation interface, and the AR effect adjusted by the AR developer is simulated in real time. Therefore, the AR developer only needs to use the AR management platform to do simple uploading and online adjustment operations, and then can complete an AR module that is desired by the mobile client, and does not require the AR developer to additionally learn the relevant knowledge in the AR field. The difficulty of developing an AR module is further reduced.
  • AR marker uploaded in FIG. 2 and the image of the AR renderer are merely examples, and are not used as the AR marker image information and the AR renderer model file corresponding to the AR marker image information.
  • the 3D rendering engine in various embodiments of the present invention includes but is not limited to Three.js a 3D rendering engine, or a lower-level WebGL native 3D engine, etc.; the background system supporting the AR management platform in various embodiments of the present invention may be set in a third-party AR background service system, or may be an independent background. system.
  • the third-party AR background service system 30 may include: an AR marker library 300, an AR rendering library 302, and mapping establishment. a module 304, an identification service module 306, a rendering module 308, and a rendering information sending module 3010, where
  • the AR marker library 300 is configured to save the received AR marker image information
  • the AR rendering library 302 is configured to save the received AR renderer model file corresponding to the AR marker image information
  • the mapping establishing module 304 is configured to establish a mapping relationship between the AR marker image information and the AR renderer model file.
  • the identification service module 306 is configured to receive an access identification service for requesting the AR identifier sent by the AR mobile client, and perform image recognition on the AR marker according to the AR marker image information saved in the AR marker library. Descripting information of the AR marker, and transmitting the tracking information to the AR mobile client;
  • the rendering module 308 is configured to search, according to the mapping relationship, an AR renderer model file corresponding to the AR marker, and perform AR rendering by using the AR management platform;
  • the rendering information sending module 3010 is configured to send information about the AR rendering effect generated by the AR management platform to the AR mobile client.
  • the AR mobile client can display the AR rendering effect to the user according to the received information of the AR rendering effect.
  • the third-party AR background service system 30 is mainly pre-configured to include an AR marker library 300 and an AR rendering library 302, where the AR marker library 300 includes an AR development user.
  • the AR rendering library 302 includes an AR rendering object that the AR development user wants to present in the scene, and the present invention is implemented.
  • the background protocol is set in advance according to the access principle provided by the AR core engine SDK document, and the AR developer does not need to develop according to the client protocol, which greatly shortens the development cycle; and the third-party AR background service system according to the embodiment of the present invention is based in advance.
  • the background service provided by the third-party AR background service system in the embodiment of the present invention is for the AR developer. It is transparent, eliminating the need for AR developers to create this development in the background service, further shortening the development cycle and simplifying the development process.
  • the AR module in the embodiment of the present invention is an AR module generated by the AR developer according to the preset third-party software development interface information for the mobile client AR module development and the corresponding configured document;
  • the three-party software development interface information is uniformly encapsulated with an AR core engine and an AR rendering engine, wherein system parameter and posture information associated with the AR core engine are transmitted to the AR rendering engine, and the corresponding configuration document includes the AR core engine and the AR
  • the rendering engine's interface usage information that is to say, based on the interface usage information, the AR developer can directly develop the AR module of the mobile client according to the software development interface information, without having to select the AR rendering engine by itself, without paying attention to some principles inside the AR and how to use the AR core engine.
  • the output parameters, how to load AR renderings, etc. enable the rapid and simple development of AR applications for mobile clients.
  • the interface usage information includes: usage guidance information of the software development interface, for example, the AR developer provides help information using the interface.
  • the software development interface may include an SDK packaged with the AR core engine and an AR rendering engine.
  • the AR core engine may be posture information of an image capturing device (for example, a camera) for performing identification, tracking, and then obtaining an image of each frame in the video.
  • the posture information may include: a relative position parameter indicating a relative position of the image acquisition device relative to an acquisition object corresponding to the AR marker.
  • the relative position parameter can be used to determine a rendering position of the renderer in the image to the rendering engine.
  • the relative position parameter can be a depiction
  • the location of the image acquisition device and the AR marker image information is described, and the AR renderer generally needs to determine the drawing position according to the AR marker, and if the relative position parameter of the image acquisition device and the acquisition target corresponding to the AR marker is known, The AR renderer can be superimposed on or around the AR marker based on the relative positional parameter.
  • the AR rendering engine may be a component that performs image rendering of a render object in an image, and the image rendering may include: image coloring, which causes the image to exhibit a specific image effect by coloring, for example, a lighting effect, a shadow effect, a texture effect, or a 3D stereoscopic image. Effects or material effects, etc.
  • the system parameters may include: hardware parameters of the image acquisition device, for example, focal length in the camera, size parameters of various sensors, spacing between multiple prisms in a prism group, thickness of the prism group, and camera distortion parameters.
  • the system parameters and the relative position parameters of the camera together determine the position of the AR marker in the image, thus determining the position of the AR renderer determined in the AR marker in the image.
  • the sensor may include a photosensitive sensor or the like.
  • the flowchart of the method for generating the augmented reality module provided by the embodiment of the present invention, which is shown in FIG. 4, illustrates how the AR developer develops the AR module and generates the AR module, including the following steps:
  • Step S400 Acquire preset third-party software development interface information for mobile client augmented reality AR module development
  • the third-party software development interface information is uniformly encapsulated with an AR core engine and an AR rendering engine, wherein system parameter and posture information associated with the AR core engine are transmitted to the AR rendering engine; thereby providing the AR developer with Uniform and simple interface use, AR developers do not have to care about how to choose the right rendering engine, just need to be integrated into their own application (App) according to the development documentation requirements.
  • the third-party software development interface information in the embodiment of the present invention includes, but is not limited to, a third-party SDK. It should be noted that, in terms of mobile client encapsulation, different mobile client SDK interfaces may also be encapsulated for different levels of AR developers. , reserve some complicated interface to the relatively professional AR users, and improve the overall effect without affecting the overall effect. The flexibility of AR application development.
  • Step S402 Generate an AR module of the mobile client according to the third-party software development interface information and the corresponding configured document.
  • the simple interface may be: an SDK with an AR core engine and an AR rendering engine, and associated with the encapsulated AR core engine and the AR rendering engine, and directly connected to the App. Therefore, the simple interface can be called a direct application interface.
  • the complex interface may be an SDK that encapsulates one or more AR core engines and/or one or more AR rendering engines not associated with the AR core engine. That is, the AR core engine encapsulated in the complex interface is not separated from the AR rendering engine, and the AR core engine and the AR rendering engine are specifically selected and associated, which is required by the AR developer. Operational. Therefore, the complex interface in this embodiment may also be referred to as an interface to be configured.
  • AR developers need to select the corresponding AR core engine and AR rendering engine according to their own needs, and associate the selected AR core engine and AR rendering engine.
  • the AR core engine is associated with the AR rendering engine, indicating that the connection between the AR core engine and the AR rendering engine has been established, and the AR core engine imports the system parameters and posture information into the subsequent application. In the AR rendering engine.
  • the document of the corresponding configuration in the embodiment of the present invention includes the interface usage information of the AR core engine and the AR rendering engine; the generated AR module may be added to an existing application, that is, the application is updated and upgraded.
  • the AR application including the AR module is generated, and a new AR application may be directly generated according to the generated AR module.
  • the AR application interacts with a preset third-party AR background service system during operation, that is, the installation terminal of the AR application and the mobile terminal running the AR application and the preset third-party AR background service system Interact to get and display real-time AR rendering effects.
  • the third-party AR background service system provides a background management service including AR marker management, AR renderer management, and AR marker recognition.
  • the method for generating an augmented reality module of the embodiment of the present invention may further include: receiving a login instruction, and logging in to a preset AR management platform; and uploading an AR marker image to the third-party AR background service system based on the AR management platform.
  • Information, and/or an AR renderer model file corresponding to the AR marker image information may further include: receiving a login instruction, and logging in to a preset AR management platform; and uploading an AR marker image to the third-party AR background service system based on the AR management platform.
  • Information, and/or an AR renderer model file corresponding to the AR marker image information may further include: receiving a login instruction, and logging in to a preset AR management platform; and uploading an AR marker image to the third-party AR background service system based on the AR management platform.
  • Information, and/or an AR renderer model file corresponding to the AR marker image information may further include: receiving a login instruction, and logging in to a preset AR management platform; and uploading an AR marker image to the third
  • the AR developer can perform account registration on the preset AR management platform, and then input a login command on the electronic terminal, where the login command can include the registered account and the login password, thereby using the registered account.
  • the AR developer can upload the AR marker image information required by the AR management platform and the AR renderer model file corresponding to the AR marker image information through the electronic terminal according to requirements, and then The AR management platform can send the uploaded information to the third-party AR background service system for storage management.
  • the method for generating an augmented reality module of the embodiment of the present invention may further include: receiving a login instruction, and logging in to a preset AR management platform; receiving an AR effect adjustment instruction input based on the AR management platform; The instruction is adjusted, and the adjusted AR rendering effect is generated in real time through a pre-configured 3D rendering engine; and the adjusted rendering parameter information is uploaded to the third-party AR background service system for storage management.
  • the AR effect adjustment instruction can be input in the adjusted 3D simulation interface provided by the AR open platform website, and the AR developer can be actually received for the electronic terminal.
  • the AR management platform simulates the AR rendering in real time through the pre-configured 3D rendering engine according to the AR effect adjustment instruction.
  • the effect is returned to the electronic terminal, and the electronic terminal can display the adjusted AR rendering effect in real time through the display screen.
  • the AR management platform uploads the adjusted rendering parameter information to the third-party AR background service system for storage management.
  • AR developers only need to use the AR management platform for simple upload and online adjustment. Operation, you can complete the AR module you want to build on the mobile client, without the need for AR developers to learn the relevant knowledge of the AR field, further reducing the difficulty of developing an AR module.
  • the third-party software development interface information in the embodiment of the present invention may be uniformly encapsulated with multiple sets of AR core engines and their corresponding AR rendering engines, and the AR rendering engines in each group are different;
  • performing the AR module development of the mobile client according to the third-party software development interface information in step S302 may include: selecting a group of AR core engines and corresponding ones from the multiple sets of AR core engines and their corresponding AR rendering engines.
  • the AR rendering engine is configured to generate an AR module of the mobile client according to the selected AR core engine and the AR rendering engine and the corresponding configured documents. Therefore, AR developers can also select different pre-configured AR rendering engines according to their own needs, thus meeting the needs of different AR developers to select different AR rendering engines, further improving the flexibility and convenience of AR application development. Sex.
  • the AR developer can directly develop the AR module of the mobile client according to the software development interface information, without selecting the AR rendering engine by itself. There is no need to care about some internal principles of the AR and how to use the parameters output by the AR core engine, how to load the AR renderings, etc., to realize the rapid and simple development of the AR application of the mobile client, and to solve the AR application development based on the mobile client in the prior art.
  • the background service provided by the third-party AR background service system in the embodiment of the present invention is transparent to the AR developer, and the AR developer is saved in the background service to further shorten the development cycle and simplify the development. Process; and AR developers only need to use the AR management platform to do simple Upload, online adjustment operations, you can complete the AR module you want to build on the mobile client, you do not need AR developers additionally learn about the AR field and further reduce the difficulty of developing an AR module.
  • the present invention further provides a device for generating an augmented reality module, which is a schematic structural diagram of a device for generating an augmented reality module according to an embodiment of the present invention as shown in FIG.
  • the generating device 50 of the augmented reality module may include: an interface information acquiring module 500 and a generating module 502, where
  • the interface information obtaining module 500 is configured to acquire preset third-party software development interface information for mobile client augmented reality AR module development; the third-party software development interface information is uniformly encapsulated with an AR core engine and an AR rendering engine, where The system parameters and posture information associated with the AR core engine are transmitted to the AR rendering engine;
  • the generating module 502 is configured to generate an AR module of the mobile client according to the third-party software development interface information and a correspondingly configured document; wherein the corresponding configured document includes interface usage information of the AR core engine and the AR rendering engine.
  • the AR application interacts with a preset third-party AR background service system during operation, and the third-party AR background service system provides a background including AR marker management, AR renderer management, and AR marker recognition. Management services.
  • the generating device 50 of the augmented reality module includes an interface information acquiring module 500 and a generating module 502, and The receiving login module 504 and the uploading module 506 are included, wherein
  • the receiving login module 504 is configured to receive the login instruction and log in to the preset AR management platform
  • the uploading module 506 is configured to upload AR marker image information and an AR renderer model file corresponding to the AR marker image information to the preset third-party AR background service system based on the AR management platform; wherein the third party The AR background service system provides background management services including AR marker management, AR renderer management, and AR marker recognition.
  • the generating apparatus 50 of the augmented reality module includes an interface information acquiring module 500, a generating module 502, and a receiving login module.
  • the 504 and the uploading module 506 may further include an instruction receiving module 508 and a display uploading module 5010, where
  • the instruction receiving module 508 is configured to receive the login command by the login module 504, and log in to the preset AR management platform, and receive an AR effect adjustment instruction input based on the AR management platform;
  • the display uploading module 5010 is configured to simulate and display the adjusted AR effect in real time through a pre-configured 3D rendering engine according to the AR effect adjustment instruction; and upload the adjusted rendering parameter information to the third-party AR background service system. Save management.
  • the rendering parameter information may include: a relative position parameter of the AR renderer and the AR marker.
  • the third-party software development interface information may be uniformly encapsulated with multiple sets of AR core engines and corresponding AR rendering engines, and the AR rendering engines in each group are different;
  • the generating module 502 is further configured to: select, from the plurality of groups of AR core engines and their corresponding AR rendering engines, a set of AR core engines and their corresponding AR rendering engines; according to the selected AR core engine and the AR rendering engine, and Corresponding to the configured document, the AR module of the mobile client is generated.
  • the document configured here also stores information such as the identifier of the AR marker, the name of the AR renderer corresponding to the AR marker, the relative position of the preset AR marker, and the relative positional relationship of the AR renderer. Information such as a preset positional relationship between the AR identifier and the AR renderer is used to indicate the relative position of the AR renderer and the AR marker in the image.
  • the augmented reality module generating device 50 in the embodiment of the present invention may include, but is not limited to, a device capable of application development such as a personal computer or a tablet computer, and functions of each functional module of the augmented reality module generating device 50.
  • a device capable of application development such as a personal computer or a tablet computer
  • functions of each functional module of the augmented reality module generating device 50 may be specifically implemented, and the specific implementation process may refer to the related description of the foregoing method embodiment, and details are not described herein again.
  • the embodiment of the present invention implements the software development interface information of the AR core engine and the AR rendering engine in advance, and the AR developer can directly develop the AR module of the mobile client according to the software development interface information, without
  • the AR rendering engine is selected by itself, and it is not necessary to care about some principles inside the AR, how to use the parameters output by the AR core engine, how to load the AR rendering object, etc., and realize the rapid and simple development of the AR application of the mobile client, and solve the prior art based on the mobile
  • the client's AR application development efficiency is not high, it is not suitable for quickly developing an AR module in its own application, learning high-cost technical problems, shortening the development cycle, simplifying the development process, thereby greatly reducing the development of an AR module.
  • the background service provided by the third-party AR background service system in the embodiment of the present invention is transparent to the AR developer, and the AR developer is saved in the background service to further reduce the development. Cycles simplify the development process; and AR developers only need to use the AR to manage the peace By doing simple uploading and online adjustment operations, you can build an AR module you want on the mobile client. You don't need AR developers to learn more about the AR field, which further reduces the difficulty of developing an AR module.
  • the embodiment of the invention further provides a third-party AR background service system, comprising: one or more background servers.
  • a third-party AR back-end server includes a plurality of back-end servers, usually these back-end servers are connected to each other to form a computer cluster.
  • a communication interface configured to exchange information with the AR mobile client
  • a processor configured to perform the foregoing one or more technical solutions to provide a method for generating an augmented reality module.
  • the communication interface can be an Internet interface, and can be used for the AR mobile client to perform information interaction, for example, obtaining the foregoing third-party software development interface information and providing the configured document.
  • the communication interface may be a wired interface, such as a fiber optic cable interface or a cable interface, and the third-party AR background service system may establish a connection with the AR mobile client via the Internet.
  • the communication interface can also be a wireless interface.
  • the processor can be various types of processors, such as a central processing unit, a microprocessor, a digital signal processor, a programmable array, an application processor, or an application specific integrated circuit.
  • the processor can obtain third-party software development interface information from the AR mobile client and provide configured documents to the AR mobile client through computer executable instructions such as a computer program, and assist the AR mobile client to generate the AR module. To simplify the formation of the AR module of the AR mobile client.
  • the processor may be connected to the communication interface through a bus interface such as an integrated circuit bus to facilitate the processor to control information interaction between the communication interface and the AR mobile client.
  • a bus interface such as an integrated circuit bus to facilitate the processor to control information interaction between the communication interface and the AR mobile client.
  • the AR mobile client may include: a wireless interface and a processor, where the wireless interface may be used by the AR mobile client to connect with the third-party AR background service system for information interaction.
  • the processor in the AR mobile client can also be connected to the wireless interface through a bus interface in the AR mobile client, and can be used in the AR mobile client based on the configuration document provided by the third AR back state server.
  • the AR module is generated internally.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed.
  • the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.
  • the units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place or distributed to multiple network units; You can choose which one according to your actual needs. Some or all of the units implement the objectives of the embodiment of the present embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the above integration
  • the unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed.
  • the foregoing storage device includes the following steps: the foregoing storage medium includes: a mobile storage device, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • ROM read-only memory
  • RAM random access memory
  • magnetic disk or an optical disk.
  • optical disk A medium that can store program code.
  • the above-described integrated unit of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product.
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a magnetic disk, or an optical disk.
  • the technical solution provided in the embodiment of the present invention will simultaneously develop the interface information in the third party software. Encapsulated with AR core engine and AR rendering engine, the subsequent third-party software does not need to develop the AR rendering engine that is compatible with the AR core engine when developing the AR mode in the AR application, thereby reducing the development of the third party.
  • the difficulty shortens the development cycle of the AR module, thereby improving the development efficiency of the AR module and having a positive industrial effect.
  • the technical solution provided by the embodiment of the present invention when providing the third-party software development interface information developed by the AR module, can be directly provided together with the provided AR core engine and the AR rendering engine, and has the advantages of simple implementation and simple implementation in the industry. specialty.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明实施例公开了增强现实模块的生成方法,包括:获取预设的用于移动客户端增强现实AR模块开发的第三方软件开发接口信息;第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与AR核心引擎关联的***参数和姿态信息传入到了AR渲染引擎中;根据所述第三方软件开发接口信息及其对应配置的文档,生成移动客户端的AR模块;其中对应配置的文档包括AR核心引擎和AR渲染引擎的接口使用信息。本发明还公开了一种增强现实模块的生成装置和后台***及计算机存储介质。

Description

增强现实模块的生成方法及装置、生成***和存储介质
本申请基于申请号为201610570848.7、申请日为2016年07月18日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本发明涉及计算机领域,尤其涉及增强现实模块的生成方法、增强现实模块的生成装置以及增强现实模块的生成***和计算机存储介质。
背景技术
增强现实(Augmented Reality,AR)是一种实时地计算摄影机影像的位置及角度并加上相应图像、视频、3D(Three Dimensional)模型的技术,这种技术的目标是在屏幕上把虚拟世界套在现实世界并进行互动。这种技术由1990年提出,随着随身电子产品CPU运算能力的提升,AR的用途将会越来越广。
如图1示出的现有技术中提供的基于移动客户端的AR应用开发模块的架构框图,主要针对于较为专业的AR开发者或开发用户,均采用只提供AR核心引擎的软件开发工具包(Software Development Kit,SDK)的方式来进行开发,该AR核心引擎包含了AR中最基本的一些技术;AR开发者拿到该SDK后,需要自行选择合适的AR渲染引擎,这个难度是比较大的,因为现有的渲染引擎,提供的接口都要求开发人员有一定的图形学基础,需要将AR核心引擎得到的一些***参数、姿态信息,按照一定的要求传入到AR渲染引擎当中,从开发效率来看,不适合快速地在自身的应用当中开发一个AR模块,学习成本较高。
发明内容
本发明实施例期望提供一种增强现实模块的生成方法、增强现实模块的生成装置以及和计算机存储介质,至少部分解决了现有技术中基于移动客户端的AR应用开发效率不高,不适合快速地在自身的应用当中开发一个AR模块,学习成本较高的技术问题。
本发明实施例第一方面公开了一种增强现实模块的生成方法,包括:
获取预设的用于移动客户端增强现实AR模块开发的第三方软件开发接口信息;所述第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与所述AR核心引擎关联的***参数和姿态信息传入到了所述AR渲染引擎中;
根据所述第三方软件开发接口信息及其对应配置的文档,生成移动客户端的AR模块;其中所述对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息。
本发明实施例第二方面公开了一种增强现实模块的生成装置,包括:
接口信息获取模块,配置为获取预设的用于移动客户端增强现实AR模块开发的第三方软件开发接口信息;所述第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与所述AR核心引擎关联的***参数和姿态信息传入到了所述AR渲染引擎中;
生成模块,配置为根据所述第三方软件开发接口信息及其对应配置的文档,生成移动客户端的AR模块;其中所述对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息。
本发明实施例第三方面公开了一种增强现实模块的生成***,包括:增强现实AR移动客户端和第三方AR后台服务***,其中,
所述第三方AR后台服务***,配置为向AR开发者提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务;
所述AR移动客户端,配置为在运行包含了AR模块的AR应用的过程中与所述第三方AR后台服务***进行交互,并显示生成的AR效果;其中,所述AR模块为AR开发者根据预设的用于移动客户端AR模块开发的第三方软件开发接口信息及其对应配置的文档而生成的AR模块;其中所述第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与所述AR核心引擎关联的***参数和姿态信息传入到了所述AR渲染引擎中,所述对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息。
本发明实施例第四方面公开了一种计算机存储介质,所述计算机存储介质存储有程序,所述程序执行时包括本发明实施例第一方面中的增强现实模块的生成方法的全部步骤。
本发明实施例第五方面公开了一种第三方AR后台服务***,一个或多个后台服务器;
所述后台服务器包括:
通信接口,配置为与AR移动客户端进行信息交互;
处理器,与所述通信接口连接,配置为执行前述的增强现实模块的生成方法。
实施本发明实施例,通过提供预先统一封装有AR核心引擎和AR渲染引擎的软件开发接口信息,AR开发者可直接根据该软件开发接口信息进行移动客户端的AR模块开发,无需自行选取AR渲染引擎、无需关心AR内部的一些原理以及如何使用AR核心引擎输出的参数、如何加载AR渲染物等,实现了快速简单地开发移动客户端的AR应用,解决了现有技术中基于移动客户端的AR应用开发效率不高,不适合快速地在自身的应用当中开发一个AR模块,学习成本较高的技术问题,缩短了开发周期,简化了开发流程,从而大大减小了开发一个AR模块的难度。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是现有技术中提供的基于移动客户端的AR应用开发模块的架构框图;
图2是本发明实施例提供的增强现实模块的生成***的结构示意图;
图3是本发明实施例提供的第三方AR后台服务***的结构示意图;
图4是本发明实施例提供的增强现实模块的生成方法的流程示意图;
图5是本发明实施例提供的增强现实模块的生成装置的结构示意图;
图6是本发明提供的增强现实模块的生成装置的另一实施例的结构示意图;
图7是本发明提供的增强现实模块的生成装置的另一实施例的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,应当理解,以下所说明的优选实施例仅用于说明和解释本发明,并不用于限定本发明。
为了更好理解本发明实施例公开的一种增强现实模块的生成方法、增强现实模块的生成装置以及增强现实模块的生成***,下面先对本发明实施例提供的增强现实模块的生成***进行描述。请参阅图2,图2是本发明实施例提供的增强现实模块的生成***的结构示意图。如图2所示,该增强现实模块的生成***可以包括AR移动客户端和第三方AR后台服务系 统,其中:
该第三方AR后台服务***是针对AR开发者而言的,该第三方AR后台服务***可以向AR开发者提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务;该AR移动客户端可以为安装并运行有AR应用的移动终端,也就是说该AR应用包含了AR模块,该AR移动客户端在运行包含了AR模块的AR应用的过程中与该第三方AR后台服务***进行交互,从该第三方AR后台服务***获取到AR渲染效果的信息,最终显示生成的AR效果;需要说明的是,本发明各个实施例中的AR渲染物是指在屏幕现实中添加的虚拟物体,是对AR的核心,即对现实的增强;AR标志物是指AR中,期望出现AR效果的场景标志物,该标志物的位置决定了AR渲染物的位置;AR开发者或开发用户是指使用本AR应用的开发***进行移动端应用中AR模块开发的开发者。
可选地,该第三方AR后台服务***向AR开发者提供了一个多功能后台,可以满足使用中需要后台管理的需求,AR标志物、AR渲染物存储的服务,用于AR标志物识别的后台服务(包括图像识别、AR训练文件服务等),AR渲染物处理(格式转换管理、压缩、AR渲染物几何参数管理)服务,从而免去AR开发者后台维护的工作。本发明实施例的增强现实模块的生成***还可以包括AR管理平台,该AR管理平台可以包括:
AR标志物管理模块,配置为管理AR开发者上传的AR标志物图像信息;将所述AR标志物图像信息上传到所述第三方AR后台服务***;
AR渲染物管理模块,配置为管理AR开发者上传的与该AR标志物图像信息对应的AR渲染物模型文件;将所述AR渲染物模型文件上传到所述第三方AR后台服务***。这里的AR渲染物模型文件,可用于为AR渲染物提供原始渲染参数;该原始渲染参数可包括:预先定义了所述AR渲染物与AR标志物之间的相对位置关系等。
AR效果调整模块,配置为接收AR开发者输入的AR效果调整指令,通过预先配置好的3D渲染引擎实时模拟生成调整后的AR渲染效果;并将调整后的渲染参数信息上传到该第三方AR后台服务***进行保存管理。
这里的调整后的渲染参数信息,至少包括:调整后的AR渲染物与AR标志物之间的相对位置关系。
在一些实施例中,调整前的原始渲染参数或调整后的渲染参数,不局限于AR渲染物与AR标志物之间的相对位置关系,还可包括:渲染方式、渲染所需达到的渲染效果。这里渲染效果可包括:立体(3D)效果、灯影效果和/或阴影效果等。
可选地,本发明各个实施例中的AR管理平台可以为一个AR开放平台网站,该AR开放平台网站为一个提供给AR开发者管理自身AR标志物、AR渲染物以及进行AR效果调整的平台网站。AR开发者可以登录到该AR开放平台网站,并根据需求上传自身需要的AR标志物图像信息、与该AR标志物图像信息对应的AR渲染物模型文件等,并且可以通过调用该AR开放平台网站的3D模拟显示功能,查看模拟出的AR效果,该AR开放平台网站可以通过预先配置好的3D渲染引擎模拟生成AR渲染效果;该AR开发者还可以根据需求在该AR开放平台网站提供的调整3D模拟界面中调整AR效果,并实时在线模拟出AR开发者调整后的AR效果。因此,AR开发者只需要利用该AR管理平台做简单的上传、在线调整操作,便可以完成在移动客户端构建一个自己想要的AR模块,不需要AR开发者额外学习AR领域的相关知识,进一步减小了开发一个AR模块的难度。
需要说明的是,图2中上传的AR标志物以及AR渲染物的图像,仅仅是举例,不作为限定AR标志物图像信息和与该AR标志物图像信息对应的AR渲染物模型文件。
可理解的是,本发明各个实施例中的3D渲染引擎包括但不限于Three.js 的3D渲染引擎、或者更为底层的WebGL原生3D引擎,等等;本发明各个实施例中支撑该AR管理平台的后台***可以设置在第三方AR后台服务***中,也可以为一个独立的后台***。
可选地,如图3示出的本发明实施例提供的第三方AR后台服务***的结构示意图,第三方AR后台服务***30可以包括:AR标志物库300、AR渲染物库302、映射建立模块304、识别服务模块306、渲染模块308以及渲染信息发送模块3010,其中,
AR标志物库300用于保存接收到的AR标志物图像信息;
AR渲染物库302用于保存接收到的与所述AR标志物图像信息对应的AR渲染物模型文件;
映射建立模块304用于建立所述AR标志物图像信息与所述AR渲染物模型文件的映射关系;
识别服务模块306用于接收该AR移动客户端发送的请求AR标志物的访问识别服务,根据所述AR标志物库中保存的AR标志物图像信息对所述AR标志物进行图像识别,获得所述AR标志物的跟踪信息,并将所述跟踪信息发送给所述AR移动客户端;
渲染模块308用于根据所述映射关系,查找与所述AR标志物对应的AR渲染物模型文件并通过该AR管理平台进行AR渲染;
渲染信息发送模块3010用于将该AR管理平台生成的AR渲染效果的信息发送给该AR移动客户端。该AR移动客户端即可根据接收到的该AR渲染效果的信息向用户显示AR渲染效果。
可选地,针对AR的应用场景,在数据方面,该第三方AR后台服务***30主要预先配置了包括AR标志物库300和AR渲染物库302,该AR标志物库300包含了AR开发用户想要实现AR效果的图片库,该AR渲染物库302包含了AR开发用户想要在场景中呈现的AR渲染物,本发明实施 例以预先按照AR核心引擎SDK文档提供的访问原则设定好后台协议,AR开发者无需根据客户端协议自行开发,大大缩短看开发周期;而且本发明实施例的第三方AR后台服务***预先根据标志物识别模块的开发规范,建立好了识别服务模块306,AR开发者只需调用该识别服务模块306即可,因此本发明实施例中第三方AR后台服务***提供的后台服务对于AR开发者来说是透明的,省去了AR开发者在后台服务建立这发面的工作,进一步缩短了开发周期,简化了开发流程。
可选地,本发明实施例中的AR模块为AR开发者根据预设的用于移动客户端AR模块开发的第三方软件开发接口信息及其对应配置的文档而生成的AR模块;其中该第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与该AR核心引擎关联的***参数和姿态信息传入到了该AR渲染引擎中,该对应配置的文档包括该AR核心引擎和AR渲染引擎的接口使用信息。也就是说,基于所述接口使用信息,AR开发者可直接根据该软件开发接口信息进行移动客户端的AR模块开发,无需自行选取AR渲染引擎、无需关心AR内部的一些原理以及如何使用AR核心引擎输出的参数、如何加载AR渲染物等,实现了快速简单地开发移动客户端的AR应用。
所述接口使用信息包括:软件开发接口的使用指导信息,例如,可是AR开发者提供使用该接口的帮助信息。该软件开发接口可包括:封装有所述AR核心引擎和AR渲染引擎的SDK。
在本发明实施例中,所述AR核心引擎可为用于进行AR标志物的识别、跟踪,进而获得视频中每一帧图像的图像采集设备(例如,相机)的姿态信息。所述姿态信息可包括:指示所述图像采集设备相对于AR标志物对应的采集对象的相对位置的相对位置参数。所述相对位置参数,可用于向渲染引擎确定渲染物在图像中的绘制位置。例如,所述相对位置参数可为描 述了图像采集设备与AR标志物图像信息的位置,而所述AR渲染物通常需要根据AR标志物来确定绘制位置,若知道了图像采集设备与形成AR标志物对应的采集对象的相对位置参数,就能够根据该相对位置参数,将所述AR渲染物叠加在所述AR标志物之上或周围。
所述AR渲染引擎可为进行图像中渲染物的图像渲染的组件,所述图像渲染可包括:图像着色,通过着色使得图像呈现特定图像效果,例如,灯光效果、阴影效果、纹理效果或者3D立体效果或材质效果等。
所述***参数可包括:图像采集设备的硬件参数,例如,摄像头内的焦距、各种传感器的尺寸参数,一个棱镜组内多个棱镜间的间距、棱镜组的厚度及相机畸变参数等。***参数和相机的相对位置参数,共同会决定所述AR标志物在图像中的位置,故而决定了绘制决定于AR标志物的AR渲染物在图像中的位置。所述传感器可包括:感光传感器等。
下面结合图4示出的本发明实施例提供的增强现实模块的生成方法的流程示意图,说明如何AR开发者如何进行AR模块开发,生成AR模块,包括如下步骤:
步骤S400:获取预设的用于移动客户端增强现实AR模块开发的第三方软件开发接口信息;
可选地,该第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与该AR核心引擎关联的***参数和姿态信息传入到了该AR渲染引擎中;从而为AR开发者提供统一简单的接口使用,AR开发者不必要再关心如何挑选合适的渲染引擎,只需要根据开发文档要求,合入到自己应用(App)中即可。本发明实施例中的第三方软件开发接口信息包括但不限于第三方SDK,需要说明的是,在移动客户端封装方面,也可以针对不同水平的AR开发者,封装不同的移动客户端SDK接口,预留出一些复杂一点的接口给相对专业的AR用户,在不影响整体效果的同时,提高了 AR应用开发的灵活性。
步骤S402:根据所述第三方软件开发接口信息及其对应配置的文档,生成移动客户端的AR模块。
所述简单的接口可为:同时封装有AR核心引擎和AR渲染引擎的SDK,且关联了封装好的AR核心引擎和AR渲染引擎,可直接接入到App中使用。故所述简单的接口又可称直接应用接口。
所述复杂的接口可为:封装了一个或多个AR核心引擎和/或一个或多个与所述AR核心引擎未关联的AR渲染引擎的SDK。即封装在复杂的接口内的AR核心引擎与所述AR渲染引擎是未分离的和未关联的,而具体选择哪一个AR核心引擎及AR渲染引擎,并进行关联,是需要由AR开发者自行操作的。故在本实施例中复杂的接口,又可以称为待配置接口。在应用时,AR开发者需要根据自己的需求选择对应的AR核心引擎和AR渲染引擎,并关联选择的AR核心引擎及AR渲染引擎。在本实施例中,AR核心引擎和AR渲染引擎关联了,表示已经建立了AR核心引擎和AR渲染引擎之间的连接,后续应用时AR核心引擎会将***参数及姿态信息等导入到与其关联的AR渲染引擎中。
可选地,本发明实施例中的对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息;该生成的AR模块可以加入到已有的应用,即对该应用进行更新升级从而生成包含有该AR模块的AR应用,也可以直接根据该生成的AR模块生成一个新的AR应用。该AR应用在运行过程中与预设的第三方AR后台服务***进行交互,也就是说,安装了该AR应用的安装包并运行该AR应用的移动终端与预设的第三方AR后台服务***进行交互,以得到并显示实时的AR渲染效果。该第三方AR后台服务***提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务。
可选地,本发明实施例的增强现实模块的生成方法还可以包括:接收登录指令,并登录预设的AR管理平台;基于该AR管理平台向该第三方AR后台服务***上传AR标志物图像信息,和/或与该AR标志物图像信息对应的AR渲染物模型文件。
可选地,AR开发者可以在该预设的AR管理平台上进行账号注册,然后在电子终端上输入登陆指令,该登陆指令可以包括注册的账号以及登陆密码等信息,从而通过该注册的账号登陆到该AR管理平台,那么AR开发者可以根据需求通过电子终端在该AR管理平台上传自身需要的AR标志物图像信息、与该AR标志物图像信息对应的AR渲染物模型文件等,那么该AR管理平台可以将上传的信息发送给该第三方AR后台服务***,以作保存管理。
再可选地,本发明实施例的增强现实模块的生成方法还可以包括:接收登录指令,并登录预设的AR管理平台;接收基于该AR管理平台输入的AR效果调整指令;根据该AR效果调整指令,通过预先配置好的3D渲染引擎实时模拟生成调整后的AR渲染效果;并将调整后的渲染参数信息上传到该第三方AR后台服务***进行保存管理。
可选地,AR开发者通过注册的账号登陆到该AR管理平台后,可以在该AR开放平台网站提供的调整3D模拟界面中输入AR效果调整指令,实际上可以为电子终端接收到AR开发者基于该AR管理平台输入的AR效果调整指令后,将该AR效果调整指令传输给该AR管理平台,那么该AR管理平台根据该AR效果调整指令,通过预先配置好的3D渲染引擎实时模拟AR渲染效果,并将该效果信息返回给电子终端,该电子终端即可通过显示屏实时地显示调整后的AR渲染效果。另外,该AR管理平台将调整后的渲染参数信息上传到该第三方AR后台服务***进行保存管理。
因此,AR开发者只需要利用该AR管理平台做简单的上传、在线调整 操作,便可以完成在移动客户端构建一个自己想要的AR模块,不需要AR开发者额外学习AR领域的相关知识,进一步减小了开发一个AR模块的难度。
还需要说明的是,本发明实施例中的第三方软件开发接口信息可以统一封装有多组AR核心引擎及其对应的AR渲染引擎,每一组中的AR渲染引擎不同;
那么步骤S302中根据所述第三方软件开发接口信息进行移动客户端的AR模块开发,可以包括:从该多组AR核心引擎及其对应的AR渲染引擎中,选取一组AR核心引擎及其对应的AR渲染引擎;然后根据选取的AR核心引擎和AR渲染引擎,以及对应配置的文档,生成移动客户端的AR模块。因此,AR开发者也可以根据自身的需求来选择不同的预先配置好的AR渲染引擎,从而满足了不同AR开发者选择不同的AR渲染引擎的需求,进一步提高了AR应用开发的灵活性和便利性。
实施本发明实施例,通过提供预先统一封装有AR核心引擎和AR渲染引擎的软件开发接口信息,AR开发者可直接根据该软件开发接口信息进行移动客户端的AR模块开发,无需自行选取AR渲染引擎、无需关心AR内部的一些原理以及如何使用AR核心引擎输出的参数、如何加载AR渲染物等,实现了快速简单地开发移动客户端的AR应用,解决了现有技术中基于移动客户端的AR应用开发效率不高,不适合快速地在自身的应用当中开发一个AR模块,学***台做简单的上传、在线调整操作,便可以完成在移动客户端构建一个自己想要的AR模块,不需要 AR开发者额外学习AR领域的相关知识,进一步减小了开发一个AR模块的难度。
为了便于更好地实施本发明实施例的上述方案,本发明还对应提供了一种增强现实模块的生成装置,如图5示出的本发明实施例提供的增强现实模块的生成装置的结构示意图,增强现实模块的生成装置50可以包括:接口信息获取模块500和生成模块502,其中,
接口信息获取模块500配置为获取预设的用于移动客户端增强现实AR模块开发的第三方软件开发接口信息;所述第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与所述AR核心引擎关联的***参数和姿态信息传入到了所述AR渲染引擎中;
生成模块502配置为根据所述第三方软件开发接口信息及其对应配置的文档,生成移动客户端的AR模块;其中所述对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息。
可选地,该AR应用在运行过程中与预设的第三方AR后台服务***进行交互,所述第三方AR后台服务***提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务。
可选地,如图6示出的本发明提供的增强现实模块的生成装置的另一实施例的结构示意图,增强现实模块的生成装置50包括接口信息获取模块500和生成模块502外,还可以包括接收登陆模块504和上传模块506,其中,
接收登陆模块504配置为接收登录指令,并登录预设的AR管理平台;
上传模块506配置为基于所述AR管理平台向预设的第三方AR后台服务***上传AR标志物图像信息,以及与所述AR标志物图像信息对应的AR渲染物模型文件;其中所述第三方AR后台服务***提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务。
可选地,如图7示出的本发明提供的增强现实模块的生成装置的另一实施例的结构示意图,增强现实模块的生成装置50包括接口信息获取模块500、生成模块502、接收登陆模块504和上传模块506外,还可以包括指令接收模块508和显示上传模块5010,其中,
指令接收模块508配置为接收登陆模块504接收登录指令,并登录预设的AR管理平台之后,接收基于所述AR管理平台输入的AR效果调整指令;
显示上传模块5010配置为根据所述AR效果调整指令,通过预先配置好的3D渲染引擎实时模拟显示调整后的AR效果;并将调整后的渲染参数信息上传到所述第三方AR后台服务***进行保存管理。
所述渲染参数信息可包括:AR渲染物与AR标志物的相对位置参数。
可选地,该第三方软件开发接口信息可以统一封装有多组AR核心引擎及其对应的AR渲染引擎,每一组中的AR渲染引擎不同;
生成模块502,还配置为从所述多组AR核心引擎及其对应的AR渲染引擎中,选取一组AR核心引擎及其对应的AR渲染引擎;根据选取的AR核心引擎和AR渲染引擎,以及对应配置的文档,生成移动客户端的AR模块。这里配置的文档内还存储有:AR标志物的标识、AR标志物对应的AR渲染物的名称、预设的AR标识物和AR渲染物相对位置关系等信息。预设的AR标识物和AR渲染物相对位置关系等信息,用于指示AR渲染物与AR标志物在图像中的相对位置。
需要说明的是,本发明实施例中的增强现实模块的生成装置50可以包括但不限于个人计算机、平板电脑等可以进行应用程序开发的设备,增强现实模块的生成装置50的各功能模块的功能可根据上述方法实施例中的方法具体实现,其具体实现过程可以参照上述方法实施例的相关描述,此处不再赘述。
综上所述,实施本发明实施例,通过提供预先统一封装有AR核心引擎和AR渲染引擎的软件开发接口信息,AR开发者可直接根据该软件开发接口信息进行移动客户端的AR模块开发,无需自行选取AR渲染引擎、无需关心AR内部的一些原理以及如何使用AR核心引擎输出的参数、如何加载AR渲染物等,实现了快速简单地开发移动客户端的AR应用,解决了现有技术中基于移动客户端的AR应用开发效率不高,不适合快速地在自身的应用当中开发一个AR模块,学***台做简单的上传、在线调整操作,便可以完成在移动客户端构建一个自己想要的AR模块,不需要AR开发者额外学习AR领域的相关知识,进一步减小了开发一个AR模块的难度。
本发明实施例还提供一种第三方AR后台服务***,包括:一个或多个后台服务器。当所述第三方AR后台服务器包括多个后台服务器时,通常这些后台服务器相互连接形成计算机机群。
所述后台服务器可包括:
通信接口,配置为与AR移动客户端进行信息交互;
处理器,与所述通信接口连接,配置为执行前述一个或多个技术方案提供增强现实模块的生成方法。
所述通信接口可为互联网接口,可用于AR移动客户端进行信息交互,例如,获取前述的第三方软件开发接口信息及提供配置的文档等。所述通信接口可为有线接口,例如,光缆接口或电缆接口,所述第三方AR后台服务***,可以通过互联网与所述AR移动客户端建立连接。在一些实施例中, 所述通信接口也可为无线接口。
所述处理器可为各种类型的处理器,例如,中央处理器、微处理器、数字信号处理器、可编程阵列、应用处理器或专用集成电路等。
所述处理器可通过计算机程序等计算机可执行指令,从所述AR移动客户端获取第三方软件开发接口信息及向AR移动客户端提供配置的文档等,协助AR移动客户端进行AR模块的生成,以简化所述AR移动客户端的AR模块的形成。
所述处理器可与所述通信接口,通过集成电路总线等总线接口连接,以方便所述处理器控制所述通信接口与所述AR移动客户端的信息交互。
在本实施例中,所述AR移动客户端可包括:无线接口及处理器,该无线接口可用于所述AR移动客户端与所述第三方AR后台服务***连接,以进行信息交互。所述AR移动客户端内的处理器,同样可以通过AR移动客户端内的总线接口与所述无线接口连接,可用于基于第三AR后态服务器提供的配置的文档等,在AR移动客户端内生成AR模块。
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个***,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。
上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元,即可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的 部分或全部单元来实现本实施例方案的目的。
另外,在本发明各实施例中的各功能单元可以全部集成在一个处理模块中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
或者,本发明上述集成的单元如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例所述方法的全部或部分。而前述的存储介质包括:移动存储设备、ROM、磁碟或者光盘等各种可以存储程序代码的介质。
以上所揭露的仅为本发明较佳实施例而已,当然不能以此来限定本发明之权利范围,凡按照本发明原理所作的修改,都应当理解为落入本发明的保护范围。
工业实用性
本发明实施例中提供的技术方案,会在第三方软件开发接口信息同时 封装有AR核心引擎及AR渲染引擎,这样后续第三方软件在开发AR应用中的AR模式时,就不用自行开发与所述AR核心引擎相适配的AR渲染引擎,从而降低了第三方的开发难度,缩短了AR模块的开发周期,从而提升了AR模块的开发效率,具有积极的工业效果。且本发明实施例提供的技术方案,在提供AR模块开发的第三方软件开发接口信息时,直接将与提供的AR核心引擎和AR渲染引擎一起提供即可,具有实现简便,在工业上实现简单的特点。

Claims (15)

  1. 一种增强现实模块的生成方法,包括:
    获取预设的用于移动客户端增强现实AR模块开发的第三方软件开发接口信息;所述第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与所述AR核心引擎关联的***参数和姿态信息传入到了所述AR渲染引擎中;
    根据所述第三方软件开发接口信息及所述第三方软件开发接口信息对应配置的文档,生成移动客户端的AR模块;其中所述对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息。
  2. 如权利要求1所述的方法,其中,还包括:
    接收登录指令,并登录预设的AR管理平台;
    基于所述AR管理平台向预设的第三方AR后台服务***上传AR标志物图像信息,以及与所述AR标志物图像信息对应的AR渲染物模型文件;其中所述第三方AR后台服务***提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务。
  3. 如权利要求2所述的方法,其中,所述接收登录指令,并登录预设的AR管理平台之后,还包括:
    接收基于所述AR管理平台输入的AR效果调整指令;
    根据所述AR效果调整指令,通过预先配置好的3D渲染引擎实时模拟生成调整后的AR渲染效果;并将调整后的渲染参数信息上传到所述第三方AR后台服务***进行保存管理。
  4. 如权利要求1至3任一项所述的方法,其中,所述第三方软件开发接口信息统一封装有多组AR核心引擎及其对应的AR渲染引擎,每一组中的AR渲染引擎不同;
    所述根据所述第三方软件开发接口信息及所述第三方软件开发接口信 息对应配置的文档,生成移动客户端的AR模块,包括:
    从所述多组AR核心引擎及其对应的AR渲染引擎中,选取一组AR核心引擎及其对应的AR渲染引擎;
    根据选取的AR核心引擎和AR渲染引擎,以及对应配置的文档,生成移动客户端的AR模块。
  5. 一种增强现实模块的生成装置,包括:
    接口信息获取模块,配置为获取预设的用于移动客户端增强现实AR模块开发的第三方软件开发接口信息;所述第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中与所述AR核心引擎关联的***参数和姿态信息传入到了所述AR渲染引擎中;
    生成模块,配置为根据所述第三方软件开发接口信息及所述第三方软件开发接口信息对应配置的文档,生成移动客户端的AR模块;其中所述对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息。
  6. 如权利要求5所述的装置,其中,还包括:
    接收登陆模块,配置为接收登录指令,并登录预设的AR管理平台;
    上传模块,配置为基于所述AR管理平台向预设的第三方AR后台服务***上传AR标志物图像信息,以及与所述AR标志物图像信息对应的AR渲染物模型文件;其中所述第三方AR后台服务***提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务。
  7. 如权利要求6所述的装置,其中,还包括:
    指令接收模块,配置为在所述接收登陆模块接收登录指令,并登录预设的AR管理平台之后,接收基于所述AR管理平台输入的AR效果调整指令;
    显示上传模块,配置为根据所述AR效果调整指令,通过预先配置好的3D渲染引擎实时模拟生成调整后的AR渲染效果;并将调整后的渲染参数 信息上传到所述第三方AR后台服务***进行保存管理。
  8. 如权利要求5至7任一项所述的装置,其中,所述第三方软件开发接口信息统一封装有多组AR核心引擎及其对应的AR渲染引擎,每一组中的AR渲染引擎不同;
    所述生成模块,配置为从所述多组AR核心引擎及其对应的AR渲染引擎中,选取一组AR核心引擎及其对应的AR渲染引擎;根据选取的AR核心引擎和AR渲染引擎,以及对应配置的文档,生成移动客户端的AR模块。
  9. 一种增强现实模块的生成***,包括:增强现实AR移动客户端和第三方AR后台服务***,其中,
    所述第三方AR后台服务***,配置为向AR开发者提供包括AR标志物管理、AR渲染物管理以及AR标志物识别的后台管理服务;
    所述AR移动客户端,配置为在运行包含了AR模块的AR应用的过程中与所述第三方AR后台服务***进行交互,并显示生成的AR效果;其中,所述AR模块为AR开发者根据预设的用于移动客户端AR模块开发的第三方软件开发接口信息及其对应配置的文档而生成的AR模块;其中,所述第三方软件开发接口信息统一封装有AR核心引擎和AR渲染引擎,其中,与所述AR核心引擎关联的***参数和姿态信息传入到了所述AR渲染引擎中,所述对应配置的文档包括所述AR核心引擎和AR渲染引擎的接口使用信息。
  10. 如权利要求9所述的***,其中,还包括AR管理平台,所述AR管理平台包括:
    AR标志物管理模块,配置为管理AR开发者上传的AR标志物图像信息;将所述AR标志物图像信息上传到所述第三方AR后台服务***;
    AR渲染物管理模块,配置为管理AR开发者上传的与所述AR标志物图像信息对应的AR渲染物模型文件;将所述AR渲染物模型文件上传到所 述第三方AR后台服务***。
  11. 如权利要求10所述的***,其中,所述AR管理平台还包括:
    AR效果调整模块,配置为接收AR开发者输入的AR效果调整指令,通过预先配置好的3D渲染引擎实时模拟生成调整后的AR渲染效果;并将调整后的渲染参数信息上传到所述第三方AR后台服务***进行保存管理。
  12. 如权利要求11所述的***,其中,所述第三方AR后台服务***包括:
    AR标志物库,配置为保存接收到的AR标志物图像信息;
    AR渲染物库,配置为保存接收到的与所述AR标志物图像信息对应的AR渲染物模型文件;
    映射建立模块,配置为建立所述AR标志物图像信息与所述AR渲染物模型文件的映射关系。
  13. 如权利要求12所述的***,其中,所述第三方AR后台服务***还包括:
    识别服务模块,配置为接收所述AR移动客户端发送的请求AR标志物的访问识别服务,根据所述AR标志物库中保存的AR标志物图像信息对所述AR标志物进行图像识别,获得所述AR标志物的跟踪信息,并将所述跟踪信息发送给所述AR移动客户端;
    渲染模块,配置为根据所述映射关系,查找与所述AR标志物对应的AR渲染物模型文件,并通过所述AR管理平台进行AR渲染;
    渲染信息发送模块,配置为将所述AR管理平台生成的AR渲染效果的信息发送给所述AR移动客户端。
  14. 一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令用于执行权利要求1至4任一项所述的方法。
  15. 一种第三方增强现实AR后台服务***,包括:一个或多个后台服务器;
    所述后台服务器包括:
    通信接口,配置为与AR移动客户端进行信息交互;
    处理器,与所述通信接口连接,配置为执行权利要求1至4任一项提供的增强现实模块的生成方法。
PCT/CN2017/092670 2016-07-18 2017-07-12 增强现实模块的生成方法及装置、生成***和存储介质 WO2018014766A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/202,196 US10732968B2 (en) 2016-07-18 2018-11-28 Method, apparatus and system for generating augmented reality module and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610570848.7 2016-07-18
CN201610570848.7A CN107632824B (zh) 2016-07-18 2016-07-18 一种增强现实模块的生成方法、生成装置以及生成***

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/202,196 Continuation US10732968B2 (en) 2016-07-18 2018-11-28 Method, apparatus and system for generating augmented reality module and storage medium

Publications (1)

Publication Number Publication Date
WO2018014766A1 true WO2018014766A1 (zh) 2018-01-25

Family

ID=60992952

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/092670 WO2018014766A1 (zh) 2016-07-18 2017-07-12 增强现实模块的生成方法及装置、生成***和存储介质

Country Status (3)

Country Link
US (1) US10732968B2 (zh)
CN (1) CN107632824B (zh)
WO (1) WO2018014766A1 (zh)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109240681A (zh) * 2018-09-26 2019-01-18 郑州云海信息技术有限公司 一种模型生成方法、装置及计算机可读存储介质
CN109814848A (zh) * 2019-02-21 2019-05-28 广州卓远虚拟现实科技有限公司 一种虚拟现实通用动感引擎
US20210201543A1 (en) * 2019-06-06 2021-07-01 Shmuel Ur Innovation Ltd. Augmented Reality Systems
US11017602B2 (en) * 2019-07-16 2021-05-25 Robert E. McKeever Systems and methods for universal augmented reality architecture and development
CN110704058A (zh) * 2019-10-14 2020-01-17 北京代码乾坤科技有限公司 页面渲染方法、装置、存储介质、处理器及电子装置
CN112363696B (zh) * 2020-11-11 2023-12-22 中车工业研究院有限公司 增强现实快速开发***及方法、电子设备及可读存储介质
CN112612456A (zh) * 2020-12-25 2021-04-06 深圳市引力创新科技有限公司 一种多程序***性管理框架及管理方法
US11521358B2 (en) 2021-01-07 2022-12-06 Google Llc Computing platform for facilitating augmented reality experiences with third party assets
CN115409680A (zh) * 2021-05-29 2022-11-29 华为云计算技术有限公司 渲染方法、设备以及***
CN113625997B (zh) * 2021-07-20 2024-03-12 青岛小鸟看看科技有限公司 一种xr软件开发架构、应用方法和电子设备
CN114581575A (zh) * 2021-12-13 2022-06-03 北京市建筑设计研究院有限公司 一种模型渲染处理方法、装置及电子设备
CN114821001B (zh) * 2022-04-12 2024-04-19 支付宝(杭州)信息技术有限公司 基于ar的互动方法、装置及电子设备
US11989840B2 (en) 2022-05-10 2024-05-21 Lemon Inc. Augmented reality effects on blockchain
CN117635791B (zh) * 2023-11-16 2024-05-31 重庆市祥和大宇包装有限公司 3d模型的呈现方法及***、存储介质、电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102843349A (zh) * 2011-06-24 2012-12-26 中兴通讯股份有限公司 实现移动增强现实业务的方法及***、终端及服务器
CN105183477A (zh) * 2015-09-10 2015-12-23 上海踏风网络科技有限公司 应用程序虚拟道具信息获取***及获取方法
CN105338117A (zh) * 2015-11-27 2016-02-17 亮风台(上海)信息科技有限公司 用于生成ar应用和呈现ar实例的方法、设备与***

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102739872A (zh) * 2012-07-13 2012-10-17 苏州梦想人软件科技有限公司 移动终端及应用于移动终端的增强现实方法
US10318100B2 (en) * 2013-10-16 2019-06-11 Atheer, Inc. Method and apparatus for addressing obstruction in an interface
WO2015191346A1 (en) * 2014-06-09 2015-12-17 Huntington Ingalls Incorporated System and method for augmented reality display of electrical system information
WO2016011149A1 (en) * 2014-07-16 2016-01-21 Huntington Ingalls Incorporated System and method for augmented reality display of hoisting and rigging information
CN106663411A (zh) * 2014-11-16 2017-05-10 易欧耐特感知公司 用于增强现实准备、处理和应用的***和方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102843349A (zh) * 2011-06-24 2012-12-26 中兴通讯股份有限公司 实现移动增强现实业务的方法及***、终端及服务器
CN105183477A (zh) * 2015-09-10 2015-12-23 上海踏风网络科技有限公司 应用程序虚拟道具信息获取***及获取方法
CN105338117A (zh) * 2015-11-27 2016-02-17 亮风台(上海)信息科技有限公司 用于生成ar应用和呈现ar实例的方法、设备与***

Also Published As

Publication number Publication date
CN107632824A (zh) 2018-01-26
CN107632824B (zh) 2019-01-01
US10732968B2 (en) 2020-08-04
US20190129715A1 (en) 2019-05-02

Similar Documents

Publication Publication Date Title
WO2018014766A1 (zh) 增强现实模块的生成方法及装置、生成***和存储介质
WO2018219120A1 (zh) 图像显示方法、图像处理方法、装置、终端及服务器
US9367950B1 (en) Providing virtual reality experiences based on three-dimensional designs produced using three-dimensional design software
US10679426B2 (en) Method and apparatus for processing display data
CN106846497B (zh) 应用于终端的呈现三维地图的方法和装置
JP2021010156A (ja) 情報を生成する方法および装置
WO2023179346A1 (zh) 特效图像处理方法、装置、电子设备及存储介质
WO2019114328A1 (zh) 一种基于增强现实的视频处理方法及其装置
JP6861287B2 (ja) 映像のための効果共有方法およびシステム
US11985135B2 (en) Stated age filter
WO2023207379A1 (zh) 图像处理方法、装置、设备及存储介质
JP2023522266A (ja) マルチメディアデータ配信の方法、装置、デバイス及び媒体
CN113965773A (zh) 直播展示方法和装置、存储介质及电子设备
JP2024513005A (ja) イマーシブテクノロジーズメディアフォーマット(itmf)仕様のマッピングアーキテクチャのための方法、装置、及びコンピュータプログラム
CN113989442B (zh) 建筑信息模型构建方法及相关装置
CN111258690A (zh) 一种构建3d页面的方法和装置
CN108513090B (zh) 群组视频会话的方法及装置
WO2024016828A2 (zh) 一种基于虚拟相机的图像采集方法和相关装置
CN113436320B (zh) 基于ifc模型文件的3d模型生成***及方法
WO2022151687A1 (zh) 合影图像生成方法、装置、设备、存储介质、计算机程序及产品
CN111176451B (zh) 一种虚拟现实多通道沉浸式环境的控制方法及***
CN111240615B (zh) 一种vr沉浸式大屏追踪环境的参数配置方法及***
CN112614049A (zh) 图像处理方法、装置、存储介质以及终端
KR102464437B1 (ko) 기가 픽셀 미디어 객체 감상 및 거래를 제공하는 메타버스 기반 크로스 플랫폼 서비스 시스템
CN116091738B (zh) 一种虚拟ar生成方法、***、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17830400

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17830400

Country of ref document: EP

Kind code of ref document: A1