CN114219923A - AR, VR and MR fusion method and system applied to vestige reproduction - Google Patents

AR, VR and MR fusion method and system applied to vestige reproduction Download PDF

Info

Publication number
CN114219923A
CN114219923A CN202111531070.6A CN202111531070A CN114219923A CN 114219923 A CN114219923 A CN 114219923A CN 202111531070 A CN202111531070 A CN 202111531070A CN 114219923 A CN114219923 A CN 114219923A
Authority
CN
China
Prior art keywords
building
scene
historical
vestige
buildings
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111531070.6A
Other languages
Chinese (zh)
Other versions
CN114219923B (en
Inventor
汪波
周岩
王锐
何姝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kaitaiming Technology And Culture Development Co ltd
Original Assignee
Beijing Kaitaiming Technology And Culture Development Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Kaitaiming Technology And Culture Development Co ltd filed Critical Beijing Kaitaiming Technology And Culture Development Co ltd
Priority to CN202111531070.6A priority Critical patent/CN114219923B/en
Publication of CN114219923A publication Critical patent/CN114219923A/en
Application granted granted Critical
Publication of CN114219923B publication Critical patent/CN114219923B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/25Fusion techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/04Architectural design, interior design

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention provides a method and a system for fusing AR, VR and MR, which are applied to vestige reproduction. Scanning all vestiges and historical buildings in the scenic spot, and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot; calling historical data related to the historical relics and the historical buildings in a database, and acquiring historical original image information corresponding to the current relics and the historical buildings; combining historical original image information, actual images and video information, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to a data storage device; when a user wears the virtual realization equipment to watch ancient historic buildings, VR, AR and MR scene images are switched according to the position of the user and the trails and building information presented in the virtual realization equipment worn by the user. The system comprises modules corresponding to the method steps.

Description

AR, VR and MR fusion method and system applied to vestige reproduction
Technical Field
The invention provides a method and a system for fusing AR, VR and MR, which are applied to vestige reproduction, and belongs to the technical field of virtual implementation.
Background
Along with the improvement of living standard of people, more and more people utilize the vacation to go out and visit ancient historical relic or historical building, often because historical relic exists the incomplete or incomplete and leads to can't watching historical relic original appearance, makes the visitor can't really realize the true original appearance of ancient historical relic.
Disclosure of Invention
The invention provides a method and a system for fusing AR, VR and MR, which are applied to the reproduction of a historical relic, and are used for solving the problem that the conventional historical relic and ancient buildings cannot restore and show the original appearance of the ancient historical buildings, and the adopted technical scheme is as follows:
a method of AR and VR, MR fusion for use in genetic reconstruction, the method comprising:
scanning all vestiges and historical buildings in the scenic spot to obtain current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
calling file data such as historical data related to the historical relics and the historical buildings in a database, and acquiring historical original image information corresponding to the current relics and the historical buildings through the historical data;
building grade division is carried out according to building completion degree, AR, VR and MR scene images are respectively formed by combining historical original appearance image information and actual image and video information of the vestige and the historical building in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device;
when a user wears the virtual realization equipment to watch ancient historic buildings, VR, AR and MR scene images are switched according to the position of the user and the trails and building information presented in the virtual realization equipment worn by the user.
Further, combining the historical original image information of the vestige and the historical buildings, the actual image and the video information, and respectively forming AR, VR and MR scene images in an image fusion mode, wherein the method comprises the following steps:
judging the completion degree of the vestige and the historical buildings through actual images and video information, and classifying the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
aiming at the trails and buildings of a first-level integrity building, establishing a virtual scene corresponding to a historical original image through the trails and the historical original image information of the historical building, establishing a real scene corresponding to the trails and the building by utilizing the actual image and video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
aiming at the trails and buildings of the second-level integrity buildings, establishing a virtual scene corresponding to the historical primitive appearance images through the trails and the historical primitive appearance image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building.
Aiming at the trails and buildings of the buildings with three-level integrity, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
Further, the historic site and the historical buildings are graded as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
Further, when the user wears the virtual realization device to watch the historic legacy historic building, VR, AR and MR scene image switching is carried out according to the position of the user and the vestige and building information presented in the virtual realization device worn by the user, including:
when a user wears virtual implementation equipment to watch historic buildings of ancient heritage, judging the current heritage and scene images corresponding to the buildings according to the heritage and the building information corresponding to the position where the user is located;
when the vestige and the building watched by the user wearing the virtual realization equipment are the first-level integrity building, the virtual realization equipment automatically calls the MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reproduction;
when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building, the virtual realization equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site;
when the vestige and the building watched by the user wearing the virtual realization equipment are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction.
Further, the performing VR, AR and MR scene image switching further includes:
before switching the MR scene image, the AR scene image and the VR scene image, prejudging the next watching scene of the user through the motion trail of the user, comprising the following steps:
monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to be used as a building of a prepared imaging scheme;
calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
when the user reaches the building position corresponding to the building of the preliminary imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
A system for AR and VR, MR fusion for use in genetic reconstruction, the system comprising:
the information acquisition module is used for scanning all the vestiges and historical buildings in the scenic spot and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
the original appearance information acquisition module is used for calling file data such as historical data related to the historical relics and the historical buildings in a database and acquiring historical original appearance image information corresponding to the current relics and the historical buildings through the historical data;
the fusion imaging module is used for carrying out building grade division according to the building completion degree, combining historical original appearance image information, actual images and video information of the trails and the historical buildings, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to the data storage device;
and the scene switching module is used for switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building.
Further, the fusion imaging module includes:
the level classification module is used for judging the completion degree of the vestige and the historical buildings according to the actual image and video information and performing level classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the level classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
the MR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the historic building and the historical original appearance image information of the historic building aiming at the vestige and the building of the primary integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the AR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the trails and the historical buildings, establishing a real scene corresponding to the trails and the buildings through the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building.
The VR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the building with three-level integrity, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
Further, the historic site and the historical buildings are graded as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
Further, the scene switching module includes:
the judging module is used for judging a current vestige and a scene image corresponding to a building according to the vestige and the building information corresponding to the position of the user when the user wears the virtual realization equipment to watch the historic relic;
the MR scene display module is used for automatically calling an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual implementation equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual implementation equipment are the first-level integrity building;
the AR scene display module is used for automatically calling the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual realization equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building;
and the VR scene display module is used for automatically calling the VR scene images corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction when the vestige and the building watched by the virtual realization equipment worn by the user are the three-level integrity building.
Further, the scene switching module further includes:
the pre-judging switching module is used for pre-judging the next watching scene of the user through the motion trail of the user before the MR scene image, the AR scene image and the VR scene image are switched, and comprises the following steps:
the track monitoring module is used for monitoring the motion track of the user in real time, and acquiring three trails and buildings which are closest to the motion track direction of the user according to the motion track direction of the user to serve as the building of the prepared imaging scheme;
the calling module is used for calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and the switching module is used for directly calling the vestige and the building scene image from the cache area for scene switching when the user reaches the building position corresponding to the building with the preparation imaging scheme.
The invention has the beneficial effects that:
the method and the system for fusing the AR, the VR and the MR, which are applied to the vestige reproduction, can visually reproduce the vestige with different integrity degrees in a mode of combining the AR, the VR and the MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode. Meanwhile, the method and the system for fusing AR, VR and MR, which are applied to the vestige reproduction, can realize the rapid switching of the three imaging modes of AR, VR and MR, can effectively reduce the change delay of the switching image quality in the imaging switching process of different scenes, and effectively improve the scene switching efficiency, flexibility and visual experience.
Drawings
FIG. 1 is a first flow chart of the method of the present invention;
FIG. 2 is a second flow chart of the method of the present invention;
fig. 3 is a system block diagram of the system of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The embodiment of the invention provides a method for fusing AR, VR and MR, which is applied to the reproduction of a genetic trail, and as shown in FIG. 1, the method comprises the following steps:
s1, scanning all trails and historical buildings in the scenic spot, and acquiring current actual images and video information of all trails and historical buildings in the scenic spot;
s2, retrieving file data such as historical data related to the historical relics and the historical buildings in the database, and acquiring historical original appearance image information corresponding to the current relics and the historical buildings through the historical data;
s3, building grade division is carried out according to building completion degrees, AR, VR and MR scene images are respectively formed by combining historical original appearance image information and actual image and video information of the vestige and the historical building in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device;
and S4, when the user wears the virtual realization equipment to watch the ancient historic building, switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual realization equipment worn by the user.
The working principle of the technical scheme is as follows: firstly, scanning all vestiges and historical buildings in a scenic spot, and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot; then, calling file data such as historical data related to the historical relics and the historical buildings in a database, and acquiring historical original image information corresponding to the current relics and the historical buildings through the historical data; then, building grade division is carried out according to building completion degree, AR, VR and MR scene images are respectively formed by combining historical original image information, actual images and video information of the vestige and the historical buildings in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device; and finally, when the user wears the virtual realization equipment to watch the ancient historic building, switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual realization equipment worn by the user.
The effect of the above technical scheme is as follows: the method for fusing AR, VR and MR for genetic reconstruction provided by this embodiment can visually reconstruct the genetic with different degrees of completeness by combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode. Meanwhile, the method for fusing the AR, the VR and the MR, which is applied to the vestige reproduction, can realize the rapid switching of the AR, the VR and the MR imaging modes, can effectively reduce the switching image quality change delay in the imaging switching process of different types of scenes, and effectively improve the scene switching efficiency, flexibility and visual experience.
In an embodiment of the present invention, the historical original image information of the historic site and the historical building, the actual image and the video information are combined to form AR, VR and MR scene images respectively in an image fusion manner, including:
s301, judging the completion degree of the vestige and the historical buildings through actual images and video information, and carrying out grade classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the grade classification comprises a first-grade integrity building, a second-grade integrity building and a third-grade integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
s302, aiming at the vestige and the building of a first-level integrity building, establishing a virtual scene corresponding to a historical original image through the vestige and historical original image information of the historical building, establishing a real scene corresponding to the vestige and the building by utilizing actual images and video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
s303, aiming at the trails and buildings of the second-level integrity building, establishing a virtual scene corresponding to the historical primitive image through the trails and the historical primitive image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building.
S304, aiming at the trails and buildings of the three-level integrity building, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical building, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
Wherein, the grade of the historical architecture and the historical architecture is divided as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
The working principle of the technical scheme is as follows: firstly, judging the completion degree of the vestige and the historical buildings through actual images and video information, and classifying the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building; then, aiming at the trails and buildings of the first-level integrity buildings, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building; then, aiming at the trails and buildings of the buildings with the second-level integrity, establishing a virtual scene corresponding to the historical primitive appearance image through the trails and the historical primitive appearance image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building. Finally, aiming at the trails and buildings of the buildings with three-level integrity, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
The effect of the above technical scheme is as follows: by means of the method, the integrity degree of the historic site and the ancient building can be highly matched with the scene presenting mode, and authenticity and visual experience of each scene imaging mode are improved. Meanwhile, the building is graded according to the integrity ratio, the degree of cooperation between the building and each type of imaging mode can be effectively improved, and the authenticity of each scene imaging mode is improved. The problem that reality is reduced due to the fact that a virtual scene and a real scene cannot be completely fused due to the fact that the building integrity degree is not high is solved. Meanwhile, the building grade division is carried out according to the proportion, so that the buildings can be greatly divided into high-grade scene image presenting modes such as AR and MR, the number and the range of buildings reproduced by utilizing AR and MR traces are improved as much as possible on the premise that high fusion and high reality of a virtual scene and a real scene are ensured, and the visual experience of the trace reproduction is improved.
In an embodiment of the present invention, when a user wears a virtual implementation device to watch an ancient historic building, switching VR, AR and MR scene images according to a location of the user and the historic site and building information presented in the virtual implementation device worn by the user includes:
s401, when a user wears virtual implementation equipment to watch historic buildings, judging the current vestige and the scene image corresponding to the buildings according to the vestige and the building information corresponding to the position where the user is located;
s402, when the vestige and the building watched by a user wearing the virtual implementation equipment are a first-level integrity building, the virtual implementation equipment automatically calls an MR scene image corresponding to the vestige and the building of the first-level integrity building in a data storage device to reproduce the historic site;
s403, when the vestige watched by the user wearing the virtual implementation equipment and the building are a second-level integrity building, the virtual implementation equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site;
s404, when the vestige watched by the user wearing the virtual realization equipment and the building are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the vestige and the building of the three-level integrity building in the data storage device to reproduce the historic site.
The working principle of the technical scheme is as follows: firstly, when a user wears virtual implementation equipment to watch historic buildings of ancient heritage, judging a scene image corresponding to a current heritage and a building according to the heritage and the building information corresponding to the position of the user; then, when the vestige and the building watched by the user wearing the virtual realization equipment are a first-level integrity building, the virtual realization equipment automatically calls the MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site; then, when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building, the virtual realization equipment automatically calls the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site; and finally, when the trails watched by the user wearing the virtual implementation equipment and the buildings are the buildings with three levels of integrity, the virtual implementation equipment automatically calls VR scene images corresponding to the trails and the buildings with three levels of integrity in the data storage device to reproduce the trails.
The effect of the above technical scheme is as follows: the method can be used for visually reproducing the vestige with different integrity degrees in a mode of combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode.
In an embodiment of the present invention, the performing VR, AR and MR scene image switching further includes:
before switching the MR scene image, the AR scene image and the VR scene image, prejudging the next watching scene of the user through the motion trail of the user, comprising the following steps:
step 1, monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to serve as a building of a prepared imaging scheme;
step 2, calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and 3, when the user reaches the building position corresponding to the building with the preparation imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
Meanwhile, the running track of the tourist is changed in real time, so that the cache scene in the cache region is also changed continuously, and in order to ensure that the cache region can not only have enough space for temporarily storing the scene images, but also ensure that the scene images stored in the maximum cache region can contain landscape buildings near the tourist, the reserved time of each scene in the cache region is set as follows:
Figure BDA0003410768060000091
wherein, T represents the length of the cache storage time of each of the three preliminary imaging scheme buildings in the cache area when the tourist runs to one position; d represents the path distance between the tourist and the corresponding sight spot building when the three preliminary imaging scheme buildings are stored; d1Representing the real-time distances between the tourist and buildings corresponding to the stored buildings of the three prepared imaging schemes in the running process of the tourist; when (D-D)1)/(D+D0)<1/3, indicating that the visitor is moving away from the corresponding building, then the preliminary imaging scheme building whose distance from the visitor meets the condition is deleted in the buffer area. T is0Represents a storage time reference, wherein T0Is in the range of 15 to 20 minutes, andt is with D1Is changed; d0Indicating a base standard extension distance for properly extending the buffer time of the preliminary imaging plan building, D0The value range of (A) is 5 m-10 m, preferably 7 m. Meanwhile, the basic standard is prolonged by the distance, the set up method can guarantee that the cache time of the preliminary imaging scheme building is sufficient, the deleting efficiency can not be influenced, and the problem that the cache space is excessively occupied due to the fact that the cache time of the preliminary imaging scheme building is too long is solved.
The working principle of the technical scheme is as follows: firstly, monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to serve as a building of a prepared imaging scheme; then, calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme; and finally, when the user reaches the building position corresponding to the building with the preliminary imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
The effect of the above technical scheme is as follows: by the method, the vestige building which is probably visited next by the user can be judged in advance according to the action track of the user, the three vestige buildings which are probably visited by the user on the path in advance are determined through the track path of the user, the vestige and the scene corresponding to the buildings are called from the data storage device in advance, and data parameter preparation is carried out on the next switching scene of the virtual implementation equipment in advance according to the type of the scene, so that the scene switching efficiency and speed can be effectively improved, the switching image quality change delay in the imaging switching process of different kinds of scenes can be effectively reduced, and the scene switching flexibility and the visual experience are effectively improved.
An embodiment of the present invention provides a system for fusing AR, VR, and MR for genetic reconstruction, as shown in fig. 3, the system includes:
the information acquisition module is used for scanning all the vestiges and historical buildings in the scenic spot and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
the original appearance information acquisition module is used for calling file data such as historical data related to the historical relics and the historical buildings in a database and acquiring historical original appearance image information corresponding to the current relics and the historical buildings through the historical data;
the fusion imaging module is used for carrying out building grade division according to the building completion degree, combining historical original appearance image information, actual images and video information of the trails and the historical buildings, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to the data storage device;
and the scene switching module is used for switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building.
The working principle of the technical scheme is as follows: firstly, scanning all vestiges and historical buildings in a scenic spot through an information acquisition module to acquire current actual images and video information of all the vestiges and the historical buildings in the scenic spot; then, using original appearance information acquisition module to call file data such as historical data related to the historic site and the historic building in the database, and acquiring historic original appearance image information corresponding to the current historic site and the historic building through the historical data; then, building grade division is carried out according to building completion degrees by using a fusion imaging module, AR, VR and MR scene images are respectively formed by combining historical original appearance image information, actual images and video information of the trails and the historical buildings in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device; and finally, switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building through the scene switching module.
The effect of the above technical scheme is as follows: the method for fusing AR, VR and MR for genetic reconstruction provided by this embodiment can visually reconstruct the genetic with different degrees of completeness by combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode. Meanwhile, the method for fusing the AR, the VR and the MR, which is applied to the vestige reproduction, can realize the rapid switching of the AR, the VR and the MR imaging modes, can effectively reduce the switching image quality change delay in the imaging switching process of different types of scenes, and effectively improve the scene switching efficiency, flexibility and visual experience.
In one embodiment of the present invention, the fusion imaging module comprises:
the level classification module is used for judging the completion degree of the vestige and the historical buildings according to the actual image and video information and performing level classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the level classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
the MR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the historic building and the historical original appearance image information of the historic building aiming at the vestige and the building of the primary integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the AR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the trails and the historical buildings, establishing a real scene corresponding to the trails and the buildings through the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building.
The VR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the building with three-level integrity, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
Wherein, the grade of the historical architecture and the historical architecture is divided as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
The working principle of the technical scheme is as follows: firstly, judging the completion degree of the vestige and the historical buildings by adopting a grade division module through actual images and video information, and carrying out grade classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the grade classification comprises a first-grade integrity building, a second-grade integrity building and a third-grade integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building; then, aiming at the trails and buildings of the first-level integrity building through an MR scene module, establishing a virtual scene corresponding to the historical primitive image through the trails and the historical primitive image information of the historical building, establishing a real scene corresponding to the trails and the building by utilizing the actual image and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building; then, aiming at the trails and buildings of the buildings with the second-level integrity degree through an AR scene module, establishing a virtual scene corresponding to the historical primitive image through the trails and the historical primitive image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings through the actual image and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building. Finally, aiming at the trails and buildings of the buildings with three-level integrity, a VR scene module is adopted to establish a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, and the virtual scene is utilized to form a VR scene image; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
The effect of the above technical scheme is as follows: by means of the method, the integrity degree of the historic site and the ancient building can be highly matched with the scene presenting mode, and authenticity and visual experience of each scene imaging mode are improved. Meanwhile, the building is graded according to the integrity ratio, the degree of cooperation between the building and each type of imaging mode can be effectively improved, and the authenticity of each scene imaging mode is improved. The problem that reality is reduced due to the fact that a virtual scene and a real scene cannot be completely fused due to the fact that the building integrity degree is not high is solved. Meanwhile, the building grade division is carried out according to the proportion, so that the buildings can be greatly divided into high-grade scene image presenting modes such as AR and MR, the number and the range of buildings reproduced by utilizing AR and MR traces are improved as much as possible on the premise that high fusion and high reality of a virtual scene and a real scene are ensured, and the visual experience of the trace reproduction is improved.
In an embodiment of the present invention, the scene switching module includes:
the judging module is used for judging a current vestige and a scene image corresponding to a building according to the vestige and the building information corresponding to the position of the user when the user wears the virtual realization equipment to watch the historic relic;
the MR scene display module is used for automatically calling an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual implementation equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual implementation equipment are the first-level integrity building;
the AR scene display module is used for automatically calling the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual realization equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building;
and the VR scene display module is used for automatically calling the VR scene images corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction when the vestige and the building watched by the virtual realization equipment worn by the user are the three-level integrity building.
The working principle of the technical scheme is as follows: firstly, when a user wears virtual implementation equipment to watch an ancient historic building, a judgment module judges a scene image corresponding to a current trail and a building according to the trail and the building information corresponding to the position of the user; then, when the vestige and the building which are watched by a user wearing the virtual implementation equipment are a first-level integrity building, the virtual implementation equipment automatically calls an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reproduction by utilizing an MR scene display module; then, when the vestige watched by the user wearing the virtual realization equipment and the building are a second-level integrity building, the virtual realization equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reproduction through the AR scene display module; and finally, when the trails watched by the user wearing the virtual realization equipment and the building are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the trails of the three-level integrity building and the building in the data storage device for historic site reproduction by adopting the VR scene display module.
The effect of the above technical scheme is as follows: the method can be used for visually reproducing the vestige with different integrity degrees in a mode of combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode.
In an embodiment of the present invention, the scene switching module further includes:
the pre-judging switching module is used for pre-judging the next watching scene of the user through the motion trail of the user before the MR scene image, the AR scene image and the VR scene image are switched, and comprises the following steps:
the track monitoring module is used for monitoring the motion track of the user in real time, and acquiring three trails and buildings which are closest to the motion track direction of the user according to the motion track direction of the user to serve as the building of the prepared imaging scheme;
the calling module is used for calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and the switching module is used for directly calling the vestige and the building scene image from the cache area for scene switching when the user reaches the building position corresponding to the building with the preparation imaging scheme.
The working principle of the technical scheme is as follows: during the switching operation of each scene display module, a prejudgment switching module prejudges the next watching scene of a user through the motion track of the user before switching an MR scene image, an AR scene image and a VR scene image, and the operation process of the prejudgment switching module comprises the following steps:
monitoring the motion trail of a user in real time through a trail monitoring module, and acquiring three trails and buildings which are closest to each other in the motion trail direction of the user according to the motion trail direction of the user to serve as a building of a prepared imaging scheme; then, calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device through a calling module, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme; and then, directly calling the vestige and the building scene image from the cache area for scene switching by adopting a switching module when the user reaches the building position corresponding to the building with the preparation imaging scheme.
The effect of the above technical scheme is as follows: by the method, the vestige building which is probably visited next by the user can be judged in advance according to the action track of the user, the three vestige buildings which are probably visited by the user on the path in advance are determined through the track path of the user, the vestige and the scene corresponding to the buildings are called from the data storage device in advance, and data parameter preparation is carried out on the next switching scene of the virtual implementation equipment in advance according to the type of the scene, so that the scene switching efficiency and speed can be effectively improved, the switching image quality change delay in the imaging switching process of different kinds of scenes can be effectively reduced, and the scene switching flexibility and the visual experience are effectively improved.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. A method for AR and VR, MR fusion for use in genetic reconstruction, the method comprising:
scanning all vestiges and historical buildings in the scenic spot to obtain current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
calling historical data related to the historical relics and the historical buildings in a database, and acquiring historical original image information corresponding to the current relics and the historical buildings through the historical data;
building grade division is carried out according to building completion degree, AR, VR and MR scene images are respectively formed by combining historical original appearance image information and actual image and video information of the vestige and the historical building in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device;
when a user wears the virtual realization equipment to watch ancient historic buildings, VR, AR and MR scene images are switched according to the position of the user and the trails and building information presented in the virtual realization equipment worn by the user.
2. The method of claim 1, wherein the steps of combining the historical original image information and the actual image and video information of the historic buildings to form the images of the AR, VR and MR scenes respectively by means of image fusion comprise:
judging the completion degree of the vestige and the historical buildings through actual images and video information, and classifying the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
aiming at the trails and buildings of a first-level integrity building, establishing a virtual scene corresponding to a historical original image through the trails and the historical original image information of the historical building, establishing a real scene corresponding to the trails and the building by utilizing the actual image and video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
aiming at the trails and buildings of the second-level integrity buildings, establishing a virtual scene corresponding to the historical primitive appearance images through the trails and the historical primitive appearance image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
aiming at the trails and buildings of the buildings with three-level integrity, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
3. The method of claim 2, wherein the historic building and the historic site are graded as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
4. The method of claim 1, wherein when the user wears the virtual implementation device to watch the historic legacy buildings, switching between VR, AR and MR scene images according to the position of the user and the vestige and building information displayed in the virtual implementation device worn by the user comprises:
when a user wears virtual implementation equipment to watch historic buildings of ancient heritage, judging the current heritage and scene images corresponding to the buildings according to the heritage and the building information corresponding to the position where the user is located;
when the vestige and the building watched by the user wearing the virtual realization equipment are the first-level integrity building, the virtual realization equipment automatically calls the MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reproduction;
when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building, the virtual realization equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site;
when the vestige and the building watched by the user wearing the virtual realization equipment are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction.
5. The method of claim 1 or 4, wherein the performing VR, AR and MR scene image switching further comprises:
before switching the MR scene image, the AR scene image and the VR scene image, prejudging the next watching scene of the user through the motion trail of the user, comprising the following steps:
monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to be used as a building of a prepared imaging scheme;
calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
when the user reaches the building position corresponding to the building of the preliminary imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
6. A system for AR and VR, MR fusion for use in genetic reconstruction, the system comprising:
the information acquisition module is used for scanning all the vestiges and historical buildings in the scenic spot and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
the original appearance information acquisition module is used for calling historical data related to the vestige and the historical buildings in a database and acquiring historical original appearance image information corresponding to the current vestige and the historical buildings through the historical data;
the fusion imaging module is used for carrying out building grade division according to the building completion degree, combining historical original appearance image information, actual images and video information of the trails and the historical buildings, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to the data storage device;
and the scene switching module is used for switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building.
7. The system of claim 6, wherein the fusion imaging module comprises:
the level classification module is used for judging the completion degree of the vestige and the historical buildings according to the actual image and video information and performing level classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the level classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
the MR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the historic building and the historical original appearance image information of the historic building aiming at the vestige and the building of the primary integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the AR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the trails and the historical buildings, establishing a real scene corresponding to the trails and the buildings through the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the VR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the building with three-level integrity, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
8. The system of claim 7, wherein the historic building and the historic site are graded as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
9. The system of claim 6, wherein the scene switching module comprises:
the judging module is used for judging a current vestige and a scene image corresponding to a building according to the vestige and the building information corresponding to the position of the user when the user wears the virtual realization equipment to watch the historic relic;
the MR scene display module is used for automatically calling an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual implementation equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual implementation equipment are the first-level integrity building;
the AR scene display module is used for automatically calling the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual realization equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building;
and the VR scene display module is used for automatically calling the VR scene images corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction when the vestige and the building watched by the virtual realization equipment worn by the user are the three-level integrity building.
10. The system of claim 6 or 9, wherein the scene switching module further comprises:
the pre-judging switching module is used for pre-judging the next watching scene of the user through the motion trail of the user before the MR scene image, the AR scene image and the VR scene image are switched, and comprises the following steps:
the track monitoring module is used for monitoring the motion track of the user in real time, and acquiring three trails and buildings which are closest to the motion track direction of the user according to the motion track direction of the user to serve as the building of the prepared imaging scheme;
the calling module is used for calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and the switching module is used for directly calling the vestige and the building scene image from the cache area for scene switching when the user reaches the building position corresponding to the building with the preparation imaging scheme.
CN202111531070.6A 2021-12-14 2021-12-14 AR, VR and MR fusion method and system applied to vestige reproduction Active CN114219923B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111531070.6A CN114219923B (en) 2021-12-14 2021-12-14 AR, VR and MR fusion method and system applied to vestige reproduction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111531070.6A CN114219923B (en) 2021-12-14 2021-12-14 AR, VR and MR fusion method and system applied to vestige reproduction

Publications (2)

Publication Number Publication Date
CN114219923A true CN114219923A (en) 2022-03-22
CN114219923B CN114219923B (en) 2022-09-23

Family

ID=80702095

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111531070.6A Active CN114219923B (en) 2021-12-14 2021-12-14 AR, VR and MR fusion method and system applied to vestige reproduction

Country Status (1)

Country Link
CN (1) CN114219923B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677021A (en) * 2015-12-31 2016-06-15 周岩 New method based on fusion of AR system and VR system and applying new method to recurrence of relics
US20180206069A1 (en) * 2017-01-18 2018-07-19 Alexis Santos Interactive tour system
CN108961400A (en) * 2018-10-22 2018-12-07 湖南六新智能科技有限公司 A kind of historical relic is intelligent to assist bootstrap technique and guidance system
CN110275617A (en) * 2019-06-21 2019-09-24 姚自栋 Switching method and system, the storage medium and terminal of mixed reality scene
CN110444133A (en) * 2019-08-13 2019-11-12 上饶市中科院云计算中心大数据研究院 A kind of method and apparatus of tourist attraction intelligent guide
CN111640184A (en) * 2020-06-05 2020-09-08 上海商汤智能科技有限公司 Ancient building reproduction method, ancient building reproduction device, electronic equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677021A (en) * 2015-12-31 2016-06-15 周岩 New method based on fusion of AR system and VR system and applying new method to recurrence of relics
US20180206069A1 (en) * 2017-01-18 2018-07-19 Alexis Santos Interactive tour system
CN108961400A (en) * 2018-10-22 2018-12-07 湖南六新智能科技有限公司 A kind of historical relic is intelligent to assist bootstrap technique and guidance system
CN110275617A (en) * 2019-06-21 2019-09-24 姚自栋 Switching method and system, the storage medium and terminal of mixed reality scene
CN110444133A (en) * 2019-08-13 2019-11-12 上饶市中科院云计算中心大数据研究院 A kind of method and apparatus of tourist attraction intelligent guide
CN111640184A (en) * 2020-06-05 2020-09-08 上海商汤智能科技有限公司 Ancient building reproduction method, ancient building reproduction device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN114219923B (en) 2022-09-23

Similar Documents

Publication Publication Date Title
US11790779B2 (en) Three-dimensional information processing method and three-dimensional information processing device
CN102740127B (en) A kind of watch on a client device and generate the method for collection of choice specimens external member, client device and system
CN100562103C (en) object tracking device, object tracking system and object tracking method
CN108108698A (en) Method for tracking target and system based on recognition of face and panoramic video
US20070061076A1 (en) Navigation and inspection system
US20090153549A1 (en) System and method for producing multi-angle views of an object-of-interest from images in an image dataset
CN109151439A (en) A kind of the automatic tracing camera system and method for view-based access control model
CN110659385B (en) Fusion method of multi-channel video and three-dimensional GIS scene
CN101180653A (en) Method and device for three-dimensional rendering
CN102685533A (en) Methods and systems for converting 2d motion pictures for stereoscopic 3d exhibition
Veas et al. Techniques for view transition in multi-camera outdoor environments
CN104756489A (en) Virtual viewpoint synthesis method and system
CN107507230A (en) Method for tracking target and panorama camera applied to panoramic picture
CN106845435A (en) A kind of augmented reality Implementation Technology based on material object detection tracing algorithm
CN103888768A (en) Video image frame sequence concentration method and device
CN114219923B (en) AR, VR and MR fusion method and system applied to vestige reproduction
CN103268648A (en) Multi-lens wide-angle automobile data recorder
CN112182286B (en) Intelligent video management and control method based on three-dimensional live-action map
JPH1166350A (en) Retrieval type scene labeling device and system
CN111970538A (en) Teaching video processing method and system
JP3156645B2 (en) Information transmission type landscape labeling device and system
Kollert et al. Mapping of 3D eye-tracking in urban outdoor environments
CN109982239A (en) Store floor positioning system and method based on machine vision
CN106033623A (en) 3D visualized mass data processing method, apparatus and system thereof
KR20190143647A (en) User device and method for providing sports video and user device for displaying sports video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant