CN107797665A - A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality - Google Patents

A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality Download PDF

Info

Publication number
CN107797665A
CN107797665A CN201711130030.4A CN201711130030A CN107797665A CN 107797665 A CN107797665 A CN 107797665A CN 201711130030 A CN201711130030 A CN 201711130030A CN 107797665 A CN107797665 A CN 107797665A
Authority
CN
China
Prior art keywords
sand table
augmented reality
model
dimensional
display terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711130030.4A
Other languages
Chinese (zh)
Other versions
CN107797665B (en
Inventor
王戈
王思颖
郑海萌
王伟
郑曙光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201711130030.4A priority Critical patent/CN107797665B/en
Publication of CN107797665A publication Critical patent/CN107797665A/en
Application granted granted Critical
Publication of CN107797665B publication Critical patent/CN107797665B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The embodiment of the invention discloses a kind of 3-dimensional digital sand table deduction method and its system based on augmented reality, wherein, this method includes:The first operation that display terminal receives user deduces application program to open sand table;Deduced in sand table in application program, display terminal gathers currently practical environment picture by built-in image capture device;Display terminal carries out feature extraction to obtain target signature point to currently practical environment picture;Display terminal carries out matching treatment according to default database to target signature point, to obtain target location;Display terminal is obtained according to the target location and display target virtual scene;Display terminal receives user to the second of destination virtual scene the operation, and the second operation includes mobile, scaling, lifting, behavior setting is carried out to role and Real time dynamic display, screen snapshot or video generation is carried out to sand table bandwagon effect.Implement the embodiment of the present invention, enhance and bring sense into when user watches actual object, and improve interaction effect.

Description

A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality
Technical field
The present invention relates to augmented reality field, and in particular to a kind of 3-dimensional digital sand table based on augmented reality is deduced Method and its system.
Background technology
Sand table is the relation according to a certain percentage according to topographic map, airphoto or landform on the spot, with silt, war game and its The model of its material composting.Sand table is used to topography and geomorphology or building minimizing displaying, so as to be convenient for people to observe, at present It is widely used in military or business activity.
It is the static performance for using model build etc. subject matter mostly but known sand table is mainly physical plane sand table, Bandwagon effect lacks interest, for spectators, also lacks interactive.Therefore, there is a kind of multimedia for carrying out interaction Sand table, its major programme are as follows:On the basis of traditional sand table model, it is soft to be provided with multimedia human-computer interaction for organically combination The equipment such as the computer of part, LED display, allow it to issue an instruction to realize sand table illuminating lamp to controller by computer The operation such as unlatching, color and flicker conversion, and the controls such as smog and the big minor adjustment of current, the operation of model vehicle can also be carried out System, makes sand table model be provided with the artistic effect of vivid and interesting.Although the multimedia sand table is by controller to equipment on sand table Control enhance the interest and audience interaction of sand table, but its effect is excessively flat, is still difficult to meet spectators Geng Gao's Demand for experience.
Further, with the continuous development of scientific technology, augmented reality has developed to certain maturity.Increase Strong reality (Augmented Reality, abbreviation AR), it is a kind of that real world information and virtual world information is " seamless " integrated New technology, be script in the certain time spatial dimension of real world be difficult experience entity information (visual information, Sound, taste and tactile etc.), by science and technology such as computers, it is superimposed again after analog simulation, by virtual Information application to truly The world, perceived by human sensory, so as to reach the sensory experience of exceeding reality.
Based on this, it is necessary to provide a kind of the sand table deduction method based on augmented reality and its system to strengthen user Sense is brought into when watching actual object, and lifts interaction effect.
The content of the invention
The purpose of the embodiment of the present invention be to provide a kind of 3-dimensional digital sand table deduction method based on augmented reality and its System, sense is brought into when user watches actual object to strengthen, and lift interaction effect.
To achieve the above object, in a first aspect, the embodiments of the invention provide a kind of 3-dimensional digital based on augmented reality Sand table deduction method, including:
The first operation that display terminal receives user deduces application program to open sand table;
Deduced in the sand table in application program, the display terminal is gathered current real by built-in image capture device Border environment picture;
The display terminal carries out feature extraction to obtain target signature point to the currently practical environment picture;
The display terminal carries out matching treatment according to default database to the target signature point, to obtain target position Put, the target location is any position in augmented reality sand table model, and the database includes characteristic point and the enhancing The corresponding relation of position in real sand table model, and the corresponding virtual field in each position in the augmented reality sand table model Scape;
The display terminal is obtained according to the target location and display target virtual scene;
The display terminal receives second operation of the user to the destination virtual scene, and second operation includes moving Dynamic, scaling, lifting, behavior setting and Real time dynamic display are carried out to role, screen snapshot is carried out to sand table bandwagon effect or is regarded Frequency generates.
As a preferred embodiment, the first operation that display terminal receives user applies journey to open sand table deduction Before sequence, methods described also includes:
Processor gathers multiple actual scene information;
The processor is described three-dimensional empty according to multiple actual scene information architecture three-dimensional digital sand table models Intending digital sand table model includes terrain information;
The processor carries out parameter addition processing to the three-dimensional digital sand table model to obtain three dimensional lifelike mould Type, the three dimensional lifelike model include terrestrial object information, climatic information and social role;
The processor generates the sand table according to the three dimensional lifelike model and deduces application program.
Deduced as an alternative embodiment, the processor generates the sand table according to the three dimensional lifelike model Application program specifically includes:
The processor carries out sports rule addition processing to the social role in the three dimensional lifelike model, to be increased Strong real sand table model;
The processor scans actual object information by the display terminal, and the physical objects information is carried out special To obtain initial characteristicses point, the actual object information includes picture in kind and in kind for sign extraction;
The processor obtains multiple initial positions in the augmented reality model, and by the initial characteristicses point and just The beginning one-to-one binding of position progress;
The processor preserves the binding relationship of the initial characteristicses point and initial position, should to generate the sand table deduction Use program.
Add as an alternative embodiment, the processor carries out parameter to the three-dimensional digital sand table model Processing is added to be specifically included to obtain the three dimensional lifelike model:
The processor is husky added to three-dimensional numeral by the terrestrial object information, climatic information and social role Disk model is to obtain the three dimensional lifelike model.
As an alternative embodiment, the terrestrial object information includes vegetation, river and building, the weather letter Breath includes rainfall, snowed and sunshine, the social role include personage and animal.
Second aspect, the embodiment of the present invention additionally provide a kind of 3-dimensional digital sand table deduction system based on augmented reality, Including display terminal.Wherein, the display terminal includes:
Receiving module, the first operation for receiving user deduce application program to open sand table;
First acquisition module, currently practical environment picture is gathered for being deduced in the sand table in application program;
Extraction module, for carrying out feature extraction to the currently practical environment picture to obtain target signature point;
Matching module, for carrying out matching treatment to the target signature point according to default database, to obtain target Position, the target location are any position in augmented reality sand table model, and the database includes characteristic point and the increasing The corresponding relation of position in strong real sand table model, and each position corresponding one in the augmented reality sand table model is virtual Scene;
Display module, for obtaining simultaneously display target virtual scene according to the target location;
The receiving module is additionally operable to receive second operation of the user to the destination virtual scene, the second operation bag Mobile, scaling, lifting are included, behavior setting is carried out to role and Real time dynamic display, screen snapshot is carried out to sand table bandwagon effect Or video generation.
As an alternative embodiment, the deduction system also includes processor, the processor includes:
Second acquisition module, for gathering multiple actual scene information;
Module is built, for according to multiple actual scene information architecture three-dimensional digital sand table models, described three Dimension virtual digit sand table model includes terrain information;
Add module, handled for carrying out parameter addition to the three-dimensional digital sand table model to obtain three dimensional lifelike Model, the three dimensional lifelike model include terrestrial object information, climatic information and social role;
Generation module, application program is deduced for generating the sand table according to the three dimensional lifelike model.
As an alternative embodiment, the generation module is specifically used for:
Sports rule addition processing is carried out to the social role in the three dimensional lifelike model, to obtain augmented reality sand table Model;
Actual object information is scanned by the display terminal, and feature extraction is carried out to the physical objects information to obtain Initial characteristicses point is taken, the actual object information includes picture in kind and in kind;
Multiple initial positions in the augmented reality model are obtained, and the initial characteristicses point and initial position are carried out One-to-one binding;
The binding relationship of the initial characteristicses point and initial position is preserved, application program is deduced to generate the sand table.
As an alternative embodiment, the add module is specifically used for:
The terrestrial object information, climatic information and social role are added to the three-dimensional digital sand table model to obtain To the three dimensional lifelike model.
As an alternative embodiment, the terrestrial object information includes vegetation, river and building, the weather letter Breath includes rainfall, snowed and sunshine, the social role include personage and animal;The display terminal includes mobile phone, flat board Computer and augmented reality glasses.
Implement the 3-dimensional digital sand table deduction method and its system based on augmented reality that the embodiment of the present invention is provided, use The sand table that display terminal is opened at family deduces application program, deduces in application program in the sand table, is set by built-in IMAQ It is standby to gather currently practical environment picture, and display target virtual scene is obtained based on the current actual environment picture, so as to strengthen Sense is brought into when user watches actual object.Meanwhile user can perform movement, scaling, lifting, diagonal to destination virtual scene Color carry out behavior setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to Improve interaction effect.
Brief description of the drawings
, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art The required accompanying drawing used is briefly described in embodiment or description of the prior art.In all of the figs, similar element Or part is typically identified by similar reference.In accompanying drawing, each element or part might not be drawn according to the ratio of reality.
Fig. 1 is the signal stream for the 3-dimensional digital sand table deduction method based on augmented reality that first embodiment of the invention provides Cheng Tu;
Fig. 2 is the signal stream for the 3-dimensional digital sand table deduction method based on augmented reality that second embodiment of the invention provides Cheng Tu;
Fig. 3 to Fig. 5 is bandwagon effect figure;
Fig. 6 is that the structure for the 3-dimensional digital sand table deduction system based on augmented reality that first embodiment of the invention provides is shown It is intended to;
Fig. 7 is the structural representation of display terminal in Fig. 6;
Fig. 8 is the structural representation of processor in Fig. 6.
Embodiment
The embodiment of technical solution of the present invention is described in detail below in conjunction with accompanying drawing.Following examples are only used for Clearly illustrate technical scheme, therefore be intended only as example, and the protection of the present invention can not be limited with this Scope.
It should be noted that unless otherwise indicated, technical term or scientific terminology used in this application should be this hair The ordinary meaning that bright one of ordinary skill in the art are understood.
Fig. 1 is refer to, is the 3-dimensional digital sand table deduction side based on augmented reality that first embodiment of the invention is provided The schematic flow sheet of method, as illustrated, this method may include steps of:
S101, the first operation that display terminal receives user deduce application program to open sand table.
S102, deduced in sand table in application program, display terminal is gathered currently practical by built-in image capture device Environment picture.
S103, display terminal carry out feature extraction to obtain target signature point to currently practical environment picture.
S104, display terminal carries out matching treatment according to default database to target signature point, to obtain target location.
Wherein, target location is any position in augmented reality sand table model, and it is existing with enhancing that database includes characteristic point The corresponding relation (including one-to-one corresponding, one-to-many correspondence, multi-to-multi correspond to) of position in real sand table model, this feature point refers to Extracted from actual object picture, and the corresponding virtual scene (one in each position in augmented reality sand table model One correspondence).
S105, display terminal is obtained according to target location and display target virtual scene.
S106, display terminal receive second operation of the user to destination virtual scene.
Specifically, user can move to the destination virtual scene being shown on display terminal, scales, lift, diagonally Color carry out behavior setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation.
Implement the 3-dimensional digital sand table deduction method based on augmented reality that the embodiment of the present invention is provided, user opens aobvious Show that the sand table of terminal deduces application program, deduced in the sand table in application program, worked as by built-in image capture device collection Preceding actual environment picture, and display target virtual scene is obtained based on the current actual environment picture, seen so as to enhance user See and bring sense into during actual object.Meanwhile user can perform movement, scaling to destination virtual scene, lifting, role be gone For setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to improve mutually Dynamic effect.
Fig. 2 is refer to, is the 3-dimensional digital sand table deduction side based on augmented reality that second embodiment of the invention is provided The schematic flow sheet of method, as illustrated, this method may include steps of:
S201, processor gather multiple actual scene information.
The processor can be but be not limited only to possess picture collection function and any equipment of data processing function.Should Multiple actual scene information that processor is gathered include but are not limited to indoor scene and outdoor scene, outdoor scene include but It is not limited only to the scene of different geographical features, such as hills, level land and river etc..
S202, processor is according to multiple actual scene information architecture three-dimensional digital sand table models.
Wherein, the three-dimensional digital sand table model includes terrain information.Specifically, it is right according to actual scene information It carries out feature point extraction, determines to need the particular location that augmented reality sand table is overlapped to display, and this is to specific position Put and bound, ensure that sand table is shown and fitted with actual environment, so as to realize the structure of three-dimensional digital sand table model.Need It is noted that the particular location can be a plane.
S203, processor carry out parameter addition processing to three-dimensional digital sand table model to obtain three dimensional lifelike model.
Wherein, three dimensional lifelike model includes terrestrial object information, climatic information and social role.Specifically, processor is by ground Thing information, climatic information and social role are added to three-dimensional digital sand table model to obtain the three dimensional lifelike model. Terrestrial object information includes but are not limited to vegetation, river and building, climatic information includes but are not limited to rainfall, snow and Sunshine, social role include but are not limited to personage and animal.
S204, processor generate sand table according to three dimensional lifelike model and deduce application program.
Specifically, step S204 includes:
(1) processor is carried out at sports rule addition to the social role (personage and animal etc.) in three dimensional lifelike model Reason, to obtain augmented reality sand table model;The sports rule is included but are not limited to away, runs and jumped;
(2) processor by display terminal scan actual object information, and to physical objects information carry out feature extraction with Obtain initial characteristicses point;Actual object information includes but are not limited to picture in kind and in kind, such as including desktop and table Face picture;
(3) processor obtains multiple initial positions in augmented reality sand table model, and by initial characteristicses point and initial bit Put and carry out one-to-one binding;Such as initial characteristicses point 1 corresponds to initial position 1;
(4) processor preserves the binding relationship of initial characteristicses point and initial position, and application program is deduced to generate sand table.
S205, the first operation that display terminal receives user deduce application program to open sand table.
The display terminal can include but are not limited to mobile phone, tablet personal computer and augmented reality glasses.Work as display terminal When being mobile phone or tablet personal computer, sand table deduces a APP, Yong Hudian that application program can be understood as being installed on mobile phone or computer Hit APP and deduce application program to open the sand table.When display terminal is augmented reality glasses, sand table deduces application program can be with It is interpreted as being arranged at a software control procedure inside augmented reality glasses, software control is provided with augmented reality glasses The operation button of program, user press the button and deduce application program to start sand table.
S206, deduced in sand table in application program, display terminal is gathered currently practical by built-in image capture device Environment picture.
After opening sand table deduction application program, display terminal can pass through built-in image capture device (being usually camera) Gather currently practical environment picture.The actual environment picture can be desktop picture or wall picture etc., but be not limited only to this.
S207, display terminal carry out feature extraction to obtain target signature point to currently practical environment picture.
After collecting actual environment picture, display terminal uses feature extraction algorithm to carry out feature extraction to it to obtain mesh Mark characteristic point.
Feature extraction is that the environment picture that will be collected is converted into gray-scale map, obtains the contour edge conduct of object in environment Characteristic point.Algorithm flow:It is by an image (the window grabgraf to be detected):1) it is converted into gray-scale map;2) corrected using Gamma Method to input picture carry out color space standardization;3) gradient of each pixel is calculated, for obtaining profile information;4) Divide the image into zonule;5) histogram of gradients in each region is counted, forms the description in each region;6) will be per several areas Domain forms a group, and an interior description to provincial characteristics of group integrates the description for just having obtained this group;7) by image All groups of feature description integrates, and rejects discontinuous characteristic point information (impurity), the contour feature for just having obtained image is retouched State, this is exactly finally to be available for comparing the characteristic vector used.
S208, display terminal carries out matching treatment according to default database to target signature point, to obtain target location.
Wherein, target location is any position in augmented reality sand table model, and it is existing with enhancing that database includes characteristic point The corresponding relation (including one-to-one corresponding, one-to-many correspondence, multi-to-multi correspond to) of position in real sand table model, this feature point refers to Extracted from actual object picture, and the corresponding virtual scene (one in each position in augmented reality sand table model One correspondence).For example, in database characteristic point, the position of augmented reality sand table model and virtual scene corresponding relation It is as follows:Characteristic point 1 corresponds to position 1, and position 1 corresponds to virtual scene 1;Characteristic point 1 corresponds to position 1/2, and position 1 corresponds to Virtual scene 1, position 2 correspond to virtual scene 2;Characteristic point 1/2 corresponds to position 1.
If target signature point is a, with reference to learning that target signature point a and characteristic point 1 belong to tolerance after database matching In the range of, accordingly, it is determined that target location is characterized a little position 1 corresponding to 1.
S209, display terminal is obtained according to target location and display target virtual scene.
Specifically, with reference to position in database and the corresponding relation of virtual scene, virtual field corresponding to position 1 can be learnt Scape is 1, i.e., virtual scene 1 is destination virtual scene, and is shown on display terminal, as shown in Figures 3 to 5.Need Bright, Fig. 3 to Fig. 5 is rendering effect figure, and it, which there must be certain color and filling, can just give expression to effect.From Fig. 3 to In Fig. 5 as can be seen that under any background, virtual scene, and virtual field can be shown by implementing above-mentioned steps S201 to S209 The display effect of scape will not also be influenceed by background.
S210, display terminal receive second operation of the user to destination virtual scene.
Specifically, user can move to the destination virtual scene being shown on display terminal, scales, lift, diagonally Color carry out behavior setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to The deduction of the 3-dimensional digital sand table based on augmented reality is realized, improves user and the 3-dimensional digital sand table based on augmented reality Between interaction effect, and improve enjoyment.
Implement the 3-dimensional digital sand table deduction method based on augmented reality that the embodiment of the present invention is provided, user opens aobvious Show that the sand table of terminal deduces application program, deduced in the sand table in application program, worked as by built-in image capture device collection Preceding actual environment picture, and display target virtual scene is obtained based on the current actual environment picture, seen so as to enhance user See and bring sense into during actual object.Meanwhile user can perform movement, scaling to destination virtual scene, lifting, role be gone For setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to improve mutually Dynamic effect.
Fig. 6 is refer to, is the 3-dimensional digital sand table deduction system based on augmented reality that first embodiment of the invention provides Structural representation, as illustrated, the system include carry out data interaction display terminal 100 and processor 200.Display terminal 100 include but are not limited to mobile phone, tablet personal computer and augmented reality glasses.
Further, Fig. 7 is refer to, display terminal 100 includes:
Receiving module 10, the first operation for receiving user deduce application program to open sand table;
First acquisition module 11, currently practical environment picture is gathered for being deduced in the sand table in application program;
Extraction module 12, for carrying out feature extraction to the currently practical environment picture to obtain target signature point;
Matching module 13, for carrying out matching treatment to the target signature point according to default database, to obtain mesh Cursor position, the target location be augmented reality sand table model in any position, the database include characteristic point with it is described The corresponding relation of position in augmented reality sand table model, and each position corresponding one in the augmented reality sand table model is empty Intend scene;
Display module 14, for obtaining simultaneously display target virtual scene according to the target location;
Receiving module 10 is additionally operable to receive second operation of the user to the destination virtual scene, and second operation includes Mobile, scaling, lifting, behavior setting and Real time dynamic display are carried out to role, screen snapshot is carried out to sand table bandwagon effect or Video generates.
Further, Fig. 8 is refer to, processor 200 includes:
Second acquisition module 20, for gathering multiple actual scene information;
Module 21 is built, it is described for according to multiple actual scene information architecture three-dimensional digital sand table models Three-dimensional digital sand table model includes terrain information;
Add module 22, forced for carrying out parameter addition processing to the three-dimensional digital sand table model with obtaining three-dimensional True mode, the three dimensional lifelike model include terrestrial object information, climatic information and social role;Terrestrial object information includes vegetation, river Stream and building, the climatic information include rainfall, snowed and sunshine, the social role include personage and animal;
Generation module 23, application program is deduced for generating the sand table according to the three dimensional lifelike model.
Further, generation module 23 is specifically used for:
Sports rule addition processing is carried out to the social role in the three dimensional lifelike model, to obtain augmented reality sand table Model;
Actual object information is scanned by the display terminal, and feature extraction is carried out to the physical objects information to obtain Initial characteristicses point is taken, the actual object information includes picture in kind and in kind;
Obtain multiple initial positions in the augmented reality sand table model, and by the initial characteristicses point and initial position Carry out one-to-one binding;
The binding relationship of the initial characteristicses point and initial position is preserved, application program is deduced to generate the sand table.
Further, add module 22 is specifically used for:
The terrestrial object information, climatic information and social role are added to the three-dimensional digital sand table model to obtain To the three dimensional lifelike model.
Implement the 3-dimensional digital sand table deduction system based on augmented reality that the embodiment of the present invention is provided, user opens aobvious Show that the sand table of terminal deduces application program, deduced in the sand table in application program, worked as by built-in image capture device collection Preceding actual environment picture, and display target virtual scene is obtained based on the current actual environment picture, seen so as to enhance user See and bring sense into during actual object.Meanwhile user can perform movement, scaling to destination virtual scene, lifting, role be gone For setting and Real time dynamic display, to sand table bandwagon effect carry out screen snapshot or video generation etc. operation, so as to improve mutually Dynamic effect.
It should be noted that in the present embodiment the 3-dimensional digital sand table deduction system based on augmented reality Concrete workflow Journey refer to the description of method part, will not be repeated here.
Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations;Although with reference to foregoing each reality Example is applied the present invention is described in detail, it will be understood by those within the art that:It still can be to foregoing each Technical scheme described in embodiment is modified, and either carries out equivalent substitution to which part or all technical characteristic;And These modifications are replaced, and the essence of appropriate technical solution is departed from the scope of various embodiments of the present invention technical scheme, its It all should cover among the claim of the present invention and the scope of specification.

Claims (10)

  1. A kind of 1. 3-dimensional digital sand table deduction method based on augmented reality, it is characterised in that including:
    The first operation that display terminal receives user deduces application program to open sand table;
    Deduced in the sand table in application program, the display terminal gathers currently practical ring by built-in image capture device Border picture;
    The display terminal carries out feature extraction to obtain target signature point to the currently practical environment picture;
    The display terminal carries out matching treatment according to default database to the target signature point, to obtain target location, The target location is any position in augmented reality sand table model, and the database includes characteristic point and the augmented reality The corresponding relation of position in sand table model, and the corresponding virtual scene in each position in the augmented reality sand table model;
    The display terminal is obtained according to the target location and display target virtual scene;
    The display terminal receives second operation of the user to the destination virtual scene, and second operation includes mobile, contracting Put, lift, behavior setting and Real time dynamic display are carried out to role, screen snapshot or video are carried out to sand table bandwagon effect giving birth to Into.
  2. 2. the 3-dimensional digital sand table methods of exhibiting based on augmented reality as claimed in claim 1, it is characterised in that display terminal The first operation of user is received so that before opening sand table deduction application program, methods described also includes:
    Processor gathers multiple actual scene information;
    The processor is according to multiple actual scene information architecture three-dimensional digital sand table models, the three-dimensional number Word sand table model includes terrain information;
    The processor carries out parameter addition processing to the three-dimensional digital sand table model to obtain three dimensional lifelike model, institute Stating three dimensional lifelike model includes terrestrial object information, climatic information and social role;
    The processor generates the sand table according to the three dimensional lifelike model and deduces application program.
  3. 3. the 3-dimensional digital sand table deduction method based on augmented reality as claimed in claim 2, it is characterised in that the processing Device generates the sand table deduction application program according to the three dimensional lifelike model and specifically included:
    The processor carries out sports rule addition processing to the social role in the three dimensional lifelike model, existing to obtain enhancing Real sand table model;
    The processor scans actual object information by the display terminal, and carries out feature to the physical objects information and carry Take to obtain initial characteristicses point, the actual object information includes picture in kind and in kind;
    The processor obtains multiple initial positions in the augmented reality sand table model, and by the initial characteristicses point and just The beginning one-to-one binding of position progress;
    The processor preserves the binding relationship of the initial characteristicses point and initial position, and journey is applied to generate the sand table deduction Sequence.
  4. 4. the 3-dimensional digital sand table deduction method based on augmented reality as claimed in claim 2 or claim 3, it is characterised in that described Processor carries out parameter addition processing to the three-dimensional digital sand table model and specifically wrapped with obtaining the three dimensional lifelike model Include:
    The terrestrial object information, climatic information and social role are added to the three-dimensional digital sand table mould by the processor Type is to obtain the three dimensional lifelike model.
  5. 5. the 3-dimensional digital sand table deduction method based on augmented reality as claimed in claim 4, it is characterised in that the atural object Information includes vegetation, river and building, and the climatic information includes rainfall, snows and sunshine, social role's bag Include personage and animal.
  6. 6. a kind of 3-dimensional digital sand table deduction system based on augmented reality, including display terminal, it is characterised in that the display Terminal includes:
    Receiving module, the first operation for receiving user deduce application program to open sand table;
    First acquisition module, currently practical environment picture is gathered for being deduced in the sand table in application program;
    Extraction module, for carrying out feature extraction to the currently practical environment picture to obtain target signature point;
    Matching module, for carrying out matching treatment to the target signature point according to default database, to obtain target location, The target location is any position in augmented reality sand table model, and the database includes characteristic point and the augmented reality The corresponding relation of position in sand table model, and the corresponding virtual scene in each position in the augmented reality sand table model;
    Display module, for obtaining simultaneously display target virtual scene according to the target location;
    The receiving module is additionally operable to receive second operation of the user to the destination virtual scene, and second operation includes moving Dynamic, scaling, lifting, behavior setting and Real time dynamic display are carried out to role, screen snapshot is carried out to sand table bandwagon effect or is regarded Frequency generates.
  7. 7. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 6, it is characterised in that the deduction System also includes processor, and the processor includes:
    Second acquisition module, for gathering multiple actual scene information;
    Module is built, for according to multiple actual scene information architecture three-dimensional digital sand table models, the three-dimensional void Intending digital sand table model includes terrain information;
    Add module, handled for carrying out parameter addition to the three-dimensional digital sand table model to obtain three dimensional lifelike mould Type, the three dimensional lifelike model include terrestrial object information, climatic information and social role;
    Generation module, application program is deduced for generating the sand table according to the three dimensional lifelike model.
  8. 8. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 7, it is characterised in that the generation Module is specifically used for:
    Sports rule addition processing is carried out to the social role in the three dimensional lifelike model, to obtain augmented reality sand table mould Type;
    Actual object information is scanned by the display terminal, and feature extraction is carried out to the physical objects information to obtain just Beginning characteristic point, the actual object information include picture in kind and in kind;
    Multiple initial positions in the augmented reality sand table model are obtained, and the initial characteristicses point and initial position are carried out One-to-one binding;
    The binding relationship of the initial characteristicses point and initial position is preserved, application program is deduced to generate the sand table.
  9. 9. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 7 or 8, it is characterised in that described Add module is specifically used for:
    By the terrestrial object information, climatic information and social role added to the three-dimensional digital sand table model to obtain State three dimensional lifelike model.
  10. 10. the 3-dimensional digital sand table deduction system based on augmented reality as claimed in claim 9, it is characterised in that describedly Thing information includes vegetation, river and building, and the climatic information includes rainfall, snows and sunshine, the social role Including personage and animal;The display terminal includes mobile phone, tablet personal computer and augmented reality glasses.
CN201711130030.4A 2017-11-15 2017-11-15 Three-dimensional digital sand table deduction method and system based on augmented reality Active CN107797665B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711130030.4A CN107797665B (en) 2017-11-15 2017-11-15 Three-dimensional digital sand table deduction method and system based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711130030.4A CN107797665B (en) 2017-11-15 2017-11-15 Three-dimensional digital sand table deduction method and system based on augmented reality

Publications (2)

Publication Number Publication Date
CN107797665A true CN107797665A (en) 2018-03-13
CN107797665B CN107797665B (en) 2021-02-02

Family

ID=61535106

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711130030.4A Active CN107797665B (en) 2017-11-15 2017-11-15 Three-dimensional digital sand table deduction method and system based on augmented reality

Country Status (1)

Country Link
CN (1) CN107797665B (en)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109917906A (en) * 2019-01-24 2019-06-21 北京德火科技有限责任公司 A kind of method and system for realizing sight spot interaction based on augmented reality
CN110163831A (en) * 2019-04-19 2019-08-23 深圳市思为软件技术有限公司 The object Dynamic Display method, apparatus and terminal device of three-dimensional sand table
CN110209285A (en) * 2019-06-19 2019-09-06 哈尔滨拓博科技有限公司 A kind of sand table display systems based on gesture control
CN110349270A (en) * 2019-07-02 2019-10-18 石家庄中扬网络科技股份有限公司 Virtual sand table rendering method based on realistic space positioning
CN110348900A (en) * 2019-07-03 2019-10-18 联保(北京)科技有限公司 A kind of data processing method, system and device
CN110544311A (en) * 2018-05-29 2019-12-06 百度在线网络技术(北京)有限公司 Safety warning method, device and storage medium
CN110648396A (en) * 2019-09-17 2020-01-03 西安万像电子科技有限公司 Image processing method, device and system
CN110721387A (en) * 2019-11-04 2020-01-24 北京容大天成科技有限公司 3D digital psychological sand table implementation method and device, electronic equipment and psychological sand table
CN110826375A (en) * 2018-08-10 2020-02-21 广东虚拟现实科技有限公司 Display method, display device, terminal equipment and storage medium
CN111104470A (en) * 2019-11-19 2020-05-05 青岛海信网络科技股份有限公司 Method and system for linkage of electronic sand table and emergency platform
CN111599223A (en) * 2020-06-12 2020-08-28 浙江商汤科技开发有限公司 Sand table display system and sand table display method
CN111638793A (en) * 2020-06-04 2020-09-08 浙江商汤科技开发有限公司 Aircraft display method and device, electronic equipment and storage medium
CN111640201A (en) * 2020-06-11 2020-09-08 浙江商汤科技开发有限公司 Control method and device for virtual sand table display, electronic equipment and storage medium
CN111652984A (en) * 2020-06-10 2020-09-11 上海商汤智能科技有限公司 Sand table demonstration method and device, computer equipment and storage medium
CN111651057A (en) * 2020-06-11 2020-09-11 浙江商汤科技开发有限公司 Data display method and device, electronic equipment and storage medium
CN111651056A (en) * 2020-06-10 2020-09-11 浙江商汤科技开发有限公司 Sand table demonstration method and device, computer equipment and storage medium
CN111651055A (en) * 2020-06-09 2020-09-11 浙江商汤科技开发有限公司 City virtual sand table display method and device, computer equipment and storage medium
CN111651053A (en) * 2020-06-10 2020-09-11 浙江商汤科技开发有限公司 Urban sand table display method and device, electronic equipment and storage medium
CN111696193A (en) * 2020-05-06 2020-09-22 广东康云科技有限公司 Internet of things control method, system and device based on three-dimensional scene and storage medium
CN113254742A (en) * 2021-07-14 2021-08-13 深圳市赛野展览展示有限公司 Display device based on 5G deep learning artificial intelligence
CN113436559A (en) * 2021-05-19 2021-09-24 吉林大学 Sand table dynamic landscape real-time display system and display method
CN115097938A (en) * 2022-06-25 2022-09-23 成都西南信息控制研究院有限公司 Immersive virtual sand table deduction public display system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105045389A (en) * 2015-07-07 2015-11-11 深圳水晶石数字科技有限公司 Demonstration method for interactive sand table system
CN106371581A (en) * 2016-04-01 2017-02-01 苏州美房云客软件科技股份有限公司 Interaction method based on IM (Instant Messaging) and 3D virtual technology
CN106571072A (en) * 2015-10-26 2017-04-19 苏州梦想人软件科技有限公司 Method for realizing children education card based on AR
CN106816077A (en) * 2015-12-08 2017-06-09 张涛 Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN106887183A (en) * 2017-03-24 2017-06-23 广西七三科技有限公司 A kind of interactive demonstration method and system of BIM augmented realities in sand table is built

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105045389A (en) * 2015-07-07 2015-11-11 深圳水晶石数字科技有限公司 Demonstration method for interactive sand table system
CN106571072A (en) * 2015-10-26 2017-04-19 苏州梦想人软件科技有限公司 Method for realizing children education card based on AR
CN106816077A (en) * 2015-12-08 2017-06-09 张涛 Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality
CN106371581A (en) * 2016-04-01 2017-02-01 苏州美房云客软件科技股份有限公司 Interaction method based on IM (Instant Messaging) and 3D virtual technology
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN106887183A (en) * 2017-03-24 2017-06-23 广西七三科技有限公司 A kind of interactive demonstration method and system of BIM augmented realities in sand table is built

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110544311A (en) * 2018-05-29 2019-12-06 百度在线网络技术(北京)有限公司 Safety warning method, device and storage medium
CN110544311B (en) * 2018-05-29 2023-04-25 百度在线网络技术(北京)有限公司 Security warning method, device and storage medium
CN110826375A (en) * 2018-08-10 2020-02-21 广东虚拟现实科技有限公司 Display method, display device, terminal equipment and storage medium
CN109917906A (en) * 2019-01-24 2019-06-21 北京德火科技有限责任公司 A kind of method and system for realizing sight spot interaction based on augmented reality
CN110163831A (en) * 2019-04-19 2019-08-23 深圳市思为软件技术有限公司 The object Dynamic Display method, apparatus and terminal device of three-dimensional sand table
CN110163831B (en) * 2019-04-19 2021-04-23 深圳市思为软件技术有限公司 Method and device for dynamically displaying object of three-dimensional virtual sand table and terminal equipment
CN110209285A (en) * 2019-06-19 2019-09-06 哈尔滨拓博科技有限公司 A kind of sand table display systems based on gesture control
CN110349270A (en) * 2019-07-02 2019-10-18 石家庄中扬网络科技股份有限公司 Virtual sand table rendering method based on realistic space positioning
CN110348900A (en) * 2019-07-03 2019-10-18 联保(北京)科技有限公司 A kind of data processing method, system and device
CN110348900B (en) * 2019-07-03 2022-07-29 联保(北京)科技有限公司 Data processing method, system and device
CN110648396A (en) * 2019-09-17 2020-01-03 西安万像电子科技有限公司 Image processing method, device and system
CN110721387A (en) * 2019-11-04 2020-01-24 北京容大天成科技有限公司 3D digital psychological sand table implementation method and device, electronic equipment and psychological sand table
CN111104470A (en) * 2019-11-19 2020-05-05 青岛海信网络科技股份有限公司 Method and system for linkage of electronic sand table and emergency platform
CN111696193B (en) * 2020-05-06 2023-08-25 广东康云科技有限公司 Internet of things control method, system and device based on three-dimensional scene and storage medium
CN111696193A (en) * 2020-05-06 2020-09-22 广东康云科技有限公司 Internet of things control method, system and device based on three-dimensional scene and storage medium
CN111638793A (en) * 2020-06-04 2020-09-08 浙江商汤科技开发有限公司 Aircraft display method and device, electronic equipment and storage medium
CN111638793B (en) * 2020-06-04 2023-09-01 浙江商汤科技开发有限公司 Display method and device of aircraft, electronic equipment and storage medium
CN111651055A (en) * 2020-06-09 2020-09-11 浙江商汤科技开发有限公司 City virtual sand table display method and device, computer equipment and storage medium
CN111652984B (en) * 2020-06-10 2024-03-22 上海商汤智能科技有限公司 Sand table demonstration method and device, computer equipment and storage medium
CN111651053A (en) * 2020-06-10 2020-09-11 浙江商汤科技开发有限公司 Urban sand table display method and device, electronic equipment and storage medium
CN111651056A (en) * 2020-06-10 2020-09-11 浙江商汤科技开发有限公司 Sand table demonstration method and device, computer equipment and storage medium
CN111652984A (en) * 2020-06-10 2020-09-11 上海商汤智能科技有限公司 Sand table demonstration method and device, computer equipment and storage medium
CN111651057A (en) * 2020-06-11 2020-09-11 浙江商汤科技开发有限公司 Data display method and device, electronic equipment and storage medium
CN111640201A (en) * 2020-06-11 2020-09-08 浙江商汤科技开发有限公司 Control method and device for virtual sand table display, electronic equipment and storage medium
CN111599223A (en) * 2020-06-12 2020-08-28 浙江商汤科技开发有限公司 Sand table display system and sand table display method
CN113436559A (en) * 2021-05-19 2021-09-24 吉林大学 Sand table dynamic landscape real-time display system and display method
CN113254742A (en) * 2021-07-14 2021-08-13 深圳市赛野展览展示有限公司 Display device based on 5G deep learning artificial intelligence
CN115097938A (en) * 2022-06-25 2022-09-23 成都西南信息控制研究院有限公司 Immersive virtual sand table deduction public display system and method

Also Published As

Publication number Publication date
CN107797665B (en) 2021-02-02

Similar Documents

Publication Publication Date Title
CN107797665A (en) A kind of 3-dimensional digital sand table deduction method and its system based on augmented reality
CN112263837B (en) Weather rendering method, device, equipment and storage medium in virtual environment
CN110084161B (en) Method and system for rapidly detecting key points of human skeleton
CN103810504B (en) Image processing method and device
King et al. ARVino-outdoor augmented reality visualisation of viticulture GIS data
CN109064549B (en) Method for generating mark point detection model and method for detecting mark point
CN109345556A (en) Neural network prospect for mixed reality separates
CN105654471A (en) Augmented reality AR system applied to internet video live broadcast and method thereof
CN106296567B (en) A kind of conversion method and device of the multi-level image style based on rarefaction representation
CN108388882A (en) Based on the gesture identification method that the overall situation-part is multi-modal RGB-D
CN105959595A (en) Virtuality to reality autonomous response method for virtuality and reality real-time interaction
CN107452060A (en) Full angle automatic data collection generates virtual data diversity method
CN106910188A (en) The detection method of airfield runway in remote sensing image based on deep learning
CN107944459A (en) A kind of RGB D object identification methods
CN102393966A (en) Self-adapting image compressive sampling method based on multi-dimension saliency map
CN104537705A (en) Augmented reality based mobile platform three-dimensional biomolecule display system and method
Li et al. Key technology of virtual roaming system in the museum of ancient high-imitative calligraphy and paintings
CN104407696B (en) The virtual ball simulation of mobile device and the method for control
CN111145135A (en) Image descrambling processing method, device, equipment and storage medium
CN105976395A (en) Video target tracking method based on sparse representation
CN110288521A (en) Image beautification method, device and electronic equipment
CN106709883A (en) Point cloud denoising method based on joint bilateral filtering and sharp feature skeleton extraction
CN108375806A (en) The acquisition methods and device of weather-map
CN112435333B (en) Road scene generation method and related device
KR101235850B1 (en) A method for expressing whether of virtual world and an apparatus thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant