CN105718054B - The contactless smart terminal control method and device of augmented reality object, system - Google Patents
The contactless smart terminal control method and device of augmented reality object, system Download PDFInfo
- Publication number
- CN105718054B CN105718054B CN201610031686.XA CN201610031686A CN105718054B CN 105718054 B CN105718054 B CN 105718054B CN 201610031686 A CN201610031686 A CN 201610031686A CN 105718054 B CN105718054 B CN 105718054B
- Authority
- CN
- China
- Prior art keywords
- characteristic body
- layout
- terminal control
- intelligent terminal
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of contactless smart terminal control method of augmented reality object and devices, system, comprising: characteristic body identification device: acquisition image identifies multiple characteristic bodies from described image；Characteristic body is laid out identification device: identifying the layout relationship between the multiple characteristic body；Control instruction generating means: intelligent terminal control instruction is generated according to the layout relationship.The present invention uses characteristic body to carry out contactless control to intelligent terminal as input medium, so that control experience is humanized, and brings the convenience on computation to special population (such as the children that not will use keyboard).Virtual vision, acoustic information are superimposed using the Graphics Fusion that augmented reality is combined into the characteristic body (such as seven-piece puzzle) in reality scene.Using the network savvy of intelligent terminal, by internet, conducive to the exchange realized between each player with interact, the new playing method of seven-piece puzzle of remote interaction may be implemented.
Description
Technical field
The present invention relates to the non-contact control methods of augmented reality and intelligent terminal, and in particular, to augmented reality object
Contactless smart terminal control method and device, system.
Background technique
Contactless smart terminal control is the control of the traditional approach such as difference and mouse, keyboard, touch screen.Enhancing is existing
Real technology, it is a kind of by " seamless " the integrated new technology of real world information and virtual world information, is originally in reality
It is difficult the entity information (visual information, sound, taste, tactile etc.) experienced in the certain time spatial dimension in the world, passes through
The science and technology such as intelligent terminal are superimposed after analog simulation again, virtual Information application to real world are felt by human sensory
Know, to reach the sensory experience of exceeding reality.True environment and virtual object have been added to the same picture in real time
Or space exists simultaneously.
By the non-contact control of augmented reality and intelligent terminal, both technologies be can combine to so that controlling experience more
The convenience on computation is brought for hommization and to special population (such as the children that not will use keyboard).
Summary of the invention
For the defects in the prior art, the object of the present invention is to provide a kind of contactless smart of augmented reality object ends
Hold control method and device, system.
A kind of contactless smart terminal control mechanism of the augmented reality object provided according to the present invention, comprising:
Characteristic body identification device: acquisition image identifies multiple characteristic bodies from described image；
Characteristic body is laid out identification device: identifying the layout relationship between the multiple characteristic body；
Control instruction generating means: intelligent terminal control instruction is generated according to the layout relationship.
Preferably, further includes:
Image processing apparatus: the described of the layout relationship arrangement are shown as according to the intelligent terminal control instruction more
A characteristic body.
Preferably, the characteristic body identification device, comprising:
Feature extraction identification device: according to feature that is following any or appointing a variety of elements to constitute, know from described image
The substance feature object of the feature is not provided:
Shape；
Color；
Pattern；
Lines；
Texture.
Preferably, the characteristic body is laid out identification device, comprising:
It is laid out coalignment: with matching way, finding the default layout to match as institute from default layout set
State layout relationship.
Preferably, the layout coalignment, including any one following device:
Gabarit coalignment: detection obtains the gabarit of the spliced forming shape of the multiple characteristic body, gathers from default layout
In find out the default layout to match with the gabarit；
External envelope coalignment: detecting the geometric center point of each characteristic body in the multiple characteristic body, obtains described each
The enveloping outer enclosure of the geometric center point of a characteristic body finds out from default layout set and presets with what the enveloping outer enclosure matched
Layout.
Preferably, the control instruction generating means, comprising:
Instructions match device: it from preset layout relationship table corresponding with instruction, finds out and with number layout relationship pair
The intelligent terminal control instruction answered.
A kind of contactless smart terminal control system of the augmented reality object provided according to the present invention, including band camera
Intelligent terminal, the intelligent terminal includes the contactless smart terminal control mechanism of above-mentioned augmented reality object.
It preferably, further include bracket of finding a view；
Intelligent terminal is mounted on described find a view on bracket；
The reflecting mirror found a view on bracket is set, the scene in bracket plane in front of finding a view is reflexed into intelligence
The camera of terminal；
A kind of contactless smart terminal control method of the augmented reality object provided according to the present invention, comprising:
Characteristic body identification step: acquisition image identifies multiple characteristic bodies from described image；
Characteristic body is laid out identification step: identifying the layout relationship between the multiple characteristic body；
Control instruction generation step: intelligent terminal control instruction is generated according to the layout relationship.
Preferably, further includes:
Image processing step: the described of the layout relationship arrangement are shown as according to the intelligent terminal control instruction more
A characteristic body.
Preferably, the characteristic body identification step, comprising:
Feature extraction identification step: according to feature that is following any or appointing a variety of elements to constitute, know from described image
The substance feature object of the feature is not provided:
Shape；
Color；
Pattern；
Lines；
Texture.
Preferably, the characteristic body is laid out identification step, comprising:
It is laid out matching step: with matching way, finding the default layout to match as institute from default layout set
State layout relationship.
Preferably, the layout matching step, including any one following step:
Gabarit matching step: detection obtains the gabarit of the spliced forming shape of the multiple characteristic body, gathers from default layout
In find out the default layout to match with the gabarit；
External envelope matching step: detecting the geometric center point of each characteristic body in the multiple characteristic body, obtains described each
The enveloping outer enclosure of the geometric center point of a characteristic body finds out from default layout set and presets with what the enveloping outer enclosure matched
Layout.
Preferably, the control instruction generation step, comprising:
Instructions match step: it from preset layout relationship table corresponding with instruction, finds out and with number layout relationship pair
The intelligent terminal control instruction answered.
Compared with prior art, the present invention have it is following the utility model has the advantages that
1, characteristic body is used to carry out contactless control to intelligent terminal as input medium, so that control experience is more
Hommization, and the convenience on computation is brought to special population (such as the children that not will use keyboard).
2, the Graphics Fusion that the characteristic body (such as seven-piece puzzle) in reality scene is combined into is superimposed using augmented reality
Virtual vision, acoustic information.
3, using the network savvy of intelligent terminal, by internet, conducive to the exchange realized between each player with interact,
The new playing method of seven-piece puzzle of remote interaction may be implemented.
Detailed description of the invention
Upon reading the detailed description of non-limiting embodiments with reference to the following drawings, other feature of the invention,
Objects and advantages will become more apparent upon:
Fig. 1 is step flow chart of the invention.
Fig. 2 is structural schematic diagram of the invention.
Fig. 3 is effect diagram of the invention.
In figure:
1- seven-piece puzzle entity
2- reflective mirror
The front camera of 3- plate intelligent terminal
4- plate intelligent terminal
5- finds a view bracket
6- desktop
7- player puts the hand of seven-piece puzzle
The hand for the player that 8- camera takes
The seven-piece plate pattern that 9- camera took be well placed
The three-dimensional virtual scene and object of 10- synthesis
Specific embodiment
The present invention is described in detail combined with specific embodiments below.Following embodiment will be helpful to the technology of this field
Personnel further understand the present invention, but the invention is not limited in any way.It should be pointed out that the ordinary skill of this field
For personnel, without departing from the inventive concept of the premise, several changes and improvements can also be made.These belong to the present invention
Protection scope.
A kind of contactless smart terminal control mechanism of the augmented reality object provided according to the present invention, comprising:
Characteristic body identification device: acquisition image identifies multiple characteristic bodies from described image；
Characteristic body is laid out identification device: identifying the layout relationship between the multiple characteristic body；
Control instruction generating means: intelligent terminal control instruction is generated according to the layout relationship；
Image processing apparatus: the described of the layout relationship arrangement are shown as according to the intelligent terminal control instruction more
A characteristic body.
The characteristic body identification device, comprising:
Feature extraction identification device: according to feature that is following any or appointing a variety of elements to constitute, know from described image
The substance feature object of the feature is not provided:
Shape；
Color；
Pattern；
Lines；
Texture.
The characteristic body is laid out identification device, comprising:
It is laid out coalignment: with matching way, finding the default layout to match as institute from default layout set
State layout relationship.
The layout coalignment, including any one following device:
Gabarit coalignment: detection obtains the gabarit of the spliced forming shape of the multiple characteristic body, gathers from default layout
In find out the default layout to match with the gabarit；
External envelope coalignment: detecting the geometric center point of each characteristic body in the multiple characteristic body, obtains described each
The enveloping outer enclosure of the geometric center point of a characteristic body finds out from default layout set and presets with what the enveloping outer enclosure matched
Layout.
The control instruction generating means, comprising:
Instructions match device: it from preset layout relationship table corresponding with instruction, finds out and with number layout relationship pair
The intelligent terminal control instruction answered.
A kind of contactless smart terminal control system of the augmented reality object provided according to the present invention, including band camera
Intelligent terminal, the intelligent terminal includes the contactless smart terminal control mechanism of above-mentioned augmented reality object.
The contactless smart terminal control system of the augmented reality object further includes bracket of finding a view；Intelligent terminal is mounted on
It is described to find a view on bracket；The reflecting mirror found a view on bracket is arranged in reflect the scene found a view in bracket plane in front
To the camera of intelligent terminal.
The contactless smart terminal control mechanism of augmented reality object of the present invention can be by mentioning according to the present invention
Step process in a kind of contactless smart terminal control method of the augmented reality object supplied is realized.
Specifically, the contactless smart terminal control method of the augmented reality object, comprising:
Characteristic body identification step: acquisition image identifies multiple characteristic bodies from described image；
Characteristic body is laid out identification step: identifying the layout relationship between the multiple characteristic body；
Control instruction generation step: intelligent terminal control instruction is generated according to the layout relationship；
Image processing step: the described of the layout relationship arrangement are shown as according to the intelligent terminal control instruction more
A characteristic body.
The characteristic body identification step, comprising:
Feature extraction identification step: according to feature that is following any or appointing a variety of elements to constitute, know from described image
The substance feature object of the feature is not provided:
Shape；
Color；
Pattern；
Lines；
Texture.
The characteristic body is laid out identification step, comprising:
It is laid out matching step: with matching way, finding the default layout to match as institute from default layout set
State layout relationship.
The layout matching step, including any one following step:
Gabarit matching step: detection obtains the gabarit of the spliced forming shape of the multiple characteristic body, gathers from default layout
In find out the default layout to match with the gabarit；
External envelope matching step: detecting the geometric center point of each characteristic body in the multiple characteristic body, obtains described each
The enveloping outer enclosure of the geometric center point of a characteristic body finds out from default layout set and presets with what the enveloping outer enclosure matched
Layout.
The control instruction generation step, comprising:
Instructions match step: it from preset layout relationship table corresponding with instruction, finds out and with number layout relationship pair
The intelligent terminal control instruction answered.
In a preferred embodiment, the quantity of characteristic body shares 7, each jigsaw respectively in seven-piece puzzle.It finds a view bracket
Ontology support plate intelligent terminal at an angle towards player, the angle of reflective mirror just can be by plate intelligent terminal
Preceding a piece of desktop area picture is reflected to the front camera of plate intelligent terminal, this desktop area picture is shown in plate
In the screen of intelligent terminal.Preferably use the pure color desktop of low color saturation.When identifying that seven-piece puzzle is spliced into one
When the shape of fish, image processing apparatus renders picture, and the fish that display screen shows that seven-piece puzzle is spliced into is strolled in ocean
Trip, and can cooperate with sound, light effect.It further, can more people's realization games on line by networking.
For example, plate intelligent terminal is placed on the bracket of desktop by player A, it is reflective in the camera alignment bracket of front
Mirror.After game starts, plays household entity seven-piece puzzle and risk a pattern on the desktop before plate intelligent terminal.Reflective mirror is by table
A panel region before the upper flat plate intelligent terminal of face is reflected on the front camera of plate intelligent terminal, and plate intelligent terminal continues
The picture for shooting this desktop area starts three-dimensional rendering module, wash with watercolours when recognizing the specific pattern that object for appreciation household seven-piece puzzle is risked
Contaminate three-dimensional virtual scene corresponding to this pattern.Desktop outdoor scene taken by the three-dimensional virtual scene and camera of rendering by with
Real enhancement method superposition is synthesized together, and is displayed on the screen.While showing picture, plate intelligent terminal play this seven
Voice and music corresponding to skilful plate pattern and virtual scene.At another player by network link, player B is with identical
Mode carry out game.After the completion of pattern is put in the spelling of both sides, seven-piece puzzle determination module will determine that result output is quantified, will
It generates data packet, is sent in the equipment of opponent player by network, while receiving the data packet that battle player device is sent,
The result of battle three-dimensional picture is rendered into together again to be superimposed upon on final display picture.
One skilled in the art will appreciate that in addition to realizing system provided by the invention in a manner of pure computer readable program code
And its other than each device, completely can by by method and step carry out programming in logic come so that system provided by the invention and its
Each device is in the form of logic gate, switch, specific integrated circuit, programmable logic controller (PLC) and embedded microcontroller etc.
To realize identical function.So system provided by the invention and its every device are considered a kind of hardware component, and it is right
The device for realizing various functions for including in it can also be considered as the structure in hardware component；It can also will be for realizing each
The device of kind function is considered as either the software module of implementation method can be the structure in hardware component again.
Specific embodiments of the present invention are described above.It is to be appreciated that the invention is not limited to above-mentioned
Particular implementation, those skilled in the art can make a variety of changes or modify within the scope of the claims, this not shadow
Ring substantive content of the invention.In the absence of conflict, the feature in embodiments herein and embodiment can any phase
Mutually combination.
Claims (8)
1. a kind of contactless smart terminal control mechanism of augmented reality object characterized by comprising
Characteristic body identification device: acquisition image identifies multiple characteristic bodies from described image；
Characteristic body is laid out identification device: identifying the layout relationship between the multiple characteristic body；
Control instruction generating means: intelligent terminal control instruction is generated according to the layout relationship；
The characteristic body is laid out identification device, comprising:
It is laid out coalignment: with matching way, finding the default layout to match as the cloth from default layout set
Office's relationship；
The layout coalignment, including any one following device:
Gabarit coalignment: detection obtains the gabarit of the spliced forming shape of the multiple characteristic body, looks into from default layout set
Find out the default layout to match with the gabarit；
External envelope coalignment: detecting the geometric center point of each characteristic body in the multiple characteristic body, obtains each spy
The enveloping outer enclosure for levying the geometric center point of object finds out the default cloth to match with the enveloping outer enclosure from default layout set
Office.
2. the contactless smart terminal control mechanism of augmented reality object according to claim 1, which is characterized in that also wrap
It includes:
Image processing apparatus: the multiple spy of the layout relationship arrangement is shown as according to the intelligent terminal control instruction
Levy object.
3. the contactless smart terminal control mechanism of augmented reality object according to claim 1, which is characterized in that described
Characteristic body identification device, comprising:
Feature extraction identification device: it according to feature that is following any or appointing a variety of elements to constitute, is identified from described image
Substance feature object with the feature:
Shape；
Color；
Pattern；
Lines；
Texture.
4. the contactless smart terminal control mechanism of augmented reality object according to claim 1, which is characterized in that described
Control instruction generating means, comprising:
Instructions match device: it from preset layout relationship table corresponding with instruction, finds out corresponding with number layout relationship
Intelligent terminal control instruction.
5. a kind of contactless smart terminal control system of augmented reality object, including the intelligent terminal with camera, feature
It is, the intelligent terminal includes the contactless smart terminal control of augmented reality object described in any one of Claims 1-4
Device processed.
6. the contactless smart terminal control system of augmented reality object according to claim 5, which is characterized in that also wrap
Include bracket of finding a view；
Intelligent terminal is mounted on described find a view on bracket；
The reflecting mirror found a view on bracket is set, the scene in bracket plane in front of finding a view is reflexed into intelligent terminal
Camera.
7. a kind of contactless smart terminal control method of augmented reality object characterized by comprising
Characteristic body identification step: acquisition image identifies multiple characteristic bodies from described image；
Characteristic body is laid out identification step: identifying the layout relationship between the multiple characteristic body；
Control instruction generation step: intelligent terminal control instruction is generated according to the layout relationship；
The characteristic body is laid out identification step, comprising:
It is laid out matching step: with matching way, finding the default layout to match as the cloth from default layout set
Office's relationship；
The layout matching step, including any one following step:
Gabarit matching step: detection obtains the gabarit of the spliced forming shape of the multiple characteristic body, looks into from default layout set
Find out the default layout to match with the gabarit；
External envelope matching step: detecting the geometric center point of each characteristic body in the multiple characteristic body, obtains each spy
The enveloping outer enclosure for levying the geometric center point of object finds out the default cloth to match with the enveloping outer enclosure from default layout set
Office.
8. the contactless smart terminal control method of augmented reality object according to claim 7, which is characterized in that also wrap
It includes:
Image processing step: the multiple spy of the layout relationship arrangement is shown as according to the intelligent terminal control instruction
Levy object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610031686.XA CN105718054B (en) | 2016-01-18 | 2016-01-18 | The contactless smart terminal control method and device of augmented reality object, system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610031686.XA CN105718054B (en) | 2016-01-18 | 2016-01-18 | The contactless smart terminal control method and device of augmented reality object, system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105718054A CN105718054A (en) | 2016-06-29 |
| CN105718054B true CN105718054B (en) | 2019-05-10 |
Family
ID=56147240
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610031686.XA Active CN105718054B (en) | 2016-01-18 | 2016-01-18 | The contactless smart terminal control method and device of augmented reality object, system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105718054B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106709959B (en) * | 2017-01-09 | 2019-12-17 | 成都极米科技股份有限公司 | method and device for recognizing chocolate plate and electronic equipment |
| CN108345907B (en) * | 2018-02-09 | 2022-02-11 | 广东美的制冷设备有限公司 | Recognition method, augmented reality device, and storage medium |
| CN109453508A (en) * | 2018-10-29 | 2019-03-12 | 奇想空间（北京）教育科技有限公司 | Amusement facility based on seven-piece puzzle |
| CN110569907B (en) * | 2019-09-10 | 2022-03-04 | 网易（杭州）网络有限公司 | Method and device for identifying splicing pattern, computer storage medium and electronic equipment |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6044079B2 (en) * | 2012-02-06 | 2016-12-14 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
| JP6041604B2 (en) * | 2012-09-27 | 2016-12-14 | 京セラ株式会社 | Display device, control system, and control program |
-
2016
- 2016-01-18 CN CN201610031686.XA patent/CN105718054B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105718054A (en) | 2016-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107852573B (en) | Mixed reality social interactions | |
| US9898872B2 (en) | Mobile tele-immersive gameplay | |
| US7445549B1 (en) | Networked portable and console game systems | |
| US7905779B2 (en) | Video game including effects for providing different first person experiences of the same video game world and a storage medium storing software for the video game | |
| US8866848B2 (en) | Image processing device, control method for an image processing device, program, and information storage medium | |
| CN105718054B (en) | The contactless smart terminal control method and device of augmented reality object, system | |
| US10380803B1 (en) | Methods and systems for virtualizing a target object within a mixed reality presentation | |
| WO2016011788A1 (en) | Augmented reality technology-based handheld reading device and method thereof | |
| KR102090891B1 (en) | Methods and devices for generating eye images | |
| WO2010020739A1 (en) | Entertainment device and method of interaction | |
| CN106730815A (en) | The body-sensing interactive approach and system of a kind of easy realization | |
| JP2013097473A (en) | Game processing system, game processing method, game processing device, and game processing program | |
| JP2012164236A (en) | Object | |
| US6717575B2 (en) | Image drawing method, image drawing apparatus, recording medium, and program | |
| JP2005319029A (en) | Program, information storage medium, and image generating system | |
| JP2002092633A (en) | Game system and information storage medium | |
| JP2012164235A (en) | Program, information storage medium, reader, and server | |
| JP2004073241A (en) | Game system, program, and information storage medium | |
| JP2005209217A (en) | Game system and information storage medium | |
| JP2003175274A (en) | Game system and information memory medium | |
| JP2005275796A (en) | Program, information storage medium, and image generation system | |
| JP2005319106A (en) | Program, information storage medium, and image forming system | |
| JP2002373348A (en) | Image generation system, program and information storage medium | |
| WO2023119715A1 (en) | Video generation method and image generation program | |
| CN111651048B (en) | Multi-virtual object arrangement display method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |