CN106648074A - Man-machine interaction method of intelligent robot - Google Patents
Man-machine interaction method of intelligent robot Download PDFInfo
- Publication number
- CN106648074A CN106648074A CN201611055100.XA CN201611055100A CN106648074A CN 106648074 A CN106648074 A CN 106648074A CN 201611055100 A CN201611055100 A CN 201611055100A CN 106648074 A CN106648074 A CN 106648074A
- Authority
- CN
- China
- Prior art keywords
- intelligent robot
- control device
- man
- action
- machine interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Manipulator (AREA)
- Toys (AREA)
Abstract
The invention discloses a man-machine interaction method of an intelligent robot. The method at least includes the following execution steps that a control device gives a command to a 3D holographic projection device to generate an animated image with a holographic effect; an image sensor shoots the face image and limb action of an interaction object and transmits the face image and the limb action to the control device; a sound sensor and the image sensor are synchronous, and the sound of the interaction object is recorded and transmitted to the control device; the control device processes the information transmitted by the image sensor and the sound sensor, compared with prestored information, a command for control over the 3D holographic projection device and the sound device is generated, then the animated image with the holographic effect generates action, an execution mechanism is instructed to control the robot to generate or not to generate action, and meanwhile audio frequency corresponding to the action is played or not played. Holographic projection is integrated on the robot, man-machine interaction is carried out according to the sound, expression, limb action and other information fed back by the sensors, a traditional communication mode of a liquid crystal panel interaction interface is changed, man-machine interaction is more stereoscopic and vivid, and recreation interactivity is higher. Meanwhile, by the utilization of autonomous moving of the robot, obstacles can be intelligently avoided.
Description
Technical field
The invention belongs to artificial intelligence field, and in particular to a kind of man-machine interaction method of intelligent robot.
Background technology
Traditional Brand Marketing adopts the LED display with electronic advertisement board as characteristic or billboard mode.This color
Bright-coloured advertising, can to a certain extent help Brand Marketing or product promotion.However, reality is, daily life
People are only that display device is thrown to take a glance at hurriedly to these advertisement most cases in work, and unconsciously have ignored advertisement
Main contents information.And current advertisement form can not realize the interaction with people, not possess recreational.
In addition, also have a kind of image dress ornament of confession people wearing performance in conventional ads form, to reach and crowd's interaction
Purpose.But, this interactive effect apparently depends on the quality of performing artist, and needs other means such as stage property, leaflet
Etc. being aided in, content is single.
With development in science and technology, occurring in that on market a kind of can play audio frequency, video and can carry out the advertisement of simple question and answer
Robot.But, the advertisement form content is also more single, it is impossible to carry out depth interaction with crowd, recreational not high.
The content of the invention
The purpose of the present invention is precisely in order to improve the interactive and recreational of Brand Marketing, it is proposed that a kind of artificial intelligence's
Method, makes every effort to, by the interaction between people and robot, marketing message be passed to into spectators in more recreational mode.
The invention provides a kind of man-machine interaction method of intelligent robot, the intelligent robot is at least including control dress
Put, 3D holographic projectors, imageing sensor, sound transducer, actuator；
The intelligent robot at least performs following operation：
Control device instruction 3D holographic projectors generate the animating image of holographic effect；
Imageing sensor shoots the facial image and limb action of interactive object, and sends control device to；Sound sensor
Device is synchronous with imageing sensor, records the sound of interactive object, and sends control device to；
Control device processes the information of imageing sensor and sound transducer transmission, and compares with prestored information, generates control
The instruction of 3D holographic projectors processed and voice device, and then the animating image generation action of holographic effect is caused, and instruction is held
Row mechanism controls intelligent robot produces or does not produce action, while playing or not playing audio frequency corresponding with action.
Further, the intelligent robot also includes diastimeter, can measure intelligent robot with interactive objects or outer
The distance of portion's scenery, and send control device to.
Preferably, described image sensor at least one.
Preferably, described image sensor is two binocular depth photographic head, intelligent robot front is separately mounted to
And rear.
Preferably, described image sensor is ccd video camera.
The present invention proposes a kind of brand-new man-machine friendship of product advertising medium publicity equipment using the artificial carrier of intelligent machine
Mutual method.Integrated line holographic projections carry out man-machine interaction in robot, change the exchange of traditional liquid crystal panel interactive interface
Mode, man-machine interaction is more three-dimensional lively, and entertainment interactive is higher.Simultaneously using the autonomous of robot, it is possible to achieve intelligence
Can avoidance.
Description of the drawings
Fig. 1 is the man-machine interaction logic chart of the present invention.
Specific embodiment
The present invention is described in further detail below in conjunction with the accompanying drawings.
Referring to the logic diagram shown in accompanying drawing 1, the man-machine interaction method of a kind of intelligent robot of the present invention, based on one kind
At least include the intelligent robots of part such as control device, 3D holographic projectors, multiple sensors, actuator and propose.
The robot controller of the present invention can be the microprocessor (CPU) of certain model, prestore animation fragment, should
Storage information can generate the animating image of holographic effect by 3D holographic projectors.The animating image can have walk,
The different shape such as sleep, dance, staring blankly, flashing.
At least include imageing sensor (such as ccd video camera/shooting is first-class), sound transducer in multiple sensors, surpass
Sound-ranging equipment and/or laser range finder etc..
Imageing sensor is clapped for taking the photograph the facial image and limb action of interactive object, and sends control device to.It is above-mentioned
Photographic head at least one, can be binocular or three mesh photographic head, or depth camera or binocular depth, three mesh depth
Photographic head.When using multiple sensors, can by each sensor point row or towards multiple directions arrangement, with obtain greater angle and
The external information of latitude.Further, intelligent robot can be measured with interactive objects or outside using multiple images sensor
The space geometry relation of scenery, can extract more sufficient interactive background information.
Such as, imageing sensor can use 2 photographic head, be separately mounted to robot front and back, can cooperate with
The larger range of external environment condition to before and after, such as artificial abortion, furniture, green plant movement and fixed target carry out information gathering；Also may be used
Updated with carrying out instant external environmental information with one of binocular camera, another can be used to gather interactive object
Body kinematicses information, so as to carry out the interaction based on gesture or action.
Sound transducer is synchronous with imageing sensor, records the sound of interactive object, and sends control device to.Ultrasound wave
Diastimeter or laser range finder can robot measurement and interactive objects or the distance of outside scenery, and send control device to.
The most basic function of diastimeter, can be such that robot easily walks in crowd without touching with pedestrian or other barriers
Hit.
Imageing sensor cooperates with the gathered data of diastimeter, can make robot in real crowded field
Under institute, such as shop, show room or airport environment, according to the target of setting, the direction and side of oneself movement are found in crowd
Formula.
Control device searches facial expression, limb action, the speech intonation information for prestoring, and the emotion of interactive object is made
Judge, and combine range information, the control instruction for prestoring is sent to 3D holographic projectors, actuator, voice device etc., enter
And cause the animating image of holographic effect to produce expression and action, such as smile, it is excited, dejected, shake hands, dance for joy, and refer to
Make actuating mechanism controls robot produce or not produce action, such as retreat, avoid, turning round, dancing, while playing or not playing
Audio frequency corresponding with action.
According to above-mentioned method, the expression of the animating image of 3D hologram effect, sound and action logically have phase
Closing property or concordance.It is seemingly based on animating image itself will that i.e. interactive object can experience the action of robot or sound
Produce.Thus interactive object naturally can make the appropriate interactive action of next step according to the situation of animating image.
This exchange way clearly enhances the interest of human-computer interaction with effect.
Specific to embodiment, the man-machine interaction method of a kind of intelligent robot of the present invention, using holographic 3D animating images
(the smart line holographic projections as being located at robot transparent material head) are made accordingly to the expression of interactive object, language and action
Reaction, while interactive object also can make further cross reaction according to the expression of animating image, language and action.From
And, user can be interactive by linking up with the holographic spirit images of 3D, reaches the purpose with robot interactive.Robot bottom has many
Individual wheel, depends on range sensor and video camera, it is possible to achieve the motion of Autonomous Control, such as go forward " shaking hands " or barrier
Detour.
Present invention line holographic projections integrated in robot carry out man-machine interaction, change traditional liquid crystal panel interactive interface
Exchange way, man-machine interaction is more three-dimensional lively, and entertainment interactive is higher.Simultaneously using the autonomous of robot, can be with
Realize intelligent barrier avoiding.
It is obvious to a person skilled in the art that the invention is not restricted to the details of above-mentioned one exemplary embodiment, Er Qie
In the case of spirit or essential attributes without departing substantially from the present invention, the present invention can be in other specific forms realized.Therefore, no matter
From the point of view of which point, embodiment all should be regarded as exemplary, and be nonrestrictive, the scope of the present invention is by appended power
Profit is required rather than described above is limited, it is intended that all in the implication and scope of the equivalency of claim by falling
Change is included in the present invention.Any reference in claim should not be considered as and limit involved claim.
Moreover, it will be appreciated that although this specification is been described by according to embodiment, not each embodiment is only wrapped
Containing an independent technical scheme, this narrating mode of description is only that for clarity those skilled in the art should
Using description as an entirety, the technical scheme in each embodiment can also Jing it is appropriately combined, form those skilled in the art
Understandable other embodiment.
Claims (4)
1. a kind of man-machine interaction method of intelligent robot, it is characterised in that：
The intelligent robot at least includes control device, 3D holographic projectors, imageing sensor, sound transducer, execution
Mechanism；
The intelligent robot at least performs following operation：
Control device instruction 3D holographic projectors generate the animating image of holographic effect；
Imageing sensor shoots the facial image and limb action of interactive object, and sends control device to；Sound transducer with
Imageing sensor synchronization, records the sound of interactive object, and sends control device to；
Control device processes the information of imageing sensor and sound transducer transmission, and compares with prestored information, generates control 3D
The instruction of holographic projector and voice device, and then the animating image generation action of holographic effect is caused, and instruct execution machine
Structure control intelligent robot produces or does not produce action, while playing or not playing audio frequency corresponding with action.
2. the man-machine interaction method of a kind of intelligent robot according to claim 1, it is characterised in that：
The intelligent robot also includes diastimeter, can measure intelligent robot and interactive objects or the distance of outside scenery,
And send control device to.
3. the man-machine interaction method of a kind of intelligent robot according to claim 1, it is characterised in that：
Described image sensor at least one.
4. the man-machine interaction method of a kind of intelligent robot according to claim 3, it is characterised in that：Described image is sensed
Device is two binocular depth photographic head, is separately mounted to intelligent robot front and back.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611055100.XA CN106648074A (en) | 2016-11-25 | 2016-11-25 | Man-machine interaction method of intelligent robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611055100.XA CN106648074A (en) | 2016-11-25 | 2016-11-25 | Man-machine interaction method of intelligent robot |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106648074A true CN106648074A (en) | 2017-05-10 |
Family
ID=58812078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611055100.XA Pending CN106648074A (en) | 2016-11-25 | 2016-11-25 | Man-machine interaction method of intelligent robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106648074A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107203149A (en) * | 2017-07-24 | 2017-09-26 | 中山市博林树投资管理有限公司 | A kind of virtual artificial intelligence companion |
| CN107256081A (en) * | 2017-05-11 | 2017-10-17 | 芜湖威灵数码科技有限公司 | A kind of touch line holographic projections interactive device |
| CN107300877A (en) * | 2017-07-26 | 2017-10-27 | 佛山伊贝尔科技有限公司 | A kind of hologram three-dimensional projects robot |
| CN107351083A (en) * | 2017-07-26 | 2017-11-17 | 佛山伊贝尔科技有限公司 | A kind of holographic intelligent robot |
| CN107351082A (en) * | 2017-07-26 | 2017-11-17 | 佛山伊贝尔科技有限公司 | A kind of human-computer dialogue holography robot |
| CN108322794A (en) * | 2018-03-26 | 2018-07-24 | 青岛里奥机器人技术有限公司 | Robot holography 3D image show methods |
| CN108877347A (en) * | 2018-08-02 | 2018-11-23 | 安徽硕威智能科技有限公司 | Classroom outdoor scene reproducing interactive tutoring system based on robot projection function |
| CN108932167A (en) * | 2017-05-22 | 2018-12-04 | 中兴通讯股份有限公司 | A kind of intelligent answer synchronous display method, device, system and storage medium |
| CN109040875A (en) * | 2018-08-27 | 2018-12-18 | 深圳普罗米修斯视觉技术有限公司 | A kind of holographic communication system with intelligent sound box |
| CN110014431A (en) * | 2017-11-28 | 2019-07-16 | 丰田自动车株式会社 | Communication device |
| CN110588550A (en) * | 2019-09-08 | 2019-12-20 | 一汽轿车股份有限公司 | Man-machine interaction system based on artificial intelligence |
| CN110751951A (en) * | 2019-10-25 | 2020-02-04 | 智亮君 | Handshake interaction method and system based on intelligent mirror and storage medium |
| CN111309153A (en) * | 2020-03-25 | 2020-06-19 | 北京百度网讯科技有限公司 | Control method and device for man-machine interaction, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105427865A (en) * | 2015-11-04 | 2016-03-23 | 百度在线网络技术（北京）有限公司 | Voice control system and method of intelligent robot based on artificial intelligence |
| CN105446953A (en) * | 2015-11-10 | 2016-03-30 | 深圳狗尾草智能科技有限公司 | Intelligent robot and virtual 3D interactive system and method |
| CN105511608A (en) * | 2015-11-30 | 2016-04-20 | 北京光年无限科技有限公司 | Intelligent robot based interaction method and device, and intelligent robot |
| CN105759973A (en) * | 2016-03-09 | 2016-07-13 | 电子科技大学 | Far-near distance man-machine interactive system based on 3D sight estimation and far-near distance man-machine interactive method based on 3D sight estimation |
| CN205521501U (en) * | 2015-11-14 | 2016-08-31 | 华中师范大学 | Robot based on three -dimensional head portrait of holographically projected 3D |
-
2016
- 2016-11-25 CN CN201611055100.XA patent/CN106648074A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105427865A (en) * | 2015-11-04 | 2016-03-23 | 百度在线网络技术（北京）有限公司 | Voice control system and method of intelligent robot based on artificial intelligence |
| CN105446953A (en) * | 2015-11-10 | 2016-03-30 | 深圳狗尾草智能科技有限公司 | Intelligent robot and virtual 3D interactive system and method |
| CN205521501U (en) * | 2015-11-14 | 2016-08-31 | 华中师范大学 | Robot based on three -dimensional head portrait of holographically projected 3D |
| CN105511608A (en) * | 2015-11-30 | 2016-04-20 | 北京光年无限科技有限公司 | Intelligent robot based interaction method and device, and intelligent robot |
| CN105759973A (en) * | 2016-03-09 | 2016-07-13 | 电子科技大学 | Far-near distance man-machine interactive system based on 3D sight estimation and far-near distance man-machine interactive method based on 3D sight estimation |
Non-Patent Citations (1)
| Title |
|---|
| 刘洞波等: "《移动机器人粒子滤波定位与地图创建》", 30 September 2016 * |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107256081A (en) * | 2017-05-11 | 2017-10-17 | 芜湖威灵数码科技有限公司 | A kind of touch line holographic projections interactive device |
| CN108932167A (en) * | 2017-05-22 | 2018-12-04 | 中兴通讯股份有限公司 | A kind of intelligent answer synchronous display method, device, system and storage medium |
| CN108932167B (en) * | 2017-05-22 | 2023-08-08 | 中兴通讯股份有限公司 | Intelligent question-answer synchronous display method, device and system and storage medium |
| CN107203149A (en) * | 2017-07-24 | 2017-09-26 | 中山市博林树投资管理有限公司 | A kind of virtual artificial intelligence companion |
| CN107300877A (en) * | 2017-07-26 | 2017-10-27 | 佛山伊贝尔科技有限公司 | A kind of hologram three-dimensional projects robot |
| CN107351083A (en) * | 2017-07-26 | 2017-11-17 | 佛山伊贝尔科技有限公司 | A kind of holographic intelligent robot |
| CN107351082A (en) * | 2017-07-26 | 2017-11-17 | 佛山伊贝尔科技有限公司 | A kind of human-computer dialogue holography robot |
| CN110014431A (en) * | 2017-11-28 | 2019-07-16 | 丰田自动车株式会社 | Communication device |
| CN108322794B (en) * | 2018-03-26 | 2020-12-15 | 临沂文衡信息技术有限公司 | Holographic 3D image display method for robot |
| CN108322794A (en) * | 2018-03-26 | 2018-07-24 | 青岛里奥机器人技术有限公司 | Robot holography 3D image show methods |
| CN108877347A (en) * | 2018-08-02 | 2018-11-23 | 安徽硕威智能科技有限公司 | Classroom outdoor scene reproducing interactive tutoring system based on robot projection function |
| CN109040875A (en) * | 2018-08-27 | 2018-12-18 | 深圳普罗米修斯视觉技术有限公司 | A kind of holographic communication system with intelligent sound box |
| CN110588550A (en) * | 2019-09-08 | 2019-12-20 | 一汽轿车股份有限公司 | Man-machine interaction system based on artificial intelligence |
| CN110751951A (en) * | 2019-10-25 | 2020-02-04 | 智亮君 | Handshake interaction method and system based on intelligent mirror and storage medium |
| CN110751951B (en) * | 2019-10-25 | 2022-11-11 | 智亮君 | Handshake interaction method and system based on intelligent mirror and storage medium |
| CN111309153A (en) * | 2020-03-25 | 2020-06-19 | 北京百度网讯科技有限公司 | Control method and device for man-machine interaction, electronic equipment and storage medium |
| CN111309153B (en) * | 2020-03-25 | 2024-04-09 | 北京百度网讯科技有限公司 | Man-machine interaction control method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106648074A (en) | Man-machine interaction method of intelligent robot | |
| US11669152B2 (en) | Massive simultaneous remote digital presence world | |
| US11073916B2 (en) | Extramissive spatial imaging digital eye glass apparatuses, methods and systems for virtual or augmediated vision, manipulation, creation, or interaction with objects, materials, or other entities | |
| CN107154069B (en) | Data processing method and system based on virtual roles | |
| KR101327995B1 (en) | Apparatus and method for processing performance on stage using digital character | |
| KR101917630B1 (en) | System and method for augmented and virtual reality | |
| US9196074B1 (en) | Refining facial animation models | |
| Allison | More than a man in a monkey suit: Andy Serkis, motion capture, and digital realism | |
| US20110304629A1 (en) | Real-time animation of facial expressions | |
| EP2526527A1 (en) | Capturing views and movements of actors performing within generated scenes | |
| US11823316B2 (en) | Photoreal character configurations for spatial computing | |
| CN104704535A (en) | Augmented reality system | |
| CN106737750A (en) | A kind of man-machine interactive intelligent robot | |
| JPWO2020095368A1 (en) | Information processing system, display method and computer program | |
| Michailova et al. | Realism and animation | |
| Tang et al. | Emerging human-toy interaction techniques with augmented and mixed reality | |
| O'Sullivan et al. | Metropolis: multisensory simulation of a populated city | |
| KR102411533B1 (en) | System and method for robot interaction holographic display | |
| Fomina | Conceptual metaphors in augmented reality projects | |
| Doroski | Thoughts of spirits in madness: Virtual production animation and digital technologies for the expansion of independent storytelling | |
| Gomide | Motion capture and performance | |
| Thandu | An Exploration of Virtual Reality Technologies for Museums | |
| Rehak | 3. Chains of Evidence: Augmented Performance before and after the Digital | |
| Saltz | Sharing the Stage with Media | |
| WO2020261341A1 (en) | Graphic game program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20171106 Address after: 230088 E1 building, 2800 Innovation Industrial Park, 507 innovation Avenue, Hefei hi tech Zone, Anhui Applicant after: Hefei Zhongke Aowei Intelligent Technology Co Ltd Address before: 230088 E1 building, 2800 Innovation Industrial Park, 504 innovation Avenue, Hefei hi tech Zone, Anhui Applicant before: Hefei wisdom Intelligent Technology Co., Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190221 Address after: 230088 Room 1102-A002, 11th floor, Zhongxin Building, Northeast corner of the junction of Innovation Avenue and Wangjiangxi Road, Hefei High-tech Zone, Anhui Province Applicant after: Hefei Hong Hui Technology Co. Ltd. Address before: 230088 Room 507, E1 Building, Innovation Industrial Park, 2800 Innovation Avenue, Hefei High-tech Zone, Anhui Province Applicant before: Hefei Zhongke Aowei Intelligent Technology Co Ltd |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |
|
| RJ01 | Rejection of invention patent application after publication |