WO2018148874A1 - Smart robot based on camera navigation and control method therefor - Google Patents
Smart robot based on camera navigation and control method therefor Download PDFInfo
- Publication number
- WO2018148874A1 WO2018148874A1 PCT/CN2017/073571 CN2017073571W WO2018148874A1 WO 2018148874 A1 WO2018148874 A1 WO 2018148874A1 CN 2017073571 W CN2017073571 W CN 2017073571W WO 2018148874 A1 WO2018148874 A1 WO 2018148874A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- intelligent robot
- camera
- mobile terminal
- navigation
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 238000004891 communication Methods 0.000 claims abstract description 16
- 230000007613 environmental effect Effects 0.000 claims description 4
- 230000004044 response Effects 0.000 abstract description 3
- 230000002452 interceptive effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 3
- 238000004140 cleaning Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
Definitions
- the invention relates to the field of robot control, and in particular to an intelligent robot based on camera navigation and a control method thereof.
- robots are becoming more and more popular. With the miniaturization and cost reduction of robots, they have gradually entered the family life of ordinary users. For example, depending on the function of the robot, it can be generally divided into a cleaning robot, a window cleaning robot, a service robot, a care robot, and the like.
- robots may lack effective interaction with users. For example, the robot cannot get back to the user in time.
- the present invention provides an intelligent robot based on camera navigation, comprising: a communication module, configured to communicate with a user's mobile terminal, receive a user instruction, and feed back a corresponding instruction result to the mobile terminal, wherein
- the user instruction includes returning a user position from the current location of the intelligent robot to the mobile terminal, the user instruction further including a current environment image of the user; and a camera navigation module configured to locate by using the captured image of the camera a current location of the intelligent robot, and using the current environment image to locate a current location of the user; a control module configured to perform navigation processing according to a current location of the smart robot and a current location of the user, and Generating a motor control signal and the command result; and a motor module for walking in accordance with the navigation route in accordance with the motor control signal.
- the communication module is a Bluetooth communication module.
- the communication module is an infrared communication module.
- the camera navigation module includes: an image acquisition unit configured to acquire an image by using a camera; a positioning unit configured to match the acquired image and map data and perform positioning of a current location; and a map storage unit, Used to store the map data and form a map.
- control module includes: a user instruction receiving unit, configured to receive the user instruction from the mobile terminal; a navigation processing unit, configured to be based on a current location of the smart robot and the user a current position for performing navigation processing; an underlying motor control unit for generating the motor control signal; and an instruction result generating unit for generating the instruction result accordingly.
- the present invention also provides an intelligent robot control method based on camera navigation, comprising: communicating with a user's mobile terminal to receive a user instruction, wherein the user instruction includes returning from the current location of the intelligent robot to the mobile terminal a user location, the user instruction further including a current environment image of the user; using a captured image of the camera to locate a current location of the smart robot, and using the current environment image to locate a current location of the user; Performing navigation processing on the current position of the intelligent robot and the current position of the user, and generating a motor control signal and the command result; and walking according to the navigation route according to the motor control signal, and feeding back corresponding command results The mobile terminal.
- the step of communicating with the user's mobile terminal includes communicating using a Bluetooth module.
- the step of communicating with the user's mobile terminal includes communicating using an infrared module.
- the step of locating the current location of the smart robot with the captured image of the camera, and locating the current location of the user using the current environment image comprises: capturing an image with a camera; matching the Acquiring images and map data and performing local location positioning; and storing the map data and forming a map.
- the intelligent robot based on camera navigation provided by the invention and the control method thereof can effectively realize the interaction operation between the user and the robot, and the current position of the intelligent robot is fast in response to the user instruction. Quickly and accurately return to the user location of the mobile terminal.
- FIG. 1 is a block diagram of an intelligent robot based on camera navigation in accordance with an embodiment of the present invention.
- FIG. 2 is a block diagram of the control module of Figure 1.
- FIG. 3 is a block diagram of the camera navigation module of FIG. 1.
- FIG. 4 is a flow chart showing a method for controlling an intelligent robot based on camera navigation according to an embodiment of the present invention.
- FIG. 1 is a block diagram of a smart camera 100 based on camera navigation in accordance with an embodiment of the present invention.
- the camera-based intelligent robot 100 may include a communication module 102 for communicating with a user's mobile terminal (not shown), receiving user instructions, and feeding back corresponding instruction results to the mobile terminal.
- the user instructions may include returning a user location from the current location of the intelligent robot to the mobile terminal, the user instructions may further include a current environmental image of the user (eg, a ceiling image including a plurality of location feature points) ).
- the communication module can be a Bluetooth communication module.
- the communication module can be an infrared communication module.
- the camera navigation based intelligent robot 100 may further include a camera navigation module 108 for The current position of the intelligent robot 100 is located using the captured image of the camera, and the current location of the user is located using the current environmental image.
- the intelligent robot 100 based on camera navigation may further include a control module 106 for performing navigation processing according to the current position of the intelligent robot and the current position of the user, and generating a motor control signal and the instruction result.
- a control module 106 for performing navigation processing according to the current position of the intelligent robot and the current position of the user, and generating a motor control signal and the instruction result.
- the intelligent robot 100 based on camera navigation may further include a motor module 104 for walking in accordance with the navigation route according to the motor control signal.
- control module 106 can include a user instruction receiving unit 202 for receiving the user instruction from the mobile terminal, and a navigation processing unit 204 for determining a current location of the smart robot and The current position of the user is used for navigation processing; the bottom motor control unit 206 is configured to generate the motor control signal; and the instruction result generating unit is configured to generate the instruction result accordingly.
- FIG. 3 is a block diagram of the camera navigation module 108 of FIG.
- the camera navigation module 108 may include: an image acquisition unit 302 for acquiring an image by using a camera; a positioning unit 304, configured to match the collected image and map data and perform positioning of a current position;
- the map storage unit 306 is configured to store the map data and form a map.
- FIG. 4 is a flow diagram of a smart robot control method 400 based on camera navigation in accordance with an embodiment of the present invention.
- the intelligent robot control method 400 based on camera navigation may include the following steps:
- Step 410 Communicate with a user's mobile terminal, receiving a user instruction, where the user instruction includes returning a user location from the current location of the intelligent robot to the mobile terminal, the user instruction further including the user's current Environmental image.
- the step 410 of communicating with a user's mobile terminal can include communicating using a Bluetooth module.
- the step 410 of communicating with the user's mobile terminal may include: Communicate with the infrared module.
- Step 420 Locating the current position of the intelligent robot by using the captured image of the camera, and using the current environment image to locate the current location of the user.
- the step of using the captured image of the camera to locate the current location of the intelligent robot and using the current environment image to locate the current location of the user may include: capturing images using a camera; matching The captured image and map data are positioned for current location; and the map data is stored and a map is formed.
- Step 430 Perform navigation processing according to the current location of the intelligent robot and the current location of the user, and generate a motor control signal and the instruction result.
- Step 440 Follow the navigation route according to the motor control signal, and feed back the corresponding command result to the mobile terminal.
- the camera-based intelligent robot and the control method thereof provided by the invention can effectively realize the interaction operation between the user and the robot, and quickly and accurately return from the current position of the intelligent robot to the user position of the mobile terminal in response to the user instruction. .
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
- Navigation (AREA)
Abstract
Description
Claims (9)
- 一种基于摄像头导航的智能机器人,包括:An intelligent robot based on camera navigation, including:通信模块,用于与用户的移动终端进行通信,接收用户指令,并将对应的指令结果反馈给所述移动终端,其中所述用户指令包括从所述智能机器人的当前位置返回到所述移动终端的用户位置,所述用户指令还包括所述用户的当前环境图像;a communication module, configured to communicate with a user's mobile terminal, receive a user instruction, and feed back a corresponding instruction result to the mobile terminal, wherein the user instruction includes returning from the current location of the intelligent robot to the mobile terminal User location, the user instruction further including a current environment image of the user;摄像头导航模块,用于利用摄像头的采集图像来定位所述智能机器人的当前位置,以及利用所述当前环境图像来定位所述用户的当前位置;a camera navigation module, configured to use a captured image of the camera to locate a current location of the intelligent robot, and use the current environment image to locate a current location of the user;控制模块,用于根据所述智能机器人的当前位置和所述用户的当前位置来进行导航处理,并且产生电机控制信号和所述指令结果;以及a control module, configured to perform navigation processing according to a current location of the intelligent robot and a current location of the user, and generate a motor control signal and the instruction result;电机模块,用于根据所述电机控制信号而按照导航路线行走。And a motor module for walking according to the navigation route according to the motor control signal.
- 如权利要求1所述的智能机器人,其特征在于,所述通信模块为蓝牙通信模块。The intelligent robot of claim 1 wherein said communication module is a Bluetooth communication module.
- 如权利要求1所述的智能机器人,其特征在于,所述通信模块为红外通信模块。The intelligent robot of claim 1 wherein said communication module is an infrared communication module.
- 如权利要求1所述的智能机器人,其特征在于,所述摄像头导航模块包括:The intelligent robot according to claim 1, wherein the camera navigation module comprises:图像采集单元,用于利用摄像头采集图像;An image acquisition unit for acquiring an image by using a camera;定位单元,用于匹配所述采集的图像与地图数据并且进行当前位置的定位;以及a positioning unit configured to match the acquired image and map data and perform positioning of a current location;地图存储单元,用于存储所述地图数据并且形成地图。A map storage unit for storing the map data and forming a map.
- 如权利要求1所述的智能机器人,其特征在于,所述控制模块包括: The intelligent robot of claim 1 wherein said control module comprises:用户指令接收单元,用于接收来自所述移动终端的所述用户指令;a user instruction receiving unit, configured to receive the user instruction from the mobile terminal;导航处理单元,用于根据所述智能机器人的当前位置和所述用户的当前位置来进行导航处理;a navigation processing unit, configured to perform navigation processing according to a current location of the intelligent robot and a current location of the user;底层电机控制单元,用于产生所述电机控制信号;以及An underlying motor control unit for generating the motor control signal;指令结果生成单元,用于相应产生所述指令结果。The instruction result generating unit is configured to generate the instruction result accordingly.
- 一种基于摄像头导航的智能机器人控制方法,包括:An intelligent robot control method based on camera navigation, comprising:与用户的移动终端进行通信,接收用户指令,其中所述用户指令包括从所述智能机器人的当前位置返回到所述移动终端的用户位置,所述用户指令还包括所述用户的当前环境图像;Communicating with a user's mobile terminal, receiving user instructions, wherein the user instructions include returning to a user location of the mobile terminal from a current location of the intelligent robot, the user instructions further including a current environmental image of the user;利用摄像头的采集图像来定位所述智能机器人的当前位置,以及利用所述当前环境图像来定位所述用户的当前位置;Using a captured image of the camera to locate a current location of the intelligent robot, and utilizing the current environment image to locate a current location of the user;根据所述智能机器人的当前位置和所述用户的当前位置来进行导航处理,并且产生电机控制信号和所述指令结果;以及Performing navigation processing according to a current position of the intelligent robot and a current position of the user, and generating a motor control signal and the instruction result;根据所述电机控制信号而按照导航路线行走,并将对应的指令结果反馈给所述移动终端。Walking according to the motor control signal according to the navigation route, and feeding back corresponding command results to the mobile terminal.
- 如权利要求6所述的智能机器人控制方法,其特征在于,所述与用户的移动终端进行通信的步骤包括:利用蓝牙模块进行通信。The intelligent robot control method according to claim 6, wherein said step of communicating with a user's mobile terminal comprises: communicating using a Bluetooth module.
- 如权利要求6所述的智能机器人控制方法,其特征在于,所述与用户的移动终端进行通信的步骤包括:利用红外模块进行通信。The intelligent robot control method according to claim 6, wherein said step of communicating with a user's mobile terminal comprises: communicating using an infrared module.
- 如权利要求6所述的智能机器人控制方法,其特征在于,所述利用摄像头的采集图像来定位所述智能机器人的当前位置,以及利用所述当前环境图像来定位所述用户的当前位置的步骤包括:The intelligent robot control method according to claim 6, wherein the step of locating the current position of the intelligent robot by using the captured image of the camera and the step of locating the current position of the user by using the current environment image include:利用摄像头采集图像; Using the camera to capture images;匹配所述采集的图像与地图数据并且进行当前位置的定位;以及Matching the acquired image with map data and performing local location positioning;存储所述地图数据并且形成地图。 The map data is stored and a map is formed.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/073571 WO2018148874A1 (en) | 2017-02-15 | 2017-02-15 | Smart robot based on camera navigation and control method therefor |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/073571 WO2018148874A1 (en) | 2017-02-15 | 2017-02-15 | Smart robot based on camera navigation and control method therefor |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018148874A1 true WO2018148874A1 (en) | 2018-08-23 |
Family
ID=63170046
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/073571 WO2018148874A1 (en) | 2017-02-15 | 2017-02-15 | Smart robot based on camera navigation and control method therefor |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2018148874A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013085085A1 (en) * | 2011-12-08 | 2013-06-13 | Lg Electronics Inc. | Automatic moving apparatus and manual operation method thereof |
CN103869814A (en) * | 2012-12-17 | 2014-06-18 | 联想(北京)有限公司 | Terminal positioning and navigation method and mobile terminal |
CN105259898A (en) * | 2015-10-13 | 2016-01-20 | 江苏拓新天机器人科技有限公司 | Floor sweeping robot controlled by smart phone |
CN105302131A (en) * | 2014-07-22 | 2016-02-03 | 德国福维克控股公司 | Method for cleaning or processing a room using an automatically moved device |
CN105739500A (en) * | 2016-03-29 | 2016-07-06 | 海尔优家智能科技(北京)有限公司 | Interaction control method and device of intelligent sweeping robot |
CN106037589A (en) * | 2015-04-16 | 2016-10-26 | Lg电子株式会社 | Robot cleaner |
-
2017
- 2017-02-15 WO PCT/CN2017/073571 patent/WO2018148874A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013085085A1 (en) * | 2011-12-08 | 2013-06-13 | Lg Electronics Inc. | Automatic moving apparatus and manual operation method thereof |
CN103869814A (en) * | 2012-12-17 | 2014-06-18 | 联想(北京)有限公司 | Terminal positioning and navigation method and mobile terminal |
CN105302131A (en) * | 2014-07-22 | 2016-02-03 | 德国福维克控股公司 | Method for cleaning or processing a room using an automatically moved device |
CN106037589A (en) * | 2015-04-16 | 2016-10-26 | Lg电子株式会社 | Robot cleaner |
CN105259898A (en) * | 2015-10-13 | 2016-01-20 | 江苏拓新天机器人科技有限公司 | Floor sweeping robot controlled by smart phone |
CN105739500A (en) * | 2016-03-29 | 2016-07-06 | 海尔优家智能科技(北京)有限公司 | Interaction control method and device of intelligent sweeping robot |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3396486B1 (en) | Charging method, device and storage medium for cleaning robot | |
CN107336243B (en) | Robot control system and control method based on intelligent mobile terminal | |
CN110495819B (en) | Robot control method, robot, terminal, server and control system | |
CN111565896A (en) | Mobile device for cleaning, cooperative cleaning system, and control method thereof | |
WO2022000755A1 (en) | Robot, motion control method and apparatus therefor, and computer-readable storage medium | |
US20190183310A1 (en) | Photomosaic floor mapping | |
US9477302B2 (en) | System and method for programing devices within world space volumes | |
US10437251B2 (en) | Method for specifying position, terminal device, autonomous device, and program | |
US20230057965A1 (en) | Robot and control method therefor | |
CN110570465B (en) | Real-time positioning and map construction method and device and computer readable storage medium | |
US20210233529A1 (en) | Imaging control method and apparatus, control device, and imaging device | |
CN104156695A (en) | Method and device for aligning face image | |
CN106096011A (en) | Method for picture sharing and device | |
KR20200020295A (en) | AUGMENTED REALITY SERVICE PROVIDING APPARATUS INTERACTING WITH ROBOT and METHOD OF THEREOF | |
CN104008129A (en) | Position information processing method, device and terminal | |
KR20210017081A (en) | Apparatus and method for displaying graphic elements according to object | |
WO2018148878A1 (en) | Smart robot capable of adaptively adjusting visual field, and control method therefor | |
CN110633336A (en) | Method and device for determining laser data search range and storage medium | |
WO2018148874A1 (en) | Smart robot based on camera navigation and control method therefor | |
KR102620877B1 (en) | Electronic device for recommending photographing spot for an image and method for operating thefeof | |
CN107153621A (en) | device identification method and device | |
TWI737588B (en) | System and method of capturing image | |
JP2021013159A (en) | Information processing apparatus, telepresence robot, site control system, remote control system, information processing method, and program | |
CN106647794A (en) | Flight control method and apparatus | |
WO2018148877A1 (en) | Dual-camera smart robot and control method therefor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17897107 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17897107 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02/01/2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17897107 Country of ref document: EP Kind code of ref document: A1 |