WO2020140682A1 - 与机器人服务有关的方法及相关***、可读存储介质 - Google Patents
与机器人服务有关的方法及相关***、可读存储介质 Download PDFInfo
- Publication number
- WO2020140682A1 WO2020140682A1 PCT/CN2019/123290 CN2019123290W WO2020140682A1 WO 2020140682 A1 WO2020140682 A1 WO 2020140682A1 CN 2019123290 W CN2019123290 W CN 2019123290W WO 2020140682 A1 WO2020140682 A1 WO 2020140682A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- grid
- service
- serviceable
- served
- area
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000004590 computer program Methods 0.000 claims description 20
- 230000015654 memory Effects 0.000 claims description 14
- 230000002068 genetic effect Effects 0.000 claims description 7
- 238000004140 cleaning Methods 0.000 abstract description 2
- 238000002372 labelling Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 8
- 238000005265 energy consumption Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0287—Control of position or course in two dimensions specially adapted to land vehicles involving a plurality of land vehicles, e.g. fleet or convoy travelling
- G05D1/0291—Fleet control
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
- B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/008—Manipulators for service tasks
- B25J11/0085—Cleaning
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
- B25J9/161—Hardware, e.g. neural networks, fuzzy logic, interfaces, processor
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
- G05D1/0219—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory ensuring the processing of the whole working surface
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
- G05D1/0274—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/12—Computing arrangements based on biological models using genetic models
- G06N3/126—Evolutionary algorithms, e.g. genetic algorithms or genetic programming
Definitions
- the present disclosure relates to the field of computer technology. More specifically, it relates to a method and related system related to robot service, and a readable storage medium.
- the multi-service robot service path planning method is usually to adopt the average distribution method of the service area. It is simply to divide the area by equal area and then plan the full coverage path, so as to provide comprehensive services regardless of whether the location of each area requires service. This method cannot identify the location of a region with service demand and performs path planning and service for it, which has low service efficiency and wastes energy consumption.
- a method including: acquiring an image of a region to be served, wherein the region to be served includes a serviceable grid obtained by dividing the region to be served; performing pedestrian recognition on the image to obtain Pedestrian heat of each serviceable grid within a preset time period; and marking a serviceable grid with pedestrian heat exceeding a preset threshold and a serviceable grid within a preset range centered on it as a to-be-served grid.
- the sub-area to be served composed of the grid to be served.
- the method further includes: allocating a corresponding number of serviceable grids to each of the plurality of service robots to obtain a service area corresponding to each service robot; and determining the sub-area to be serviced and the corresponding service robot At the intersection of service areas, the service robot with the largest intersection is regarded as the service robot serving the sub-area to be served.
- the method further includes: generating a service path of the service robot.
- allocating a corresponding number of serviceable grids to each of the plurality of service robots includes allocating an equal number of serviceable grids to each of the plurality of service robots.
- the method further includes: constructing an area to be served, and dividing the area to be served into an equal area grid to obtain a serviceable grid.
- the marking of a serviceable grid with pedestrian heat exceeding a preset threshold and a serviceable grid within a preset range centered on it is marked as a grid to be served, and obtaining the subregion to be served further includes : Mark the serviceable grid with pedestrian heat exceeding the preset threshold and the serviceable grid within the preset range centered on it as the grid to be serviced, group the grids to be serviced by clustering method, according to each grouping The edge grid constitutes the sub-region to be served.
- forming the sub-region to be served according to the edge grids in each group further includes: for each group, a serviceable grid covered by a polygonal region wrapped by a center connecting line of the edge grid in the group All serve as the grid to be served of the group, and constitute the sub-area of the group to be served.
- the generation of the service path of the service robot further includes: if a certain service robot serves as a service robot performing at least two sub-regions to be served, then the optimal service robot is calculated by genetic algorithm for all Describe the service sequence of at least two sub-areas to be served.
- performing pedestrian recognition on the image to obtain pedestrian popularity of each serviceable grid within a preset time period further includes: performing pedestrian recognition on the image within a preset time period to obtain each The number of pedestrians in each serviceable grid at a time; and the average value of the number of pedestrians in each serviceable grid in a preset period of time is integrated within the preset period to obtain the pedestrian heat of each serviceable grid.
- a system including: a pedestrian heat acquisition module configured to acquire an image of an area to be served, wherein the area to be served includes a serviceable grid obtained by dividing the area to be served, and Pedestrian recognition is performed on the image to obtain the pedestrian heat of each serviceable grid within a preset time period; and the sub-region marking module to be served is configured to configure the serviceable grid with pedestrian heat exceeding a preset threshold and its center The serviceable grid within the preset range is marked as the grid to be serviced, and the subregion to be serviced composed of the grid to be serviced is obtained.
- the system further includes: a serviceable grid division module configured to allocate a corresponding number of serviceable grids to each of the plurality of service robots to obtain a service area corresponding to each service robot; and a determination module , Configured to determine the intersection of the sub-area to be served and the service area corresponding to each service robot, and use the service robot with the largest intersection as the service robot serving the sub-area to be served.
- a serviceable grid division module configured to allocate a corresponding number of serviceable grids to each of the plurality of service robots to obtain a service area corresponding to each service robot
- a determination module Configured to determine the intersection of the sub-area to be served and the service area corresponding to each service robot, and use the service robot with the largest intersection as the service robot serving the sub-area to be served.
- the determination module is further configured to: generate a service path of the service robot.
- the serviceable grid division module is configured to allocate an equal number of serviceable grids to each of the plurality of service robots.
- the system further includes: a serviceable grid acquisition module configured to construct a map of the area to be served, and divide the area of the service area into equal-area grids to obtain the serviceable grid.
- a serviceable grid acquisition module configured to construct a map of the area to be served, and divide the area of the service area into equal-area grids to obtain the serviceable grid.
- the to-be-served sub-region marking module is configured to mark a serviceable grid with pedestrian heat exceeding a preset threshold and a serviceable grid within a preset range centered on it as a to-be-served grid Grid, the grids to be served are grouped by clustering method, and the sub-regions to be served are formed according to the edge grids in each group.
- the to-be-served sub-region marking module is further configured to form a to-be-served sub-region according to the edge grids in each group by:
- the serviceable grids covered by the polygonal area wrapped by the center connecting line all serve as the grid to be serviced of the group, and constitute the sub-region to be serviced of the group.
- the determination module is configured to, when a certain service robot is used as a service robot that executes services for at least two sub-regions to be serviced, calculate the optimal service robot for the at least two Service order of service sub-area.
- the pedestrian heat acquisition module is configured to perform pedestrian recognition on the image within a preset period of time to obtain the number of pedestrians that can serve the grid at each moment within the preset period of time;
- the average value of the number of pedestrians in each serviceable grid in the system is integrated within a preset period to obtain the pedestrian heat of each serviceable grid.
- a service system which includes a plurality of service robots and the system described above.
- a computer-readable storage medium on which a computer program is stored, where the program implements the method described above when the program is executed by a processor.
- a computer system including: a memory on which a computer program is stored; and one or more processors configured to execute the computer program to perform the method as described above.
- a service robot including: a memory on which computer program instructions are stored; and a processor coupled to the memory and configured to: receive a serviceable grid of a service area of the service robot Pedestrian popularity, serviceable grids are obtained by dividing the service area into grids, determining the number of serviceable grids where pedestrian popularity exceeds a preset threshold, determining whether the number exceeds a threshold, and responding to the number A threshold is exceeded, so that the service robot serves the service area.
- the serviceable grid is obtained by dividing the service area into equal-area grids.
- a service robot including: a memory on which computer program instructions are stored; and a processor coupled to the memory and configured to: receive information of a plurality of sub-regions to be served, wherein The plurality of sub-regions to be serviced is composed of a serviceable grid where pedestrian heat exceeds a preset threshold, and the serviceable grid is obtained by grid dividing the region to be serviced including the plurality of sub-regions to be serviced, Calculate the number of grids where the service area of the service robot intersects the multiple service sub-areas, and determine the sub-area to be served with the largest number of intersecting grids as the service area of the service robot.
- the serviceable grid is obtained by dividing the area to be serviced including the multiple sub-areas to be served by an equal area grid.
- the processor is further configured to determine the sub-area to be served with the number of intersecting grids exceeding the threshold and the number of intersecting grids as the service area of the service robot.
- FIG. 1 shows a flowchart of a service robot path planning method provided by an embodiment of the present disclosure.
- FIG. 2 shows a schematic diagram of grid division of a service area map and distribution of serviceable grids for multiple service robots.
- FIG. 3 shows a schematic diagram of marking a grid to be served.
- FIG. 4 shows a schematic diagram of the intersection of the sub-area to be served and the service area corresponding to each service robot.
- Fig. 5 shows a schematic diagram of grouping grids to be served by clustering and forming sub-regions to be served according to edge grids in each group.
- FIG. 6 shows a schematic diagram of a service system provided by an embodiment of the present disclosure.
- FIG. 7 is a schematic structural diagram of a service robot path planning system provided by an embodiment of the present disclosure.
- the present disclosure relates to methods, systems, and media related to service robots.
- the method according to some embodiments of the present disclosure may include: acquiring an image of a region to be served, wherein the region to be served includes a serviceable grid obtained by dividing the area to be serviced into equal-area grids; and then performing pedestrian recognition on the image to Obtain the pedestrian heat of each serviceable grid within the preset time period; and mark the serviceable grid with pedestrian heat exceeding the preset threshold and the serviceable grid within the preset range centered on it as the to-be-served grid to obtain
- the sub-area to be served consists of the grid to be served.
- This novel method for determining the sub-area to be serviced takes into account pedestrian heat, so that the area that is really necessary to be served can be effectively determined, and the area that is not necessary to be served can be avoided from being determined as the area to be served, which improves the efficiency of service and saves Unnecessary energy consumption.
- the method according to some embodiments of the present disclosure may further include: allocating a corresponding number of serviceable grids to each of the plurality of service robots to obtain a service area corresponding to each service robot; and determining the sub-area to be serviced and the corresponding service robot The intersection of the service areas of the system takes the service robot with the largest intersection as the service robot serving the sub-area to be served.
- This novel method of allocating service robots considers that the size of the intersection between the sub-area to be served and the service area corresponding to each service robot is different, and takes the service robot with the largest intersection as the service robot serving the sub-area to be served, so that The change of the service sub-area to determine the most suitable service robot to serve the sub-area to be served further improves service efficiency and saves energy consumption.
- the method according to some embodiments of the present disclosure may further include: generating a service path of the service robot.
- the service path is generated based on the sub-area to be served, thereby further improving service efficiency and saving energy consumption.
- the services may be cleaning services, sales services, consulting services, and so on.
- the method illustrated below includes multiple steps, and those skilled in the art may understand that one or more of the multiple steps may be omitted. In some cases, more steps can also be added.
- an embodiment of the present disclosure provides a service robot path planning method, including:
- the flat map of the shopping mall is divided into multiple grids, where the serviceable grids such as shopping mall channels, etc., and the non-serviceable grids such as merchants Stores, containers, etc., each service robot is allocated to a service area composed of the same number and adjacent service grids.
- the number of service grids is not necessarily the number of service robots. It is an integer multiple. Therefore, if the number of serviceable grids is an integer multiple of the number of service robots, it should be absolutely the same, otherwise it should be roughly the same.
- each of the multiple service robots is assigned an equal number (for example, 12) of service areas composed of serviceable grids, but those skilled in the art can understand that Each of the service robots is assigned a service area composed of a different number of serviceable grids.
- S5. Determine the intersection of the sub-area to be served and the service area corresponding to each service robot, and use the service robot with the largest intersection as the service robot serving the sub-area to be serviced to generate the service path of the service robot; in a specific example, as shown in FIG. 4 As shown, the service area corresponding to the service robot in the upper left corner is A, and the intersection between the sub-area to be serviced and the service area A is the largest. Therefore, the service robot in the upper-left corner is regarded as the service robot serving the sub-area to be served.
- the service robot path planning method provided in this embodiment divides the map of the area to be serviced and identifies the serviceable grid therein, and assigns corresponding service areas to multiple service robots, based on the serviceable grid identified from the image
- the number of pedestrians is used to obtain the pedestrian heat of the serviceable grid, and the pedestrian heat is used as the basis for judging the dirty degree of the serviceable grid, and the pedestrian flow of the serviceable grid around the serviceable grid with high pedestrian heat is bound to be
- the serviceable grid with pedestrian heat exceeding the preset threshold and the serviceable grid within the preset range centered on it are marked as the grid to be serviced, and the service range is expanded to obtain area.
- the obtained sub-area to be served is a relatively continuous serviceable grid, which avoids over-dispersion and facilitates path planning.
- the service robot with the largest intersection with the sub-area to be served only serves the sub-area to be serviced and does not serve all the serviceable grids. It can realize targeted local services after judging the degree of dirt damage in different areas. , Effectively avoid serving unnecessary regional locations, improve efficiency and save energy consumption.
- performing pedestrian recognition on the image in step S3 to obtain pedestrian heat of each serviceable grid within a preset time period further includes:
- Pedestrian recognition is performed on the image within a preset period of time to obtain the number of pedestrians that can serve the grid at each moment within the preset period of time;
- the average value of the number of pedestrians in each serviceable grid in the preset time period is separately integrated within the preset time period to obtain the pedestrian heat of each serviceable grid.
- multiple cameras may be provided in the area to be served to ensure that all serviceable grids can be covered.
- Pedestrian recognition is performed frame by frame with images collected by multiple cameras (by means of feature recognition of the pedestrian's head, etc.).
- step S4 mark a serviceable grid with pedestrian heat exceeding a preset threshold and a serviceable grid within a preset range centered on it as a grid to be served, "Obtaining the subarea to be served” further includes:
- This implementation method ensures that the grids to be served in each sub-region to be serviced are concentrated and non-continuous grids to be served in the sub-regions to be serviced are avoided, thereby ensuring that the service robot performs a short path when performing services It is convenient to plan its service path in the sub-area to be served.
- the clustering method is used to group the grids to be served, and the sub-regions to be serviced according to the edge grids in each grouping further include:
- the grids to be served are grouped according to the preset clustering radius and the minimum number of grids to be served in the group, and the sub-regions to be served are formed according to the edge grids in each group.
- the clustering method is used to group the grids to be serviced according to the preset clustering radius R and the minimum number m of the grids to be served in the grouping.
- a certain grouping is connected by In the edge grid in the group, the serviceable grid covered by the polygonal area wrapped by the center connecting line of the edge grid in the group is taken as the group to be serviced and constitutes the group to be served sub-region.
- the generation of the service path of the service robot in step S5 further includes: if a certain service robot serves as a service robot that executes services in at least two sub-regions to be served, then using genetic algorithms The optimal service sequence of the at least two sub-regions to be serviced by the service robot is calculated, wherein the genetic algorithm may be an existing general genetic algorithm.
- the generating the service path of the service robot in step S5 further includes: acquiring a center to-be-served grid of the service sub-region, and setting the service-to-be-served grid when the service robot executes the service Counterclockwise internal spiral service for the center.
- the service robot can be avoided from reciprocating in the same path in the generated service path, which can further improve service efficiency and save energy consumption.
- the counterclockwise inner spiral conforms to the pedestrian walking habit, which can reduce the Pedestrian influence.
- the inner spiral represents the spiral movement from outside to inside.
- the method further includes: counting a period in which the total pedestrian heat of the area to be served is the lowest in each period of each day, and the path planning manner in this period is for each service robot to serve the corresponding The service area is to provide a full service for the area to be served.
- another embodiment of the present disclosure provides a service system, including a service robot path planning system 100 and multiple service robots 200;
- the service robot path planning system 100 includes:
- the serviceable grid acquisition module 101 is configured to construct a map of the area to be served, and divide the area to be serviced into equal-area grids to obtain the serviceable grid;
- the serviceable grid division module 102 is configured to allocate a corresponding number of serviceable grids to each of a plurality of service robots to obtain a service area corresponding to each service robot;
- the pedestrian heat obtaining module 103 is configured to obtain an image of the area to be served, and perform pedestrian recognition on the image to obtain the pedestrian heat of each serviceable grid within a preset time period;
- the to-be-served sub-region marking module 104 is configured to mark a serviceable grid with pedestrian heat exceeding a preset threshold and a serviceable grid within a preset range centered on it as a to-be-served grid to obtain a to-be-served sub-region;
- the determining module 105 is configured to determine the intersection of the sub-area to be served and the service area corresponding to each service robot, and use the service robot with the largest intersection as the service robot serving the sub-area to be served to generate the service path of the service robot.
- the service robot 200 is configured to serve the sub-area to be serviced according to the service path instruction generated by the service robot path planning system 100.
- the service robot may include, for example, a memory storing a computer program and a processor.
- the processor may execute a computer program to cause the service robot to perform the method of the embodiments of the present disclosure.
- the service robot may receive the pedestrian heat of the serviceable grid of the service area of the service robot.
- the serviceable grid may be obtained by grid dividing the service area.
- the service robot may determine the number of serviceable grids where pedestrian heat exceeds a preset threshold, determine whether the number exceeds a threshold, and in response to the number exceeding a threshold, cause the service robot to serve the service area. For example, suppose that the service robot is responsible for a certain service area containing 12 grids. When it is determined based on the received pedestrian heat information that the number of grids with pedestrian heat exceeding the threshold is 7, and the threshold exceeds 6, for example, the service robot is started. Serve the service area.
- This solution enables service robots to perform necessary services based on pedestrian heat, avoiding unnecessary services, improving service efficiency, and saving energy consumption.
- the service robot may include, for example, a memory storing a computer program and a processor.
- the processor may execute a computer program to cause the service robot to perform the methods of other embodiments of the present disclosure.
- the service robot may receive information of multiple sub-areas to be served.
- the multiple sub-regions to be served may be composed of a serviceable grid whose pedestrian heat exceeds a preset threshold.
- the serviceable grid is obtained by grid-dividing the area to be served that includes the plurality of sub-areas to be served.
- the service robot may calculate the number of grids where the service area that the service robot is responsible for intersects with the plurality of service sub-areas, and determine the sub-area to be served with the largest number of intersecting grids as the service area of the service robot. For example, assuming that the service area of the service robot and the three sub-areas to be serviced all have intersections, the sub-area to be serviced with the largest number of intersecting grids is determined as the service area of the service robot.
- the service robot determines the sub-region to be served that the number of intersecting grids exceeds the threshold and the number of intersecting grids is the service area of the service robot. That is, when the number of intersecting grids is the largest and exceeds the threshold, the corresponding sub-area to be serviced is determined as the service area of the service robot.
- a computer system suitable for implementing the service robot path planning system and the service robot provided by this embodiment includes a central processing unit (CPU), which can be based on a program stored in a read-only memory (ROM) Or a program loaded into a random access memory (RAM) from a storage section to perform various appropriate actions and processes.
- CPU central processing unit
- RAM random access memory
- various programs and data necessary for the operation of the computer system are also stored.
- the CPU, ROM, and RAM are connected through the bus.
- the input/input (I/O) interface is also connected to the bus.
- the following components are connected to the I/O interface: input part including keyboard, mouse, etc.; output part including liquid crystal display (LCD), etc. and speakers; storage part including hard disk, etc.; and network including such as LAN card, modem, etc.
- the communication part of the interface card performs communication processing via a network such as the Internet.
- the drive is also connected to the I/O interface as needed. Removable media, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive as needed, so that the computer program read out therefrom is installed into the storage portion as needed.
- the process described in the above flowchart can be implemented as a computer software program.
- this embodiment includes a computer program product that includes a computer program tangibly contained on a computer-readable medium, and the above-mentioned computer program contains program code for executing the method shown in the flowchart.
- the computer program may be downloaded and installed from the network through the communication section, and/or installed from a removable medium.
- each block in the flowchart or schematic diagram may represent a module, a program segment, or a part of code, and the above-mentioned module, program segment, or part of code contains one or more Execute instructions.
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may actually be executed in parallel, and they may sometimes be executed in reverse order, depending on the functions involved.
- each block in the schematic and/or flowchart, and combinations of blocks in the schematic and/or flowchart can be implemented with a dedicated hardware-based system that performs the specified function or operation Or, it can be realized by a combination of dedicated hardware and computer instructions.
- the modules described in this embodiment may be implemented in software or hardware.
- the described module can also be set in the processor.
- a processor including a serviceable grid acquisition module, a serviceable grid division module, a pedestrian heat acquisition module, a sub-region marking module to be served and Identify the module.
- the names of these modules do not constitute a limitation on the module itself under certain circumstances.
- this embodiment also provides a non-volatile computer storage medium.
- the non-volatile computer storage medium may be the non-volatile computer storage medium included in the above-described device in the foregoing embodiment, or It may be a non-volatile computer storage medium that exists alone and is not installed in the terminal.
- the non-volatile computer storage medium stores one or more programs.
- the device When the one or more programs are executed by a device, the device is configured to: construct a map of the area to be served, and divide the area map of the service into an equal area grid , Obtain a serviceable grid; assign a corresponding number of serviceable grids to each of the multiple service robots to obtain a service area corresponding to each service robot; obtain an image of the area to be serviced, perform pedestrian recognition on the image to obtain a pre- Pedestrian heat of each serviceable grid within the set time period; mark the serviceable grid whose pedestrian heat exceeds the preset threshold and the serviceable grid within the preset range centered on it as the grid to be serviced to obtain the grid to be served Area; determine the intersection of the sub-area to be served and the service area corresponding to each service robot, and use the service robot with the largest intersection as the service robot serving the sub-area to be serviced to generate the service path of the service robot.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Automation & Control Theory (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Aviation & Aerospace Engineering (AREA)
- Remote Sensing (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Software Systems (AREA)
- Biophysics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- Biomedical Technology (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Genetics & Genomics (AREA)
- Physiology (AREA)
- Electromagnetism (AREA)
- Fuzzy Systems (AREA)
- Traffic Control Systems (AREA)
- Electric Vacuum Cleaner (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Description
Claims (26)
- 一种方法,包括:获取待服务区域的图像,其中待服务区域包括通过对待服务区域进行栅格划分获得的可服务栅格;对所述图像进行行人识别以获取预设时段内各可服务栅格的行人热度;和将行人热度超过预设阈值的可服务栅格及以其为中心的预设范围内的可服务栅格标记为待服务栅格,得到由待服务栅格组成的待服务子区域。
- 如权利要求1所述的方法,还包括:为多个服务机器人的每一个分配相应数量的可服务栅格,得到对应各服务机器人的服务区域;判断待服务子区域与对应各服务机器人的服务区域的交集,将交集最大的服务机器人作为服务待服务子区域的服务机器人。
- 如权利要求2所述的方法,还包括:生成服务机器人的服务路径。
- 如权利要求3所述的方法,其中,为多个服务机器人的每一个分配相应数量的可服务栅格包括为多个服务机器人的每一个分配等数量的可服务栅格。
- 如权利要求4所述的方法,还包括:构建待服务区域,并对待服务区域进行等面积栅格划分,获取可服务栅格。
- 根据权利要求1-5中任一项所述的方法,其中,所述将行人热度超过预设阈值的可服务栅格及以其为中心的预设范围内的可服务栅格标记为待服务栅格,得到待服务子区域进一步包括:将行人热度超过预设阈值的可服务栅格及以其为中心的预设范围内的可服务栅格标记为待服务栅格,通过聚类方法将待服务栅格分组,根据各分组中的边缘栅格构成待服务子区域。
- 据权利要求6所述的方法,其中,根据各分组中的边缘栅格构成待服务子区域进一步包括:对于各分组,通过将该分组中的边缘栅格的中心连接线包裹的多边形区域覆盖的可服务栅格均作为该分组的待服务栅格,构成该分组的待服务子区域。
- 根据权利要求3所述的方法,其中,所述生成服务机器人的服务路径进一步包括:若某个服务机器人作为执行服务至少两个待服务子区域的服务机器人,则通过遗传算法计算得到最优的服务机器人对于所述至少两个待服务子区域的服务顺序。
- 根据权利要求1-5中任一项所述的方法,其中,对所述图像进行行人识别以获取预设时段内各可服务栅格的行人热度进一步包括:在预设时段内对所述图像进行行人识别,得到预设时段内各时刻各可服务栅格的行人数量;分别对预设时段内各可服务栅格的行人数量的平均值在预设时段内进行积分,得到各可服务栅格的行人热度。
- 一种***,包括:行人热度获取模块,配置为:获取待服务区域的图像,其中待服务区域包括通过对待服务区域进行栅格划分获得的可服务栅格,和对所述图像进行行人识别以获取预设时段内各可服务栅格的行人热度;以及待服务子区域标记模块,配置为将行人热度超过预设阈值的可服务栅格及以其为中心的预设范围内的可服务栅格标记为待服务栅格,得到由待服务栅格组成的待服务子区域。
- 如权利要求10所述的***,还包括:可服务栅格划分模块,配置为为多个服务机器人的每一个分配相应数量的可服务栅格,得到对应各服务机器人的服务区域;和确定模块,配置为判断待服务子区域与对应各服务机器人的服务区域的交集,将交集最大的服务机器人作为服务待服务子区域的服务机器人。
- 如权利要求11所述的***,其中,所述确定模块还配置为:生成服务机器人的服务路径。
- 如权利要求12所述的***,其中,可服务栅格划分模块被配置为为多个服务机器人的每一个分配等数量的可服务栅格。
- 如权利要求13所述的***,还包括:可服务栅格获取模块,配置为构建待服务区域地图,并对待服务区域地图进行等面积栅格划分,获取可服务栅格。
- 根据权利要求10-14所述的***,其中,所述待服务子区域标记模块,配置为将行人热度超过预设阈值的可服务栅格及以其为中心的预设范围内的可服务栅格标记为待 服务栅格,通过聚类方法将待服务栅格分组,根据各分组中的边缘栅格构成待服务子区域。
- 根据权利要求15所述的***,其中,所述待服务子区域标记模块进一步配置为通过以下方式来根据各分组中的边缘栅格构成待服务子区域:对于各分组,通过将该分组中的边缘栅格的中心连接线包裹的多边形区域覆盖的可服务栅格均作为该分组的待服务栅格,构成该分组的待服务子区域。
- 根据权利要求10-14中任一项所述的***,其中,所述确定模块,配置为在某个服务机器人作为执行服务至少两个待服务子区域的服务机器人时,通过遗传算法计算得到最优的服务机器人对于所述至少两个待服务子区域的服务顺序。
- 根据权利要求10-14所述的***,其中,所述行人热度获取模块,配置为在预设时段内对所述图像进行行人识别,得到预设时段内各时刻各可服务栅格的行人数量;分别对预设时段内各可服务栅格的行人数量的平均值在预设时段内进行积分,得到各可服务栅格的行人热度。
- 一种服务***,其中,包括多个服务机器人和如权利要求10-18中任一项所述的***。
- 一种计算机可读存储介质,其上存储有计算机程序,其中,该程序被处理器执行时实现如权利要求1-9中任一项所述的方法。
- 一种计算机***,包括:存储器,其上存储计算机程序;以及一个或多个处理器,配置为执行所述计算机程序来执行如权利要求1-9中任一项所述的方法。
- 一种服务机器人,包括:存储器,其上存储计算机程序指令;和处理器,其与存储器耦接并被配置为:接收该服务机器人的服务区域的可服务栅格的行人热度,可服务栅格是通过对服务区域进行栅格划分获得的,确定行人热度超过预设阈值的可服务栅格的数量,确定所述数量是否超过一阈值,以及当确定所述数量超过一阈值,使得服务机器人服务该服务区域。
- 如权利要求22所述的服务机器人,其中,可服务栅格是通过对服务区域进行等面积 栅格划分获得的。
- 一种服务机器人,包括:存储器,其上存储计算机程序指令;和处理器,其与存储器耦接并被配置为:接收多个待服务子区域的信息,其中所述多个待服务子区域是由行人热度超过预设阈值的可服务栅格组成的,可服务栅格是通过对包括所述多个待服务子区域的待服务区域进行栅格划分获得的,计算服务机器人的服务区域与所述多个服务子区域相交的栅格数,和将相交的栅格数最大的待服务子区域确定为该服务机器人的服务区域。
- 如权利要求24的服务机器人,其中,可服务栅格是通过对包括所述多个待服务子区域的待服务区域进行等面积栅格划分获得的。
- 如权利要求24或25的服务机器人,其中,处理器还配置为:将相交的栅格数超过阈值并且相交的栅格数最多的待服务子区域确定为该服务机器人的服务区域。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/762,323 US11687095B2 (en) | 2019-01-02 | 2019-12-05 | Method, related system, and readable storage medium related to robot service |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910001378.6A CN109571482B (zh) | 2019-01-02 | 2019-01-02 | 清扫机器人路径规划方法及相关***、可读存储介质 |
CN201910001378.6 | 2019-01-02 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020140682A1 true WO2020140682A1 (zh) | 2020-07-09 |
Family
ID=65915757
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/123290 WO2020140682A1 (zh) | 2019-01-02 | 2019-12-05 | 与机器人服务有关的方法及相关***、可读存储介质 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11687095B2 (zh) |
CN (1) | CN109571482B (zh) |
WO (1) | WO2020140682A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114115283A (zh) * | 2021-12-02 | 2022-03-01 | 深圳市证通电子股份有限公司 | 基于改进的对向并行算法的机器人路径规划方法和*** |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109571482B (zh) | 2019-01-02 | 2021-08-27 | 京东方科技集团股份有限公司 | 清扫机器人路径规划方法及相关***、可读存储介质 |
EP4013219A1 (en) * | 2019-08-13 | 2022-06-22 | DeLaval Holding AB | A method and arrangement for barn cleaning |
JP2021029487A (ja) * | 2019-08-21 | 2021-03-01 | パナソニックIpマネジメント株式会社 | 自律走行型掃除機、自律走行型掃除機の制御方法、及び、プログラム |
CN111124438A (zh) * | 2019-12-16 | 2020-05-08 | 深圳市三宝创新智能有限公司 | 一种企业前台机器人的部署方法 |
CN111012251B (zh) * | 2019-12-17 | 2021-09-03 | 哈工大机器人(合肥)国际创新研究院 | 一种清扫机器人的全覆盖路径的规划方法及装置 |
CN111077894B (zh) * | 2020-01-02 | 2023-11-28 | 小狗电器互联网科技(北京)股份有限公司 | 一种确定待清扫区域的方法及装置 |
CN111227715A (zh) * | 2020-01-16 | 2020-06-05 | 湖南格兰博智能科技有限责任公司 | 一种适应大面积的弓形清扫方法 |
CN111476459B (zh) * | 2020-03-11 | 2022-03-18 | 珠海格力电器股份有限公司 | 清洁机集群协同工作方法、装置、设备及计算机可读介质 |
KR20210131749A (ko) * | 2020-04-24 | 2021-11-03 | 엘지전자 주식회사 | 로봇 청소기 및 로봇 청소기의 제어방법 |
CN111643011B (zh) * | 2020-05-26 | 2022-06-03 | 深圳市杉川机器人有限公司 | 清洁机器人控制方法、装置、清洁机器人和存储介质 |
CN112386171B (zh) * | 2020-11-18 | 2021-11-05 | 福州市长乐区三互信息科技有限公司 | 楼宇物业智能清洁方法及其*** |
CN112587035B (zh) * | 2020-12-08 | 2023-05-05 | 珠海一微半导体股份有限公司 | 移动机器人识别工作场景的控制方法和*** |
CN112990098B (zh) * | 2021-04-13 | 2023-08-15 | 追觅创新科技(苏州)有限公司 | 区域划分方法和装置、存储介质、电子装置 |
CN114010104A (zh) * | 2021-11-01 | 2022-02-08 | 普联技术有限公司 | 一种清扫面积的统计方法及统计装置 |
CN114129092B (zh) * | 2021-12-08 | 2022-10-14 | 上海景吾智能科技有限公司 | 清洁机器人清洁区域规划***及方法 |
KR20230093944A (ko) * | 2021-12-20 | 2023-06-27 | 주식회사 우아한형제들 | 자율이동장치의 최적 주행 경로를 결정하기 위한 방법 및 이를 수행하는 컴퓨팅 시스템 |
CN114427310A (zh) * | 2022-02-18 | 2022-05-03 | 智橙动力(北京)科技有限公司 | 泳池边缘清洗方法、装置、电子设备及计算机存储介质 |
CN114895691B (zh) * | 2022-07-13 | 2022-12-02 | 深之蓝(天津)水下智能科技有限公司 | 泳池清洁机器人的路径规划方法和装置 |
CN115590420B (zh) * | 2022-11-07 | 2023-03-10 | 南京市金龙锋信息科技有限公司 | 基于物联网的智慧居家数据处理方法、***及电子设备 |
CN116092211A (zh) * | 2022-12-19 | 2023-05-09 | 罗普特科技集团股份有限公司 | 生成巡逻路线的方法、装置及存储介质 |
CN117464694B (zh) * | 2023-12-28 | 2024-03-05 | 汉狮光动科技(广东)有限公司 | 中空玻璃自动清洗装置路径规划方法 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080046125A1 (en) * | 2006-08-18 | 2008-02-21 | Samsung Electronics Co., Ltd. | Method of dividing coverage area for robot and device thereof |
CN107049155A (zh) * | 2017-04-25 | 2017-08-18 | 北京小米移动软件有限公司 | 扫地机器人的控制方法和装置 |
CN107368079A (zh) * | 2017-08-31 | 2017-11-21 | 珠海市微半导体有限公司 | 机器人清扫路径的规划方法及芯片 |
WO2017198209A1 (zh) * | 2016-05-19 | 2017-11-23 | 科沃斯机器人股份有限公司 | 组合机器人及其巡航路径生成方法 |
CN108606728A (zh) * | 2018-05-08 | 2018-10-02 | 平安科技(深圳)有限公司 | 一种扫地机器人控制方法、设备、扫地机器人及存储介质 |
CN108827309A (zh) * | 2018-06-29 | 2018-11-16 | 炬大科技有限公司 | 一种机器人路径规划方法及具有它的吸尘器 |
CN109571482A (zh) * | 2019-01-02 | 2019-04-05 | 京东方科技集团股份有限公司 | 清扫机器人路径规划方法及相关***、可读存储介质 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140172477A1 (en) * | 2012-12-14 | 2014-06-19 | Wal-Mart Stores, Inc. | Techniques for using a heat map of a retail location to deploy employees |
EP3484678A4 (en) * | 2016-07-13 | 2020-02-19 | Discovery Robotics | DEVICE AND METHOD FOR PROVIDING A RECONFIGURABLE ROBOTIC PLATFORM |
CN108120441A (zh) * | 2016-11-28 | 2018-06-05 | 沈阳新松机器人自动化股份有限公司 | 全覆盖路径规划方法及*** |
CN107943058A (zh) * | 2017-12-26 | 2018-04-20 | 北京面面俱到软件有限公司 | 扫地机器人及其清扫路径规划方法 |
CN108214492A (zh) * | 2017-12-29 | 2018-06-29 | 北京视觉世界科技有限公司 | 清洁区域的清洁方法、装置、计算机设备和存储介质 |
CN108436921B (zh) * | 2018-06-14 | 2020-04-24 | 广东盈科机器人产业有限公司 | 一种扫地机器人智能控制方法 |
CN108420371B (zh) * | 2018-06-21 | 2021-10-12 | 山东鹏耀智佳精密工业有限公司 | 一种分离式扫地机器人控制方法 |
-
2019
- 2019-01-02 CN CN201910001378.6A patent/CN109571482B/zh active Active
- 2019-12-05 US US16/762,323 patent/US11687095B2/en active Active
- 2019-12-05 WO PCT/CN2019/123290 patent/WO2020140682A1/zh active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080046125A1 (en) * | 2006-08-18 | 2008-02-21 | Samsung Electronics Co., Ltd. | Method of dividing coverage area for robot and device thereof |
WO2017198209A1 (zh) * | 2016-05-19 | 2017-11-23 | 科沃斯机器人股份有限公司 | 组合机器人及其巡航路径生成方法 |
CN107049155A (zh) * | 2017-04-25 | 2017-08-18 | 北京小米移动软件有限公司 | 扫地机器人的控制方法和装置 |
CN107368079A (zh) * | 2017-08-31 | 2017-11-21 | 珠海市微半导体有限公司 | 机器人清扫路径的规划方法及芯片 |
CN108606728A (zh) * | 2018-05-08 | 2018-10-02 | 平安科技(深圳)有限公司 | 一种扫地机器人控制方法、设备、扫地机器人及存储介质 |
CN108827309A (zh) * | 2018-06-29 | 2018-11-16 | 炬大科技有限公司 | 一种机器人路径规划方法及具有它的吸尘器 |
CN109571482A (zh) * | 2019-01-02 | 2019-04-05 | 京东方科技集团股份有限公司 | 清扫机器人路径规划方法及相关***、可读存储介质 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114115283A (zh) * | 2021-12-02 | 2022-03-01 | 深圳市证通电子股份有限公司 | 基于改进的对向并行算法的机器人路径规划方法和*** |
CN114115283B (zh) * | 2021-12-02 | 2023-09-19 | 深圳市证通电子股份有限公司 | 基于改进的对向并行算法的机器人路径规划方法和*** |
Also Published As
Publication number | Publication date |
---|---|
CN109571482A (zh) | 2019-04-05 |
CN109571482B (zh) | 2021-08-27 |
US11687095B2 (en) | 2023-06-27 |
US20210208593A1 (en) | 2021-07-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020140682A1 (zh) | 与机器人服务有关的方法及相关***、可读存储介质 | |
US20200134558A1 (en) | Order allocation method and device | |
JP7082160B2 (ja) | 店舗の棚への製品の配置を追跡する方法 | |
WO2022088659A1 (zh) | 资源调度方法及装置、电子设备、存储介质和程序产品 | |
WO2019037367A1 (zh) | 配送任务处理方法、装置及电子设备 | |
Jang et al. | The software-defined vehicular cloud: A new level of sharing the road | |
JP7186092B2 (ja) | ジョブ位置間の走行コストを用いたジョブスケジューリングのための方法、システム、およびコンピュータ可読媒体 | |
CN108335071A (zh) | 配送任务分配方法、装置、电子设备及计算机存储介质 | |
CN113762519B (zh) | 一种数据清洗方法、装置及设备 | |
CN110472605B (zh) | 一种基于深度学习人脸分区的皮肤问题分类方法 | |
CN103854279A (zh) | 用于圆的霍夫变换 | |
WO2021189827A1 (zh) | 识别模糊图像的方法、装置、设备及计算机可读存储介质 | |
CN107122147A (zh) | 用于将图像基元部署至计算构造的图像流管线控制器 | |
CN110162396A (zh) | 内存回收方法、装置、***和存储介质 | |
CN108427679A (zh) | 一种人流分布处理方法及其设备 | |
JP6842447B2 (ja) | リソース割当ての最適化を支援するシステム及び方法 | |
CN107526620A (zh) | 一种用户态输入输出设备配置方法及装置 | |
WO2019029721A1 (zh) | 任务的调度方法、装置、设备及存储介质 | |
CN107203256A (zh) | 一种网络功能虚拟化场景下的节能分配方法与装置 | |
US7398090B2 (en) | Defining a smart area | |
JP6666553B2 (ja) | 情報処理装置、ジョブ管理方法およびジョブ管理プログラム | |
CN107220114A (zh) | 基于资源统一调度的分布式资源调度方法 | |
US20220327001A1 (en) | Multi-cloud spot instance market | |
CN110308991A (zh) | 一种基于随机任务的数据中心节能优化方法及*** | |
JP5894492B2 (ja) | 画像処理装置、画像検索装置及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19907496 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19907496 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02/11/2021) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19907496 Country of ref document: EP Kind code of ref document: A1 |