US20190216283A1 - Detecting degradation of back squeegee water pick-up performance for autonomous floor scrubbers - Google Patents
Detecting degradation of back squeegee water pick-up performance for autonomous floor scrubbers Download PDFInfo
- Publication number
- US20190216283A1 US20190216283A1 US16/249,671 US201916249671A US2019216283A1 US 20190216283 A1 US20190216283 A1 US 20190216283A1 US 201916249671 A US201916249671 A US 201916249671A US 2019216283 A1 US2019216283 A1 US 2019216283A1
- Authority
- US
- United States
- Prior art keywords
- floor scrubber
- detecting
- vacuum
- squeegee
- alert
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 title claims abstract description 37
- 230000015556 catabolic process Effects 0.000 title abstract description 8
- 238000006731 degradation reaction Methods 0.000 title abstract description 8
- 238000004140 cleaning Methods 0.000 claims abstract description 77
- 238000000034 method Methods 0.000 claims abstract description 54
- 238000012544 monitoring process Methods 0.000 claims abstract description 6
- 230000009471 action Effects 0.000 claims description 16
- 230000001010 compromised effect Effects 0.000 claims description 15
- 230000000007 visual effect Effects 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 11
- 230000037361 pathway Effects 0.000 claims description 10
- 239000012530 fluid Substances 0.000 claims description 9
- 238000012423 maintenance Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 238000010407 vacuum cleaning Methods 0.000 claims description 7
- 238000003708 edge detection Methods 0.000 claims description 5
- 230000001788 irregular Effects 0.000 claims description 2
- 238000011176 pooling Methods 0.000 claims 1
- 238000001514 detection method Methods 0.000 description 15
- 238000007781 pre-processing Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000008439 repair process Effects 0.000 description 3
- 230000011218 segmentation Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 229920001971 elastomer Polymers 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000036961 partial effect Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 239000005060 rubber Substances 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 244000007853 Sarothamnus scoparius Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000013019 agitation Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/29—Floor-scrubbing machines characterised by means for taking-up dirty liquid
- A47L11/30—Floor-scrubbing machines characterised by means for taking-up dirty liquid by suction
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L9/00—Details or accessories of suction cleaners, e.g. mechanical means for controlling the suction or for effecting pulsating action; Storing devices specially adapted to suction cleaners or parts thereof; Carrying-vehicles specially adapted for suction cleaners
- A47L9/28—Installation of the electric equipment, e.g. adaptation or attachment to the suction cleaner; Controlling suction cleaners by electric means
- A47L9/2805—Parameters or conditions being sensed
- A47L9/2826—Parameters or conditions being sensed the condition of the floor
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/28—Floor-scrubbing machines, motor-driven
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/40—Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers
- A47L11/4011—Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/40—Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers
- A47L11/4036—Parts or details of the surface treating tools
- A47L11/4044—Vacuuming or pick-up tools; Squeegees
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/40—Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers
- A47L11/4063—Driving means; Transmission means therefor
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/40—Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers
- A47L11/4063—Driving means; Transmission means therefor
- A47L11/4066—Propulsion of the whole machine
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L9/00—Details or accessories of suction cleaners, e.g. mechanical means for controlling the suction or for effecting pulsating action; Storing devices specially adapted to suction cleaners or parts thereof; Carrying-vehicles specially adapted for suction cleaners
- A47L9/28—Installation of the electric equipment, e.g. adaptation or attachment to the suction cleaner; Controlling suction cleaners by electric means
- A47L9/2805—Parameters or conditions being sensed
- A47L9/2821—Pressure, vacuum level or airflow
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L9/00—Details or accessories of suction cleaners, e.g. mechanical means for controlling the suction or for effecting pulsating action; Storing devices specially adapted to suction cleaners or parts thereof; Carrying-vehicles specially adapted for suction cleaners
- A47L9/28—Installation of the electric equipment, e.g. adaptation or attachment to the suction cleaner; Controlling suction cleaners by electric means
- A47L9/2805—Parameters or conditions being sensed
- A47L9/2831—Motor parameters, e.g. motor load or speed
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L9/00—Details or accessories of suction cleaners, e.g. mechanical means for controlling the suction or for effecting pulsating action; Storing devices specially adapted to suction cleaners or parts thereof; Carrying-vehicles specially adapted for suction cleaners
- A47L9/28—Installation of the electric equipment, e.g. adaptation or attachment to the suction cleaner; Controlling suction cleaners by electric means
- A47L9/2836—Installation of the electric equipment, e.g. adaptation or attachment to the suction cleaner; Controlling suction cleaners by electric means characterised by the parts which are controlled
- A47L9/2852—Elements for displacement of the vacuum cleaner or the accessories therefor, e.g. wheels, casters or nozzles
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L9/00—Details or accessories of suction cleaners, e.g. mechanical means for controlling the suction or for effecting pulsating action; Storing devices specially adapted to suction cleaners or parts thereof; Carrying-vehicles specially adapted for suction cleaners
- A47L9/28—Installation of the electric equipment, e.g. adaptation or attachment to the suction cleaner; Controlling suction cleaners by electric means
- A47L9/2894—Details related to signal transmission in suction cleaners
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2201/00—Robotic cleaning machines, i.e. with automatic control of the travelling movement or the cleaning operation
- A47L2201/06—Control of the cleaning action for autonomous devices; Automatic detection of the surface condition before, during or after cleaning
Definitions
- the embodiments described herein relate to semi-autonomous cleaning devices and more particularly, to a system and method for detecting the status of one or more components and/or systems in a semi-autonomous cleaning device to determine the operating condition of one or more components.
- robots can be used to clean a surface, mow a lawn, collect items from a stocked inventory, etc.
- some known robots fail to provide a user with an indication of the robot's position, progress, and/or status of one or more components of the system.
- the problem of debris accumulation in back squeegee of a cleaning robot or floor scrubber is a common problem.
- the operator can prevent the problem from happening by observing debris in the floor and avoiding driving the floor scrubber over the debris.
- the operator can also detect if the squeegee has blocking debris by visually inspecting the operation of one or more functions of the floor scrubber such as, for example, the quality of water pick-up provided by the back squeegee.
- the prevention and detection of debris in the back squeegee currently presents challenges that can reduce the efficacy and/or efficiency of these devices.
- systems and methods for detecting the status of one or more components and/or systems in a semi-automatic cleaning device are described herein.
- systems and methods described herein can be used for detecting degradation of back squeegee performance which can obviate or mitigate at least one disadvantage of some known cleaning devices.
- a method for detecting the status of one or more components and/or systems in a semi-automatic cleaning device can include detecting vacuum performance degradation by monitoring the current (amperage) being drawn by the vacuum motor, or the voltage at the terminals of the vacuum motor.
- one or more components can be monitored by inspecting images captured by a camera mounted on a back door of the cleaning device to determine, for example, one or more other problems associated with a squeegee mount, water pick up, and/or the like.
- the systems and/or methods described herein can detect any problems associated with, for example, a back squeegee (or other suitable component) and can warn and/or can provide an indication to the operator about the problem. In some instances, such systems and/or methods can limit and/or substantially prevent water drop by the cleaning device due to any problem that may occur. Other features and advantages of the systems and/or methods are described more fully below.
- FIG. 1 is a rear perspective view of a cleaning device according to an embodiment.
- FIG. 2 is a detailed rear view of a rear-mounted camera on a cleaning device such as, for example, the cleaning device of FIG. 1 .
- FIG. 3 is a rear perspective view illustrating the rear camera scanning a portion of a floor behind the cleaning device to detect the presence of excess water.
- FIG. 4 is a top view of the cleaning device that shows a camera field of vision with respect to the general orientation of the cleaning device.
- FIG. 5 is a flow chart illustrating a method for detecting the status of one or more components and/or systems of a cleaning device according to an embodiment.
- FIG. 6 is a block diagram showing the interconnection of the functional modules used for visual streak detection by the floor scrubber.
- FIG. 7 shows a system block diagram for a squeegee detection algorithm.
- a system and/or method can be provided for detecting the status of one or more components and/or systems of, for example, a semi-automatic cleaning device or the like.
- systems and methods can be used for detecting degradation of back squeegee performance.
- a system and/or method for detecting the status of one or more components is provided for detecting vacuum performance degradation by monitoring the current (amperage) being drawn by a vacuum motor, the voltage at the terminals of the vacuum motor, or the operating power consumed by the vacuum motor.
- the vacuum motor is an electric motor.
- one or more other components can be monitored by inspecting images captured by a camera mounted on a back door of the cleaning device to determine, for example, one or more other problems associated with a squeegee mount, water pick up, and/or the like.
- the systems and/or methods described herein can be used on any suitable device, machine, system, robot, etc.
- the systems and methods described herein can be used with and/or on a semi-autonomous cleaning robot or the like.
- a semi-autonomous cleaning robot can be similar to or substantially the same as any of those described in U.S. Patent Publication No. 2016/0309973 entitled, “Apparatus and Methods for Semi-Autonomous Cleaning of Surfaces,” filed Apr. 25, 2016, the disclosure of which is incorporated herein by reference in its entirety.
- any of the systems and/or methods described herein can be used to measure an electric current of a vacuum motor connected to a main control board of a cleaning device.
- the cleaning device can be any semi-autonomous (or manual or fully autonomous) cleaning device or robot.
- the control board can be, for example, an electronic control board or printed circuit board (PCB) that includes at least a processor and a memory.
- the electric current of the vacuum motor can provide information about the quality of the vacuum being created. For example, in some instances, the current can be relatively high when the vacuum operates correctly and relatively low when there is/are one or more problems (or vice versa).
- Cleaning systems and in particular, vacuum cleaning systems are dependent on the consistent application of cleaning fluid, mechanical agitation, for example with a moving brush system, and the consistent removal of the cleaning fluid from the surface through a vacuum.
- Many cleaning systems rely on a flexible rubber squeegee in pressure contact with the floor to contain the cleaning fluid and debris from the surface for removal by a vacuum system.
- Detecting a clogged vacuum pathway is a difficult problem for either a human operator or for an autonomous vacuum cleaning system.
- the failure is evident by the failure of the vacuum system to adequately remove the cleaning fluid and debris from the surface to the return/dirty water tank. This failure may be observable by noting excess cleaning fluid deposited on the cleaning surface, particularly at the edges of the squeegee. Complicating this situation is the fact that the blockage may be either a partial or a full blockage. This means that the failure symptoms such as excess cleaning fluid deposited on the cleaning surface may appear to various degrees, and in many cases of lighter or partial clogging, be difficult to detect.
- the techniques described herein use various measurement techniques to establish whether the vacuum system is operating within the desired parameter range.
- the measured values of these parameters can be compared to a threshold value, be analyzed through a trend analysis, or compared to previous values to generate a signal indicative of a departure from the desired parameter range, i.e. range of normal operation.
- the measured value may be directly compared to a threshold value instead of computing the difference between the measured value and the threshold value, in for example, a hardware or analog solution.
- the motor current is measured to determine changes that would be consistent with the increased load on the vacuum fan due to a blockage in the in the pathway between the surface being cleaned and a return/dirty water tank.
- motors draw more current when there is greater shaft resistance, in this case due to increased air turbulence at the vacuum fan blades due to clogging.
- the additional load or clogging may also be detected by observing changes to the rotational speed of the motor, for example by an optical encoder connected to an electronic measurement device.
- clogging can be measured by detecting the vacuum fan motor noise or microphonics. As the load on the motor increases due to clogging, the motor will change its characteristic vibrations and vibration frequency.
- the fundamental vibration frequency can be evaluated by connecting a microphone placed on or near to the vacuum fan motor, and sampling the resultant waveform to determine the periodicity.
- the clogging can be detected by measuring the pressure at different points along the vacuum pathway from the squeegee to the return/dirty water tank.
- Normal, non-clogged operation has a characteristic average pressure profile along the length of the vacuum pathway. Placing pressure sensors along this pathway enables the detection of an abnormal pressure pattern (differential suction) by comparing the relative pressure at points along the vacuum pathway.
- An extra pressure sensor outside the vacuum system can be used to provide a reference pressure, and to confirm that the entire system is operating under adequate vacuum.
- control board and/or electronic system of the cleaning device can use and/or analyze the image coming from the back camera to detect the position of the squeegee, for example, using a basic masking. If the squeegee is out of position, the control board and/or electronic system can, for example, use image filtering or the like to detect this problem. In other instances, the control board and/or electronic system can perform any other technique such as, for example, edge detection. For example, if the squeegee has a leaking problem, streaks may be left behind the squeegee.
- a streak detector can be used and/or implemented at or by the control board or electronic system.
- a neural network can be used and/or implemented at or by the control board or electronic system to estimate the most likely parameters associated with the streak detection algorithm.
- Other visual artifacts such as detecting irregular ripples or pooled fluid indicating a misplaced or damaged squeegee can be similarly implemented with suitable standard image analysis algorithms.
- FIG. 1 is a perspective view illustrating semi-autonomous cleaning device 100 according to an embodiment.
- the semi-autonomous cleaning device 100 (also referred to herein as “cleaning device,” “device,”, “vacuum cleaning system”, and/or “floor scrubber”) can be any suitable device, machine, system, robot, etc. configured to clean, scrub, or otherwise move along a surface in an at least semi-autonomous manner.
- the cleaning device 100 can be similar to or substantially the same as any of the cleaning devices described in the US 2016/0309973 publication. While described as a “semi-autonomous” cleaning device 100 , it should be understood that the cleaning device 100 can be fully autonomous or can include one or more systems, subsystems, components, etc. configured to function autonomously. Accordingly, the term “semi-autonomous” is not intended to be limiting to a cleaning device that functions in a partially autonomous manner.
- the floor scrubber 100 includes a set of water tanks and covers 101 (top cover not shown) coupled to a frame 102 with an attached cleaning head 103 and rear squeegee 104 .
- water is dispensed onto the floor through the cleaning head and vacuumed up into a return/dirty water tank 105 .
- a vacuum motor 106 held within the return water tank is a vacuum motor 106 that generates a suction force operable to pull the water off the floor near the rear squeegee and into the return/dirty water tank 105 .
- the floor scrubber 100 includes handlebars 107 , which can be used for steering control during manual operation but are not active when the machine is in autonomous run mode.
- the floor scrubber 100 includes an electronic system having one or more computing devices configured to control one or more components of the floor scrubber 100 .
- the electronic system can be similar to or substantially the same as those included in the cleaning devices described in the US 2016/0309973 publication.
- the electronic system can include a control board, a printed circuit board (PCB), and or any suitable computing device, each of which can include at least a memory and a processor. Controls, instructions, and/or information is displayed to an operator through a touch screen 108 that is included in and/or electrically or electronically connected to the electronic system.
- PCB printed circuit board
- FIG. 2 illustrates a detailed view of a portion of a floor scrubber 200 .
- the floor scrubber 200 can be similar to or the same as the floor scrubber 100 described above with reference to FIG. 1 .
- the rear of the floor scrubber 200 has an electrical access panel 201 which has a camera 202 mounted to the access panel 201 that is pointed behind the floor scrubber 200 to monitor water pick up off the floor.
- the floor scrubber 200 can be similar to any of the cleaning devices described in detail in the US 2016/0309973 publication.
- the camera 202 can be any suitable imaging device configured to capture a still image or record a video.
- the camera 202 can be configured to capture a still image or a video of a portion of the floor from which information can be analyzed and/or extracted to determine, for example, an amount of water left on the floor.
- FIG. 3 illustrates a detailed view of the overall operation of capturing an image or recording a video using the camera 202 .
- the camera 202 is configured to scan the path behind the floor scrubber 200 .
- the camera field of vision depicted by 301 is to provide a visual aide, but the actual field of vision is related to the ability of the camera 200 . That is to say, in some embodiments, the camera's 202 field of vision can be larger than the field of vision 301 shown in FIG. 3 , can be smaller than the field of vision 301 , and/or can be a different shape that the shape of the field of vision 301 .
- one or more settings of the camera 202 can be modified such that the camera 202 has any desired field of vision.
- the target area to be monitored is located behind a rear squeegee 303 (e.g., similar to or the same as the rear squeegee 104 shown in FIG. 1 ), which is inspecting the floor where the floor scrubber has just cleaned.
- the target area to be monitored is within the field of vision 301 and includes an area of the floor behind the rear squeegee 303 .
- FIG. 4 illustrates a position along a surface associated with a field of vision 402 of the camera 202 as a cleaning device 400 (e.g., similar to or the same as the cleaning devices 100 and/or 200 ) moves along the surface.
- FIG. 4 illustrates a top view of the cleaning device that shows a camera field of vision with respect to the general orientation of the cleaning device.
- the field of vision monitored by the rear camera is extended towards the floor scrubber to include rear components of the floor scrubber, including the rear squeegee. This allows the camera image to be analyzed for the presence and correct positioning of the features of the floor scrubber including the rear squeegee.
- FIG. 5 is a flow chart illustrating an overview of a process flow 500 or logic executed by the electronic system within the floor scrubber (e.g., the floor scrubber 100 , 200 , and/or 400 ).
- the floor scrubber begins, cleaning, at step 503 , at a designated, desired, and/or predetermined area.
- the one or more cameras on the floor scrubber captures one or more images or records one or more videos of the recently cleaned surface, at step 506 . These images or videos are then monitored and analyzed by the on-board computing device (e.g., included in the electronic system), at step 506 .
- a streak detection algorithm can be used to detect excess water at step 508 .
- a streak detection algorithm is the canny edge detection algorithm or variations thereof.
- the streak detection algorithm is an image processing technique that takes the image gathered (e.g., from step 506 ), removes any excess noise, and evaluates intensity gradients of the image (or image data). If the gradient value of the edges in the image is calculated to be below a predetermined threshold and no potential edges are detected, the floor cleaner continues to operate where the process reverts back to normal cleaning (e.g., at step 503 ). If the streak detection algorithm detects excess water, indicated by visual artifacts (at step 508 ), it moves on to the next step of the flow chart (at step 514 ).
- Excess water detection, indicating improper or compromised cleaning operation may be accomplished by measuring the intensity gradient within an image or image data, determining whether there is a potential edge of water in the path cleaned by the floor scrubber.
- the computing device of the floor scrubber flags and/or otherwise defines an indication of a potential issue with the rear squeegee (e.g., the rear squeegee 303 ).
- the computing device on-board the floor scrubber monitors a voltage and amperage associated with and/or otherwise drawn by a vacuum motor at step 514 .
- a drop or spike in the voltage and/or amperage of the vacuum motor may indicate an issue with the rear squeegee such as a blockage or any other cause of suction loss, such as a clogged vacuum pathway. If the drop or spike in the voltage and/or amperage occurs in conjunction with the streak detection algorithm (visual scanning) indicating potential water detected, at step 514 , the floor scrubber will move to the next step 518 to halt operation and alert the operator in order to prevent potential damage to the device or to prevent leaving excess water on the floor.
- a poorly functioning vacuum motor can also be detected by detecting electrical parameters of the motor, for example applied voltage with not current drawn.
- the rear squeegee can be a consumable item that can be serviced, removed, and/or replaced.
- the electronic system and/or the compute device included therein can initiate a corrective action such as sending an alert or notification to the operator indicative of in instruction to motor and/or maintenance the rear squeegee, at step 522 .
- the alert and/or notification can be any suitable alert and/or notification.
- the alert and/or notification can be a visual indication (e.g., a flashing light, visual light, etc.) and/or an audible indication (e.g., an alarm, an audio sound or any suitable audible output).
- the corrective action can include sending or wirelessly transmitting an alert or notification such as an electronic signal sent to a remote electronic device such as, for example, a controller, a remote, a smart phone, a desktop, a laptop, a control server and/or any other suitable device.
- the signal may also be directed to a remote autonomous floor scrubber management system, wherein repair and maintenance functions can be coordinated for one or more floor scrubbers or other machines.
- the signal can be indicative of an instruction for the remote device to provide an alert or notification to be observed by the operator.
- the electronic signal can be an electronic message (e-mail, an instant message (IM), a text notification or short message service (SMS) or a facsimile (e.g., fax),
- the alert and/or notification may include tactile vibrations such as buzzing of a mobile phone or pager on the operator and rumbling of the steering wheel or seat of the floor scrubber.
- Corrective actions can include directing an operator or maintenance personnel to inspect various subsystems of the floor scrubber, stopping the floor scrubber, stopping the vacuum motor, logging the time, status and/or position of the floor scrubber, ordering replacement parts, or indicating additional repair, correction, or maintenance activities.
- FIG. 6 is a block diagram showing the interconnection of the functional modules used for visual streak detection by the floor scrubber (e.g., the floor scrubber 100 , 200 , and/or 400 ).
- the block diagram 600 of FIG. 6 includes a Front Camera 608 that is mounted on the front of the floor scrubber, generally pointing in the direction of travel for the floor scrubber.
- the Front Camera 608 feeds the continuous image to the Preprocessing unit 607 , which filters and transforms the image to a reference image.
- the Preprocessing Unit 607 applies image processing filters on the input image to remove noise, reduce size or transform to another space. These operations can be done with OpenCV or with other similar software libraries.
- the preprocessor outputs video data to the Features Estimation unit 606 .
- the Features Estimation Unit 606 extracts edge, color and texture features from the preprocessed image. These operations could be done with OpenCV libraries or coded using algorithms found in well-known image processing literature.
- system 600 also has a Rear Camera 601 , that is mounted on the rear of the floor scrubber, generally pointing opposite the direction of travel for the floor scrubber.
- the Rear Camera 601 feeds the continuous image to the Preprocessing unit 602 , which filters and transforms the image to an image of interest.
- the continuous image stream may be sampled periodically to provide a series of static images for use in further image processing.
- the Preprocessing Unit 602 applies image processing filters on the input image to remove noise, reduce size or transform to another space.
- the two image streams coming from Features Estimation unit 606 and Features Estimation unit 603 are compared in Water Areas Segmentation unit 604 .
- the Water Areas Segmentation Unit 604 examines the generated edge, color and texture features from both rear and front cameras and provides a likelihood for different image areas to be covered with water.
- a learning-based mechanism such as Support Vector Machine (SVM) can be used.
- SVM Support Vector Machine
- the Decision Rendering unit 605 takes the output of the Water Areas Segmentation unit 604 and decides on the presence of water patches and generate appropriate notifications.
- FIG. 7 shows a system block diagram for the squeegee detection algorithm.
- the block diagram 700 of FIG. 7 includes a Rear Camera 701 that sends continuous video output to Preprocessing unit 702 .
- Preprocessing unit 702 provides discrete features extraction and/or applies image processing filters on the input image to remove noise, reduce size or transform to another space. These operations could be done with OpenCV or with similar software libraries.
- the output of the Preprocessing unit 702 is fed into the Matching unit 703 .
- the Memory 704 contains reference features encoded to facilitate easy comparison the features identified by the Rear Camera 701 .
- the Memory 704 also contains information on where in the visual field the identified objects should be placed.
- the Memory 704 feeds into the Model Generation unit 705 , that creates a model for comparison to the actual features and position observed by the Rear Camera 701 .
- Model generation could be as simple as retrieving a template or a set of features from memory, or it could involve rotating, resizing or subdividing the template or model to match against different possible location and orientations of the squeegee in the image. These operations could be done with the help of standard computer vision or computer graphics libraries such as OpenCV and or OpenGL.
- the Matching module 703 compares discrete features by comparing their descriptors which could be done using an algorithm like RANSAC for example which is also available in OpenCV, or by performing patch matching.
- Pose estimation uses the results of matching to generate a hypothesis (or hypotheses) about the pose of the squeegee in the image, including a confidence estimation.
- the Decision Rendering unit 707 utilizes the results of pose estimation to determine whether the squeegee or any of its visually identifiable (visually monitored) mechanical components such as squeegee, squeegee assembly, bolts, carrier, or idler wheels are in the correct position, misaligned, trailing behind the robot or totally absent and generate appropriate notifications and corrective actions.
- Identifying misplaced or misaligned components is particularly crucial for removeable, replaceable, or disposable parts such as rear squeegee rubbers and idler wheels. While in this implementation, the camera position is advantageously directed to the rear of the device and towards the rear squeegee assembly, other implementations may benefit from cameras other positions, including at the underside, rear, front or side of the floor scrubber.
- the system compares the intensity gradients of a front facing camera with the gradient of a rear facing camera to account for baseline intensity gradients of the surface being cleaned. Some delay or hysteresis is added to the signaling algorithm, for situations where the intensity gradient of the surface being cleaned is changing due to different patterns in the surface.
- edge detection algorithm detects streaking at the edges of the squeegee during sharper turns in the cleaning path
- areas that have not been cleaned properly can be logged into a database to note for further cleaning. From this database, the areas where some such streaking occurs can be marked for a second pass and re-cleaned.
- the monitoring systems described herein can be used to detect the presence of multiple failures, either individually, or preferably in concert to improve the quality and specificity of alerts and corrective actions.
- Corrective actions can include directing an operator or maintenance personnel to inspect various subsystems of the floor scrubber, stopping the floor scrubber, logging the time, status and/or position of the floor scrubber, ordering replacement parts, or indicating additional repair, correction, or maintenance activities. These activities can be prioritized in the order they are presented to an operator or to maintenance personnel by some combination of ease of execution of the corrective action, cost of the corrective action, or likelihood of a specific cause of the fault.
- the computing device on-board the floor scrubber monitors a voltage and amperage associated with and/or otherwise drawn by a vacuum motor 514 .
- a drop or spike in the voltage and/or amperage of the vacuum motor 516 can indicate an issue with the rear squeegee such as a blockage or any other cause of suction loss. If the drop or spike in the voltage and/or amperage occurs in conjunction with the canny or streak detection algorithm (visual scanning) indicating potential water detected (e.g., at step 512 ), the floor scrubber will halt operation 518 to prevent potential damage or to prevent leaving excess water on the floor.
- the rear squeegee can be a consumable item that can be serviced, removed, and/or replaced.
- the electronic system and/or the compute device included therein can send an alert or notification to the operator (i.e., alerting the operator) indicative of in instruction to motor and/or maintenance the rear squeegee 522 .
- the alert and/or notification can be any suitable alert and/or notification.
- the alert and/or notification can be a visual indication (e.g., a flashing light, etc.) and/or an audible indication (e.g., an alarm, or any suitable audible output).
- the alert or notification can be a signal sent to a remote electronic device such as, for example, a controller, a remote, a smart phone, a desktop, a laptop, a control server and/or any other suitable device.
- the signal can be indicative of an instruction for the remote device to provide an alert or notification to be observed by the operator.
- the monitoring systems described herein can be used to detect different types of failures, either individually, or preferably in concert for more precise diagnostic capabilities. For example, a compromised vacuum function can be created if a squeegee develops a hole, tear or aperture, is misplaced, is an incorrect part, is installed with excessive skew or otherwise misaligned, is dragging debris, falls off entirely, or is worn to the extent that it does not make a good seal with the cleaning surface.
- the clog detection system would measure out of range pressure along the vacuum pathway relative to ambient pressure.
- the operating electrical or mechanical parameters such as speed of the vacuum motor or current draw may also depart from normal operating parameters under the above conditions, due to decreased air turbulence at the vacuum fan blades due to additional air flow.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Electric Vacuum Cleaner (AREA)
Abstract
Description
- The application claims priority to and the benefit of U.S. Provisional Patent Application Ser. No. 62/617,716, entitled “DETECTING DEGRADATION OF BACK SQUEEGEE WATER PICK-UP PERFORMANCE FOR AUTONOMOUS FLOOR SCRUBBERS”, filed on Jan. 16, 2018, the disclosure of which is incorporated herein by reference in its entirety.
- The embodiments described herein relate to semi-autonomous cleaning devices and more particularly, to a system and method for detecting the status of one or more components and/or systems in a semi-autonomous cleaning device to determine the operating condition of one or more components.
- The use of semi-autonomous devices configured to perform a set of tasks is known. For example, robots can be used to clean a surface, mow a lawn, collect items from a stocked inventory, etc. In some instances, however, some known robots fail to provide a user with an indication of the robot's position, progress, and/or status of one or more components of the system. For example, the problem of debris accumulation in back squeegee of a cleaning robot or floor scrubber is a common problem. In manual floor scrubbers, the operator can prevent the problem from happening by observing debris in the floor and avoiding driving the floor scrubber over the debris. The operator can also detect if the squeegee has blocking debris by visually inspecting the operation of one or more functions of the floor scrubber such as, for example, the quality of water pick-up provided by the back squeegee. In self-driving or semi-automatic floor scrubbers, the prevention and detection of debris in the back squeegee currently presents challenges that can reduce the efficacy and/or efficiency of these devices.
- Systems and methods for detecting the status of one or more components and/or systems in a semi-automatic cleaning device are described herein. For example, systems and methods described herein can be used for detecting degradation of back squeegee performance which can obviate or mitigate at least one disadvantage of some known cleaning devices.
- In some embodiments, a method for detecting the status of one or more components and/or systems in a semi-automatic cleaning device can include detecting vacuum performance degradation by monitoring the current (amperage) being drawn by the vacuum motor, or the voltage at the terminals of the vacuum motor. In addition, one or more components can be monitored by inspecting images captured by a camera mounted on a back door of the cleaning device to determine, for example, one or more other problems associated with a squeegee mount, water pick up, and/or the like.
- Thus, the systems and/or methods described herein can detect any problems associated with, for example, a back squeegee (or other suitable component) and can warn and/or can provide an indication to the operator about the problem. In some instances, such systems and/or methods can limit and/or substantially prevent water drop by the cleaning device due to any problem that may occur. Other features and advantages of the systems and/or methods are described more fully below.
-
FIG. 1 is a rear perspective view of a cleaning device according to an embodiment. -
FIG. 2 is a detailed rear view of a rear-mounted camera on a cleaning device such as, for example, the cleaning device ofFIG. 1 . -
FIG. 3 is a rear perspective view illustrating the rear camera scanning a portion of a floor behind the cleaning device to detect the presence of excess water. -
FIG. 4 is a top view of the cleaning device that shows a camera field of vision with respect to the general orientation of the cleaning device. -
FIG. 5 is a flow chart illustrating a method for detecting the status of one or more components and/or systems of a cleaning device according to an embodiment. -
FIG. 6 is a block diagram showing the interconnection of the functional modules used for visual streak detection by the floor scrubber. -
FIG. 7 shows a system block diagram for a squeegee detection algorithm. - In some embodiments, a system and/or method can be provided for detecting the status of one or more components and/or systems of, for example, a semi-automatic cleaning device or the like. For example, systems and methods can be used for detecting degradation of back squeegee performance. In some embodiments, a system and/or method for detecting the status of one or more components is provided for detecting vacuum performance degradation by monitoring the current (amperage) being drawn by a vacuum motor, the voltage at the terminals of the vacuum motor, or the operating power consumed by the vacuum motor. In some embodiments, the vacuum motor is an electric motor. In addition, one or more other components can be monitored by inspecting images captured by a camera mounted on a back door of the cleaning device to determine, for example, one or more other problems associated with a squeegee mount, water pick up, and/or the like.
- The systems and/or methods described herein can be used on any suitable device, machine, system, robot, etc. For example, in some embodiments, the systems and methods described herein can be used with and/or on a semi-autonomous cleaning robot or the like. In some embodiments, such a semi-autonomous cleaning robot can be similar to or substantially the same as any of those described in U.S. Patent Publication No. 2016/0309973 entitled, “Apparatus and Methods for Semi-Autonomous Cleaning of Surfaces,” filed Apr. 25, 2016, the disclosure of which is incorporated herein by reference in its entirety.
- In some embodiments, any of the systems and/or methods described herein can be used to measure an electric current of a vacuum motor connected to a main control board of a cleaning device. The cleaning device can be any semi-autonomous (or manual or fully autonomous) cleaning device or robot. The control board can be, for example, an electronic control board or printed circuit board (PCB) that includes at least a processor and a memory. The electric current of the vacuum motor can provide information about the quality of the vacuum being created. For example, in some instances, the current can be relatively high when the vacuum operates correctly and relatively low when there is/are one or more problems (or vice versa).
- Cleaning systems, and in particular, vacuum cleaning systems are dependent on the consistent application of cleaning fluid, mechanical agitation, for example with a moving brush system, and the consistent removal of the cleaning fluid from the surface through a vacuum. Many cleaning systems rely on a flexible rubber squeegee in pressure contact with the floor to contain the cleaning fluid and debris from the surface for removal by a vacuum system.
- One of the significant problems with vacuum cleaning systems is the potential for larger objects, such as plastic bags, balls, packaging, or other objects to become lodged in the pathway between the surface being cleaned and a return/dirty water tank, creating a compromised vacuum function. A lodged object will block the proper flow of cleaning fluid and debris from the surface to the return/dirty water tank, and compromise the cleaning effectiveness of the system, caused by a compromised cleaning operation of some component or components of the floor scrubber. This problem is exacerbated when the cleaning system is autonomous, as much time may pass before the blockage situation is detected and resolved through a corrective action, resulting in improperly cleaned surfaces and requiring expensive and time-consuming re-cleaning.
- When cleaning a surface, many different types of debris can be present. In an ideal situation, the surfaces to be cleaned by the vacuum cleaning system have been pre-cleaned of all large debris. Typically, this pre-cleaning is done manually by human workers who operate brooms and other tools to pick up the larger debris and remove it manually in bins. While this pre-cleaning process is time consuming and expensive, it is even less desirable to have the vacuum cleaning system routinely compromised by clogging debris.
- Detecting a clogged vacuum pathway is a difficult problem for either a human operator or for an autonomous vacuum cleaning system. In some cases, the failure is evident by the failure of the vacuum system to adequately remove the cleaning fluid and debris from the surface to the return/dirty water tank. This failure may be observable by noting excess cleaning fluid deposited on the cleaning surface, particularly at the edges of the squeegee. Complicating this situation is the fact that the blockage may be either a partial or a full blockage. This means that the failure symptoms such as excess cleaning fluid deposited on the cleaning surface may appear to various degrees, and in many cases of lighter or partial clogging, be difficult to detect.
- The techniques described herein use various measurement techniques to establish whether the vacuum system is operating within the desired parameter range. The measured values of these parameters can be compared to a threshold value, be analyzed through a trend analysis, or compared to previous values to generate a signal indicative of a departure from the desired parameter range, i.e. range of normal operation. Of course, depending on the configuration of the system, the measured value may be directly compared to a threshold value instead of computing the difference between the measured value and the threshold value, in for example, a hardware or analog solution.
- In one aspect, the motor current is measured to determine changes that would be consistent with the increased load on the vacuum fan due to a blockage in the in the pathway between the surface being cleaned and a return/dirty water tank. Normally, motors draw more current when there is greater shaft resistance, in this case due to increased air turbulence at the vacuum fan blades due to clogging. The additional load or clogging may also be detected by observing changes to the rotational speed of the motor, for example by an optical encoder connected to an electronic measurement device.
- In another aspect of the invention, clogging can be measured by detecting the vacuum fan motor noise or microphonics. As the load on the motor increases due to clogging, the motor will change its characteristic vibrations and vibration frequency. The fundamental vibration frequency can be evaluated by connecting a microphone placed on or near to the vacuum fan motor, and sampling the resultant waveform to determine the periodicity.
- In another aspect of the invention, the clogging can be detected by measuring the pressure at different points along the vacuum pathway from the squeegee to the return/dirty water tank. Normal, non-clogged operation has a characteristic average pressure profile along the length of the vacuum pathway. Placing pressure sensors along this pathway enables the detection of an abnormal pressure pattern (differential suction) by comparing the relative pressure at points along the vacuum pathway. An extra pressure sensor outside the vacuum system (ambient) can be used to provide a reference pressure, and to confirm that the entire system is operating under adequate vacuum.
- The embodiments and/or methods described here also can be used to inspect visually one or more components using the back camera. For example, the control board and/or electronic system of the cleaning device can use and/or analyze the image coming from the back camera to detect the position of the squeegee, for example, using a basic masking. If the squeegee is out of position, the control board and/or electronic system can, for example, use image filtering or the like to detect this problem. In other instances, the control board and/or electronic system can perform any other technique such as, for example, edge detection. For example, if the squeegee has a leaking problem, streaks may be left behind the squeegee. To detect edges, a streak detector can be used and/or implemented at or by the control board or electronic system. To tune one or more parameters to trace the streak, a neural network can be used and/or implemented at or by the control board or electronic system to estimate the most likely parameters associated with the streak detection algorithm. Other visual artifacts, such as detecting irregular ripples or pooled fluid indicating a misplaced or damaged squeegee can be similarly implemented with suitable standard image analysis algorithms.
-
FIG. 1 is a perspective view illustratingsemi-autonomous cleaning device 100 according to an embodiment. The semi-autonomous cleaning device 100 (also referred to herein as “cleaning device,” “device,”, “vacuum cleaning system”, and/or “floor scrubber”) can be any suitable device, machine, system, robot, etc. configured to clean, scrub, or otherwise move along a surface in an at least semi-autonomous manner. For example, in some embodiments, thecleaning device 100 can be similar to or substantially the same as any of the cleaning devices described in the US 2016/0309973 publication. While described as a “semi-autonomous”cleaning device 100, it should be understood that thecleaning device 100 can be fully autonomous or can include one or more systems, subsystems, components, etc. configured to function autonomously. Accordingly, the term “semi-autonomous” is not intended to be limiting to a cleaning device that functions in a partially autonomous manner. - As illustrated in
FIG. 1 , thefloor scrubber 100 includes a set of water tanks and covers 101 (top cover not shown) coupled to aframe 102 with an attachedcleaning head 103 andrear squeegee 104. During operation water is dispensed onto the floor through the cleaning head and vacuumed up into a return/dirty water tank 105. Held within the return water tank is avacuum motor 106 that generates a suction force operable to pull the water off the floor near the rear squeegee and into the return/dirty water tank 105. Thefloor scrubber 100 includeshandlebars 107, which can be used for steering control during manual operation but are not active when the machine is in autonomous run mode. - Although not shown in
FIG. 1 , thefloor scrubber 100 includes an electronic system having one or more computing devices configured to control one or more components of thefloor scrubber 100. For example, in some embodiments, the electronic system can be similar to or substantially the same as those included in the cleaning devices described in the US 2016/0309973 publication. As such, the electronic system can include a control board, a printed circuit board (PCB), and or any suitable computing device, each of which can include at least a memory and a processor. Controls, instructions, and/or information is displayed to an operator through atouch screen 108 that is included in and/or electrically or electronically connected to the electronic system. -
FIG. 2 illustrates a detailed view of a portion of afloor scrubber 200. Thefloor scrubber 200 can be similar to or the same as thefloor scrubber 100 described above with reference toFIG. 1 . The rear of thefloor scrubber 200 has anelectrical access panel 201 which has acamera 202 mounted to theaccess panel 201 that is pointed behind thefloor scrubber 200 to monitor water pick up off the floor. As described above, thefloor scrubber 200 can be similar to any of the cleaning devices described in detail in the US 2016/0309973 publication. Thecamera 202 can be any suitable imaging device configured to capture a still image or record a video. More particularly, with thecamera 202 pointed behind the floor scrubber 200 (e.g., toward the floor), thecamera 202 can be configured to capture a still image or a video of a portion of the floor from which information can be analyzed and/or extracted to determine, for example, an amount of water left on the floor. -
FIG. 3 illustrates a detailed view of the overall operation of capturing an image or recording a video using thecamera 202. Thecamera 202 is configured to scan the path behind thefloor scrubber 200. The camera field of vision depicted by 301 is to provide a visual aide, but the actual field of vision is related to the ability of thecamera 200. That is to say, in some embodiments, the camera's 202 field of vision can be larger than the field ofvision 301 shown inFIG. 3 , can be smaller than the field ofvision 301, and/or can be a different shape that the shape of the field ofvision 301. Moreover, in some embodiments, one or more settings of thecamera 202 can be modified such that thecamera 202 has any desired field of vision. In some instances, the target area to be monitored is located behind a rear squeegee 303 (e.g., similar to or the same as therear squeegee 104 shown inFIG. 1 ), which is inspecting the floor where the floor scrubber has just cleaned. In other words, the target area to be monitored is within the field ofvision 301 and includes an area of the floor behind therear squeegee 303.FIG. 4 illustrates a position along a surface associated with a field ofvision 402 of thecamera 202 as a cleaning device 400 (e.g., similar to or the same as thecleaning devices 100 and/or 200) moves along the surface. -
FIG. 4 illustrates a top view of the cleaning device that shows a camera field of vision with respect to the general orientation of the cleaning device. In some embodiments, the field of vision monitored by the rear camera is extended towards the floor scrubber to include rear components of the floor scrubber, including the rear squeegee. This allows the camera image to be analyzed for the presence and correct positioning of the features of the floor scrubber including the rear squeegee. -
FIG. 5 is a flow chart illustrating an overview of aprocess flow 500 or logic executed by the electronic system within the floor scrubber (e.g., thefloor scrubber step 502, the floor scrubber begins, cleaning, atstep 503, at a designated, desired, and/or predetermined area. During the cleaning process, atstep 503, the one or more cameras on the floor scrubber captures one or more images or records one or more videos of the recently cleaned surface, atstep 506. These images or videos are then monitored and analyzed by the on-board computing device (e.g., included in the electronic system), atstep 506. Further, a streak detection algorithm can be used to detect excess water atstep 508. One example of a streak detection algorithm is the canny edge detection algorithm or variations thereof. The streak detection algorithm is an image processing technique that takes the image gathered (e.g., from step 506), removes any excess noise, and evaluates intensity gradients of the image (or image data). If the gradient value of the edges in the image is calculated to be below a predetermined threshold and no potential edges are detected, the floor cleaner continues to operate where the process reverts back to normal cleaning (e.g., at step 503). If the streak detection algorithm detects excess water, indicated by visual artifacts (at step 508), it moves on to the next step of the flow chart (at step 514). Excess water detection, indicating improper or compromised cleaning operation (at step 508) may be accomplished by measuring the intensity gradient within an image or image data, determining whether there is a potential edge of water in the path cleaned by the floor scrubber. In further embodiment, the computing device of the floor scrubber flags and/or otherwise defines an indication of a potential issue with the rear squeegee (e.g., the rear squeegee 303). - In further embodiments, the computing device on-board the floor scrubber monitors a voltage and amperage associated with and/or otherwise drawn by a vacuum motor at
step 514. In some instances, a drop or spike in the voltage and/or amperage of the vacuum motor, atstep 514, may indicate an issue with the rear squeegee such as a blockage or any other cause of suction loss, such as a clogged vacuum pathway. If the drop or spike in the voltage and/or amperage occurs in conjunction with the streak detection algorithm (visual scanning) indicating potential water detected, atstep 514, the floor scrubber will move to thenext step 518 to halt operation and alert the operator in order to prevent potential damage to the device or to prevent leaving excess water on the floor. A poorly functioning vacuum motor can also be detected by detecting electrical parameters of the motor, for example applied voltage with not current drawn. - In further embodiments, the rear squeegee can be a consumable item that can be serviced, removed, and/or replaced. Thus, if excess water is detected, at
step 508, and there is no change in the voltage and/or amperage (e.g., no drop or spike) to the vacuum motor, atstep 514, then the electronic system and/or the compute device included therein, can initiate a corrective action such as sending an alert or notification to the operator indicative of in instruction to motor and/or maintenance the rear squeegee, atstep 522. The alert and/or notification can be any suitable alert and/or notification. For example, the alert and/or notification can be a visual indication (e.g., a flashing light, visual light, etc.) and/or an audible indication (e.g., an alarm, an audio sound or any suitable audible output). In other embodiments, the corrective action can include sending or wirelessly transmitting an alert or notification such as an electronic signal sent to a remote electronic device such as, for example, a controller, a remote, a smart phone, a desktop, a laptop, a control server and/or any other suitable device. The signal may also be directed to a remote autonomous floor scrubber management system, wherein repair and maintenance functions can be coordinated for one or more floor scrubbers or other machines. The signal can be indicative of an instruction for the remote device to provide an alert or notification to be observed by the operator. The electronic signal can be an electronic message (e-mail, an instant message (IM), a text notification or short message service (SMS) or a facsimile (e.g., fax), In further embodiments, the alert and/or notification may include tactile vibrations such as buzzing of a mobile phone or pager on the operator and rumbling of the steering wheel or seat of the floor scrubber. Corrective actions can include directing an operator or maintenance personnel to inspect various subsystems of the floor scrubber, stopping the floor scrubber, stopping the vacuum motor, logging the time, status and/or position of the floor scrubber, ordering replacement parts, or indicating additional repair, correction, or maintenance activities. -
FIG. 6 is a block diagram showing the interconnection of the functional modules used for visual streak detection by the floor scrubber (e.g., thefloor scrubber FIG. 6 includes aFront Camera 608 that is mounted on the front of the floor scrubber, generally pointing in the direction of travel for the floor scrubber. TheFront Camera 608 feeds the continuous image to thePreprocessing unit 607, which filters and transforms the image to a reference image. ThePreprocessing Unit 607 applies image processing filters on the input image to remove noise, reduce size or transform to another space. These operations can be done with OpenCV or with other similar software libraries. The preprocessor outputs video data to theFeatures Estimation unit 606. TheFeatures Estimation Unit 606 extracts edge, color and texture features from the preprocessed image. These operations could be done with OpenCV libraries or coded using algorithms found in well-known image processing literature. - Furthermore,
system 600 also has aRear Camera 601, that is mounted on the rear of the floor scrubber, generally pointing opposite the direction of travel for the floor scrubber. TheRear Camera 601 feeds the continuous image to thePreprocessing unit 602, which filters and transforms the image to an image of interest. As is known in image processing technology, the continuous image stream may be sampled periodically to provide a series of static images for use in further image processing. ThePreprocessing Unit 602 applies image processing filters on the input image to remove noise, reduce size or transform to another space. The two image streams coming fromFeatures Estimation unit 606 andFeatures Estimation unit 603 are compared in WaterAreas Segmentation unit 604. The WaterAreas Segmentation Unit 604 examines the generated edge, color and texture features from both rear and front cameras and provides a likelihood for different image areas to be covered with water. A learning-based mechanism such as Support Vector Machine (SVM) can be used. In addition, and not shown, would be a comparison delay equivalent to the transit time for floor scrubber between the two cameras, so that the comparison is on the same area of the floor, pre and post cleaning. TheDecision Rendering unit 605, takes the output of the WaterAreas Segmentation unit 604 and decides on the presence of water patches and generate appropriate notifications. -
FIG. 7 shows a system block diagram for the squeegee detection algorithm. The block diagram 700 ofFIG. 7 includes aRear Camera 701 that sends continuous video output toPreprocessing unit 702. Preprocessingunit 702 provides discrete features extraction and/or applies image processing filters on the input image to remove noise, reduce size or transform to another space. These operations could be done with OpenCV or with similar software libraries. The output of thePreprocessing unit 702 is fed into theMatching unit 703. TheMemory 704 contains reference features encoded to facilitate easy comparison the features identified by theRear Camera 701. TheMemory 704 also contains information on where in the visual field the identified objects should be placed. TheMemory 704 feeds into theModel Generation unit 705, that creates a model for comparison to the actual features and position observed by theRear Camera 701. Model generation could be as simple as retrieving a template or a set of features from memory, or it could involve rotating, resizing or subdividing the template or model to match against different possible location and orientations of the squeegee in the image. These operations could be done with the help of standard computer vision or computer graphics libraries such as OpenCV and or OpenGL. TheMatching module 703, compares discrete features by comparing their descriptors which could be done using an algorithm like RANSAC for example which is also available in OpenCV, or by performing patch matching. This can be done with standard techniques available in opensource libraries or coded following well known image processing algorithms. The output of theMatching unit 703 feeds into thePose Extraction unit 706. Pose estimation uses the results of matching to generate a hypothesis (or hypotheses) about the pose of the squeegee in the image, including a confidence estimation. TheDecision Rendering unit 707, utilizes the results of pose estimation to determine whether the squeegee or any of its visually identifiable (visually monitored) mechanical components such as squeegee, squeegee assembly, bolts, carrier, or idler wheels are in the correct position, misaligned, trailing behind the robot or totally absent and generate appropriate notifications and corrective actions. Identifying misplaced or misaligned components is particularly crucial for removeable, replaceable, or disposable parts such as rear squeegee rubbers and idler wheels. While in this implementation, the camera position is advantageously directed to the rear of the device and towards the rear squeegee assembly, other implementations may benefit from cameras other positions, including at the underside, rear, front or side of the floor scrubber. - In another embodiment, the system compares the intensity gradients of a front facing camera with the gradient of a rear facing camera to account for baseline intensity gradients of the surface being cleaned. Some delay or hysteresis is added to the signaling algorithm, for situations where the intensity gradient of the surface being cleaned is changing due to different patterns in the surface.
- In situations where the edge detection algorithm detects streaking at the edges of the squeegee during sharper turns in the cleaning path, such areas that have not been cleaned properly can be logged into a database to note for further cleaning. From this database, the areas where some such streaking occurs can be marked for a second pass and re-cleaned. The monitoring systems described herein can be used to detect the presence of multiple failures, either individually, or preferably in concert to improve the quality and specificity of alerts and corrective actions. Corrective actions can include directing an operator or maintenance personnel to inspect various subsystems of the floor scrubber, stopping the floor scrubber, logging the time, status and/or position of the floor scrubber, ordering replacement parts, or indicating additional repair, correction, or maintenance activities. These activities can be prioritized in the order they are presented to an operator or to maintenance personnel by some combination of ease of execution of the corrective action, cost of the corrective action, or likelihood of a specific cause of the fault.
- In further embodiments, the computing device on-board the floor scrubber monitors a voltage and amperage associated with and/or otherwise drawn by a
vacuum motor 514. In some instances, a drop or spike in the voltage and/or amperage of the vacuum motor 516 can indicate an issue with the rear squeegee such as a blockage or any other cause of suction loss. If the drop or spike in the voltage and/or amperage occurs in conjunction with the canny or streak detection algorithm (visual scanning) indicating potential water detected (e.g., at step 512), the floor scrubber will haltoperation 518 to prevent potential damage or to prevent leaving excess water on the floor. In some embodiments, the rear squeegee can be a consumable item that can be serviced, removed, and/or replaced. Thus, if excess water is detected (e.g., at step 512) and there is no change in the voltage and/or amperage (e.g., no drop or spike) to the vacuum motor (e.g., at step 520), then the electronic system and/or the compute device included therein can send an alert or notification to the operator (i.e., alerting the operator) indicative of in instruction to motor and/or maintenance therear squeegee 522. The alert and/or notification can be any suitable alert and/or notification. For example, the alert and/or notification can be a visual indication (e.g., a flashing light, etc.) and/or an audible indication (e.g., an alarm, or any suitable audible output). In other embodiments, the alert or notification can be a signal sent to a remote electronic device such as, for example, a controller, a remote, a smart phone, a desktop, a laptop, a control server and/or any other suitable device. The signal can be indicative of an instruction for the remote device to provide an alert or notification to be observed by the operator. - The monitoring systems described herein can be used to detect different types of failures, either individually, or preferably in concert for more precise diagnostic capabilities. For example, a compromised vacuum function can be created if a squeegee develops a hole, tear or aperture, is misplaced, is an incorrect part, is installed with excessive skew or otherwise misaligned, is dragging debris, falls off entirely, or is worn to the extent that it does not make a good seal with the cleaning surface. The clog detection system would measure out of range pressure along the vacuum pathway relative to ambient pressure. The operating electrical or mechanical parameters such as speed of the vacuum motor or current draw may also depart from normal operating parameters under the above conditions, due to decreased air turbulence at the vacuum fan blades due to additional air flow.
- While various embodiments have been described above, it should be understood that they have been presented by way of example only, and not limitation. Where schematics and/or embodiments described above indicate certain components arranged in certain orientations or positions, the arrangement of components may be modified. While the embodiments have been particularly shown and described, it will be understood that various changes in form and details may be made.
- Although various embodiments have been described as having particular features, concepts, and/or combinations of components, other embodiments are possible having any combination or sub-combination of any features, concepts, and/or components from any of the embodiments described herein. The specific configurations of the various components can also be varied. For example, the specific size, specific shape, and/or specific configuration of the various components and/or various inputs or outputs can be different from the embodiments shown, while still providing the functions as described herein. The size, shape, and/or configuration of the various components can be specifically selected for a desired or intended usage.
- Where methods and/or events described above indicate certain events and/or procedures occurring in certain order, the ordering of certain events and/or procedures may be modified and that such modifications are in accordance with accepted and/or desired variations of the specific embodiments. Additionally, certain events and/or procedures may be performed concurrently in a parallel process when possible, as well as performed sequentially as described above. Certain steps may be partially completed or may be omitted before proceeding to subsequent steps.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/249,671 US20190216283A1 (en) | 2018-01-16 | 2019-01-16 | Detecting degradation of back squeegee water pick-up performance for autonomous floor scrubbers |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201862617716P | 2018-01-16 | 2018-01-16 | |
US16/249,671 US20190216283A1 (en) | 2018-01-16 | 2019-01-16 | Detecting degradation of back squeegee water pick-up performance for autonomous floor scrubbers |
Publications (1)
Publication Number | Publication Date |
---|---|
US20190216283A1 true US20190216283A1 (en) | 2019-07-18 |
Family
ID=67212523
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/249,671 Abandoned US20190216283A1 (en) | 2018-01-16 | 2019-01-16 | Detecting degradation of back squeegee water pick-up performance for autonomous floor scrubbers |
Country Status (1)
Country | Link |
---|---|
US (1) | US20190216283A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190208979A1 (en) * | 2018-01-05 | 2019-07-11 | Irobot Corporation | System for spot cleaning by a mobile robot |
CN112401774A (en) * | 2020-10-30 | 2021-02-26 | 添可智能科技有限公司 | Floor brush device, adjusting method thereof and cleaning equipment |
USD973985S1 (en) * | 2020-06-08 | 2022-12-27 | Avidbots Corp | Floor cleaning apparatus |
WO2023126046A1 (en) | 2021-12-27 | 2023-07-06 | Alfred Kärcher SE & Co. KG | Cleaning system and method for operating a cleaning system |
USD997475S1 (en) * | 2020-08-20 | 2023-08-29 | Aziobot Bv | Cleaning robot |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5650702A (en) * | 1994-07-07 | 1997-07-22 | S. C. Johnson & Son, Inc. | Controlling system for self-propelled floor cleaning vehicles |
US7454846B2 (en) * | 2006-04-11 | 2008-11-25 | Brobeck William I | Automatic tennis court drying machine |
US20140166047A1 (en) * | 2012-12-05 | 2014-06-19 | Vorwerk & Co. Interholding Gmbh | Traveling cleaning appliance and method for operating such an appliance |
US20160135655A1 (en) * | 2014-11-17 | 2016-05-19 | Samsung Electronics Co., Ltd. | Robot cleaner, terminal apparatus, and method of controlling the same |
US20160206170A1 (en) * | 2015-01-20 | 2016-07-21 | Lg Electronics Inc. | Robot cleaner |
US20170049287A1 (en) * | 2015-08-18 | 2017-02-23 | Nilfisk, Inc. | Water trailing detection system |
US9763551B2 (en) * | 2013-04-19 | 2017-09-19 | Dyson Technology Limited | Air moving appliance with on-board diagnostics |
US20190387945A1 (en) * | 2017-01-25 | 2019-12-26 | Lg Electronics Inc. | Mobile robot |
-
2019
- 2019-01-16 US US16/249,671 patent/US20190216283A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5650702A (en) * | 1994-07-07 | 1997-07-22 | S. C. Johnson & Son, Inc. | Controlling system for self-propelled floor cleaning vehicles |
US7454846B2 (en) * | 2006-04-11 | 2008-11-25 | Brobeck William I | Automatic tennis court drying machine |
US20140166047A1 (en) * | 2012-12-05 | 2014-06-19 | Vorwerk & Co. Interholding Gmbh | Traveling cleaning appliance and method for operating such an appliance |
US9763551B2 (en) * | 2013-04-19 | 2017-09-19 | Dyson Technology Limited | Air moving appliance with on-board diagnostics |
US20160135655A1 (en) * | 2014-11-17 | 2016-05-19 | Samsung Electronics Co., Ltd. | Robot cleaner, terminal apparatus, and method of controlling the same |
US20160206170A1 (en) * | 2015-01-20 | 2016-07-21 | Lg Electronics Inc. | Robot cleaner |
US20170049287A1 (en) * | 2015-08-18 | 2017-02-23 | Nilfisk, Inc. | Water trailing detection system |
US20190387945A1 (en) * | 2017-01-25 | 2019-12-26 | Lg Electronics Inc. | Mobile robot |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190208979A1 (en) * | 2018-01-05 | 2019-07-11 | Irobot Corporation | System for spot cleaning by a mobile robot |
US10575699B2 (en) * | 2018-01-05 | 2020-03-03 | Irobot Corporation | System for spot cleaning by a mobile robot |
US11160432B2 (en) | 2018-01-05 | 2021-11-02 | Irobot Corporation | System for spot cleaning by a mobile robot |
US11961285B2 (en) | 2018-01-05 | 2024-04-16 | Irobot Corporation | System for spot cleaning by a mobile robot |
USD973985S1 (en) * | 2020-06-08 | 2022-12-27 | Avidbots Corp | Floor cleaning apparatus |
USD997475S1 (en) * | 2020-08-20 | 2023-08-29 | Aziobot Bv | Cleaning robot |
CN112401774A (en) * | 2020-10-30 | 2021-02-26 | 添可智能科技有限公司 | Floor brush device, adjusting method thereof and cleaning equipment |
WO2023126046A1 (en) | 2021-12-27 | 2023-07-06 | Alfred Kärcher SE & Co. KG | Cleaning system and method for operating a cleaning system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190216283A1 (en) | Detecting degradation of back squeegee water pick-up performance for autonomous floor scrubbers | |
US20240075501A1 (en) | System and method for estimating damage to a shaker table screen using computer vision | |
US8200024B2 (en) | Image monitoring system | |
US11083357B2 (en) | Water trailing detection system | |
CN106415598B (en) | Lens contamination detection, identification and mitigation for vehicle-mounted camera systems | |
US20220265110A1 (en) | System and method of semi-autonomous cleaning of surfaces | |
US11191413B2 (en) | System and method of monitoring consumable wear components of semi-autonomous floor care equipment | |
CN102841026A (en) | System and method for determining stress on wind turbine blade during loading | |
CN112082781A (en) | Vehicle and fault detection method and fault detection device thereof | |
CN111064870A (en) | Lens cleaning method, control device and storage medium of visual robot | |
EP2665039A2 (en) | Detection of near-field camera obstruction | |
CN111230723A (en) | Real-time detection system, real-time detection method and chemical mechanical polishing equipment | |
EP3107063A1 (en) | Method for processing camera images | |
US20170051474A1 (en) | Path detection for ground engaging teeth | |
JP4039425B2 (en) | Image processing apparatus and method | |
CN117094992A (en) | Electrical equipment fault detection method and system based on image processing | |
CA3030301A1 (en) | Detecting degradation of back squeegee water pick-up performance for autonomous floor scrubbers | |
EP3626550A1 (en) | Sensor cleaning system for environment sensors of a vehicle | |
JP5710230B2 (en) | Monitoring system and monitoring method | |
US20170357087A1 (en) | Optical protection element replacement system of the security camera device and method thereof | |
US20170054947A1 (en) | System and method for monitoring condition of worksite | |
US20220235788A1 (en) | Centrifugal Pump and Method for Status Detection of a Centrifugal Pump | |
Usamentiaga et al. | Jam detector for steel pickling lines using machine vision | |
JP7261958B2 (en) | Autonomous vacuum cleaner | |
EP4086858A1 (en) | Agricultural systems and methods using image quality metrics for vision-based detection of surface conditions |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |