CN111506074B - Machine control method of crop tedding dust collection device - Google Patents
Machine control method of crop tedding dust collection device Download PDFInfo
- Publication number
- CN111506074B CN111506074B CN202010379496.3A CN202010379496A CN111506074B CN 111506074 B CN111506074 B CN 111506074B CN 202010379496 A CN202010379496 A CN 202010379496A CN 111506074 B CN111506074 B CN 111506074B
- Authority
- CN
- China
- Prior art keywords
- tedding
- crop
- obstacle
- dust
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000000428 dust Substances 0.000 title claims abstract description 134
- 238000000034 method Methods 0.000 title claims description 21
- 230000004888 barrier function Effects 0.000 claims abstract description 38
- 238000010521 absorption reaction Methods 0.000 claims description 15
- 230000011218 segmentation Effects 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 7
- 230000007246 mechanism Effects 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 4
- 210000003462 vein Anatomy 0.000 claims description 4
- 238000005096 rolling process Methods 0.000 claims description 3
- 239000000126 substance Substances 0.000 claims description 3
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 description 7
- 238000004140 cleaning Methods 0.000 description 2
- 239000012535 impurity Substances 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0242—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using non-visible light signals, e.g. IR or UV signals
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01F—PROCESSING OF HARVESTED PRODUCE; HAY OR STRAW PRESSES; DEVICES FOR STORING AGRICULTURAL OR HORTICULTURAL PRODUCE
- A01F25/00—Storing agricultural or horticultural produce; Hanging-up harvested fruit
-
- A—HUMAN NECESSITIES
- A23—FOODS OR FOODSTUFFS; TREATMENT THEREOF, NOT COVERED BY OTHER CLASSES
- A23B—PRESERVING, e.g. BY CANNING, MEAT, FISH, EGGS, FRUIT, VEGETABLES, EDIBLE SEEDS; CHEMICAL RIPENING OF FRUIT OR VEGETABLES; THE PRESERVED, RIPENED, OR CANNED PRODUCTS
- A23B9/00—Preservation of edible seeds, e.g. cereals
- A23B9/08—Drying; Subsequent reconstitution
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
- G05D1/0253—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting relative motion information from a plurality of images taken successively, e.g. visual odometry, optical flow
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0255—Control of position or course in two dimensions specially adapted to land vehicles using acoustic signals, e.g. ultra-sonic singals
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0276—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Automation & Control Theory (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Electromagnetism (AREA)
- Wood Science & Technology (AREA)
- Zoology (AREA)
- Chemical & Material Sciences (AREA)
- Food Science & Technology (AREA)
- Polymers & Plastics (AREA)
- Acoustics & Sound (AREA)
- Environmental Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
The invention discloses a crop tedding dust collection device, which comprises: the crop tedding dust collector main body; the ultrasonic distance sensor is detachably arranged on the crop tedding and dust collecting device main body and can detect the distance of obstacles around the crop tedding and dust collecting device main body; the infrared camera is detachably arranged on the crop tedding and dust collecting device main body, is coaxially arranged with the ultrasonic distance sensor, and can shoot images of obstacles around the crop tedding and dust collecting device main body; the controller is connected with the ultrasonic distance sensor and the infrared camera, can analyze the barrier distance and the barrier image, plans a walking path of the crop tedding dust collection device main body, and controls the crop tedding dust collection device main body to move along the walking path.
Description
Technical Field
The invention relates to the field of control of a tedding dust collection device, in particular to a crop tedding dust collection device and a control method of the crop tedding dust collection device.
Background
The crop tedding dust collector mainly replaces manpower to be used for storing and airing crops, generally, manual airing needs to turn over crops by using a rake or an agricultural tool, and when the crops contain more impurities, the crops are raised by using the tool, and the impurities are separated from the crops by using wind, so that the labor and the time are wasted.
In the prior art, the crop tedding dust collector needs to walk along a certain path in the working process, or the crop tedding dust collector is arranged to walk along the edge of a detection wall or other objects. The independent use of the distance sensor is mostly adopted to realize traveling along the wall, and the machine is adjusted according to the distance information returned by the distance sensor, so that the traveling along the wall can be realized, the change of the wall in front of the tedding dust suction device can not be predicted, the phenomenon that the crop tedding dust suction device can not realize pre-turning in advance when the crop tedding dust suction device reaches the inflection point of the wall exists, and the cleaning effect of the crop tedding dust suction device along the uneven wall is poor.
Disclosure of Invention
The invention designs and develops a crop tedding dust absorption device, wherein an ultrasonic distance sensor and an infrared camera are arranged at the top of the crop tedding dust absorption device, so that obstacles around the crop tedding dust absorption device can be detected, the information of the obstacles can be predicted in advance, and the tedding effect is good.
The invention also designs and develops a control method of the crop tedding dust collection device, which can analyze the distance between the obstacles and the images of the obstacles, plan the tedding path of the crop tedding dust collection device main body, and control the crop tedding dust collection device main body to move along the tedding path, so that the airing effect is good.
The technical scheme provided by the invention is as follows:
a crop tedding dust extraction includes:
the crop tedding dust collector main body;
the ultrasonic distance sensor is detachably arranged on the crop tedding and dust collecting device main body and can detect the distance of obstacles around the crop tedding and dust collecting device main body;
the infrared camera is detachably arranged on the crop tedding and dust collecting device main body, is coaxially arranged with the ultrasonic distance sensor, and can shoot images of obstacles around the crop tedding and dust collecting device main body;
and the controller is connected with the ultrasonic distance sensor and the infrared camera, can analyze the distance of the barrier and the image of the barrier, plans the walking path of the crop tedding dust collector main body, and controls the crop tedding dust collector main body to move along the walking path.
Preferably, the crop tedding dust collection main body comprises:
a dust collection base;
the supporting frame is rotatably supported on the dust absorption base;
and the tedding rake is detachably connected with one end of the support frame and can rotate along with the support frame.
Preferably, the support frame comprises:
the rotating frame is arranged at the top of the dust collection base main body and can rotate around the dust collection base main body for 360 degrees;
the clamping frame is a telescopic frame, can clamp the ultrasonic distance sensor and the infrared camera, and is hinged with the rotating frame;
the pneumatic support column is arranged between the support frame and the rotating frame, and the included angle between the rotating frame and the clamping frame can be changed by changing the length of the pneumatic support column.
Preferably, the dust suction base comprises:
a dust suction mechanism having a dust suction function;
and the rolling wheels are rotatably supported at the bottom of the dust collection mechanism and can drive the crop tedding dust collection main body to move.
A control method of a crop tedding dust suction device comprises the following steps:
step one, shooting barrier images around the crop tedding dust collector main body by using the infrared camera, and preprocessing the barrier images;
the infrared camera rotates and respectively shoots infrared images of the infrared camera which rotates to 90 degrees, 180 degrees, 270 degrees and 360 degrees from an initial position;
step two, performing pixel-by-pixel sliding on the pixel points in the preprocessed obstacle image, and calculating the local contrast of each pixel point to obtain a local contrast map of the whole image;
step three, performing threshold segmentation on the local contrast map, identifying an obstacle in an infrared image, and determining a corner of the obstacle;
detecting the distance between the identified obstacle in the infrared image and the crop tedding dust collection device by using an ultrasonic sensor, and estimating the height of the obstacle according to the distance between the bottom boundary of the obstacle in the infrared image and the bottom boundary of the infrared image and the area of the obstacle in the infrared image;
step five, integrating the height and the corner of the barrier and the distance between the crop tedding dust collection device to obtain the tedding boundary of the crop tedding dust collection device;
and step six, planning a tedding path of the crop tedding dust collection device according to the tedding boundary, and controlling the crop tedding dust collection device to move along the tedding path.
Preferably, the obstacle image preprocessing process in the first step includes:
step a, performing binarization processing on the acquired barrier image to obtain a binarized barrier image:
in the formula, I (x, y) is a gray value of a position, thresh is a preset threshold, and f (x, y) is a gray value of a position of the binarized vein image (x, y);
step b, carrying out pixel point segmentation on the binary image to obtain xi (m × n pixel points); wherein m is the number of horizontal pixels, and n is the number of vertical pixels;
and c, respectively carrying out negation and histogram equalization operations on the image after the pixel point segmentation, thereby obtaining the preprocessed obstacle image with the size of m multiplied by n pixels.
Preferably, the calculation formula of the local contrast of the obstacle image pixel point is as follows:
wherein D is h (x, y) is the local contrast of the infrared image of the pixel at the (x, y) position, f s (x, y) is the mean value of the binary gray scale of the pixel point at the (x, y) position, f (x) c ,y c ) The binarized gray value of the pixel point at the central position of the infrared image area is obtained;
by thresholding the global contrast map:
when in use
Determining pixel points as barrier pixel points, traversing the global contrast map, and dividing boundaries of a plurality of barriers;
wherein, the threshold value calculation formula is as follows:
wherein T is a division threshold value,
weighted average of local contrast maps, D max To weight the maximum of the local contrast map, δ is a constant.
Preferably, the obstacle turning angle calculation process is:
calculating coordinates of center point of the obstacle, the coordinates (x) of the center point z ,y z ) Is calculated by
Comprises the following steps:
the horizontal rotation angle of the obstacle is calculated as:
wherein alpha is the horizontal rotation angle of the obstacle, omega is the rotation angle of the infrared image obtained by the infrared camera, and P (x) z ,y z ) The horizontal distance between the center position of the obstacle and the center point of the infrared image is defined, gamma is the boundary angle of the infrared image in the horizontal direction obtained by the shooting of the infrared camera, and X is the width of the infrared image obtained by the shooting of the infrared camera;
calculating the pitch angle of the obstacle as follows:
wherein, Q (x) z ,y z ) The longitudinal distance between the center position of the barrier and the center point of the infrared image is shown.
Preferably, the obstacle height calculation formula is:
height H of the barrier i Comparing with the height of the tedding dust-collecting device if the aboveHeight H of obstacle i And if the height of the obstacle is less than the height of the tedding dust suction device, determining that the corresponding obstacle is a real obstacle.
Preferably, the crop tedding dust extraction's tedding boundary is:
respectively determining real obstacles in infrared images in four directions of 90 degrees, 180 degrees, 270 degrees and 360 degrees, and obtaining the distance N between the real obstacles and the crop tedding dust collection device λ 、N ν 、N o And N π ；
And calculating the minimum barrier distance min { N } of the infrared image in the 90-degree direction λ }; calculating the minimum barrier distance min { N } of the infrared image in the 180-degree direction ν }; minimum obstacle distance min { N } of infrared image in 270 degree direction o The minimum barrier distance min { N } of the infrared image in the 360-degree direction π }；
Will the min { N } λ }、min{N ν }、min{N o }、min{N π And the ring formed by enclosing is used as a tedding boundary, so that the tedding dust suction device does ring motion from inside to outside in the boundary.
The invention has the advantages of
The invention designs and develops a crop tedding dust absorption device, wherein an ultrasonic distance sensor and an infrared camera are arranged at the top of the crop tedding dust absorption device, so that obstacles around the crop tedding dust absorption device can be detected, the information of the obstacles can be predicted in advance, and the tedding effect is good.
The invention also designs and develops a control method of the crop tedding dust collection device, which can analyze the distance between the obstacles and the images of the obstacles, plan the tedding path of the crop tedding dust collection device main body, and control the crop tedding dust collection device main body to move along the tedding path, so that the airing effect is good.
Drawings
Fig. 1 is a schematic structural view of the crop tedding and dust collecting device.
Fig. 2 is a schematic structural view of the support frame of the present invention.
Detailed Description
The present invention is further described in detail below with reference to the attached drawings so that those skilled in the art can implement the invention by referring to the description text.
As shown in fig. 1, the crop tedding and dust collecting device provided by the invention comprises: crop tedding and dust collecting device main body 110, ultrasonic distance sensor 120, infrared camera 130 and controller 140.
The ultrasonic distance sensor 120 is detachably arranged on the crop tedding dust collector main body 110 and can detect the distance of obstacles around the crop tedding dust collector main body; the infrared camera 130 is detachably arranged on the crop tedding dust collector main body, is coaxially arranged with the ultrasonic distance sensor 120, and can shoot images of obstacles around the crop tedding dust collector main body 110; the controller 140 is connected to the ultrasonic distance sensor 120 and the infrared camera 130, and can analyze the distance to the obstacle and the image of the obstacle, plan a tedding path of the main body of the crop tedding dust collector, and control the main body 110 of the crop tedding dust collector to move along the tedding path.
As shown in fig. 2, the crop tedding dust collector main body 110 is provided with a support frame 150, and the support frame 150 is rotatably supported above the crop tedding dust collector main body 110.
As a preference, the supporting bracket 150 includes: a rotating frame 151, a clamping frame 152 and a pneumatic support 153.
The rotating frame 151 is arranged at the top of the crop tedding dust collector main body and can rotate 360 degrees around the crop tedding dust collector main body 110; the holder 152 is a telescopic holder capable of holding the ultrasonic distance sensor 120 and the infrared camera 130, and is hinged to the turret 151. Preferably, a pneumatic support 153 is provided between the holding frame 152 and the rotating frame 151, and an included angle between the rotating frame and the holding frame 152 can be changed by changing the length of the pneumatic support 153.
Preferably, the clamping frame 152 is an electric telescopic frame, comprising: the clamping device comprises a first support 151a, a second support 152b, a lead screw 152c and a driving motor 152d, wherein the second support 152b can slide along the first support 151, the second support 152b is sleeved on the lead screw 152c, the lead screw 152c can be rotatably supported on the first support 151a, the lead screw 152c is driven to rotate by the driving motor 152d, and then the second support 152b is driven to slide along the first support 151a, so that the length adjustment of the clamping frame 152 is realized.
The tedding harrow 160 can be detachably connected with one end of the clamping frame 152, can rotate or extend along with the supporting frame 150, and the tedding harrow 160 can be turned to the top of the main body of the crop tedding dust collector along with the supporting frame when not in use, so that the service life is prolonged. Preferably, the suction base comprises: a dust suction mechanism having a function of sucking a light object by negative pressure; and the rolling wheels are rotatably supported at the bottom of the dust collection mechanism and can drive the crop tedding dust collection main body to move.
A control method of a crop tedding dust suction device comprises the following steps:
step one, utilizing an infrared camera to shoot images of obstacles around a main body of the crop tedding dust collection device, and preprocessing the images of the obstacles, wherein the preprocessing process of the images of the obstacles comprises the following steps:
step a, performing binarization processing on the acquired barrier image to obtain a binarized barrier image:
in the formula, I (x, y) is a gray value of a position, thresh is a preset threshold, and f (x, y) is a gray value of a position of the binarized vein image (x, y);
step b, carrying out pixel point segmentation on the binary image to obtain xi (m × n pixel points); wherein m is the number of horizontal pixels, and n is the number of vertical pixels;
c, respectively carrying out negation and histogram equalization operations on the image after the pixel point segmentation, thereby obtaining the preprocessed obstacle image with the size of m multiplied by n pixels
The infrared camera 130 is rotated and takes infrared images in four directions of 90 °, 180 °, 270 ° and 360 ° from the initial position.
Step two, performing pixel-by-pixel sliding on pixel points in the preprocessed obstacle image, and calculating the local contrast of each pixel point to obtain a local contrast map of the whole map;
the calculation formula of the local contrast of the obstacle image pixel point is as follows:
wherein D is h (x, y) is the local contrast of the IR image of the pixel at the (x, y) position, f s (x, y) is the mean value of the binarized gray levels of the pixel points at the (x, y) positions, and f (x) c ,y c ) The binarized gray value of the pixel point at the central position of the infrared image area is obtained;
by thresholding the global contrast map:
when in use
Determining the pixel points as barrier pixel points, traversing the global contrast map, and dividing the boundaries of a plurality of barriers;
wherein, the threshold value calculation formula is as follows:
wherein T is a division threshold value,
weighted average of local contrast maps, D max To weight the maximum of the local contrast map, δ is a constant.
Step three, performing threshold segmentation on the local contrast map, identifying an obstacle in the infrared image, and determining an obstacle corner; the obstacle turning angle calculation process comprises the following steps:
first, coordinates of a center point of the obstacle, coordinates of the center point (x), are calculated z ,y z ) Is calculated byPublic
The formula is as follows:
the horizontal rotation angle of the obstacle is calculated as:
wherein alpha is the horizontal rotation angle of the obstacle, omega is the rotation angle of the sensor support during the infrared image obtained by the infrared camera, P (x) z ,y z ) The horizontal distance between the center position of the obstacle and the center point of the infrared image is shown, gamma is the boundary angle of the infrared image obtained by the infrared camera in the horizontal direction, and X is the width of the infrared image obtained by the infrared camera.
Calculating the pitch angle of the obstacle as follows:
wherein, Q (x) z ,y z ) The longitudinal distance between the center position of the barrier and the center point of the infrared image is shown.
Detecting the distance between the identified obstacle in the infrared image and the crop tedding dust collection device by using an ultrasonic sensor, and estimating the height of the obstacle according to the distance between the bottom boundary of the obstacle in the infrared image and the bottom boundary of the infrared image and the area of the obstacle in the infrared image;
the obstacle height calculation formula is:
height H of barrier i Comparing with the height of the tedding dust-collecting device, if the height of the obstacle is H i And if the height of the obstacle is less than the height of the tedding dust suction device, determining that the corresponding obstacle is a real obstacle.
Step five, synthesizing the height and the corner of the barrier and the distance between the crop tedding dust collection device to obtain the tedding boundary of the crop tedding dust collection device;
the tedding boundary of the clean tedding dust collection device is as follows: respectively determining 90 deg., 180 deg. and 270 deg
And real obstacles in the infrared images in four directions of 360 degrees are obtained, and the distance N between the real obstacles and the crop tedding dust collection device is obtained λ 、N ν 、N o And N π ；
And step six, planning a tedding path of the crop tedding dust collection device according to the tedding boundary, and controlling the crop tedding dust collection device to move along the tedding path. And calculating the minimum barrier distance min { N } of the infrared image in the 90-degree direction λ }; calculating the minimum barrier distance min { N } of the infrared image in the 180 DEG direction ν }; minimum obstacle distance min { N } of infrared image in 270 degree direction o Min, minimum obstacle distance min { N } of infrared image in 360 degree direction π }；
Will min { N } λ }、min{N ν }、min{N o }、min{N π The ring-shaped periphery is the most of the tedding boundary, so that the tedding dust suction device does circular motion from inside to outside in the boundary, and then the farm workAnd (4) stopping the object tedding dust suction device at the tedding boundary, repeating the actions, and determining the tedding boundary again for cleaning.
The invention designs and develops a crop tedding dust absorption device, wherein an ultrasonic distance sensor and an infrared camera are arranged at the top of the crop tedding dust absorption device, so that obstacles around the crop tedding dust absorption device can be detected, the information of the obstacles can be predicted in advance, and the tedding effect is good.
The invention also designs and develops a control method of the crop tedding dust collection device, which can analyze the distance between the obstacles and the images of the obstacles, plan the tedding path of the crop tedding dust collection device main body, and control the crop tedding dust collection device main body to move along the tedding path, so that the airing effect is good.
While embodiments of the invention have been described above, it is not limited to the applications set forth in the description and the embodiments, which are fully applicable in various fields of endeavor to which the invention pertains, and further modifications may readily be made by those skilled in the art, it being understood that the invention is not limited to the details shown and described herein without departing from the general concept defined by the appended claims and their equivalents.
Claims (5)
1. A control method of a crop tedding dust absorption device, which uses the crop tedding dust absorption device and is characterized in that,
the crop tedding dust suction device comprises:
the crop tedding dust collector main body;
the ultrasonic distance sensor is detachably arranged on the crop tedding dust collector main body and can detect the distance between obstacles around the crop tedding dust collector main body;
the infrared camera is detachably arranged on the crop tedding dust collector main body, is coaxial with the ultrasonic distance sensor, and can shoot images of obstacles around the crop tedding dust collector main body;
the controller is connected with the ultrasonic distance sensor and the infrared camera, can analyze the barrier distance and the barrier image, plans a walking path of the crop tedding dust collection device main body, and controls the crop tedding dust collection device main body to move along the walking path;
the crop tedding dust absorption main body comprises:
a dust collection base;
the supporting frame is rotatably supported on the dust absorption base;
the tedding rake is detachably connected with one end of the supporting frame and can rotate along with the supporting frame;
the support frame includes:
the rotating frame is arranged at the top of the dust collection base main body and can rotate around the dust collection base main body for 360 degrees;
the clamping frame is a telescopic frame, can clamp the ultrasonic distance sensor and the infrared camera, and is hinged with the rotating frame;
the pneumatic support is arranged between the support frame and the rotating frame, and the included angle between the rotating frame and the clamping frame can be changed by changing the length of the pneumatic support;
the dust absorption base includes:
a dust suction mechanism having a dust suction function;
the rolling wheels are rotatably supported at the bottom of the dust collection mechanism and can drive the crop tedding dust collection main body to move;
the method comprises the following steps:
step one, shooting images of obstacles around a main body of the crop tedding dust collection device by using the infrared camera, and preprocessing the images of the obstacles;
the infrared camera rotates and respectively shoots infrared images of the infrared camera which rotates to 90 degrees, 180 degrees, 270 degrees and 360 degrees from an initial position;
step two, performing pixel-by-pixel sliding on the pixel points in the preprocessed obstacle image, and calculating the local contrast of each pixel point to obtain a local contrast map of the whole image;
thirdly, performing threshold segmentation on the local contrast map, identifying an obstacle in an infrared image, and determining a corner of the obstacle;
detecting the distance between the identified obstacle in the infrared image and the crop tedding dust collection device by using an ultrasonic sensor, and estimating the height of the obstacle according to the distance between the bottom boundary of the obstacle in the infrared image and the bottom boundary of the infrared image and the area of the obstacle in the infrared image;
step five, synthesizing the height and the corner of the barrier and the distance between the crop tedding dust collection device and the crop tedding dust collection device to obtain a tedding boundary of the crop tedding dust collection device;
planning a tedding path of the crop tedding dust collection device according to the tedding boundary, and controlling the crop tedding dust collection device to move along the tedding path;
the obstacle height calculation formula is as follows:
height H of the barrier i Comparing with the height of the tedding dust suction device, if the height H of the barrier is higher than the height of the tedding dust suction device i And if the height of the obstacle is less than the height of the tedding dust suction device, determining that the corresponding obstacle is a real obstacle.
2. The method for controlling the crop tedding and dust collecting device according to claim 1, wherein the obstacle image preprocessing process in the first step comprises:
step a, carrying out binarization processing on the acquired obstacle image to obtain a binarized obstacle image:
in the formula, I (x, y) is a gray value of a position, thresh is a preset threshold, and f (x, y) is a gray value of a position of the binarized vein image (x, y);
b, carrying out pixel point segmentation on the binarized vein image to obtain xi (m × n pixel points); wherein m is the number of horizontal pixels, and n is the number of vertical pixels;
and c, respectively carrying out negation and histogram equalization operations on the image after the pixel point segmentation, thereby obtaining the preprocessed obstacle image with the size of m multiplied by n pixels.
3. The control method of the crop tedding dust extraction device as claimed in claim 2, wherein the calculation formula of the local contrast of the obstacle image pixel point is as follows:
wherein D is h (x, y) is the local contrast of the infrared image of the pixel at the (x, y) position, f s (x, y) is the mean value of the binarized gray levels of the pixel points at the (x, y) positions, and f (x) c ,y c ) The binarized gray value of the pixel point at the central position of the infrared image area is obtained;
by thresholding the global contrast map:
when in use
Determining pixel points as barrier pixel points, traversing the global contrast map, and dividing boundaries of a plurality of barriers;
wherein, the threshold value calculation formula is as follows:
wherein T is a division threshold value,
weighted average of local contrast maps, D max To weight the maximum of the local contrast map, δ is a constant.
4. The control method of the crop tedding dust extraction device as claimed in claim 3, wherein the obstacle turning angle calculation process is:
calculating center position point coordinates of the obstacle, the center position point coordinates (x) z ,y z ) The calculation formula of (2) is as follows:
the horizontal rotation angle of the obstacle is calculated as:
wherein alpha is the horizontal rotation angle of the obstacle, omega is the rotation angle of the infrared image obtained by the infrared camera, and P (x) z ,y z ) Is the horizontal distance, gamma, between the center of the obstacle and the center of the infrared imageThe boundary angle in the horizontal direction of the infrared image obtained by shooting of the infrared camera is obtained, and X is the width of the infrared image obtained by shooting of the infrared camera;
calculating the pitch angle of the obstacle as follows:
wherein, Q (x) z ,y z ) The longitudinal distance between the center position of the barrier and the center point of the infrared image is shown.
5. The method of controlling a crop tedding vacuum cleaner as claimed in claim 4, wherein the boundaries of the crop tedding vacuum cleaner are:
respectively determining real obstacles in infrared images in four directions of 90 degrees, 180 degrees, 270 degrees and 360 degrees, and obtaining the distance N between the real obstacles and the crop tedding dust collection device λ 、N ν 、N o And N π ；
And calculating the minimum obstacle distance min { N } of the infrared image in the 90 DEG direction λ }; calculating the minimum barrier distance min { N } of the infrared image in the 180-degree direction ν }; minimum obstacle distance min { N } of infrared image in 270 degree direction o The minimum barrier distance min { N } of the infrared image in the 360-degree direction π }；
Will the min { N } λ }、min{N ν }、min{N o }、min{N π And (4) a ring formed by surrounding is used as a tedding boundary, so that the tedding dust suction device does ring motion from inside to outside in the boundary.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010379496.3A CN111506074B (en) | 2020-05-08 | 2020-05-08 | Machine control method of crop tedding dust collection device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010379496.3A CN111506074B (en) | 2020-05-08 | 2020-05-08 | Machine control method of crop tedding dust collection device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111506074A CN111506074A (en) | 2020-08-07 |
| CN111506074B true CN111506074B (en) | 2022-08-26 |
Family
ID=71868234
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010379496.3A Active CN111506074B (en) | 2020-05-08 | 2020-05-08 | Machine control method of crop tedding dust collection device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111506074B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113442132A (en) * | 2021-05-25 | 2021-09-28 | 杭州申弘智能科技有限公司 | Fire inspection robot based on optimized path and control method thereof |
| CN113829318B (en) * | 2021-10-09 | 2023-06-20 | 北京云迹科技股份有限公司 | Intelligent object-conveying robot and control method thereof |
Citations (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102338621A (en) * | 2011-04-27 | 2012-02-01 | 天津工业大学 | Method for detecting height of obstacle for indoor visual navigation |
| CN202190553U (en) * | 2011-08-19 | 2012-04-18 | 谢云 | Grain tedding device |
| CN102631279A (en) * | 2012-03-21 | 2012-08-15 | 东北大学 | Infrared sensor based electronic navigator and control method thereof |
| CN202857727U (en) * | 2012-10-19 | 2013-04-10 | 徐州工程学院 | Automatic solar energy grain tedder |
| CN104865965A (en) * | 2015-05-20 | 2015-08-26 | 深圳市锐曼智能装备有限公司 | Barrier-avoidance control method combining depth camera and supersonic wave for robot and system thereof |
| CN106570463A (en) * | 2016-10-31 | 2017-04-19 | 江苏华航威泰机器人科技有限公司 | Method for robot to identify an obstacle |
| CN107009357A (en) * | 2017-04-05 | 2017-08-04 | 武汉科技大学 | A kind of method that object is captured based on NAO robots |
| CN207201376U (en) * | 2017-09-26 | 2018-04-10 | 安徽翰鹏农业科技有限公司 | Paddy dries hemmer |
| CN108064562A (en) * | 2016-11-11 | 2018-05-25 | 常州翔升农机有限公司 | A kind of horizontal rotation type herbage teds rake (RK) |
| CN108182690A (en) * | 2017-12-29 | 2018-06-19 | 中国人民解放军63861部队 | A kind of infrared Weak target detecting method based on prospect weighting local contrast |
| CN108634870A (en) * | 2018-03-26 | 2018-10-12 | 深圳市赛亿科技开发有限公司 | A kind of Robot Cleaner Controlling System method and system based on Internet of Things |
| CN109382347A (en) * | 2018-09-26 | 2019-02-26 | 国网山东省电力公司海阳市供电公司 | A kind of electric power cable machine for cleaning snow cover device people and control system |
| CN109615695A (en) * | 2018-11-13 | 2019-04-12 | 远景能源（南京）软件技术有限公司 | The automation conversion method of space photo outside house to roof CAD diagram paper |
| CN109740445A (en) * | 2018-12-13 | 2019-05-10 | 天津津航技术物理研究所 | A kind of method for detecting infrared puniness target becoming size |
| CN208956469U (en) * | 2018-10-18 | 2019-06-11 | 河南师范大学 | A kind of picking fruit robot arm |
| CN110084167A (en) * | 2019-04-19 | 2019-08-02 | 中国航空无线电电子研究所 | A kind of scales data and image processing method and device |
| CN110163182A (en) * | 2019-05-30 | 2019-08-23 | 辽宁工业大学 | A kind of hand back vein identification method based on KAZE feature |
| CN110325089A (en) * | 2017-05-23 | 2019-10-11 | 东芝生活电器株式会社 | Electric dust collector |
| CN209563431U (en) * | 2018-11-02 | 2019-11-01 | 宁夏中宁县兴顺农林生态开发有限公司 | It is a kind of can dust suction solarization grain with turning over grain device |
| CN209615274U (en) * | 2019-02-12 | 2019-11-12 | 浙江工业职业技术学院 | Clamping device is used in a kind of lamps and lanterns processing of industrial design |
| CN110542306A (en) * | 2019-08-29 | 2019-12-06 | 合肥华创现代农业科技有限公司 | Intelligent tedder for small crops |
| CN110853024A (en) * | 2019-11-14 | 2020-02-28 | 北京推想科技有限公司 | Medical image processing method, medical image processing device, storage medium and electronic equipment |
| CN111325788A (en) * | 2020-02-07 | 2020-06-23 | 北京科技大学 | Building height determination method based on street view picture |
| CN111429756A (en) * | 2020-03-30 | 2020-07-17 | 淮阴工学院 | Highway tunnel rear-end collision prevention early warning method based on video technology |
-
2020
- 2020-05-08 CN CN202010379496.3A patent/CN111506074B/en active Active
Patent Citations (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102338621A (en) * | 2011-04-27 | 2012-02-01 | 天津工业大学 | Method for detecting height of obstacle for indoor visual navigation |
| CN202190553U (en) * | 2011-08-19 | 2012-04-18 | 谢云 | Grain tedding device |
| CN102631279A (en) * | 2012-03-21 | 2012-08-15 | 东北大学 | Infrared sensor based electronic navigator and control method thereof |
| CN202857727U (en) * | 2012-10-19 | 2013-04-10 | 徐州工程学院 | Automatic solar energy grain tedder |
| CN104865965A (en) * | 2015-05-20 | 2015-08-26 | 深圳市锐曼智能装备有限公司 | Barrier-avoidance control method combining depth camera and supersonic wave for robot and system thereof |
| CN106570463A (en) * | 2016-10-31 | 2017-04-19 | 江苏华航威泰机器人科技有限公司 | Method for robot to identify an obstacle |
| CN108064562A (en) * | 2016-11-11 | 2018-05-25 | 常州翔升农机有限公司 | A kind of horizontal rotation type herbage teds rake (RK) |
| CN107009357A (en) * | 2017-04-05 | 2017-08-04 | 武汉科技大学 | A kind of method that object is captured based on NAO robots |
| CN110325089A (en) * | 2017-05-23 | 2019-10-11 | 东芝生活电器株式会社 | Electric dust collector |
| CN207201376U (en) * | 2017-09-26 | 2018-04-10 | 安徽翰鹏农业科技有限公司 | Paddy dries hemmer |
| CN108182690A (en) * | 2017-12-29 | 2018-06-19 | 中国人民解放军63861部队 | A kind of infrared Weak target detecting method based on prospect weighting local contrast |
| CN108634870A (en) * | 2018-03-26 | 2018-10-12 | 深圳市赛亿科技开发有限公司 | A kind of Robot Cleaner Controlling System method and system based on Internet of Things |
| CN109382347A (en) * | 2018-09-26 | 2019-02-26 | 国网山东省电力公司海阳市供电公司 | A kind of electric power cable machine for cleaning snow cover device people and control system |
| CN208956469U (en) * | 2018-10-18 | 2019-06-11 | 河南师范大学 | A kind of picking fruit robot arm |
| CN209563431U (en) * | 2018-11-02 | 2019-11-01 | 宁夏中宁县兴顺农林生态开发有限公司 | It is a kind of can dust suction solarization grain with turning over grain device |
| CN109615695A (en) * | 2018-11-13 | 2019-04-12 | 远景能源（南京）软件技术有限公司 | The automation conversion method of space photo outside house to roof CAD diagram paper |
| CN109740445A (en) * | 2018-12-13 | 2019-05-10 | 天津津航技术物理研究所 | A kind of method for detecting infrared puniness target becoming size |
| CN209615274U (en) * | 2019-02-12 | 2019-11-12 | 浙江工业职业技术学院 | Clamping device is used in a kind of lamps and lanterns processing of industrial design |
| CN110084167A (en) * | 2019-04-19 | 2019-08-02 | 中国航空无线电电子研究所 | A kind of scales data and image processing method and device |
| CN110163182A (en) * | 2019-05-30 | 2019-08-23 | 辽宁工业大学 | A kind of hand back vein identification method based on KAZE feature |
| CN110542306A (en) * | 2019-08-29 | 2019-12-06 | 合肥华创现代农业科技有限公司 | Intelligent tedder for small crops |
| CN110853024A (en) * | 2019-11-14 | 2020-02-28 | 北京推想科技有限公司 | Medical image processing method, medical image processing device, storage medium and electronic equipment |
| CN111325788A (en) * | 2020-02-07 | 2020-06-23 | 北京科技大学 | Building height determination method based on street view picture |
| CN111429756A (en) * | 2020-03-30 | 2020-07-17 | 淮阴工学院 | Highway tunnel rear-end collision prevention early warning method based on video technology |
Non-Patent Citations (4)
| Title |
|---|
| A Practical Obstacle Detection System;Gustavo Freitas;《2012 IEEE/RSJ International Conference on Intelligent Robots and Systems》;20121224;全文 * |
| IPSO_based_binarization_processing_in_uneven_illumination_images_for_billet_defect_detection;Bi Zhang1;《2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA)》;20180728;全文 * |
| 基于机器视觉的蘑菇自动采摘***关键技术研究;杨永强;《中国优秀硕士学位论文全文库 信息科技辑》;20190301;全文 * |
| 基于激光雷达和机器视觉融合的智能车前方障碍物检测技术研究;冯鹏航;《中国优秀硕士学位论文全文库 工程科技Ⅱ辑》;20200315;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111506074A (en) | 2020-08-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210182579A1 (en) | Mobile robot, control method and control system thereof | |
| CN111506074B (en) | Machine control method of crop tedding dust collection device | |
| US11710255B2 (en) | Management and display of object-collection data | |
| CN109063575B (en) | Intelligent mower autonomous and orderly mowing method based on monocular vision | |
| CN107175645A (en) | Mobile robot | |
| CN103290798B (en) | Cleaning robot | |
| US20190294914A1 (en) | Bale detection and classification using stereo cameras | |
| CN108065866A (en) | A kind of automatic pointing sweeping machine and method | |
| WO2021142984A1 (en) | Mobile robot and control method therefor, device, storage medium, and program | |
| CN111571618A (en) | Autonomous picking robot based on visual algorithm and picking method thereof | |
| CN116686545B (en) | Litchi picking robot shade removing method based on machine vision control | |
| CN112034837A (en) | Method for determining working environment of mobile robot, control system and storage medium | |
| CN113812262A (en) | Tea-oil camellia fruit picking robot based on machine vision | |
| CN207077433U (en) | Mobile robot | |
| CN112720408B (en) | Visual navigation control method for all-terrain robot | |
| US20210038950A1 (en) | System and Apparatus to collect tennis balls in the court | |
| CN110431999B (en) | Gantry type automatic fruit harvesting robot | |
| KR101854337B1 (en) | Cleaner and controlling method | |
| CN112417944A (en) | Robot control method and electronic equipment | |
| US20210121028A1 (en) | Robot cleaner | |
| WO2021238000A1 (en) | Boundary-following working method and system of robot, robot, and readable storage medium | |
| CN115501560A (en) | Intelligent table tennis ball picking device and method | |
| JPH1042665A (en) | Image pick up device of robot for agricultural use | |
| CN212445254U (en) | Autonomous picking robot based on visual algorithm | |
| CN113442132A (en) | Fire inspection robot based on optimized path and control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |