WO2021093410A1 - Vehicle control method and device, and computer readable storage medium - Google Patents

Vehicle control method and device, and computer readable storage medium Download PDF

Info

Publication number
WO2021093410A1
WO2021093410A1 PCT/CN2020/111456 CN2020111456W WO2021093410A1 WO 2021093410 A1 WO2021093410 A1 WO 2021093410A1 CN 2020111456 W CN2020111456 W CN 2020111456W WO 2021093410 A1 WO2021093410 A1 WO 2021093410A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
destination point
storage location
coordinates
straight line
Prior art date
Application number
PCT/CN2020/111456
Other languages
French (fr)
Chinese (zh)
Inventor
赵健章
刘瑞超
Original Assignee
深圳创维数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维数字技术有限公司 filed Critical 深圳创维数字技术有限公司
Publication of WO2021093410A1 publication Critical patent/WO2021093410A1/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/10Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W2050/0001Details of the control system
    • B60W2050/0019Control system elements or transfer functions
    • B60W2050/0028Mathematical models, e.g. for simulation
    • B60W2050/0031Mathematical model of the vehicle
    • B60W2050/0034Multiple-track, 2D vehicle model, e.g. four-wheel model

Definitions

  • This application relates to the field of intelligent navigation technology, and in particular to a vehicle control method, device, and computer-readable storage medium.
  • SLAM Simultaneous Localization and Mapping, real-time positioning and map construction
  • SLAM includes two major functions: positioning and mapping.
  • the main function of mapping is to understand the surrounding environment and establish the corresponding relationship between the surrounding environment and space; the main function of positioning is to judge the position of the car body on the map based on the built map, so as to obtain the information in the environment.
  • lidar is an active detection sensor that does not depend on external light conditions and has high-precision ranging information. Therefore, the SLAM method based on lidar is still the most widely used method in the robot SLAM method, and in ROS (Robot Operating System, robot software platform) SLAM applications have also been very extensive.
  • the positioning of the navigation target point is carried out by means of lidar, and its accuracy depends on the linearity of the lidar.
  • lidar because it is difficult for lidar to maintain good linearity in a large spatial range, it is easy to cause the positioning deviation of the SLAM forklift after reaching the destination point, that is, the positioning accuracy of the destination point is poor, which causes the forklift to be unable to accurately stop at the destination point of the storage location. , Which in turn leads to a waste of time for the forklift to adjust its posture in the next step.
  • the main purpose of this application is to provide a vehicle control method, device, and computer-readable storage medium, aiming to solve the problem of poor target point positioning accuracy in the existing SLAM positioning, which causes the vehicle to be unable to park accurately.
  • the present application provides a vehicle control method, and the vehicle control method includes:
  • the ground image is acquired based on the camera device installed on the body of the vehicle, and the linear equation of the ground identification line is acquired according to the ground image, which is recorded as the first linear equation;
  • the driving data corresponding to the vehicle reaching the destination point of the storage location is calculated based on the relative position information, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
  • the present application also provides a vehicle control device, the vehicle control device comprising: a memory, a processor, and a control of the vehicle that is stored in the memory and can run on the processor A program, when the control program of the vehicle is executed by the processor, realizes the steps of the control method of the vehicle as described above.
  • the present application also provides a computer-readable storage medium having a vehicle control program stored on the computer-readable storage medium, and when the vehicle control program is executed by a processor, the above-mentioned The steps of the vehicle control method.
  • the present application provides a vehicle control method, device, and computer-readable storage medium.
  • a navigation destination point near the navigation point of the storage location when the vehicle is detected to reach the navigation destination point, based on the camera device installed on the vehicle body Obtain the ground image, and obtain the straight line equation of the ground marking line according to the ground image, and record it as the first straight line equation; then, according to the first straight line equation and the preset warehouse location offset distance, determine the current pose and library of the vehicle
  • the relative position information between the location destination points; and based on the relative location information, the driving data corresponding to the vehicle reaching the destination point of the storage location is calculated, and the vehicle is controlled to travel to the destination destination point of the storage location according to the driving data.
  • FIG. 1 is a schematic diagram of a structure of a vehicle control device in a hardware operating environment involved in a solution of an embodiment of the application;
  • FIG. 3 is a schematic diagram of an application scenario involved in the vehicle control method of this application.
  • FIG. 5 is a schematic flowchart of a second embodiment of a vehicle control method according to this application.
  • FIG. 6 is a schematic flowchart of a sixth embodiment of a vehicle control method according to this application.
  • FIG. 7 is a schematic diagram of a posture before and after the rotation of the AGV involved in the control method of the vehicle of this application.
  • FIG. 1 is a schematic structural diagram of a vehicle control device in a hardware operating environment involved in a solution of an embodiment of the application.
  • the vehicle control device may include: a processor 1001, such as a CPU (Central Processing Unit, central processing unit), communication bus 1002, user interface 1003, network interface 1004, and memory 1005.
  • the communication bus 1002 is used to implement connection and communication between these components.
  • the user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as Wireless-Fidelity, Wi-Fi interface).
  • the memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage.
  • the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
  • control device of the vehicle shown in FIG. 1 does not constitute a limitation on the control device of the vehicle, and may include more or less components than those shown in the figure, or combine certain components, or different components.
  • the layout of the components does not constitute a limitation on the control device of the vehicle, and may include more or less components than those shown in the figure, or combine certain components, or different components. The layout of the components.
  • the memory 1005 which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and a vehicle control program.
  • the network interface 1004 is mainly used to connect to a background server and perform data communication with the background server;
  • the user interface 1003 is mainly used to connect to a client and perform data communication with the client;
  • the processor 1001 It can be used to call the control program of the vehicle stored in the memory 1005.
  • the vehicle control device includes a memory 1005, a processor 1001, and a vehicle control program that is stored on the memory 1005 and can run on the processor 1001, wherein the processor 1001 calls the memory 1005
  • the vehicle control program is stored in the storage device, the vehicle control method provided in the embodiment of the present application is executed.
  • This application provides a vehicle control method.
  • Fig. 2 is a schematic flowchart of a first embodiment of a vehicle control method according to this application.
  • the vehicle control method includes:
  • Step S10 when it is detected that the vehicle reaches the navigation destination point, the ground image is acquired based on the camera device installed on the body of the vehicle, and the linear equation of the ground marking line is acquired according to the ground image, which is recorded as the first linear equation ;
  • the vehicle control method further includes:
  • Step A Obtain the coordinates of the destination point of the storage location in the preset real-time positioning and map construction SLAM map, and determine the coordinates of the navigation destination point corresponding to the destination point of the storage location according to the coordinates of the destination point of the storage location;
  • Step B Based on the coordinates of the navigation destination point and the preset SLAM map, control the vehicle to travel to the navigation destination point.
  • the vehicle control method can be applied in a storage scenario, and goods are transported by AGV (Automated Guided Vehicle).
  • AGV Automated Guided Vehicle
  • the AGV trolley may be a transport vehicle with safety protection and various transfer functions, such as a SLAM (Simultaneous Localization and Mapping, instant positioning and map construction) forklift.
  • SLAM Simultaneous Localization and Mapping, instant positioning and map construction
  • a forklift is used as an example for illustration.
  • this figure 3 is a schematic diagram of the application scenario of a ground-stack warehouse, where 1.1-1.3 represent the SLAM forklift terminal; 2.1, the pallet cargo; 2.2, the identification line of the ground-stack warehouse (wherein, the warehouse
  • the ground marking line in is essentially tape pasted on the ground, usually composed of diamond-shaped blocks in two colors spaced apart, such as black diamond-shaped blocks with yellow diamond-shaped blocks, black diamond-shaped blocks with white diamond-shaped blocks, etc., which can be convenient for manual labor. (Place the pallets according to the position of the machine operation); 2.3, the warehouse wall; 2.4, the warehouse aisle; 3, the destination point of the storage location; 4, the line of direct entry from the destination point of the storage location.
  • the error of the SLAM positioning of lidar can only be within the approximate range of +/-20cm.
  • forklifts usually The location of the destination point needs a positioning accuracy within 5cm, and in some places it even needs to be within 2cm. Only relying on the edge of the natural environment detected by the lidar for positioning cannot meet the needs of the scene. Therefore, in this embodiment, a fast and high-precision target point positioning function is realized by means of visual assisted positioning.
  • the coordinates of the destination point A are (a, b), and the coordinates of the navigation destination point can be set as (a+20, b+20); then, based on the coordinates of the navigation destination point and the preset SLAM map, control the vehicle to navigate Point of purpose.
  • the ground image is acquired based on the camera device installed on the vehicle body, and the linear equation of the ground marking line is acquired according to the ground image, which is recorded as The first linear equation.
  • the vehicle when the vehicle reaches the navigation destination, its current actual position is point B in Figure 4, and the destination point of the storage location is point A in Figure 4.
  • the ground can be obtained according to the camera device installed on the vehicle body Image, and then obtain the linear equation 1 (l1 in Figure 4) and the linear equation 2 (l2 in Figure 4) corresponding to the ground marking line.
  • the straight line equation of the ground marking line is constructed by taking the current pose of the vehicle as the origin of coordinates, the opposite direction of the fork arm of the vehicle as the positive direction of the y-axis, and the right direction of the y-axis as the positive direction of the x-axis. Calculated in a two-dimensional rectangular coordinate system.
  • Step S20 Determine the relative position information between the current pose of the vehicle and the destination point of the storage location according to the first straight line equation and the preset storage location opening offset distance;
  • the relative position information between the current pose of the vehicle and the destination point of the storage location is determined according to the first straight line equation and the preset offset distance of the storage location.
  • the relative position information includes the first coordinates of the destination point of the storage location
  • the preset offset distance of the storage location port includes the preset distance between the destination point of the storage location and the storage location (L 1 in Figure 4) and the preset distance between the destination point of the storage location and the storage location.
  • the relative position information acquisition process is: first take the current position of the vehicle as the origin of the coordinates, and use the fork arm of the vehicle as the origin of the coordinates.
  • the opposite direction is the positive direction of the y-axis
  • the right direction of the y-axis is the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system
  • calculate the intersection point between the ground markings in the two-dimensional rectangular coordinate The coordinates of the intersection in the system, and calculate the attitude angle of the vehicle; then according to the coordinates of the intersection, the attitude angle of the vehicle, and the preset offset distance of the warehouse location, the coordinates of the warehouse location destination point in the two-dimensional rectangular coordinate system are determined.
  • the first coordinate of the destination point of the location For the specific execution process, refer to the following second embodiment, which will not be repeated here.
  • step S30 the driving data corresponding to the vehicle reaching the destination point of the storage location is calculated based on the relative position information, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
  • the driving data includes the first rotation angle and the moving distance.
  • the relative position information is based on the current position of the vehicle as the origin of the coordinates and the opposite direction of the fork arm of the vehicle as the y axis, in the two-dimensional rectangular coordinate system constructed.
  • the coordinates corresponding to the destination point of the location that is, the first coordinate of the destination point of the location
  • the first rotation angle corresponding to the vehicle reaching the destination point of the storage location is calculated; when calculating the moving distance, only the distance between the first coordinate of the destination point of the storage location and the coordinate origin is calculated, and the vehicle can reach the storage location.
  • the moving distance corresponding to the destination point The specific calculation process can refer to the following third embodiment. After the driving data is calculated, the vehicle is first controlled to perform a rotation operation at the first rotation angle to obtain the vehicle after the attitude transition, and then the vehicle after the attitude transition is controlled to travel to the destination point of the storage location according to the moving distance.
  • the embodiment of the application provides a method for controlling a vehicle.
  • a navigation destination point near the navigation point of a storage location when it is detected that the vehicle reaches the navigation destination point, the ground is acquired based on the camera device installed on the vehicle body.
  • Image and obtain the straight line equation of the ground marking line according to the ground image, and record it as the first straight line equation; then, according to the first straight line equation and the preset storage location opening offset distance, determine the current pose and storage location purpose of the vehicle
  • the relative position information between the points; and based on the relative position information, the driving data corresponding to the vehicle reaching the destination point of the storage location is calculated, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
  • visual aided positioning can be achieved to compensate for the poor positioning accuracy of the target point of the lidar, and the accuracy of the target point positioning can be improved, from the original positioning accuracy of +/-5 ⁇ +/-15cm to +/ -3cm, so that the vehicle will be parked accurately in front of the pallet location, which is convenient for the accurate operation of the vehicle in and out of the pallet location in the next step.
  • the improvement of the positioning accuracy of the destination point of the storage location there is no need for the vehicle to adjust the posture after reaching the destination point of the storage location, thereby saving time wasted by adjusting the posture and improving the work efficiency of the vehicle.
  • the relative position information includes the first coordinates of the destination point of the storage location
  • step S20 includes:
  • Step S21 using the current position of the vehicle as the origin of coordinates, the opposite direction of the fork arm of the vehicle as the positive direction of the y-axis, and the right direction of the y-axis as the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system;
  • the current position of the vehicle is taken as the origin of coordinates
  • the opposite direction of the fork arm of the vehicle is taken as the positive direction of the y axis
  • the right direction of the y axis is taken as the positive direction of the x axis to construct a two-dimensional rectangular coordinate system.
  • the center of the rear wheel of the forklift can be used as the origin of coordinates
  • the opposite direction of the fork arm of the forklift is the positive direction of the y-axis
  • the right direction of the y-axis is x Axis positive direction
  • Step S22 based on the first straight line equation, calculate the intersection coordinates of the intersection between the ground marking lines in the two-dimensional rectangular coordinate system, and calculate the posture angle of the vehicle;
  • the intersection coordinates of the intersection between the ground marking lines in the two-dimensional rectangular coordinate system are calculated, and the posture angle of the vehicle is calculated.
  • the two ground identification lines ie the line l1 and the line l2 can be calculated.
  • Step S23 Determine the coordinates of the destination point of the storage location in the two-dimensional rectangular coordinate system according to the coordinates of the intersection, the attitude angle of the vehicle, and the offset distance of the preset storage location, which is recorded as the library The first coordinate of the destination point.
  • the preset location offset distance includes the preset distance between the destination point of the location and the location (L 1 in Figure 4) and the preset distance between the destination point of the location and the ground marking line (L 2 in Figure 4).
  • L 1 is generally set to be 0.5 times or more of the vehicle width (denoted as W 1 ).
  • the relative position information between the current pose of the vehicle and the destination point of the storage location can be calculated, so as to facilitate the subsequent acquisition of the first rotation angle and movement distance corresponding to the vehicle's arrival at the destination point of the storage location based on the relative position information.
  • the driving data includes a first rotation angle and a moving distance
  • the step of "calculating the driving data corresponding to the vehicle reaching the destination point of the storage location based on the relative position information" includes:
  • Step a1 calculating the slope of the straight line formed by the first coordinates of the destination point of the storage location and the origin of the coordinates, and calculating the first rotation angle corresponding to the vehicle reaching the destination point of the storage location according to the slope;
  • Step a2 Calculate the distance between the first coordinate of the destination point of the storage location and the origin of the coordinates, and obtain the movement distance corresponding to the vehicle to the destination point of the storage location.
  • the slope of the straight line formed by the first coordinate of the destination point of the storage location and the coordinate origin is calculated, and the first rotation angle corresponding to the vehicle reaching the destination point of the storage location is calculated according to the slope.
  • the first rotation angle w tan -1
  • tan -1
  • step a1 and step a2 are in no particular order.
  • the step of "controlling the vehicle to travel to the destination point of the storage location according to the driving data" includes:
  • Step a3 controlling the vehicle to perform a rotation operation at the first rotation angle in the driving data to obtain a vehicle with a posture transition;
  • Step a4 controlling the vehicle after the posture transition to drive to the destination point of the storage location according to the moving distance in the driving data.
  • the vehicle after the driving data is acquired, where the driving data includes a first rotation angle and a moving distance, the vehicle can be controlled to perform a rotation operation at the first rotation angle in the driving data to obtain a vehicle with a posture transition. Then, the vehicle after the control attitude transition is driven to the destination point of the storage location according to the moving distance in the driving data.
  • step a3 includes:
  • Step a31 during the rotation process, obtain the straight line equation of the ground marking line in real time, and record it as the second straight line equation;
  • Step a32 Calculate the PID rotation control amount in real time according to the slope corresponding to the second linear equation and the proportional-integral-derivative PID algorithm, and control the vehicle to perform a rotation operation according to the PID rotation control amount until the driving data is reached The first angle of rotation in;
  • the straight line equation of the ground marking line is obtained in real time, which is recorded as the second straight line equation.
  • the method of obtaining the second straight line equation is consistent with that of the first straight line equation. You can refer to The above-mentioned embodiments will not be repeated here.
  • the second straight line equation is the straight line equation corresponding to the straight line l1 in FIG. 4 in real time during the rotation process.
  • the PID rotation control amount is calculated in real time, and the vehicle is controlled to rotate according to the PID rotation control amount until the first rotation angle in the driving data is reached.
  • PID algorithm is a closed-loop control algorithm.
  • Closed-loop control is a control method that corrects according to the output feedback of the control object. It corrects according to the quota or standard when the deviation between the actual and the plan is measured.
  • PID is the abbreviation of Proportion, Integral, and Differential, which respectively represent three control algorithms. The combination of these three algorithms can effectively correct the deviation of the controlled object so that it can reach a stable state.
  • step a4 includes:
  • Step a41 in the process of moving, obtain the real-time distance between the intersection of the ground marking line and the vehicle after the posture transition;
  • Step a42 Calculate the PID movement control amount in real time according to the real-time distance and the PID algorithm, and control the vehicle after the attitude transition to move according to the PID movement control amount until the movement distance in the driving data is reached, Drive to the destination point of the storage location.
  • the movement can also be controlled based on the PID algorithm.
  • the real-time distance between the intersection of the ground marking line and the vehicle after the posture transition is obtained; wherein, the method for obtaining the intersection of the ground marking line can refer to the second embodiment described above.
  • the PID algorithm is used to calculate the PID rotation control quantity and the PID movement control quantity in real time, which can realize the real-time high-precision control of vehicles (such as forklifts) under complex conditions such as unsatisfactory environment and incomplete influencing factors.
  • vehicles such as forklifts
  • the completion of operations such as rotation and movement can further control the vehicle to park on the coordinates of the destination point of the storage location more accurately.
  • the step of "acquiring a ground image based on the camera device installed on the body of the vehicle, and obtaining a straight line equation of the ground identification line according to the ground image" includes:
  • Step b1 acquiring a ground image based on the camera device installed on the body of the vehicle, and identifying the centroid position of each target element corresponding to the ground marking line in the ground image;
  • Step b2 Determine the target data coordinates corresponding to each target element according to the centroid position of each target element, and generate a straight line equation of the ground marking line according to the target data coordinates.
  • the ground image is acquired based on the camera device installed on the body of the vehicle, and the centroid position of each target element corresponding to the ground target line in the ground image is identified. Specifically, first extract each target element from the ground image (black diamond blocks can be selected as the target element in the ground image); then obtain the initial contour of each target element, and then call OpenCV (open source computer vision library) for calculation
  • OpenCV open source computer vision library
  • the preset function of the center of mass position transmits the initial contour of each target element to the preset function.
  • the coordinate value is output.
  • the coordinate value is the center of mass coordinate of each target element in the ground image. .
  • Call the preset radius value and set the circular area corresponding to each target element with the center of mass coordinate as the center of the circle.
  • the circular area is the position of the center of mass of the target element in the ground image.
  • the installation parameters of the stereo camera After identifying the centroid position of each target element, combine the installation parameters of the stereo camera to perform polar coordinate conversion on the centroid coordinates representing the centroid position to obtain the depth data coordinates of each target element, which can be fitted to generate the ground marking line according to the depth data coordinates.
  • Linear equation Specifically, the circular area as the center of mass of the target element is used as the preset range interval, and the depth data coordinates of each target element are all based on the preset range interval to find points adjacent to it. Whenever the front and back or left and right points are found, the three points are removed and saved in an array as the target coordinate data of each depth data coordinate. After finding the target coordinate data for each depth data coordinate, the target coordinate data is then transformed into the coordinate system.
  • the target coordinate data is established with the location of the camera as the coordinate origin, for the convenience of subsequent calculation processing, the target The coordinate data is converted into the corresponding coordinate data in the two-dimensional rectangular coordinate system constructed with the center of the rear wheel of the vehicle as the coordinate origin, and then the least square method is used to generate the target coordinate data after the coordinate system conversion into a straight line equation.
  • the equation is the straight line equation corresponding to the ground marking line in the ground image.
  • the ground image can be acquired based on the camera device installed on the vehicle body, and then the linear equation corresponding to the ground marking line can be acquired based on the ground image, which can facilitate the subsequent determination of relative position information and formal data based on the linear equation, thereby Through the way of visual aided positioning, it realizes the function of fast and high-precision target point positioning.
  • the vehicle control method further includes:
  • Step S40 after the vehicle has traveled to the destination point of the storage location, obtain the straight line equation of the ground marking line, which is recorded as the third straight line equation;
  • step S50 a second rotation angle is calculated according to the third straight line equation, and the vehicle is controlled to perform a rotation operation at the second rotation angle.
  • the straight line equation of the ground marking line is obtained again, which is recorded as the third straight line equation.
  • the third straight line equation is obtained in the same manner as the first straight line equation. Consistent, please refer to the above-mentioned embodiment, which will not be repeated here. Among them, as shown in Figure 7(A), the third straight line equation is the straight line equation corresponding to the ground marking line l1.
  • the second rotation angle is calculated according to the third straight line equation.
  • the center of the current rear wheel of the vehicle (such as a SLAM forklift) is used as the coordinate origin, and the fork arm of the vehicle is pointed in the opposite direction It is the positive direction of the y-axis, and the right side of the y-axis is the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system.
  • the slope of the third straight-line equation calculate the distance between the ground marking line and the y-axis corresponding to the third straight-line equation
  • the included angle is the second rotation angle.
  • the vehicle is controlled to perform a rotation operation at the second rotation angle to control the vehicle to be parallel to the ground marking line corresponding to the third straight line equation.
  • the posture of the vehicle as shown in FIG. 7(A) is rotated to the posture as shown in FIG. 7(B).
  • the PID closed-loop control system can be used to control the rotation of the vehicle, so as to control the vehicle to park on the coordinates of the destination point of the storage location with a more accurate posture.
  • the specific implementation The process is similar to the foregoing embodiment, and will not be repeated here.
  • the PID closed-loop control system can also control the vehicle to make minor jitter adjustments near the destination point of the storage location, so as to park at the destination point coordinates of the storage location more accurately, and further improve the destination point of the storage location. positioning accuracy.
  • the straight line equation (third straight line equation) of the ground marking line can be obtained to determine the second rotation angle, and then control the vehicle to rotate to the parallel position according to the second rotation angle. This facilitates operations such as fork picking or stacking of goods in the next step.
  • the present application also provides a computer-readable storage medium that stores a control program of a vehicle on the computer-readable storage medium.
  • the control program of the vehicle is executed by a processor, the control program of the vehicle as described in any of the above embodiments is realized. Steps of the control method.
  • the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disks, optical disks), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.
  • a terminal device which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Navigation (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

A vehicle control method and control device, and a computer readable storage medium, comprising: when detecting that a vehicle arrives at a navigation destination point, obtaining a ground image on the basis of a photographing device mounted on the vehicle body of the vehicle, obtaining a straight line equation of a ground identification line according to the ground image, and denoting same as a first straight line equation; determining, according to the first straight line equation and a preset storage position port offset distance, relative position information of the current position of the vehicle and a storage position destination point; and calculating, on the basis of the relative position information, traveling data corresponding to the vehicle arriving at the storage position destination point, and controlling, according to the traveling data, the vehicle to travel to the storage position destination point. Thus, the problem that a vehicle is unable to park accurately due to poor positioning accuracy of a destination point in existing SLAM positioning is solved.

Description

车辆的控制方法、装置及计算机可读存储介质Vehicle control method, device and computer readable storage medium
本申请要求于2019年11月12日提交中国专利局、申请号为201911103400.4、发明名称为“车辆的控制方法、装置及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201911103400.4, and the invention title is "Vehicle control method, device and computer readable storage medium" on November 12, 2019, the entire content of which is incorporated by reference Incorporate in the application.
技术领域Technical field
本申请涉及智能导航技术领域,尤其涉及一种车辆的控制方法、装置及计算机可读存储介质。This application relates to the field of intelligent navigation technology, and in particular to a vehicle control method, device, and computer-readable storage medium.
背景技术Background technique
基于自然环境的SLAM(Simultaneous Localization and Mapping,即时定位与地图构建)包括两大功能:定位与建图。其中,建图的主要作用是对周边环境的理解,建立周边环境与空间的对应关系;定位的主要作用是根据建好的图,判断车体在地图中的位置,从而得到环境中的信息。其次,激光雷达是一种主动式探测传感器,不依赖于外界光照条件,且具备高精度的测距信息。因此,基于激光雷达的SLAM方法依旧是机器人SLAM方法中应用最为广泛的方法,并且在ROS(Robot Operating System,机器人软件平台)的SLAM应用也已非常广泛。SLAM (Simultaneous Localization and Mapping, real-time positioning and map construction) includes two major functions: positioning and mapping. Among them, the main function of mapping is to understand the surrounding environment and establish the corresponding relationship between the surrounding environment and space; the main function of positioning is to judge the position of the car body on the map based on the built map, so as to obtain the information in the environment. Secondly, lidar is an active detection sensor that does not depend on external light conditions and has high-precision ranging information. Therefore, the SLAM method based on lidar is still the most widely used method in the robot SLAM method, and in ROS (Robot Operating System, robot software platform) SLAM applications have also been very extensive.
在现有的SLAM导航应用中,通过激光雷达的方式进行导航目的点的定位,其精度取决于激光雷达的线性度。但是,由于激光雷达在很大的空间范围内很难保持良好的线性度,容易造成SLAM叉车到达目的点之后的定位偏差,即目的点定位精度较差,从而导致叉车无法准确停靠库位目的点,进而导致下一步叉车需调整姿态而浪费时间。In the existing SLAM navigation application, the positioning of the navigation target point is carried out by means of lidar, and its accuracy depends on the linearity of the lidar. However, because it is difficult for lidar to maintain good linearity in a large spatial range, it is easy to cause the positioning deviation of the SLAM forklift after reaching the destination point, that is, the positioning accuracy of the destination point is poor, which causes the forklift to be unable to accurately stop at the destination point of the storage location. , Which in turn leads to a waste of time for the forklift to adjust its posture in the next step.
技术解决方案Technical solutions
本申请的主要目的在于提供一种车辆的控制方法、装置及计算机可读存储介质,旨在解决现有SLAM定位中目的点定位精度较差、导致车辆无法准确停靠的问题。The main purpose of this application is to provide a vehicle control method, device, and computer-readable storage medium, aiming to solve the problem of poor target point positioning accuracy in the existing SLAM positioning, which causes the vehicle to be unable to park accurately.
为实现上述目的,本申请提供一种车辆的控制方法,所述车辆的控制方法包括:In order to achieve the above objective, the present application provides a vehicle control method, and the vehicle control method includes:
在检测到车辆到达导航目的点时,基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程,记为第一直线方程;When it is detected that the vehicle reaches the navigation destination point, the ground image is acquired based on the camera device installed on the body of the vehicle, and the linear equation of the ground identification line is acquired according to the ground image, which is recorded as the first linear equation;
根据所述第一直线方程和预设库位口偏移距离,确定所述车辆的当前位姿与库位目的点之间的相对位置信息;Determine the relative position information between the current pose of the vehicle and the destination point of the storage location according to the first straight line equation and the preset storage location opening offset distance;
基于所述相对位置信息计算得到所述车辆到达所述库位目的点所对应的行驶数据,并根据所述行驶数据控制所述车辆行驶至所述库位目的点。The driving data corresponding to the vehicle reaching the destination point of the storage location is calculated based on the relative position information, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
此外,为实现上述目的,本申请还提供一种车辆的控制装置,所述车辆的控制装置包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的车辆的控制程序,所述车辆的控制程序被所述处理器执行时实现如上所述的车辆的控制方法的步骤。In addition, in order to achieve the above objective, the present application also provides a vehicle control device, the vehicle control device comprising: a memory, a processor, and a control of the vehicle that is stored in the memory and can run on the processor A program, when the control program of the vehicle is executed by the processor, realizes the steps of the control method of the vehicle as described above.
此外,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有车辆的控制程序,所述车辆的控制程序被处理器执行时实现如上所述的车辆的控制方法的步骤。In addition, in order to achieve the above-mentioned object, the present application also provides a computer-readable storage medium having a vehicle control program stored on the computer-readable storage medium, and when the vehicle control program is executed by a processor, the above-mentioned The steps of the vehicle control method.
本申请提供一种车辆的控制方法、装置及计算机可读存储介质,通过在库位导航点附近预设一导航目的点,在检测到车辆到达导航目的点时,基于车体上安装的摄像装置获取地面图像,并根据地面图像获取地面标识线的直线方程,记为第一直线方程;然后,根据第一直线方程和预设库位口偏移距离,确定车辆的当前位姿与库位目的点之间的相对位置信息;进而基于相对位置信息计算得到车辆到达库位目的点所对应的行驶数据,并根据行驶数据控制车辆行驶至库位目的点。通过上述方式,可实现视觉辅助定位,以弥补激光雷达目的点定位精度较差的缺陷,可提高目的点定位的精度,使得车辆准确停靠在栈板库位前面,便于车辆下一步对栈板库位的出入库的准确操作。同时,由于库位目的点定位精度的提高,无需车辆到达库位目的点后调整姿态,从而可节省因调整姿态而浪费的时间,提高车辆的工作效率。The present application provides a vehicle control method, device, and computer-readable storage medium. By presetting a navigation destination point near the navigation point of the storage location, when the vehicle is detected to reach the navigation destination point, based on the camera device installed on the vehicle body Obtain the ground image, and obtain the straight line equation of the ground marking line according to the ground image, and record it as the first straight line equation; then, according to the first straight line equation and the preset warehouse location offset distance, determine the current pose and library of the vehicle The relative position information between the location destination points; and based on the relative location information, the driving data corresponding to the vehicle reaching the destination point of the storage location is calculated, and the vehicle is controlled to travel to the destination destination point of the storage location according to the driving data. Through the above method, visual aided positioning can be realized to compensate for the poor positioning accuracy of the target point of the lidar, and the accuracy of the target point positioning can be improved, so that the vehicle can accurately park in front of the pallet warehouse, which is convenient for the vehicle to check the pallet warehouse in the next step. Accurate operation of the entry and exit of the warehouse. At the same time, due to the improvement of the positioning accuracy of the destination point of the storage location, there is no need for the vehicle to adjust the posture after reaching the destination point of the storage location, thereby saving time wasted by adjusting the posture and improving the work efficiency of the vehicle.
附图说明Description of the drawings
图1为本申请实施例方案涉及的硬件运行环境的车辆的控制装置结构示意图;FIG. 1 is a schematic diagram of a structure of a vehicle control device in a hardware operating environment involved in a solution of an embodiment of the application;
图2为本申请车辆的控制方法第一实施例的流程示意图;2 is a schematic flowchart of the first embodiment of the vehicle control method of this application;
图3为本申请车辆的控制方法涉及的一应用场景示意图;FIG. 3 is a schematic diagram of an application scenario involved in the vehicle control method of this application;
图4为本申请车辆的控制方法涉及的行驶数据计算过程中所涉及参数的一示意图;4 is a schematic diagram of the parameters involved in the calculation process of the driving data involved in the control method of the vehicle of this application;
图5为本申请车辆的控制方法第二实施例的流程示意图;FIG. 5 is a schematic flowchart of a second embodiment of a vehicle control method according to this application;
图6为本申请车辆的控制方法第六实施例的流程示意图;6 is a schematic flowchart of a sixth embodiment of a vehicle control method according to this application;
图7为本申请车辆的控制方法涉及的AGV旋转前后的一姿态示意图。FIG. 7 is a schematic diagram of a posture before and after the rotation of the AGV involved in the control method of the vehicle of this application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
本发明的实施方式Embodiments of the present invention
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, and not used to limit the application.
参照图1,图1为本申请实施例方案涉及的硬件运行环境的车辆的控制装置结构示意图。Referring to FIG. 1, FIG. 1 is a schematic structural diagram of a vehicle control device in a hardware operating environment involved in a solution of an embodiment of the application.
如图1所示,该车辆的控制装置可以包括:处理器1001,例如CPU(Central Processing Unit,中央处理器),通信总线1002,用户接口1003,网络接口1004,存储器1005。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如无线保真Wireless-Fidelity,Wi-Fi接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in Figure 1, the vehicle control device may include: a processor 1001, such as a CPU (Central Processing Unit, central processing unit), communication bus 1002, user interface 1003, network interface 1004, and memory 1005. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as Wireless-Fidelity, Wi-Fi interface). The memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
本领域技术人员可以理解,图1中示出的车辆的控制装置结构并不构成对车辆的控制装置的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the structure of the control device of the vehicle shown in FIG. 1 does not constitute a limitation on the control device of the vehicle, and may include more or less components than those shown in the figure, or combine certain components, or different components. The layout of the components.
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作***、网络通信模块、用户接口模块以及车辆的控制程序。As shown in FIG. 1, the memory 1005, which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and a vehicle control program.
在图1所示的车辆的控制装置中,网络接口1004主要用于连接后台服务器,与后台服务器进行数据通信;用户接口1003主要用于连接客户端,与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的车辆的控制程序。In the vehicle control device shown in FIG. 1, the network interface 1004 is mainly used to connect to a background server and perform data communication with the background server; the user interface 1003 is mainly used to connect to a client and perform data communication with the client; and the processor 1001 It can be used to call the control program of the vehicle stored in the memory 1005.
在本实施例中,车辆的控制装置包括:存储器1005、处理器1001及存储在所述存储器1005上并可在所述处理器1001上运行的车辆的控制程序,其中,处理器1001调用存储器1005中存储的车辆的控制程序时,并执行本申请实施例提供的车辆的控制方法。In this embodiment, the vehicle control device includes a memory 1005, a processor 1001, and a vehicle control program that is stored on the memory 1005 and can run on the processor 1001, wherein the processor 1001 calls the memory 1005 When the vehicle control program is stored in the storage device, the vehicle control method provided in the embodiment of the present application is executed.
基于上述硬件结构,提出本申请车辆的控制方法各个实施例。Based on the above hardware structure, various embodiments of the vehicle control method of the present application are proposed.
本申请提供一种车辆的控制方法。This application provides a vehicle control method.
参照图2,图2为本申请车辆的控制方法第一实施例的流程示意图。Referring to Fig. 2, Fig. 2 is a schematic flowchart of a first embodiment of a vehicle control method according to this application.
在本实施例中,该车辆的控制方法包括:In this embodiment, the vehicle control method includes:
步骤S10,在检测到车辆到达导航目的点时,基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程,记为第一直线方程;Step S10, when it is detected that the vehicle reaches the navigation destination point, the ground image is acquired based on the camera device installed on the body of the vehicle, and the linear equation of the ground marking line is acquired according to the ground image, which is recorded as the first linear equation ;
在本实施例中,在上述步骤S10之前,该车辆的控制方法还包括:In this embodiment, before the above step S10, the vehicle control method further includes:
步骤A,获取所述库位目的点在预设即时定位与地图构建SLAM地图中的坐标,根据所述库位目的点的坐标确定与所述库位目的点对应的导航目的点的坐标;Step A: Obtain the coordinates of the destination point of the storage location in the preset real-time positioning and map construction SLAM map, and determine the coordinates of the navigation destination point corresponding to the destination point of the storage location according to the coordinates of the destination point of the storage location;
步骤B,基于所述导航目的点的坐标和所述预设SLAM地图,控制所述车辆行驶至所述导航目的点。Step B: Based on the coordinates of the navigation destination point and the preset SLAM map, control the vehicle to travel to the navigation destination point.
在本实施例中,该车辆的控制方法可应用于仓储场景中,通过AGV(Automated Guided Vehicle,自动导引运输车)小车来搬运货物。AGV小车可以为具有安全保护以及各种移载功能的运输车,如SLAM(Simultaneous Localization and Mapping,即时定位与地图构建)叉车,下述实施例中以叉车为例进行说明。如图3所示,该图3为地堆式仓库的应用场景示意图,其中,1.1-1.3,表示SLAM叉车终端;2.1,表示栈板货物;2.2,表示地堆仓位的标识线(其中,仓库中的地面标识线其实质为粘贴在地面上的胶带,通常由两种颜色相互间隔形成的菱形块图案组成,如黑色菱形块搭配黄色菱形块,黑色菱形块搭配白色菱形块等,可便于人工和机器作业按位置摆放栈板);2.3,表示仓库墙壁;2.4,表示仓库过道;3,表示库位目的点;4,表示从库位目的点直接入库的线路。In this embodiment, the vehicle control method can be applied in a storage scenario, and goods are transported by AGV (Automated Guided Vehicle). The AGV trolley may be a transport vehicle with safety protection and various transfer functions, such as a SLAM (Simultaneous Localization and Mapping, instant positioning and map construction) forklift. In the following embodiments, a forklift is used as an example for illustration. As shown in Figure 3, this figure 3 is a schematic diagram of the application scenario of a ground-stack warehouse, where 1.1-1.3 represent the SLAM forklift terminal; 2.1, the pallet cargo; 2.2, the identification line of the ground-stack warehouse (wherein, the warehouse The ground marking line in is essentially tape pasted on the ground, usually composed of diamond-shaped blocks in two colors spaced apart, such as black diamond-shaped blocks with yellow diamond-shaped blocks, black diamond-shaped blocks with white diamond-shaped blocks, etc., which can be convenient for manual labor. (Place the pallets according to the position of the machine operation); 2.3, the warehouse wall; 2.4, the warehouse aisle; 3, the destination point of the storage location; 4, the line of direct entry from the destination point of the storage location.
由于激光雷达在很大的空间范围内很难保持良好的线性度,激光雷达的SLAM定位本身误差只能做到+/-20cm大致范围内,在仓储和生产线的AGV对接应用中,通常叉车在目的点位置,都需要5cm以内的定位精度,有些地方甚至需要2cm以内,仅仅靠激光雷达探测的自然环境边缘进行定位是不能满足场景需求的。因此,本实施例中通过视觉辅助定位的方式,实现快速的高精度目的点定位功能。先将SLAM导航的目的点(即导航目的点)设置在库位目的点(如图3中的A点)的旁边(例如图3中的B点),当导航到达B目的点之后(实际上是一个半径20cm的圆圈范围),再通过识别地面标识线,准确的移动到A点(实际上是一个半径5cm的圆圈范围),以达到准确到达库位目的点。Since it is difficult for lidar to maintain good linearity in a large space, the error of the SLAM positioning of lidar can only be within the approximate range of +/-20cm. In the application of AGV docking in storage and production lines, forklifts usually The location of the destination point needs a positioning accuracy within 5cm, and in some places it even needs to be within 2cm. Only relying on the edge of the natural environment detected by the lidar for positioning cannot meet the needs of the scene. Therefore, in this embodiment, a fast and high-precision target point positioning function is realized by means of visual assisted positioning. First set the destination point of the SLAM navigation (ie the navigation destination point) next to the destination point of the location (point A in Figure 3) (such as point B in Figure 3), when the navigation reaches the destination point B (actually It is a circle with a radius of 20cm), and then accurately moves to point A (actually a circle with a radius of 5cm) by identifying the ground marking line to reach the destination point of the storage location accurately.
具体的,先获取库位目的点在预设SLAM地图中的坐标,根据库位目的点的坐标确定与库位目的点对应的导航目的点的坐标,例如针对图3的应用场景,当库位目的点A的坐标为(a,b),可设定导航目的点的坐标为(a+20,b+20);然后,基于导航目的点的坐标和预设SLAM地图,控制车辆行驶至导航目的点。Specifically, first obtain the coordinates of the destination point of the storage location in the preset SLAM map, and determine the coordinates of the navigation destination point corresponding to the destination point of the storage location according to the coordinates of the destination point of the storage location. The coordinates of the destination point A are (a, b), and the coordinates of the navigation destination point can be set as (a+20, b+20); then, based on the coordinates of the navigation destination point and the preset SLAM map, control the vehicle to navigate Point of purpose.
在检测到车辆到达导航目的点(即在距离导航目的点预设范围内)时,基于车辆的车体上安装的摄像装置获取地面图像,并根据地面图像获取地面标识线的直线方程,记为第一直线方程。如图4所示,车辆到达导航目的点时,其当前实际位置为图4中的B点,库位目的点为图4中的A点,可根据车辆的车体上安装的摄像装置获取地面图像,进而获取地面标识线对应的直线方程1(如图4中的l1)和直线方程2(如图4中的l2)。其中,该地面标识线的直线方程是以车辆的当前位姿为坐标原点、以车辆的叉臂指向的反方向为y轴正方向、以y轴右侧方向为x轴正方向、构建所得的二维直角坐标系计算得到的。When it is detected that the vehicle reaches the navigation destination point (that is, within the preset range from the navigation destination point), the ground image is acquired based on the camera device installed on the vehicle body, and the linear equation of the ground marking line is acquired according to the ground image, which is recorded as The first linear equation. As shown in Figure 4, when the vehicle reaches the navigation destination, its current actual position is point B in Figure 4, and the destination point of the storage location is point A in Figure 4. The ground can be obtained according to the camera device installed on the vehicle body Image, and then obtain the linear equation 1 (l1 in Figure 4) and the linear equation 2 (l2 in Figure 4) corresponding to the ground marking line. Among them, the straight line equation of the ground marking line is constructed by taking the current pose of the vehicle as the origin of coordinates, the opposite direction of the fork arm of the vehicle as the positive direction of the y-axis, and the right direction of the y-axis as the positive direction of the x-axis. Calculated in a two-dimensional rectangular coordinate system.
步骤S20,根据所述第一直线方程和预设库位口偏移距离,确定所述车辆的当前位姿与库位目的点之间的相对位置信息;Step S20: Determine the relative position information between the current pose of the vehicle and the destination point of the storage location according to the first straight line equation and the preset storage location opening offset distance;
然后,根据第一直线方程和预设库位口偏移距离,确定车辆的当前位姿与库位目的点之间的相对位置信息。其中,相对位置信息包括库位目的点的第一坐标,预设库位口偏移距离包括预先设定的库位目的点与库位之间的距离(如图4中的L 1)和预先设定的库位目的点与地面标识线之间的距离(如图4中的L 2),相对位置信息的获取过程为:先以车辆的当前位置为坐标原点,以车辆的叉臂指向的反方向为y轴正方向,以y轴右侧方向为x轴正方向,构建二维直角坐标系;然后,基于第一直线方程,计算地面标识线之间的交叉点在二维直角坐标系中的交叉点坐标,并计算车辆的姿态角度;进而根据交叉点坐标、车辆的姿态角度、预设库位口偏移距离,确定库位目的点在二维直角坐标系中的坐标,记为库位目的点的第一坐标。具体的执行过程可参照下述第二实施例,此处不作赘述。 Then, the relative position information between the current pose of the vehicle and the destination point of the storage location is determined according to the first straight line equation and the preset offset distance of the storage location. Among them, the relative position information includes the first coordinates of the destination point of the storage location, and the preset offset distance of the storage location port includes the preset distance between the destination point of the storage location and the storage location (L 1 in Figure 4) and the preset distance between the destination point of the storage location and the storage location. Set the distance between the destination point of the storage location and the ground marking line (L 2 in Figure 4), the relative position information acquisition process is: first take the current position of the vehicle as the origin of the coordinates, and use the fork arm of the vehicle as the origin of the coordinates. The opposite direction is the positive direction of the y-axis, and the right direction of the y-axis is the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system; then, based on the first straight line equation, calculate the intersection point between the ground markings in the two-dimensional rectangular coordinate The coordinates of the intersection in the system, and calculate the attitude angle of the vehicle; then according to the coordinates of the intersection, the attitude angle of the vehicle, and the preset offset distance of the warehouse location, the coordinates of the warehouse location destination point in the two-dimensional rectangular coordinate system are determined. The first coordinate of the destination point of the location. For the specific execution process, refer to the following second embodiment, which will not be repeated here.
步骤S30,基于所述相对位置信息计算得到所述车辆到达所述库位目的点所对应的行驶数据,并根据所述行驶数据控制所述车辆行驶至所述库位目的点。In step S30, the driving data corresponding to the vehicle reaching the destination point of the storage location is calculated based on the relative position information, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
在确定得到车辆的当前位姿与库位目的点之间的相对位置信息之后,基于相对位置信息计算得到车辆到达库位目的点所对应的行驶数据,并根据行驶数据控制车辆行驶至库位目的点。其中,行驶数据包括第一旋转角度和移动距离,由于相对位置信息为以车辆的当前位置为坐标原点、以车辆的叉臂指向的反方向为y轴,构建得到的二维直角坐标系中,库位目的点所对应的坐标(即库位目的点的第一坐标),故在计算第一旋转角度时,只需计算库位目的点的第一坐标与坐标原点所构成直线的斜率,进而根据斜率计算得到车辆到达库位目的点所对应的第一旋转角度;在计算移动距离时,只需计算库位目的点的第一坐标与坐标原点之间的距离,即可得到车辆到达库位目的点所对应的移动距离。具体的计算过程可参照下述第三实施例。在计算得到行驶数据之后,先控制车辆以第一旋转角度进行旋转操作,得到姿态转变后的车辆,然后控制姿态转变后的车辆根据移动距离行驶至库位目的点。After determining the relative position information between the current pose of the vehicle and the destination point of the storage location, calculate the driving data corresponding to the vehicle reaching the destination point of the storage location based on the relative position information, and control the vehicle to travel to the destination point of the storage location based on the driving data point. Wherein, the driving data includes the first rotation angle and the moving distance. Since the relative position information is based on the current position of the vehicle as the origin of the coordinates and the opposite direction of the fork arm of the vehicle as the y axis, in the two-dimensional rectangular coordinate system constructed, The coordinates corresponding to the destination point of the location (that is, the first coordinate of the destination point of the location), so when calculating the first rotation angle, only the slope of the straight line formed by the first coordinate of the destination point of the location and the origin of the coordinates needs to be calculated, and then According to the slope, the first rotation angle corresponding to the vehicle reaching the destination point of the storage location is calculated; when calculating the moving distance, only the distance between the first coordinate of the destination point of the storage location and the coordinate origin is calculated, and the vehicle can reach the storage location. The moving distance corresponding to the destination point. The specific calculation process can refer to the following third embodiment. After the driving data is calculated, the vehicle is first controlled to perform a rotation operation at the first rotation angle to obtain the vehicle after the attitude transition, and then the vehicle after the attitude transition is controlled to travel to the destination point of the storage location according to the moving distance.
本申请实施例提供一种车辆的控制方法,通过在库位导航点附近预设一导航目的点,在检测到车辆到达导航目的点时,基于所述车辆的车体上安装的摄像装置获取地面图像,并根据地面图像获取地面标识线的直线方程,记为第一直线方程;然后,根据第一直线方程和预设库位口偏移距离,确定车辆的当前位姿与库位目的点之间的相对位置信息;进而基于相对位置信息计算得到车辆到达库位目的点所对应的行驶数据,并根据行驶数据控制车辆行驶至库位目的点。通过上述方式,可实现视觉辅助定位,以弥补激光雷达目的点定位精度较差的缺陷,可提高目的点定位的精度,由原来的定位精度+/-5~+/-15cm,提高到+/-3cm以内,从而使得车辆准确停靠在栈板库位前面,便于车辆下一步对栈板库位的出入库的准确操作。同时,由于库位目的点定位精度的提高,无需车辆到达库位目的点后调整姿态,从而可节省因调整姿态而浪费的时间,提高车辆的工作效率。The embodiment of the application provides a method for controlling a vehicle. By presetting a navigation destination point near the navigation point of a storage location, when it is detected that the vehicle reaches the navigation destination point, the ground is acquired based on the camera device installed on the vehicle body. Image, and obtain the straight line equation of the ground marking line according to the ground image, and record it as the first straight line equation; then, according to the first straight line equation and the preset storage location opening offset distance, determine the current pose and storage location purpose of the vehicle The relative position information between the points; and based on the relative position information, the driving data corresponding to the vehicle reaching the destination point of the storage location is calculated, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data. Through the above method, visual aided positioning can be achieved to compensate for the poor positioning accuracy of the target point of the lidar, and the accuracy of the target point positioning can be improved, from the original positioning accuracy of +/-5~+/-15cm to +/ -3cm, so that the vehicle will be parked accurately in front of the pallet location, which is convenient for the accurate operation of the vehicle in and out of the pallet location in the next step. At the same time, due to the improvement of the positioning accuracy of the destination point of the storage location, there is no need for the vehicle to adjust the posture after reaching the destination point of the storage location, thereby saving time wasted by adjusting the posture and improving the work efficiency of the vehicle.
进一步地,基于上述第一实施例,提出本申请车辆的控制方法的第二实施例。参照图5,在本实施例中,所述相对位置信息包括库位目的点的第一坐标,步骤S20包括:Further, based on the above-mentioned first embodiment, a second embodiment of the vehicle control method of the present application is proposed. 5, in this embodiment, the relative position information includes the first coordinates of the destination point of the storage location, and step S20 includes:
步骤S21,以所述车辆的当前位置为坐标原点,以所述车辆的叉臂指向的反方向为y轴正方向,以y轴右侧方向为x轴正方向,构建二维直角坐标系;Step S21, using the current position of the vehicle as the origin of coordinates, the opposite direction of the fork arm of the vehicle as the positive direction of the y-axis, and the right direction of the y-axis as the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system;
在本实施例中,以车辆的当前位置为坐标原点,以车辆的叉臂指向的反方向为y轴正方向,以y轴右侧方向为x轴正方向,构建二维直角坐标系。具体的,对于SLAM叉车而言,如图4所示,可以以叉车的车后轮中心为坐标原点,以叉车的叉臂指向的反方向为y轴正方向,以y轴右侧方向为x轴正方向,构建二维直角坐标系。即在该构建的二维直角坐标系中,车辆(图4中B点)的坐标为(0,0)。In this embodiment, the current position of the vehicle is taken as the origin of coordinates, the opposite direction of the fork arm of the vehicle is taken as the positive direction of the y axis, and the right direction of the y axis is taken as the positive direction of the x axis to construct a two-dimensional rectangular coordinate system. Specifically, for a SLAM forklift, as shown in Figure 4, the center of the rear wheel of the forklift can be used as the origin of coordinates, the opposite direction of the fork arm of the forklift is the positive direction of the y-axis, and the right direction of the y-axis is x Axis positive direction, construct a two-dimensional rectangular coordinate system. That is, in the constructed two-dimensional rectangular coordinate system, the coordinates of the vehicle (point B in Figure 4) are (0,0).
步骤S22,基于所述第一直线方程,计算地面标识线之间的交叉点在所述二维直角坐标系中的交叉点坐标,并计算所述车辆的姿态角度;Step S22, based on the first straight line equation, calculate the intersection coordinates of the intersection between the ground marking lines in the two-dimensional rectangular coordinate system, and calculate the posture angle of the vehicle;
然后,基于第一直线方程,计算地面标识线之间的交叉点在二维直角坐标系中的交叉点坐标,并计算车辆的姿态角度。例如图4,假设得到直线l1的直线方程为ax+by+c=0,直线l2的直线方程为dx+ey+f=0,可计算得到两地面标识线(即直线l1和直线l2)之间的交叉点P的坐标(x P,y P),其中,x P=(ec-bf)/(bd-ae),y P=(cd-ae)/(ae-bd),基于直线l1的直线方程可计算得到车辆的姿态角度θ=tan -1(-b/a)。 Then, based on the first straight line equation, the intersection coordinates of the intersection between the ground marking lines in the two-dimensional rectangular coordinate system are calculated, and the posture angle of the vehicle is calculated. For example, as shown in Figure 4, assuming that the linear equation of the line l1 is ax+by+c=0, and the linear equation of the line l2 is dx+ey+f=0, the two ground identification lines (ie the line l1 and the line l2) can be calculated. The coordinates of the intersection point P between (x P , y P ), where x P = (ec-bf)/(bd-ae), y P = (cd-ae)/(ae-bd), based on the straight line l1 The straight line equation can be calculated to get the attitude angle of the vehicle θ=tan -1 (-b/a).
步骤S23,根据所述交叉点坐标、所述车辆的姿态角度、预设库位口偏移距离,确定所述库位目的点在所述二维直角坐标系中的坐标,记为所述库位目的点的第一坐标。Step S23: Determine the coordinates of the destination point of the storage location in the two-dimensional rectangular coordinate system according to the coordinates of the intersection, the attitude angle of the vehicle, and the offset distance of the preset storage location, which is recorded as the library The first coordinate of the destination point.
在得到交叉点坐标和车辆的姿态角度之后,根据交叉点坐标、车辆的姿态角度、预设库位口偏移距离,确定库位目的点在二维直角坐标系中的坐标,记为库位目的点的第一坐标。其中,预设库位口偏移距离包括预先设定的库位目的点与库位之间的距离(如图4中的L 1)和预先设定的库位目的点与地面标识线之间的距离(如图4中的L 2),一般而言,L 1一般设置为0.5倍以上的车宽(记为W 1),优选地,可设定L 1=0.6W 1,L 2是基于库位宽(记为W 2)设置的,优选地,可设定L 2=W 2+0.5W 2=1.5W 2,当然,可以理解,在具体实施过程中,可根据实际情况预先设定库位口偏移距离。根据L 1、L 2和θ,可计算得到库位目的点(图4中的A点)的坐标(x A,y A),其中,x A=x Pcosθ-L 1,y A=y Pcosθ-L 2After obtaining the coordinates of the intersection and the attitude angle of the vehicle, according to the coordinates of the intersection, the attitude angle of the vehicle, and the preset offset distance of the location, determine the coordinates of the destination point of the location in the two-dimensional rectangular coordinate system, and record it as the location The first coordinate of the destination point. Among them, the preset location offset distance includes the preset distance between the destination point of the location and the location (L 1 in Figure 4) and the preset distance between the destination point of the location and the ground marking line (L 2 in Figure 4). Generally speaking, L 1 is generally set to be 0.5 times or more of the vehicle width (denoted as W 1 ). Preferably, L 1 =0.6W 1 , L 2 is It is set based on the location width (denoted as W 2 ). Preferably, L 2 =W 2 +0.5W 2 =1.5W 2 can be set. Of course, it can be understood that in the specific implementation process, it can be preset according to the actual situation. The offset distance of the fixed location port. According to L 1 , L 2 and θ, the coordinates (x A , y A ) of the destination point (point A in Figure 4) can be calculated , where x A = x P cosθ-L 1 , y A = y P cosθ-L 2 .
通过上述方式,可计算得到车辆的当前位姿与库位目的点之间的相对位置信息,进而便于后续基于该相对位置信息获取得到车辆到达库位目的点所对应的第一旋转角度和移动距离。Through the above method, the relative position information between the current pose of the vehicle and the destination point of the storage location can be calculated, so as to facilitate the subsequent acquisition of the first rotation angle and movement distance corresponding to the vehicle's arrival at the destination point of the storage location based on the relative position information. .
进一步地,基于上述第二实施例,提出本申请车辆的控制方法的第三实施例。在本实施例中,所述行驶数据包括第一旋转角度和移动距离,步骤“基于所述相对位置信息计算得到所述车辆到达所述库位目的点所对应的行驶数据”包括:Further, based on the above-mentioned second embodiment, a third embodiment of the vehicle control method of the present application is proposed. In this embodiment, the driving data includes a first rotation angle and a moving distance, and the step of "calculating the driving data corresponding to the vehicle reaching the destination point of the storage location based on the relative position information" includes:
步骤a1,计算所述库位目的点的第一坐标与所述坐标原点所构成直线的斜率,根据所述斜率计算得到所述车辆到达所述库位目的点所对应的第一旋转角度;Step a1, calculating the slope of the straight line formed by the first coordinates of the destination point of the storage location and the origin of the coordinates, and calculating the first rotation angle corresponding to the vehicle reaching the destination point of the storage location according to the slope;
步骤a2,计算所述库位目的点的第一坐标与所述坐标原点之间的距离,得到所述车辆到达所述库位目的点所对应的移动距离。Step a2: Calculate the distance between the first coordinate of the destination point of the storage location and the origin of the coordinates, and obtain the movement distance corresponding to the vehicle to the destination point of the storage location.
在计算得到库位目的点的第一坐标之后,计算库位目的点的第一坐标与坐标原点所构成直线的斜率,根据斜率计算得到车辆到达库位目的点所对应的第一旋转角度。其中,库位目的点的第一坐标与坐标原点所构成直线的斜率k=y A/x A,第一旋转角度w=tan -1|1/k|= tan -1|x A/y A|。 After the first coordinate of the destination point of the storage location is calculated, the slope of the straight line formed by the first coordinate of the destination point of the storage location and the coordinate origin is calculated, and the first rotation angle corresponding to the vehicle reaching the destination point of the storage location is calculated according to the slope. Among them, the slope of the straight line formed by the first coordinate of the location destination point and the coordinate origin is k=y A /x A , and the first rotation angle w=tan -1 |1/k|= tan -1 |x A /y A |.
计算库位目的点的第一坐标与坐标原点之间的距离,得到车辆到达库位目的点所对应的移动距离。移动距离s=(x A 2+y A 21/2Calculate the distance between the first coordinate of the destination point of the storage location and the origin of the coordinates, and obtain the corresponding moving distance of the vehicle to the destination point of the storage location. The moving distance s=(x A 2 +y A 2 ) 1/2 .
其中,步骤a1和步骤a2的执行顺序不分先后。Among them, the order of execution of step a1 and step a2 is in no particular order.
进一步地,基于上述第一实施例,提出本申请车辆的控制方法的第四实施例。在本实施例中,步骤“根据所述行驶数据控制所述车辆行驶至所述库位目的点”包括:Further, based on the above-mentioned first embodiment, a fourth embodiment of the vehicle control method of the present application is proposed. In this embodiment, the step of "controlling the vehicle to travel to the destination point of the storage location according to the driving data" includes:
步骤a3,控制所述车辆以所述行驶数据中的第一旋转角度进行旋转操作,得到姿态转变后的车辆;Step a3, controlling the vehicle to perform a rotation operation at the first rotation angle in the driving data to obtain a vehicle with a posture transition;
步骤a4,控制所述姿态转变后的车辆根据所述行驶数据中的移动距离行驶至所述库位目的点。Step a4, controlling the vehicle after the posture transition to drive to the destination point of the storage location according to the moving distance in the driving data.
在本实施例中,在获取到行驶数据之后,其中,行驶数据包括第一旋转角度和移动距离,可先控制车辆以行驶数据中的第一旋转角度进行旋转操作,得到姿态转变后的车辆,然后控制姿态转变后的车辆根据行驶数据中的移动距离行驶至库位目的点。In this embodiment, after the driving data is acquired, where the driving data includes a first rotation angle and a moving distance, the vehicle can be controlled to perform a rotation operation at the first rotation angle in the driving data to obtain a vehicle with a posture transition. Then, the vehicle after the control attitude transition is driven to the destination point of the storage location according to the moving distance in the driving data.
进一步地,为实现对车辆的高精度控制,在旋转和移动过程中,可基于PID(proportion-integral-differential,比例-积分-微分)闭环控制***来控制车辆的旋转和移动。具体的,步骤a3包括:Further, in order to achieve high-precision control of the vehicle, during the rotation and movement process, the rotation and movement of the vehicle can be controlled based on a PID (proportion-integral-differential, proportional-integral-differential) closed-loop control system. Specifically, step a3 includes:
步骤a31,在旋转过程中,实时获取地面标识线的直线方程,记为第二直线方程;Step a31, during the rotation process, obtain the straight line equation of the ground marking line in real time, and record it as the second straight line equation;
步骤a32,根据所述第二直线方程对应的斜率和比例-积分-导数PID算法实时计算PID旋转控制量,并根据所述PID旋转控制量控制所述车辆进行旋转操作,直至达到所述行驶数据中的第一旋转角度;Step a32: Calculate the PID rotation control amount in real time according to the slope corresponding to the second linear equation and the proportional-integral-derivative PID algorithm, and control the vehicle to perform a rotation operation according to the PID rotation control amount until the driving data is reached The first angle of rotation in;
在本实施例中,在旋转过程中,实时获取地面标识线的直线方程,记为第二直线方程,其中,第二直线方程的获取方式与第一直线方程的获取方式相一致,可参照上述实施例,此处不作赘述。第二直线方程即为图4中的直线l1在旋转过程中实时对应的直线方程。然后,根据第二直线方程对应的斜率和比例-积分-导数PID算法实时计算PID旋转控制量,并根据PID旋转控制量控制车辆进行旋转操作,直至达到行驶数据中的第一旋转角度。其中,PID算法是一种闭环控制算法,闭环控制是根据控制对象输出反馈来进行校正的控制方式,它是在测量出实际与计划发生偏差时,按定额或标准来进行纠正的。PID是比例(Proportion)、积分(Integral)、微分(Differential)的缩写,分别代表了三种控制算法。通过这三个算法的组合可有效地纠正被控制对象的偏差,从而使其达到一个稳定的状态。In this embodiment, during the rotation process, the straight line equation of the ground marking line is obtained in real time, which is recorded as the second straight line equation. The method of obtaining the second straight line equation is consistent with that of the first straight line equation. You can refer to The above-mentioned embodiments will not be repeated here. The second straight line equation is the straight line equation corresponding to the straight line l1 in FIG. 4 in real time during the rotation process. Then, according to the slope corresponding to the second straight line equation and the proportional-integral-derivative PID algorithm, the PID rotation control amount is calculated in real time, and the vehicle is controlled to rotate according to the PID rotation control amount until the first rotation angle in the driving data is reached. Among them, PID algorithm is a closed-loop control algorithm. Closed-loop control is a control method that corrects according to the output feedback of the control object. It corrects according to the quota or standard when the deviation between the actual and the plan is measured. PID is the abbreviation of Proportion, Integral, and Differential, which respectively represent three control algorithms. The combination of these three algorithms can effectively correct the deviation of the controlled object so that it can reach a stable state.
对应的,步骤a4包括:Correspondingly, step a4 includes:
步骤a41,在移动过程中,获取地面标识线的交叉点与所述姿态转变后的车辆之间的实时距离;Step a41, in the process of moving, obtain the real-time distance between the intersection of the ground marking line and the vehicle after the posture transition;
步骤a42,根据所述实时距离和所述PID算法实时计算PID移动控制量,并根据所述PID移动控制量控制所述姿态转变后的车辆进行移动,直至达到所述行驶数据中的移动距离、行驶至所述库位目的点。Step a42: Calculate the PID movement control amount in real time according to the real-time distance and the PID algorithm, and control the vehicle after the attitude transition to move according to the PID movement control amount until the movement distance in the driving data is reached, Drive to the destination point of the storage location.
对应的,在移动过程中,也可以基于PID算法进行控制。具体的,在移动过程中,获取地面标识线的交叉点与姿态转变后的车辆之间的实时距离;其中,地面标识线的交叉点的获取方法可参照上述第二实施例。在获取到该实时距离之后,根据实时距离和PID算法实时计算PID移动控制量,并根据PID移动控制量控制姿态转变后的车辆进行移动,直至达到行驶数据中的移动距离、行驶至库位目的点。Correspondingly, during the movement, it can also be controlled based on the PID algorithm. Specifically, during the movement, the real-time distance between the intersection of the ground marking line and the vehicle after the posture transition is obtained; wherein, the method for obtaining the intersection of the ground marking line can refer to the second embodiment described above. After obtaining the real-time distance, calculate the PID movement control amount in real time according to the real-time distance and PID algorithm, and control the movement of the vehicle after the attitude transition according to the PID movement control amount, until the movement distance in the driving data is reached and the purpose of driving to the storage location is reached. point.
通过上述方式,采用PID算法来实时计算PID旋转控制量和PID移动控制量,可以实现车辆(如叉车)在环境不够理想、影响因素不完全确定等复杂条件下的实时高精度控制,尤其适合在狭小作业空间以及需要频繁转向和精确定位的环境内,完成旋转和移动等操作,可进一步控制车辆更准确地停靠在库位目的点坐标上。Through the above method, the PID algorithm is used to calculate the PID rotation control quantity and the PID movement control quantity in real time, which can realize the real-time high-precision control of vehicles (such as forklifts) under complex conditions such as unsatisfactory environment and incomplete influencing factors. In a small working space and an environment that requires frequent steering and precise positioning, the completion of operations such as rotation and movement can further control the vehicle to park on the coordinates of the destination point of the storage location more accurately.
进一步地,基于上述第一实施例,提出本申请车辆的控制方法的第五实施例。在本实施例中,步骤“基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程”包括:Further, based on the above-mentioned first embodiment, a fifth embodiment of the vehicle control method of the present application is proposed. In this embodiment, the step of "acquiring a ground image based on the camera device installed on the body of the vehicle, and obtaining a straight line equation of the ground identification line according to the ground image" includes:
步骤b1,基于所述车辆的车体上安装的摄像装置获取地面图像,并识别所述地面图像中与地面标识线对应的各目标元素的质心位置;Step b1, acquiring a ground image based on the camera device installed on the body of the vehicle, and identifying the centroid position of each target element corresponding to the ground marking line in the ground image;
步骤b2,根据所述各目标元素的质心位置,确定各目标元素对应的目标数据坐标,并根据所述目标数据坐标生成地面标识线的直线方程。Step b2: Determine the target data coordinates corresponding to each target element according to the centroid position of each target element, and generate a straight line equation of the ground marking line according to the target data coordinates.
在本实施例中,地面标识线的直线方程的获取过程如下:In this embodiment, the process of obtaining the straight line equation of the ground marking line is as follows:
先基于车辆的车体上安装的摄像装置获取地面图像,并识别地面图像中与地面目标线对应的各目标元素的质心位置。具体的,先从地面图像中提取出各目标元素(可以选取黑色菱块作为地面图像中的目标元素);然后获取各目标元素的初始轮廓,进而调用OpenCV(开源计算机视觉库)中用于计算质心位置的预设函数,将各目标元素的初始轮廓传输到该预设函数中,经过该预设函数的处理,输出坐标值,该坐标值即为各目标元素的在地面图像中的质心坐标。调用预先设定的半径数值,以质心坐标作为为圆心设定与各个目标元素对应的圆形区域,该圆形区域即为目标元素在地面图像中的质心位置。First, the ground image is acquired based on the camera device installed on the body of the vehicle, and the centroid position of each target element corresponding to the ground target line in the ground image is identified. Specifically, first extract each target element from the ground image (black diamond blocks can be selected as the target element in the ground image); then obtain the initial contour of each target element, and then call OpenCV (open source computer vision library) for calculation The preset function of the center of mass position transmits the initial contour of each target element to the preset function. After the preset function is processed, the coordinate value is output. The coordinate value is the center of mass coordinate of each target element in the ground image. . Call the preset radius value, and set the circular area corresponding to each target element with the center of mass coordinate as the center of the circle. The circular area is the position of the center of mass of the target element in the ground image.
在识别出各目标元素的质心位置之后,结合立体相机的安装参数对表征质心位置的质心坐标进行极坐标转换,得到各目标元素的深度数据坐标,以依据深度数据坐标拟合生成地面标识线的直线方程。具体的,将作为目标元素质心位置的圆形区域作为预设范围区间,各目标元素的深度数据坐标均以该预设范围区间为基础,查找与其前后左右相邻的点。每当找到前后或者左右有点的时候,将三个点去除保存到一个数组中,作为各深度数据坐标的目标坐标数据。在各深度数据坐标均查找到目标坐标数据后,然后对目标坐标数据进行坐标系转化,由于该目标坐标数据是以摄像装置所在位置作为坐标原点建立的,为便于后面的计算处理,可将目标坐标数据转换为以车辆的车后轮中心为坐标原点构建的二维直角坐标系中对应的坐标数据,进而采用最小二乘法将各经坐标系转换后的目标坐标数据生成为直线方程,该直线方程即为地面图像中地面标识线对应的直线方程。After identifying the centroid position of each target element, combine the installation parameters of the stereo camera to perform polar coordinate conversion on the centroid coordinates representing the centroid position to obtain the depth data coordinates of each target element, which can be fitted to generate the ground marking line according to the depth data coordinates. Linear equation. Specifically, the circular area as the center of mass of the target element is used as the preset range interval, and the depth data coordinates of each target element are all based on the preset range interval to find points adjacent to it. Whenever the front and back or left and right points are found, the three points are removed and saved in an array as the target coordinate data of each depth data coordinate. After finding the target coordinate data for each depth data coordinate, the target coordinate data is then transformed into the coordinate system. Since the target coordinate data is established with the location of the camera as the coordinate origin, for the convenience of subsequent calculation processing, the target The coordinate data is converted into the corresponding coordinate data in the two-dimensional rectangular coordinate system constructed with the center of the rear wheel of the vehicle as the coordinate origin, and then the least square method is used to generate the target coordinate data after the coordinate system conversion into a straight line equation. The equation is the straight line equation corresponding to the ground marking line in the ground image.
通过上述方式,可实现基于车辆的车体上安装的摄像装置获取地面图像,然后基于地面图像获取到地面标识线对应的直线方程,可便于后面基于该直线方程确定相对位置信息和形式数据,从而通过视觉辅助定位的方式,实现快速的高精度目的点定位功能。Through the above method, the ground image can be acquired based on the camera device installed on the vehicle body, and then the linear equation corresponding to the ground marking line can be acquired based on the ground image, which can facilitate the subsequent determination of relative position information and formal data based on the linear equation, thereby Through the way of visual aided positioning, it realizes the function of fast and high-precision target point positioning.
进一步地,基于上述各实施例,提出本申请车辆的控制方法的第六实施例。参照图6,在本实施例中,在步骤S30之后,该车辆的控制方法还包括:Further, based on the foregoing embodiments, a sixth embodiment of the vehicle control method of the present application is proposed. Referring to Fig. 6, in this embodiment, after step S30, the vehicle control method further includes:
步骤S40,在所述车辆行驶至所述库位目的点之后,获取地面标识线的直线方程,记为第三直线方程;Step S40, after the vehicle has traveled to the destination point of the storage location, obtain the straight line equation of the ground marking line, which is recorded as the third straight line equation;
步骤S50,根据所述第三直线方程计算得到第二旋转角度,并控制所述车辆以所述第二旋转角度进行旋转操作。In step S50, a second rotation angle is calculated according to the third straight line equation, and the vehicle is controlled to perform a rotation operation at the second rotation angle.
在本实施例中,在控制车辆行驶至库位目的点之后,再次获取地面标识线的直线方程,记为第三直线方程,第三直线方程的获取方式与第一直线方程的获取方式相一致,可参照上述实施例,此处不作赘述。其中,如图7(A)所示,第三直线方程即为地面标识线l1对应的直线方程。In this embodiment, after the vehicle is controlled to travel to the destination point of the storage location, the straight line equation of the ground marking line is obtained again, which is recorded as the third straight line equation. The third straight line equation is obtained in the same manner as the first straight line equation. Consistent, please refer to the above-mentioned embodiment, which will not be repeated here. Among them, as shown in Figure 7(A), the third straight line equation is the straight line equation corresponding to the ground marking line l1.
然后,根据第三直线方程计算得到第二旋转角度,具体的,参照上述第二实施例,以车辆(如SLAM叉车)的当前车后轮中心为坐标原点,以车辆的叉臂指向的反方向为y轴方向正方向,以y轴右侧方向为x轴正方向,构建二维直角坐标系,根据第三直线方程的斜率,计算该第三直线方程对应的地面标识线与y轴之间的夹角,即为第二旋转角度。在计算得到第二旋转角度之后,控制车辆以第二旋转角度进行旋转操作,以控制车辆与第三直线方程对应的地面标识线平行。具体的,例如图7,将车辆如图7(A)所示的姿态旋转至如图7(B)所示的姿态。Then, the second rotation angle is calculated according to the third straight line equation. Specifically, referring to the above-mentioned second embodiment, the center of the current rear wheel of the vehicle (such as a SLAM forklift) is used as the coordinate origin, and the fork arm of the vehicle is pointed in the opposite direction It is the positive direction of the y-axis, and the right side of the y-axis is the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system. According to the slope of the third straight-line equation, calculate the distance between the ground marking line and the y-axis corresponding to the third straight-line equation The included angle is the second rotation angle. After the second rotation angle is calculated, the vehicle is controlled to perform a rotation operation at the second rotation angle to control the vehicle to be parallel to the ground marking line corresponding to the third straight line equation. Specifically, for example, in FIG. 7, the posture of the vehicle as shown in FIG. 7(A) is rotated to the posture as shown in FIG. 7(B).
需要说明的是,在控制车辆以第二旋转角度进行旋转操作时,可采用PID闭环控制***来控制车辆的旋转,以控制车辆以更准确的姿态停靠在库位目的点坐标上,具体的执行过程与上述实施例相似,此处不作赘述。It should be noted that when controlling the vehicle to perform a rotation operation at the second rotation angle, the PID closed-loop control system can be used to control the rotation of the vehicle, so as to control the vehicle to park on the coordinates of the destination point of the storage location with a more accurate posture. The specific implementation The process is similar to the foregoing embodiment, and will not be repeated here.
此外,在控制车辆旋转到平行位置后,还可以基于PID闭环控制***控制车辆在库位目的点附近进行微小抖动调整,以更准确停靠在库位目的点坐标上,进一步提高库位目的点的定位精度。In addition, after controlling the vehicle to rotate to a parallel position, the PID closed-loop control system can also control the vehicle to make minor jitter adjustments near the destination point of the storage location, so as to park at the destination point coordinates of the storage location more accurately, and further improve the destination point of the storage location. positioning accuracy.
通过上述方式,可在车辆行驶至库位目的点之后,通过获取地面标识线的直线方程(第三直线方程),以确定第二旋转角度,进而根据第二旋转角度控制车辆旋转到平行位置,从而便于下一步进行叉取或堆放货物等操作。Through the above method, after the vehicle reaches the destination point of the storage location, the straight line equation (third straight line equation) of the ground marking line can be obtained to determine the second rotation angle, and then control the vehicle to rotate to the parallel position according to the second rotation angle. This facilitates operations such as fork picking or stacking of goods in the next step.
本申请还提供一种计算机可读存储介质,该计算机可读存储介质上存储有车辆的控制程序,所述车辆的控制程序被处理器执行时实现如以上任一项实施例所述的车辆的控制方法的步骤。The present application also provides a computer-readable storage medium that stores a control program of a vehicle on the computer-readable storage medium. When the control program of the vehicle is executed by a processor, the control program of the vehicle as described in any of the above embodiments is realized. Steps of the control method.
本申请计算机可读存储介质的具体实施例与上述车辆的控制方法各实施例基本相同,在此不作赘述。The specific embodiments of the computer-readable storage medium of the present application are basically the same as the above-mentioned embodiments of the vehicle control method, and will not be repeated here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者***不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者***所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者***中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, It also includes other elements not explicitly listed, or elements inherent to the process, method, article, or system. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above implementation manners, those skilled in the art can clearly understand that the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disks, optical disks), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of the application, and do not limit the scope of the patent for this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of the application, or directly or indirectly applied to other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (15)

  1. 一种车辆的控制方法,其中,所述车辆的控制方法包括以下步骤:A vehicle control method, wherein the vehicle control method includes the following steps:
    在检测到车辆到达导航目的点时,基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程,记为第一直线方程;When it is detected that the vehicle reaches the navigation destination point, the ground image is acquired based on the camera device installed on the body of the vehicle, and the linear equation of the ground identification line is acquired according to the ground image, which is recorded as the first linear equation;
    根据所述第一直线方程和预设库位口偏移距离,确定所述车辆的当前位姿与库位目的点之间的相对位置信息;Determine the relative position information between the current pose of the vehicle and the destination point of the storage location according to the first straight line equation and the preset storage location opening offset distance;
    基于所述相对位置信息计算得到所述车辆到达所述库位目的点所对应的行驶数据,并根据所述行驶数据控制所述车辆行驶至所述库位目的点。The driving data corresponding to the vehicle reaching the destination point of the storage location is calculated based on the relative position information, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
  2. 如权利要求1所述的车辆的控制方法,其中,所述相对位置信息包括库位目的点的第一坐标,所述根据所述第一直线方程和预设库位口偏移距离,确定所述车辆的当前位姿与库位目的点之间的相对位置信息的步骤包括:The vehicle control method according to claim 1, wherein the relative position information includes the first coordinates of the destination point of the storage location, and the determination is made according to the first linear equation and the preset storage location offset distance The steps of the relative position information between the current pose of the vehicle and the destination point of the storage location include:
    以所述车辆的当前位置为坐标原点,以所述车辆的叉臂指向的反方向为y轴正方向,以y轴右侧方向为x轴正方向,构建二维直角坐标系;Taking the current position of the vehicle as the origin of coordinates, the opposite direction of the fork arm of the vehicle as the positive direction of the y-axis, and the right direction of the y-axis as the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system;
    基于所述第一直线方程,计算地面标识线之间的交叉点在所述二维直角坐标系中的交叉点坐标,并计算所述车辆的姿态角度;Based on the first straight line equation, calculating the intersection coordinates of the intersection between the ground marking lines in the two-dimensional rectangular coordinate system, and calculating the posture angle of the vehicle;
    根据所述交叉点坐标、所述车辆的姿态角度、预设库位口偏移距离,确定所述库位目的点在所述二维直角坐标系中的坐标,记为所述库位目的点的第一坐标。Determine the coordinates of the destination point of the storage location in the two-dimensional rectangular coordinate system according to the coordinates of the intersection, the attitude angle of the vehicle, and the preset offset distance of the storage location, and record it as the destination point of the storage location The first coordinate.
  3. 如权利要求2所述的车辆的控制方法,其中,所述行驶数据包括第一旋转角度和移动距离,所述基于所述相对位置信息计算得到所述车辆到达所述库位目的点所对应的行驶数据的步骤包括:The method for controlling a vehicle according to claim 2, wherein the driving data includes a first rotation angle and a moving distance, and the calculation based on the relative position information obtains the corresponding value for the vehicle to reach the destination point of the storage location The steps of driving data include:
    计算所述库位目的点的第一坐标与所述坐标原点所构成直线的斜率,根据所述斜率计算得到所述车辆到达所述库位目的点所对应的第一旋转角度;Calculating the slope of the straight line formed by the first coordinates of the destination point of the storage location and the origin of the coordinates, and calculating the first rotation angle corresponding to the vehicle reaching the destination point of the storage location according to the slope;
    计算所述库位目的点的第一坐标与所述坐标原点之间的距离,得到所述车辆到达所述库位目的点所对应的移动距离。The distance between the first coordinate of the destination point of the storage location and the origin of the coordinates is calculated, and the movement distance corresponding to the vehicle reaching the destination point of the storage location is obtained.
  4. 如权利要求1所述的车辆的控制方法,其中,所述根据所述行驶数据控制所述车辆行驶至所述库位目的点的步骤包括:The method for controlling a vehicle according to claim 1, wherein the step of controlling the vehicle to travel to the destination point of the storage location according to the travel data comprises:
    控制所述车辆以所述行驶数据中的第一旋转角度进行旋转操作,得到姿态转变后的车辆;Controlling the vehicle to perform a rotation operation at the first rotation angle in the driving data to obtain a vehicle with a posture transition;
    控制所述姿态转变后的车辆根据所述行驶数据中的移动距离行驶至所述库位目的点。The vehicle after the posture transition is controlled to travel to the destination point of the storage location according to the moving distance in the travel data.
  5. 如权利要求4所述的车辆的控制方法,其中,所述控制所述车辆以所述行驶数据中的第一旋转角度进行旋转操作的步骤包括:5. The vehicle control method according to claim 4, wherein the step of controlling the vehicle to perform a rotation operation at the first rotation angle in the travel data comprises:
    在旋转过程中,实时获取地面标识线的直线方程,记为第二直线方程;During the rotation, the straight line equation of the ground marking line is obtained in real time, and it is recorded as the second straight line equation;
    根据所述第二直线方程对应的斜率和比例-积分-导数PID算法实时计算PID旋转控制量,并根据所述PID旋转控制量控制所述车辆进行旋转操作,直至达到所述行驶数据中的第一旋转角度;According to the slope corresponding to the second linear equation and the proportional-integral-derivative PID algorithm, the PID rotation control amount is calculated in real time, and the vehicle is controlled to perform the rotation operation according to the PID rotation control amount until the first in the driving data is reached. A rotation angle;
    所述控制所述姿态转变后的车辆根据所述行驶数据中的移动距离行驶至所述库位目的点的步骤包括:The step of controlling the vehicle after the posture transition to travel to the destination point of the storage location according to the moving distance in the travel data includes:
    在移动过程中,获取地面标识线的交叉点与所述姿态转变后的车辆之间的实时距离;During the movement, acquiring the real-time distance between the intersection of the ground marking line and the vehicle after the posture transition;
    根据所述实时距离和所述PID算法实时计算PID移动控制量,并根据所述PID移动控制量控制所述姿态转变后的车辆进行移动,直至达到所述行驶数据中的移动距离、行驶至所述库位目的点。The PID movement control quantity is calculated in real time according to the real-time distance and the PID algorithm, and the vehicle after the attitude transition is controlled to move according to the PID movement control quantity until the movement distance in the driving data is reached and the vehicle travels to the desired position. Describe the destination of the location.
  6. 如权利要求1所述的车辆的控制方法,其中,所述基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程的步骤包括:The vehicle control method according to claim 1, wherein the step of acquiring a ground image based on a camera device installed on the body of the vehicle, and acquiring a straight line equation of a ground marking line according to the ground image comprises:
    基于所述车辆的车体上安装的摄像装置获取地面图像,并识别所述地面图像中与地面标识线对应的各目标元素的质心位置;Acquiring a ground image based on a camera device installed on the body of the vehicle, and identifying the centroid position of each target element corresponding to the ground identification line in the ground image;
    根据所述各目标元素的质心位置,确定各目标元素对应的目标数据坐标,并根据所述目标数据坐标生成地面标识线的直线方程。According to the centroid position of each target element, the target data coordinates corresponding to each target element are determined, and the straight line equation of the ground marking line is generated according to the target data coordinates.
  7. 如权利要求1所述的车辆的控制方法,其中,所述根据所述行驶数据控制所述车辆行驶至所述库位目的点的步骤之后,所述车辆的控制方法还包括:5. The vehicle control method according to claim 1, wherein after the step of controlling the vehicle to travel to the destination point of the storage location according to the travel data, the vehicle control method further comprises:
    在所述车辆行驶至所述库位目的点之后,获取地面标识线的直线方程,记为第三直线方程;After the vehicle travels to the destination point of the storage location, the straight line equation of the ground marking line is obtained, which is recorded as the third straight line equation;
    根据所述第三直线方程计算得到第二旋转角度,并控制所述车辆以所述第二旋转角度进行旋转操作。A second rotation angle is calculated according to the third straight line equation, and the vehicle is controlled to perform a rotation operation at the second rotation angle.
  8. 如权利要求1所述的车辆的控制方法,其中,所述在检测到车辆到达导航目的点时,基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程,记为第一直线方程的步骤之前,所述车辆的控制方法还包括:The method for controlling a vehicle according to claim 1, wherein when detecting that the vehicle reaches the navigation destination point, the ground image is acquired based on the camera device installed on the vehicle body of the vehicle, and the ground image is acquired based on the ground image. Before the step of marking the straight line equation of the marking line as the first straight line equation, the control method of the vehicle further includes:
    获取所述库位目的点在预设即时定位与地图构建SLAM地图中的坐标,根据所述库位目的点的坐标确定与所述库位目的点对应的导航目的点的坐标;Obtain the coordinates of the destination point of the storage location in the preset real-time positioning and map construction SLAM map, and determine the coordinates of the navigation destination point corresponding to the destination point of the storage location according to the coordinates of the destination point of the storage location;
    基于所述导航目的点的坐标和所述预设SLAM地图,控制所述车辆行驶至所述导航目的点。Based on the coordinates of the navigation destination point and the preset SLAM map, control the vehicle to travel to the navigation destination point.
  9. 一种车辆的控制装置,其中,所述车辆的控制装置包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的车辆的控制程序,所述车辆的控制程序被所述处理器执行时实现如下步骤:A vehicle control device, wherein the vehicle control device includes a memory, a processor, and a vehicle control program stored in the memory and running on the processor, and the vehicle control program is When the processor executes, the following steps are implemented:
    在检测到车辆到达导航目的点时,基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程,记为第一直线方程;When it is detected that the vehicle reaches the navigation destination point, the ground image is acquired based on the camera device installed on the body of the vehicle, and the linear equation of the ground identification line is acquired according to the ground image, which is recorded as the first linear equation;
    根据所述第一直线方程和预设库位口偏移距离,确定所述车辆的当前位姿与库位目的点之间的相对位置信息;Determine the relative position information between the current pose of the vehicle and the destination point of the storage location according to the first straight line equation and the preset storage location opening offset distance;
    基于所述相对位置信息计算得到所述车辆到达所述库位目的点所对应的行驶数据,并根据所述行驶数据控制所述车辆行驶至所述库位目的点。The driving data corresponding to the vehicle reaching the destination point of the storage location is calculated based on the relative position information, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
  10. 如权利要求9所述的车辆的控制装置,其中,所述相对位置信息包括库位目的点的第一坐标,所述计算机可读指令被所述处理器执行时还实现如下步骤:The vehicle control device according to claim 9, wherein the relative position information includes the first coordinates of the destination point of the storage location, and the computer-readable instructions further implement the following steps when executed by the processor:
    以所述车辆的当前位置为坐标原点,以所述车辆的叉臂指向的反方向为y轴正方向,以y轴右侧方向为x轴正方向,构建二维直角坐标系;Taking the current position of the vehicle as the origin of coordinates, the opposite direction of the fork arm of the vehicle as the positive direction of the y-axis, and the right direction of the y-axis as the positive direction of the x-axis to construct a two-dimensional rectangular coordinate system;
    基于所述第一直线方程,计算地面标识线之间的交叉点在所述二维直角坐标系中的交叉点坐标,并计算所述车辆的姿态角度;Based on the first straight line equation, calculating the intersection coordinates of the intersection between the ground marking lines in the two-dimensional rectangular coordinate system, and calculating the posture angle of the vehicle;
    根据所述交叉点坐标、所述车辆的姿态角度、预设库位口偏移距离,确定所述库位目的点在所述二维直角坐标系中的坐标,记为所述库位目的点的第一坐标。Determine the coordinates of the destination point of the storage location in the two-dimensional rectangular coordinate system according to the coordinates of the intersection, the attitude angle of the vehicle, and the preset offset distance of the storage location, and record it as the destination point of the storage location The first coordinate.
  11. 如权利要求10所述的车辆的控制装置,其中,所述行驶数据包括第一旋转角度和移动距离,所述计算机可读指令被所述处理器执行时还实现如下步骤:The vehicle control device according to claim 10, wherein the driving data includes a first rotation angle and a moving distance, and the computer-readable instructions further implement the following steps when executed by the processor:
    计算所述库位目的点的第一坐标与所述坐标原点所构成直线的斜率,根据所述斜率计算得到所述车辆到达所述库位目的点所对应的第一旋转角度;Calculating the slope of the straight line formed by the first coordinates of the destination point of the storage location and the origin of the coordinates, and calculating the first rotation angle corresponding to the vehicle reaching the destination point of the storage location according to the slope;
    计算所述库位目的点的第一坐标与所述坐标原点之间的距离,得到所述车辆到达所述库位目的点所对应的移动距离。The distance between the first coordinate of the destination point of the storage location and the origin of the coordinates is calculated, and the movement distance corresponding to the vehicle reaching the destination point of the storage location is obtained.
  12. 如权利要求9所述的车辆的控制装置,其中,所述计算机可读指令被所述处理器执行时还实现如下步骤:The vehicle control device according to claim 9, wherein the following steps are further implemented when the computer-readable instructions are executed by the processor:
    控制所述车辆以所述行驶数据中的第一旋转角度进行旋转操作,得到姿态转变后的车辆;Controlling the vehicle to perform a rotation operation at the first rotation angle in the driving data to obtain a vehicle with a posture transition;
    控制所述姿态转变后的车辆根据所述行驶数据中的移动距离行驶至所述库位目的点。The vehicle after the posture transition is controlled to travel to the destination point of the storage location according to the moving distance in the travel data.
  13. 如权利要求12所述的车辆的控制装置,其中,所述计算机可读指令被所述处理器执行时还实现如下步骤:The vehicle control device according to claim 12, wherein the following steps are further implemented when the computer-readable instructions are executed by the processor:
    在旋转过程中,实时获取地面标识线的直线方程,记为第二直线方程;During the rotation, the straight line equation of the ground marking line is obtained in real time, and it is recorded as the second straight line equation;
    根据所述第二直线方程对应的斜率和比例-积分-导数PID算法实时计算PID旋转控制量,并根据所述PID旋转控制量控制所述车辆进行旋转操作,直至达到所述行驶数据中的第一旋转角度;According to the slope corresponding to the second linear equation and the proportional-integral-derivative PID algorithm, the PID rotation control amount is calculated in real time, and the vehicle is controlled to perform the rotation operation according to the PID rotation control amount until the first in the driving data is reached. A rotation angle;
    所述控制所述姿态转变后的车辆根据所述行驶数据中的移动距离行驶至所述库位目的点的步骤包括:The step of controlling the vehicle after the posture transition to travel to the destination point of the storage location according to the moving distance in the travel data includes:
    在移动过程中,获取地面标识线的交叉点与所述姿态转变后的车辆之间的实时距离;During the movement, acquiring the real-time distance between the intersection of the ground marking line and the vehicle after the posture transition;
    根据所述实时距离和所述PID算法实时计算PID移动控制量,并根据所述PID移动控制量控制所述姿态转变后的车辆进行移动,直至达到所述行驶数据中的移动距离、行驶至所述库位目的点。The PID movement control quantity is calculated in real time according to the real-time distance and the PID algorithm, and the vehicle after the attitude transition is controlled to move according to the PID movement control quantity until the movement distance in the driving data is reached and the vehicle travels to the desired position. Describe the destination of the location.
  14. 如权利要求9所述的车辆的控制装置,其中,所述计算机可读指令被所述处理器执行时还实现如下步骤:The vehicle control device according to claim 9, wherein the following steps are further implemented when the computer-readable instructions are executed by the processor:
    基于所述车辆的车体上安装的摄像装置获取地面图像,并识别所述地面图像中与地面标识线对应的各目标元素的质心位置;Acquiring a ground image based on a camera device installed on the body of the vehicle, and identifying the centroid position of each target element corresponding to the ground identification line in the ground image;
    根据所述各目标元素的质心位置,确定各目标元素对应的目标数据坐标,并根据所述目标数据坐标生成地面标识线的直线方程。According to the centroid position of each target element, the target data coordinates corresponding to each target element are determined, and the straight line equation of the ground marking line is generated according to the target data coordinates.
  15. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有车辆的控制程序,所述车辆的控制程序被处理器执行时实现如下步骤:A computer-readable storage medium, wherein a vehicle control program is stored on the computer-readable storage medium, and the following steps are implemented when the vehicle control program is executed by a processor:
    在检测到车辆到达导航目的点时,基于所述车辆的车体上安装的摄像装置获取地面图像,并根据所述地面图像获取地面标识线的直线方程,记为第一直线方程;When it is detected that the vehicle reaches the navigation destination point, the ground image is acquired based on the camera device installed on the body of the vehicle, and the linear equation of the ground identification line is acquired according to the ground image, which is recorded as the first linear equation;
    根据所述第一直线方程和预设库位口偏移距离,确定所述车辆的当前位姿与库位目的点之间的相对位置信息;Determine the relative position information between the current pose of the vehicle and the destination point of the storage location according to the first straight line equation and the preset storage location opening offset distance;
    基于所述相对位置信息计算得到所述车辆到达所述库位目的点所对应的行驶数据,并根据所述行驶数据控制所述车辆行驶至所述库位目的点。The driving data corresponding to the vehicle reaching the destination point of the storage location is calculated based on the relative position information, and the vehicle is controlled to travel to the destination point of the storage location according to the driving data.
PCT/CN2020/111456 2019-11-12 2020-08-26 Vehicle control method and device, and computer readable storage medium WO2021093410A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911103400.4A CN110789529B (en) 2019-11-12 2019-11-12 Vehicle control method, device and computer-readable storage medium
CN201911103400.4 2019-11-12

Publications (1)

Publication Number Publication Date
WO2021093410A1 true WO2021093410A1 (en) 2021-05-20

Family

ID=69444287

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/111456 WO2021093410A1 (en) 2019-11-12 2020-08-26 Vehicle control method and device, and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN110789529B (en)
WO (1) WO2021093410A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110789529B (en) * 2019-11-12 2020-12-08 深圳创维数字技术有限公司 Vehicle control method, device and computer-readable storage medium
CN113119975B (en) * 2021-04-29 2023-03-24 东风汽车集团股份有限公司 Distance identification display method, device and equipment and readable storage medium
CN113256713B (en) * 2021-06-10 2021-10-15 浙江华睿科技股份有限公司 Pallet position identification method and device, electronic equipment and storage medium
CN113370236B (en) * 2021-07-07 2024-03-01 深圳海外装饰工程有限公司 Reticle robot, system thereof, reticle control method, and storage medium
CN114323020B (en) * 2021-12-06 2024-02-06 纵目科技(上海)股份有限公司 Vehicle positioning method, system, equipment and computer readable storage medium
CN114265414A (en) * 2021-12-30 2022-04-01 深圳创维数字技术有限公司 Vehicle control method, device, equipment and computer readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3333048A1 (en) * 2016-12-12 2018-06-13 Valeo Schalter und Sensoren GmbH Method for autonomous manoeuvring of a motor vehicle on a parking lot using marking elements, driver assistance system, motor vehicle, infrastructure facility and communication system
US20180283878A1 (en) * 2013-04-16 2018-10-04 Apple Inc. Seamless Transition from Outdoor to Indoor Mapping
CN110231041A (en) * 2018-03-06 2019-09-13 北京京东尚科信息技术有限公司 A kind of air navigation aid and device of lane switching
CN110307850A (en) * 2019-08-02 2019-10-08 湖南海迅自动化技术有限公司 Reckoning localization method and automated parking system
CN110361011A (en) * 2019-08-27 2019-10-22 国以贤智能科技(上海)有限公司 Method, apparatus, equipment and the storage medium of vision guided navigation
CN110789529A (en) * 2019-11-12 2020-02-14 深圳创维数字技术有限公司 Vehicle control method, device and computer-readable storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103076007B (en) * 2012-12-28 2016-01-20 苏州苏迪智能***有限公司 Lateral parking detection system and detection method thereof
CN103950448B (en) * 2014-04-21 2016-06-29 中国科学院深圳先进技术研究院 Park track guidance method and system, park orbit generation method and system
CN107305386A (en) * 2016-04-22 2017-10-31 王锦海 A kind of intelligent optical guidance system
CN105946853B (en) * 2016-04-28 2018-05-29 中山大学 The system and method for long range automatic parking based on Multi-sensor Fusion
JP2019133445A (en) * 2018-01-31 2019-08-08 株式会社デンソーテン Section line detection device, section line detection system, and section line detection method
CN109598972B (en) * 2018-11-23 2021-11-19 中汽研(天津)汽车工程研究院有限公司 Automatic parking space detection and distance measurement system based on vision

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180283878A1 (en) * 2013-04-16 2018-10-04 Apple Inc. Seamless Transition from Outdoor to Indoor Mapping
EP3333048A1 (en) * 2016-12-12 2018-06-13 Valeo Schalter und Sensoren GmbH Method for autonomous manoeuvring of a motor vehicle on a parking lot using marking elements, driver assistance system, motor vehicle, infrastructure facility and communication system
CN110231041A (en) * 2018-03-06 2019-09-13 北京京东尚科信息技术有限公司 A kind of air navigation aid and device of lane switching
CN110307850A (en) * 2019-08-02 2019-10-08 湖南海迅自动化技术有限公司 Reckoning localization method and automated parking system
CN110361011A (en) * 2019-08-27 2019-10-22 国以贤智能科技(上海)有限公司 Method, apparatus, equipment and the storage medium of vision guided navigation
CN110789529A (en) * 2019-11-12 2020-02-14 深圳创维数字技术有限公司 Vehicle control method, device and computer-readable storage medium

Also Published As

Publication number Publication date
CN110789529A (en) 2020-02-14
CN110789529B (en) 2020-12-08

Similar Documents

Publication Publication Date Title
WO2021093410A1 (en) Vehicle control method and device, and computer readable storage medium
CN110796063B (en) Method, device, equipment, storage medium and vehicle for detecting parking space
JP6816830B2 (en) A position estimation system and a mobile body equipped with the position estimation system.
JP6825712B2 (en) Mobiles, position estimators, and computer programs
CN110969655A (en) Method, device, equipment, storage medium and vehicle for detecting parking space
CN110837814A (en) Vehicle navigation method, device and computer readable storage medium
WO2022000197A1 (en) Flight operation method, unmanned aerial vehicle, and storage medium
CN109144068A (en) The automatically controlled mode and control device of three-dimensional shift-forward type navigation switching AGV fork truck
CN110956327B (en) Multi-robot automatic parking method, medium, terminal and device
JPWO2019187816A1 (en) Mobiles and mobile systems
JP7111424B2 (en) Mobile object, position estimation device, and computer program
WO2021093413A1 (en) Method for acquiring attitude adjustment parameters of transportation device, transportation device and storage medium
CN114714357A (en) Sorting and carrying method, sorting and carrying robot and storage medium
CN112947479B (en) Intelligent storage-oriented omnidirectional heavy-load AGV motion control method and system
CN114442054A (en) Sensor and chassis combined calibration system and method for mobile robot
CN115993089B (en) PL-ICP-based online four-steering-wheel AGV internal and external parameter calibration method
CN114296458B (en) Vehicle control method, device and computer readable storage medium
JP2018013860A (en) Autonomous movable object control device
CN108445893A (en) A kind of Movement Controller of Mobile Robot and mobile robot
JP6642026B2 (en) Autonomous mobile control device
JP2019067001A (en) Moving body
CN114283193A (en) Pallet three-dimensional visual positioning method and system
CN113048978A (en) Mobile robot repositioning method and mobile robot
JP2021056764A (en) Movable body
WO2024014194A1 (en) Route setting method, program, and route setting system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20886411

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20886411

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 31/10/2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20886411

Country of ref document: EP

Kind code of ref document: A1