CN111873744A - Active suspension pre-aiming control method based on camera sensor road surface information identification - Google Patents
Active suspension pre-aiming control method based on camera sensor road surface information identification Download PDFInfo
- Publication number
- CN111873744A CN111873744A CN202010677973.4A CN202010677973A CN111873744A CN 111873744 A CN111873744 A CN 111873744A CN 202010677973 A CN202010677973 A CN 202010677973A CN 111873744 A CN111873744 A CN 111873744A
- Authority
- CN
- China
- Prior art keywords
- road surface
- camera sensor
- rgb
- active suspension
- aiming
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60G—VEHICLE SUSPENSION ARRANGEMENTS
- B60G17/00—Resilient suspensions having means for adjusting the spring or vibration-damper characteristics, for regulating the distance between a supporting surface and a sprung part of vehicle or for locking suspension during use to meet varying vehicular or surface conditions, e.g. due to speed or load
- B60G17/015—Resilient suspensions having means for adjusting the spring or vibration-damper characteristics, for regulating the distance between a supporting surface and a sprung part of vehicle or for locking suspension during use to meet varying vehicular or surface conditions, e.g. due to speed or load the regulating means comprising electric or electronic elements
- B60G17/019—Resilient suspensions having means for adjusting the spring or vibration-damper characteristics, for regulating the distance between a supporting surface and a sprung part of vehicle or for locking suspension during use to meet varying vehicular or surface conditions, e.g. due to speed or load the regulating means comprising electric or electronic elements characterised by the type of sensor or the arrangement thereof
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60G—VEHICLE SUSPENSION ARRANGEMENTS
- B60G2401/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60G2401/14—Photo or light sensitive means, e.g. Infrared
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T90/00—Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Vehicle Body Suspensions (AREA)
Abstract
The invention discloses an active suspension pre-aiming control method based on camera sensor road surface identification, which comprises the following steps: acquiring the pre-aiming information of the front road surface through a camera sensor; carrying out data processing on the pre-aiming information of the front road surface to obtain an unevenness value of the front road surface, and determining the grade of the unevenness of the road surface according to an unevenness dividing criterion; receiving a front road surface unevenness grade instruction, and establishing an active suspension model based on front road surface preview information; design of active suspension H with multiple performance index constraints∞An optimal controller; obtaining H using a multi-objective constrained optimization algorithm∞And optimizing the weight value in the controller to realize the performance balance of various performance indexes of the suspension. The invention utilizes the camera sensor to acquire the road surface preview information in combination with H∞Optimal control is achieved, the time lag phenomenon in the process of adjusting the damping parameters of the active suspension is improved, and multi-performance index balance control of the active suspension is achieved.
Description
Technical Field
The invention relates to parameter control of an active suspension, in particular to a pre-aiming control method of the active suspension based on camera sensor road surface identification.
Background
When the vehicle runs, the excitation provided by the uneven road surface may cause the vehicle to bump, so that the vehicle generates vertical vibration, and the smoothness and comfort of the vehicle are affected. In order to improve the ride comfort of the vehicle, it is necessary to provide a new method for improving the suspension performance. With the continuous development of machine vision, the traditional 2D camera sensor has been gradually transformed into a 3D camera sensor, which can not only represent two-dimensional plane information but also represent three-dimensional stereo coordinate information in the photographed image, such as: kinect, ZED 2KStereo Camera, and Bumble Bee, among others. If the stereoscopic vision sensor can be applied to road surface unevenness detection, pre-aiming information is provided for suspension control, and the suspension is preset with parameters to complete the vibration reduction function, so that the suspension performance is greatly improved.
The road heading information may allow the vehicle suspension to adjust to the most appropriate setting before receiving the road excitation input. For example, when the camera sensor scans a concave-convex road surface, the suspension controller is adjusted to be in a soft damping state in advance to absorb road surface excitation so as to reduce vehicle body vibration and improve comfort, and is timely switched to be in a hard damping state after passing through the concave-convex road surface so as to inhibit subsequent oscillation of a vehicle body.
The existing research of active suspension control through preview information only stays at the theoretical level of wheelbase preview control. In the document [ Madau D P, Khaykin B l. continuous variable semi-active suspension system using centrally located road surface rate and accelerometer sensors: US 2003 ], road surface information fed back from a front axle is applied to the adjustment of a rear axle suspension according to a travel time difference between the front axle and the rear axle. This method is generally time-lag and only works after the front wheels of the vehicle have run for a period of time on the road, but the driver has experienced vibrations from the undulations. In the literature [ study on a laser radar-based road unevenness reconstruction method ] road height information in front of a vehicle is obtained by a laser radar, but the method is not generally implemented due to the cost and computational complexity of the laser radar.
Therefore, the active suspension pre-aiming control method based on camera sensor road surface identification is designed and developed, not only can the road surface pre-aiming information be accurately obtained, the time lag phenomenon in the active suspension control process is improved, but also the implementation cost of the method is reduced due to the use of the low-cost camera sensor.
Disclosure of Invention
Aiming at the technical problems, the invention provides an active suspension pre-aiming control method based on camera sensor road surface identification, which can realize road surface information identification at low cost and is easy to realize active suspension pre-aiming control.
Acquiring road surface pre-aiming information according to a Kinect camera sensor, calculating road surface unevenness, adding the unevenness information into a suspension system model, and establishing a suspension system dynamic model based on the vehicle front pre-aiming control; secondly, a suspension controller is designed to realize optimization of multiple performance indexes of a suspension model, improve a time lag phenomenon in a suspension parameter adjusting process and reduce adverse effects caused by road excitation.
In order to realize the functions, the invention adopts the technical scheme that:
an active suspension pre-aiming control method based on camera sensor road surface identification comprises the following steps:
acquiring front road surface preview information through a camera sensor;
secondly, performing data processing on the front road surface preview information to obtain a front road surface unevenness value, and determining a road surface unevenness grade according to an unevenness dividing criterion;
step three, receiving the front road surface unevenness grade instruction determined in the step two, and establishing an active suspension model based on front road surface preview information;
step four, designing an active suspension H with multiple performance index constraints∞An optimal controller;
step five, obtaining H by using a multi-objective constraint optimization algorithm∞And optimizing the weight value in the controller to realize the performance balance of various performance indexes of the suspension.
Further, in the first step, before the front road surface preview information is collected, the camera sensor is calibrated and calibrated first, so that the accuracy of the collected road surface information is ensured.
Further, in the second step, the data processing of the forward road preview information includes the following processes:
performing noise reduction processing on an image acquired by a camera sensor by adopting a bilateral filter algorithm;
using an image splicing algorithm based on features to reconstruct a scene, and reducing overlapped contents in the same scene in the front and back continuous frame images: detecting key feature points of two RGB images of adjacent road parts by an SURF algorithm; then matching the feature points between the images by using a k-nearest neighbor algorithm, and removing abnormal values by using a RANSAC algorithm; and finally, estimating a homography transformation matrix between the two images according to the matched feature points, and splicing the continuous frame images by using homography transformation to obtain a new fusion image.
Further, according to claim 1, in the second step, after the image processing, the method for active suspension pre-aiming control based on the camera sensor road surface recognition is performed, the calculation of the IRI value is performed on the pre-aiming information of the front road surface collected by the camera sensor, so as to obtain the value of the front road surface unevenness, and the road surface unevenness grade is determined according to a preset formula, which includes the following steps:
transferring the depth data output by the camera sensor depth camera to an RGB image;
acquiring an aligned RGB image (3D point cloud data containing a longitudinal contour of a road surface), importing the RGB image into ProVAL software, and selecting a semi-vehicle model to calculate an IRI value;
determining the grade value alpha of the road surface unevenness according to the grade division rule in the international standard ISO 8608r。
Further, the transferring the depth data output by the camera sensor depth camera to the RGB image comprises the following steps:
firstly, the depth data acquired by the camera sensor is converted from image coordinates to world coordinates, and the calculation process is as follows:
ZIR=ZD
in the formula (X)IR,YIR,ZIR) World coordinates of three-dimensional points on the camera sensor; (u)D,vD) Pixel coordinates of the depth image;is the distortion center coordinate of the camera sensor plane;is the focal length of the sensor portion of the IR camera; zDRepresenting depth values, obtained by a camera sensor; intrinsic parameters of remaining camera sensorsObtaining through camera sensor calibration;
then, converting the depth coordinate information of the camera sensor into RGB image coordinates, wherein a calculation formula is as follows;
wherein (X)RGB,YRGB,ZRGB) World coordinates relative to the RGB camera sensor; (X)IR,YIR,ZIR) World coordinates relative to the IR camera sensor; the rotation matrix R and the translation matrix t are external parameters obtained through calibration and estimation of a camera sensor;
finally, the world coordinate (X) is determined according toRGB,YRGB,ZRGB) Pixel coordinates (u) mapped to RBG imageRGB,vRGB) The above step (1);
wherein the content of the first and second substances,are all intrinsic parameters of the RGB camera sensor obtained by camera sensor calibration.
Further, the step three of establishing the active suspension model based on the front road aiming information comprises the following processes:
the front suspension and the rear suspension adopt Newton's second law to obtain a suspension model dynamic equation as follows:
wherein M is the sprung mass of the vehicle body, I is the moment of inertia of the vehicle body relative to the center of mass, and Mf、mrFor unsprung masses, x, of the front and rear wheelssIs the absolute displacement of the vehicle body, xf、xrRespectively, the unsprung mass displacement of the front and rear wheels, theta is the pitch angle, ksf、ksrFor the rigidity of the front and rear suspensions, cf、crIntrinsic damping coefficient, k, of front and rear suspensions, respectivelytf、ktrStiffness of front and rear tires, uf、urIs according to H∞Controlling the damping force generated by the strategy, wherein a and b are respectively the front and rear wheelbases, and L is the pre-aiming distance;
wherein w (t) is the front wheel input; w (t-tau) is the rear wheel input; τ ═ (a + b)/v is the time delay between the front and rear wheels;
control input is U ═ Uf,ur]T;
Rewriting the system equation into the form of a state equation:
X=AX+BU+D1w(t)+D2w(t-τ)
further, the step four designs the active suspension H with multiple performance index constraints∞The optimal controller comprises the following processes:
considering system control targets as system sprung mass vertical acceleration, system pitch angle acceleration, front and rear suspension dynamic travel and front and rear wheel tire deformation, determining a system performance objective function as follows:
in the formula, T is control cycle time;J3=E[(zs+aθ-zf)2];J4=E[(zs-bθ-zr)2];J5=E[(zf-hf)2];J6=E[(zr-hr)2]; is according to H∞Optimally controlling the generated suspension damping force;
the above formula is rewritten as follows:
in the formula, the performance index is restricted; q ═ Cyu TCyuIs a symmetric semi-positive definite matrix; f ═ Dyu TDyu、N=Cyu TDyuIs a positive definite matrix; cyu=Cyu1Cyu2;
Using H∞Control, assume that the measurement vector ψ is:
ψ=Cmx+ξ
wherein, CmA conversion matrix of state and measurement is adopted, and xi is a measurement error;
to minimize the performance indicator function, the system control input U is solved for:
in the formula (I), the compound is shown in the specification,for the best estimation vector of the system state, r (t) is a vector containing the preview information, including the pre-axial and wheelbase preview information, and the formula is as follows:
in the formula, tpIs the preview time; ca、CbControlling gain for feedback and feedforward; wherein, Ca=F-1(NT+BTS);Ca=-F- 1NT(ii) a S is a steady state solution obtained by the Riccati equation:
S(A-BF-1NT)+(A-BF-1NT)TS-S(BF-1BT--2DDT)S+(Q-NF-1NT)=0
wherein L is H∞Gain vector of optimal controller: l ═ PCm TR-1(ii) a R is a positive definite matrix of measurement errors; p is the covariance matrix of the estimation error:
the invention has the following beneficial effects:
1) a Kinect camera sensor with low cost is selected as a pavement information acquisition sensor, so that the development cost of the method is reduced while the acquisition precision is ensured, and the method is easy to realize;
2) the method comprises the steps that front road information is used as input of pre-aiming control, an active suspension pre-aiming control model based on the front road information is established, road interference can be prevented in advance, and a suspension system is adjusted to the most appropriate control parameters in advance before a vehicle inputs road excitation response;
3) designing H constrained by multiple performance indicators∞The predictive controller generates a feedforward term using the front road surface information on the basis of feedback control to form more effective control input.
Drawings
Fig. 1 is a flow chart of an active suspension pre-aiming control method based on camera sensor road surface recognition.
Fig. 2 is a schematic view of a camera sensor mounting position.
Fig. 3 is an active suspension semi-vehicle model.
Fig. 4 is a vehicle body acceleration transfer characteristic curve.
Fig. 5 is a tire dynamic deformation transfer characteristic curve.
Fig. 6 is a process diagram of the present invention.
Detailed Description
The invention is described in further detail below with reference to the following figures and examples:
examples
The time lag phenomenon existing in the control process of the traditional vehicle active suspension is considered, and the wheelbase preview scheme and the H are combined∞The predictive control method provides an active suspension pre-aiming control method based on camera sensor road surface identification, which identifies front road surface information to enable a vehicle suspension system to carry out pre-aiming control before an axle with parameter adjustment aiming at unknown road interference in advance, and comprises the following steps as shown in figure 1:
the method comprises the following steps of firstly, acquiring the preview information of the front road surface through a camera sensor:
1.1) calibrating and calibrating a camera sensor before information acquisition:
the camera sensor selects a Kinect V2 depth camera, and the internal and external calibration parameters are determined by a CameraCalibration Toolbox calibration tool box in MATLAB.
The camera sensor probably has the error in the installation, needs to carry out camera calibration, guarantees accurate collection road surface information, for this reason, compares the data of camera sensor collection with the true height in ground, calibrates the data accuracy of camera sensor collection, eliminates the camera because the installation is not hard up the error that appears, and its concrete step is as follows: .
Firstly, mounting a Kinect camera to the height of 600-1300 mm from the ground, acquiring 10 depth images at the interval of 100mm, and randomly extracting 2000 points from each image to calculate the measurement height between the camera and the ground by taking the average value;
then, determining the real height between the camera sensor and the ground by using a laser range finder, and fitting by using a least square method to obtain the relation between the real height value and the Kinect camera measurement value:
Zgt=1.0016Zm+5.5122
in the formula, ZgtIndicating the true value, Z, obtained by the laser rangefindermRepresenting the depth value directly measured by Kinect;
1.2) set up the road surface information acquisition system, carry out the road surface of the place ahead and aim at information acquisition:
the road surface information acquisition system comprises a Kinect V2 camera sensor and a GPS sensor, wherein the Kinect V2 camera sensor is connected into a vehicle industrial personal computer through a special PCI-E USB card, and the GPS sensor is used for recording real-time vehicle speed information and creating timestamps on acquired images in sequence. In order to manage different programs and enable data acquisition software to be easy to operate, an independent data acquisition process is integrated through a LabVIEW virtual environment, wherein the data acquisition software of Kinect is written by C + +, an OpenNI library is used for simultaneously recording RGB data streams and depth data streams, the resolution ratio is 640 multiplied by 480 pixels, the frame rate is 30fps, and GPS data acquisition software is developed by C/C + + and Garmin Software Development Kit (SDK).
Step two, carrying out data processing on the front road surface information to obtain a front road surface unevenness value, and determining the road surface unevenness grade according to a preset formula:
2.1) carrying out image processing on the front road surface data collected by the camera sensor:
2.1.1) the original color difference image collected by the camera sensor contains a plurality of noise points which can affect the accuracy of depth data and need to be subjected to noise reduction treatment, therefore, a bilateral filter algorithm which can not only keep the edge information of the image but also achieve the smooth noise reduction effect is selected to carry out noise reduction treatment on the image;
2.1.1) during the camera sensor collection process, about 30% of overlapping content appears in the front and back continuous frame images, and the image mosaic algorithm based on the characteristics is used for scene reconstruction, so that the overlapping content in the same scene is reduced, the depth data processing speed is increased, and the implementation steps are as follows:
firstly, detecting key feature points of two RGB images of adjacent road parts by an SURF algorithm; then matching the feature points between the images by using a k-nearest neighbor algorithm, and removing abnormal values by using a RANSAC algorithm; finally, according to the matched feature points, a homography transformation matrix between the two images is estimated, and the continuous frame images are spliced by using homography transformation to obtain a new fusion image;
2.2) calculating the front road surface unevenness value, and determining the road surface unevenness grade according to a preset formula:
after image processing is carried out on front pavement data acquired by a camera sensor, IRI (international flatness index) value calculation is carried out, which requires that RGB camera output and depth camera output of a Kinect camera sensor are spatially aligned, so that in order to correctly combine the RGB image and the depth data, the depth data are transferred to the RGB image by the method, and the method comprises the following steps;
firstly, converting depth data acquired by a Kinect camera sensor from image coordinates into world coordinates, wherein the calculation process is as follows:
ZIR=ZD
in the formula (X)IR,YIR,ZIR) World coordinates of three-dimensional points on the Kinect camera sensor, (u)D,vD) Is the pixel coordinates of the depth image,is the distorted center coordinates of the camera sensor plane,is the focal length of the sensor portion of the IR camera. ZDRepresenting depth values obtained by the Kinect camera sensor, intrinsic parameters of the remaining camera sensorsObtaining through camera sensor calibration;
then, converting the depth coordinate information of the camera sensor into RGB image coordinates, wherein a calculation formula is as follows;
wherein (X)RGB,YRGB,ZRGB) (X) world coordinates relative to the RGB Camera sensorIR,YIR,ZIR) The rotation matrix R and the translation matrix t are extrinsic parameters estimated by Kinect camera sensor calibration for world coordinates relative to the IR camera sensor.
Finally, the world coordinate (X) is determined according toRGB,YRGB,ZRGB) Pixel coordinates (u) mapped to RBG imageRGB,vRGB) The above step (1);
wherein the content of the first and second substances,all are intrinsic parameters of the RGB camera sensor obtained by calibrating the camera sensor;
in conclusion, 3D point cloud data of the longitudinal profile of the road surface on the aligned RGB images are obtained, ProVAL software is introduced, a semi-vehicle model is selected to calculate an IRI value, and the road surface unevenness grade value alpha is determined according to the grade division rule in the international standard ISO 8608r;
In this example, the ground identification information is output: alpha is alphar=2rad/m,σ2=3×10-4m2;
Step three, receiving the front road surface unevenness grade instruction determined in the step two, and establishing an active suspension model based on the front road surface preview information:
firstly, as shown in fig. 3, a suspension model dynamic equation obtained by applying newton's second law to front and rear suspensions is as follows:
wherein M is the sprung mass of the vehicle body, I is the moment of inertia of the vehicle body relative to the center of mass, and Mf、mrFor unsprung masses, x, of the front and rear wheelssIs the absolute displacement of the vehicle body, xf、xrRespectively, the unsprung mass displacement of the front and rear wheels, theta is the pitch angle, ksf、ksrFor the rigidity of the front and rear suspensions, cf、crIntrinsic damping coefficient, k, of front and rear suspensions, respectivelytf、ktrStiffness of front and rear tires, uf、urIs according to H∞Controlling the damping force generated by the strategy, wherein a and b are respectively the front and rear wheelbases, and L is the pre-aiming distance;
the state variables that define the suspension system are:the disturbance is input as Wherein w (t) is a front wheel; road surface input, w (t- τ) is rear wheel input, τ ═ a + b/v is the time delay between the front and rear wheels; control input is U ═ Uf,ur]T;
Rewriting the system equation into the form of a state equation:
X=AX+BU+D1w(t)+D2w(t-τ)
In summary, the road surface information-based front axle pre-aiming control only needs to input road surface unevenness information equivalent to a virtual front axle, input an actual front axle equivalent to a virtual rear axle, form new inter-axle pre-aiming control by the virtual front axle and measure the front road surface unevenness information input by the virtual front axle to control the action of the front suspension.
Step four, designing an active suspension H with multiple performance index constraints∞An optimal controller:
considering the system control targets as system sprung mass vertical acceleration, system pitch angle acceleration, front and rear suspension dynamic travel and front and rear wheel tire deformation, the system performance objective function can be determined as follows:
in the formula, T is control cycle time;J3=E[(zs+aθ-zf)2];J4=E[(zs-bθ-zr)2];J5=E[(zf-hf)2];J6=E[(zr-hr)2]; is according to H∞Optimally controlling the generated suspension damping force;
the above formula is further rewritten as follows:
wherein, for performance index constraint, Q ═ Cyu TCyuIs a symmetric semi-positive definite matrix, F ═ Dyu TDyu、N=Cyu TDyuIs a positive definite matrix, Cyu=Cyu1Cyu2;
Using H∞Control, assuming a measurement vector psi of:
ψ=Cmx+ξ
Wherein, CmA conversion matrix of state and measurement is adopted, and xi is a measurement error;
it is believed that the relative displacement and velocity between the sprung and unsprung masses can be H∞Optimal controller estimation, in order to minimize the performance indicator function, the system control input U is solved:
in the formula (I), the compound is shown in the specification,for the best estimation vector of the system state, r (t) is a vector containing the preview information, including the pre-axial and wheelbase preview information, and the formula is as follows:
in the formula, tpFor preview time, Ca、CbControlling gain for feedback and feedforward; wherein C isa=F-1(NT+BTS);Ca=-F- 1NT(ii) a S is a steady state solution obtained by the Riccati equation:
S(A-BF-1NT)+(A-BF-1NT)TS-S(BF-1BT--2DDT)S+(Q-NF-1NT)=0
wherein L is H∞Gain vector of optimal controller: l ═ PCm TR-1R is a positive definite matrix of measurement errors; p is the covariance matrix of the estimation error:
step five, obtaining H by using a multi-objective constraint optimization algorithm∞Weighting parameters p in an optimal controller1,ρ2,…,ρ8And the weight value is used for realizing the performance balance of various performance indexes (namely the mass acceleration of the spring, the pitching acceleration, the dynamic stroke of the front and rear suspensions, the adhesion force with reasonable damping force under different vehicle speeds and running speeds) of the suspension.
In this example, the vehicle parameters are selected as follows: the total mass of the vehicle body is as follows: m is 1200 kg; the unsprung masses of the front and rear suspensions are respectively: m isf=75kg,mr80 kg; moment of inertia: i is 1800kg m2(ii) a Front and rear spring linear stiffness: k is a radical ofsf=30kN/m,ksr30 kN/m; inherent damping coefficient of front and rear wheel suspensions: c. Cf=400Ns/m,cr450 Ns/m; front and rear tire elastic stiffness: k is a radical oftf=300kN/m,ktr300 kN/m; the wheelbase front and rear: a is 1.011m, b is 1.803 m;
in this example, the fixed constants of the weight parameters ρ are selected in accordance with the spring mass acceleration, the pitch acceleration and the R value1=1,ρ2=1,R=10-3Obtaining the optimized value as follows: rho3=31.623,ρ4=98.958,ρ5=5551.6,ρ6=1224.1,ρ7=1.64×10-6,ρ8=2.11×10-8;
FIG. 4 is a vehicle acceleration transfer characteristic curve predicted by the pre-aiming control of the front road information; fig. 5 is a tire dynamic deformation transfer characteristic curve.
As can be seen from fig. 4 and 5, the active suspension pre-aiming control method based on the camera sensor road surface information recognition provided by the invention has an obvious improvement effect compared with the conventional suspension control method. Road surface pre-aiming identification is realized through a Kinect camera sensor, and road surface identification information and an active suspension H are combined∞The optimal controller is organically combined, so that the vehicle faces to an unknown road surfaceSuspension parameters are adjusted in advance with a low amplitude during interference, so that a time lag phenomenon in the parameter adjusting process is avoided, and meanwhile, the Kinect camera sensor with low cost is easy to implement.
Claims (7)
1. An active suspension pre-aiming control method based on camera sensor road surface identification is characterized by comprising the following steps:
acquiring front road surface preview information through a camera sensor;
secondly, performing data processing on the front road surface preview information to obtain a front road surface unevenness value, and determining a road surface unevenness grade according to an unevenness dividing criterion;
step three, receiving the front road surface unevenness grade instruction determined in the step two, and establishing an active suspension model based on front road surface preview information;
step four, designing an active suspension H with multiple performance index constraints∞An optimal controller;
step five, obtaining H by using a multi-objective constraint optimization algorithm∞And optimizing the weight value in the controller to realize the performance balance of multiple suspension performance indexes.
2. The active suspension pre-aiming control method based on the camera sensor road surface recognition is characterized in that in the first step, before the collection of the front road surface pre-aiming information, the camera sensor is calibrated and calibrated to ensure the accuracy of the collected road surface information.
3. The active suspension pre-aiming control method based on the camera sensor road surface recognition is characterized in that in the second step, the data processing of the front road surface pre-aiming information comprises the following processes:
performing noise reduction processing on an image acquired by a camera sensor by adopting a bilateral filter algorithm;
using an image splicing algorithm based on features to reconstruct a scene, and reducing overlapped contents in the same scene in the front and back continuous frame images: detecting key feature points of two RGB images of adjacent road parts by an SURF algorithm; then matching the feature points between the images by using a k-nearest neighbor algorithm, and removing abnormal values by using a RANSAC algorithm; and finally, estimating a homography transformation matrix between the two images according to the matched feature points, and splicing the continuous frame images by using homography transformation to obtain a new fusion image.
4. The active suspension pre-aiming control method based on camera sensor road surface recognition as claimed in claim 1, wherein in the second step, the calculation of the IRI value is performed after the image processing of the pre-aiming information of the front road surface collected by the camera sensor, so as to obtain the front road surface unevenness value, and the road surface unevenness grade is determined according to a preset formula, including the following processes:
transferring the depth data output by the camera sensor depth camera to an RGB image;
acquiring an aligned RGB image, importing the aligned RGB image into ProVAL software, and selecting a half car model to calculate an IRI value;
determining the grade value alpha of the road surface unevenness according to the grade division rule in the international standard ISO 8608r。
5. The active suspension pre-aiming control method based on camera sensor pavement recognition is characterized in that the step of transferring the depth data output by the camera sensor depth camera to an RGB image comprises the following steps:
firstly, the depth data acquired by the camera sensor is converted from image coordinates to world coordinates, and the calculation process is as follows:
ZIR=ZD
in the formula (X)IR,YIR,ZIR) World coordinates of three-dimensional points on the camera sensor; (u)D,vD) Pixel coordinates of the depth image;is the distortion center coordinate of the camera sensor plane;is the focal length of the sensor portion of the IR camera; zDRepresenting depth values, obtained by a camera sensor; intrinsic parameters of remaining camera sensorsObtaining through camera sensor calibration;
then, converting the depth coordinate information of the camera sensor into RGB image coordinates, wherein a calculation formula is as follows;
wherein (X)RGB,YRGB,ZRGB) World coordinates relative to the RGB camera sensor; (X)IR,YIR,ZIR) World coordinates relative to the IR camera sensor; the rotation matrix R and the translation matrix t are external parameters obtained through calibration and estimation of a camera sensor;
finally, the world coordinate (X) is determined according toRGB,YRGB,ZRGB) Pixel coordinates (u) mapped to RBG imageRGB,vRGB) The above step (1);
6. The active suspension pre-aiming control method based on the camera sensor road surface recognition is characterized in that the step three of establishing an active suspension model based on the front road surface pre-aiming information comprises the following processes:
the front suspension and the rear suspension adopt Newton's second law to obtain a suspension model dynamic equation as follows:
wherein M is the sprung mass of the vehicle body, I is the moment of inertia of the vehicle body relative to the center of mass, and Mf、mrFor unsprung masses, x, of the front and rear wheelssIs the absolute displacement of the vehicle body, xf、xrRespectively, the unsprung mass displacement of the front and rear wheels, theta is the pitch angle, ksf、ksrFor the rigidity of the front and rear suspensions, cf、crIntrinsic damping coefficient, k, of front and rear suspensions, respectivelytf、ktrStiffness of front and rear tires, uf、urIs according to H∞Controlling the damping force generated by the strategy, wherein a and b are respectively the front and rear wheelbases, and L is the pre-aiming distance;
wherein w (t) is the front wheel input; w (t-tau) is the rear wheel input; τ ═ (a + b)/v is the time delay between the front and rear wheels;
control input is U ═ Uf,ur]T;
Rewriting the system equation into the form of a state equation:
X=AX+BU+D1w(t)+D2w(t-τ)
7. the active suspension pre-aiming control method based on camera sensor road surface recognition is characterized in that the step four is used for designing an active suspension H with multiple performance index constraints∞The optimal controller comprises the following processes:
considering system control targets as system sprung mass vertical acceleration, system pitch angle acceleration, front and rear suspension dynamic travel and front and rear wheel tire deformation, determining a system performance objective function as follows:
in the formula, T is control cycle time;J3=E[(zs+aθ-zf)2];J4=E[(zs-bθ-zr)2];J5=E[(zf-hf)2];J6=E[(zr-hr)2]; is according to H∞Optimally controlling the generated suspension damping force;
the above formula is rewritten as follows:
in the formula, the performance index is restricted; q ═ Cyu TCyuIs a symmetric semi-positive definite matrix; f ═ Dyu TDyu、N=Cyu TDyuIs a positive definite matrix; cyu=Cyu1Cyu2;
According to H∞Control law, assuming that the measurement vector ψ is:
ψ=Cmx+ξ
wherein, CmA conversion matrix of state and measurement is adopted, and xi is a measurement error;
to minimize the performance indicator function, the system control input U is solved for:
in the formula (I), the compound is shown in the specification,for the best estimation vector of the system state, r (t) is a vector containing the preview information, including the pre-axial and wheelbase preview information, and the formula is as follows:
in the formula, tpIs the preview time; ca、CbControlling gain for feedback and feedforward; wherein, Ca=F-1(NT+BTS);Ca=-F-1NT(ii) a S is a steady state solution obtained by the Riccati equation:
S(A-BF-1NT)+(A-BF-1NT)TS-S(BF-1BT--2DDT)S+(Q-NF-1NT)=0
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010677973.4A CN111873744B (en) | 2020-07-15 | 2020-07-15 | Active suspension pre-aiming control method based on camera sensor road surface information identification |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010677973.4A CN111873744B (en) | 2020-07-15 | 2020-07-15 | Active suspension pre-aiming control method based on camera sensor road surface information identification |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111873744A true CN111873744A (en) | 2020-11-03 |
CN111873744B CN111873744B (en) | 2023-03-28 |
Family
ID=73151629
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010677973.4A Active CN111873744B (en) | 2020-07-15 | 2020-07-15 | Active suspension pre-aiming control method based on camera sensor road surface information identification |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111873744B (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112606649A (en) * | 2020-12-08 | 2021-04-06 | 东风汽车集团有限公司 | Vehicle and vehicle body balance control method and control system thereof |
CN113147308A (en) * | 2021-03-30 | 2021-07-23 | 浙江工业大学 | Suspension pre-aiming control method based on binocular vision technology and suspension control device |
CN113183709A (en) * | 2021-06-04 | 2021-07-30 | 合肥工业大学 | Automobile electric control suspension pre-aiming control method |
CN113352832A (en) * | 2021-07-06 | 2021-09-07 | 南昌大学 | Multi-target dynamic optimal active suspension control method based on pavement grade recognition |
CN113739717A (en) * | 2021-08-20 | 2021-12-03 | 中国工程物理研究院激光聚变研究中心 | Line laser sensor pose calibration method in on-machine measurement system |
CN114332828A (en) * | 2022-03-17 | 2022-04-12 | 北京中科慧眼科技有限公司 | Method and system for adjusting working mode of suspension damper based on binocular stereo camera |
CN115284809A (en) * | 2022-10-09 | 2022-11-04 | 江西科技学院 | Intelligent internet fleet active suspension control method and system and computer equipment |
Citations (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5090728A (en) * | 1990-02-14 | 1992-02-25 | Toyota Jidosha Kabushiki Kaisha | Apparatus for controlling damping force of shock absorber |
JP2007302111A (en) * | 2006-05-11 | 2007-11-22 | Honda Motor Co Ltd | Suspension control device |
JP2010195323A (en) * | 2009-02-26 | 2010-09-09 | Nissan Motor Co Ltd | Vehicular state estimating device, vehicular state estimating method, vehicular suspension control device, and automobile |
WO2012028228A2 (en) * | 2010-09-03 | 2012-03-08 | Daimler Ag | Device and method for controlling an active chassis of a vehicle |
DE102013207147A1 (en) * | 2012-05-03 | 2013-11-07 | Ifm Electronic Gmbh | Road surface profile detecting system for motor car, has time-of-flight cameras which detect road surface profile and determine distance and dimension of irregularities in overlapping monitored areas of cameras |
US20140195112A1 (en) * | 2013-01-08 | 2014-07-10 | Ford Global Technologies, Llc | Adaptive Active Suspension System With Road Preview |
CN104220317A (en) * | 2012-03-29 | 2014-12-17 | 丰田自动车株式会社 | Road surface state estimation apparatus |
CN104541128A (en) * | 2012-08-02 | 2015-04-22 | 丰田自动车株式会社 | Road surface condition acquisition device and suspension system |
US20150352920A1 (en) * | 2014-04-04 | 2015-12-10 | Ford Global Technologies, Llc | Suspension system using optically recorded information, vehicles including suspension systems, and methods of using suspension systems |
CN205112911U (en) * | 2015-10-13 | 2016-03-30 | 湖北航天技术研究院特种车辆技术中心 | Take aim at formula initiative suspension in advance based on oil/gas spring |
CN106183691A (en) * | 2016-09-21 | 2016-12-07 | 吉林大学 | One takes aim at formula Active suspension and control method thereof in advance |
CN106647256A (en) * | 2016-10-08 | 2017-05-10 | 西南交通大学 | H-infinite PID-based active suspension rack control system and control method |
US20170151850A1 (en) * | 2015-12-01 | 2017-06-01 | Honda Research Institute Europe Gmbh | Predictive suspension control for a vehicle using a stereo camera sensor |
US20170213336A1 (en) * | 2014-07-31 | 2017-07-27 | Continental Automotive France | Method for controlling the suspension of a vehicle by processing images from at least one on-board camera |
CN107168279A (en) * | 2017-05-11 | 2017-09-15 | 浙江工业大学 | Based on H∞Control method of active suspension system of vehicle with preview control |
WO2018155541A1 (en) * | 2017-02-24 | 2018-08-30 | 日立オートモティブシステムズ株式会社 | Vehicle behavior control device |
CN108944328A (en) * | 2018-04-04 | 2018-12-07 | 燕山大学 | A kind of Vehicle Active Suspension control method that single line laser radar Longitudinal is taken aim in advance |
CN109591537A (en) * | 2019-01-25 | 2019-04-09 | 成都西汽研车辆技术开发有限公司 | A kind of automotive semi-active suspension control system and method |
CN110143108A (en) * | 2019-03-26 | 2019-08-20 | 江西科技学院 | Automotive suspension semi-active control method and system |
CN110154666A (en) * | 2019-04-28 | 2019-08-23 | 西安理工大学 | A kind of vehicle suspension system of achievable road condition predicting is adaptively counter to push away control method |
US20190344634A1 (en) * | 2018-05-08 | 2019-11-14 | Hyundai Motor Company | Electronically controlled suspension control system of vehicle using road surface information and control method using the same |
CN110588272A (en) * | 2019-09-23 | 2019-12-20 | 无锡职业技术学院 | Automobile suspension system based on visual sensing technology and road surface unevenness measuring method |
CN110789287A (en) * | 2019-10-08 | 2020-02-14 | 江苏科技大学 | Adjustable additional air chamber air suspension system based on three-dimensional optical scanning and self-adaptive control method thereof |
CN110877509A (en) * | 2019-12-11 | 2020-03-13 | 西安科技大学 | Active suspension vision pre-aiming control method based on improved fruit fly algorithm |
CN111273547A (en) * | 2020-02-05 | 2020-06-12 | 哈尔滨工业大学 | Unmanned vehicle comfort control method integrating vehicle speed planning and pre-aiming semi-active suspension |
-
2020
- 2020-07-15 CN CN202010677973.4A patent/CN111873744B/en active Active
Patent Citations (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5090728A (en) * | 1990-02-14 | 1992-02-25 | Toyota Jidosha Kabushiki Kaisha | Apparatus for controlling damping force of shock absorber |
JP2007302111A (en) * | 2006-05-11 | 2007-11-22 | Honda Motor Co Ltd | Suspension control device |
JP2010195323A (en) * | 2009-02-26 | 2010-09-09 | Nissan Motor Co Ltd | Vehicular state estimating device, vehicular state estimating method, vehicular suspension control device, and automobile |
WO2012028228A2 (en) * | 2010-09-03 | 2012-03-08 | Daimler Ag | Device and method for controlling an active chassis of a vehicle |
CN104220317A (en) * | 2012-03-29 | 2014-12-17 | 丰田自动车株式会社 | Road surface state estimation apparatus |
DE102013207147A1 (en) * | 2012-05-03 | 2013-11-07 | Ifm Electronic Gmbh | Road surface profile detecting system for motor car, has time-of-flight cameras which detect road surface profile and determine distance and dimension of irregularities in overlapping monitored areas of cameras |
CN104541128A (en) * | 2012-08-02 | 2015-04-22 | 丰田自动车株式会社 | Road surface condition acquisition device and suspension system |
US20140195112A1 (en) * | 2013-01-08 | 2014-07-10 | Ford Global Technologies, Llc | Adaptive Active Suspension System With Road Preview |
US20150352920A1 (en) * | 2014-04-04 | 2015-12-10 | Ford Global Technologies, Llc | Suspension system using optically recorded information, vehicles including suspension systems, and methods of using suspension systems |
US20170213336A1 (en) * | 2014-07-31 | 2017-07-27 | Continental Automotive France | Method for controlling the suspension of a vehicle by processing images from at least one on-board camera |
CN205112911U (en) * | 2015-10-13 | 2016-03-30 | 湖北航天技术研究院特种车辆技术中心 | Take aim at formula initiative suspension in advance based on oil/gas spring |
US20170151850A1 (en) * | 2015-12-01 | 2017-06-01 | Honda Research Institute Europe Gmbh | Predictive suspension control for a vehicle using a stereo camera sensor |
CN106183691A (en) * | 2016-09-21 | 2016-12-07 | 吉林大学 | One takes aim at formula Active suspension and control method thereof in advance |
CN106647256A (en) * | 2016-10-08 | 2017-05-10 | 西南交通大学 | H-infinite PID-based active suspension rack control system and control method |
WO2018155541A1 (en) * | 2017-02-24 | 2018-08-30 | 日立オートモティブシステムズ株式会社 | Vehicle behavior control device |
CN107168279A (en) * | 2017-05-11 | 2017-09-15 | 浙江工业大学 | Based on H∞Control method of active suspension system of vehicle with preview control |
CN108944328A (en) * | 2018-04-04 | 2018-12-07 | 燕山大学 | A kind of Vehicle Active Suspension control method that single line laser radar Longitudinal is taken aim in advance |
DE102019111321A1 (en) * | 2018-05-08 | 2019-11-14 | Hyundai Motor Company | An electronically controlled vehicle suspension control system using road surface information and a control method using such a system |
US20190344634A1 (en) * | 2018-05-08 | 2019-11-14 | Hyundai Motor Company | Electronically controlled suspension control system of vehicle using road surface information and control method using the same |
CN109591537A (en) * | 2019-01-25 | 2019-04-09 | 成都西汽研车辆技术开发有限公司 | A kind of automotive semi-active suspension control system and method |
CN110143108A (en) * | 2019-03-26 | 2019-08-20 | 江西科技学院 | Automotive suspension semi-active control method and system |
CN110154666A (en) * | 2019-04-28 | 2019-08-23 | 西安理工大学 | A kind of vehicle suspension system of achievable road condition predicting is adaptively counter to push away control method |
CN110588272A (en) * | 2019-09-23 | 2019-12-20 | 无锡职业技术学院 | Automobile suspension system based on visual sensing technology and road surface unevenness measuring method |
CN110789287A (en) * | 2019-10-08 | 2020-02-14 | 江苏科技大学 | Adjustable additional air chamber air suspension system based on three-dimensional optical scanning and self-adaptive control method thereof |
CN110877509A (en) * | 2019-12-11 | 2020-03-13 | 西安科技大学 | Active suspension vision pre-aiming control method based on improved fruit fly algorithm |
CN111273547A (en) * | 2020-02-05 | 2020-06-12 | 哈尔滨工业大学 | Unmanned vehicle comfort control method integrating vehicle speed planning and pre-aiming semi-active suspension |
Non-Patent Citations (3)
Title |
---|
邹斌;熊辉;李超群;刘康;: "基于Simulink/CarSim的磁流变悬架预瞄模糊控制" * |
陈兵等: "军用车辆悬架***预瞄控制现状与发展趋势研究", 《兵工自动化》 * |
陈凡: "电流变半主动悬架预瞄控制研究", 《中国优秀硕士学位论文全文数据库工程科技Ⅱ辑》 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112606649A (en) * | 2020-12-08 | 2021-04-06 | 东风汽车集团有限公司 | Vehicle and vehicle body balance control method and control system thereof |
CN113147308A (en) * | 2021-03-30 | 2021-07-23 | 浙江工业大学 | Suspension pre-aiming control method based on binocular vision technology and suspension control device |
CN113183709A (en) * | 2021-06-04 | 2021-07-30 | 合肥工业大学 | Automobile electric control suspension pre-aiming control method |
CN113183709B (en) * | 2021-06-04 | 2022-09-27 | 合肥工业大学 | Preview control method for automobile electric control suspension |
CN113352832A (en) * | 2021-07-06 | 2021-09-07 | 南昌大学 | Multi-target dynamic optimal active suspension control method based on pavement grade recognition |
CN113739717A (en) * | 2021-08-20 | 2021-12-03 | 中国工程物理研究院激光聚变研究中心 | Line laser sensor pose calibration method in on-machine measurement system |
CN113739717B (en) * | 2021-08-20 | 2023-10-24 | 中国工程物理研究院激光聚变研究中心 | Line laser sensor pose calibration method in on-machine measurement system |
CN114332828A (en) * | 2022-03-17 | 2022-04-12 | 北京中科慧眼科技有限公司 | Method and system for adjusting working mode of suspension damper based on binocular stereo camera |
CN115284809A (en) * | 2022-10-09 | 2022-11-04 | 江西科技学院 | Intelligent internet fleet active suspension control method and system and computer equipment |
CN115284809B (en) * | 2022-10-09 | 2023-01-24 | 江西科技学院 | Intelligent internet fleet active suspension control method and system and computer equipment |
Also Published As
Publication number | Publication date |
---|---|
CN111873744B (en) | 2023-03-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111873744B (en) | Active suspension pre-aiming control method based on camera sensor road surface information identification | |
EP3176013B1 (en) | Predictive suspension control for a vehicle using a stereo camera sensor | |
CN104220317B (en) | Road surface state estimation apparatus | |
CN112698302B (en) | Sensor fusion target detection method under bumpy road condition | |
US20100299109A1 (en) | Road shape recognition device | |
CN111860322B (en) | Unstructured pavement type identification method based on multi-source sensor information fusion | |
CN107390205A (en) | A kind of monocular vision vehicle odometry method that front truck feature is obtained using car networking | |
CN104972861A (en) | Method For Operation Of Suspension System For Vehicle And Suspension System With Visual System And Vehicle With Proper Equipment | |
WO2016020718A1 (en) | Method and apparatus for determining the dynamic state of a vehicle | |
CN113147308A (en) | Suspension pre-aiming control method based on binocular vision technology and suspension control device | |
JP6936098B2 (en) | Object estimation device | |
CN112606649B (en) | Vehicle and vehicle body balance control method and control system thereof | |
CN104204726A (en) | Moving-object position/attitude estimation apparatus and method for estimating position/attitude of moving object | |
CN110588272B (en) | Automobile suspension system based on visual sensing technology and road surface unevenness measuring method | |
CN108121941A (en) | A kind of object speed calculation method based on monitoring device | |
CN115298045A (en) | Vehicle control device, vehicle control method, and vehicle control system | |
CN113936259B (en) | Intelligent automobile body posture control method and system based on visual perception | |
CN112509054A (en) | Dynamic calibration method for external parameters of camera | |
JP6768554B2 (en) | Calibration device | |
KR101618501B1 (en) | Method for ego-motion estimation of vehicle | |
CN106885523B (en) | A kind of vehicle route tracking error vision measurement optimization method | |
CN116442707B (en) | System and method for estimating vertical and pitching motion information of vehicle body based on binocular vision | |
JP2019067115A (en) | Road surface detecting device | |
CN106960440B (en) | Based on subject image characteristic point pixel space position combination control method | |
CN115366892A (en) | Rollover early warning method and system based on 3D point cloud optimization dynamic LTR |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |