CN110132306A - The correcting method and system of vehicle location error - Google Patents
The correcting method and system of vehicle location error Download PDFInfo
- Publication number
- CN110132306A CN110132306A CN201910421222.3A CN201910421222A CN110132306A CN 110132306 A CN110132306 A CN 110132306A CN 201910421222 A CN201910421222 A CN 201910421222A CN 110132306 A CN110132306 A CN 110132306A
- Authority
- CN
- China
- Prior art keywords
- pose
- winding
- vehicle
- current
- vision
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/005—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 with correlation of navigation data from several sources, e.g. map or contour matching
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
- G01C21/30—Map- or contour-matching
- G01C21/32—Structuring or formatting of map data
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C25/00—Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Navigation (AREA)
- Image Analysis (AREA)
Abstract
The present invention relates to technical field of vehicle, the correcting method and system of a kind of vehicle location error are disclosed, it include: when detecting that winding phenomenon occurs in the process of moving in current vehicle, it will be merged with the matched winding vision pose of winding phenomenon and with the matched vehicle body pose of winding phenomenon, to generate global fusion map, wherein, winding vision pose is acquired by the visual sensor of current vehicle, and vehicle body pose is acquired by the IMU of current vehicle;Based on all key frames for including in the global fixed winding vision pose of fusion map, and the visual signature point determined from key frame is optimized, the Target key frames after being optimized;Winding detection is carried out to Target key frames, obtains the first winding testing result;First winding testing result is fed back into IMU, so that IMU carries out error correction to vehicle body pose.Implement the embodiment of the present invention, is able to ascend the accuracy of vehicle location function.
Description
Technical field
The present invention relates to technical field of vehicle, and in particular to a kind of correcting method and system of vehicle location error.
Background technique
With the fast development of autonomous driving vehicle, positioning function almost becomes the necessary functions of autonomous driving vehicle.
Currently, some autonomous driving vehicles can be according to the collected data building vehicle-periphery of sensor being arranged on vehicle
SLAM map (Simultaneous Localization And Mapping, immediately positioning and building map), hereafter, automatically
Driving can be by the Inertial Measurement Unit (Inertial Measurement Unit, IMU) of vehicle itself in preparatory structure
It is positioned in the SLAM map built.
However, it has been found in practice that the data that vehicle is acquired usually using IMU were positioned in SLAM map, by
There may be errors for the measuring instrument for including in IMU, therefore the collected data of IMU are also typically present error, so as to cause
The accuracy of the positioning function of autonomous driving vehicle is poor.
Summary of the invention
The embodiment of the present invention discloses the correcting method and system of a kind of vehicle location error, is able to ascend vehicle location function
Accuracy.
First aspect of the embodiment of the present invention discloses a kind of correcting method of vehicle location error, which comprises
It, will be with the matched winding of winding phenomenon when detecting that winding phenomenon occurs in the process of moving in current vehicle
It vision pose and is merged with the matched vehicle body pose of the winding phenomenon, to generate global fusion map, wherein described
Winding vision pose is acquired by the visual sensor of the current vehicle, and the vehicle body pose passes through the current vehicle
IMU acquisition;
Based on the key frame in the global fixed winding vision pose of fusion map, and to from the key frame
Determining visual signature point optimizes, the Target key frames after being optimized;
Winding detection is carried out to the Target key frames, obtains the first winding testing result;
The first winding testing result is fed back into the IMU, so that the IMU carries out error to the vehicle body pose
It corrects.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the method also includes:
When the current vehicle is in driving status, the Current vision pose of the visual sensor acquisition is obtained;
Global optimization is carried out to the Current vision pose, obtains Current vision optimization pose;
When detecting that Current vision optimization pose indicates that winding phenomenon occurs in the process of moving in the current vehicle
When, winding detection is carried out to Current vision optimization pose, obtains the second winding testing result;
The second winding testing result is fed back into the IMU, to correct the running error of the IMU.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described to the Current vision position
Appearance carries out global optimization, obtains Current vision optimization pose, comprising:
Pass through the current key frame in the fixed Current vision pose of global optimization;
Optimize the visual signature point in the current key frame, pose is optimized with the Current vision after being optimized.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described to the Target key frames
Winding detection is carried out, the first winding testing result is obtained, comprising:
It obtains and several matched history keyword frames of the Target key frames;
Calculate the error of the Target key frames Yu each history keyword frame;
Overall error is obtained according to each error calculation, and the overall error is determined as the first winding testing result.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described to detect current vehicle
When occurring winding phenomenon in the process of moving, it will show with the matched winding vision pose of the winding phenomenon and with the winding
As matched vehicle body pose is merged, before generating global fusion map, the method also includes:
The environmental visual pose of the current vehicle in the process of moving is acquired by the visual sensor;
When the current environment vision pose and any one of environmental visual position for detecting the visual sensor acquisition
When appearance is similar, determine that winding phenomenon occurs in the process of moving in the current vehicle.
Second aspect of the embodiment of the present invention discloses the correcting method of another vehicle location error, which comprises
When vehicle is in driving status, the target visual pose of the visual sensor acquisition of the vehicle is obtained;
Pass through the key frame in the fixed target visual pose of global optimization;
Optimize the visual signature point in the key frame, pose is optimized with the target visual after being optimized;
It is right when detecting that the target visual optimization pose indicates that winding phenomenon occurs in the process of moving in the vehicle
The target visual optimization pose carries out winding detection, obtains third winding result;
The third winding result is fed back to the IMU of the vehicle, to correct the running error of the IMU.
The third aspect of the embodiment of the present invention discloses a kind of correcting system of vehicle location error, comprising:
Associative cell will be with the winding for when detecting that winding phenomenon occurs in the process of moving in current vehicle
It the matched winding vision pose of phenomenon and is merged with the matched vehicle body pose of the winding phenomenon, to generate global fusion
Map, wherein the winding vision pose is acquired by the visual sensor of the current vehicle, and the vehicle body pose passes through institute
State the IMU acquisition of current vehicle;
First optimization unit, for fixing the key frame in the winding vision pose based on the global fusion map,
And the visual signature point determined from the key frame is optimized, the Target key frames after being optimized;
First detection unit obtains the first winding testing result for carrying out winding detection to the Target key frames;
First feedback unit, for the first winding testing result to be fed back to the IMU, so that the IMU is to institute
It states vehicle body pose and carries out error correction.
As an alternative embodiment, in the third aspect of the embodiment of the present invention, the system also includes:
First acquisition unit, for when the current vehicle is in driving status, obtaining the visual sensor acquisition
Current vision pose;
Second optimization unit obtains Current vision optimization pose for carrying out global optimization to the Current vision pose;
Second detection unit detects that the Current vision optimization pose indicates that the current vehicle is being run over for working as
When occurring winding phenomenon in journey, winding detection is carried out to Current vision optimization pose, obtains the second winding testing result;
Second feedback unit, for the second winding testing result to be fed back to the IMU, to correct the IMU fortune
Error in row.
As an alternative embodiment, in the third aspect of the embodiment of the present invention, the second optimization unit includes:
Fixed subelement, for passing through the current key frame in the fixed Current vision pose of global optimization;
Optimize subelement, for optimizing the visual signature point in the current key frame, to work as forward sight after being optimized
Feel optimization pose.
As an alternative embodiment, in the third aspect of the embodiment of the present invention, the first detection unit includes:
Subelement is obtained, for obtaining and several matched history keyword frames of the Target key frames;
Computation subunit, for calculating the error of the Target key frames Yu each history keyword frame;
It determines subelement, for obtaining overall error according to each error calculation, and the overall error is determined as
One winding testing result.
As an alternative embodiment, in the third aspect of the embodiment of the present invention, the system also includes:
Acquisition unit, for the associative cell will with the matched winding vision pose of the winding phenomenon and with institute
It states the matched vehicle body pose of winding phenomenon to be merged, before generating global fusion map, be adopted by the visual sensor
Collect the environmental visual pose of the current vehicle in the process of moving;
Determination unit, for when the current environment vision pose and any one institute for detecting the visual sensor acquisition
State environmental visual pose it is similar when, determine that winding phenomenon occurs in the process of moving in the current vehicle.
Fourth aspect of the embodiment of the present invention discloses the correcting system of another vehicle location error, comprising:
Second acquisition unit, what the visual sensor for when vehicle is in driving status, obtaining the vehicle acquired
Target visual pose;
Fixed cell, for passing through the key frame in the fixed target visual pose of global optimization;
Third optimizes unit, for optimizing the visual signature point in the key frame, with the target visual after being optimized
Optimize pose;
Third detection unit detects that the target visual optimization pose indicates the vehicle in the process of moving for working as
When there is winding phenomenon, winding detection is carried out to target visual optimization pose, obtains third winding result;
Third feedback unit, for the third winding result to be fed back to the IMU of the vehicle, to correct the IMU
Running error.
The 5th aspect of the embodiment of the present invention discloses a kind of vehicle electronic device, comprising:
It is stored with the memory of executable program code;
The processor coupled with the memory;
The processor calls the executable program code stored in the memory, executes the embodiment of the present invention the
The instruction of some or all of correcting method of vehicle location error step disclosed in one side;
Alternatively, the processor calls the executable program code stored in the memory, it is real to execute the present invention
Apply the instruction of some or all of correcting method of vehicle location error step disclosed in a second aspect.
The 6th aspect of the embodiment of the present invention discloses a kind of vehicle, and the vehicle includes that the 5th aspect of the embodiment of the present invention is open
Vehicle electronic device.
The 7th aspect of the embodiment of the present invention discloses a kind of computer readable storage medium, the computer readable storage medium
Store program code, wherein said program code includes any one method for executing first aspect and second aspect
Some or all of step instruction.
Eighth aspect of the embodiment of the present invention discloses a kind of computer program product, when the computer program product is calculating
When being run on machine, so that the computer executes some or all of any one method of first aspect and second aspect step
Suddenly.
The aspect of the embodiment of the present invention the 9th disclose a kind of using distribution platform, and the application distribution platform is for publication calculating
Machine program product, wherein when the computer program product is run on computers, so that the computer executes first party
Some or all of any one of face and second aspect method step.
Compared with prior art, the embodiment of the present invention has the advantages that
In the embodiment of the present invention, when detecting that winding phenomenon occurs in the process of moving in current vehicle, it will show with winding
It is associated as matched winding vision pose and with the matched vehicle body pose of winding phenomenon, wherein winding vision pose is logical
The visual sensor acquisition of current vehicle is crossed, vehicle body pose is acquired by the IMU of current vehicle;In fixed winding vision pose
Key frame, and the visual signature point determined from key frame is optimized, the Target key frames after being optimized;Target is closed
Key frame carries out winding detection, obtains the first winding testing result;First winding testing result is fed back into IMU, so that IMU is to vehicle
Body pose carries out error correction.As it can be seen that implementing the embodiment of the present invention, the winding phenomenon in vehicle travel process can be being detected
When, the corresponding winding vision pose of winding phenomenon is associated with vehicle body pose, and then is calculated according to winding vision pose
The winding testing result arrived carries out error correction to collected vehicle body pose, to eliminate error existing for vehicle body pose, thus
Improve the accuracy of vehicle location function.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to needed in the embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is a kind of flow diagram of the correcting method of vehicle location error disclosed by the embodiments of the present invention;
Fig. 2 is the flow diagram of the correcting method of another vehicle location error disclosed by the embodiments of the present invention;
Fig. 3 is the flow diagram of the correcting method of another vehicle location error disclosed by the embodiments of the present invention;
Fig. 4 is the flow diagram of the correcting method of another vehicle location error disclosed by the embodiments of the present invention;
Fig. 5 is a kind of structural schematic diagram of the correcting system of vehicle location error disclosed by the embodiments of the present invention;
Fig. 6 is the structural schematic diagram of the correcting system of another vehicle location error disclosed by the embodiments of the present invention;
Fig. 7 is the structural schematic diagram of the correcting system of another vehicle location error disclosed by the embodiments of the present invention;
Fig. 8 is the structural schematic diagram of the correcting system of another vehicle location error disclosed by the embodiments of the present invention;
Fig. 9 is a kind of structural schematic diagram of vehicle electronic device disclosed by the embodiments of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that the described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on this
Embodiment in invention, every other reality obtained by those of ordinary skill in the art without making creative efforts
Example is applied, shall fall within the protection scope of the present invention.
It should be noted that term " includes " and " having " and their any changes in the embodiment of the present invention and attached drawing
Shape, it is intended that cover and non-exclusive include.Such as contain the process, method of a series of steps or units, system, product or
Equipment is not limited to listed step or unit, but optionally further comprising the step of not listing or unit or optional
Ground further includes the other step or units intrinsic for these process, methods, product or equipment.
The embodiment of the present invention discloses the correcting method and system of a kind of vehicle location error, can be according to winding testing result
Error correction is carried out to collected vehicle body pose, to eliminate error existing for vehicle body pose, to improve vehicle location function
The accuracy of energy.It is described in detail separately below.
Embodiment one
Referring to Fig. 1, Fig. 1 is a kind of process signal of the correcting method of vehicle location error disclosed by the embodiments of the present invention
Figure.As shown in Figure 1, the correcting method of the vehicle location error may comprise steps of:
101, when detecting that winding phenomenon occurs in the process of moving in current vehicle, vehicle electronic device will show with winding
It is merged as matched winding vision pose and with the matched vehicle body pose of winding phenomenon, to generate global fusion map,
Wherein, which is acquired by the visual sensor of current vehicle, which is adopted by the IMU of current vehicle
Collection.
In the embodiment of the present invention, winding phenomenon can turn again to previous traveling warp for vehicle after travelling a period of time
The place crossed.The visual sensor and IMU of current vehicle can be to be run based on the SLAM constructed in advance.Current vehicle
Visual sensor may include image capture device (such as video camera) and visual odometry (Visual Odometry, VO),
Image capture device can acquire the image of current vehicle in the process of moving, and visual odometry can be estimated based on SLAM map
Movement relation between adjacent image, and then the motion state of image capture device is obtained, so that visual odometry can root
The vision pose of current vehicle is determined according to the motion state of image capture device, and is showed when winding occurs in the process of moving in vehicle
As when, which can be determined as to winding vision pose.Furthermore, it is possible to by winding in the SLAM map constructed in advance
It vision pose and is associated with the matched vehicle body pose of winding phenomenon, to generate based on the SLAM map constructed in advance
Global fusion map.
In the embodiment of the present invention, current vehicle can be got by IMU the travel speed of current vehicle, driving direction,
The information such as acceleration and angular speed, vehicle electronic device can be according to the running condition information meters of the IMU current vehicle obtained
Calculation obtains the vehicle body pose of current vehicle.
102, vehicle electronic device is based on the key frame in the global fixed winding vision pose of fusion map, and to from key
The visual signature point determined in frame optimizes, the Target key frames after being optimized.
In the embodiment of the present invention, vehicle electronic device can be by the mode of pose figure (Pose Graph, PG) from winding
It fixes all key frames in vision pose, and then global bundle adjustment (Global Bundle can be used
Adjustment, GBA) all key frames are optimized, to obtain Target key frames.Wherein, vehicle electronic device acquires
To winding vision pose in may include the collected several frame images of image capture device, therefore vehicle electronic device can be with
Target image is determined from several frame images by way of PG, and the target image can be determined as key frame.
103, vehicle electronic device carries out winding detection to Target key frames, obtains the first winding testing result.
In the embodiment of the present invention, when detecting that winding phenomenon occurs in vehicle, it is believed that vehicle is not to travel for the first time
To current location, it can think vehicle repeatedly by current location, and then can consider vehicle collect multiple current locations
Corresponding vision pose.In addition, vehicle electronic device can carry out Target key frames by vision winding and scale re-optimization
Winding detection, and then global optimization is carried out to overall situation fusion map according to the detection of this winding, so that obtained winding detection
As a result more accurate.
As an alternative embodiment, vehicle electronic device carries out winding detection to Target key frames, first is obtained
The mode of winding testing result may include following steps:
The initial visual position acquired for the first time is chosen in the corresponding vision pose in the current location of vehicle electronic device from acquisition
Appearance, and initial key frame can be determined from the initial visual pose;
Vehicle electronic device can determine target visual characteristic point from Target key frames, can also be from initial key frame
In determine initial visual characteristic point, wherein visual signature point can by key point (Key-point) and description son
(Descriptor) two parts form;
Available target critical point and goal description in target visual characteristic point of vehicle electronic device, and can
To get the initial key point in initial visual characteristic point and initial description;
Vehicle electronic device can compare the first difference between target critical point and initial key point, can also compare mesh
The second difference between mark description and initial description;
The first winding testing result comprising the first difference and the second difference can be generated in vehicle electronic device.
Wherein, implement this embodiment, it can be by current collected Target key frames and the initial view acquired in the past
Feel that the initial visual characteristic point of pose compares, so that the first winding testing result of this winding detection is obtained, to mention
The high accuracy of the first winding testing result of output.
It may include several pixels in the embodiment of the present invention, in key point, vehicle electronic device can determine each picture
The color of vegetarian refreshments can also determine that the layout of each pixel in key point determines between each pixel in key point
Positional relationship, and then the colour-difference of pixel between target critical point and initial key point can be compared by vehicle electronic device
Placement differences between different and each pixel, to obtain the first difference comprising color difference and placement differences;This
Outside, vehicle electronic device can obtain several region units around characteristic point, and calculate each region block and characteristic point
Harr wavelet character obtains the principal direction of characteristic point region, and then vehicle electronics from according to several Harr wavelet characters
It is exhausted relative to the horizontal direction value, vertical direction value, horizontal direction of principal direction that equipment can calculate the corresponding key point of characteristic point
To value and vertical direction absolute value, and can determine comprising horizontal direction value, vertical direction value, horizontal direction absolute value with
And vertical direction absolute value description son, it is seen then that vehicle electronic device can by the horizontal direction value of goal description with initially
The horizontal direction value of description compares to obtain that horizontal direction value difference is different, by the vertical direction value of goal description with initially retouch
The vertical direction value for stating son compares to obtain that vertical direction value difference is different, by the horizontal direction absolute value of goal description with initially
The horizontal direction absolute value of description compares to obtain horizontal direction absolute value difference, and the vertical direction of goal description is exhausted
The vertical direction absolute value of value and initial description is compared to obtain vertical direction absolute value difference, to obtain comprising water
It is square different to value difference, vertical direction value difference is different, horizontal direction absolute value difference and vertical direction absolute value difference it is second poor
It is different.
104, the first winding testing result is fed back to IMU by vehicle electronic device, so that IMU carries out error to vehicle body pose
It corrects.
As an alternative embodiment, the first winding testing result is fed back to IMU by vehicle electronic device, so that
The mode that IMU carries out error correction to vehicle body pose may include following steps:
Vehicle electronic device obtains location information corresponding with the first winding testing result;
Vehicle electronic device obtains the matched basic body pose of the location information;
Vehicle electronic device analyzes the vehicle body pose of IMU acquisition and the vehicle body position and attitude error of the basic body pose;
The vehicle body position and attitude error is fed back to IMU by vehicle electronic device, so that IMU carries out error correction to vehicle body pose.
Wherein, implement this embodiment, vehicle electronic device can be made to be passed according to the first winding testing result to vision
Sensor carries out error correction, to obtain the standard vision pose of current vehicle present position, and then can obtain from SLAM map
Location information of the current vehicle corresponding with standard vision pose in the SLAM map is got, so that vehicle electronic device can be with
Get with the matched basic body pose of the location information, since the IMU of vehicle electronic device may be deposited in position fixing process
The error accumulation the case where, therefore the collected vehicle body pose of the IMU of basic body pose and current vehicle can be carried out pair
Than, the vehicle body position and attitude error of the vehicle body pose of IMU acquisition is obtained, and then the vehicle body position and attitude error can be fed back to IMU, so that
IMU is the error accumulation occurred in position fixing process according to elimination IMU with vehicle body position and attitude error.
In the method depicted in fig. 1, error can be carried out to collected vehicle body pose according to winding testing result to entangle
Just, to eliminate error existing for vehicle body pose, to improve the accuracy of vehicle location function.In addition, implementing described by Fig. 1
Method, improve output the first winding testing result accuracy.In addition, implement method described in Fig. 1, it can be to IMU
The vehicle body position and attitude error is fed back, so that IMU is tired according to the error that IMU occurs in position fixing process is eliminated with vehicle body position and attitude error
Product.
Embodiment two
Referring to Fig. 2, the process that Fig. 2 is the correcting method of another vehicle location error disclosed by the embodiments of the present invention is shown
It is intended to.Compared with embodiment one, result that the IMU that the embodiment of the present invention increases vehicle is detected according to winding in IMU to existing
The method corrected of error and the more detailed method for illustrating to carry out global optimization to Current vision pose, both
The accuracy for correcting imu error is improved, and the effect of optimization to Current vision optimization pose can be improved.As shown in Fig. 2, should
The correcting method of vehicle location error may comprise steps of:
Step 201~step 204 is identical as step 101~step 104, and the following contents repeats no more.
205, when current vehicle is in driving status, vehicle electronic device obtains the Current vision of visual sensor acquisition
Pose.
In the embodiment of the present invention, the visual sensor of vehicle collected vision pose when being remained static due to vehicle
It does not change, therefore, vehicle can Current vision pose of acquisition vehicle when being in driving status.
206, vehicle electronic device carries out global optimization to Current vision pose, obtains Current vision optimization pose.
In the embodiment of the present invention, global optimization can optimize for GBA, and vehicle electronic device can be by GBA to working as forward sight
Feel that pose optimizes, it can optimize to the current key frame in Current vision pose, to obtain optimizing current pass
The Current vision of key frame optimizes pose.
As an alternative embodiment, vehicle electronic device carries out global optimization to Current vision pose, worked as
The mode of anterior optic optimization pose may include following steps:
Vehicle electronic device passes through the current key frame in the fixed Current vision pose of global optimization;
Vehicle electronic device optimizes the visual signature point in current key frame, optimizes position with the Current vision after being optimized
Appearance.
Wherein, implement this embodiment, the key in Current vision pose can be fixed by way of global optimization
Frame, and optimize the visual signature point in the key frame, so that the Current vision after being optimized optimizes pose, to improve to working as
The effect of optimization of anterior optic optimization pose.
In the embodiment of the present invention, current key frame can be the key frame got from Current vision pose, due to vehicle
The collected Current vision pose of visual sensor in may include several key frames, therefore vehicle electronic device can be from
Any one frame current key frame is fixed in several key frames, and then GBA can be used, current key frame is optimized, to obtain
The visual signature point of optimization in current key frame, vehicle electronic device can be by the current passes of the visual signature point comprising optimization
The corresponding pose of key frame is determined as Current vision optimization pose.
207, when detecting that winding phenomenon occurs in the process of moving in Current vision optimization pose instruction current vehicle, vehicle
It carries electronic equipment and winding detection is carried out to Current vision optimization pose, obtain the second winding testing result.
In the embodiment of the present invention, the vehicle electronic device of current vehicle first collected to visual sensor can work as forward sight
Feel that pose optimizes, so that vehicle electronic device can be using the Current vision optimization pose after optimizing as foundation, to vehicle
Winding phenomenon is detected, and the available previous collected Current vision of vehicle electronic device optimizes the corresponding position of pose
History vision pose, and history keyword frame can be determined from the history vision pose;Vehicle electronic device can be from going through
History visual signature point is determined in history key frame;Vehicle electronic device can also get the history in history visual signature point
Key point and Reassessment, and the current key point in the available visual signature point to current key frame and currently retouch
State son;Vehicle electronic device can compare the third difference between history keyword point and current key point, can also compare history
The 4th difference between description and current description;Vehicle electronic device can be generated comprising third difference and the 4th difference
Second winding testing result.
208, the second winding testing result is fed back to IMU by vehicle electronic device, to correct the running error of IMU.
In the embodiment of the present invention, implement above-mentioned step 205~step 208, it can be right when vehicle is in driving status
The Current vision pose that visual sensor is got optimizes, and then optimizes pose by the Current vision after optimization and detect vehicle
Currently whether there is winding phenomenon, and after detecting winding phenomenon to Current vision optimization pose carry out winding detection, and
The result that winding detects is fed back into the IMU of vehicle, so that the result that the IMU of vehicle is detected according to winding is to present in IMU
Error is corrected, to improve the accuracy of winding phenomenon detection, and then can promote the accuracy for correcting imu error.
In the embodiment of the present invention, before arbitrary steps of the step 205~step 208 in step 201~step 204 or
It executes later and the embodiment of the present invention is not impacted.
In the method depicted in fig. 2, error can be carried out to collected vehicle body pose according to winding testing result to entangle
Just, to eliminate error existing for vehicle body pose, to improve the accuracy of vehicle location function.In addition, implementing described by Fig. 2
Method, improve to Current vision optimization pose effect of optimization.In addition, implementing method described in Fig. 2, it is existing to improve winding
As the accuracy of detection, and then the accuracy for correcting imu error can be promoted.
Embodiment three
Referring to Fig. 3, the process that Fig. 3 is the correcting method of another vehicle location error disclosed by the embodiments of the present invention is shown
It is intended to.Compared with embodiment one, the embodiment of the present invention increases the method for winding phenomenon detection and more detailed illustrates
The calculation method method of first winding result had not only improved the accuracy for the detection of vehicle winding phenomenon, but also can be improved back
The accuracy of ring testing result.As shown in figure 3, the correcting method of the vehicle location error may comprise steps of:
301, vehicle electronic device acquires the environmental visual pose of current vehicle in the process of moving by visual sensor.
In the embodiment of the present invention, the visual sensor of vehicle may include image capture device and visual odometry, vehicle-mounted
Electronic equipment can control several images of image capture device acquisition vehicle in the process of moving, and visual odometry can be with base
The movement relation between SLAM map estimation arbitrary neighborhood image, and then analyzed to obtain image capture device according to movement relation
Motion state, so that visual odometry can determine the ring of vehicle in the process of moving according to the motion state of image capture device
Border vision pose.
302, when the current environment vision pose and any one environmental visual pose phase for detecting visual sensor acquisition
Like when, vehicle electronic device determines that winding phenomenon occurs in the process of moving in current vehicle.
In the embodiment of the present invention, vehicle can repeatedly pass through same position in the process of moving, it can be considered that vehicle
The corresponding vision pose in multiple current locations can be collected, vehicle electronic device can regard current collected current environment
Feel that pose and previous collected environment pose carry out the calculating of similarity, to determine whether vehicle returns according to similarity
Ring phenomenon.
In the embodiment of the present invention, current environment can be regarded by way of bag of words (Bag-of-words Model)
Feel that each visual signature point for including in pose and the corresponding vision pose of current environment vision pose is determined as word (Word),
And then generate the dictionary (Dictionary) comprising all words;Further, since different words (i.e. visual signature point) for
The similarity judgement contribution of different key frames is different, therefore different words should have different weights;The weight can lead to
Two amounts are crossed to describe: inverse document frequency (Inverse Document Frequency, IDF) and translating frequency (Term
Frequency, TF), wherein IDF describes the frequency that word occurs when constructing dictionary, and the lower IDF the more representative;TF is retouched
The frequency that word occurs in single-frame images is stated, the higher TF the more representative;The vision for including in any one frame vision pose
The quantity of characteristic point can be N number of, and can be ranked up in advance to each visual signature point, so that each visual signature point is all
Unique serial number i can be corresponded to.
Wherein, the calculation formula of IDF can be with are as follows:
N can indicate that the number for occurring each word in dictionary is added in above-mentioned formula, and obtained each word goes out
Occurrence number summation, i can indicate the serial number (such as 1,2,3) for currently calculating the word of IDF, therefore, niIt can indicate serial number i
The number that occurs in dictionary of word;
In addition, the calculation formula of TF can be with are as follows:
N, i and n in above-mentioned formulaiWith n, i and n in the calculation formula of IDFiThe meaning of expression is identical;Therefore it calculates
The weight η of the word of serial number iiCalculation formula can be with are as follows:
ηi=TFi×IDFi
Therefore, a frame key frame A is by word niAnd the bag of words of word corresponding weight η composition can be with are as follows:
Wherein, υAFor single vector, due to the quantity of word be it is N number of, i can be the Any Digit in 1~N;Together
When, it can also be by the ownership renormalization in a frame key frame:
When calculating the difference between two frame key frames, similarity can be obtained by comparing corresponding weight, when two frames
When similarity between key frame is higher, it is believed that above-mentioned two frame is winding.
In the embodiment of the present invention, implement above-mentioned step 301~step 302, the visual sensor of vehicle can be acquired
Current environment vision pose compared with previous collected environmental visual pose, to judge position that vehicle current driving is arrived
The position whether before run over for it is set, if so, it is considered that winding phenomenon occurs in current driving process in vehicle, from
And improve the accuracy detected for vehicle winding phenomenon.
303, when detecting that winding phenomenon occurs in the process of moving in current vehicle, vehicle electronic device will show with winding
It is merged as matched winding vision pose and with the matched vehicle body pose of winding phenomenon, to generate global fusion map,
Wherein, which is acquired by the visual sensor of current vehicle, which is adopted by the IMU of current vehicle
Collection.
304, vehicle electronic device is based on the key frame in the global fixed winding vision pose of fusion map, and to from key
The visual signature point determined in frame optimizes, the Target key frames after being optimized.
305, vehicle electronic device obtains and several matched history keyword frames of Target key frames.
306, vehicle electronic device calculates the error of Target key frames and each history keyword frame.
It, can be based on the pose figure in the primary pose figure of PG, g2o or Lie algebra to target critical in the embodiment of the present invention
The error of frame and each history keyword frame is calculated, and the Target key frames based on SLAM map can be calculated and go through with each
Error between history key frame.
307, vehicle electronic device obtains overall error according to each error calculation, and overall error is determined as the inspection of the first winding
Survey result.
In the embodiment of the present invention, implement above-mentioned step 305~step 307, Target key frames can be calculated and gone through with each
Error between history key frame, and overall error may further be calculated according to each error, obtained overall error can
Be determined as winding detection as a result, so as to improve by several between Target key frames and several history keyword frames
The accuracy for the winding testing result that a error obtains.
308, the first winding testing result is fed back to IMU by vehicle electronic device, so that IMU carries out error to vehicle body pose
It corrects.
In the method depicted in fig. 3, error can be carried out to collected vehicle body pose according to winding testing result to entangle
Just, to eliminate error existing for vehicle body pose, to improve the accuracy of vehicle location function.In addition, described by implementing Fig. 3
Method, improve the accuracy that detects for vehicle winding phenomenon.In addition, method described in implementing Fig. 3, can be improved and pass through
The accuracy for the winding testing result that several errors between Target key frames and several history keyword frames obtain.
Example IV
Referring to Fig. 4, the process that Fig. 4 is the correcting method of another vehicle location error disclosed by the embodiments of the present invention is shown
It is intended to.As shown in figure 4, the correcting method of the vehicle location error may comprise steps of:
401, when vehicle is in driving status, vehicle electronic device obtains the target view of the visual sensor acquisition of vehicle
Feel pose.
In the embodiment of the present invention, the visual sensor of vehicle can be to be run based on the SLAM constructed in advance.Vehicle
Visual sensor may include image capture device (such as video camera) and visual odometry, image capture device can be adopted
Collecting the image of vehicle in the process of moving, visual odometry can estimate movement relation between adjacent image based on SLAM map,
And then the motion state of image capture device is obtained, so that visual odometry can be according to the movement shape of image capture device
State determines the target visual pose of vehicle.In addition, vehicle electronic device can be the electronic equipments such as vehicle-mounted computer, vehicle can be passed through
It carries electronic equipment and server carries out data interaction, collected data can also be carried out by operation by vehicle electronic device,
To realize the normal operation of vehicle electronic device.
402, vehicle electronic device passes through the key frame in the fixed target visual pose of global optimization.
In the embodiment of the present invention, global optimization can pass through PG's for the optimization of the mode of PG, vehicle electronic device
Mode fixed any one frame key frame out from target visual pose, so that vehicle electronic device is subsequent excellent to key frame progress
Change.
403, the visual signature point in vehicle electronic device optimization key frame optimizes position with the target visual after being optimized
Appearance.
In the embodiment of the present invention, vehicle electronic device can be used GBA to key frame fixed in target visual pose into
Row optimization, to obtain the target visual characteristic point of the optimization in the key frame, vehicle electronic device can be by the mesh comprising optimization
The corresponding target visual pose of mark visual signature point is determined as target visual optimization pose.
404, when detecting that winding phenomenon occurs in the process of moving in target visual optimization pose instruction vehicle, vehicle mounted electric
Sub- equipment carries out winding detection to target visual optimization pose, obtains third winding result.
In the embodiment of the present invention, target visual pose can be acquired in real time in vehicle travel process, and to the mesh of acquisition
Mark vision pose is detected, if detecting that winding phenomenon occurs in vehicle, so that it may be returned according to the target visual pose
Ring detection, and error correction timely is carried out to the IMU of vehicle in vehicle operation, so that vehicle in the process of running may be used
To carry out winding detection at any time, and error correction is carried out to IMU at any time, improves the timeliness of error correction.
405, third winding result is fed back to the IMU of vehicle by vehicle electronic device, to correct the running error of IMU.
In the method described in Fig. 4, error can be carried out to collected vehicle body pose according to winding testing result and entangled
Just, to eliminate error existing for vehicle body pose, to improve the accuracy of vehicle location function.
Embodiment five
Referring to Fig. 5, Fig. 5 is a kind of structural representation of the correcting system of vehicle location error disclosed by the embodiments of the present invention
Figure.As shown in figure 5, the correcting system of the vehicle location error may include:
Associative cell 501, for that will show with winding when detecting that winding phenomenon occurs in the process of moving in current vehicle
It is merged as matched winding vision pose and with the matched vehicle body pose of winding phenomenon, to generate global fusion map,
Wherein, winding vision pose is acquired by the visual sensor of current vehicle, and vehicle body pose is acquired by the IMU of current vehicle.
First optimization unit 502, the global fixed winding vision pose of fusion map for being generated based on associative cell 501
In key frame, and to from key frame determine visual signature point optimize, the Target key frames after being optimized.
First detection unit 503, the Target key frames for obtaining to the first optimization unit 502 carry out winding detection, obtain
To the first winding testing result.
As an alternative embodiment, first detection unit 503 carries out winding detection to Target key frames, the is obtained
The mode of one winding testing result is specifically as follows:
Choose the initial visual pose acquired for the first time from the corresponding vision pose in the current location of acquisition, and can be from
Initial key frame is determined in the initial visual pose;
Target visual characteristic point is determined from Target key frames, and initial visual can also be determined from initial key frame
Characteristic point;
The target critical point and goal description in target visual characteristic point are got, and available to initial visual
Initial key point and initial description in characteristic point;
The first difference between target critical point and initial key point is compared, goal description can also be compared and initially retouched
State the second difference between son;
Generate the first winding testing result comprising the first difference and the second difference.
Wherein, implement this embodiment, it can be by current collected Target key frames and the initial view acquired in the past
Feel that the initial visual characteristic point of pose compares, so that the first winding testing result of this winding detection is obtained, to mention
The high accuracy of the first winding testing result of output.
First feedback unit 504, the first winding testing result for obtaining first detection unit 503 feed back to IMU,
So that IMU carries out error correction to vehicle body pose.
As an alternative embodiment, the first winding testing result is fed back to IMU by the first feedback unit 504, with
The mode for making IMU carry out error correction to vehicle body pose is specifically as follows:
Obtain location information corresponding with the first winding testing result;
Obtain the matched basic body pose of the location information;
Analyze the vehicle body pose of IMU acquisition and the vehicle body position and attitude error of the basic body pose;
The vehicle body position and attitude error is fed back into IMU, so that IMU carries out error correction to vehicle body pose.
Wherein, implement this embodiment, error can be carried out to visual sensor according to the first winding testing result and entangled
Just, it to obtain the standard vision pose of current vehicle present position, and then can be got from SLAM map and standard vision
Location information of the corresponding current vehicle of pose in the SLAM map, to get and the matched basic body of the location information
The case where pose, there may be error accumulations in position fixing process due to the IMU of vehicle, can by basic body pose with
The collected vehicle body pose of the IMU of current vehicle compares, and obtains the vehicle body position and attitude error of the vehicle body pose of IMU acquisition, into
And the vehicle body position and attitude error can be fed back to IMU, so that IMU is that foundation eliminates IMU in position fixing process with vehicle body position and attitude error
The error accumulation of appearance.
As it can be seen that implement the correcting system of vehicle location error described in Fig. 5, it can be according to winding testing result to acquisition
The vehicle body pose arrived carries out error correction, to eliminate error existing for vehicle body pose, to improve the standard of vehicle location function
True property.In addition, implementing the correcting system of vehicle location error described in Fig. 5, the first winding testing result of output is improved
Accuracy.In addition, implementing the correcting system of vehicle location error described in Fig. 5, vehicle body pose mistake can be fed back to IMU
Difference, so that IMU is the error accumulation occurred in position fixing process according to elimination IMU with vehicle body position and attitude error.
Embodiment six
Referring to Fig. 6, the structure that Fig. 6 is the correcting system of another vehicle location error disclosed by the embodiments of the present invention is shown
It is intended to.Wherein, the correcting system of vehicle location error shown in fig. 6 is the correcting system of vehicle location error as shown in Figure 5
It optimizes.Compared with the correcting system of vehicle location error shown in fig. 5, vehicle location error shown in fig. 6
The side that the result that the IMU that correcting system further increases vehicle is detected according to winding corrects error present in IMU
Method and the more detailed method for illustrating to carry out global optimization to Current vision pose, both improve and correct imu error
Accuracy, and the effect of optimization to Current vision optimization pose, the correcting system of vehicle location error shown in fig. 6 can be improved
Can also include:
First acquisition unit 505, for when current vehicle is in driving status, obtaining the current of visual sensor acquisition
Vision pose.
Second optimization unit 506, the Current vision pose for obtaining to first acquisition unit 505 carry out global optimization,
Obtain Current vision optimization pose.
Second detection unit 507, for when the Current vision optimization pose instruction for detecting that the second optimization unit 506 obtains
When winding phenomenon occurs in the process of moving in current vehicle, winding detection is carried out to Current vision optimization pose, is obtained second time
Ring testing result.
Second feedback unit 508, the second winding testing result for obtaining second detection unit 507 feed back to IMU,
To correct the running error of IMU.
, can be when vehicle be in driving status in the embodiment of the present invention, Current vision that visual sensor is got
Pose optimizes, and then optimizes pose detection vehicle by the Current vision after optimization and currently whether there is winding phenomenon, and
Winding detection is carried out to Current vision optimization pose after detecting winding phenomenon, and the result that winding detects is fed back into vehicle
IMU so that the IMU of vehicle corrects error present in IMU according to the result that winding detects, to improve winding
The accuracy of phenomenon detection, and then the accuracy for correcting imu error can be promoted.
As an alternative embodiment, the second optimization unit of the correcting system of vehicle location error shown in fig. 6
506 may include:
Fixed subelement 5061, the Current vision pose for being obtained by the fixed first acquisition unit 505 of global optimization
In current key frame;
Optimize subelement 5062, for optimizing the visual signature point in the fixed current key frame of fixed subelement 5061,
Optimize pose with the Current vision after being optimized.
Wherein, implement this embodiment, the key in Current vision pose can be fixed by way of global optimization
Frame, and optimize the visual signature point in the key frame, so that the Current vision after being optimized optimizes pose, to improve to working as
The effect of optimization of anterior optic optimization pose.
As it can be seen that implement the correcting system of vehicle location error described in Fig. 6, it can be according to winding testing result to acquisition
The vehicle body pose arrived carries out error correction, to eliminate error existing for vehicle body pose, to improve the standard of vehicle location function
True property.In addition, implementing the correcting system of vehicle location error described in Fig. 6, the optimization to Current vision optimization pose is improved
Effect.In addition, implementing the correcting system of vehicle location error described in Fig. 6, the accuracy of winding phenomenon detection is improved, into
And the accuracy for correcting imu error can be promoted.
Embodiment seven
Referring to Fig. 7, the structure that Fig. 7 is the correcting system of another vehicle location error disclosed by the embodiments of the present invention is shown
It is intended to.Wherein, the correcting system of vehicle location error shown in Fig. 7 is the correcting system of vehicle location error as shown in Figure 6
It optimizes.Compared with the correcting system of vehicle location error shown in fig. 6, vehicle location error shown in Fig. 7
Correcting system further increases the method for winding phenomenon detection and more detailed illustrates the calculating of the first winding result
Method method had not only improved the accuracy for the detection of vehicle winding phenomenon, but also the accuracy of winding testing result can be improved,
The first detection unit 503 of the correcting system of vehicle location error shown in Fig. 7 may include:
Obtain subelement 5031, for obtains with first optimize the obtained Target key frames of unit 502 it is matched several
History keyword frame.
Computation subunit 5032, for calculating the Target key frames and obtain subelement that the first optimization unit 502 obtains
The error of the 5031 each history keyword frames obtained.
Determining subelement 5033, each error calculation for being obtained according to computation subunit 5032 obtains overall error, and
Overall error is determined as the first winding testing result.
In the embodiment of the present invention, the error between Target key frames and each history keyword frame can be calculated, and according to
Overall error may further be calculated in each error, obtained overall error be assured that for winding detection as a result, to
The winding testing result obtained by several errors between Target key frames and several history keyword frames can be improved
Accuracy.
As an alternative embodiment, the correcting system of vehicle location error shown in Fig. 7 can also include:
Acquisition unit 509, being used for will be with the matched winding vision pose of winding phenomenon and and winding in associative cell 501
The matched vehicle body pose of phenomenon is merged, and before generating global fusion map, acquires current vehicle by visual sensor
Environmental visual pose in the process of moving;
Determination unit 510, for being adopted when the current environment vision pose for detecting visual sensor acquisition with any one
When the environmental visual pose that collection unit 509 acquires is similar, determine that winding phenomenon occurs in the process of moving in current vehicle.
Wherein, implement this embodiment, can to the visual sensor of vehicle acquire current environment vision pose with
Previous collected environmental visual pose compared, with judge vehicle current driving to position whether before run over for it
Position, if so, it is considered that winding phenomenon occurs in current driving process in vehicle, to improve existing for vehicle winding
As the accuracy of detection.
As it can be seen that implement the correcting system of vehicle location error described in Fig. 7, it can be according to winding testing result to acquisition
The vehicle body pose arrived carries out error correction, to eliminate error existing for vehicle body pose, to improve the standard of vehicle location function
True property.In addition, implementing the correcting system of vehicle location error described in Fig. 7, the standard detected for vehicle winding phenomenon is improved
True property.In addition, implement Fig. 7 described in vehicle location error correcting system, can be improved by Target key frames with it is several
The accuracy for the winding testing result that several errors between a history keyword frame obtain.
Embodiment eight
Referring to Fig. 8, the structure that Fig. 8 is the correcting system of another vehicle location error disclosed by the embodiments of the present invention is shown
It is intended to.As shown in figure 8, the correcting system of the vehicle location error may include:
Second acquisition unit 801, the mesh of the visual sensor acquisition for when vehicle is in driving status, obtaining vehicle
Mark vision pose.
Fixed cell 802, in the target visual pose by the fixed acquisition of second acquisition unit 801 of global optimization
Key frame.
Third optimizes unit 803, for optimizing the visual signature point in the fixed key frame of fixed cell 802, to obtain
Target visual after optimization optimizes pose.
Third detection unit 804, for when the target visual optimization pose instruction for detecting that third optimization unit 803 obtains
When winding phenomenon occurs in the process of moving in vehicle, winding detection is carried out to target visual optimization pose, obtains third winding knot
Fruit.
Third feedback unit 805, the third winding result for obtaining third detection unit 804 feed back to vehicle
IMU, to correct the running error of IMU.
As it can be seen that implement the correcting system of vehicle location error described in Fig. 8, it can be according to winding testing result to acquisition
The vehicle body pose arrived carries out error correction, to eliminate error existing for vehicle body pose, to improve the standard of vehicle location function
True property.
Embodiment nine
Referring to Fig. 9, Fig. 9 is a kind of structural schematic diagram of vehicle electronic device disclosed by the embodiments of the present invention.Such as Fig. 9 institute
Show, which may include:
It is stored with the memory 901 of executable program code;
The processor 902 coupled with memory 901;
Wherein, processor 902 calls the executable program code stored in memory 901, executes above method embodiment
Some or all of method in one~embodiment of the method three step;
Alternatively, processor 902 calls the executable program code stored in memory 901, above method embodiment is executed
Some or all of method in four step.
A kind of vehicle is also disclosed in the embodiment of the present invention, wherein the vehicle includes the vehicle electronic device in embodiment nine.
A kind of computer readable storage medium is also disclosed in the embodiment of the present invention, wherein computer-readable recording medium storage
Program code, wherein program code includes for executing some or all of the method in above each method embodiment step
Instruction.
A kind of computer program product is also disclosed in the embodiment of the present invention, wherein when computer program product on computers
When operation, so that computer executes some or all of the method in such as above each method embodiment step.
The embodiment of the present invention is also disclosed a kind of using distribution platform, wherein using distribution platform for issuing computer journey
Sequence product, wherein when computer program product is run on computers, so that computer executes such as the above each method embodiment
In some or all of method step.
It should be understood that " embodiment of the present invention " that specification is mentioned in the whole text mean special characteristic related with embodiment,
Structure or characteristic is included at least one embodiment of the present invention.Therefore, the whole instruction occur everywhere " in the present invention
In embodiment " not necessarily refer to identical embodiment.In addition, these a particular feature, structure, or characteristics can be with any suitable
Mode combines in one or more embodiments.Those skilled in the art should also know that embodiment described in this description
Alternative embodiment is belonged to, related actions and modules are not necessarily necessary for the present invention.
In various embodiments of the present invention, it should be appreciated that magnitude of the sequence numbers of the above procedures are not meant to execute suitable
Successively, the execution sequence of each process should be determined by its function and internal logic the certainty of sequence, without coping with the embodiment of the present invention
Implementation process constitutes any restriction.
In addition, the terms " system " and " network " are often used interchangeably herein.It should be understood that the terms
"and/or", only a kind of incidence relation for describing affiliated partner, indicates may exist three kinds of relationships, such as A and/or B, can
To indicate: individualism A exists simultaneously A and B, these three situations of individualism B.In addition, character "/" herein, typicallys represent
Forward-backward correlation object is a kind of relationship of "or".
In embodiment provided by the present invention, it should be appreciated that " B corresponding with A " indicates that B is associated with A, can be with according to A
Determine B.It is also to be understood that determine that B is not meant to determine B only according to A according to A, it can also be according to A and/or other information
Determine B.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium include read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory,
RAM), programmable read only memory (Programmable Read-only Memory, PROM), erasable programmable is read-only deposits
Reservoir (Erasable Programmable Read Only Memory, EPROM), disposable programmable read-only memory (One-
Time Programmable Read-Only Memory, OTPROM), the electronics formula of erasing can make carbon copies read-only memory
(Electrically-Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact
Disc Read-Only Memory, CD-ROM) or other disc memories, magnetic disk storage, magnetic tape storage or can
For carrying or any other computer-readable medium of storing data.
Above-mentioned unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, can be in one place, or may be distributed over multiple nets
On network unit.Some or all of units can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, each functional unit in various embodiments of the present invention can integrate in one processing unit, it is also possible to
Each unit physically exists alone, and can also be integrated in one unit with two or more units.Above-mentioned integrated unit
Both it can take the form of hardware realization, can also realize in the form of software functional units.
If above-mentioned integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product,
It can store in a retrievable memory of computer.Based on this understanding, technical solution of the present invention substantially or
Person says all or part of of the part that contributes to existing technology or the technical solution, can be in the form of software products
It embodies, which is stored in a memory, including several requests are with so that a computer is set
Standby (can be personal computer, server or network equipment etc., specifically can be the processor in computer equipment) executes
Some or all of each embodiment above method of the invention step.
Detailed Jie has been carried out to the correcting method and system of a kind of vehicle location error disclosed by the embodiments of the present invention above
It continues, used herein a specific example illustrates the principle and implementation of the invention, and the explanation of above embodiments is only
It is to be used to help understand method and its core concept of the invention;At the same time, for those skilled in the art, according to this hair
Bright thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage
Solution is limitation of the present invention.
Claims (14)
1. a kind of correcting method of vehicle location error, which is characterized in that the described method includes:
It, will be with the matched winding vision of the winding phenomenon when detecting that winding phenomenon occurs in the process of moving in current vehicle
It pose and is merged with the matched vehicle body pose of the winding phenomenon, to generate global fusion map, wherein the winding
Vision pose is acquired by the visual sensor of the current vehicle, and the vehicle body pose is adopted by the IMU of the current vehicle
Collection;
Based on the key frame in the global fixed winding vision pose of fusion map, and determined to from the key frame
Visual signature point optimize, the Target key frames after being optimized;
Winding detection is carried out to the Target key frames, obtains the first winding testing result;
The first winding testing result is fed back into the IMU, is entangled so that the IMU carries out error to the vehicle body pose
Just.
2. the method according to claim 1, wherein the method also includes:
When the current vehicle is in driving status, the Current vision pose of the visual sensor acquisition is obtained;
Global optimization is carried out to the Current vision pose, obtains Current vision optimization pose;
It is right when detecting that the Current vision optimization pose indicates that winding phenomenon occurs in the process of moving in the current vehicle
The Current vision optimization pose carries out winding detection, obtains the second winding testing result;
The second winding testing result is fed back into the IMU, to correct the running error of the IMU.
3. according to the method described in claim 2, it is characterized in that, it is described to the Current vision pose carry out global optimization,
Obtain Current vision optimization pose, comprising:
Pass through the current key frame in the fixed Current vision pose of global optimization;
Optimize the visual signature point in the current key frame, pose is optimized with the Current vision after being optimized.
4. described in any item methods according to claim 1~3, which is characterized in that described to be returned to the Target key frames
Ring detection, obtains the first winding testing result, comprising:
It obtains and several matched history keyword frames of the Target key frames;
Calculate the error of the Target key frames Yu each history keyword frame;
Overall error is obtained according to each error calculation, and the overall error is determined as the first winding testing result.
5. according to the method described in claim 4, it is characterized in that, described ought detect that current vehicle occurs in the process of moving
When winding phenomenon, will with the matched winding vision pose of the winding phenomenon and with the matched vehicle body pose of the winding phenomenon
It is merged, before generating global fusion map, the method also includes:
The environmental visual pose of the current vehicle in the process of moving is acquired by the visual sensor;
When the current environment vision pose and any one of environmental visual pose phase for detecting the visual sensor acquisition
Like when, determine that winding phenomenon occurs in the process of moving in the current vehicle.
6. a kind of correcting method of vehicle location error, which is characterized in that the described method includes:
When vehicle is in driving status, the target visual pose of the visual sensor acquisition of the vehicle is obtained;
Pass through the key frame in the fixed target visual pose of global optimization;
Optimize the visual signature point in the key frame, pose is optimized with the target visual after being optimized;
When detecting that the target visual optimization pose indicates that winding phenomenon occurs in the process of moving in the vehicle, to described
Target visual optimizes pose and carries out winding detection, obtains third winding result;
The third winding result is fed back to the IMU of the vehicle, to correct the running error of the IMU.
7. a kind of correcting system of vehicle location error characterized by comprising
Associative cell will be with the winding phenomenon for when detecting that winding phenomenon occurs in the process of moving in current vehicle
It matched winding vision pose and is merged with the matched vehicle body pose of the winding phenomenon, to generate global fusion ground
Figure, wherein the winding vision pose is acquired by the visual sensor of the current vehicle, and the vehicle body pose passes through described
The IMU of current vehicle is acquired;
First optimization unit, for fixing the key frame in the winding vision pose based on the global fusion map, and it is right
The visual signature point determined from the key frame optimizes, the Target key frames after being optimized;
First detection unit obtains the first winding testing result for carrying out winding detection to the Target key frames;
First feedback unit, for the first winding testing result to be fed back to the IMU, so that the IMU is to the vehicle
Body pose carries out error correction.
8. system according to claim 7, which is characterized in that the system also includes:
First acquisition unit, for when the current vehicle is in driving status, obtaining working as the visual sensor acquisition
Anterior optic pose;
Second optimization unit obtains Current vision optimization pose for carrying out global optimization to the Current vision pose;
Second detection unit detects that the Current vision optimization pose indicates the current vehicle in the process of moving for working as
When there is winding phenomenon, winding detection is carried out to Current vision optimization pose, obtains the second winding testing result;
Second feedback unit, for the second winding testing result to be fed back to the IMU, to correct in the IMU operation
Error.
9. system according to claim 8, which is characterized in that described second, which optimizes unit, includes:
Fixed subelement, for passing through the current key frame in the fixed Current vision pose of global optimization;
Optimize subelement, it is excellent with the Current vision after being optimized for optimizing the visual signature point in the current key frame
Change pose.
10. according to the described in any item systems of claim 7~9, which is characterized in that the first detection unit includes:
Subelement is obtained, for obtaining and several matched history keyword frames of the Target key frames;
Computation subunit, for calculating the error of the Target key frames Yu each history keyword frame;
It determines subelement, for obtaining overall error according to each error calculation, and the overall error is determined as first time
Ring testing result.
11. system according to claim 10, which is characterized in that the system also includes:
Acquisition unit, for the associative cell will with the matched winding vision pose of the winding phenomenon and with described time
The matched vehicle body pose of ring phenomenon is merged, and before generating global fusion map, acquires institute by the visual sensor
State the environmental visual pose of current vehicle in the process of moving;
Determination unit, for when the current environment vision pose and any one of ring for detecting the visual sensor acquisition
When border vision pose is similar, determine that winding phenomenon occurs in the process of moving in the current vehicle.
12. a kind of correcting system of vehicle location error characterized by comprising
Second acquisition unit, the target of the visual sensor acquisition for when vehicle is in driving status, obtaining the vehicle
Vision pose;
Fixed cell, for passing through the key frame in the fixed target visual pose of global optimization;
Third optimizes unit, for optimizing the visual signature point in the key frame, is optimized with the target visual after being optimized
Pose;
Third detection unit detects that the target visual optimization pose indicates that the vehicle occurs in the process of moving for working as
When winding phenomenon, winding detection is carried out to target visual optimization pose, obtains third winding result;
Third feedback unit, for the third winding result to be fed back to the IMU of the vehicle, to correct the IMU operation
In error.
13. a kind of vehicle electronic device characterized by comprising
It is stored with the memory of executable program code;
The processor coupled with the memory;
The processor calls the executable program code stored in the memory, and perform claim requires any one of 1~5
The instruction of some or all of the correcting method of vehicle location error step;
Alternatively, the processor calls the executable program code stored in the memory, perform claim is required described in 6
Some or all of the correcting method of vehicle location error step instruction.
14. a kind of vehicle, which is characterized in that the vehicle includes vehicle electronic device described in claim 13.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910421222.3A CN110132306B (en) | 2019-05-20 | 2019-05-20 | Method and system for correcting vehicle positioning error |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910421222.3A CN110132306B (en) | 2019-05-20 | 2019-05-20 | Method and system for correcting vehicle positioning error |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110132306A true CN110132306A (en) | 2019-08-16 |
CN110132306B CN110132306B (en) | 2021-02-19 |
Family
ID=67571804
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910421222.3A Active CN110132306B (en) | 2019-05-20 | 2019-05-20 | Method and system for correcting vehicle positioning error |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110132306B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110967038A (en) * | 2019-11-25 | 2020-04-07 | 广州小鹏汽车科技有限公司 | Vehicle positioning method, vehicle positioning device and vehicle |
CN111145634A (en) * | 2019-12-31 | 2020-05-12 | 深圳市优必选科技股份有限公司 | Method and device for correcting map |
CN111539305A (en) * | 2020-04-20 | 2020-08-14 | 肇庆小鹏汽车有限公司 | Map construction method and system, vehicle and storage medium |
CN112596691A (en) * | 2020-09-02 | 2021-04-02 | 禾多科技(北京)有限公司 | Information pushing method and device, electronic equipment and computer readable medium |
CN113543014A (en) * | 2020-03-31 | 2021-10-22 | 北京慧行实达科技有限公司 | Vehicle satellite positioning data aggregation optimization system and method thereof |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107160395A (en) * | 2017-06-07 | 2017-09-15 | 中国人民解放军装甲兵工程学院 | Map constructing method and robot control system |
CN107193279A (en) * | 2017-05-09 | 2017-09-22 | 复旦大学 | Robot localization and map structuring system based on monocular vision and IMU information |
US20170343356A1 (en) * | 2016-05-25 | 2017-11-30 | Regents Of The University Of Minnesota | Resource-aware large-scale cooperative 3d mapping using multiple mobile devices |
CN107869989A (en) * | 2017-11-06 | 2018-04-03 | 东北大学 | A kind of localization method and system of the fusion of view-based access control model inertial navigation information |
WO2018140701A1 (en) * | 2017-01-27 | 2018-08-02 | Kaarta, Inc. | Laser scanner with real-time, online ego-motion estimation |
CN108447097A (en) * | 2018-03-05 | 2018-08-24 | 清华-伯克利深圳学院筹备办公室 | Depth camera scaling method, device, electronic equipment and storage medium |
CN109307508A (en) * | 2018-08-29 | 2019-02-05 | 中国科学院合肥物质科学研究院 | A kind of panorama inertial navigation SLAM method based on more key frames |
CN109341706A (en) * | 2018-10-17 | 2019-02-15 | 张亮 | A kind of production method of the multiple features fusion map towards pilotless automobile |
CN109579840A (en) * | 2018-10-25 | 2019-04-05 | 中国科学院上海微***与信息技术研究所 | A kind of close coupling binocular vision inertia SLAM method of dotted line Fusion Features |
-
2019
- 2019-05-20 CN CN201910421222.3A patent/CN110132306B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170343356A1 (en) * | 2016-05-25 | 2017-11-30 | Regents Of The University Of Minnesota | Resource-aware large-scale cooperative 3d mapping using multiple mobile devices |
WO2018140701A1 (en) * | 2017-01-27 | 2018-08-02 | Kaarta, Inc. | Laser scanner with real-time, online ego-motion estimation |
CN107193279A (en) * | 2017-05-09 | 2017-09-22 | 复旦大学 | Robot localization and map structuring system based on monocular vision and IMU information |
CN107160395A (en) * | 2017-06-07 | 2017-09-15 | 中国人民解放军装甲兵工程学院 | Map constructing method and robot control system |
CN107869989A (en) * | 2017-11-06 | 2018-04-03 | 东北大学 | A kind of localization method and system of the fusion of view-based access control model inertial navigation information |
CN108447097A (en) * | 2018-03-05 | 2018-08-24 | 清华-伯克利深圳学院筹备办公室 | Depth camera scaling method, device, electronic equipment and storage medium |
CN109307508A (en) * | 2018-08-29 | 2019-02-05 | 中国科学院合肥物质科学研究院 | A kind of panorama inertial navigation SLAM method based on more key frames |
CN109341706A (en) * | 2018-10-17 | 2019-02-15 | 张亮 | A kind of production method of the multiple features fusion map towards pilotless automobile |
CN109579840A (en) * | 2018-10-25 | 2019-04-05 | 中国科学院上海微***与信息技术研究所 | A kind of close coupling binocular vision inertia SLAM method of dotted line Fusion Features |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110967038A (en) * | 2019-11-25 | 2020-04-07 | 广州小鹏汽车科技有限公司 | Vehicle positioning method, vehicle positioning device and vehicle |
CN110967038B (en) * | 2019-11-25 | 2021-08-27 | 广州小鹏自动驾驶科技有限公司 | Vehicle positioning method, vehicle positioning device and vehicle |
CN111145634A (en) * | 2019-12-31 | 2020-05-12 | 深圳市优必选科技股份有限公司 | Method and device for correcting map |
CN111145634B (en) * | 2019-12-31 | 2022-02-22 | 深圳市优必选科技股份有限公司 | Method and device for correcting map |
CN113543014A (en) * | 2020-03-31 | 2021-10-22 | 北京慧行实达科技有限公司 | Vehicle satellite positioning data aggregation optimization system and method thereof |
CN111539305A (en) * | 2020-04-20 | 2020-08-14 | 肇庆小鹏汽车有限公司 | Map construction method and system, vehicle and storage medium |
CN111539305B (en) * | 2020-04-20 | 2024-03-12 | 肇庆小鹏汽车有限公司 | Map construction method and system, vehicle and storage medium |
CN112596691A (en) * | 2020-09-02 | 2021-04-02 | 禾多科技(北京)有限公司 | Information pushing method and device, electronic equipment and computer readable medium |
CN112596691B (en) * | 2020-09-02 | 2021-10-15 | 禾多科技(北京)有限公司 | Information pushing method and device, electronic equipment and computer readable medium |
Also Published As
Publication number | Publication date |
---|---|
CN110132306B (en) | 2021-02-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110132306A (en) | The correcting method and system of vehicle location error | |
CN112734852B (en) | Robot mapping method and device and computing equipment | |
CN110136199A (en) | A kind of vehicle location based on camera, the method and apparatus for building figure | |
CN109084732A (en) | Positioning and air navigation aid, device and processing equipment | |
CN109767475A (en) | A kind of method for calibrating external parameters and system of sensor | |
CN110377025A (en) | Sensor aggregation framework for automatic driving vehicle | |
CN110163889A (en) | Method for tracking target, target tracker, target following equipment | |
CN107990899A (en) | A kind of localization method and system based on SLAM | |
CN109084746A (en) | Monocular mode for the autonomous platform guidance system with aiding sensors | |
CN108051002A (en) | Transport vehicle space-location method and system based on inertia measurement auxiliary vision | |
CN107888828A (en) | Space-location method and device, electronic equipment and storage medium | |
CN110148170A (en) | A kind of positioning initialization method and car-mounted terminal applied to vehicle location | |
CN110147094A (en) | A kind of vehicle positioning method and car-mounted terminal based on vehicle-mounted viewing system | |
CN105931275A (en) | Monocular and IMU fused stable motion tracking method and device based on mobile terminal | |
CN109857111A (en) | High-precision locating method and system based on shared SLAM map | |
CN106352877A (en) | Moving device and positioning method thereof | |
CN107478220A (en) | Unmanned plane indoor navigation method, device, unmanned plane and storage medium | |
CN110146096A (en) | A kind of vehicle positioning method and device based on image perception | |
CN109059907A (en) | Track data processing method, device, computer equipment and storage medium | |
CN112907678A (en) | Vehicle-mounted camera external parameter attitude dynamic estimation method and device and computer equipment | |
CN109255749A (en) | From the map structuring optimization in non-autonomous platform of advocating peace | |
CN106708037A (en) | Autonomous mobile equipment positioning method and device, and autonomous mobile equipment | |
CN110136058A (en) | It is a kind of that drawing method and car-mounted terminal are built based on vertical view spliced map | |
CN110440797A (en) | Vehicle attitude estimation method and system | |
CN109669533A (en) | A kind of motion capture method, the apparatus and system of view-based access control model and inertia |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: 510000 No.8 Songgang street, Cencun, Tianhe District, Guangzhou City, Guangdong Province Applicant after: GUANGZHOU XPENG AUTOMOBILE TECHNOLOGY Co.,Ltd. Address before: Room 245, No. 333, jiufo Jianshe Road, Zhongxin Guangzhou Knowledge City, Guangzhou City, Guangdong Province Applicant before: GUANGZHOU XPENG AUTOMOBILE TECHNOLOGY Co.,Ltd. |