KR101816034B1 - Apparatus and method for detecting road boundary line using camera and radar - Google Patents
Apparatus and method for detecting road boundary line using camera and radar Download PDFInfo
- Publication number
- KR101816034B1 KR101816034B1 KR1020150177293A KR20150177293A KR101816034B1 KR 101816034 B1 KR101816034 B1 KR 101816034B1 KR 1020150177293 A KR1020150177293 A KR 1020150177293A KR 20150177293 A KR20150177293 A KR 20150177293A KR 101816034 B1 KR101816034 B1 KR 101816034B1
- Authority
- KR
- South Korea
- Prior art keywords
- radar
- distance
- road
- road boundary
- boundary
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/867—Combination of radar systems with cameras
-
- G06K9/00798—
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Traffic Control Systems (AREA)
Abstract
The present invention relates to an apparatus and method for detecting a road boundary using a camera and a radar, and more particularly to a system and method for detecting a road image boundary in an image input through a camera during a vehicle running, Boundary candidate line selection; A distance detecting unit connected to the actuator for rotating the rotatable radar to the left or right according to a predetermined sensing angle and detecting the distance of the stationary target through the rotated radar; A boundary line selecting unit that synthesizes a distance between the selected road boundary candidate and the detected stationary target through distance matching and selects a road boundary candidate matching the detected distance of the stationary target with a road boundary line; And a range setting unit for setting a moving range of the vehicle by adding the distance between the selected road boundary line and the corresponding road boundary line to the input image.
Description
The present invention relates to an apparatus and method for detecting a road boundary using a camera and a radar, and more particularly, to an apparatus and method for detecting a road boundary using a camera and a radar, Detection apparatus and method.
Generally, the driver is driving while paying attention so that the vehicle does not get out of the running road while the vehicle is running, that is, it keeps the running road without leaving the road boundary.
In this way, the driver keeps his or her attention so that the vehicle does not deviate from the road boundary while driving, in order to prevent a traffic accident that may occur when the road boundary is detached.
However, the driver can not recognize the departure from the road boundary when driving on an abnormal road section or driving while sleeping or sleeping in a bad weather condition, resulting in a large accident.
In order to solve the problem of the accident caused by the departure of the road, a road boundary recognition system has been developed and applied to help the driver recognize the road while driving and to prevent the driver from leaving the road.
A conventional system for detecting or recognizing road boundaries detects road boundaries using radar.
Since such a conventional road boundary detection system detects a road boundary only by using a radar, accuracy of a road boundary is deteriorated or a limited boundary is detected.
In addition, the technique of detecting the stationary object and estimating the boundary of the road greatly increases the uncertainty when the vehicle travels in the middle of both boundary lines during actual road driving.
On the other hand, the technique of estimating the boundary of the road can be applied only in the flat road condition, and the road boundary can not be detected in the ramp.
Embodiments of the present invention are directed to a road boundary detection device using a camera and a radar that can improve the accuracy of road boundary detection by detecting a road boundary by using a camera and a radar for road boundary detection and rotating a radar connected to the actuator And methods.
SUMMARY OF THE INVENTION Embodiments of the present invention provide an apparatus and method for detecting a road boundary using a camera and a radar that can easily set a movable range of a vehicle using the detected road boundary.
The embodiments of the present invention determine whether a vehicle enters or exits a ramp, and if it is determined that the vehicle is entering or exiting the ramp, the radar connected to the actuator is rotated up and down to detect the road boundary, And a method and apparatus for detecting a road boundary using a camera and a radar.
According to the first aspect of the present invention, a boundary candidate selecting unit for detecting a road image boundary in an image input through a camera while driving a vehicle and selecting the detected road image boundary as a road boundary candidate; A distance detecting unit connected to the actuator for rotating the rotatable radar to the left or right according to a predetermined sensing angle and detecting the distance of the stationary target through the rotated radar; A boundary line selecting unit that synthesizes a distance between the selected road boundary candidate and the detected stationary target through distance matching and selects a road boundary candidate matching the detected distance of the stationary target with a road boundary line; And a range setting unit for setting a moving range of the vehicle by adding the distance between the selected road boundary line and the corresponding road boundary line to the input image.
The apparatus further includes a ramp determining unit that rotates the radar upward or downward using an actuator connected to the radar when the vehicle is determined to enter or exit the ramp, The distance of the stationary target can be detected through the rotated radar.
The ramp determining unit may determine the rotation angle of the radar according to a traveling state including the steering angle or the lateral acceleration of the vehicle, and may rotate the radar up or down by the determined rotation angle.
The ramp determining unit may determine the rotation angle of the radar through image analysis of the input image, and may rotate the radar up or down by the determined rotation angle.
The ramp determining unit may synchronize the radar sensing and signal processing timings to rotate the radar using the actuator within a predetermined time.
According to a second aspect of the present invention, there is provided a method of detecting a road image, comprising the steps of: detecting a road image boundary on an input image during driving; Selecting the road image boundary as a road boundary candidate; Detecting the distance of the stationary target by rotating the radar to the left or right according to a predetermined sensing angle; Selecting a road boundary candidate as a road boundary line by synthesizing a distance between the selected road boundary candidate and the detected stationary state target through distance matching and matching the distance of the detected stationary state target; And adding a distance between the selected road boundary line and the corresponding road boundary line to the input image to set a movable range of the vehicle.
The method includes: determining whether the vehicle enters or exits a ramp; Rotating the radar up or down using an actuator connected to the radar when the vehicle enters or exits the ramp; And detecting a distance of the stationary target through the upward or downward rotated radar.
The step of rotating the radar upside or downside may determine the rotation angle of the radar according to a traveling state including the steering angle or the lateral acceleration of the vehicle and rotate the radar up or down by the determined rotation angle .
The step of rotating the radar up or down may determine the rotation angle of the radar through image analysis of the input image and rotate the radar up or down by the determined rotation angle.
The step of rotating the radar upside or downside may rotate the radar using the actuator within a predetermined time in synchronism with the radar sensing and signal processing timings.
Embodiments of the present invention can improve the accuracy of road boundary detection by detecting a road boundary by using a camera and a radar for road boundary detection and rotating a radar connected to the actuator.
Embodiments of the present invention can easily set the movable range of the vehicle using the detected road boundary line.
The embodiments of the present invention determine whether a vehicle enters or exits a ramp, and if it is determined that the vehicle is entering or exiting the ramp, the radar connected to the actuator is rotated up and down to detect the road boundary, have.
1 is a block diagram of a road boundary detection apparatus using a camera and a radar according to an embodiment of the present invention.
FIG. 2 is an explanatory view of a rotating operation of a radar connected to an actuator according to an embodiment of the present invention. FIG.
3 is a flowchart of a road boundary detection method using a camera and a radar according to an embodiment of the present invention.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Will be described in detail with reference to the portions necessary for understanding the operation and operation according to the present specification. In describing the embodiments of the present invention, description of technical contents which are well known in the technical field to which the present invention belongs and which are not directly related to the present specification will be omitted. This is for the sake of clarity without omitting the unnecessary explanation and without giving the gist of the present invention.
In describing the components of the present specification, the same reference numerals may be given to components having the same name, and the same reference numerals may be given to different drawings. However, even in such a case, it does not mean that the corresponding component has different functions according to the embodiment, or does not mean that it has the same function in different embodiments, and the function of each component is different from that of the corresponding embodiment Based on the description of each component in FIG.
1 is a block diagram of a road boundary detection apparatus using a camera and a radar according to an embodiment of the present invention.
1, a camera and a radar-based road boundary detection apparatus 100 according to an embodiment of the present invention includes a boundary candidate selection unit 110, a
The specific configuration and operation of each component of the road boundary detection apparatus 100 using the camera and the radar of FIG. 1 will be described below.
The boundary candidate selection unit 110 is connected to a camera 111 that photographs a road image while the vehicle is running. The boundary candidate selection unit 110 detects a road image boundary from the image input through the camera 111 while driving the vehicle. The boundary candidate selection unit 110 selects the detected road image boundary as a road boundary candidate. Here, the camera 111 captures an image of the front lane and the road boundary, and transmits the image to the boundary candidate selecting unit 110. [ Then, the boundary candidate selection unit 110 detects a road image boundary through the transmitted image and selects a boundary candidate.
The
The boundary
The movement
On the other hand, the
Here, the
The
The
Then, the
FIG. 2 is an explanatory view of a rotating operation of a radar connected to an actuator according to an embodiment of the present invention. FIG.
As shown in FIG. 2, the
For example, an area that can be detected through the
When the vehicle enters the curved road and travels, the first sensing area TX1 detected by the
Then, the
3 is a flowchart of a road boundary detection method using a camera and a radar according to an embodiment of the present invention.
The boundary candidate selection unit 110 receives the image photographed through the camera 111 while driving the vehicle (S302).
Then, the boundary candidate selecting unit 110 detects the road image boundary in the input image during the driving of the vehicle (S304).
Then, the boundary candidate selecting unit 110 confirms whether the road boundary candidate is selected using the detected road image boundary (S306).
If the road boundary candidate is selected using the road image boundary, the
On the other hand, if the road boundary candidate is not selected using the road image boundary (S306), the boundary candidate selection unit 110 performs the process again from S302, which is taken through the camera 111. [
The
The boundary
If the distance between the road boundary candidate and the boundary image is matched, the boundary
The movement
If the distance between the road boundary candidate and the boundary image is not matched, the
If it is determined that the vehicle enters or exits the ramp, the
On the other hand, if it is not determined that the vehicle enters or exits the ramp, the road boundary detecting apparatus 100 performs the process from step S304 to detect the road image boundary again.
The
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.
100: Road boundary detection device
110: boundary candidate selection unit
111: camera
120:
121: Radar
122: Actuator
130: Boundary line selection
140: Moving range setting unit
150:
Claims (10)
A distance detector which rotates the radar connected to the actuator and rotates to the left or right according to a predetermined detection angle and detects the distance of the stationary target through the left or right radar;
A ramp determining unit for rotating the radar up or down using the actuator if it is determined that the vehicle enters or exits the ramp;
A boundary line selecting unit that synthesizes a distance between the selected road boundary candidate and the detected stationary target through distance matching and selects a road boundary candidate matching the detected distance of the stationary target with a road boundary line; And
And a range setting unit for setting a moving range of the vehicle by adding the distance between the selected road boundary line and the corresponding road boundary line to the input image,
Wherein the distance detecting unit detects the distance of the stationary target through the upper or lower radar if it is determined that the vehicle enters or exits the ramp.
The ramp-
Determining a rotation angle of the radar according to a traveling state including a steering angle or a lateral acceleration of the vehicle and rotating the radar up or down by the determined rotation angle.
The ramp-
Determining a rotation angle of the radar through image analysis of the input image, and rotating the radar up or down by the determined rotation angle.
The ramp-
And the radar is rotated using the actuator within a predetermined time in synchronism with the sensing and signal processing timings of the radar.
Selecting the road image boundary as a road boundary candidate;
Detecting the distance of the stationary target by rotating the radar to the left or right according to a predetermined sensing angle;
Determining whether the vehicle enters or exits a ramp;
Rotating the radar up or down using an actuator connected to the radar when the vehicle enters or exits the ramp;
Detecting a distance of the stationary target through the upward or downward rotated radar;
Selecting a road boundary candidate as a road boundary line by synthesizing a distance between the selected road boundary candidate and the detected stationary state target through distance matching and matching the distance of the detected stationary state target; And
And adding a distance between the selected road boundary line and the corresponding road boundary line to the input image to set a movable range of the vehicle.
The step of rotating the radar up or down
Determining a rotation angle of the radar according to a traveling state including the steering angle or the lateral acceleration of the vehicle and rotating the radar upward or downward by the determined rotation angle.
The step of rotating the radar up or down
Determining a rotation angle of the radar through image analysis of the input image, and rotating the radar upward or downward by the determined rotation angle.
The step of rotating the radar up or down
And the radar is rotated using the actuator within a predetermined time in synchronism with the sensing and signal processing timings of the radar.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150177293A KR101816034B1 (en) | 2015-12-11 | 2015-12-11 | Apparatus and method for detecting road boundary line using camera and radar |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150177293A KR101816034B1 (en) | 2015-12-11 | 2015-12-11 | Apparatus and method for detecting road boundary line using camera and radar |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20170069719A KR20170069719A (en) | 2017-06-21 |
KR101816034B1 true KR101816034B1 (en) | 2018-02-21 |
Family
ID=59281727
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150177293A KR101816034B1 (en) | 2015-12-11 | 2015-12-11 | Apparatus and method for detecting road boundary line using camera and radar |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101816034B1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110045376B (en) * | 2019-04-28 | 2021-06-01 | 森思泰克河北科技有限公司 | Drivable region acquisition method, computer-readable storage medium, and terminal device |
CN110550029B (en) * | 2019-08-12 | 2021-02-09 | 华为技术有限公司 | Obstacle avoiding method and device |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012225806A (en) * | 2011-04-20 | 2012-11-15 | Toyota Central R&D Labs Inc | Road gradient estimation device and program |
-
2015
- 2015-12-11 KR KR1020150177293A patent/KR101816034B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012225806A (en) * | 2011-04-20 | 2012-11-15 | Toyota Central R&D Labs Inc | Road gradient estimation device and program |
Also Published As
Publication number | Publication date |
---|---|
KR20170069719A (en) | 2017-06-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10688997B2 (en) | Lane merging determination apparatus | |
US20190235073A1 (en) | Navigation based on radar-cued visual imaging | |
US10345443B2 (en) | Vehicle cruise control apparatus and vehicle cruise control method | |
EP2983153B1 (en) | Signal recognition device | |
US10836388B2 (en) | Vehicle control method and apparatus | |
KR101594128B1 (en) | A movable system for enforcing traffic | |
US9274213B2 (en) | Method for calibrating a plurality of environment sensors in a vehicle | |
EP2927863B1 (en) | Vehicle-mounted image processing device | |
JP6787157B2 (en) | Vehicle control device | |
US10422871B2 (en) | Object recognition apparatus using a plurality of object detecting means | |
JP2005301581A (en) | Inter-vehicle communication system, inter-vehicle communication equipment and controller | |
US20190126825A1 (en) | Method and apparatus for compositing vehicle periphery images using cameras provided in vehicle | |
CN107004250B (en) | Image generation device and image generation method | |
KR20200075913A (en) | Apparatus and method for providing user interface for platooning of vehicle | |
JP2018048949A (en) | Object recognition device | |
KR102535618B1 (en) | Driver assistance system for detecting obstacle using fusion object sensing information and method thereof | |
JP4848644B2 (en) | Obstacle recognition system | |
KR101816034B1 (en) | Apparatus and method for detecting road boundary line using camera and radar | |
CN109461318B (en) | Vehicle control device and method for recognizing traffic sign | |
JP2635246B2 (en) | Inter-vehicle distance detection device for tracking the preceding vehicle | |
JP2005202787A (en) | Display device for vehicle | |
EP3139346B1 (en) | Vision system for a motor vehicle and method of controlling a vision system | |
JP6465919B2 (en) | Obstacle detection system | |
KR20170081523A (en) | Advanced driver assisted system and method for processing information in the system | |
KR101935512B1 (en) | Vehicle and controlling method for the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant |