US20160078764A1 - Parking assist system - Google Patents

Parking assist system Download PDF

Info

Publication number
US20160078764A1
US20160078764A1 US14/850,304 US201514850304A US2016078764A1 US 20160078764 A1 US20160078764 A1 US 20160078764A1 US 201514850304 A US201514850304 A US 201514850304A US 2016078764 A1 US2016078764 A1 US 2016078764A1
Authority
US
United States
Prior art keywords
area
vehicle
obstacle
parking
target position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US14/850,304
Other versions
US10031227B2 (en
Inventor
Yusuke Kiyokawa
Masaya Kato
Hiroyuki Tachibana
Tomohisa Yamashita
Tomoyuki Matsuba
Motonari Obayashi
Hironobu Ishijima
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Aisin Corp
Original Assignee
Aisin Seiki Co Ltd
Toyota Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aisin Seiki Co Ltd, Toyota Motor Corp filed Critical Aisin Seiki Co Ltd
Assigned to AISIN SEIKI KABUSHIKI KAISHA, TOYOTA JIDOSHA KABUSHIKI KAISHA reassignment AISIN SEIKI KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KATO, MASAYA, KIYOKAWA, YUSUKE, MATSUBA, Tomoyuki, Ishijima, Hironobu, OBAYASHI, Motonari, TACHIBANA, HIROYUKI, YAMASHITA, TOMOHISA
Publication of US20160078764A1 publication Critical patent/US20160078764A1/en
Application granted granted Critical
Publication of US10031227B2 publication Critical patent/US10031227B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/93Sonar systems specially adapted for specific applications for anti-collision purposes
    • G01S15/931Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/14Adaptive cruise control
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/14Traffic control systems for road vehicles indicating individual free spaces in parking areas
    • G08G1/141Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces
    • G08G1/143Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces inside the vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/18Conjoint control of vehicle sub-units of different type or different function including control of braking systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/20Conjoint control of vehicle sub-units of different type or different function including control of steering systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/06Automatic manoeuvring for parking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D15/00Steering not otherwise provided for
    • B62D15/02Steering position indicators ; Steering position determination; Steering aids
    • B62D15/027Parking aids, e.g. instruction means
    • B62D15/0285Parking performed automatically
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/168Driving aids for parking, e.g. acoustic or visual feedback on parking space
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2510/00Input parameters relating to a particular sub-units
    • B60W2510/18Braking system
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2510/00Input parameters relating to a particular sub-units
    • B60W2510/20Steering systems
    • B60W2510/202Steering torque
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00Input parameters relating to overall vehicle dynamics
    • B60W2520/28Wheel speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/10Accelerator pedal position
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/93Sonar systems specially adapted for specific applications for anti-collision purposes
    • G01S15/931Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2015/932Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles for parking operations

Definitions

  • the invention relates to a parking assist system.
  • JP 2009-101984 A Japanese Patent Application Publication No. 2009-101984
  • the target position When a target position is determined on the basis of only the detected results of the ultrasonic sensors, the target position may deviate from a parking space. When a target position is determined on the basis of only the images, the target position may be close to an obstacle. Therefore, it may be difficult to determine a target position. For example, it is desirable to obtain a parking assist system that is able to determine a target position at a less inconvenient position.
  • An aspect of the invention provides a parking assist system.
  • the parking assist system includes an electronic control unit.
  • the electronic control unit is configured to detect an obstacle, detect a boundary of a parking space, determine a target position to which a vehicle moves, and, when the vehicle is allowed to be located in a third area in which a first area and a second area overlap with each other, be allowed to determine the target position in the third area.
  • the first area is an area across a limit line from the obstacle.
  • the limit line is set substantially along an outer periphery of the obstacle at a position spaced a predetermined distance from the obstacle outward of the obstacle.
  • the second area is an area out of the boundary.
  • FIG. 1 is an exemplary perspective view of a vehicle according to an embodiment in a state where part of a cabin is seen through;
  • FIG. 2 is an exemplary plan view (bird's-eye view) of the vehicle according to the embodiment
  • FIG. 3 is a view of an example of a dashboard of the vehicle according to the embodiment when viewed from the rear side of the vehicle;
  • FIG. 4 is an exemplary block diagram of the configuration of a parking assist system according to the embodiment.
  • FIG. 5 is an exemplary block diagram of the configuration of part of an ECU of the parking assist system according to the embodiment
  • FIG. 6 is a flowchart that shows an example of the procedure of a process that is executed by the parking assist system according to the embodiment
  • FIG. 7 is a schematic plan view of an example of a set candidate position of a target position and an obstacle and parking boundary detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 8 is a schematic plan view of another example of a set candidate position of a target position and an obstacle and parking boundary detected by the parking assist system according to the embodiment, and is a view in the case where no candidate position is set;
  • FIG. 9 is a schematic plan view of further another example of a set candidate position of a target position and an obstacle and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 10 is a schematic plan view of yet another example of a set candidate position of a target position and an obstacle and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 11 is a schematic plan view of further another example of a set candidate position of a target position and obstacles and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 12 is a schematic plan view of further another example of a set candidate position of a target position and obstacles and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where no candidate position is set;
  • FIG. 13 is a schematic plan view of an example of a set candidate position of a target position and obstacles and parking boundaries detected by the parking assist system according to the embodiment, and is a view that shows an example of an orientation of a vehicle at a candidate position;
  • FIG. 14 is a schematic plan view that shows an example of a position of the vehicle, positions of an obstacle and a parking boundary, and a target position in the parking assist system according to the embodiment, and is a view in a state where the vehicle is distant from the target position;
  • FIG. 15 is a schematic plan view that shows an example of a position of the vehicle, positions of an obstacle and a parking boundary, and a target position in the parking assist system according to the embodiment, and is a view in a state where the vehicle is close to the target position.
  • a vehicle 1 according to the present embodiment may be, for example, an automobile that uses an internal combustion engine (not shown) as a drive source, that is, an internal combustion engine automobile, may be an automobile that uses an electric motor (not shown) as a drive source, that is, an electric automobile, a fuel-cell automobile, or the like, may be a hybrid automobile that uses both the internal combustion engine and the electric motor as drive sources, or may be an automobile including another drive source.
  • Various transmissions may be mounted on the vehicle 1 .
  • Various devices, such as system and components, required to drive an internal combustion engine or an electric motor may be mounted on the vehicle 1 .
  • the system, number, layout, and the like, of a device related to driving of wheels 3 in the vehicle 1 may be variously set.
  • a vehicle body 2 constitutes a cabin 2 a in which an occupant (not shown) is seated.
  • a steering unit 4 an accelerator operation unit 5 , a brake operation unit 6 , a shift operation unit 7 , and the like, are provided near a seat 2 b of a driver as an occupant inside the cabin 2 a.
  • the steering unit 4 is, for example, a steering wheel projecting from a dashboard 24 .
  • the accelerator operation unit 5 is, for example, an accelerator pedal located near driver's foot.
  • the brake operation unit 6 is, for example, a brake pedal located near driver's foot.
  • the shift operation unit 7 is, for example, a shift lever projecting from a center console.
  • the steering unit 4 , the accelerator operation unit 5 , the brake operation unit 6 , the shift operation unit 7 , and the like, are not limited to these components.
  • a display device 8 and an audio output device 9 are provided inside the cabin 2 a.
  • the display device 8 serves as a display output unit.
  • the audio output device 9 serves as an audio output unit.
  • the display device 8 is, for example, a liquid crystal display (LCD), an organic electroluminescent display (OELD), or the like.
  • the audio output device 9 is, for example, a speaker.
  • the display device 8 is, for example, covered with a translucent operation input unit 10 , such as a touch panel. An occupant is allowed to visually recognize an image that is displayed on the display screen of the display device 8 via the operation input unit 10 .
  • An occupant is allowed to perform an operation input by operating the operation input unit 10 through touching, pressing or moving the operation input unit 10 with a finger, or the like, at a position corresponding to an image that is displayed on the display screen of the display device 8 .
  • These display device 8 , audio output device 9 , operation input unit 10 , and the like are, for example, provided in a monitor device 11 located at the center in the vehicle width direction, that is, transverse direction, of the dashboard 24 .
  • the monitor device 11 may have an operation input unit (not shown), such as a switch, a dial, a joystick and a push button.
  • An audio output device (not shown) may be provided at another position inside the cabin 2 a, different from the monitor device 11 . Audio may be output from the audio output device 9 of the monitor device 11 and another audio output device.
  • the monitor device 11 is, for example, shared with a navigation system or an audio system.
  • a display device 12 different from the display device 8 is provided inside the cabin 2 a.
  • the display device 12 is, for example, provided in an instrument panel unit 25 in the dashboard 24 , and is located at substantially the center of the instrument panel unit 25 between a speed indicating unit 25 a and a rotation speed indicating unit 25 b.
  • the size of the screen 12 a of the display device 12 is smaller than the size of the screen 8 a of the display device 8 .
  • An image that shows information for assisting in parking the vehicle 1 may be mainly displayed on the display device 12 .
  • the amount of information that is displayed on the display device 12 may be smaller than the amount of information that is displayed on the display device 8 .
  • the display device 12 is, for example, an LCD, an OELD, or the like. Information that is displayed on the display device 12 may be displayed on the display device 8 .
  • the vehicle 1 is, for example a four-wheel vehicle, and includes two right and left front wheels 3 F and two right and left rear wheels 3 R. Each of these four wheels 3 may be configured to be steerable.
  • the vehicle 1 includes a steering system that steers at least two of the wheels 3 .
  • the steering system 13 includes an actuator 13 a and a torque sensor 13 b.
  • the steering system 13 is electrically controlled by an electronic control unit (ECU) 14 , or the like, to actuate the actuator 13 a.
  • the steering system 13 is, for example, an electric power steering system, a steer-by-wire (SBW) system, or the like.
  • the steering system 13 adds torque, that is, assist torque, to the steering unit 4 with the use of the actuator 13 a to compensate for steering force or steers the wheels 3 with the use of the actuator 13 a.
  • the actuator 13 a may steer one of the wheels 3 or may steer a plurality of the wheels 3 .
  • the torque sensor 13 b detects a torque that is applied to the steering unit 4 by a driver.
  • each of the imaging units 15 is, for example, a digital camera that incorporates an imaging device, such as a charge coupled device (CCD) and a CMOS image sensor (CIS).
  • Each of the imaging units 15 is able to output moving image data at a predetermined frame rate.
  • Each of the imaging units 15 has a wide angle lens or a fisheye lens, and is able to capture an image in, for example, the range of 140° to the range of 190° in the horizontal direction.
  • the optical axis of each of the imaging units 15 is set so as to be oriented obliquely downward.
  • each of the imaging units 15 sequentially captures a road surface on which the vehicle 1 is allowed to move and an outside environment around the vehicle body 2 , including an area in which the vehicle 1 is allowed to be parked, and outputs the captured image as captured image data.
  • the imaging unit 15 a is, for example, located at a rear end 2 e of the vehicle body 2 , and is provided at a lower wall portion of a door 2 h of a rear boot.
  • the imaging unit 15 b is, for example, located at a right-side end 2 f of the vehicle body 2 , and is provided at a right-side door mirror 2 g.
  • the imaging unit 15 c is, for example, located at the front of the vehicle body 2 , that is, a front end 2 c in the vehicle longitudinal direction, and is provided at a front bumper, or the like.
  • the imaging unit 15 d is, for example, located at the left side of the vehicle body 2 , that is, a left-side end 2 d in the vehicle width direction, and is provided at a door mirror 2 g that serves as a left-side projecting portion.
  • the ECU 14 is able to generate an image having a wider viewing angle or generate an imaginary bird's-eye image of the vehicle 1 from above by executing operation processing and image processing on the basis of the image data obtained by the imaging units 15 .
  • a bird's-eye image may be referred to as plan image.
  • the ECU 14 identifies partition lines, or the like, on a road surface around the vehicle 1 from the images of the imaging units 15 , and detects (extracts) parking spaces indicated by the partition lines, or the like.
  • each of the distance measuring units 16 , 17 is, for example, a sonar that emits ultrasonic wave and captures the reflected wave.
  • the sonar may also be referred to as a sonar sensor or an ultrasonic detector.
  • the ECU 14 is able to detect whether there is an object, such as an obstacle, located around the vehicle 1 or measure a distance to the object on the basis of the detected results of the distance measuring units 16 , 17 .
  • each of the distance measuring units 16 , 17 is an example of a detection unit that detects an object.
  • Each of the distance measuring units 17 may be, for example, used to detect an object at a relatively close distance.
  • Each of the distance measuring units 16 may be, for example, used to detect an object at a relatively long distance, which is distant from an object that each of the distance measuring units 17 detects.
  • the distance measuring units 17 may be, for example, used to detect an object ahead of or behind the vehicle 1 .
  • the distance measuring units 16 may be, for example, used to detect an object to the side of the vehicle 1 .
  • a brake system 18 in addition to the ECU 14 , the monitor device 11 , the steering system 13 , the distance measuring units 16 , 17 , and the like, a brake system 18 , a steering angle sensor 19 , an accelerator sensor 20 , a shift sensor 21 , a wheel speed sensor 22 , and the like, are electrically connected to one another via an in-vehicle network 23 that serves as an electric communication line.
  • the in-vehicle network 23 is, for example, provided as a controller area network (CAN).
  • the ECU 14 is able to control the steering system 13 , the brake system 18 , and the like, by transmitting control signals through the in-vehicle network 23 .
  • the ECU 14 is able to receive detected results of the torque sensor 13 b, a brake sensor 18 b, the steering angle sensor 19 , the distance measuring units 16 , the distance measuring units 17 , the accelerator sensor 20 , the shift sensor 21 , the wheel speed sensor 22 , and the like, and operation signals of the operation input unit 10 , and the like, via the in-vehicle network 23 .
  • the ECU 14 includes a central processing unit (CPU) 14 a, a read only memory (ROM) 14 b, a random access memory (RAM) 14 c, a display control unit 14 d, an audio control unit 14 e, a solid state drive or flash memory (SSD) 14 f, and the like.
  • the CPU 14 a is, for example, able to execute various operation processing and control, such as image processing related to images that are displayed on the display devices 8 , 12 , determination of a target position of the vehicle 1 , computation of a moving path of the vehicle 1 , determination as to whether there is an interference with an object, automatic control over the vehicle 1 , and cancellation of automatic control.
  • the CPU 14 a is able to read a program installed and stored in a nonvolatile storage device, such as the ROM 14 b, and execute operation processing in accordance with the program.
  • the RAM 14 c temporarily stores various pieces of data that are used for computation in the CPU 14 a.
  • the display control unit 14 d mainly executes image processing by the use of image data obtained by the imaging units 15 , synthesis of image data that are displayed on the display device 8 , and the like, within the operation processing in the ECU 14 .
  • the audio control unit 14 e mainly processes audio data that are output from the audio output device 9 within the operation processing in the ECU 14 .
  • the SSD 14 f is a rewritable nonvolatile storage unit, and is able to store data even when the power of the ECU 14 is turned off.
  • the CPU 14 a, the ROM 14 b, the RAM 14 c, and the like, may be integrated within the same package.
  • the ECU 14 may be formed of another logical operation processor, such as a digital signal processor (DSP), a logical circuit, or the like, instead of the CPU 14 a.
  • a hard disk drive (HDD) may be provided instead of the SSD 14 f.
  • the SSD 14 f or the HDD may be provided separately from the ECU 14 .
  • the ECU 14 is an example of an electronic control unit of a parking assist system.
  • the brake system 18 is, for example, an anti-lock brake system (ABS) that prevents the brake from locking up the wheels, a side slip prevention device (electronic stability control (ESC)) that prevents a side slip of the vehicle 1 during cornering, an electric brake system that enhances brake force (performs brake assist), a brake-by-wire (BBW), or the like.
  • ABS anti-lock brake system
  • ESC electronic stability control
  • BBW brake-by-wire
  • the brake system 18 imparts braking force to the wheels 3 and, by extension, the vehicle 1 , via the actuator 18 a.
  • the brake system 18 is able to execute various controls by detecting locking up of the wheels by the brake, a spin of the wheels 3 , a sign of a side slip, and the like, from, for example, a rotation difference between the right and left wheels 3 .
  • the brake sensor 18 b is, for example, a sensor that detects the position of a movable unit of the brake operation unit 6 .
  • the brake sensor 18 b is able to detect the position of the brake pedal that serves as the movable unit.
  • the brake sensor 18 b includes a displacement sensor.
  • the steering angle sensor 19 is, for example, a sensor that detects a steering amount of the steering unit 4 , such as the steering wheel.
  • the steering angle sensor 19 is, for example, provided by using a Hall element, or the like.
  • the ECU 14 acquires a driver's steering amount of the steering unit 4 , a steering amount of each wheel 3 during automatic steering, or the like, from the steering angle sensor 19 , and executes various controls.
  • the steering angle sensor 19 detects a rotation angle of a rotating portion included in the steering unit 4 .
  • the steering angle sensor 19 is an example of an angle sensor.
  • the accelerator sensor 20 is, for example, a sensor that detects the position of a movable unit of the accelerator operation unit 5 .
  • the accelerator sensor 20 is able to detect the position of the accelerator pedal that serves as the movable unit.
  • the accelerator sensor 20 includes a displacement sensor.
  • the shift sensor 21 is, for example, a sensor that detects the position of a movable unit of the shift operation unit 7 .
  • the shift sensor 21 is able to detect the position of a lever, an arm, a button, or the like, that serves as the movable unit.
  • the shift sensor 21 may include a displacement sensor or may be provided as a switch.
  • the wheel speed sensor 22 is a sensor that detects a rotation amount or rotation speed of each wheel 3 per unit time.
  • the wheel speed sensor 22 outputs a wheel speed pulse number, indicating the detected rotation speed, as a sensor value.
  • the wheel speed sensor 22 may be, for example, provided by using a Hall element, or the like.
  • the ECU 14 computes a moving amount, and the like, of the vehicle 1 on the basis of the sensor value acquired from the wheel speed sensor 22 , and executes various controls. There is a case where the wheel speed sensor 22 is provided in the brake system 18 . In this case, the ECU 14 acquires the detected result of the wheel speed sensor 22 via the brake system 18 .
  • the ECU 14 includes an acquisition unit 141 , an obstacle detection unit 142 , a parking space detection unit 143 , a candidate position setting unit 144 , a target position determination unit 145 , an output information control unit 146 , a path calculation unit 147 , a guidance control unit 148 , an orientation setting unit 150 , a storage unit 149 , and the like.
  • the CPU 14 a functions as the acquisition unit 141 , the obstacle detection unit 142 , the parking space detection unit 143 , the candidate position setting unit 144 , the target position determination unit 145 , the output information control unit 146 , the path calculation unit 147 , the guidance control unit 148 , the orientation setting unit 150 , or the like, by executing a process in accordance with a corresponding program.
  • Data that are used in operation processes of the units, data of results in operation processes, and the like, are stored in the storage unit 149 . At least part of the functions of the above-described units may be implemented by hardware.
  • the acquisition unit 141 acquires various pieces of data, signal, and the like.
  • the acquisition unit 141 for example, acquires data, signals, and the like, such as detected results of the sensors, operation inputs, input commands, and image data.
  • the acquisition unit 141 is able to acquire a signal resulting from an operation input of the operation unit 14 g.
  • the operation unit 14 g is, for example, a push button, a switch, or the like.
  • the obstacle detection unit 142 detects an obstacle that interferes with traveling of the vehicle 1 .
  • the obstacle is, for example, another vehicle, a wall, a pole, a fence, a protrusion, a step, a sprag, an object, or the like.
  • the obstacle detection unit 142 is able to detect whether there is an obstacle, the height of an obstacle, the size of an obstacle, and the like, by the use of various techniques.
  • the obstacle detection unit 142 is, for example, able to detect an obstacle on the basis of detected results of the distance measuring units 16 , 17 .
  • Each of the distance measuring units 16 , 17 is able to detect an object corresponding to the height of its beam and is not able to detect an object lower than the height of the beam.
  • the obstacle detection unit 142 is able to detect the height of an obstacle on the basis of the detected results of the distance measuring units 16 , 17 and the heights of beams of the distance measuring units 16 , 17 .
  • the obstacle detection unit 142 may detect whether there is an obstacle or the height of an obstacle on the basis of a detected result of the wheel speed sensor 22 or an acceleration sensor (not shown) and detected results of the distance measuring units 16 , 17 .
  • the obstacle detection unit 142 may, for example, detect the height of an obstacle through image processing based on images captured by the imaging units 15 .
  • the parking space detection unit 143 detects a parking space that is provided as a mark or an object.
  • the parking space is a space that is a target or reference set such that the vehicle 1 is parked in that place.
  • a parking boundary is a boundary or outer periphery of the parking space, and is, for example, a partition line, a frame line, a straight line, a band, a step, an edge of any one of them, or the like. That is, the parking boundary is a mark, an object, or the like.
  • the parking space detection unit 143 is, for example, able to detect a parking space and a parking boundary through image processing based on images captured by the imaging units 15 .
  • the parking space detection unit 143 is an example of a parking boundary detection unit.
  • the candidate position setting unit 144 sets at least one candidate position that is a candidate for a target position, that is, a terminal position of a moving path of the vehicle 1 .
  • the candidate position setting unit 144 for example, sets a candidate position on the basis of at least one of a detected result of the obstacle detection unit 142 or a detected result of the parking space detection unit 143 .
  • the orientation setting unit 150 sets the orientation of the vehicle 1 at each candidate position.
  • the orientation setting unit 150 for example, sets the orientation of the vehicle 1 at a candidate position on the basis of at least one of a detected result of the obstacle detection unit 142 or a detected result of the parking space detection unit 143 .
  • the orientation setting unit 150 sets the orientation on the basis of the parking space.
  • the target position determination unit 145 determines a target position from among at least one candidate position.
  • the target position determination unit 145 is, for example, able to determine a high-rank candidate position, that is, an upper-level candidate position, as a target position, from among at least one candidate position ranked on the basis of a predetermined condition.
  • the target position determination unit 145 is, for example, able to determine a candidate position corresponding to an occupant's operation input, that is, a candidate position selected by the occupant, as a target position from among at least one candidate position.
  • the output information control unit 146 controls the display control unit 14 d or the audio control unit 14 e, by extension, the display device 8 , the display device 12 or the audio output device 9 , such that the display device 8 , the display device 12 or the audio output device 9 outputs intended information in an intended mode at each of steps, such as a start of parking assist, an end of parking assist, determination of a target position, calculation of a path and guidance control.
  • the path calculation unit 147 calculates a moving path from the current position of the vehicle 1 to the target position on the basis of the current position of the vehicle 1 , that is, the host vehicle, the determined target position, the detected obstacle, and the like.
  • the guidance control unit 148 controls the portions such that the vehicle 1 moves along the calculated moving path.
  • the guidance control unit 148 is, for example, able to move the vehicle 1 along the moving path by controlling the steering system 13 in response to the position of the vehicle 1 .
  • the guidance control unit 148 may control not only the steering system 13 but also a drive mechanism, such as an engine and a motor, the brake system 18 that serves as a braking mechanism, or the like.
  • the guidance control unit 148 may, for example, inform the driver of movement of the vehicle 1 along the moving path through display output or audio output commensurate with the position of the vehicle 1 by controlling the output information control unit 146 , the display control unit 14 d or the audio control unit 14 e, by extension, the display device 8 , the display device 12 or the audio output device 9 .
  • the storage unit 149 stores data that are used in computation in the ECU 14 or data calculated in computation in the ECU 14 .
  • the obstacle detection unit 142 detects an obstacle (S 1 ), and the parking space detection unit 143 detects a parking space and a parking boundary (S 2 ).
  • the candidate position setting unit 144 sets at least one candidate position that is a candidate for a target position, that is, terminal position, of the moving path of the vehicle 1 on the basis of the detected results of S 1 and S 2 (S 3 ).
  • the acquisition unit 141 acquires an operation input that issues a command to start parking assist (S 4 ). That is, in the present embodiment, for example, before an operation command is input, S 1 to S 3 are executed.
  • the target position determination unit 145 determines a target position from among at least one candidate position (S 5 ).
  • the target position determination unit 145 is able to rank each of the at least one candidate position, and determine the highest-rank candidate position as the target position.
  • the target position determination unit 145 may determine a candidate position, selected on the basis of an occupant's operation input, as the target position.
  • the path calculation unit 147 calculates a moving path from the current position of the vehicle 1 to the determined target position (S 6 ).
  • the guidance control unit 148 controls the portions such that the vehicle 1 moves along the calculated moving path (S 7 ).
  • the target position, the moving path, or the like may be corrected or updated as needed in the middle of movement of the vehicle 1 along the moving path.
  • FIG. 7 to FIG. 12 are exemplary schematic views of detected obstacles B and parking boundaries D and a candidate position C on a two-dimensional coordinate system.
  • FIG. 7 to FIG. 12 illustrate detected results obtained at the time when the vehicle 1 passes by the front of the obstacles B and the parking boundaries D in the leftward direction (traveling direction V) of each drawing in a place in which a plurality of parking spaces in which the vehicle 1 is double parked in position in which the vehicle front is oriented upward in each drawing are set.
  • the two-dimensional coordinate system is, for example, a coordinate system along a road surface with an origin set at the host vehicle.
  • the target position determination unit 145 determines a target position from among at least one candidate position C set by the candidate position setting unit 144 . That is, the target position determination unit 145 is able to determine a position set for the candidate position C as a target position but the target position determination unit 145 is not able to determine a position not set for the candidate position C as a target position. Thus, the following condition for setting a candidate position C is also a condition for setting a target position.
  • FIG. 7 to FIG. 12 show detected results at the time when the vehicle 1 passes by the upper side of each drawing in the leftward direction (traveling direction V), so the obstacle B is, for example, detected in a downward-open inverted U shape in each drawing.
  • the parking boundary D is detected from image data captured by the imaging units 15 .
  • An image of each parking boundary D is detected as a linear or band-shaped area. Detected results vary depending on settings of the distance measuring units 16 , 17 and imaging units 15 .
  • a limit line L is set substantially along the outer periphery of the obstacle B at a position spaced a predetermined distance d from the outer periphery of the obstacle B.
  • the limit line L is, for example, a straight line, and is set in correspondence with a section B 1 of the obstacle B, extending in a direction that intersects with the traveling direction V of the traveling vehicle 1 and spaced apart from the corner.
  • the limit line L may be, for example, obtained through regression analysis, such as a method of least squares, on the section B 1 . That is, the limit line L extends in the direction that intersects with the traveling direction V of the traveling vehicle 1 .
  • the limit line L is not limited to a straight line.
  • the candidate position C is set on a side across the limit line L from the obstacle B, and is not set on the obstacle B side of the limit line L.
  • the candidate position setting unit 144 is able to identify an area across the limit line L from the obstacle B on the basis of a detected position of the obstacle B and a position (coordinates) of the limit line L. By such settings, at least a certain distance, that is, a clearance, is ensured between the obstacle B and the vehicle 1 located at the candidate position C.
  • the candidate position setting unit 144 sets a candidate position C such that the candidate position C does not overlap with the parking boundary D. That is, a candidate position C is set in an area that does not overlap with the parking boundary D, that is, an area out of the parking boundary D, within an intended area (an area allowed to be set).
  • the candidate position setting unit 144 determines whether a candidate position C is allowed to be set in a third area A 3 between the limit line L and the parking boundary D.
  • the third area A 3 is an area in which a first area A 1 and a second area A 2 overlap with each other.
  • the first area A 1 is an area across the limit line L from the obstacle B.
  • the second area A 2 is an area out of the parking boundary D.
  • the second area A 2 is also regarded as an area across one of boundary lines D 1 from the parking boundary D.
  • the boundary lines D 1 extend in the longitudinal direction of the parking boundary D along end edges of the parking boundary D in the width direction (transverse direction in FIG. 7 and FIG. 8 ).
  • the second area A 2 is an area other than the detected parking boundary D, an area that does not overlap with the parking boundary D, an area on one side or the other side of the parking boundary D in the transverse direction, that is, the width direction, and an area outside of the parking boundary D.
  • the size of the third area A 3 is larger than the size of the vehicle at the candidate position C.
  • the candidate position setting unit 144 sets a candidate position C in the third area A 3 shown in FIG. 7 .
  • the size of the third area A 3 is smaller than the size of the vehicle at the candidate position C.
  • the candidate position setting unit 144 does not set a candidate position C in the third area A 3 shown in FIG. 8 .
  • the candidate position setting unit 144 sets a candidate position C in the vehicle width direction of the candidate position C such that the candidate position C is located at the center of the third area A 3 .
  • the candidate position setting unit 144 sets a candidate position C in the vehicle longitudinal direction of the candidate position C such that the candidate position C is located at the center between ends of the parking boundary D in the longitudinal direction.
  • a manner of setting a candidate position C in the third area A 3 is not limited to this example.
  • the front end of the candidate position C and the front end of the parking boundary D may be aligned in the vehicle longitudinal direction at the candidate position.
  • the vehicle longitudinal direction at the candidate position may be set to the longitudinal direction of the parking boundary D.
  • FIG. 9 and FIG. 10 illustrate a space S 2 adjacent to an obstacle B and in which mutually spaced two parking boundaries D are detected.
  • the candidate position setting unit 144 determines for the obstacle B and the parking boundaries D detected in the space S 2 whether a candidate position C is allowed to be set in the third area A 3 in which the first area A 1 and the second area A 2 overlap with each other.
  • the first area is an area across the limit line L from the obstacle B.
  • the second area A 2 is an area outside of the parking boundaries D.
  • the third area A 3 is between the two parking boundaries D.
  • the third area A 3 is between the left-side parking boundary D in the drawing and the limit line L.
  • the obstacle B is relatively distant from the right-side parking boundary D in FIG. 9 , and the size of the third area A 3 is larger than the size of the vehicle at the candidate position C.
  • the candidate position setting unit 144 sets a candidate position C in the third area A 3 in FIG. 9 .
  • the obstacle B overlaps with the right-side parking boundary D; however, the size of the third area A 3 between the left-side parking boundary D and the limit line L is larger than the size of the vehicle at the candidate position C.
  • the candidate position setting unit 144 sets a candidate position C in the third area A 3 in FIG. 10 .
  • FIG. 11 and FIG. 12 illustrate a space S 3 between two obstacles B and in which mutually spaced two parking boundaries D are detected.
  • the candidate position setting unit 144 determines for the obstacles B and parking boundaries D detected in the space S 3 whether a candidate position C is allowed to be set in the third area A 3 in which the first area A 1 and the second area A 2 overlap with each other.
  • the first area A 1 is an area across each limit line L from the corresponding obstacle B.
  • the second area A 2 is an area outside of the parking boundaries D.
  • the third area A 3 is between the two limit lines L.
  • the size of the third area A 3 is larger than the size of the vehicle at the candidate position C.
  • the candidate position setting unit 144 sets a candidate position C in the third area A 3 in FIG. 11 .
  • one of the obstacles B overlaps with the right-side parking boundary D, and the size of the third area A 3 is smaller than the size of the vehicle at the candidate position C.
  • the candidate position setting unit 144 does not set a candidate position C in the third area A 3 in FIG. 12 .
  • FIG. 13 is an exemplary schematic view of detected obstacles B and parking boundaries D and a candidate position C on a two-dimensional coordinate system.
  • FIG. 13 illustrates detected results obtained at the time when the vehicle 1 passes by the front of the obstacles B and the parking boundaries D in the leftward direction (traveling direction V) of FIG. 13 in a place in which a plurality of parking spaces in which the vehicle 1 is double parked in position in which the vehicle front is oriented upward in FIG. 13 are set.
  • the orientation setting unit 150 sets the orientation Cv of the vehicle 1 at the candidate position C on the basis of one or a plurality of parking boundaries D.
  • the orientation Cv is, for example, the forward side of the vehicle 1 located at the candidate position C.
  • the orientation setting unit 150 sets the orientation Cv parallel to the direction in which the one parking boundary D extends; when two parking boundaries D are detected, the orientation setting unit 150 sets the orientation Cv to a direction between directions Dv in which the two parking boundaries D respectively extend. For example, when angles of the two directions Dv with respect to a reference direction are ⁇ 1 , ⁇ 2 , an angle ⁇ of the orientation Cv with respect to the reference direction is set to ( ⁇ 1 + ⁇ 2 )/2.
  • the orientation setting unit 150 sets the orientation Cv to a direction between directions of two limit lines L or a direction parallel to a direction of one limit line L.
  • Each direction Dv is, for example, obtained through regression analysis, such as a method of least squares, on each detected parking boundary D.
  • the target position determination unit 145 is able to change the target position T in the middle of movement of the vehicle 1 along the moving path.
  • the target position T is a candidate position C.
  • the vehicle 1 moves backward along the moving path and becomes close to the target position T, the vehicle 1 is close to an obstacle B near the target position T or a parking boundary D (parking space), so a detection range or detection accuracy of an obstacle B or a parking boundary D improves.
  • the imaging unit 15 a or distance measuring units 17 provided at the rear of the vehicle body 2 as illustrated in FIG. 1 and FIG. 2 are further accurately used as compared to the position in FIG. 14 .
  • the target position determination unit 145 may update the target position T and the orientation Cv of the vehicle 1 at the target position T through a similar computation to that of the candidate position setting unit 144 on the basis of a detected obstacle B or parking boundary D at the position P 1 in the middle of movement of the vehicle 1 .
  • the target position determination unit 145 is allowed to align a rear end T 1 of the target position T and the rear end B 2 of the obstacle B with each other in the vehicle longitudinal direction.
  • the target position determination unit 145 updates the target position T such that the rear end T 1 of the target position T and the rear end B 2 of the obstacle B are arranged next to each other in the vehicle width direction.
  • the target position T of the vehicle 1 may be updated on the basis of the detected obstacles B by the distance measuring units 16 a, 16 b provided at the side of the vehicle body 2 as illustrated in FIG. 1 and FIG. 2 .
  • Such control is, for example, effective when a parking boundary D is short and located in correspondence with the front side of a parking space and the parking boundary D has no portion corresponding to the rear side of the parking space.
  • the candidate position setting unit 144 sets a target position T in the third area A 3 .
  • the first area A 1 is an area across each limit line L from the corresponding obstacle B.
  • Each limit line L is set substantially along the outer periphery of the corresponding obstacle B at a position spaced the predetermined distance d from each obstacle B outward of the obstacle B.
  • the second area A 2 is an area out of the parking boundaries D.
  • the target position determination unit 145 is allowed to determine the target position T in the third area A 3 .
  • the target position determination unit 145 is able to determine a less inconvenient position as a target position.
  • the orientation setting unit 150 sets a candidate position C, that is, an orientation Cv of the vehicle 1 at a target position T, on the basis of a parking boundary D.
  • the orientation of the vehicle 1 at the target position T tends to match with the parking space.
  • the target position determination unit 145 is able to update the target position T on the basis of at least one of a detected obstacle B or a detected parking boundary D in the middle of movement of the vehicle 1 to the target position T.
  • the target position T further tends to match with the obstacle B or the parking space.
  • the embodiment of the invention is illustrated above; however, the above-described embodiment is illustrative, and is not intended to limit the scope of the invention.
  • the embodiment may be implemented in other various forms, and may be variously omitted, replaced, combined or changed without departing from the spirit of the invention.
  • the components and shapes of each embodiment may be partially replaced.
  • the specifications (structure, type, orientation, shape, size, length, width, height, number, arrangement, position, and the like) of each component, or the like, may be changed as needed.
  • the invention is applicable to parking assist in parking places and parking spaces in various forms.
  • the way of detecting or the way of setting the position and orientation of the vehicle and the candidate position and its orientation, bases for the position and orientation of the vehicle and the candidate position and its orientation, or the like, may be variously set or changed.
  • An input signal may be based on an audio input to a microphone.
  • the parking assist system includes an obstacle detection unit 142 that detects an obstacle B, a parking space detection unit 143 that detects a boundary D of a parking space and a target position determination unit 145 that determines a target position to which a vehicle 1 moves.
  • the target position determination unit 145 is allowed to determine the target position in the third area A 3 .
  • the first area A 1 is an area across a limit line L from the obstacle B.
  • the limit line L is set substantially along an outer periphery of the obstacle B at a position spaced a predetermined distance from the obstacle B outward of the obstacle B.
  • the second area A 2 is an area out of the boundary D.
  • a target position may be determined at a position that is spaced apart from an obstacle B and that falls within a parking space.
  • the parking assist system for example, includes an orientation setting unit 150 that sets an orientation Cv of the vehicle at the target position on the basis of the boundary D.
  • an orientation setting unit 150 that sets an orientation Cv of the vehicle at the target position on the basis of the boundary D.
  • the orientation of the vehicle 1 at the target position tends to match with the parking space.
  • the target position determination unit 145 is able to update the target position on the basis of at least one of the detected obstacle B or the detected boundary D in the middle of movement of the vehicle 1 to the target position.
  • the target position further tends to match with the obstacle B or the parking space.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Acoustics & Sound (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Mathematical Physics (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)

Abstract

A parking assist system includes an electronic control unit. The electronic control unit is configured to detect an obstacle, detect a boundary of a parking space, determine a target position to which a vehicle moves, and, when the vehicle is allowed to be located in a third area in which a first area and a second area overlap with each other, be allowed to determine the target position in the third area. The first area is an area across a limit line from the obstacle. The limit line is set substantially along an outer periphery of the obstacle at a position spaced a predetermined distance from the obstacle outward of the obstacle. The second area is an area out of the boundary.

Description

    INCORPORATION BY REFERENCE
  • The disclosure of Japanese Patent Application No. 2014-186823 filed on Sep. 12, 2014 including the specification, drawings and abstract is incorporated herein by reference in its entirety.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The invention relates to a parking assist system.
  • 2. Description of Related Art
  • Generally, there is known a parking assist system that determines a parking target position on the basis of detected results of ultrasonic sensors or captured images (for example, Japanese Patent Application Publication No. 2009-101984 (JP 2009-101984 A)).
  • SUMMARY OF THE INVENTION
  • When a target position is determined on the basis of only the detected results of the ultrasonic sensors, the target position may deviate from a parking space. When a target position is determined on the basis of only the images, the target position may be close to an obstacle. Therefore, it may be difficult to determine a target position. For example, it is desirable to obtain a parking assist system that is able to determine a target position at a less inconvenient position.
  • An aspect of the invention provides a parking assist system. The parking assist system includes an electronic control unit. The electronic control unit is configured to detect an obstacle, detect a boundary of a parking space, determine a target position to which a vehicle moves, and, when the vehicle is allowed to be located in a third area in which a first area and a second area overlap with each other, be allowed to determine the target position in the third area. The first area is an area across a limit line from the obstacle. The limit line is set substantially along an outer periphery of the obstacle at a position spaced a predetermined distance from the obstacle outward of the obstacle. The second area is an area out of the boundary.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Features, advantages, and technical and industrial significance of exemplary embodiments of the invention will be described below with reference to the accompanying drawings, in which like numerals denote like elements, and wherein:
  • FIG. 1 is an exemplary perspective view of a vehicle according to an embodiment in a state where part of a cabin is seen through;
  • FIG. 2 is an exemplary plan view (bird's-eye view) of the vehicle according to the embodiment;
  • FIG. 3 is a view of an example of a dashboard of the vehicle according to the embodiment when viewed from the rear side of the vehicle;
  • FIG. 4 is an exemplary block diagram of the configuration of a parking assist system according to the embodiment;
  • FIG. 5 is an exemplary block diagram of the configuration of part of an ECU of the parking assist system according to the embodiment;
  • FIG. 6 is a flowchart that shows an example of the procedure of a process that is executed by the parking assist system according to the embodiment;
  • FIG. 7 is a schematic plan view of an example of a set candidate position of a target position and an obstacle and parking boundary detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 8 is a schematic plan view of another example of a set candidate position of a target position and an obstacle and parking boundary detected by the parking assist system according to the embodiment, and is a view in the case where no candidate position is set;
  • FIG. 9 is a schematic plan view of further another example of a set candidate position of a target position and an obstacle and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 10 is a schematic plan view of yet another example of a set candidate position of a target position and an obstacle and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 11 is a schematic plan view of further another example of a set candidate position of a target position and obstacles and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where a candidate position is set;
  • FIG. 12 is a schematic plan view of further another example of a set candidate position of a target position and obstacles and parking boundaries detected by the parking assist system according to the embodiment, and is a view in the case where no candidate position is set;
  • FIG. 13 is a schematic plan view of an example of a set candidate position of a target position and obstacles and parking boundaries detected by the parking assist system according to the embodiment, and is a view that shows an example of an orientation of a vehicle at a candidate position;
  • FIG. 14 is a schematic plan view that shows an example of a position of the vehicle, positions of an obstacle and a parking boundary, and a target position in the parking assist system according to the embodiment, and is a view in a state where the vehicle is distant from the target position; and
  • FIG. 15 is a schematic plan view that shows an example of a position of the vehicle, positions of an obstacle and a parking boundary, and a target position in the parking assist system according to the embodiment, and is a view in a state where the vehicle is close to the target position.
  • DETAILED DESCRIPTION OF EMBODIMENTS
  • Hereinafter, an exemplary embodiment of the invention will be described. The configuration of the embodiment described below, and the operation, results and advantageous effects obtained from the configuration are illustrative. The invention may be implemented by a configuration other than the configuration that will be described in the following embodiment, and may obtain at least one of various advantageous effects based on a basic configuration or secondary advantageous effects.
  • A vehicle 1 according to the present embodiment may be, for example, an automobile that uses an internal combustion engine (not shown) as a drive source, that is, an internal combustion engine automobile, may be an automobile that uses an electric motor (not shown) as a drive source, that is, an electric automobile, a fuel-cell automobile, or the like, may be a hybrid automobile that uses both the internal combustion engine and the electric motor as drive sources, or may be an automobile including another drive source. Various transmissions may be mounted on the vehicle 1. Various devices, such as system and components, required to drive an internal combustion engine or an electric motor may be mounted on the vehicle 1. The system, number, layout, and the like, of a device related to driving of wheels 3 in the vehicle 1 may be variously set.
  • As illustrated in FIG. 1, a vehicle body 2 constitutes a cabin 2 a in which an occupant (not shown) is seated. A steering unit 4, an accelerator operation unit 5, a brake operation unit 6, a shift operation unit 7, and the like, are provided near a seat 2 b of a driver as an occupant inside the cabin 2 a. The steering unit 4 is, for example, a steering wheel projecting from a dashboard 24. The accelerator operation unit 5 is, for example, an accelerator pedal located near driver's foot. The brake operation unit 6 is, for example, a brake pedal located near driver's foot. The shift operation unit 7 is, for example, a shift lever projecting from a center console. The steering unit 4, the accelerator operation unit 5, the brake operation unit 6, the shift operation unit 7, and the like, are not limited to these components.
  • A display device 8 and an audio output device 9 are provided inside the cabin 2 a. The display device 8 serves as a display output unit. The audio output device 9 serves as an audio output unit. The display device 8 is, for example, a liquid crystal display (LCD), an organic electroluminescent display (OELD), or the like. The audio output device 9 is, for example, a speaker. The display device 8 is, for example, covered with a translucent operation input unit 10, such as a touch panel. An occupant is allowed to visually recognize an image that is displayed on the display screen of the display device 8 via the operation input unit 10. An occupant is allowed to perform an operation input by operating the operation input unit 10 through touching, pressing or moving the operation input unit 10 with a finger, or the like, at a position corresponding to an image that is displayed on the display screen of the display device 8. These display device 8, audio output device 9, operation input unit 10, and the like, are, for example, provided in a monitor device 11 located at the center in the vehicle width direction, that is, transverse direction, of the dashboard 24. The monitor device 11 may have an operation input unit (not shown), such as a switch, a dial, a joystick and a push button. An audio output device (not shown) may be provided at another position inside the cabin 2 a, different from the monitor device 11. Audio may be output from the audio output device 9 of the monitor device 11 and another audio output device. The monitor device 11 is, for example, shared with a navigation system or an audio system.
  • A display device 12 different from the display device 8 is provided inside the cabin 2 a. As shown in FIG. 3, the display device 12 is, for example, provided in an instrument panel unit 25 in the dashboard 24, and is located at substantially the center of the instrument panel unit 25 between a speed indicating unit 25 a and a rotation speed indicating unit 25 b. The size of the screen 12 a of the display device 12 is smaller than the size of the screen 8 a of the display device 8. An image that shows information for assisting in parking the vehicle 1 may be mainly displayed on the display device 12. The amount of information that is displayed on the display device 12 may be smaller than the amount of information that is displayed on the display device 8. The display device 12 is, for example, an LCD, an OELD, or the like. Information that is displayed on the display device 12 may be displayed on the display device 8.
  • As illustrated in FIG. 1 and FIG. 2, the vehicle 1 is, for example a four-wheel vehicle, and includes two right and left front wheels 3F and two right and left rear wheels 3R. Each of these four wheels 3 may be configured to be steerable. As illustrated in FIG. 4, the vehicle 1 includes a steering system that steers at least two of the wheels 3. The steering system 13 includes an actuator 13 a and a torque sensor 13 b. The steering system 13 is electrically controlled by an electronic control unit (ECU) 14, or the like, to actuate the actuator 13 a. The steering system 13 is, for example, an electric power steering system, a steer-by-wire (SBW) system, or the like. The steering system 13 adds torque, that is, assist torque, to the steering unit 4 with the use of the actuator 13 a to compensate for steering force or steers the wheels 3 with the use of the actuator 13 a. In this case, the actuator 13 a may steer one of the wheels 3 or may steer a plurality of the wheels 3. The torque sensor 13 b, for example, detects a torque that is applied to the steering unit 4 by a driver.
  • As illustrated in FIG. 2, for example, four imaging units 15 a to 15 d are provided on the vehicle body 2 as a plurality of imaging units 15. Each of the imaging units 15 is, for example, a digital camera that incorporates an imaging device, such as a charge coupled device (CCD) and a CMOS image sensor (CIS). Each of the imaging units 15 is able to output moving image data at a predetermined frame rate. Each of the imaging units 15 has a wide angle lens or a fisheye lens, and is able to capture an image in, for example, the range of 140° to the range of 190° in the horizontal direction. The optical axis of each of the imaging units 15 is set so as to be oriented obliquely downward. Thus, each of the imaging units 15 sequentially captures a road surface on which the vehicle 1 is allowed to move and an outside environment around the vehicle body 2, including an area in which the vehicle 1 is allowed to be parked, and outputs the captured image as captured image data.
  • The imaging unit 15 a is, for example, located at a rear end 2 e of the vehicle body 2, and is provided at a lower wall portion of a door 2 h of a rear boot. The imaging unit 15 b is, for example, located at a right-side end 2 f of the vehicle body 2, and is provided at a right-side door mirror 2 g. The imaging unit 15 c is, for example, located at the front of the vehicle body 2, that is, a front end 2 c in the vehicle longitudinal direction, and is provided at a front bumper, or the like. The imaging unit 15 d is, for example, located at the left side of the vehicle body 2, that is, a left-side end 2 d in the vehicle width direction, and is provided at a door mirror 2 g that serves as a left-side projecting portion. The ECU 14 is able to generate an image having a wider viewing angle or generate an imaginary bird's-eye image of the vehicle 1 from above by executing operation processing and image processing on the basis of the image data obtained by the imaging units 15. A bird's-eye image may be referred to as plan image.
  • The ECU 14 identifies partition lines, or the like, on a road surface around the vehicle 1 from the images of the imaging units 15, and detects (extracts) parking spaces indicated by the partition lines, or the like.
  • As illustrated in FIG. 1 and FIG. 2, for example, four distance measuring units 16 a to 16 d and eight distance measuring units 17 a to 17 h are provided on the vehicle body 2 as a plurality of distance measuring units 16, 17. Each of the distance measuring units 16, 17 is, for example, a sonar that emits ultrasonic wave and captures the reflected wave. The sonar may also be referred to as a sonar sensor or an ultrasonic detector. The ECU 14 is able to detect whether there is an object, such as an obstacle, located around the vehicle 1 or measure a distance to the object on the basis of the detected results of the distance measuring units 16, 17. That is, each of the distance measuring units 16, 17 is an example of a detection unit that detects an object. Each of the distance measuring units 17 may be, for example, used to detect an object at a relatively close distance. Each of the distance measuring units 16 may be, for example, used to detect an object at a relatively long distance, which is distant from an object that each of the distance measuring units 17 detects. The distance measuring units 17 may be, for example, used to detect an object ahead of or behind the vehicle 1. The distance measuring units 16 may be, for example, used to detect an object to the side of the vehicle 1.
  • As illustrated in FIG. 4, in a parking assist system 100, in addition to the ECU 14, the monitor device 11, the steering system 13, the distance measuring units 16, 17, and the like, a brake system 18, a steering angle sensor 19, an accelerator sensor 20, a shift sensor 21, a wheel speed sensor 22, and the like, are electrically connected to one another via an in-vehicle network 23 that serves as an electric communication line. The in-vehicle network 23 is, for example, provided as a controller area network (CAN). The ECU 14 is able to control the steering system 13, the brake system 18, and the like, by transmitting control signals through the in-vehicle network 23. The ECU 14 is able to receive detected results of the torque sensor 13 b, a brake sensor 18 b, the steering angle sensor 19, the distance measuring units 16, the distance measuring units 17, the accelerator sensor 20, the shift sensor 21, the wheel speed sensor 22, and the like, and operation signals of the operation input unit 10, and the like, via the in-vehicle network 23.
  • The ECU 14, for example, includes a central processing unit (CPU) 14 a, a read only memory (ROM) 14 b, a random access memory (RAM) 14 c, a display control unit 14 d, an audio control unit 14 e, a solid state drive or flash memory (SSD) 14 f, and the like. The CPU 14 a is, for example, able to execute various operation processing and control, such as image processing related to images that are displayed on the display devices 8, 12, determination of a target position of the vehicle 1, computation of a moving path of the vehicle 1, determination as to whether there is an interference with an object, automatic control over the vehicle 1, and cancellation of automatic control. The CPU 14 a is able to read a program installed and stored in a nonvolatile storage device, such as the ROM 14 b, and execute operation processing in accordance with the program. The RAM 14 c temporarily stores various pieces of data that are used for computation in the CPU 14 a. The display control unit 14 d mainly executes image processing by the use of image data obtained by the imaging units 15, synthesis of image data that are displayed on the display device 8, and the like, within the operation processing in the ECU 14. The audio control unit 14 e mainly processes audio data that are output from the audio output device 9 within the operation processing in the ECU 14. The SSD 14 f is a rewritable nonvolatile storage unit, and is able to store data even when the power of the ECU 14 is turned off. The CPU 14 a, the ROM 14 b, the RAM 14 c, and the like, may be integrated within the same package. The ECU 14 may be formed of another logical operation processor, such as a digital signal processor (DSP), a logical circuit, or the like, instead of the CPU 14 a. A hard disk drive (HDD) may be provided instead of the SSD 14 f. The SSD 14 f or the HDD may be provided separately from the ECU 14. The ECU 14 is an example of an electronic control unit of a parking assist system.
  • The brake system 18 is, for example, an anti-lock brake system (ABS) that prevents the brake from locking up the wheels, a side slip prevention device (electronic stability control (ESC)) that prevents a side slip of the vehicle 1 during cornering, an electric brake system that enhances brake force (performs brake assist), a brake-by-wire (BBW), or the like. The brake system 18 imparts braking force to the wheels 3 and, by extension, the vehicle 1, via the actuator 18 a. The brake system 18 is able to execute various controls by detecting locking up of the wheels by the brake, a spin of the wheels 3, a sign of a side slip, and the like, from, for example, a rotation difference between the right and left wheels 3. The brake sensor 18 b is, for example, a sensor that detects the position of a movable unit of the brake operation unit 6. The brake sensor 18 b is able to detect the position of the brake pedal that serves as the movable unit. The brake sensor 18 b includes a displacement sensor.
  • The steering angle sensor 19 is, for example, a sensor that detects a steering amount of the steering unit 4, such as the steering wheel. The steering angle sensor 19 is, for example, provided by using a Hall element, or the like. The ECU 14 acquires a driver's steering amount of the steering unit 4, a steering amount of each wheel 3 during automatic steering, or the like, from the steering angle sensor 19, and executes various controls. The steering angle sensor 19 detects a rotation angle of a rotating portion included in the steering unit 4. The steering angle sensor 19 is an example of an angle sensor.
  • The accelerator sensor 20 is, for example, a sensor that detects the position of a movable unit of the accelerator operation unit 5. The accelerator sensor 20 is able to detect the position of the accelerator pedal that serves as the movable unit. The accelerator sensor 20 includes a displacement sensor.
  • The shift sensor 21 is, for example, a sensor that detects the position of a movable unit of the shift operation unit 7. The shift sensor 21 is able to detect the position of a lever, an arm, a button, or the like, that serves as the movable unit. The shift sensor 21 may include a displacement sensor or may be provided as a switch.
  • The wheel speed sensor 22 is a sensor that detects a rotation amount or rotation speed of each wheel 3 per unit time. The wheel speed sensor 22 outputs a wheel speed pulse number, indicating the detected rotation speed, as a sensor value. The wheel speed sensor 22 may be, for example, provided by using a Hall element, or the like. The ECU 14 computes a moving amount, and the like, of the vehicle 1 on the basis of the sensor value acquired from the wheel speed sensor 22, and executes various controls. There is a case where the wheel speed sensor 22 is provided in the brake system 18. In this case, the ECU 14 acquires the detected result of the wheel speed sensor 22 via the brake system 18.
  • The configurations, arrangement, electrical connection modes, and the like, of the above-described various sensors and actuators are illustrative, and may be variously set (changed).
  • As shown in FIG. 5, the ECU 14 includes an acquisition unit 141, an obstacle detection unit 142, a parking space detection unit 143, a candidate position setting unit 144, a target position determination unit 145, an output information control unit 146, a path calculation unit 147, a guidance control unit 148, an orientation setting unit 150, a storage unit 149, and the like. The CPU 14 a functions as the acquisition unit 141, the obstacle detection unit 142, the parking space detection unit 143, the candidate position setting unit 144, the target position determination unit 145, the output information control unit 146, the path calculation unit 147, the guidance control unit 148, the orientation setting unit 150, or the like, by executing a process in accordance with a corresponding program. Data that are used in operation processes of the units, data of results in operation processes, and the like, are stored in the storage unit 149. At least part of the functions of the above-described units may be implemented by hardware.
  • The acquisition unit 141 acquires various pieces of data, signal, and the like. The acquisition unit 141, for example, acquires data, signals, and the like, such as detected results of the sensors, operation inputs, input commands, and image data. The acquisition unit 141 is able to acquire a signal resulting from an operation input of the operation unit 14 g. The operation unit 14 g is, for example, a push button, a switch, or the like.
  • The obstacle detection unit 142 detects an obstacle that interferes with traveling of the vehicle 1. The obstacle is, for example, another vehicle, a wall, a pole, a fence, a protrusion, a step, a sprag, an object, or the like. The obstacle detection unit 142 is able to detect whether there is an obstacle, the height of an obstacle, the size of an obstacle, and the like, by the use of various techniques. The obstacle detection unit 142 is, for example, able to detect an obstacle on the basis of detected results of the distance measuring units 16, 17. Each of the distance measuring units 16, 17 is able to detect an object corresponding to the height of its beam and is not able to detect an object lower than the height of the beam. Thus, the obstacle detection unit 142 is able to detect the height of an obstacle on the basis of the detected results of the distance measuring units 16, 17 and the heights of beams of the distance measuring units 16, 17. The obstacle detection unit 142 may detect whether there is an obstacle or the height of an obstacle on the basis of a detected result of the wheel speed sensor 22 or an acceleration sensor (not shown) and detected results of the distance measuring units 16, 17. The obstacle detection unit 142 may, for example, detect the height of an obstacle through image processing based on images captured by the imaging units 15.
  • The parking space detection unit 143 detects a parking space that is provided as a mark or an object. The parking space is a space that is a target or reference set such that the vehicle 1 is parked in that place. A parking boundary is a boundary or outer periphery of the parking space, and is, for example, a partition line, a frame line, a straight line, a band, a step, an edge of any one of them, or the like. That is, the parking boundary is a mark, an object, or the like. The parking space detection unit 143 is, for example, able to detect a parking space and a parking boundary through image processing based on images captured by the imaging units 15. The parking space detection unit 143 is an example of a parking boundary detection unit.
  • The candidate position setting unit 144 sets at least one candidate position that is a candidate for a target position, that is, a terminal position of a moving path of the vehicle 1. The candidate position setting unit 144, for example, sets a candidate position on the basis of at least one of a detected result of the obstacle detection unit 142 or a detected result of the parking space detection unit 143.
  • The orientation setting unit 150 sets the orientation of the vehicle 1 at each candidate position. The orientation setting unit 150, for example, sets the orientation of the vehicle 1 at a candidate position on the basis of at least one of a detected result of the obstacle detection unit 142 or a detected result of the parking space detection unit 143. When a parking space has been detected, the orientation setting unit 150 sets the orientation on the basis of the parking space.
  • The target position determination unit 145 determines a target position from among at least one candidate position. The target position determination unit 145 is, for example, able to determine a high-rank candidate position, that is, an upper-level candidate position, as a target position, from among at least one candidate position ranked on the basis of a predetermined condition. The target position determination unit 145 is, for example, able to determine a candidate position corresponding to an occupant's operation input, that is, a candidate position selected by the occupant, as a target position from among at least one candidate position.
  • The output information control unit 146, for example, controls the display control unit 14 d or the audio control unit 14 e, by extension, the display device 8, the display device 12 or the audio output device 9, such that the display device 8, the display device 12 or the audio output device 9 outputs intended information in an intended mode at each of steps, such as a start of parking assist, an end of parking assist, determination of a target position, calculation of a path and guidance control.
  • The path calculation unit 147, for example, calculates a moving path from the current position of the vehicle 1 to the target position on the basis of the current position of the vehicle 1, that is, the host vehicle, the determined target position, the detected obstacle, and the like.
  • The guidance control unit 148 controls the portions such that the vehicle 1 moves along the calculated moving path. In the vehicle 1 that moves by the use of creeping, or the like, without operating the accelerator pedal, the guidance control unit 148 is, for example, able to move the vehicle 1 along the moving path by controlling the steering system 13 in response to the position of the vehicle 1. The guidance control unit 148 may control not only the steering system 13 but also a drive mechanism, such as an engine and a motor, the brake system 18 that serves as a braking mechanism, or the like. The guidance control unit 148 may, for example, inform the driver of movement of the vehicle 1 along the moving path through display output or audio output commensurate with the position of the vehicle 1 by controlling the output information control unit 146, the display control unit 14 d or the audio control unit 14 e, by extension, the display device 8, the display device 12 or the audio output device 9.
  • The storage unit 149 stores data that are used in computation in the ECU 14 or data calculated in computation in the ECU 14.
  • In the parking assist system 100, a process is executed in accordance with the procedure illustrated in FIG. 6. Initially, the obstacle detection unit 142 detects an obstacle (S1), and the parking space detection unit 143 detects a parking space and a parking boundary (S2). Subsequently, the candidate position setting unit 144 sets at least one candidate position that is a candidate for a target position, that is, terminal position, of the moving path of the vehicle 1 on the basis of the detected results of S1 and S2 (S3). Subsequently, the acquisition unit 141 acquires an operation input that issues a command to start parking assist (S4). That is, in the present embodiment, for example, before an operation command is input, S1 to S3 are executed. Subsequently, the target position determination unit 145 determines a target position from among at least one candidate position (S5). In S5, the target position determination unit 145 is able to rank each of the at least one candidate position, and determine the highest-rank candidate position as the target position. Alternatively, the target position determination unit 145 may determine a candidate position, selected on the basis of an occupant's operation input, as the target position. Subsequently, the path calculation unit 147 calculates a moving path from the current position of the vehicle 1 to the determined target position (S6). Subsequently, the guidance control unit 148 controls the portions such that the vehicle 1 moves along the calculated moving path (S7). The target position, the moving path, or the like, may be corrected or updated as needed in the middle of movement of the vehicle 1 along the moving path.
  • Next, an example of setting of a candidate position C by the candidate position setting unit 144 according to the present embodiment will be described with reference to FIG. 7 to FIG. 12. FIG. 7 to FIG. 12 are exemplary schematic views of detected obstacles B and parking boundaries D and a candidate position C on a two-dimensional coordinate system. FIG. 7 to FIG. 12 illustrate detected results obtained at the time when the vehicle 1 passes by the front of the obstacles B and the parking boundaries D in the leftward direction (traveling direction V) of each drawing in a place in which a plurality of parking spaces in which the vehicle 1 is double parked in position in which the vehicle front is oriented upward in each drawing are set. The two-dimensional coordinate system is, for example, a coordinate system along a road surface with an origin set at the host vehicle.
  • The target position determination unit 145 determines a target position from among at least one candidate position C set by the candidate position setting unit 144. That is, the target position determination unit 145 is able to determine a position set for the candidate position C as a target position but the target position determination unit 145 is not able to determine a position not set for the candidate position C as a target position. Thus, the following condition for setting a candidate position C is also a condition for setting a target position.
  • Part of an outer surface of an obstacle B facing the traveling vehicle 1 is detected by the distance measuring units 16. As described above, FIG. 7 to FIG. 12 show detected results at the time when the vehicle 1 passes by the upper side of each drawing in the leftward direction (traveling direction V), so the obstacle B is, for example, detected in a downward-open inverted U shape in each drawing. The parking boundary D is detected from image data captured by the imaging units 15. An image of each parking boundary D is detected as a linear or band-shaped area. Detected results vary depending on settings of the distance measuring units 16, 17 and imaging units 15.
  • As illustrated in FIG. 7 and FIG. 8, around the obstacle B, a limit line L is set substantially along the outer periphery of the obstacle B at a position spaced a predetermined distance d from the outer periphery of the obstacle B. The limit line L is, for example, a straight line, and is set in correspondence with a section B1 of the obstacle B, extending in a direction that intersects with the traveling direction V of the traveling vehicle 1 and spaced apart from the corner. The limit line L may be, for example, obtained through regression analysis, such as a method of least squares, on the section B1. That is, the limit line L extends in the direction that intersects with the traveling direction V of the traveling vehicle 1. The limit line L is not limited to a straight line. The candidate position C is set on a side across the limit line L from the obstacle B, and is not set on the obstacle B side of the limit line L. The candidate position setting unit 144 is able to identify an area across the limit line L from the obstacle B on the basis of a detected position of the obstacle B and a position (coordinates) of the limit line L. By such settings, at least a certain distance, that is, a clearance, is ensured between the obstacle B and the vehicle 1 located at the candidate position C.
  • The candidate position setting unit 144 sets a candidate position C such that the candidate position C does not overlap with the parking boundary D. That is, a candidate position C is set in an area that does not overlap with the parking boundary D, that is, an area out of the parking boundary D, within an intended area (an area allowed to be set).
  • As illustrated in FIG. 7 and FIG. 8, for a space S1 adjacent to one side of the obstacle B and in which one parking boundary D is detected, the candidate position setting unit 144 determines whether a candidate position C is allowed to be set in a third area A3 between the limit line L and the parking boundary D. The third area A3 is an area in which a first area A1 and a second area A2 overlap with each other. The first area A1 is an area across the limit line L from the obstacle B. The second area A2 is an area out of the parking boundary D. The second area A2 is also regarded as an area across one of boundary lines D1 from the parking boundary D. The boundary lines D1 extend in the longitudinal direction of the parking boundary D along end edges of the parking boundary D in the width direction (transverse direction in FIG. 7 and FIG. 8). The second area A2 is an area other than the detected parking boundary D, an area that does not overlap with the parking boundary D, an area on one side or the other side of the parking boundary D in the transverse direction, that is, the width direction, and an area outside of the parking boundary D.
  • In the example shown in FIG. 7, the size of the third area A3 is larger than the size of the vehicle at the candidate position C. Thus, the candidate position setting unit 144 sets a candidate position C in the third area A3 shown in FIG. 7. On the other hand, in the example shown in FIG. 8, the size of the third area A3 is smaller than the size of the vehicle at the candidate position C. Thus, the candidate position setting unit 144 does not set a candidate position C in the third area A3 shown in FIG. 8.
  • The candidate position setting unit 144, for example, sets a candidate position C in the vehicle width direction of the candidate position C such that the candidate position C is located at the center of the third area A3. The candidate position setting unit 144, for example, sets a candidate position C in the vehicle longitudinal direction of the candidate position C such that the candidate position C is located at the center between ends of the parking boundary D in the longitudinal direction. A manner of setting a candidate position C in the third area A3 is not limited to this example. For example, the front end of the candidate position C and the front end of the parking boundary D may be aligned in the vehicle longitudinal direction at the candidate position. The vehicle longitudinal direction at the candidate position may be set to the longitudinal direction of the parking boundary D.
  • FIG. 9 and FIG. 10 illustrate a space S2 adjacent to an obstacle B and in which mutually spaced two parking boundaries D are detected. In this case as well, the candidate position setting unit 144 determines for the obstacle B and the parking boundaries D detected in the space S2 whether a candidate position C is allowed to be set in the third area A3 in which the first area A1 and the second area A2 overlap with each other. The first area is an area across the limit line L from the obstacle B. The second area A2 is an area outside of the parking boundaries D. In the example shown in FIG. 9, the third area A3 is between the two parking boundaries D. In the example shown in FIG. 10, the third area A3 is between the left-side parking boundary D in the drawing and the limit line L.
  • In the example shown in FIG. 9, the obstacle B is relatively distant from the right-side parking boundary D in FIG. 9, and the size of the third area A3 is larger than the size of the vehicle at the candidate position C. Thus, the candidate position setting unit 144 sets a candidate position C in the third area A3 in FIG. 9. In the example shown in FIG. 10, the obstacle B overlaps with the right-side parking boundary D; however, the size of the third area A3 between the left-side parking boundary D and the limit line L is larger than the size of the vehicle at the candidate position C. Thus, the candidate position setting unit 144 sets a candidate position C in the third area A3 in FIG. 10.
  • FIG. 11 and FIG. 12 illustrate a space S3 between two obstacles B and in which mutually spaced two parking boundaries D are detected. In this case as well, the candidate position setting unit 144 determines for the obstacles B and parking boundaries D detected in the space S3 whether a candidate position C is allowed to be set in the third area A3 in which the first area A1 and the second area A2 overlap with each other. The first area A1 is an area across each limit line L from the corresponding obstacle B. The second area A2 is an area outside of the parking boundaries D. In the examples shown in FIG. 11 and FIG. 12, the third area A3 is between the two limit lines L.
  • In the example shown in FIG. 11, the size of the third area A3 is larger than the size of the vehicle at the candidate position C. Thus, the candidate position setting unit 144 sets a candidate position C in the third area A3 in FIG. 11. On the other hand, in the example shown in FIG. 12, one of the obstacles B overlaps with the right-side parking boundary D, and the size of the third area A3 is smaller than the size of the vehicle at the candidate position C. Thus, the candidate position setting unit 144 does not set a candidate position C in the third area A3 in FIG. 12.
  • Next, an example of setting of an orientation of the vehicle 1 at the candidate position C by the orientation setting unit 150 according to the present embodiment will be described with reference to FIG. 13. FIG. 13 is an exemplary schematic view of detected obstacles B and parking boundaries D and a candidate position C on a two-dimensional coordinate system. FIG. 13 illustrates detected results obtained at the time when the vehicle 1 passes by the front of the obstacles B and the parking boundaries D in the leftward direction (traveling direction V) of FIG. 13 in a place in which a plurality of parking spaces in which the vehicle 1 is double parked in position in which the vehicle front is oriented upward in FIG. 13 are set.
  • The orientation setting unit 150 sets the orientation Cv of the vehicle 1 at the candidate position C on the basis of one or a plurality of parking boundaries D. The orientation Cv is, for example, the forward side of the vehicle 1 located at the candidate position C. For example, when only one parking boundary D is detected, the orientation setting unit 150 sets the orientation Cv parallel to the direction in which the one parking boundary D extends; when two parking boundaries D are detected, the orientation setting unit 150 sets the orientation Cv to a direction between directions Dv in which the two parking boundaries D respectively extend. For example, when angles of the two directions Dv with respect to a reference direction are α1, α2, an angle β of the orientation Cv with respect to the reference direction is set to (α12)/2. When no parking boundary D has been detected, the orientation setting unit 150 sets the orientation Cv to a direction between directions of two limit lines L or a direction parallel to a direction of one limit line L. Each direction Dv is, for example, obtained through regression analysis, such as a method of least squares, on each detected parking boundary D.
  • As illustrated in FIG. 14 and FIG. 15, the target position determination unit 145 is able to change the target position T in the middle of movement of the vehicle 1 along the moving path. In FIG. 14, the target position T is a candidate position C. As illustrated in FIG. 15, when the vehicle 1 moves backward along the moving path and becomes close to the target position T, the vehicle 1 is close to an obstacle B near the target position T or a parking boundary D (parking space), so a detection range or detection accuracy of an obstacle B or a parking boundary D improves. At a position P1 in FIG. 15, the imaging unit 15 a or distance measuring units 17 provided at the rear of the vehicle body 2 as illustrated in FIG. 1 and FIG. 2 are further accurately used as compared to the position in FIG. 14. Thus, the target position determination unit 145 may update the target position T and the orientation Cv of the vehicle 1 at the target position T through a similar computation to that of the candidate position setting unit 144 on the basis of a detected obstacle B or parking boundary D at the position P1 in the middle of movement of the vehicle 1.
  • As shown in FIG. 15, at the position P1, a rear end B2 of the obstacle B is detected, so the target position determination unit 145 is allowed to align a rear end T1 of the target position T and the rear end B2 of the obstacle B with each other in the vehicle longitudinal direction. Specifically, the target position determination unit 145, for example, updates the target position T such that the rear end T1 of the target position T and the rear end B2 of the obstacle B are arranged next to each other in the vehicle width direction. In a state where the vehicle 1 is close to the target position T, the target position T of the vehicle 1 may be updated on the basis of the detected obstacles B by the distance measuring units 16 a, 16 b provided at the side of the vehicle body 2 as illustrated in FIG. 1 and FIG. 2. Such control is, for example, effective when a parking boundary D is short and located in correspondence with the front side of a parking space and the parking boundary D has no portion corresponding to the rear side of the parking space.
  • As described above, in the present embodiment, for example, for all the obstacles B and all the parking boundaries D detected in the spaces S1 to S3, when the vehicle 1 is allowed to be located in the third area A3 in which the first area A1 and the second area A2 overlap with each other, the candidate position setting unit 144 sets a target position T in the third area A3. The first area A1 is an area across each limit line L from the corresponding obstacle B. Each limit line L is set substantially along the outer periphery of the corresponding obstacle B at a position spaced the predetermined distance d from each obstacle B outward of the obstacle B. The second area A2 is an area out of the parking boundaries D. Thus, in this case, the target position determination unit 145 is allowed to determine the target position T in the third area A3. Thus, according to the present embodiment, for example, it is possible to determine a target position T at a position that is spaced apart from an obstacle B and that falls within a parking space. That is, the target position determination unit 145 is able to determine a less inconvenient position as a target position.
  • In the present embodiment, for example, the orientation setting unit 150 sets a candidate position C, that is, an orientation Cv of the vehicle 1 at a target position T, on the basis of a parking boundary D. Thus, according to the present embodiment, for example, the orientation of the vehicle 1 at the target position T tends to match with the parking space.
  • In the present embodiment, for example, the target position determination unit 145 is able to update the target position T on the basis of at least one of a detected obstacle B or a detected parking boundary D in the middle of movement of the vehicle 1 to the target position T. Thus, for example, the target position T further tends to match with the obstacle B or the parking space.
  • The embodiment of the invention is illustrated above; however, the above-described embodiment is illustrative, and is not intended to limit the scope of the invention. The embodiment may be implemented in other various forms, and may be variously omitted, replaced, combined or changed without departing from the spirit of the invention. The components and shapes of each embodiment may be partially replaced. The specifications (structure, type, orientation, shape, size, length, width, height, number, arrangement, position, and the like) of each component, or the like, may be changed as needed. The invention is applicable to parking assist in parking places and parking spaces in various forms. The way of detecting or the way of setting the position and orientation of the vehicle and the candidate position and its orientation, bases for the position and orientation of the vehicle and the candidate position and its orientation, or the like, may be variously set or changed. An input signal may be based on an audio input to a microphone.
  • The parking assist system according to the above-described embodiment, for example, includes an obstacle detection unit 142 that detects an obstacle B, a parking space detection unit 143 that detects a boundary D of a parking space and a target position determination unit 145 that determines a target position to which a vehicle 1 moves. When the vehicle 1 is allowed to be located in a third area A3 in which a first area A1 and a second area A2 overlap with each other, the target position determination unit 145 is allowed to determine the target position in the third area A3. The first area A1 is an area across a limit line L from the obstacle B. The limit line L is set substantially along an outer periphery of the obstacle B at a position spaced a predetermined distance from the obstacle B outward of the obstacle B. The second area A2 is an area out of the boundary D. Thus, with the parking assist system according to the embodiment, for example, a target position may be determined at a position that is spaced apart from an obstacle B and that falls within a parking space.
  • The parking assist system, for example, includes an orientation setting unit 150 that sets an orientation Cv of the vehicle at the target position on the basis of the boundary D. Thus, for example, the orientation of the vehicle 1 at the target position tends to match with the parking space.
  • In the parking assist system, for example, the target position determination unit 145 is able to update the target position on the basis of at least one of the detected obstacle B or the detected boundary D in the middle of movement of the vehicle 1 to the target position. Thus, for example, the target position further tends to match with the obstacle B or the parking space.

Claims (4)

What is claimed is:
1. A parking assist system comprising:
an electronic control unit configured to
detect an obstacle,
detect a boundary of a parking space,
determine a target position to which a vehicle moves, and
when the vehicle is allowed to be located in a third area in which a first area and a second area overlap with each other, be allowed to determine the target position in the third area, the first area being an area across a limit line from the obstacle, the limit line being set substantially along an outer periphery of the obstacle at a position spaced a predetermined distance from the obstacle outward of the obstacle, the second area being an area out of the boundary.
2. The parking assist system according to claim 1, wherein
the electronic control unit is configured to set an orientation of the vehicle at the target position on a basis of the boundary.
3. The parking assist system according to claim 1, wherein
the electronic control unit is configured to be able to update the target position on a basis of at least one of the detected obstacle or the detected boundary in a middle of movement of the vehicle to the target position.
4. The parking assist system according to claim 2, wherein
the electronic control unit is configured to be able to update the target position on a basis of at least one of the detected obstacle or the detected boundary in a middle of movement of the vehicle to the target position.
US14/850,304 2014-09-12 2015-09-10 Parking assist system Active 2036-04-15 US10031227B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014186823A JP6096156B2 (en) 2014-09-12 2014-09-12 Parking assistance device
JP2014-186823 2014-09-12

Publications (2)

Publication Number Publication Date
US20160078764A1 true US20160078764A1 (en) 2016-03-17
US10031227B2 US10031227B2 (en) 2018-07-24

Family

ID=55406219

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/850,304 Active 2036-04-15 US10031227B2 (en) 2014-09-12 2015-09-10 Parking assist system

Country Status (4)

Country Link
US (1) US10031227B2 (en)
JP (1) JP6096156B2 (en)
CN (1) CN105416278B (en)
DE (1) DE102015115263A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150197281A1 (en) * 2011-04-19 2015-07-16 Ford Global Technologies, Llc Trailer backup assist system with lane marker detection
US20150203156A1 (en) * 2011-04-19 2015-07-23 Ford Global Technologies, Llc Trailer backup assist system with waypoint selection
US20180307919A1 (en) * 2015-10-22 2018-10-25 Nissan Motor Co., Ltd. Parking Space Line Detection Method and Device
US20180339701A1 (en) * 2017-05-26 2018-11-29 Mando Corporation Parking control apparatus and method
CN108961836A (en) * 2017-05-24 2018-12-07 福特全球技术公司 The method and apparatus that low frequency for surrounding vehicles positions
US10242575B1 (en) 2017-12-05 2019-03-26 Industrial Technology Research Institute Marked parking space identification system and method thereof
US20190111970A1 (en) * 2017-10-13 2019-04-18 Hyundai Motor Company Device and method for displaying target parking space of vehicle
CN109661338A (en) * 2016-09-06 2019-04-19 日产自动车株式会社 Determination method, parking assistance method, outbound householder method and the obstacle judgment device of barrier
US10583832B2 (en) 2017-05-02 2020-03-10 Cnh Industrial America Llc Obstacle detection system for a work vehicle
CN114550485A (en) * 2020-11-26 2022-05-27 上海汽车集团股份有限公司 Parking space detection method and device
US20230311854A1 (en) * 2022-03-29 2023-10-05 Continental Autonomous Mobility US, LLC Autonomous vehicle garage parking

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102327344B1 (en) * 2017-05-23 2021-11-17 주식회사 만도모빌리티솔루션즈 Smart parking assist system and method for control thereof
CN107364442B (en) * 2017-06-23 2019-08-23 深圳市盛路物联通讯技术有限公司 A kind of automatic stop process and system
JP6662356B2 (en) * 2017-08-03 2020-03-11 トヨタ自動車株式会社 Vehicle control device
DE102018103402B3 (en) * 2018-02-15 2019-08-08 Valeo Schalter Und Sensoren Gmbh Method for estimating a height of an object by means of an ultrasound sensor device by detecting reflection points of the object, ultrasound sensor device and driver assistance system
CN109615903B (en) * 2018-11-12 2021-08-17 合肥晟泰克汽车电子股份有限公司 Parking space identification method
CN109633662B (en) 2018-12-28 2022-03-08 阿波罗智能技术(北京)有限公司 Obstacle positioning method and device and terminal
CN111655542A (en) * 2019-04-23 2020-09-11 深圳市大疆创新科技有限公司 Data processing method, device and equipment and movable platform
JP7147728B2 (en) 2019-10-11 2022-10-05 トヨタ自動車株式会社 parking assist device
JP7247849B2 (en) 2019-10-11 2023-03-29 トヨタ自動車株式会社 parking assist device
JP7503429B2 (en) 2020-06-29 2024-06-20 フォルシアクラリオン・エレクトロニクス株式会社 Parking assistance device and parking assistance method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100231416A1 (en) * 2009-03-10 2010-09-16 National Chiao Tung University Parking assistance system and method
US20100238051A1 (en) * 2007-10-01 2010-09-23 Nissan Motor Co., Ltd Parking assistant and parking assisting method
US20130166190A1 (en) * 2010-11-30 2013-06-27 Aisin Seiki Kabushiki Kaisha Parking position adjustment device
US20140244070A1 (en) * 2013-02-28 2014-08-28 Aisin Seiki Kabushiki Kaisha Parking assist apparatus, parking assist method and program thereof

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7737866B2 (en) * 2007-09-27 2010-06-15 Automotive Research & Testing Center Auto-parking device
DE102011003881A1 (en) * 2011-02-09 2012-08-09 Robert Bosch Gmbh Method for assisting a driver of a motor vehicle
JP5929684B2 (en) * 2012-10-09 2016-06-08 株式会社デンソー Parking assistance device
US9384662B2 (en) * 2014-04-17 2016-07-05 Ford Global Technologies, Llc Parking assistance for a vehicle

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100238051A1 (en) * 2007-10-01 2010-09-23 Nissan Motor Co., Ltd Parking assistant and parking assisting method
US8988250B2 (en) * 2007-10-01 2015-03-24 Nissan Motor Co., Ltd. Parking assistant and parking assisting method
US20100231416A1 (en) * 2009-03-10 2010-09-16 National Chiao Tung University Parking assistance system and method
US20130166190A1 (en) * 2010-11-30 2013-06-27 Aisin Seiki Kabushiki Kaisha Parking position adjustment device
US20140244070A1 (en) * 2013-02-28 2014-08-28 Aisin Seiki Kabushiki Kaisha Parking assist apparatus, parking assist method and program thereof

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150197281A1 (en) * 2011-04-19 2015-07-16 Ford Global Technologies, Llc Trailer backup assist system with lane marker detection
US20150203156A1 (en) * 2011-04-19 2015-07-23 Ford Global Technologies, Llc Trailer backup assist system with waypoint selection
US9969428B2 (en) * 2011-04-19 2018-05-15 Ford Global Technologies, Llc Trailer backup assist system with waypoint selection
US20180307919A1 (en) * 2015-10-22 2018-10-25 Nissan Motor Co., Ltd. Parking Space Line Detection Method and Device
US10810446B2 (en) * 2015-10-22 2020-10-20 Nissan Motor Co., Ltd. Parking space line detection method and device
CN109661338A (en) * 2016-09-06 2019-04-19 日产自动车株式会社 Determination method, parking assistance method, outbound householder method and the obstacle judgment device of barrier
US10583832B2 (en) 2017-05-02 2020-03-10 Cnh Industrial America Llc Obstacle detection system for a work vehicle
CN108961836A (en) * 2017-05-24 2018-12-07 福特全球技术公司 The method and apparatus that low frequency for surrounding vehicles positions
US20180339701A1 (en) * 2017-05-26 2018-11-29 Mando Corporation Parking control apparatus and method
US11198429B2 (en) * 2017-05-26 2021-12-14 Mando Corporation Parking control apparatus and method
US20190111970A1 (en) * 2017-10-13 2019-04-18 Hyundai Motor Company Device and method for displaying target parking space of vehicle
KR20190041780A (en) * 2017-10-13 2019-04-23 현대자동차주식회사 Apparatus for displaying target parking space of vehicle and method thereof
US10737724B2 (en) * 2017-10-13 2020-08-11 Hyundai Motor Company Device and method for displaying target parking space of vehicle
KR102429494B1 (en) 2017-10-13 2022-08-05 현대자동차주식회사 Apparatus for displaying target parking space of vehicle and method thereof
US10242575B1 (en) 2017-12-05 2019-03-26 Industrial Technology Research Institute Marked parking space identification system and method thereof
CN114550485A (en) * 2020-11-26 2022-05-27 上海汽车集团股份有限公司 Parking space detection method and device
US20230311854A1 (en) * 2022-03-29 2023-10-05 Continental Autonomous Mobility US, LLC Autonomous vehicle garage parking

Also Published As

Publication number Publication date
DE102015115263A1 (en) 2016-03-17
CN105416278B (en) 2020-03-27
US10031227B2 (en) 2018-07-24
JP2016060239A (en) 2016-04-25
CN105416278A (en) 2016-03-23
JP6096156B2 (en) 2017-03-15

Similar Documents

Publication Publication Date Title
US10031227B2 (en) Parking assist system
US9592852B2 (en) Parking assist system and parking assist method
US9884646B2 (en) Parking assist system and path determination method
US9836658B2 (en) Parking assist system
US20160114795A1 (en) Parking assist system and parking assist method
US9875655B2 (en) Parking assist system
US9481368B2 (en) Park exit assist system and park exit assist method
US10077045B2 (en) Parking assist system, method, and non-transitory computer readable medium storing program
US9604638B2 (en) Parking assist system
US10018473B2 (en) Vehicle position detecting device
US20160075377A1 (en) Parking assist system, parking assist method and parking assist control program
US9919735B2 (en) Control system and control method for vehicle
US20160075326A1 (en) Parking assist system
JP6006765B2 (en) Driving assistance device
JP2014069722A (en) Parking support system, parking support method, and program
US9828027B2 (en) Control system for vehicle
US10489950B2 (en) Display control device for displaying a captured image of a vehicle periphery
JP2016124398A (en) Parking support device
EP3378720B1 (en) Driving control apparatus
JP7427907B2 (en) parking assist device
JP6227514B2 (en) Parking assistance device
JP7383973B2 (en) parking assist device
US20230093819A1 (en) Parking assistance device
JP2019022110A (en) Display control device

Legal Events

Date Code Title Description
AS Assignment

Owner name: AISIN SEIKI KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIYOKAWA, YUSUKE;KATO, MASAYA;TACHIBANA, HIROYUKI;AND OTHERS;SIGNING DATES FROM 20150901 TO 20150902;REEL/FRAME:036535/0208

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIYOKAWA, YUSUKE;KATO, MASAYA;TACHIBANA, HIROYUKI;AND OTHERS;SIGNING DATES FROM 20150901 TO 20150902;REEL/FRAME:036535/0208

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4