WO2014162797A1 - 信号認識装置 - Google Patents
信号認識装置 Download PDFInfo
- Publication number
- WO2014162797A1 WO2014162797A1 PCT/JP2014/054435 JP2014054435W WO2014162797A1 WO 2014162797 A1 WO2014162797 A1 WO 2014162797A1 JP 2014054435 W JP2014054435 W JP 2014054435W WO 2014162797 A1 WO2014162797 A1 WO 2014162797A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- link
- information
- travel
- traffic
- Prior art date
Links
- 239000000284 extract Substances 0.000 claims abstract description 7
- 238000003384 imaging method Methods 0.000 claims description 40
- 238000000605 extraction Methods 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 30
- 238000000034 method Methods 0.000 description 25
- 238000001514 detection method Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 12
- 238000012545 processing Methods 0.000 description 11
- 230000008859 change Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/582—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of traffic signs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09626—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages where the origin of the information is within the own vehicle, e.g. a local storage device, digital map
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
- G06T2207/30256—Lane; Road marking
Definitions
- the present invention relates to a signal recognizing device that identifies a signal to be noticed on a traveling path of a host vehicle and recognizes the content thereof.
- Patent Document 1 based on the distance from the vehicle to the intersection and the height information of the traffic light, the image area of the traffic light where the traffic light will be imaged in the captured image of the camera is estimated, and the image area of this traffic light A technique for recognizing the state of a traffic light based on the image is known (Patent Document 1).
- the technique according to the prior art erroneously identifies the signal signal to which the vehicle should pay attention and misrecognizes the signal content indicated by the signal. There's a problem.
- the problem to be solved by the present invention is that even when a signal such as a signal that should not be noticed in a captured image of a vehicle-mounted camera is reflected or a signal that is not noticed is reflected, This is to accurately identify one traffic light that the host vehicle should pay attention to and to recognize the signal content indicated by the traffic signal with high accuracy.
- the present invention refers to map information including travel link information defined for each lane by a directional link, in which connection links and travel direction information are associated, and traffic signal information associated with the travel link information.
- the above-described problem is solved by identifying a traffic signal to be noted based on the travel link to which the current position of the host vehicle belongs.
- a travel link that is specified for each lane by a directional link including a start point, an end point, and a travel direction, and is associated with the connection link and the traveling direction information when the travel link is traveled.
- the traffic signal to be noticed during the travel of each travel link is specified, so even in a complicated traffic environment where there are multiple traffic signals, It is possible to accurately identify one traffic light that the driver should pay attention to.
- FIG. 1 is a diagram illustrating a block configuration of a driving support system 1 including a signal recognition device 100 according to the present embodiment.
- the signal recognition device 100 and the driving support system 1 including the signal recognition device 100 are mounted on a vehicle.
- the signal recognition device 100 identifies a signal to which the driver of the host vehicle is interested and recognizes the content of information indicated by the signal.
- the driving support system 1 includes a signal recognition device 100, a navigation device 50, a vehicle controller 60, and a drive system 70 (vehicle drive device) that controls driving.
- the driving support system 1 controls driving / braking of the host vehicle via the vehicle controller 60 and the driving system 70 based on information indicated by the signal recognized by the signal recognition device 100, and driving via the navigation device 50. Provide information to support the driver.
- the signal recognition device 100 of this embodiment includes a control device 10, a camera 20, a position detection device 30, and a database 40.
- the camera 20 is mounted on the host vehicle and images the surroundings of the host vehicle.
- the lens may be a telephoto lens with a narrow viewing angle that can be imaged by a distant preceding vehicle, or a fish-eye lens with a wide field of view or an omnidirectional camera lens that can capture the entire circumference to cope with changes in curves and gradients. May be.
- the attachment position of the camera 20 is not limited, in this embodiment, it installs in the vicinity of the vehicle interior mirror of the own vehicle toward the vehicle front. Further, the case where the lens is a standard lens having a viewing angle of about 25 ° to 50 ° will be described as an example.
- Imaging characteristic information 42 such as an internal parameter such as lens distortion of the camera 20 and an external parameter indicating an attachment position with respect to the vehicle can be stored in advance in the ROM.
- the camera 20 of the present embodiment has a zoom function that increases or decreases the imaging magnification at the time of imaging.
- the zoom function of the present embodiment controls the imaging magnification based on an area ratio of an image area of a specified traffic light to a captured image, which will be described later.
- the camera 20 of this embodiment includes a driving device 21.
- the drive device 21 can change the imaging direction of the camera 20.
- the drive device 21 of the present embodiment has a drive function that can be driven in the vertical direction of the host vehicle.
- the drive device 21 may be configured as a support device that is separate from the camera 20, but in the present embodiment, a PTZ camera (camera capable of driving pan, tilt, and zoom) having a mechanism for rotating the camera 20 body is driven.
- the camera 20 in which the camera 20 main body and the drive device 21 are integrated is used.
- a PTZ camera is not specifically limited, it arrange
- the aspect of the drive device 21 is not particularly limited, and a method of changing the imaging direction by installing a mirror in front of the imaging element and driving the mirror may be used.
- External parameters including the mounting position of the camera 20 with respect to the vehicle, the amount of change in the mounting position of the camera 20 due to the operation of the driving device 21, etc. are calculated in advance and stored in the database 40.
- the drive device 21 according to the present embodiment changes the imaging direction of the camera 20 based on the position of the identified traffic light image region with respect to the captured image.
- the position detection device 30 includes a GPS (Global Positioning System) and detects the current position (latitude / longitude) of the traveling vehicle.
- the current position of the host vehicle can also be acquired from the position detection device 30 provided in the navigation device 50 mounted on the host vehicle.
- the position detection device 30 of this embodiment has a function of detecting the attitude of the host vehicle.
- the position detection device 30 may include two GPSs and calculate the direction of the host vehicle, or may further include an azimuth meter to calculate the direction of the host vehicle. Also good.
- the position detection device 30 may calculate the attitude of the host vehicle based on the captured image of the camera 20.
- An example of a method for calculating the attitude of the host vehicle based on the captured image will be described.
- the viewpoint of the captured image of the camera 20 is set above the vehicle, and the captured image is converted into an overhead image when the host vehicle is viewed from the viewpoint of the vehicle information.
- the white line or curb can be recognized in the overhead image, and the direction of the vehicle can be calculated from the inclination of the white line or curb.
- the position / orientation of the host vehicle may be calculated using SLAM (Simultaneous Localization and Mapping), which is a self-position estimation technique, using an image known at the time of filing this application.
- SLAM Simultaneous Localization and Mapping
- the three-dimensional positions of the image feature points are stored in the database 40 in advance, and the image feature points stored in the database 40 and the image feature points in the captured image of the camera 20 are collated, so that The position / orientation of the vehicle can be calculated.
- the database 40 stores map information 41.
- the map information 41 may be stored in the navigation device 50 that can be accessed by the control device 10.
- the map information 41 of the present embodiment includes travel link information 411 and traffic signal information 412 associated with the travel link information 411.
- Each travel link of the travel link information 411 is a directional link including a start point, an end point, and a travel direction, and is defined for each lane.
- a directed link is defined by information on at least a start point, an end point (that is, a length), and a direction.
- each travel link (directed link) of the present embodiment is associated with a connection link connected at the start point and the end point, and travel direction information for specifying a travel direction including straight or right / left turn.
- traffic information is associated with the travel link.
- the traffic signal information is information including position information of a traffic signal to which the driver pays attention when traveling on each travel link.
- the map information 41 of the present embodiment includes a point identified by a map coordinate value such as latitude and longitude, a node with an identifier (ID), as in general map information, It includes a travel link with an identifier (ID), a traffic light with an identifier (ID), and point information (POI) associated with each point.
- the node information is specified by a map coordinate value, and includes an identifier of a node to be connected and an identifier of a plurality of nodes branched from.
- the node is set at the center of the road lane. However, at a complicated intersection having a plurality of lanes, the position of the node may be defined using a trajectory actually passed by the vehicle.
- the travel link information is specified by the map coordinate values, the identifier of the node that defines the start point and end point, the travel direction of each travel link, such as straight line, right turn, left turn, etc., and each travel link is for merging links / branches It has a type of whether it is a link, an identifier of a traveling link connected to the traveling link, and an identifier of a plurality of branched traveling links that are branched. Each traveling link is associated with an identifier of a noticeable traffic signal. Even if the travel link information of the present embodiment exists on the same road, a different ID is assigned to each lane, and the travel link information is treated as a separate travel link.
- the right-turn travel link and the straight travel link are processed as different travel links. Even if the information of the start point and the end point is common, the traffic signal to be noticed in the right turn travel link is different from the traffic signal to be noticed in the straight travel link, and is therefore stored as separate information.
- the travel path of the vehicle branches or intersects, or when a traffic signal to be noticed is different, it is defined as another travel link. That is, in the travel link information of the present embodiment, the travel link is defined for each lane, and one notable traffic signal is associated with one travel link, even if a plurality of traffic links are associated with the same travel road.
- a plurality of traffic lights are not associated with one travel link. Since one notable traffic signal is associated with one travel link defined for each lane, if the travel link on which the host vehicle travels is determined, the traffic signal that is primarily focused can be identified.
- the traffic signal information includes the height information, the installation position specified by the map coordinate value, the travel link on which the vehicle to be watched travels on each traffic signal, that is, the identifier of the travel link on which the traffic signal is to be controlled, Signal type information.
- the type information of the traffic light is information such as a traffic light that displays red, yellow, or blue, a traffic light that displays red or blue for pedestrians, or a traffic light that indicates a left or right turn by an arrow.
- FIG. 3 is a diagram showing an example of travel link information and traffic signal information at an actual intersection.
- a travel link LKD1 is set on a road where a travel link LKU1 on which the host vehicle V travels exists.
- the travel link LKU1 is a travel link in the up lane
- the travel link LKD1 is a travel link in the down lane
- both are given different identifiers as separate travel links.
- the travel link LKU2A is a travel link for a straight lane
- the travel link LKU2B is a travel link for a right turn lane
- the travel link LKU2C is a travel link for a left turn lane.
- the travel link LKU2A and the travel link LKU2C are defined as different travel links because the connection links associated with each other are different.
- both the traffic light SG1 and the traffic light SG2 enter the field of view (imaging range) at a time as shown in FIG. It may be difficult to know whether you should pay attention to. In such a situation, an erroneous process may be performed in the process of specifying one of the traffic lights by an image recognition technique or the like. Note that the z-axis shown in FIG. 4 is the imaging direction.
- the traveling link LKU1 of the host vehicle V includes a traffic light SG1. Therefore, even when entering the imaging range at the same time as shown in FIG. 4, it is possible to identify the signal SG1 to be noted and extract the image region R including the signal SG1.
- one notable traffic signal for one travel link can be specified.
- a signal recognition method according to the present embodiment will be described in which one notable traffic signal is identified and the content indicated by the signal is recognized.
- the control device 10 of the signal recognition device 100 identifies a signal device to be noticed and stores a ROM (Read Only Memory) 12 in which a program for recognizing the contents of information indicated by the signal device and a program stored in the ROM are stored.
- the computer includes a CPU (Central Processing Unit) 11 as an operation circuit that functions as the signal recognition device 100 and a RAM (Random Access Memory) 13 that functions as an accessible storage device.
- CPU Central Processing Unit
- RAM Random Access Memory
- the control device 10 of the signal recognition device 100 has a captured image acquisition function, a vehicle position acquisition function, an attention signal device identification function, a signal image region extraction function, and a signal content recognition function.
- the control apparatus 10 of this embodiment performs each function by cooperation of the software for implement
- the control device 10 acquires a captured image around the host vehicle captured by the camera 20.
- the own vehicle position acquisition function of the control device 10 of this embodiment will be described.
- the control device 10 acquires the current position of the host vehicle detected by the position detection device 30. If there is posture information of the own vehicle detected by the position detection device 30, the control device 10 also acquires it.
- the attention signal device identification function of the control device 10 refers to the map information 41 and identifies a signal device to which attention should be paid based on the travel link to which the current position of the vehicle belongs.
- the control device 10 estimates a travel link on which the host vehicle travels from the travel link information acquired from the map information 41 and the current position of the host vehicle acquired from the position detection device.
- the control device 10 estimates the travel link associated with the point or region to which the current position of the host vehicle belongs as the travel link on which the host vehicle travels. Further, the control device 10 may estimate the travel link having the shortest (near) distance from the current position of the host vehicle as the travel link on which the host vehicle travels.
- the difference between the traveling direction of the host vehicle and the vector direction from the start point to the end point of the travel link is less than a predetermined threshold, for example, 90 ° or less.
- a travel link that is the link and has the shortest (closest) distance to the current position may be estimated as the travel link on which the host vehicle travels.
- connection link transition destination
- next travel link is limited to the connection link connected to the current travel link.
- the link that is closest to the current position may be selected.
- the control device 10 of the present embodiment refers to the travel link information 411 on which the host vehicle travels in the map information 41, and calculates the travel link on which the host vehicle travels next when it is determined that the end point of the travel link has been reached. To do. Specifically, the control device 10 refers to the travel link information 411 and determines the current position of the host vehicle when the distance between the host vehicle and the end point of the directed link associated with the travel link is less than a predetermined value. The connection link that is connected at the end point of the travel link to which the belongs belongs is calculated.
- the control device 10 estimates the travel link on which the host vehicle V will travel next at the timing when the host vehicle V reaches the end point of the travel link LKU1. .
- the control device 10 refers to the travel link information 411 and / or the traffic signal information 412 associated with the map information 41, and identifies a noticeable traffic signal associated with the estimated travel link of the host vehicle. To do.
- the control device 10 identifies the travel link ID on which the host vehicle travels, refers to the traffic light information 412 associated with the travel link ID in the travel link information 411, and when the host vehicle travels on the travel link, Identify noticeable traffic lights. And the control apparatus 10 acquires the three-dimensional position information, the classification, etc., such as the installation position and height of the specified traffic signal, from the traffic signal information 412.
- the control device 10 extracts the image area of the traffic signal in the captured image of the camera 20 based on the determined position information of the traffic signal and the imaging characteristic information 42 of the camera 20.
- the control device 10 includes an external parameter that includes the position of the host vehicle acquired by the host vehicle position acquisition function, the three-dimensional position information of the traffic signal to be noted specified by the traffic signal specifying function, and the position information of the camera 20 attached to the host vehicle. From the (imaging characteristic information 42), the relative positional relationship of the traffic light with respect to the camera 20 is calculated from the geometric relationship.
- the control device 10 of the present embodiment extracts the image area of the traffic light in the captured image in consideration of the posture of the host vehicle detected by the host vehicle position acquisition function. By taking into account the attitude of the host vehicle, it is possible to accurately extract an image region in which an image of a traffic light appears.
- specific processing is not limited, coordinate conversion according to the posture of the host vehicle is performed, and an image area of the traffic signal in the captured image when the traffic signal is captured in the current posture of the host vehicle is obtained.
- the control device 10 determines the direction of the travel link on which the host vehicle travels. It can be used as a posture.
- a travel link having a curvature such as a right turn or a left turn
- the posture at the start node and the posture at the end node are included in the travel link information of the map information 41 in advance, and the position of the host vehicle and the start node of the travel link and The distance to the end point node is calculated, and the change in posture at each position from the start point node to the end point node of the travel link can be calculated based on the travel rate of the host vehicle on the travel link.
- the driving device 21 of the camera 20 changes the imaging direction of the camera 20 based on the position of the image area of the traffic light in the captured image.
- the position of the image area of the traffic light used when changing the imaging direction of the camera 20 not only the relative position information up to the traffic light based on the current camera 20 but also the vehicle speed, yaw rate, etc. It is preferable to calculate the image area of the traffic light specified in the next cycle in consideration of the traveling information of the host vehicle and the expected time required for the process of calculating the image area of the traffic light.
- the travel information of the host vehicle is acquired from the vehicle controller 60.
- the driving device 21 adjusts the imaging direction of the camera 20 so that the camera 20 can capture the image area of the predicted traffic light. As a result, the next traffic light can be accurately identified.
- the camera 20 changes the imaging magnification of the camera 20 based on the ratio of the image area of the traffic light to the captured image.
- the ratio of the image area of the traffic signal to the entire captured image used when changing the imaging magnification of the camera 20 not only the relative position information up to the traffic signal based on the current camera 20 but also the own vehicle It is preferable to calculate the image area of the traffic light specified in the next cycle in consideration of the travel information of the host vehicle such as the vehicle speed and the yaw rate of the vehicle and the expected time required for the process of calculating the image area of the traffic light.
- the driving device 21 adjusts the imaging magnification of the camera 20 so that the camera 20 can clearly capture the image area of the predicted traffic light. Thereby, the content recognition of the signal which the next traffic signal shows can be performed correctly.
- the control device 10 determines the image area on the captured image in which the image of the specified traffic signal appears from the relative position of the traffic signal with respect to the camera 20 and the internal parameters (imaging characteristic information 42) including lens distortion information of the camera 20. (Signal signal image area) is extracted.
- the central coordinates of the image area of the traffic light are obtained by projecting and converting the three-dimensional coordinates of the central portion of the traffic light (for example, the central portion of the yellow light if it is a red, yellow, blue type signal) to the coordinate system of the captured image of the camera 20. Ask.
- the size of the image area of the traffic light may be arbitrarily set to a certain size, may be set according to the type of the traffic light, or the size is changed according to the distance from the own vehicle to the traffic light May be.
- the size of the image area of the traffic light of the captured image is set so that the distance to the traffic light is larger so that the distance to the traffic light is larger, and the image area of the traffic light is closer to the traffic light. May be reduced.
- the size of the image area of the traffic light may be changed according to the detection accuracy of the position detection device 30 of the host vehicle.
- the control device 10 recognizes the signal content of the traffic signal based on the extracted traffic image of the image area.
- the control device 10 performs processing for recognizing the signal content of the traffic light for the image area of the traffic light extracted by the signal image extraction function, and acquires information indicated by the signal.
- the signal content recognition processing is not particularly limited, but a template image is held for each piece of information indicated by the traffic signal in advance, the image area of the traffic light is specifically identified by general template matching in image processing, and then Further, the lighting state of each signal (for example, red, yellow, and blue) indicated by the traffic light is verified by color recognition, and the lighted color is recognized as information indicated by the traffic light.
- the signal recognition method is not particularly limited, and a method known at the time of filing can be appropriately used.
- the processing content shown in FIG. 6 is continuously performed at an interval of, for example, about 50 msec in the signal recognition ECU functioning as the control device 10.
- step S ⁇ b> 110 the control device 10 acquires the current position of the host vehicle detected by the position detection device 30.
- step S120 the control device 10 determines the own vehicle position based on the position of the host vehicle acquired in step S110 and the information on the travel link determined that the host vehicle was traveling (belonged to) in the previous process. It is determined whether or not the vehicle has reached the end node of the travel link. As the determination method, the method described based on FIG. 5 is used. If it is determined that the host vehicle has reached the end point node, the process proceeds to step S130. If it is not determined that the host vehicle has reached the end point node, the processing of steps 110 and 120 is continued.
- step S130 the control device 10 obtains a travel link on which the host vehicle travels based on the current position of the host vehicle acquired in step S110 and the travel link information 411 included in the map information 41, and proceeds to step S140.
- step S140 the control device 10 determines a traffic signal to be noted based on the travel link to which the current position of the host vehicle belongs, from the identifier (ID) of the travel link to which the host vehicle belongs in step S130 and the map information 41. Identify.
- step S150 the control device 10 refers to the traffic signal information 412 of the map information 41, and acquires the position information of the traffic signal identified in step S140, the current position of the host vehicle acquired in step S110, and attached to the host vehicle.
- the relative position of the traffic light with respect to the camera 20 is calculated from the obtained external parameters (imaging characteristic information 42) of the camera 20.
- step S160 the control device 10 extracts the image area of the traffic signal in the captured image of the camera 20 based on the specified position information of the traffic signal and the imaging characteristic information 42 of the camera 20.
- step S170 the control device 10 recognizes the signal content of the traffic signal based on the image of the traffic signal in the image area.
- step S180 the control device 10 sends the recognition result to the navigation device 50, the vehicle controller 60, or the drive system 70.
- the in-vehicle device performs driving support according to the content of the signal indicated by the traffic light.
- the driving support system 1 of the present embodiment executes control to reduce the speed of the host vehicle or displays a stop or caution signal. Execute the guidance with voice.
- step 220 the control device 10 changes the imaging direction of the camera 20 based on the position of the image area of the traffic light in the captured image obtained in step S160. This is because when the signal image is deviated from the center of the captured image, the image capturing direction of the camera 20 is corrected so that an image of the entire signal can be acquired.
- the image area of the signal obtained in step S160 is used, the image area of the signal is predicted at the timing of processing performed in the next cycle in step S220, and the position of the predicted image area of the traffic light is estimated.
- the imaging direction of the camera 20 is changed based on the above. Since the vehicle is moving, it is predicted that the position of the image area of the traffic light in the current processing cycle is different from the position of the image area of the traffic light in the next processing cycle.
- the image area of the traffic signal specified in the next cycle is determined. calculate.
- the signal recognition device 100 has the following effects.
- the travel link information 411 defined by the directed link and associated with the connection link and the travel direction information is associated with the travel link information.
- the traffic signal to be noted is specified based on the travel link to which the current position of the host vehicle belongs, so even in a complicated traffic environment where a plurality of traffic signals exist, The traveling link can be accurately estimated, and as a result, one traffic light that the driver should pay attention to can be accurately identified.
- a travel link which is defined as a directed link by a start point and an end point, is set for each traveling lane of the road, and is set for each traveling direction information such as a straight line, a right turn, and a left turn in the intersection.
- traveling direction information such as a straight line, a right turn, and a left turn in the intersection.
- the left turn travel link LKU2C and the straight travel link LKU2A exist on the same lane, but the left turn travel link LKU2C is a connecting link LKU3- Since the straight traveling link LKU2A is associated with the TL and is associated with the transitional connection link LKU3-ST, the traveling link LKU2C and the traveling link LKU2A can be accurately identified.
- the travel link specifying process is performed at the timing when the vehicle approaches the end point node of the travel link within a predetermined distance. Can be specified. For example, when the detection accuracy of the current position of the host vehicle is lowered, it is possible not to select an incorrect connection link.
- the attitude of the host vehicle is acquired, and the image area of the traffic light in that attitude is extracted. Therefore, the position of the image area where the image of the traffic signal appears can be accurately obtained. it can.
- the lane, the directed link, the connection link, and the traveling direction information have higher accuracy. From the travel link information estimated in (1), it is possible to identify one notable traffic signal.
- the camera 20 can be driven, imaging can be performed regardless of the position of the traffic light. For example, in an intersection environment as shown in FIG. 3, in the situation of waiting for a right turn at the point TRP of the travel link LKU3-TR, the signal SG3 that is out of the field of view is captured by the camera 20 that images the normal front. be able to. Also, compared to using a camera with a wide viewing angle, using a driving camera with a narrow viewing angle can reduce the possibility that a traffic light that should not be noticed will be reflected, thereby reducing misrecognition. Can do.
- the camera 20 has a zoom drive function and controls the increase / decrease of the imaging magnification according to the size of the image area of the traffic light. Therefore, regardless of the distance relationship with the traffic light, The size of the image area of the traffic light in the captured image can be kept appropriate. For this reason, it is possible to further reduce the risk that other traffic signals are reflected. In addition, since the size of the image area of the traffic signal to be recognized is substantially constant, the accuracy of the signal recognition process can be increased.
- the driving support system 1 including the signal recognition device 100, the navigation device 50, the vehicle controller 60, and the drive system 70 according to the present invention will be described as an example. It is not limited.
- a signal recognition apparatus 100 including a control apparatus 10, a camera 20 as an imaging unit, a position detection apparatus 30, and a database 40 will be described as an example.
- the present invention is not limited to this.
- a signal recognition apparatus which includes a captured image acquisition unit, a vehicle position acquisition unit, a target signal device identification unit, a signal image region extraction unit, and a signal content recognition unit
- imaging is performed.
- the signal recognition device 100 including the control device 10 that executes the image acquisition function, the vehicle position acquisition function, the attention signal device identification function, the signal image region extraction function, and the signal content recognition function will be described as an example. It is not limited to.
- Driving support system DESCRIPTION OF SYMBOLS 100 ... Signal recognition apparatus 10 ... Control apparatus 11 ... CPU 12 ... ROM 13 ... RAM DESCRIPTION OF SYMBOLS 20 ... Camera 30 ... Position detection apparatus 40 ... Database 41 ... Map information 411 ... Traveling link information 412 ... Traffic signal information 50 ... Navigation apparatus 60 ... Vehicle controller 70 ... Drive system
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Geometry (AREA)
- Mechanical Engineering (AREA)
- Signal Processing (AREA)
- Traffic Control Systems (AREA)
- Image Analysis (AREA)
- Navigation (AREA)
- Image Processing (AREA)
Abstract
Description
本実施形態では、始点及び終点により有向リンクとして定義された、走行リンクが道路の走行車線ごとに設定され、交差点内においては、直線、右折、左折などの進行方向情報ごとに設定されるため、例えば図3に示すような複雑な交差点内の環境においても、自車両が注目すべき信号機を特定することができる。
本実施形態では、走行リンクが、次に接続する接続リンクの情報が対応づけられているので、同じ道路に複数の走行リンクが存在する場合であっても、適切に自車両の属する走行リンクを推測することができる。例えば図3のように信号機SG2が配置された交差点での左折時においては、左折走行リンクLKU2Cと、直進走行リンクLKU2Aが同じ車線上に存在するが、左折走行リンクLKU2Cは遷移する接続リンクLKU3-TLと対応づけられ、直進走行リンクLKU2Aは、遷移する接続リンクLKU3-STと対応づけられているので、走行リンクLKU2Cと走行リンクLKU2Aとを正確に識別することができる。
100…信号認識装置
10…制御装置
11…CPU
12…ROM
13…RAM
20…カメラ
30…位置検出装置
40…データベース
41…地図情報
411…走行リンク情報
412…信号機情報
50…ナビゲーション装置
60…車両コントローラ
70…駆動系
Claims (6)
- 自車両に搭載された撮像手段から、前記自車両の周囲の撮像画像を取得する撮像画像取得手段と、
前記自車両の現在位置を取得する自車位置取得手段と、
始点及び終点と走行方向とを含む有向リンクで車線ごとに定義されるとともに、前記有向リンクの始点及び終点で接続する接続リンクと、直進又は右左折を含む進行方向を特定する進行方向情報とが対応づけられた走行リンク情報と、前記走行リンクに対応づけられ、当該走行リンクを走行する際に注目する信号機の位置情報を含む信号機情報と、を含む地図情報を参照し、前記自車両の現在位置が属する走行リンクに基づいて注目すべき信号機を特定する注目信号機特定手段と、
前記特定された信号機の位置情報と前記撮像手段の撮像特性情報とに基づいて、前記撮像手段の撮像画像における前記信号機の画像領域を抽出する信号画像領域抽出手段と、
前記抽出された画像領域の前記信号機の画像に基づいて、当該信号機の信号内容を認識する信号内容認識手段と、を備える信号認識装置。 - 前記注目信号機特定手段は、前記自車両が走行する走行リンク情報を参照し、前記自車両と前記走行リンクに対応づけられた前記有向リンクの終点との距離が所定値未満となった場合に、前記自車両が現在位置が属する走行リンクの次に走行する走行リンクを演算し、前記走行リンクを走行する際に注目すべき信号機を特定することを特徴とする請求項1に記載の信号認識装置。
- 前記自車位置取得手段は、現在位置における自車両の姿勢を取得し、
前記取得された前記自車両の姿勢における、前記信号機の画像領域を抽出することを特徴とする請求項1又は2に記載の信号認識装置。 - 一つの前記走行リンク情報には、一つの前記信号機情報が対応づけられていることを特徴とする請求項1~3の何れか一項に記載の信号認識装置。
- 前記撮像手段は、当該撮像手段の撮像方向を変更させる駆動装置を備え、
前記駆動装置は、前記撮像画像における前記信号機の画像領域の位置に基づいて、前記撮像手段の撮像方向を変更することを特徴とする請求項1~4のいずれか一項に記載の信号認識装置。 - 前記撮像手段は、ズーム機能を備え、
前記撮像手段のズーム機能は、前記撮像画像に対する前記信号機の画像領域の面積比に基づいて、撮像倍率を制御することを特徴とする請求項1~5のいずれか一項に記載の信号認識装置。
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201480017472.6A CN105074794B (zh) | 2013-04-04 | 2014-02-25 | 信号识别装置 |
RU2015140803A RU2666061C2 (ru) | 2013-04-04 | 2014-02-25 | Устройство распознавания сигнала регулирования движения |
EP14778961.4A EP2983153B1 (en) | 2013-04-04 | 2014-02-25 | Signal recognition device |
MX2015013884A MX346231B (es) | 2013-04-04 | 2014-02-25 | Aparato de reconocimiento de señales de tránsito. |
JP2015509951A JP5962850B2 (ja) | 2013-04-04 | 2014-02-25 | 信号認識装置 |
BR112015024721-0A BR112015024721B1 (pt) | 2013-04-04 | 2014-02-25 | Aparelho de reconhecimento de sinal de trânsito |
US14/782,072 US9389093B2 (en) | 2013-04-04 | 2014-02-25 | Traffic signal recognition apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013-078368 | 2013-04-04 | ||
JP2013078368 | 2013-04-04 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014162797A1 true WO2014162797A1 (ja) | 2014-10-09 |
Family
ID=51658101
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/054435 WO2014162797A1 (ja) | 2013-04-04 | 2014-02-25 | 信号認識装置 |
Country Status (8)
Country | Link |
---|---|
US (1) | US9389093B2 (ja) |
EP (1) | EP2983153B1 (ja) |
JP (1) | JP5962850B2 (ja) |
CN (1) | CN105074794B (ja) |
BR (1) | BR112015024721B1 (ja) |
MX (1) | MX346231B (ja) |
RU (1) | RU2666061C2 (ja) |
WO (1) | WO2014162797A1 (ja) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016203616A1 (ja) * | 2015-06-18 | 2016-12-22 | 日産自動車株式会社 | 信号機検出装置及び信号機検出方法 |
JP2016223874A (ja) * | 2015-05-29 | 2016-12-28 | 富士重工業株式会社 | 道路地図情報処理装置、及び処理方法 |
JP2017016279A (ja) * | 2015-06-30 | 2017-01-19 | 株式会社ゼンリン | 運転支援装置、運転支援システム、コンピュータプログラム、データ構造 |
WO2017009934A1 (ja) * | 2015-07-13 | 2017-01-19 | 日産自動車株式会社 | 信号機認識装置及び信号機認識方法 |
WO2017009933A1 (ja) * | 2015-07-13 | 2017-01-19 | 日産自動車株式会社 | 信号機認識装置及び信号機認識方法 |
JP2017130163A (ja) * | 2016-01-22 | 2017-07-27 | 富士通テン株式会社 | 信号機の点灯色判定装置および信号機の点灯色判定方法 |
CN107735826A (zh) * | 2015-06-09 | 2018-02-23 | 日产自动车株式会社 | 信号机检测装置及信号机检测方法 |
JP2021076883A (ja) * | 2019-11-05 | 2021-05-20 | 三菱スペース・ソフトウエア株式会社 | データベース生成システムおよびデータベース生成プログラム |
JP2021076884A (ja) * | 2019-11-05 | 2021-05-20 | 三菱スペース・ソフトウエア株式会社 | 自動検出システムおよび自動検出プログラム |
JP2021124456A (ja) * | 2020-02-07 | 2021-08-30 | 三菱重工機械システム株式会社 | 経路推定装置、経路推定方法、及びプログラム |
JP2021524026A (ja) * | 2018-06-19 | 2021-09-09 | ベイジン ディディ インフィニティ テクノロジー アンド ディベロップメント カンパニー リミティッド | 姿勢判断システムおよび方法 |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9164511B1 (en) | 2013-04-17 | 2015-10-20 | Google Inc. | Use of detected objects for image processing |
US9558408B2 (en) * | 2013-10-15 | 2017-01-31 | Ford Global Technologies, Llc | Traffic signal prediction |
DE102016216070A1 (de) * | 2016-08-26 | 2018-03-01 | Siemens Aktiengesellschaft | Steuergerät, System mit solch einem Steuergerät und Verfahren zum Betrieb solch eines Systems |
CN109964132B (zh) * | 2017-02-07 | 2022-01-18 | 宝马股份公司 | 用于在运动物体上配置传感器的方法、设备和*** |
DE102017102593A1 (de) * | 2017-02-09 | 2018-08-09 | SMR Patents S.à.r.l. | Verfahren und Vorrichtung zum Erkennen des Signalisierungszustands von mindestens einer Signalvorrichtung |
JP6552064B2 (ja) * | 2017-03-31 | 2019-07-31 | 株式会社Subaru | 車両の走行制御システム |
JP6838522B2 (ja) * | 2017-08-10 | 2021-03-03 | トヨタ自動車株式会社 | 画像収集システム、画像収集方法、画像収集装置、および記録媒体 |
JP6843819B2 (ja) * | 2018-11-27 | 2021-03-17 | 本田技研工業株式会社 | 交通案内物認識装置、交通案内物認識方法、およびプログラム |
KR20200069542A (ko) * | 2018-12-07 | 2020-06-17 | 팅크웨어(주) | 차선 내 안내 정보 추출을 통한 경로 안내 방법 및 이를 수행하는 전자 기기 |
JP7088135B2 (ja) * | 2019-07-23 | 2022-06-21 | トヨタ自動車株式会社 | 信号表示推定システム |
JP7088137B2 (ja) * | 2019-07-26 | 2022-06-21 | トヨタ自動車株式会社 | 信号機情報管理システム |
JP2021051603A (ja) * | 2019-09-25 | 2021-04-01 | 株式会社Jvcケンウッド | 車両用電子機器制御装置、車両用電子機器、車両用制御方法およびプログラム |
MX2022005541A (es) * | 2019-11-12 | 2022-11-28 | Nissan Motor | Metodo de reconocimiento de semaforo y dispositivo de reconocimiento de semaforo. |
WO2022197628A1 (en) * | 2021-03-17 | 2022-09-22 | Argo AI, LLC | Remote guidance for autonomous vehicles |
US11987248B2 (en) * | 2021-03-23 | 2024-05-21 | Toyota Jidosha Kabushiki Kaisha | Vehicle control device |
CN113452904B (zh) * | 2021-06-18 | 2022-11-04 | 北京三快在线科技有限公司 | 一种交通信号灯检测方法及装置 |
US11810049B2 (en) * | 2021-08-20 | 2023-11-07 | Ford Global Technologies, Llc | Systems and methods to generate a last mile travel route for a delivery robot |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11306489A (ja) * | 1998-04-16 | 1999-11-05 | Matsushita Electric Ind Co Ltd | カメラシステム |
JP3857698B2 (ja) | 2004-04-05 | 2006-12-13 | 株式会社日立製作所 | 走行環境認識装置 |
JP2007071581A (ja) * | 2005-09-05 | 2007-03-22 | Xanavi Informatics Corp | ナビゲーション装置 |
JP2007178223A (ja) * | 2005-12-27 | 2007-07-12 | Aisin Aw Co Ltd | 地物認識装置 |
JP2008293277A (ja) * | 2007-05-24 | 2008-12-04 | Aisin Aw Co Ltd | 信号機検出装置、信号機検出方法及びプログラム |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100224326B1 (ko) * | 1995-12-26 | 1999-10-15 | 모리 하루오 | 차량용 네비게이션장치 |
JP3619628B2 (ja) * | 1996-12-19 | 2005-02-09 | 株式会社日立製作所 | 走行環境認識装置 |
WO2004028134A2 (en) * | 2002-09-20 | 2004-04-01 | M7 Visual Intelligence, Lp | Vehicule based data collection and porcessing system |
JP4631750B2 (ja) * | 2006-03-06 | 2011-02-16 | トヨタ自動車株式会社 | 画像処理システム |
JP4446201B2 (ja) * | 2007-03-30 | 2010-04-07 | アイシン・エィ・ダブリュ株式会社 | 画像認識装置及び画像認識方法 |
US8751154B2 (en) * | 2008-04-24 | 2014-06-10 | GM Global Technology Operations LLC | Enhanced clear path detection in the presence of traffic infrastructure indicator |
US8559673B2 (en) * | 2010-01-22 | 2013-10-15 | Google Inc. | Traffic signal mapping and detection |
JP5691915B2 (ja) | 2011-07-27 | 2015-04-01 | アイシン・エィ・ダブリュ株式会社 | 移動案内システム、移動案内装置、移動案内方法及びコンピュータプログラム |
US9501929B2 (en) * | 2013-01-25 | 2016-11-22 | Mitsubishi Electric Corporation | Movement assistance device and movement assistance method |
-
2014
- 2014-02-25 US US14/782,072 patent/US9389093B2/en active Active
- 2014-02-25 JP JP2015509951A patent/JP5962850B2/ja active Active
- 2014-02-25 WO PCT/JP2014/054435 patent/WO2014162797A1/ja active Application Filing
- 2014-02-25 EP EP14778961.4A patent/EP2983153B1/en active Active
- 2014-02-25 BR BR112015024721-0A patent/BR112015024721B1/pt active IP Right Grant
- 2014-02-25 CN CN201480017472.6A patent/CN105074794B/zh active Active
- 2014-02-25 RU RU2015140803A patent/RU2666061C2/ru active
- 2014-02-25 MX MX2015013884A patent/MX346231B/es active IP Right Grant
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11306489A (ja) * | 1998-04-16 | 1999-11-05 | Matsushita Electric Ind Co Ltd | カメラシステム |
JP3857698B2 (ja) | 2004-04-05 | 2006-12-13 | 株式会社日立製作所 | 走行環境認識装置 |
JP2007071581A (ja) * | 2005-09-05 | 2007-03-22 | Xanavi Informatics Corp | ナビゲーション装置 |
JP2007178223A (ja) * | 2005-12-27 | 2007-07-12 | Aisin Aw Co Ltd | 地物認識装置 |
JP2008293277A (ja) * | 2007-05-24 | 2008-12-04 | Aisin Aw Co Ltd | 信号機検出装置、信号機検出方法及びプログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2983153A4 |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016223874A (ja) * | 2015-05-29 | 2016-12-28 | 富士重工業株式会社 | 道路地図情報処理装置、及び処理方法 |
CN107735826B (zh) * | 2015-06-09 | 2019-07-23 | 日产自动车株式会社 | 信号机检测装置及信号机检测方法 |
CN107735826A (zh) * | 2015-06-09 | 2018-02-23 | 日产自动车株式会社 | 信号机检测装置及信号机检测方法 |
WO2016203616A1 (ja) * | 2015-06-18 | 2016-12-22 | 日産自動車株式会社 | 信号機検出装置及び信号機検出方法 |
JPWO2016203616A1 (ja) * | 2015-06-18 | 2018-04-26 | 日産自動車株式会社 | 信号機検出装置及び信号機検出方法 |
JP2017016279A (ja) * | 2015-06-30 | 2017-01-19 | 株式会社ゼンリン | 運転支援装置、運転支援システム、コンピュータプログラム、データ構造 |
KR20180018732A (ko) * | 2015-07-13 | 2018-02-21 | 닛산 지도우샤 가부시키가이샤 | 신호기 인식 장치 및 신호기 인식 방법 |
KR101988811B1 (ko) * | 2015-07-13 | 2019-06-12 | 닛산 지도우샤 가부시키가이샤 | 신호기 인식 장치 및 신호기 인식 방법 |
CN107851387A (zh) * | 2015-07-13 | 2018-03-27 | 日产自动车株式会社 | 信号机识别装置及信号机识别方法 |
WO2017009933A1 (ja) * | 2015-07-13 | 2017-01-19 | 日産自動車株式会社 | 信号機認識装置及び信号機認識方法 |
JPWO2017009933A1 (ja) * | 2015-07-13 | 2018-05-31 | 日産自動車株式会社 | 信号機認識装置及び信号機認識方法 |
JPWO2017009934A1 (ja) * | 2015-07-13 | 2018-06-14 | 日産自動車株式会社 | 信号機認識装置及び信号機認識方法 |
EP3324383A4 (en) * | 2015-07-13 | 2018-12-05 | Nissan Motor Co., Ltd. | Traffic light recognition device and traffic light recognition method |
EP3324384A4 (en) * | 2015-07-13 | 2018-12-05 | Nissan Motor Co., Ltd. | Traffic light recognition device and traffic light recognition method |
RU2678527C1 (ru) * | 2015-07-13 | 2019-01-29 | Ниссан Мотор Ко., Лтд. | Устройство и способ распознавания светофора |
CN107851387B (zh) * | 2015-07-13 | 2021-04-27 | 日产自动车株式会社 | 信号机识别装置及信号机识别方法 |
US10339805B2 (en) | 2015-07-13 | 2019-07-02 | Nissan Motor Co., Ltd. | Traffic light recognition device and traffic light recognition method |
RU2693419C1 (ru) * | 2015-07-13 | 2019-07-02 | Ниссан Мотор Ко., Лтд. | Устройство (варианты) и способ распознавания светофоров |
WO2017009934A1 (ja) * | 2015-07-13 | 2017-01-19 | 日産自動車株式会社 | 信号機認識装置及び信号機認識方法 |
US10789491B2 (en) | 2015-07-13 | 2020-09-29 | Nissan Motor Co., Ltd. | Traffic light recognition device and traffic light recognition method |
JP2017130163A (ja) * | 2016-01-22 | 2017-07-27 | 富士通テン株式会社 | 信号機の点灯色判定装置および信号機の点灯色判定方法 |
JP2021524026A (ja) * | 2018-06-19 | 2021-09-09 | ベイジン ディディ インフィニティ テクノロジー アンド ディベロップメント カンパニー リミティッド | 姿勢判断システムおよび方法 |
JP2021076883A (ja) * | 2019-11-05 | 2021-05-20 | 三菱スペース・ソフトウエア株式会社 | データベース生成システムおよびデータベース生成プログラム |
JP2021076884A (ja) * | 2019-11-05 | 2021-05-20 | 三菱スペース・ソフトウエア株式会社 | 自動検出システムおよび自動検出プログラム |
JP2021124456A (ja) * | 2020-02-07 | 2021-08-30 | 三菱重工機械システム株式会社 | 経路推定装置、経路推定方法、及びプログラム |
JP7390204B2 (ja) | 2020-02-07 | 2023-12-01 | 三菱重工機械システム株式会社 | 経路推定装置、経路推定方法、及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
JPWO2014162797A1 (ja) | 2017-02-16 |
RU2015140803A (ru) | 2017-05-15 |
MX2015013884A (es) | 2016-06-06 |
JP5962850B2 (ja) | 2016-08-03 |
EP2983153B1 (en) | 2018-12-19 |
US9389093B2 (en) | 2016-07-12 |
RU2666061C2 (ru) | 2018-09-05 |
BR112015024721B1 (pt) | 2022-01-18 |
US20160054138A1 (en) | 2016-02-25 |
EP2983153A1 (en) | 2016-02-10 |
MX346231B (es) | 2017-03-13 |
BR112015024721A2 (pt) | 2017-07-18 |
EP2983153A4 (en) | 2016-06-01 |
CN105074794A (zh) | 2015-11-18 |
CN105074794B (zh) | 2017-10-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5962850B2 (ja) | 信号認識装置 | |
US8305431B2 (en) | Device intended to support the driving of a motor vehicle comprising a system capable of capturing stereoscopic images | |
EP2933790B1 (en) | Moving object location/attitude angle estimation device and moving object location/attitude angle estimation method | |
CN109658719B (zh) | 用于识别交通指示牌的方法、车辆设备和可信性验证方法以及存储媒介 | |
JP3711405B2 (ja) | カメラを利用した車両の道路情報抽出方法及びシステム | |
CN106463051B (zh) | 信号机识别装置以及信号机识别方法 | |
WO2020209363A1 (ja) | 道路種別判定装置および運転支援装置 | |
CN113859263B (zh) | 预定行驶路径设定装置以及预定行驶路径设定方法 | |
JP2018048949A (ja) | 物体識別装置 | |
JP2006344133A (ja) | 道路区画線検出装置 | |
CN114944073B (zh) | 地图生成装置和车辆控制装置 | |
CN114973644B (zh) | 道路信息生成装置 | |
JP7226583B2 (ja) | 信号機認識方法及び信号機認識装置 | |
WO2020036044A1 (ja) | 画像処理装置と画像処理方法およびプログラム | |
JP2020038551A (ja) | 顔向き検出装置、顔向き検出方法、及び制御プログラム | |
US20220254056A1 (en) | Distance calculation apparatus and vehicle position estimation apparatus | |
JP7362800B2 (ja) | 車両制御装置 | |
US11867526B2 (en) | Map generation apparatus | |
JP7141479B2 (ja) | 地図生成装置 | |
JP7467522B2 (ja) | 車両制御装置 | |
JP2022123238A (ja) | 区画線認識装置 | |
JP2024013451A (ja) | 車両用検出装置 | |
JP2022123239A (ja) | 区画線認識装置 | |
JP2023148240A (ja) | 区画線認識装置 | |
CN115050203A (zh) | 地图生成装置以及车辆位置识别装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201480017472.6 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14778961 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2015509951 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2015/013884 Country of ref document: MX |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14782072 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014778961 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2015140803 Country of ref document: RU Kind code of ref document: A |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112015024721 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112015024721 Country of ref document: BR Kind code of ref document: A2 Effective date: 20150925 |