JP7082538B2 - 画像処理装置及びプログラム - Google Patents
画像処理装置及びプログラム Download PDFInfo
- Publication number
- JP7082538B2 JP7082538B2 JP2018130439A JP2018130439A JP7082538B2 JP 7082538 B2 JP7082538 B2 JP 7082538B2 JP 2018130439 A JP2018130439 A JP 2018130439A JP 2018130439 A JP2018130439 A JP 2018130439A JP 7082538 B2 JP7082538 B2 JP 7082538B2
- Authority
- JP
- Japan
- Prior art keywords
- image
- vehicle
- road
- unit
- superimposed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 claims description 29
- 238000013500 data storage Methods 0.000 claims description 3
- 238000007726 management method Methods 0.000 description 59
- 238000000034 method Methods 0.000 description 35
- 238000004891 communication Methods 0.000 description 29
- 230000005540 biological transmission Effects 0.000 description 9
- 230000010365 information processing Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/307—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
- B60R2300/308—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene by overlaying the real scene, e.g. through a head-up display on the windscreen
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Software Systems (AREA)
- Library & Information Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Traffic Control Systems (AREA)
- Closed-Circuit Television Systems (AREA)
- Studio Devices (AREA)
Description
[先行技術文献]
[特許文献]
[特許文献1]特開2014-170378号公報
Claims (3)
- 道路地図データであって、複数の道路のそれぞれの白線の有無を示す白線情報を含む道路地図データを格納する地図データ格納部と、
第1の車両によって撮像された第1撮像画像と、前記第1撮像画像の撮像位置とを含む第1車両画像情報を取得する車両画像情報取得部と、
前記第1車両画像情報及び前記道路地図データに基づいて、前記第1撮像画像に道路画像を重畳するか否かを判定する重畳要否判定部であって、前記道路地図データが、前記第1車両画像情報に含まれる前記第1撮像画像の撮像位置の道路に白線が含まれることを示す場合であって、前記第1撮像画像内に白線を認識できない場合に、前記第1撮像画像に前記道路画像を重畳すると判定する、重畳要否判定部と、
前記第1の車両以外の車両によって道路の見通しが良いときに撮像された複数の道路画像から、前記撮像位置に対応する道路画像を取得する道路画像取得部と、
前記重畳要否判定部によって重畳すると判定された場合に、前記第1撮像画像に前記道路画像を重畳した第1重畳画像を生成する重畳画像生成部と、
前記重畳画像生成部によって生成された前記第1重畳画像を、前記第1の車両の後方を走行している第2の車両に送信する重畳画像送信部と
を備える画像処理装置。 - 白線が含まれるが前記白線を視認できない道路を走行している第1の車両から重畳要求を受信する重畳要求受信部と、
前記重畳要求受信部が前記重畳要求を受信した場合に、前記第1の車両の前方を走行している第2の車両に対して、前記第2の車両によって撮像された撮像画像と、前記撮像画像の撮像位置とを含む車両画像情報を要求する車両画像情報要求部と、
前記車両画像情報要求部による前記要求に応じて前記第2の車両が送信した前記車両画像情報を受信する車両画像情報取得部と、
前記第1の車両及び前記第2の車両以外の車両によって道路の見通しが良いときに撮像された複数の道路画像から、前記撮像位置に対応する道路画像を取得する道路画像取得部と、
前記撮像画像に前記道路画像を重畳した重畳画像を生成する重畳画像生成部と、
前記重畳画像生成部によって生成された前記重畳画像を、前記第1の車両に送信する重畳画像送信部と
を備える画像処理装置。 - コンピュータを、請求項1又は2に記載の画像処理装置として機能させるためのプログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018130439A JP7082538B2 (ja) | 2018-07-10 | 2018-07-10 | 画像処理装置及びプログラム |
CN201910560947.0A CN110706497B (zh) | 2018-07-10 | 2019-06-26 | 图像处理装置以及计算机可读存储介质 |
US16/507,072 US11039087B2 (en) | 2018-07-10 | 2019-07-10 | Image processing apparatus and computer-readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018130439A JP7082538B2 (ja) | 2018-07-10 | 2018-07-10 | 画像処理装置及びプログラム |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2020009215A JP2020009215A (ja) | 2020-01-16 |
JP7082538B2 true JP7082538B2 (ja) | 2022-06-08 |
Family
ID=69139283
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2018130439A Active JP7082538B2 (ja) | 2018-07-10 | 2018-07-10 | 画像処理装置及びプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US11039087B2 (ja) |
JP (1) | JP7082538B2 (ja) |
CN (1) | CN110706497B (ja) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7384014B2 (ja) * | 2019-12-06 | 2023-11-21 | トヨタ自動車株式会社 | 表示システム |
US20220397421A1 (en) * | 2019-12-17 | 2022-12-15 | Mitsubishi Electric Corporation | Measurement vehicle, and base station |
JP7464230B1 (ja) | 2022-10-04 | 2024-04-09 | 株式会社Cct | 表示装置 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011152865A (ja) | 2010-01-27 | 2011-08-11 | Kyocera Corp | 車載撮像装置 |
JP2015177442A (ja) | 2014-03-17 | 2015-10-05 | パイオニア株式会社 | 情報処理装置、情報処理方法、情報処理プログラム及び情報処理プログラムを記録したコンピュータ読み取り可能な記録媒体 |
JP2016126605A (ja) | 2015-01-06 | 2016-07-11 | 株式会社日立製作所 | 走行環境認識システム |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001101566A (ja) * | 1999-09-30 | 2001-04-13 | Toshiba Corp | 交通安全確認システム |
JP2005112187A (ja) * | 2003-10-08 | 2005-04-28 | Denso Corp | 車両用表示装置 |
JP4560716B2 (ja) * | 2004-09-28 | 2010-10-13 | アイシン精機株式会社 | 車両の周辺監視システム |
JP5017989B2 (ja) * | 2006-09-27 | 2012-09-05 | ソニー株式会社 | 撮像装置、撮像方法 |
DE102007044535B4 (de) * | 2007-09-18 | 2022-07-14 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zur Fahrerinformation in einem Kraftfahrzeug |
JP5299026B2 (ja) * | 2009-03-30 | 2013-09-25 | マツダ株式会社 | 車両用表示装置 |
US8384532B2 (en) * | 2009-04-02 | 2013-02-26 | GM Global Technology Operations LLC | Lane of travel on windshield head-up display |
US8416300B2 (en) * | 2009-05-20 | 2013-04-09 | International Business Machines Corporation | Traffic system for enhancing driver visibility |
CN101739843B (zh) * | 2009-12-04 | 2012-08-29 | 河海大学常州校区 | 多视觉信息融合的车辆安全驾驶实时立体感知装置及方法 |
JP5551236B2 (ja) * | 2010-03-03 | 2014-07-16 | パナソニック株式会社 | 道路状況管理システム及び道路状況管理方法 |
JP5817927B2 (ja) * | 2012-05-18 | 2015-11-18 | 日産自動車株式会社 | 車両用表示装置、車両用表示方法及び車両用表示プログラム |
US9728228B2 (en) * | 2012-08-10 | 2017-08-08 | Smartdrive Systems, Inc. | Vehicle event playback apparatus and methods |
DE102012215322A1 (de) * | 2012-08-29 | 2014-03-06 | Robert Bosch Gmbh | Verfahren und Vorrichtung zum Erkennen einer Position eines Fahrzeugs auf einer Fahrspur |
JP6328369B2 (ja) * | 2012-11-27 | 2018-05-23 | クラリオン株式会社 | 車載用制御装置 |
JP6083261B2 (ja) | 2013-03-04 | 2017-02-22 | 株式会社デンソー | 情報処理センターおよび車載機 |
JP6156486B2 (ja) * | 2013-03-28 | 2017-07-05 | アイシン精機株式会社 | 周辺監視装置、及びプログラム |
JP6173791B2 (ja) * | 2013-06-25 | 2017-08-02 | 株式会社東芝 | 道路状況把握システム、及び道路状況把握装置 |
JP6142784B2 (ja) * | 2013-11-27 | 2017-06-07 | 株式会社デンソー | 運転支援装置 |
WO2015129045A1 (ja) * | 2014-02-28 | 2015-09-03 | パイオニア株式会社 | 画像取得システム、端末、画像取得方法および画像取得プログラム |
US20170248958A1 (en) * | 2016-02-25 | 2017-08-31 | Delphi Technologies, Inc. | Adjacent lane verification for an automated vehicle |
JP6414567B2 (ja) * | 2016-06-02 | 2018-10-31 | トヨタ自動車株式会社 | 車両用制限速度表示装置 |
US10339812B2 (en) * | 2017-03-02 | 2019-07-02 | Denso International America, Inc. | Surrounding view camera blockage detection |
US10699571B2 (en) * | 2017-12-04 | 2020-06-30 | Ford Global Technologies, Llc | High definition 3D mapping |
-
2018
- 2018-07-10 JP JP2018130439A patent/JP7082538B2/ja active Active
-
2019
- 2019-06-26 CN CN201910560947.0A patent/CN110706497B/zh active Active
- 2019-07-10 US US16/507,072 patent/US11039087B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011152865A (ja) | 2010-01-27 | 2011-08-11 | Kyocera Corp | 車載撮像装置 |
JP2015177442A (ja) | 2014-03-17 | 2015-10-05 | パイオニア株式会社 | 情報処理装置、情報処理方法、情報処理プログラム及び情報処理プログラムを記録したコンピュータ読み取り可能な記録媒体 |
JP2016126605A (ja) | 2015-01-06 | 2016-07-11 | 株式会社日立製作所 | 走行環境認識システム |
Also Published As
Publication number | Publication date |
---|---|
CN110706497A (zh) | 2020-01-17 |
US20200021751A1 (en) | 2020-01-16 |
US11039087B2 (en) | 2021-06-15 |
JP2020009215A (ja) | 2020-01-16 |
CN110706497B (zh) | 2022-12-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110519555B (zh) | 显示控制装置以及计算机可读存储介质 | |
JP7082538B2 (ja) | 画像処理装置及びプログラム | |
US10997853B2 (en) | Control device and computer readable storage medium | |
US11935336B2 (en) | Drive recorder, method of operating drive recorder, and recording medium storing instructions for operating same | |
CN110620901B (zh) | 控制装置以及计算机可读存储介质 | |
US11322026B2 (en) | Control device and computer readable storage medium | |
CN110581981B (zh) | 显示控制装置以及计算机可读存储介质 | |
CN110782686B (zh) | 控制装置以及计算机可读存储介质 | |
JP2016173764A (ja) | 撮影装置、撮影システム、撮影方法および撮影プログラム | |
JP7026003B2 (ja) | 表示制御装置及びプログラム | |
KR20080050731A (ko) | 휴대용 단말기에서 교통소통정보를 획득하기 위한 방법 및장치 | |
CN110782685B (zh) | 显示控制装置以及计算机可读存储介质 | |
JP6982548B2 (ja) | 表示制御装置及びプログラム | |
US11430213B2 (en) | Information processing device, information processing method, and storage medium | |
JP7016773B2 (ja) | 表示制御装置及びプログラム | |
WO2016147355A1 (ja) | 情報処理装置および情報処理方法 | |
JP2017182200A (ja) | 画像処理装置、画像処理方法、画像処理プログラム及び記録媒体 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20201130 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20211021 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20211026 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20211222 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220208 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220408 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20220510 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20220527 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7082538 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |