KR101614247B1 - Apparatus for displaying image matching region of panorama image - Google Patents
Apparatus for displaying image matching region of panorama image Download PDFInfo
- Publication number
- KR101614247B1 KR101614247B1 KR1020150070416A KR20150070416A KR101614247B1 KR 101614247 B1 KR101614247 B1 KR 101614247B1 KR 1020150070416 A KR1020150070416 A KR 1020150070416A KR 20150070416 A KR20150070416 A KR 20150070416A KR 101614247 B1 KR101614247 B1 KR 101614247B1
- Authority
- KR
- South Korea
- Prior art keywords
- image
- images
- degree
- synthesized
- joint surface
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2622—Signal amplitude transition in the zone between image portions, e.g. soft edges
-
- H04N5/23238—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
An object of the present invention is to provide a device for displaying a junction surface of a panoramic image which calculates the degree of mismatch between junctions in which a plurality of images overlap each other and enlarges an arbitrary image region when the mismatch degree is high. To this end, according to the present invention, there is provided an apparatus for displaying a contact surface of a panoramic image, comprising: a plurality of cameras for photographing a periphery of a vehicle; A panorama image forming a joint surface is formed in a region where arbitrary first image, second image and third image overlap each other from a plurality of images captured by the plurality of cameras, and a degree of discrepancy of the joint surfaces is calculated A control unit for dividing the joint surface and zooming in on an overlapping area in any one of the first to third images and outputting a synthesized panoramic image if the mismatch degree is higher than a preset reference value for mismatch determination; ; And a display unit for displaying a panorama image output by the control unit. Therefore, according to the present invention, the degree of discrepancy of the joints synthesized in the plurality of images is calculated, and if the degree of discrepancy is high, the arbitrary image area is enlarged and displayed to display the distortion of the discordant area and the disappearance of the object There is an advantage that it can be improved.
Description
More particularly, the present invention relates to an apparatus for displaying a joint surface of a panoramic image, and more particularly, to a joint surface display apparatus for a panoramic image, And more particularly to a joint surface display apparatus for a panoramic image.
BACKGROUND ART Generally, as a means for safe driving of a vehicle, a side mirror installed on a side door for securing a view of a rear side of a vehicle, a room mirror installed on a roof lining of a vehicle interior for securing a rear view of the vehicle room mirror.
Such a mirror can grasp the side and rear situation up to a certain level, but it may also cause a blind spot that is not visible by the mirror, which is insufficient for recognizing the rear situation, and the object or person is located in such blind spot May cause serious damage to the vehicle as well as damage to persons.
In order to prevent accidents occurring in the blind spot in the rear of the vehicle, a rear surveillance camera for rear surveillance is installed in the vehicle, and the image of the rear of the vehicle is displayed on the screen through a navigation device or a separate display device. However, there are many proposals for a rear-view surveillance system that allows the driver to recognize the situation of the rear of the vehicle accurately and to ensure safe driving.
However, since the conventional back-up surveillance system mounted on the vehicle needs to use a separate display device for displaying the back-up surveillance image, there is a disadvantage in that a separate cost is incurred by the display device, And has a disadvantage that it adversely affects the aesthetics of the vehicle.
There has been proposed a method of displaying a rear monitoring image by utilizing a room mirror, which is indispensably provided in a vehicle, in order to solve the drawbacks that arise in a rearview monitoring system mounted on an existing vehicle as is well known.
BACKGROUND ART [0002] Conventional techniques for rearward monitoring video display using a room mirror are disclosed in Korean Patent Application Publication No. 10-2002-0009711 (entitled: (Hereinafter, referred to as " technology 1 ") and Korean Patent Registration No. 10-0792933 (entitled " Automobile Room Mirror and Rear Detection System Including the Same " .
The prior art 1 discloses a rearview device for watching a rear state of a vehicle or a sky wave broadcast in accordance with a driving condition of the vehicle through a room mirror provided in a vehicle interior to remove a blind spot in a rear view, Thereby eliminating the inconvenience caused by the mounting.
The disclosed prior art 2 is composed of a room mirror housing, a half mirror installed on the front surface of the room mirror housing, a display panel provided on the rear surface of the half mirror and having a permanent magnet, and an electromagnet corresponding to the permanent magnet, So that the driver can easily look at the rear screen when backing up, thereby preventing an accident and preventing damage to the vehicle.
However, such conventional techniques merely display an image input through a rear camera, and when two or more images are synthesized and output, there is a problem that accurate image output is difficult due to image distortion.
In addition, there is a problem that objects included in the joint surface disappear in the course of synthesis.
In order to solve such problems, the present invention provides a joint surface display device for a panoramic image, which calculates a mismatch degree of a junction where mutually overlapping regions are synthesized in a plurality of images and enlarges and displays an arbitrary image region if the mismatch degree is high .
According to an aspect of the present invention, there is provided an apparatus for displaying a joint surface of a panoramic image, comprising: a plurality of cameras for photographing a periphery of a vehicle; A panorama image forming a joint surface is formed in a region where arbitrary first image, second image and third image overlap each other from a plurality of images captured by the plurality of cameras, and a degree of discrepancy of the joint surfaces is calculated A control unit for dividing the joint surface and zooming in on an overlapping area in any one of the first to third images and outputting a synthesized panoramic image if the mismatch degree is higher than a preset reference value for mismatch determination; ; And a display unit for displaying a panorama image output by the control unit.
The control unit may further include: a video input unit receiving first through third images to be combined among a plurality of images captured by the camera; An image synthesizer for synthesizing a panoramic image formed by joining the first and second images in a region where the first and second images overlap each other; A mismatch degree calculator for calculating a mismatch degree of the joint surface in the synthesized panorama image; And comparing the calculated mismatch degree with a predetermined reference value for mismatch determination, and if the mismatch degree is larger than the reference value, dividing the mismatched surface, And an image correcting unit for outputting a panoramic image synthesized on the joint surface.
According to another aspect of the present invention, the first image and the second image are images in which only a part of the image is overlapped, and the third image is an image including a region in which the first and second images overlap.
In addition, the zoom-in according to the present invention is characterized in that overlapping regions included in an image of either the first image or the second image are synthesized.
Also, the zoom-in according to the present invention is characterized in that a third image including overlapping regions of the first and second images is synthesized.
Further, the image correction unit according to the present invention is characterized in that when the degree of discrepancy is smaller than a reference value, a panoramic image including the joint surface is output.
The mismatch degree according to the present invention may be a value obtained by calculating at least one deviation of hue and contrast by comparing a third image including the overlapping area among the synthesized junction plane and the input image as a reference image, The sum value of the deviation of the pixel value of the image positioned on the left side and the right side of the junction or the sum value of the deviation of the pixel value of the image located on the upper side and the lower side, And an edge value appearing as an edge filter in the joint region, based on the difference between the intensity of the image positioned on the left side and the intensity difference value on the image positioned on the right side or the intensity difference value of the image positioned on the upper side and the lower side.
According to the present invention, it is possible to calculate the degree of discrepancy of the joints in which the regions overlapping each other in a plurality of images are calculated and enlarge and display an arbitrary image region if the degree of discordance is high to improve the distortion of the discordant region and the disappearance of the object There is an advantage to be able to do.
BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing a configuration of an apparatus for displaying a junction plane of a panoramic image according to the present invention. Fig.
2 is a block diagram showing a configuration of a control unit of a device for displaying a junction plane of a panoramic image according to the present invention.
3 is a view illustrating an image synthesizing process of a device for displaying a joint surface of a panoramic image according to the present invention.
4 is a view illustrating another example of a process of synthesizing an image of a joint surface of a panoramic image according to the present invention.
FIG. 5 is a view showing an image before combining the apparatus for displaying a joint surface of a panoramic image according to the present invention. FIG.
6 is a view illustrating an image after combining using a device for displaying a junction surface of a panoramic image according to the present invention.
7 is a view illustrating another example of a process of synthesizing an image of a joint surface of a panoramic image according to the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT Hereinafter, a preferred embodiment of a device for displaying a joint surface of a panoramic image according to the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a block diagram showing a configuration of a bonding surface display apparatus for a panoramic image according to the present invention, and FIG. 2 is a block diagram showing a configuration of a control unit of a bonding surface display apparatus for a panoramic image according to the present invention.
As shown in FIGS. 1 and 2, a joint surface display apparatus for a panoramic image according to the present invention includes a plurality of
The plurality of
The
The
The
The fourth
The first to
The
The
The
3, the
The
In addition, the
In particular, in the case of the
The
The degree of inconsistency is determined by comparing the combined
It can be determined that the synthesis is good as the color deviation or the card deviation is small.
The degree of discrepancy may be a color deviation value calculated between the synthesized
The degree of discrepancy may be a sum value obtained by calculating the sum of deviations of pixel values of images located on the left and right sides of the
The degree of discrepancy may be a difference value obtained by subtracting a color from an image positioned on the left and right sides of the joint to reduce the problem of hue, or a difference between the intensities obtained by subtracting a color from an image positioned on the upper and lower sides of the joint And it can be determined that the greater the difference value, the greater the degree of inconsistency.
The degree of discrepancy may be a value obtained by calculating an edge value represented by an edge filter in a joint region, and it may be determined that the degree of discrepancy of the joint increases when the edge value is large.
The
The zoom-in part splits the
That is, as shown in FIG. 4, the
5 and 6 are views illustrating images before and after the composite surface display apparatus of a panoramic image according to the present invention. When a
At this time, a missing object or an obstacle can be seen by separating the
In addition, if the mismatch degree is larger than the reference value, the zoom-in may be combined with the second image 220 'so that one side of the overlap region 210'a of the first image 210' The panoramic image 200 'may be provided.
Although a part of the first image 210 'is expanded and overlapped in the present embodiment, it is also possible to synthesize the panoramic image 200' by overlapping and synthesizing a part of the
Also, the
The
Therefore, by calculating the degree of inconsistency of the junctions in which the regions overlapping each other in the plurality of images are calculated and if the degree of inconsistency is high, the arbitrary image region is enlarged and displayed to improve the distortion of the inconsistent region and the disappearance of the object .
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims. It can be understood that
In the course of the description of the embodiments of the present invention, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation, , Which may vary depending on the intentions or customs of the user, the operator, and the interpretation of such terms should be based on the contents throughout this specification.
100: display device
110: First camera
120: Second camera
130: Third camera
140: Fourth camera
150:
151:
152:
153: inconsistency calculator
154: image correction unit
160:
200, 200 ': Panoramic image
210, 210 ': first image
220, 220 ': Second image
230:
240: Third image
Claims (7)
The first image 210, the second image 220 and the third image 240 are superimposed on each other from a plurality of images captured by the plurality of cameras 110, 120, 130, (230) is formed, and the degree of inconsistency of the bonding surface (230) is calculated. When the degree of inconsistency is higher than a predetermined reference value for inconsistency determination, the bonding surface (230) A controller 150 for outputting a panoramic image obtained by zooming in on an overlapping area of any one of the first to third images 210, 220, and 240 and synthesizing the panoramic image; And
And a display unit (160) for displaying the panoramic image output by the controller (150).
The control unit 150 includes an image input unit 151 receiving the first through third images 210, 220, and 240 to be composited among a plurality of images captured by the cameras 110, 120, 130, and 140;
A panoramic image 200 in which a joint surface 230 is formed in an area where the first and second images 210 and 220 are overlapped among the first to third images 210, 220 and 240 is synthesized An image combining unit 152;
A mismatch degree calculator 153 for calculating a mismatch degree of the joint surface 230 in the synthesized panorama image 200; And
If the degree of discrepancy is larger than the reference value, the joining surface 230 is divided, and the first to third images 210, 220, And an image correcting unit (154) for zooming in areas overlapping each other in any one of the images of the panoramic image (240) and outputting the panoramic image synthesized on the joint surface (230).
Wherein the first image (210) and the second image (220) are images that overlap only a part of the region, and the third image (240) is an image including an overlapping region of the first and second images A joint surface display device for an image.
Wherein the zoom-in causes the overlap area included in the image of either the first image (210) or the second image (220) to be synthesized.
Wherein the zoom in causes the third image (240) including the overlapped area of the first and second images (210, 220) to be synthesized.
Wherein the image correcting unit (154) outputs the panoramic image (200) including the joint surface (230) when the degree of inconsistency is smaller than a reference value.
Wherein the mismatch degree is a value obtained by calculating at least one deviation between hue and contrast by comparing a third image including the overlapping area among the synthesized junction plane and the input image as a reference image, And the sum of the deviations of the pixel values of the images located on the upper and lower sides, the sum of the deviations of the pixel values of the images located on the left and right sides of the junction, Wherein the at least one of the brightness difference value of the image located at the upper side and the lower side and the edge value represented by the edge filter at the junction region is calculated.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150070416A KR101614247B1 (en) | 2015-05-20 | 2015-05-20 | Apparatus for displaying image matching region of panorama image |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150070416A KR101614247B1 (en) | 2015-05-20 | 2015-05-20 | Apparatus for displaying image matching region of panorama image |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101614247B1 true KR101614247B1 (en) | 2016-04-29 |
Family
ID=55915879
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150070416A KR101614247B1 (en) | 2015-05-20 | 2015-05-20 | Apparatus for displaying image matching region of panorama image |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101614247B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101868057B1 (en) * | 2017-01-20 | 2018-06-18 | 재단법인대구경북과학기술원 | Method for generating panoramic image and apparatus thereof |
KR20190056292A (en) * | 2017-11-16 | 2019-05-24 | 엑시스 에이비 | Method, device and camera for blending a first and a second image having overlapping fields of view |
KR20200137214A (en) * | 2019-05-29 | 2020-12-09 | 현대모비스 주식회사 | Apparatus and method for evaluating a surround-view image for a vehicle |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20020009711A (en) | 2000-07-26 | 2002-02-02 | 이계안 | A picture display system using a room mirror |
JP2007328582A (en) * | 2006-06-08 | 2007-12-20 | Matsushita Electric Ind Co Ltd | Image synthesizer and method thereof |
KR100792933B1 (en) | 2006-10-11 | 2008-01-08 | 현대자동차주식회사 | Automobile room mirror and rear perception system having the same |
JP2009081666A (en) * | 2007-09-26 | 2009-04-16 | Nissan Motor Co Ltd | Vehicle periphery monitoring apparatus and image displaying method |
JP2012023658A (en) * | 2010-07-16 | 2012-02-02 | Toshiba Alpine Automotive Technology Corp | Image display device for vehicle |
JP2014090349A (en) * | 2012-10-31 | 2014-05-15 | Clarion Co Ltd | Image processing system and image processing method |
-
2015
- 2015-05-20 KR KR1020150070416A patent/KR101614247B1/en active IP Right Grant
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20020009711A (en) | 2000-07-26 | 2002-02-02 | 이계안 | A picture display system using a room mirror |
JP2007328582A (en) * | 2006-06-08 | 2007-12-20 | Matsushita Electric Ind Co Ltd | Image synthesizer and method thereof |
KR100792933B1 (en) | 2006-10-11 | 2008-01-08 | 현대자동차주식회사 | Automobile room mirror and rear perception system having the same |
JP2009081666A (en) * | 2007-09-26 | 2009-04-16 | Nissan Motor Co Ltd | Vehicle periphery monitoring apparatus and image displaying method |
JP2012023658A (en) * | 2010-07-16 | 2012-02-02 | Toshiba Alpine Automotive Technology Corp | Image display device for vehicle |
JP2014090349A (en) * | 2012-10-31 | 2014-05-15 | Clarion Co Ltd | Image processing system and image processing method |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101868057B1 (en) * | 2017-01-20 | 2018-06-18 | 재단법인대구경북과학기술원 | Method for generating panoramic image and apparatus thereof |
KR20190056292A (en) * | 2017-11-16 | 2019-05-24 | 엑시스 에이비 | Method, device and camera for blending a first and a second image having overlapping fields of view |
KR102154402B1 (en) * | 2017-11-16 | 2020-09-09 | 엑시스 에이비 | Method, device and camera for blending a first and a second image having overlapping fields of view |
KR20200137214A (en) * | 2019-05-29 | 2020-12-09 | 현대모비스 주식회사 | Apparatus and method for evaluating a surround-view image for a vehicle |
KR102566120B1 (en) | 2019-05-29 | 2023-08-11 | 현대모비스 주식회사 | Apparatus and method for evaluating a surround-view image for a vehicle |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5194679B2 (en) | Vehicle periphery monitoring device and video display method | |
JP5321711B2 (en) | Vehicle periphery monitoring device and video display method | |
JP4254887B2 (en) | Image display system for vehicles | |
US20150042799A1 (en) | Object highlighting and sensing in vehicle image display systems | |
US7825953B2 (en) | Vehicular image display apparatus | |
US10029621B2 (en) | Rear view camera system using rear view mirror location | |
US8279279B2 (en) | Image processing apparatus | |
JP4195966B2 (en) | Image display control device | |
US20140114534A1 (en) | Dynamic rearview mirror display features | |
JP7244488B2 (en) | Composite video creation device, composite video creation method, and composite video creation program | |
JP5051263B2 (en) | Vehicle rear view system | |
WO2014034364A1 (en) | Image generating apparatus, image displaying system, parameter acquiring apparatus, image generating method, and parameter acquiring method | |
US20050270500A1 (en) | Monitoring apparatus | |
JP2013183298A (en) | Rearward visibility support device for vehicle and rearward visibility support method for vehicle | |
JP2018052216A5 (en) | ||
KR101614247B1 (en) | Apparatus for displaying image matching region of panorama image | |
JP4830380B2 (en) | Vehicle periphery monitoring device and vehicle periphery monitoring method | |
JP2020028027A (en) | Periphery display device for vehicle | |
JP2016168877A (en) | Visual recognition device for vehicle | |
KR101657673B1 (en) | Apparatus and method for generating panorama view | |
JP2021027469A (en) | Image processing device, image processing method, and image processing program | |
JP6293089B2 (en) | Rear monitor | |
KR101750156B1 (en) | Apparatus and method for displaying panorama image of vehicle | |
JP2009083744A (en) | Synthetic image adjustment device | |
CN216331763U (en) | Intelligent automobile electronic rearview mirror equipment of integrated panorama function and BSD function |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GRNT | Written decision to grant | ||
FPAY | Annual fee payment |
Payment date: 20190326 Year of fee payment: 4 |