EP2730890B1 - Vehicle image capture system - Google Patents
Vehicle image capture system Download PDFInfo
- Publication number
- EP2730890B1 EP2730890B1 EP12191668.8A EP12191668A EP2730890B1 EP 2730890 B1 EP2730890 B1 EP 2730890B1 EP 12191668 A EP12191668 A EP 12191668A EP 2730890 B1 EP2730890 B1 EP 2730890B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vehicle
- images
- image capture
- capture system
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 description 6
- 238000010276 construction Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000004297 night vision Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
Definitions
- the present invention relates to a vehicle image capture system.
- the present invention further relates to a vehicle comprising a vehicle image capture system.
- Vehicles are often driven repetitively along a certain route. If a user of a vehicle for example commutes between his home and his workplace, he may choose to drive the same route for several days every week over periods of months or years. Along the route there may be objects he needs to or would like to take pictures of. Situations may arise, when he would like to take several pictures of the same object over a period of time. For example, he may want to obtain documentation of the development of a construction site next to the road, or he may want to collect information regarding which part of the year a particular passage of the road is flooded.
- the document WO 2011053335 A1 discloses a method for detecting e.g. objects along a navigable street.
- the method includes placing a GPS system with a user interface screen in a vehicle.
- the GPS is connected to a forward facing camera for capture still images. Following capture the images are geocoded, and the result is a series of geocoded pictures along a route.
- the document US 2008051997 A1 discloses a system for creating and providing interactive access to a street-based photographic image database. Images are automatically collected at incremental distances along each of a plurality of streets of travel, each of the images are indexed with respect to unique correlation data.
- the document US2010141736 A1 discloses a method for assembling a database of geographically related images.
- the method employs a computer, which is interconnected with a GPS transceiver and distance measurement means and a digital camera arranged on a moving vehicle for taking a plurality of geographic location related images.
- the camera takes a photo which is stored for post-processing.
- the post-processing determines a path traveled by the vehicle using the positions and distance measurements and assigns an accurate geographic location and orientation to each photo.
- the method is useful in building a database of geographically related images.
- the document US 2011/106434 discloses an image capturing device for a vehicle that includes an object to be captured information storage unit for storing information about an object to be captured on a map, a camera for capturing an image of the object to be captured, an object to be captured position determining unit for determining a distance from the current position to the object to be captured, and the direction of the object to be captured, a camera control unit for controlling the camera to orient the camera toward the determined direction and to focus the camera on the determined distance, and a determining unit for determining whether or not an image captured by the camera is clearly captured or not. When an image is clearly captured it is stored in the information storage unit.
- US 2006/132602 A1 relates to an image acquisition device that picks up the image of the surroundings of a vehicle, an image server that delivers images picked up, and an image display terminal that displays the images delivered by the image server.
- US 2009/0177378 A1 relates to capturing digital image data as well as performing a pattern recognition technique on the captured digital image data to determine whether the image includes one or more recognizable pre-defined features, whereas US 2003/0025791 A1 relates to a video surveillance system capable of recording time-lapse video.
- An object of the present invention is to facilitate for a user of a vehicle to capture images of a first chosen positions while driving along a route.
- the object is achieved by a vehicle image capture system, the system comprising a vehicle mounted image capture device being adapted to capture one or more images external of a vehicle, a navigation system and a user interface being arranged to allow a user to input a first position, and wherein the image capture device, the navigation system and the user interface being adapted to communicate with each other.
- the image capture system is adapted to compare an instantaneous position of the vehicle with the first position, and if the instantaneous position of the vehicle and the first position are within a predetermined proximity, to capture one or more images.
- the user may choose the first position before he starts the driving, or at any other occasion he finds convenient, he may focus on the driving and let the vehicle image capture system capture pictures of the desired first position. As a result, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a user that would like to capture images a preselected number of times, such as every time, of one or more chosen positions while driving along a route. If he, for example, decides that he would like the system to capture an image of a first position every time he drives on a route that passes the first position, the vehicle image capture system may capture several different images taken at the first position, or within the predetermined proximity of the first position, at several different occasions.
- the image capture system comprises an image capture device arranged to capture one or several images a preselected number of times, such as every time, when the instantaneous position of the vehicle and the first position are within a predetermined proximity, resulting in a series of images I 1 , I 2 , I 3 , ... I N captured within the predetermined proximity of the first position.
- An object of the present invention is to facilitate for a user that would like to see or share the captured images, and/or facilitate for a user that would like to choose a selected motif when he or she would like to capture images of a selected position.
- the user interface of the image capture system comprises a display suitable for presenting the series of images I 1 , I 2 , I 3 , ... I N .
- An object of the present invention is to facilitate for a user that would like to see or share the captured images sorted after each other, such that the captured images may be viewed as a movie clip on a display.
- the image capture system comprises processing means arranged to sort chronologically the series of images I 1 , I 2 , I 3 , ... I N and present the chronologically sorted series of images along a timeline on a display, and that the user interface further is arranged to allow a user to scroll along the timeline for presenting the series of images I 1 , I 2 , I 3 , ... I N as a movie clip.
- An object of the present invention is to increase the sorting possibilities and improve the quality of at least some of the selected images.
- the image capture system includes an object recognition system.
- An object of the present invention is to provide a series of images I 1 , I 2 , I 3 , ... I N , wherein representative objects and/or reference objects on at least one image have a similar position with respect to a frame or edge of the image as the position with respect to a frame or edge of the image of at least one other image in the series of images I 1 , I 2 , I 3 , ... I N .
- representative objects and/or reference objects on all, or at least a major part of the images in the series of images I 1 , I 2 , I 3 , ... I N are positioned in a similar position with respect to a frame or edge of the image.
- the image capture system comprise an image capture device arranged to capture several images in a sequence every time the instantaneous position of the vehicle and the first position are within a predetermined proximity, and that the object recognition system is arranged to select an image among the several images which selected image is added to the series of images I 1 , I 2 , I 3 , ... I N , and in that that the selection of an image among the several images is based on at least one characteristic of the selected image.
- the image wherein a representative object and/or reference object of an image is captured from a vehicle position such that the position of the representative object and/or reference object is closest to the position of the representative object and/or reference object of other images in the series of images I 1 , I 2 , I 3 , ... I N may be selected.
- An object of the present invention is to facilitate for a user of a vehicle to capture images of one or more chosen positions while driving along a route in a certain direction. If a user of a vehicle travels along a route in a first direction and in a second direction, an object of the present invention is to facilitate for a user of a vehicle that would like to capture images of one or more chosen positions along the route only when the vehicle approaches the one or more chosen positions from a first or second direction.
- the image capture system is arranged to capture one or more images only when the vehicle is approaching the first position from a preselected direction.
- An object of the present invention is to facilitate for a user of a vehicle to capture images of two or more positions while driving along a route.
- the image capture system comprises a user interface, wherein the user interface is arranged to allow a user to input two or more different positions, and that the image capture system is adapted to compare an instantaneous position of the vehicle with the two or more positions, and if the instantaneous position of the vehicle and any one of the two or more positions are within a predetermined proximity, to capture one or more images.
- An object of the present invention is to facilitate for a user that would like to share the captured images to, or see the captured images on, an electronic presentation device such as a computer, tablet computer, laptop, smartphone, PDA, TV or the like.
- the image capture system is arranged to send and/or receive data to/from one or more electronic presentation devices.
- An object of the present invention is to facilitate for a person that would like to travel along a route to capture images of a first chosen position while driving along a route.
- the object is achieved by a vehicle that comprises a vehicle image capture system.
- a vehicle that comprises a vehicle image capture system.
- Fig. 1 illustrates a vehicle 2 and a vehicle image capture system 1.
- the vehicle 2 may be a car, minivan, sport utility vehicle, recreational vehicle, truck, motorcycle or the like.
- a car is illustrated.
- the vehicle image capture system 1 comprises a vehicle mounted image capture device 3 being adapted to capture one or more images I external of the vehicle 2, a navigation system 4 and a user interface 5 being arranged to allow a user to input a first user-selected position.
- the navigation system 4 comprises a positioning system, e.g. a combined satellite based positioning an mapping system, such as the American Global Positioning System (GPS), the European Galileo global navigation satellite system (GNSS), the Russian Globalnaya Navigatsionnaya Sputnikovayassela or Global Navigation Satellite System (GLONASS) or the Chinese BeiDou (Compass) Navigation Satellite System.
- GPS Global Positioning System
- GNSS European Galileo global navigation satellite system
- GLONASS Global Navigation Satellite System
- Compass Chinese BeiDou
- the image capture device 1 may be a camera, such as a HD-camera, night vision camera, IR-camera, high-speed camera, digital camera or movie camera for capture images.
- the camera may be used in combination with a lens, such as an optical or digital lens, a widescreen lens, a magnifying lens or a zoom lens.
- the image capture device 1 may be a vehicle mounted camera facing in a direction external of the vehicle 2.
- an existing forward facing camera which is used also for other purposes, such as safety purposes or parking aid, may be used.
- the camera may face forward, rearward or in any other direction from the vehicle 2.
- the camera may be mounted at or in the vicinity of a windscreen, grille or rear-view mirror of the vehicle.
- the camera may be arranged to capture images from a perspective corresponding to the perspective a driver or user of the vehicle will have while seated in a driver or passenger seat of the vehicle 2.
- the image capture device 3, the navigation system 4 and the user interface 5 may be adapted to communicate with each other by any suitable means, such as via a controller area network (CAN), or any other vehicle based network.
- CAN controller area network
- the image capture system 1 may further be adapted to compare an instantaneous position of the vehicle with a position selected by a user.
- the navigation system 4 may be used for the comparison.
- the image capture system 1 may e.g. use a navigation system 4 such as a global positioning system (GPS) in order to compare the relation between a position or positions given by a user and the instantaneous position of the vehicle 2. If the instantaneous position of the vehicle 2 and the position selected by the user are within a predetermined proximity, the image capture system 1 may be adapted to capture one or more images.
- the image capture system 1 may provide location based footage, or location based image capturing, wherein the image capture system 1 only capture images if an instantaneous position of the vehicle 2 and a first position selected by a user are within a predetermined proximity.
- the images may be provided with information regarding the position where the images where captured, such as geo-tagging.
- the image capture system 1 may save and/or display other information related to the images captured, such as weather, temperature, captured audio information, road conditions etc.
- the image capture system 1 may communicate with other systems in order to collect, save or display information.
- the image capture system 1 may further be arranged to capture images of parts of the environment surrounding the vehicle 2.
- the image capture system 1 may still further be arranged to capture images of any objects or motifs within a certain distance from the vehicle 2.
- Fig. 1 illustrates a vehicle 2 seen from above at a position where a user has decided he would like to have pictures taken by the image capture system 1.
- the image capture device 3 is arranged to start to capture images of a motif 6, e.g. in front of the vehicle 2.
- the motif 6 is represented by a tree.
- the image capture system 1 may capture several images while the vehicle 2 is moving along a route 7 within the predetermined proximity of the selected position.
- the route 7 is represented by a road in fig. 1 .
- the image capture system 1 may subsequently select and save one or more images of the several images taken.
- the selection of an image I among the several images may be based on one or more characteristics of the selected image I, such as how objects are located with respect to an edge or frame of the image I, or based on the sharpness or brightness of the images.
- the selected images may form a series of images I 1 , I 2 , I 3 , ... I N .
- the image capture system 1 may be arranged to select an image I among the several images, such that objects represented in the image I have a similar position with respect to an edge or frame of the image as the corresponding objects have in other images in the series of images I 1 , I 2 , I 3 , ... I N .
- a person watching the images being displayed in sequence may be able to perceive the series of images I 1 , I 2 , I 3 , ... I N as a movie clip, wherein objects have the same or similar positions in different images.
- the image capture system 1 may be arranged to capture one or several images at a preselected number of instances when the instantaneous position of the vehicle and the first position are within a predetermined proximity. For instance, a user may select to let the image capture system 1 take one or several images every time the vehicle 2 is within a predetermined proximity of the user selected position.
- the image capture system 1 may be arranged to capture images every second time the vehicle 2 is within a predetermined proximity of the user selected position, or only if the vehicle 1 is within a predetermined proximity of the user selected position during certain periods of the day, such as during mornings and evenings.
- Fig. 2 illustrates the image capture system 1 including the image capture device 3, the navigation system 4, and the user interface 5 in vehicle 2 from a side view at a position on a route 7 where a user has decided he would like to have pictures captured by the image capture system 1.
- the image capture device 3 When the navigation system 4 detects that the vehicle 2 is within a predetermined proximity of a first position selected by the user the image capture device 3 is arranged to start to capture images of a motif 6 in front of the vehicle 2.
- the motif is represented by a tree.
- the image capture device 3 may be arranged in a front part of the vehicle 2, such as at or in the vicinity of a windscreen or grille as illustrated in fig. 2 .
- the periphery of a captured image I between an image capture device 3 and the motif 6 is outlined.
- Fig. 3 illustrates an interior of a vehicle provided with the image capture system 1.
- the user interface 5, including the display 11, timeline 8 and scrolling means 9, is arranged in a centre stack.
- the user interface 5 may be arranged in other positions, such as on or in the vicinity of the dashboard, windscreen, door interior or steering wheel.
- the image capture device 1, the navigation system 4 and the user interface 5 illustrated in fig. 3 may be adapted to communicate with each other via a controller area network (CAN), or any other vehicle based network and/or communication means.
- CAN controller area network
- a representation of objects or motifs 6 as seen through the image capture device 3 may be presented on a display 11.
- the display 11 may be part of the user interface 5.
- the display 11 may be used if a user would like to select a certain motif when capturing images of a selected position.
- the display 11 may be a touch screen, permitting a user to input data. For example, a user may select motif, extension of an image, focus areas, colours etc. on the display.
- the display may be arranged to permit a user to tag images, e.g. tagging of persons or geographical positions.
- the image capture system may be arranged to display one or more user selected positions on a map.
- a user interface 5 or a display 11 may be used for other purposes, such as navigation, communicating or entertainment.
- a user interface or display arranged in another system may be arranged to be used also in the image capture system 1.
- a user may transfer a focal point from a first distance from the vehicle 2 to a second distance from the vehicle 2.
- a user may be able to zoom such that an object on an image I captured by the image capture device 3 may be located at any desired distance from the vehicle 1.
- the image capture system 3 may therefore be used for the capture of close-up images near the vehicle 2, or for the capture of motifs further away from the vehicle 2, such as a horizon or sunset.
- the image capture device 3 may include auto-focus or the like, for capture of high quality images I. Characteristics of the image capture device 3 may depend on different factors such as speed of the vehicle 2, light conditions or road conditions.
- the image capture system 1 may comprise processing means arranged to sort chronologically the series of images I 1 , I 2 , I 3 , ... I N and present the chronologically sorted series of images along a timeline 8 on a display 11 of the user interface 5.
- a user interface 5 of the image capture system 1 may be arranged to allow a user to scroll along the timeline for presenting the series of images I 1 , I 2 , I 3 , ... I N as a movie clip 10. For instance, when scrolling in one direction the movie clip is played forwards and when scrolling in a second direction the movie clip is played backwards.
- the timeline 8 and scrolling means 9 are arranged at the display 11 of the user interface 5. However, the timeline 8 and scrolling means 9 may be arranged in the vicinity of or separate from the display 11.
- Timeline T 1 represents a number of different occasions when images I 1 , I 2 , I 3 , ... I N are captured. Any amount of time may pass between the occasions when the images I 1 , I 2 , I 3 , ... I N are captured. If a user selects a first position where he would like the image capture system 1 to capture images, and he seldom drives a route that passes by the first position, it may take days, weeks, months or even years between capture of the images I 1 , I 2 , I 3 , ... I N .
- the length of the timeline T 1 may represent the span of the total amount of time between the capture of a first image I 1 to the capture of an image I N .
- Timeline T 2 represents the images I 1 , I 2 , I 3 , ... I N , as the images are arranged together for facilitating the images being viewed on a display 11.
- the image capture system 1 comprises processing means arranged to sort chronologically the series of images I 1 , I 2 , I 3 , ... I N and present the chronologically sorted series of images along a timeline 8 on the display 11.
- the user interface 5 is arranged to allow a user to scroll along a timeline for presenting the series of images I 1 , I 2 , I 3 , ... I N as a movie clip 10.
- the span of the timeline T 2 may represent the length of the movie clip 10.
- the phenomena of showing frames or pictures on a display 11 at a higher frame rate than the rate of which the images or pictures were taken is sometimes referred to as time lapse photo or time lapse footage.
- the movie clip 10 may be displayed with a desired number of images per time unit. The number of images per second is generally expressed as frame rate. Movie clips or films are often presented at a frame rate of 24 frames/s, which means that 24 subsequent images appear on the display 11 every second.
- the user interface 5 is arranged to allow a user to scroll along the timeline 8 for presenting the series of images I 1 , I 2 , I 3 , ... I N at any frame rate, such as e.g. 1-50 frames per second. If a user scrolls at a high speed, the number of frames displayed each second may be higher than if a user scrolls at a lower speed.
- T1 is larger than T1.
- One or more of the images I 1 , I 2 , I 3 , ... I N may be blurred part of the time or all of the time the series of images I 1 , I 2 , I 3 , ... I N are displayed on the display 11. Thanks to this a user watching the movie clip 10 may perceive the changes between the different images to be smoother and more linear.
- a timeline 8, series of images I 1 , I 2 , I 3 , ... I N , or movie clip 10 may for instance be arranged to be displayed at internet pages and/or social networks such as twitter, Facebook, Instagram or the like.
- more than one image capturing system 1, arranged in two or more vehicles 2 may be arranged to communicate or interact.
- a common series of images I 1 , I 2 , I 3 , ... I N in where different images origin from different image capture systems 1 may be collected, saved and/or displayed.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Automation & Control Theory (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
Description
- The present invention relates to a vehicle image capture system. The present invention further relates to a vehicle comprising a vehicle image capture system.
- Vehicles are often driven repetitively along a certain route. If a user of a vehicle for example commutes between his home and his workplace, he may choose to drive the same route for several days every week over periods of months or years. Along the route there may be objects he needs to or would like to take pictures of. Situations may arise, when he would like to take several pictures of the same object over a period of time. For example, he may want to obtain documentation of the development of a construction site next to the road, or he may want to collect information regarding which part of the year a particular passage of the road is flooded.
- It may be inconvenient or associated with risks to stop and exit the vehicle at the time when he would like to take pictures of an object or position along his route. It may also be associated with risks if he shares focus between driving and taking pictures manually with a camera from a position within the vehicle. In addition, it may be difficult to take similar pictures from the same position using a hand held camera.
- The document
WO 2011053335 A1 discloses a method for detecting e.g. objects along a navigable street. The method includes placing a GPS system with a user interface screen in a vehicle. The GPS is connected to a forward facing camera for capture still images. Following capture the images are geocoded, and the result is a series of geocoded pictures along a route. - The document
US 2008051997 A1 discloses a system for creating and providing interactive access to a street-based photographic image database. Images are automatically collected at incremental distances along each of a plurality of streets of travel, each of the images are indexed with respect to unique correlation data. - If many vehicles equipped with the image capture systems travel along the same streets the result is a large number of images captured for the same or similar location collected by several different vehicles. In those cases,
US 2008051997 A1 suggests to reduce the number of images taken at a certain location. - The document
US2010141736 A1 discloses a method for assembling a database of geographically related images. The method employs a computer, which is interconnected with a GPS transceiver and distance measurement means and a digital camera arranged on a moving vehicle for taking a plurality of geographic location related images. The camera takes a photo which is stored for post-processing. The post-processing determines a path traveled by the vehicle using the positions and distance measurements and assigns an accurate geographic location and orientation to each photo. The method is useful in building a database of geographically related images. - The document
US 2011/106434 discloses an image capturing device for a vehicle that includes an object to be captured information storage unit for storing information about an object to be captured on a map, a camera for capturing an image of the object to be captured, an object to be captured position determining unit for determining a distance from the current position to the object to be captured, and the direction of the object to be captured, a camera control unit for controlling the camera to orient the camera toward the determined direction and to focus the camera on the determined distance, and a determining unit for determining whether or not an image captured by the camera is clearly captured or not. When an image is clearly captured it is stored in the information storage unit. -
US 2006/132602 A1 relates to an image acquisition device that picks up the image of the surroundings of a vehicle, an image server that delivers images picked up, and an image display terminal that displays the images delivered by the image server.US 2009/0177378 A1 , on the other hand, relates to capturing digital image data as well as performing a pattern recognition technique on the captured digital image data to determine whether the image includes one or more recognizable pre-defined features, whereasUS 2003/0025791 A1 relates to a video surveillance system capable of recording time-lapse video. - An object of the present invention is to facilitate for a user of a vehicle to capture images of a first chosen positions while driving along a route.
- According to an aspect of the invention, the object is achieved by a vehicle image capture system, the system comprising a vehicle mounted image capture device being adapted to capture one or more images external of a vehicle, a navigation system and a user interface being arranged to allow a user to input a first position, and wherein the image capture device, the navigation system and the user interface being adapted to communicate with each other. The image capture system is adapted to compare an instantaneous position of the vehicle with the first position, and if the instantaneous position of the vehicle and the first position are within a predetermined proximity, to capture one or more images.
- Since the user may choose the first position before he starts the driving, or at any other occasion he finds convenient, he may focus on the driving and let the vehicle image capture system capture pictures of the desired first position. As a result, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a user that would like to capture images a preselected number of times, such as every time, of one or more chosen positions while driving along a route. If he, for example, decides that he would like the system to capture an image of a first position every time he drives on a route that passes the first position, the vehicle image capture system may capture several different images taken at the first position, or within the predetermined proximity of the first position, at several different occasions.
- According to the invention, the image capture system comprises an image capture device arranged to capture one or several images a preselected number of times, such as every time, when the instantaneous position of the vehicle and the first position are within a predetermined proximity, resulting in a series of images I1, I2, I3, ... IN captured within the predetermined proximity of the first position. As a result, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a user that would like to see or share the captured images, and/or facilitate for a user that would like to choose a selected motif when he or she would like to capture images of a selected position.
- According to an aspect of the invention, the user interface of the image capture system comprises a display suitable for presenting the series of images I1, I2, I3, ... IN. As a result, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a user that would like to see or share the captured images sorted after each other, such that the captured images may be viewed as a movie clip on a display.
- According to the invention, the image capture system comprises processing means arranged to sort chronologically the series of images I1, I2, I3, ... IN and present the chronologically sorted series of images along a timeline on a display, and that the user interface further is arranged to allow a user to scroll along the timeline for presenting the series of images I1, I2, I3, ... IN as a movie clip. As a result, the above mentioned object is achieved.
- An object of the present invention is to increase the sorting possibilities and improve the quality of at least some of the selected images.
- According to an aspect of the invention, the image capture system includes an object recognition system. As a result, the above mentioned object is achieved.
- An object of the present invention is to provide a series of images I1, I2, I3, ... IN, wherein representative objects and/or reference objects on at least one image have a similar position with respect to a frame or edge of the image as the position with respect to a frame or edge of the image of at least one other image in the series of images I1, I2, I3, ... IN. Preferably representative objects and/or reference objects on all, or at least a major part of the images in the series of images I1, I2, I3, ... IN, are positioned in a similar position with respect to a frame or edge of the image.
- According to an aspect of the invention, the image capture system comprise an image capture device arranged to capture several images in a sequence every time the instantaneous position of the vehicle and the first position are within a predetermined proximity, and that the object recognition system is arranged to select an image among the several images which selected image is added to the series of images I1, I2, I3, ... IN, and in that that the selection of an image among the several images is based on at least one characteristic of the selected image. As a result, the image wherein a representative object and/or reference object of an image is captured from a vehicle position such that the position of the representative object and/or reference object is closest to the position of the representative object and/or reference object of other images in the series of images I1, I2, I3, ... IN, may be selected. Thus, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a user of a vehicle to capture images of one or more chosen positions while driving along a route in a certain direction. If a user of a vehicle travels along a route in a first direction and in a second direction, an object of the present invention is to facilitate for a user of a vehicle that would like to capture images of one or more chosen positions along the route only when the vehicle approaches the one or more chosen positions from a first or second direction.
- According to an aspect of the invention, the image capture system is arranged to capture one or more images only when the vehicle is approaching the first position from a preselected direction. As a result, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a user of a vehicle to capture images of two or more positions while driving along a route.
- According to an aspect of the invention, the image capture system comprises a user interface, wherein the user interface is arranged to allow a user to input two or more different positions, and that the image capture system is adapted to compare an instantaneous position of the vehicle with the two or more positions, and if the instantaneous position of the vehicle and any one of the two or more positions are within a predetermined proximity, to capture one or more images. As a result, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a user that would like to share the captured images to, or see the captured images on, an electronic presentation device such as a computer, tablet computer, laptop, smartphone, PDA, TV or the like.
- According to an aspect of the invention, the image capture system is arranged to send and/or receive data to/from one or more electronic presentation devices. As a result, the above mentioned object is achieved.
- An object of the present invention is to facilitate for a person that would like to travel along a route to capture images of a first chosen position while driving along a route.
- According to an aspect of the invention, the object is achieved by a vehicle that comprises a vehicle image capture system. As a result, the above mentioned object is achieved.
- Further features of, and advantages with, the present invention will become apparent when studying the appended claims and the following detailed description. Those skilled in the art will realize that different features of the present invention may be combined to create embodiments other than those described in the following, without departing from the scope of the present invention, as defined by the appended claims.
- The various aspects of the invention, including its particular features and advantages, will be readily understood from the following detailed description and the accompanying drawings, in which:
-
Fig. 1 illustrates a top view of a vehicle image capture system. -
Fig. 2 illustrates a side view of a vehicle image capture system. -
Fig. 3 illustrates a vehicle image capture system according to certain embodiments seen from an interior of a vehicle. -
Fig. 4 illustrates timelines according to certain embodiments of a vehicle image capture system. - The present invention will now be described more fully with reference to the accompanying drawings, in which example embodiments are shown. Disclosed features of example embodiments may be combined as readily understood by one of ordinary skill in the art to which this invention belongs. Like numbers refer to like elements throughout.
- Well-known functions or constructions will not necessarily be described in detail for brevity and/or clarity.
-
Fig. 1 illustrates avehicle 2 and a vehicleimage capture system 1. Thevehicle 2 may be a car, minivan, sport utility vehicle, recreational vehicle, truck, motorcycle or the like. Infig. 1 a car is illustrated. - The vehicle
image capture system 1 comprises a vehicle mountedimage capture device 3 being adapted to capture one or more images I external of thevehicle 2, a navigation system 4 and auser interface 5 being arranged to allow a user to input a first user-selected position. The navigation system 4 comprises a positioning system, e.g. a combined satellite based positioning an mapping system, such as the American Global Positioning System (GPS), the European Galileo global navigation satellite system (GNSS), the Russian Globalnaya Navigatsionnaya Sputnikovaya Sistema or Global Navigation Satellite System (GLONASS) or the Chinese BeiDou (Compass) Navigation Satellite System. - The
image capture device 1 may be a camera, such as a HD-camera, night vision camera, IR-camera, high-speed camera, digital camera or movie camera for capture images. The camera may be used in combination with a lens, such as an optical or digital lens, a widescreen lens, a magnifying lens or a zoom lens. Theimage capture device 1 may be a vehicle mounted camera facing in a direction external of thevehicle 2. For example an existing forward facing camera which is used also for other purposes, such as safety purposes or parking aid, may be used. The camera may face forward, rearward or in any other direction from thevehicle 2. The camera may be mounted at or in the vicinity of a windscreen, grille or rear-view mirror of the vehicle. The camera may be arranged to capture images from a perspective corresponding to the perspective a driver or user of the vehicle will have while seated in a driver or passenger seat of thevehicle 2. - The
image capture device 3, the navigation system 4 and theuser interface 5 may be adapted to communicate with each other by any suitable means, such as via a controller area network (CAN), or any other vehicle based network. - The
image capture system 1 may further be adapted to compare an instantaneous position of the vehicle with a position selected by a user. For example, the navigation system 4 may be used for the comparison. Theimage capture system 1 may e.g. use a navigation system 4 such as a global positioning system (GPS) in order to compare the relation between a position or positions given by a user and the instantaneous position of thevehicle 2. If the instantaneous position of thevehicle 2 and the position selected by the user are within a predetermined proximity, theimage capture system 1 may be adapted to capture one or more images. Theimage capture system 1 may provide location based footage, or location based image capturing, wherein theimage capture system 1 only capture images if an instantaneous position of thevehicle 2 and a first position selected by a user are within a predetermined proximity. - The images may be provided with information regarding the position where the images where captured, such as geo-tagging. The
image capture system 1 may save and/or display other information related to the images captured, such as weather, temperature, captured audio information, road conditions etc. Theimage capture system 1 may communicate with other systems in order to collect, save or display information. - The
image capture system 1 may further be arranged to capture images of parts of the environment surrounding thevehicle 2. Theimage capture system 1 may still further be arranged to capture images of any objects or motifs within a certain distance from thevehicle 2. -
Fig. 1 illustrates avehicle 2 seen from above at a position where a user has decided he would like to have pictures taken by theimage capture system 1. When the navigation system 4 detects thevehicle 2 within a predetermined proximity of a user selected position, theimage capture device 3 is arranged to start to capture images of amotif 6, e.g. in front of thevehicle 2. Infig. 1 themotif 6 is represented by a tree. Theimage capture system 1 may capture several images while thevehicle 2 is moving along aroute 7 within the predetermined proximity of the selected position. Theroute 7 is represented by a road infig. 1 . Theimage capture system 1 may subsequently select and save one or more images of the several images taken. The selection of an image I among the several images may be based on one or more characteristics of the selected image I, such as how objects are located with respect to an edge or frame of the image I, or based on the sharpness or brightness of the images. The selected images may form a series of images I1, I2, I3, ... IN. Theimage capture system 1 may be arranged to select an image I among the several images, such that objects represented in the image I have a similar position with respect to an edge or frame of the image as the corresponding objects have in other images in the series of images I1, I2, I3, ... IN. Thanks to this, a person watching the images being displayed in sequence, one after another, may be able to perceive the series of images I1, I2, I3, ... IN as a movie clip, wherein objects have the same or similar positions in different images. - The
image capture system 1 may be arranged to capture one or several images at a preselected number of instances when the instantaneous position of the vehicle and the first position are within a predetermined proximity. For instance, a user may select to let theimage capture system 1 take one or several images every time thevehicle 2 is within a predetermined proximity of the user selected position. Theimage capture system 1 may be arranged to capture images every second time thevehicle 2 is within a predetermined proximity of the user selected position, or only if thevehicle 1 is within a predetermined proximity of the user selected position during certain periods of the day, such as during mornings and evenings. -
Fig. 2 illustrates theimage capture system 1 including theimage capture device 3, the navigation system 4, and theuser interface 5 invehicle 2 from a side view at a position on aroute 7 where a user has decided he would like to have pictures captured by theimage capture system 1. - When the navigation system 4 detects that the
vehicle 2 is within a predetermined proximity of a first position selected by the user theimage capture device 3 is arranged to start to capture images of amotif 6 in front of thevehicle 2. Infig. 2 the motif is represented by a tree. Theimage capture device 3 may be arranged in a front part of thevehicle 2, such as at or in the vicinity of a windscreen or grille as illustrated infig. 2 . Infig. 2 the periphery of a captured image I between animage capture device 3 and themotif 6 is outlined. -
Fig. 3 illustrates an interior of a vehicle provided with theimage capture system 1. According to the embodiment offig. 3 , theuser interface 5, including thedisplay 11,timeline 8 and scrolling means 9, is arranged in a centre stack. In other embodiments theuser interface 5 may be arranged in other positions, such as on or in the vicinity of the dashboard, windscreen, door interior or steering wheel. - The
image capture device 1, the navigation system 4 and theuser interface 5 illustrated infig. 3 may be adapted to communicate with each other via a controller area network (CAN), or any other vehicle based network and/or communication means. - As illustrated in
figure 3 , a representation of objects ormotifs 6 as seen through theimage capture device 3 may be presented on adisplay 11. Thedisplay 11 may be part of theuser interface 5. Thedisplay 11 may be used if a user would like to select a certain motif when capturing images of a selected position. Thedisplay 11 may be a touch screen, permitting a user to input data. For example, a user may select motif, extension of an image, focus areas, colours etc. on the display. The display may be arranged to permit a user to tag images, e.g. tagging of persons or geographical positions. The image capture system may be arranged to display one or more user selected positions on a map. Auser interface 5 or adisplay 11 may be used for other purposes, such as navigation, communicating or entertainment. A user interface or display arranged in another system may be arranged to be used also in theimage capture system 1. - Through a zoom lens or the like, a user may transfer a focal point from a first distance from the
vehicle 2 to a second distance from thevehicle 2. Thus, a user may be able to zoom such that an object on an image I captured by theimage capture device 3 may be located at any desired distance from thevehicle 1. Theimage capture system 3 may therefore be used for the capture of close-up images near thevehicle 2, or for the capture of motifs further away from thevehicle 2, such as a horizon or sunset. - The
image capture device 3 may include auto-focus or the like, for capture of high quality images I. Characteristics of theimage capture device 3 may depend on different factors such as speed of thevehicle 2, light conditions or road conditions. - The
image capture system 1 may comprise processing means arranged to sort chronologically the series of images I1, I2, I3, ... IN and present the chronologically sorted series of images along atimeline 8 on adisplay 11 of theuser interface 5. Auser interface 5 of theimage capture system 1 may be arranged to allow a user to scroll along the timeline for presenting the series of images I1, I2, I3, ... IN as amovie clip 10. For instance, when scrolling in one direction the movie clip is played forwards and when scrolling in a second direction the movie clip is played backwards. Infig. 3 thetimeline 8 and scrolling means 9 are arranged at thedisplay 11 of theuser interface 5. However, thetimeline 8 and scrolling means 9 may be arranged in the vicinity of or separate from thedisplay 11. -
Fig. 4 illustrates two timelines T1 and T2. Timeline T1 represents a number of different occasions when images I1, I2, I3, ... IN are captured. Any amount of time may pass between the occasions when the images I1, I2, I3, ... IN are captured. If a user selects a first position where he would like theimage capture system 1 to capture images, and he seldom drives a route that passes by the first position, it may take days, weeks, months or even years between capture of the images I1, I2, I3, ... IN. The length of the timeline T1 may represent the span of the total amount of time between the capture of a first image I1 to the capture of an image IN. - Timeline T2 represents the images I1, I2, I3, ... IN, as the images are arranged together for facilitating the images being viewed on a
display 11. Theimage capture system 1 comprises processing means arranged to sort chronologically the series of images I1, I2, I3, ... IN and present the chronologically sorted series of images along atimeline 8 on thedisplay 11. Theuser interface 5 is arranged to allow a user to scroll along a timeline for presenting the series of images I1, I2, I3, ... IN as amovie clip 10. The span of the timeline T2 may represent the length of themovie clip 10. - The phenomena of showing frames or pictures on a
display 11 at a higher frame rate than the rate of which the images or pictures were taken is sometimes referred to as time lapse photo or time lapse footage. Themovie clip 10 may be displayed with a desired number of images per time unit. The number of images per second is generally expressed as frame rate. Movie clips or films are often presented at a frame rate of 24 frames/s, which means that 24 subsequent images appear on thedisplay 11 every second. Theuser interface 5 is arranged to allow a user to scroll along thetimeline 8 for presenting the series of images I1, I2, I3, ... IN at any frame rate, such as e.g. 1-50 frames per second. If a user scrolls at a high speed, the number of frames displayed each second may be higher than if a user scrolls at a lower speed. - As indicated in
fig. 4 , T1 is larger than T1. One or more of the images I1, I2, I3, ... IN may be blurred part of the time or all of the time the series of images I1, I2, I3, ... IN are displayed on thedisplay 11. Thanks to this a user watching themovie clip 10 may perceive the changes between the different images to be smoother and more linear. - A
timeline 8, series of images I1, I2, I3, ... IN, ormovie clip 10 may for instance be arranged to be displayed at internet pages and/or social networks such as twitter, Facebook, Instagram or the like. In addition, more than oneimage capturing system 1, arranged in two ormore vehicles 2 may be arranged to communicate or interact. For example, a common series of images I1, I2, I3, ... IN in where different images origin from differentimage capture systems 1 may be collected, saved and/or displayed.
Claims (8)
- A vehicle image capture system (1), the system comprising a vehicle mounted image capture device (3) being adapted to capture one or more images external of a vehicle (2), a navigation system (4) comprising a positioning system, and a user interface (5) being arranged to allow a user to input a first position,
the image capture device (3), the navigation system (4) and the user interface (5) being adapted to communicate with each other,
the image capture system (1) being adapted to, while said vehicle (2) is driving along a route, compare an instantaneous position of the vehicle (2) with the first position, and if the instantaneous position of the vehicle (2) and the first position are within a predetermined proximity, the image capture device (3) is arranged to capture one or more images,
characterized in that the image capture device (3) is arranged to capture one or several images a preselected plural number of times, such as every time, when the instantaneous position of the vehicle (2) and the first position are within a predetermined proximity, resulting in a series of images I1, I2, I3, ... IN captured within the predetermined proximity of the first position at different occasions, wherein any amount of time may pass between the occasions, wherein said vehicle image capture system (1) further comprises processing means arranged to sort chronologically the series of images I1, I2, I3, ... IN and present the chronologically sorted series of images along a timeline (8) on a display (11), and that the user interface (5) further is arranged to allow a user to scroll along the timeline (8) for presenting the series of images I1, I2, I3, ... IN as a movie clip (10). - The vehicle image capture system (1) according to claim 1, characterized in that the user interface (5) of the vehicle image capture system further comprises a display (11) suitable for presenting the series of images I1, I2, I3, ... IN
- The vehicle image capture system (1) according to any one of claim 1 or 2, characterized in that the image capture system (1) includes an object recognition system.
- The vehicle image capture system (1) according to claim 3, characterized in that the image capture device (3) is arranged to capture several images in a sequence every time the instantaneous position of the vehicle and the first position are within a predetermined proximity, and that the object recognition system is arranged to select an image among the several images which selected image is added to the series of images I1, I2, I3, ... IN, and in that the selection of an image among the several images is based on at least one characteristic of the selected image.
- The vehicle image capture system (1) according to any one of claim 1 - 4, characterized in that it is arranged to capture one or more images only when the vehicle (2) is approaching the first position from a preselected direction.
- The vehicle image capture system (1) according to any one of claim 1 - 5, characterized in that the user interface (5) further is arranged to allow a user to input two or more different positions, and that the image capture system (1) is adapted to compare an instantaneous position of the vehicle with the two or more positions, and if the instantaneous position of the vehicle (2) and any one of the two or more positions are within a predetermined proximity, to capture one or more images.
- The vehicle image capture system (1) according to any one of claim 1 - 6, characterized in that the system is arranged to send and/or receive data to/from one or more electronic presentation devices.
- A vehicle (1) characterized in that it comprises a vehicle image capture system (1) according to any one of the preceding claims.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12191668.8A EP2730890B1 (en) | 2012-11-07 | 2012-11-07 | Vehicle image capture system |
US14/063,217 US10356373B2 (en) | 2012-11-07 | 2013-10-25 | Vehicle image capture corporation |
CN201310547849.6A CN103808317B (en) | 2012-11-07 | 2013-11-07 | Vehicle image capture systems |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12191668.8A EP2730890B1 (en) | 2012-11-07 | 2012-11-07 | Vehicle image capture system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2730890A1 EP2730890A1 (en) | 2014-05-14 |
EP2730890B1 true EP2730890B1 (en) | 2020-01-15 |
Family
ID=47189746
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12191668.8A Active EP2730890B1 (en) | 2012-11-07 | 2012-11-07 | Vehicle image capture system |
Country Status (3)
Country | Link |
---|---|
US (1) | US10356373B2 (en) |
EP (1) | EP2730890B1 (en) |
CN (1) | CN103808317B (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150235094A1 (en) * | 2014-02-17 | 2015-08-20 | General Electric Company | Vehicle imaging system and method |
DE102014221025A1 (en) * | 2014-10-16 | 2016-04-21 | Bayerische Motoren Werke Aktiengesellschaft | Providing data while driving a motor vehicle |
DE102015008448B4 (en) | 2015-06-30 | 2020-09-24 | Audi Ag | Method for detecting a driving situation of a motor vehicle |
CN105141927A (en) * | 2015-09-22 | 2015-12-09 | 浙江吉利汽车研究院有限公司 | Vehicle-mounted image monitoring device |
DE102016015513A1 (en) * | 2016-12-23 | 2018-06-28 | Lucas Automotive Gmbh | Driver assistance system of a motor vehicle |
JP7063723B2 (en) * | 2018-05-22 | 2022-05-09 | 本田技研工業株式会社 | Display control device and program |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030025791A1 (en) * | 2001-06-29 | 2003-02-06 | Kenneth Kaylor | Trailer mounted surveillance system |
US20060132602A1 (en) * | 2003-06-12 | 2006-06-22 | Denso Corporation | Image server, image acquisition device, and image display terminal |
US20090177378A1 (en) * | 2008-01-07 | 2009-07-09 | Theo Kamalski | Navigation device and method |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6215523B1 (en) * | 1997-06-10 | 2001-04-10 | Flashpoint Technology, Inc. | Method and system for accelerating a user interface of an image capture unit during review mode |
US7100190B2 (en) * | 2001-06-05 | 2006-08-29 | Honda Giken Kogyo Kabushiki Kaisha | Automobile web cam and communications system incorporating a network of automobile web cams |
US20060013260A1 (en) * | 2004-06-28 | 2006-01-19 | Advanced Fibre Communications, Inc. | Optical line termination system, method and apparatus for bus management, and method and apparatus for signal concentration |
DE102004058580A1 (en) * | 2004-12-03 | 2006-06-08 | Robert Bosch Gmbh | Hand tool |
US20060271286A1 (en) | 2005-05-27 | 2006-11-30 | Outland Research, Llc | Image-enhanced vehicle navigation systems and methods |
CN101033978B (en) | 2007-01-30 | 2010-10-13 | 珠海市智汽电子科技有限公司 | Assistant navigation of intelligent vehicle and automatically concurrently assisted driving system |
US9726485B2 (en) | 2007-04-22 | 2017-08-08 | Ilookabout Inc. | Method of obtaining geographically related images using a vehicle |
WO2010026695A1 (en) * | 2008-09-03 | 2010-03-11 | 三菱電機株式会社 | Imaging system for vehicle |
US20110010643A1 (en) * | 2009-07-07 | 2011-01-13 | Samsung Electronics Co., Ltd. | Device and method for performing reomote internet browsing between portable devices |
EP2494463A4 (en) | 2009-10-29 | 2016-06-08 | Tomtom North America Inc | Method of embedding map feature data into a raster graphics file |
CN102509451B (en) | 2011-10-17 | 2014-01-29 | 北京世纪高通科技有限公司 | Method and device for obtaining information of traffic incident |
CN102607579A (en) | 2012-03-14 | 2012-07-25 | 深圳市赛格导航科技股份有限公司 | Vehicle-mounted navigation terminal and system |
-
2012
- 2012-11-07 EP EP12191668.8A patent/EP2730890B1/en active Active
-
2013
- 2013-10-25 US US14/063,217 patent/US10356373B2/en active Active
- 2013-11-07 CN CN201310547849.6A patent/CN103808317B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030025791A1 (en) * | 2001-06-29 | 2003-02-06 | Kenneth Kaylor | Trailer mounted surveillance system |
US20060132602A1 (en) * | 2003-06-12 | 2006-06-22 | Denso Corporation | Image server, image acquisition device, and image display terminal |
US20090177378A1 (en) * | 2008-01-07 | 2009-07-09 | Theo Kamalski | Navigation device and method |
Also Published As
Publication number | Publication date |
---|---|
US20140125803A1 (en) | 2014-05-08 |
CN103808317B (en) | 2019-03-08 |
US10356373B2 (en) | 2019-07-16 |
EP2730890A1 (en) | 2014-05-14 |
CN103808317A (en) | 2014-05-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2730890B1 (en) | Vehicle image capture system | |
EP2911041B1 (en) | Generating an augmented view of a location of interest | |
CN103969831B (en) | vehicle head-up display device | |
US10140770B2 (en) | Three dimensional heads-up display unit including visual context for voice commands | |
US20090202102A1 (en) | Method and system for acquisition and display of images | |
US20150221341A1 (en) | System and method for enhanced time-lapse video generation using panoramic imagery | |
US11900672B2 (en) | Integrated internal and external camera system in vehicles | |
JPWO2018167966A1 (en) | AR display device and AR display method | |
US8483951B2 (en) | Image processing method and system | |
FR2965764A1 (en) | METHOD AND DEVICE FOR DETERMINING THE PREFERRED IMAGE DATA CONCERNING THE ENVIRONMENT OF A VEHICLE | |
JP2002245079A (en) | Portable system for identifying interested site | |
EP1377934A2 (en) | Enhanced display of environmental navigation features to vehicle operator | |
US9299129B2 (en) | Method and apparatus for removing shadow from aerial or satellite photograph | |
US20130242098A1 (en) | Traffic information system | |
US20120033070A1 (en) | Local search device and local search method | |
US10757315B2 (en) | Vehicle imaging support device, method, and program storage medium | |
JP2007300559A (en) | Vehicle peripheral image providing device and shadow correcting method in vehicle peripheral image | |
US10996469B2 (en) | Method and apparatus for providing driving information of vehicle, and recording medium | |
CN112836079A (en) | Image data distribution system and image data display terminal | |
CN104280034A (en) | Vehicle-mounted navigation method and system based on panoramic videos | |
JP2022184919A (en) | Display controller and display control method | |
EP1978734A2 (en) | Apparatus and method for searching for a television program | |
CN109084748B (en) | AR navigation method and electronic equipment | |
JP2006337154A (en) | Photograph display device | |
JP6917426B2 (en) | Image display device, image display method, and image display system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20121107 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
R17P | Request for examination filed (corrected) |
Effective date: 20141114 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20171222 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20190809 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602012067244 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1225531 Country of ref document: AT Kind code of ref document: T Effective date: 20200215 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200115 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200415 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200607 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200415 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200515 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200416 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602012067244 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1225531 Country of ref document: AT Kind code of ref document: T Effective date: 20200115 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20201016 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20201107 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201107 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20201130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201130 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201107 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201107 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200115 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201130 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20231212 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20231019 Year of fee payment: 12 Ref country code: FR Payment date: 20231019 Year of fee payment: 12 Ref country code: DE Payment date: 20231019 Year of fee payment: 12 |