US20220189305A1 - Automated parking lot digital map generation and use thereof - Google Patents
Automated parking lot digital map generation and use thereof Download PDFInfo
- Publication number
- US20220189305A1 US20220189305A1 US17/122,367 US202017122367A US2022189305A1 US 20220189305 A1 US20220189305 A1 US 20220189305A1 US 202017122367 A US202017122367 A US 202017122367A US 2022189305 A1 US2022189305 A1 US 2022189305A1
- Authority
- US
- United States
- Prior art keywords
- parking
- vehicle
- parking lot
- imagery
- digital map
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/141—Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces
- G08G1/143—Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces inside the vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/027—Parking aids, e.g. instruction means
- B62D15/0285—Parking performed automatically
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3667—Display of a road map
- G01C21/367—Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3679—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities
- G01C21/3685—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities the POI's being parking facilities
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3804—Creation or updating of map data
- G01C21/3807—Creation or updating of map data characterised by the type of data
- G01C21/3811—Point data, e.g. Point of Interest [POI]
-
- G06K9/00771—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/20—Drawing from basic elements, e.g. lines or circles
- G06T11/203—Drawing of straight lines or curves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07B—TICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
- G07B15/00—Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/141—Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces
- G08G1/142—Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces external to the vehicles
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/145—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas
- G08G1/146—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas where the parking area is a limited parking space, e.g. parking garage, restricted space
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/168—Driving aids for parking, e.g. acoustic or visual feedback on parking space
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H04N5/247—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/021—Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
-
- G06K2209/15—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q2240/00—Transportation facility access, e.g. fares, tolls or parking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30236—Traffic on road, railway or crossing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30244—Camera pose
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
- G06V20/625—License plates
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/141—Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces
- G08G1/144—Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces on portable or mobile units, e.g. personal digital assistant [PDA]
Definitions
- Parking a vehicle is sometimes more problematic than it should be.
- a parking lot may be substantially full, and an individual may spend a substantial amount of time driving around the parking lot looking for an open parking spot, wasting gas and time, and increasing a risk of a collision between the vehicle and another vehicle, or between the vehicle and a pedestrian.
- Even in clear weather, an individual can inadvertently park poorly, such that their vehicle is encroaching on an adjacent parking spot.
- the embodiments relate to automated parking lot digital map generation and use thereof.
- a method in one embodiment includes receiving, by a computing device from a video camera, imagery of a parking lot, the imagery depicting lines that define a plurality of parking spots. The method further includes generating, by the computing device based on the imagery, a parking lot digital map comprising data that defines a location and dimensions of each parking spot. The method further includes storing the parking lot digital map in a memory.
- a system in another embodiment, includes one or more computing devices, each computing device comprising one or more processors.
- the one or more processors are configured to receive, from a video camera, imagery of a parking lot, the imagery depicting lines that define a plurality of parking spots.
- the one or more processors are further configured to generate, based on the imagery, a parking lot digital map comprising data that defines a location and dimensions of each parking spot.
- the one or more processors are further configured to store the parking lot digital map in a memory.
- a non-transitory computer-readable storage medium includes executable instructions to cause one or more processor devices to receive, from a video camera, imagery of a parking lot, the imagery depicting lines that define a plurality of parking spots.
- the executable instructions further cause the one or more processor devices to generate, based on the imagery, a parking lot digital map comprising data that defines a location and dimensions of each parking spot.
- the executable instructions further cause the one or more processor devices to store the parking lot digital map in a memory.
- FIG. 1 is a diagram of an environment in which automated parking lot digital map generation and use thereof may be practiced according to one embodiment
- FIG. 2 is a flowchart of a method for automated parking lot digital map generation according to one embodiment
- FIGS. 3A-3B are diagrams that illustrate automated parking lot digital map generation and use of a visual indicator in the environment illustrated in FIG. 1 , to indicate to a driver of a vehicle whether the vehicle is properly positioned within a parking spot, according to one embodiment;
- FIG. 4 is a diagram that illustrates automated parking lot digital map generation and wireless communications with a vehicle to provide the vehicle parking spot availability information, according to one embodiment
- FIG. 5 is a diagram that illustrates automated parking lot digital map generation and use thereof during inclement weather, according to one embodiment
- FIG. 6 is a diagram that illustrates automated parking lot digital map generation and use thereof to notify registered users of the occurrence of an event, according to one embodiment.
- FIG. 7 is a block diagram of a computing device suitable for implementing embodiments disclosed herein.
- Parking a vehicle is sometimes more problematic than it should be.
- a parking lot may be substantially full, and an individual may spend a substantial amount of time driving around the parking lot looking for an open parking spot, wasting gas and time, and increasing a risk of a collision between the vehicle and another vehicle, or between the vehicle and a pedestrian.
- Even in clear weather, an individual can inadvertently park poorly, such that their vehicle is encroaching on an adjacent parking spot.
- FIG. 1 is a block diagram of an environment 10 in which automated parking lot digital map generation and use thereof may be practiced according to one embodiment.
- the environment 10 includes a parking lot 12 .
- the parking lot 12 comprises a plurality of parking spots 14 - 1 - 14 - 19 (generally, parking spots 14 ). While the parking lot 12 has a rectangular shape, the embodiments have applicability to any size and shape of parking lot, as well as to parking structures with multiple floors of parking lots.
- the environment 10 includes at least one video camera 16 .
- the video camera 16 is positioned such that the entire parking lot 12 is within a field of view of the video camera 16 - 1 .
- the video camera 16 may be positioned on a structure, such as a pole, a wall, a roof, or some other fixed surface. It is noted that, while solely for purposes of illustration the parking spots 14 are perpendicular, the embodiments disclosed herein are applicable to any type of parking spots, including, by way of non-limiting example, parallel and angled parking spots.
- the video camera 16 continuously provides imagery of the parking lot 12 , in the form of a video stream 17 , to a computing device 18 . While for purposes of illustration and simplicity, the embodiments will be described as being implemented by the single computing device 18 , it is understood that, in practice, the functionality described herein may be implemented by any number of processes executing on any number of different processor devices associated with any number of different computing devices.
- Such computing devices may be communicatively coupled to one another, and to the video camera 16 via one or more networks 20 .
- One or more of such computing devices may be physically near the video camera 16 , may be geographically remote from the video camera 16 , and/or may be located in a cloud computing environment.
- the one or more networks 20 may comprise any one or a combination of wired, wireless, Wi-Fi®, and cellular networks.
- the computing device 18 includes a processor device 22 and a memory 24 .
- the memory 24 may include a registered user database 26 that includes information about registered users of the parking lot 12 , such as one or more license plates that correspond to the registered user, contact information for the registered user, billing information for the registered user, and the like.
- a controller 28 receives the video stream 17 .
- a map generator 30 extracts one or more images from the video stream 17 and analyzes the one or more images to generate a parking lot digital map 36 that comprises data that defines a location and dimensions of each parking spot 14 .
- the parking lot digital map 36 may be stored in the memory 24 and/or other locations, such as a persistent memory, such as on a hard drive or the like.
- the map generator 30 utilizes a Canny edge detector 34 to identify the lines in the images that define the parking spots 14 . Based on the lines detected by the Canny edge detector 34 , the map generator 30 generates the parking lot digital map 36 that includes a plurality of geofence structures 38 - 1 - 38 - 19 (generally, geofence structures 38 ), each of which corresponds to a parking spot 14 - 1 - 14 - 19 . Each geofence structure 38 identifies the dimensions and location of the corresponding parking spot 14 . The geofence structure 38 may identify the dimensions of the corresponding parking spot 14 via, for instance, X and Y coordinates that define a polygon that matches the exact size of the corresponding parking spot 14 .
- the parking lot digital map 36 may also include a reference location for each geofence structure 38 with respect to the imagery contained in the video stream 17 such that the polygon defined by each geofence structure 38 aligns with the corresponding parking spot 14 in the video stream 17 .
- the parking lot digital map 36 may include information that identifies a desired parking area within each parking spot 14 .
- the desired parking area may comprise, for example, an offset value, such as 8 inches, that can be applied to each polygon to help ensure a vehicle is substantially centered in a parking spot 14 .
- the desired parking area may be identical to the parking spot 14 .
- the parking lot 12 may be substantially larger than 19 parking spots and/or may be irregularly shaped, such that multiple video cameras 16 are positioned at different locations about the parking lot 12 to cover the entire parking lot 12 .
- Each of the video cameras 16 may generate video streams comprising images of different portions of the parking lot 12 .
- the controller 28 may first extract one or more images from each of the video cameras 16 and stich together, or otherwise merge, the plurality of images to generate a merged image that depicts the entire parking lot 12 .
- the controller 28 may then generate the parking lot digital map 36 from the merged image.
- the controller 28 may store the image, or merged image, from which the parking lot digital map 36 is generated as a reference image 40 . Periodically, intermittently, or in response to the occurrence of some event, the controller 28 may extract one or more images from the video stream 17 and compare the one or more images to the reference image 40 to determine if the orientation of the video camera 16 differs from the orientation of the video camera 16 when the parking lot digital map 36 was generated.
- the orientation of the video camera 16 may differ, for example, because of wind, an impact by some vehicle or other object, or other reasons.
- the controller 28 may generate a new parking lot digital map 36 based on the new imagery, and replace the original parking lot digital map 36 with the new parking lot digital map 36 .
- the video camera 16 may include or be coupled to a wind sensor that provides wind speeds to the controller 28 , and the controller 28 may utilize such information to compare the current orientation of the video camera 16 to the previous orientation of the video camera 16 .
- the video camera 16 may periodically access weather information to utilize to make such determinations.
- operator input may cause the video camera 16 to generate a new parking lot digital map 36 .
- controller 28 is a component of the computing device 18 , functionality implemented by the controller 28 may be attributed to the computing device 18 generally. Moreover, in examples where the controller 28 comprises software instructions that program the processor device 22 to carry out functionality discussed herein, functionality implemented by the controller 28 may be attributed herein to the processor device 22 .
- FIG. 2 is a method for automated parking lot digital map generation according to one embodiment.
- FIG. 2 will be discussed in conjunction with FIG. 1 .
- the computing device 18 receives, from the video camera 16 , imagery of the parking lot 12 , the imagery depicting lines that define the plurality of parking spots 14 ( FIG. 2 , block 1000 ).
- the computing device 18 generates, based on the imagery, the parking lot digital map 36 comprising data that defines a location and dimensions of each parking spot 14 ( FIG. 2 , block 1002 ).
- the computing device 18 stores the parking lot digital map 36 in the memory 24 ( FIG. 2 , block 1006 ).
- FIGS. 3A-3B illustrate the automated parking lot digital map generation and use thereof according to another embodiment.
- a vehicle 42 enters the parking lot 12 and begins to park in the parking spot 14 - 9 .
- the controller 28 continuously analyzes the video stream 17 to detect events, such as the entry or departure of vehicles.
- the controller 28 detects the vehicle 42 and determines that the vehicle 42 is attempting to park in the parking spot 14 - 9 .
- FIG. 3B an enlarged view of the parking spot 14 - 9 is illustrated at three different points in time, T 1 , T 2 , and T 3 .
- the controller 28 accesses the geofence structure 38 - 9 to identify the dimensions of the parking spot 14 - 9 .
- the controller 28 may overlay the polygon defined by the geofence structure 38 - 9 onto the images that make up the video stream 17 .
- the controller 28 may determine a vehicle boundary box 44 that surrounds the vehicle 42 .
- An indicator 46 that is wirelessly or otherwise communicatively coupled to the computing device 18 is positioned in front of the parking spot 14 - 9 .
- the indicator 46 contains three visual indicators 48 - 1 - 48 - 3 that the indicator 46 can activate upon the receipt of a control signal from the computing device 18 .
- the visual indicator 48 - 1 comprises an arrow pointing from left to right
- the visual indicator 48 - 2 comprises a circle
- the visual indicator 48 - 3 comprises an arrow pointing from right to left.
- the controller 28 may utilize an offset, in this example, 6 inches, to generate a desired parking area 50 whose borders are within the parking spot 14 - 9 .
- the desired parking area 50 may be congruent with the parking spot 14 - 9 .
- the controller 28 compares the vehicle boundary box 44 to the desired parking area 50 and determines that the vehicle 42 is outside of the desired parking area 50 .
- the controller 28 sends a control signal to the indicator 46 instructing the indicator 46 to emit the visual indicator 48 - 1 .
- the indicator 46 turns on the visual indicator 48 - 1 , thus indicating to a driver of the vehicle 42 that the driver should move the vehicle 42 to the right.
- the controller 28 compares the vehicle boundary box 44 to the desired parking area 50 and determines that the vehicle 42 is outside of the desired parking area 50 .
- the controller 28 sends a control signal to the indicator 46 instructing the indicator 46 to emit the visual indicator 48 - 3 .
- the indicator 46 turns on the visual indicator 48 - 3 , thus indicating to the driver that the driver should move the vehicle 42 to the left.
- the controller 28 compares the vehicle boundary box 44 to the desired parking area 50 and determines that the vehicle 42 is within the desired parking area 50 .
- the controller 28 sends a control signal to the indicator 46 instructing the indicator 46 to emit the visual indicator 48 - 2 .
- the indicator 46 turns on the visual indicator 48 - 2 , thus indicating to the driver that the driver is properly parking the vehicle 42 within the desired parking area 50 .
- the visual indicators 48 may comprise any suitable shape or color suitable for indicating to a driver of the vehicle 42 that the vehicle is inside or outside the desired parking area 50 .
- individuals may register or otherwise subscribe to an automatic billing mechanism associated with the parking lot 12 .
- the controller 28 may analyze the video stream 17 and detect a license plate number 52 of a license plate on the vehicle 42 .
- the controller 28 accesses the registered user database 26 and determines that the license plate number 52 is associated with a registered user, and initiates a parking charge to the registered user.
- FIG. 4 is a diagram of the environment 10 according to another embodiment.
- the controller 28 analyzes the video stream 17 and notes which parking spots 14 are taken and which parking spots 14 are available.
- the controller 28 maintains and updates, upon the arrivals and departures of vehicles, availability information 54 that identifies, at any instance in time, what parking spots 14 are available.
- a wireless controller 56 component of the controller 28 may detect the presence of the vehicle 42 , and initiate a predetermined wireless communication with the vehicle 42 to determine if the vehicle 42 is capable of receiving information from the controller 28 .
- the controller 28 If the wireless controller 56 receives a wireless communication from the vehicle 42 that indicates the vehicle 42 can receive information, the controller 28 generates, based on the parking lot digital map 36 and the availability information 54 , an availability map 58 that contains information that identifies a set of the parking spots 14 that are available, and causes the wireless controller 56 to send the availability map 58 to the vehicle 42 .
- the vehicle 42 presents the availability map 58 on a display device 60 in the vehicle 42 to the driver.
- the controller 28 may determine, based on the video stream 17 , that the vehicle 42 has parked in a manner that encroaches on two parking spots 14 . In response, the controller 28 may initiate a parking charge to the registered user for both parking spots 14 . In some embodiments, the controller 28 may first send a message to the vehicle 42 indicating that the vehicle 42 is encroaching on two parking spots, and thus will be invoiced for two parking spots to give the driver an opportunity to move the vehicle 42 within a single parking spot 14 .
- FIG. 5 is a diagram of the environment 10 according to another embodiment during inclement weather.
- the vehicle 42 is approaching or entering the parking lot 12 during inclement weather. A recent snowfall has covered the parking lot 12 such that the lines of the parking spots 14 are not visible to the driver.
- the controller 28 may determine that the vehicle 42 is capable of receiving information from the controller 28 .
- the controller 28 may communicate to the vehicle 42 the dimensions and location of the parking spots 14 based on the parking lot digital map 36 .
- the vehicle 42 includes a forward camera that presents, on the display device 60 , real-time video imagery 62 of the environment in front of the vehicle 42 .
- the vehicle 42 receives the dimensions and location of the parking spots 14 and overlays parking spot lines 64 onto the real-time video imagery 62 presented on the display device 60 , so that the driver can maneuver the vehicle 42 into the parking spot 14 - 9 , for example, even though the driver cannot see the actual parking spot lines of the parking spot 14 - 9 due to the snow.
- the vehicle 42 may be configured to integrate the dimensions and location of the parking spots 14 with existing guidelines presented by the vehicle 42 on the display device 60 that identify the forward path of the vehicle 42 given its current location and orientation of the wheels.
- the vehicle 42 can compare the existing guidelines to the dimensions and location of a particular parking spot 14 and, if the vehicle 42 is moving in a forward direction that is inconsistent with correctly parking within the parking spot 14 , provide an alert to the driver.
- the vehicle 42 may be capable of autonomous driving.
- the vehicle 42 may receive information from the controller 28 that identifies the locations and dimensions of the parking spots 14 , as well as the locations of available parking spots 14 , and park itself into an available parking spot 14 .
- FIG. 6 is a diagram of the environment 10 according to yet another embodiment.
- the controller 28 operates to notify registered users of certain events that occur.
- the controller 28 based on the imagery in the video stream 17 , determines that a vehicle 42 - 1 has impacted a vehicle 42 - 2 .
- the controller 28 detects a license plate number 66 of the vehicle 42 - 2 .
- the controller 28 determines, based on the registered user database 26 , that the license plate number 66 is associated with a registered user 68 .
- the registered user 68 is associated with a mobile computing device 70 .
- the controller 28 sends, to a destination address associated with the registered user 68 , such as an email address or a telephone number that corresponds to the registered user 68 , a message 72 identifying the event.
- the message may comprise, for example, an email or an SMS message.
- the message may include a selectable link 74 that, when selected, causes a live video stream 76 generated by the video camera 16 to be streamed to the mobile computing device 70 from which the selectable link 74 was selected.
- the controller 28 may continuously access weather information and, upon a determination that inclement weather is approaching, such as a hail storm, an electrical storm, or the like, determine the license plate of each vehicle 42 in the parking lot 12 , access the registered user database 26 to determine which of the vehicles 42 correspond to registered users of the parking lot 12 , and send messages to destination addresses associated with each of such registered users warning the registered users of the imminent inclement weather.
- the controller 28 may include in the message an opportunity to reply to the message in a manner that authorizes an attendant to move a vehicle 42 from an uncovered parking spot to a covered parking spot.
- the registered user 68 may access a first uniform resource identifier (URI) that corresponds to the parking lot 12 .
- the controller 28 may generate imagery of a current state of the parking lot 12 , including information that identifies which parking spots 14 are available, and provide the imagery to the mobile computing device 70 so that the registered user 68 can, from any location, determine a current status of the parking lot 12 .
- URI uniform resource identifier
- the registered user 68 may access a second URI that corresponds to the video camera 16 .
- the controller 28 causes a video stream from the video camera 16 to be provided to the device from which the second URI was accessed, allowing the registered user 68 to view real-time imagery of the vehicle 42 - 2 associated with the registered user 68 .
- FIG. 7 is a block diagram of the computing device 18 suitable for implementing examples according to one example.
- the computing device 18 may comprise any computing or electronic device capable of including firmware, hardware, and/or executing software instructions to implement the functionality described herein, such as a computer server, a desktop computing device, a laptop computing device, or the like.
- the computing device 18 includes the processor device 22 , the system memory 24 , and a system bus 78 .
- the system bus 78 provides an interface for system components including, but not limited to, the system memory 24 and the processor device 22 .
- the system bus 78 may be any of several types of bus structures that may further interconnect to a memory bus (with or without a memory controller), a peripheral bus, and/or a local bus using any of a variety of commercially available bus architectures.
- the system memory 24 may include non-volatile memory 80 (e.g., read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), etc.), and volatile memory 82 (e.g., random-access memory (RAM)).
- a basic input/output system (BIOS) 84 may be stored in the non-volatile memory 80 and can include the basic routines that help to transfer information between elements within the computing device 18 .
- the volatile memory 82 may also include a high-speed RAM, such as static RAM, for caching data.
- the computing device 18 may further include or be coupled to a non-transitory computer-readable storage medium such as the storage device 86 , which may comprise, for example, an internal or external hard disk drive (HDD) (e.g., enhanced integrated drive electronics (EIDE) or serial advanced technology attachment (SATA)), HDD (e.g., EIDE or SATA) for storage, flash memory, or the like.
- HDD enhanced integrated drive electronics
- SATA serial advanced technology attachment
- the storage device 86 and other drives associated with computer-readable media and computer-usable media may provide non-volatile storage of data, data structures, computer-executable instructions, and the like.
- a number of modules can be stored in the storage device 86 and in the volatile memory 82 , including an operating system and one or more program modules, such as the controller 28 , which may implement the functionality described herein in whole or in part.
- All or a portion of the examples may be implemented as a computer program product 88 stored on a transitory or non-transitory computer-usable or computer-readable storage medium, such as the storage device 86 , which includes complex programming instructions, such as complex computer-readable program code, to cause the processor device 22 to carry out the steps described herein.
- the computer-readable program code can comprise software instructions for implementing the functionality of the examples described herein when executed on the processor device 22 .
- the processor device 22 in conjunction with the controller 28 in the volatile memory 82 , may serve as a controller, or control system, for the computing device 18 that is to implement the functionality described herein.
- An operator may also be able to enter one or more configuration commands through a keyboard (not illustrated), a pointing device such as a mouse (not illustrated), or a touch-sensitive surface such as a display device.
- Such input devices may be connected to the processor device 22 through an input device interface 90 that is coupled to the system bus 78 but can be connected by other interfaces such as a parallel port, an Institute of Electrical and Electronic Engineers (IEEE) 1394 serial port, a Universal Serial Bus (USB) port, an IR interface, and the like.
- the computing device 18 may also include a communications interface 92 , such as an Ethernet transceiver, suitable for communicating with the network(s) 20 as appropriate or desired.
Abstract
Description
- Parking a vehicle is sometimes more problematic than it should be. During inclement weather, it can be difficult or impossible to know where the lines of a parking spot are, causing inefficient parking that utilizes more parking spots than necessary and causing inconvenience for those who otherwise would have been able to park in the parking lot, as well as a potential loss of revenue for a parking lot operator. A parking lot may be substantially full, and an individual may spend a substantial amount of time driving around the parking lot looking for an open parking spot, wasting gas and time, and increasing a risk of a collision between the vehicle and another vehicle, or between the vehicle and a pedestrian. Even in clear weather, an individual can inadvertently park poorly, such that their vehicle is encroaching on an adjacent parking spot.
- The embodiments relate to automated parking lot digital map generation and use thereof.
- In one embodiment a method is disclosed. The method includes receiving, by a computing device from a video camera, imagery of a parking lot, the imagery depicting lines that define a plurality of parking spots. The method further includes generating, by the computing device based on the imagery, a parking lot digital map comprising data that defines a location and dimensions of each parking spot. The method further includes storing the parking lot digital map in a memory.
- In another embodiment a system is disclosed. The system includes one or more computing devices, each computing device comprising one or more processors. The one or more processors are configured to receive, from a video camera, imagery of a parking lot, the imagery depicting lines that define a plurality of parking spots. The one or more processors are further configured to generate, based on the imagery, a parking lot digital map comprising data that defines a location and dimensions of each parking spot. The one or more processors are further configured to store the parking lot digital map in a memory.
- In another embodiment a non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium includes executable instructions to cause one or more processor devices to receive, from a video camera, imagery of a parking lot, the imagery depicting lines that define a plurality of parking spots. The executable instructions further cause the one or more processor devices to generate, based on the imagery, a parking lot digital map comprising data that defines a location and dimensions of each parking spot. The executable instructions further cause the one or more processor devices to store the parking lot digital map in a memory.
- Those skilled in the art will appreciate the scope of the disclosure and realize additional aspects thereof after reading the following detailed description of the embodiments in association with the accompanying drawing figures.
- The accompanying drawing figures incorporated in and forming a part of this specification illustrate several aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.
-
FIG. 1 is a diagram of an environment in which automated parking lot digital map generation and use thereof may be practiced according to one embodiment, -
FIG. 2 is a flowchart of a method for automated parking lot digital map generation according to one embodiment; -
FIGS. 3A-3B are diagrams that illustrate automated parking lot digital map generation and use of a visual indicator in the environment illustrated inFIG. 1 , to indicate to a driver of a vehicle whether the vehicle is properly positioned within a parking spot, according to one embodiment; -
FIG. 4 is a diagram that illustrates automated parking lot digital map generation and wireless communications with a vehicle to provide the vehicle parking spot availability information, according to one embodiment; -
FIG. 5 is a diagram that illustrates automated parking lot digital map generation and use thereof during inclement weather, according to one embodiment; -
FIG. 6 is a diagram that illustrates automated parking lot digital map generation and use thereof to notify registered users of the occurrence of an event, according to one embodiment; and -
FIG. 7 is a block diagram of a computing device suitable for implementing embodiments disclosed herein. - The embodiments set forth below represent the information to enable those skilled in the art to practice the embodiments and illustrate the best mode of practicing the embodiments. Upon reading the following description in light of the accompanying drawing figures, those skilled in the art will understand the concepts of the disclosure and will recognize applications of these concepts not particularly addressed herein. It should be understood that these concepts and applications fall within the scope of the disclosure and the accompanying claims.
- Any flowcharts discussed herein are necessarily discussed in some sequence for purposes of illustration, but unless otherwise explicitly indicated, the embodiments are not limited to any particular sequence of steps. The use herein of ordinals in conjunction with an element is solely for distinguishing what might otherwise be similar or identical labels, such as “first message” and “second message,” and does not imply a priority, a type, an importance, or other attribute, unless otherwise stated herein. The term “about” used herein in conjunction with a numeric value means any value that is within a range of ten percent greater than or ten percent less than the numeric value.
- As used herein and in the claims, the articles “a” and “an” in reference to an element refers to “one or more” of the element unless otherwise explicitly specified. The word “or” as used herein and in the claims is inclusive unless contextually impossible. As an example, the recitation of A or B means A, or B, or both A and B.
- Parking a vehicle is sometimes more problematic than it should be. During inclement weather, it can be difficult or impossible to know where the lines of a parking spot are, causing inefficient parking that utilizes more parking spots than necessary and causing inconvenience for those who otherwise would have been able to park in the parking lot, as well as a potential loss of revenue for a parking lot operator. A parking lot may be substantially full, and an individual may spend a substantial amount of time driving around the parking lot looking for an open parking spot, wasting gas and time, and increasing a risk of a collision between the vehicle and another vehicle, or between the vehicle and a pedestrian. Even in clear weather, an individual can inadvertently park poorly, such that their vehicle is encroaching on an adjacent parking spot.
- The embodiments disclosed herein implement a number of assisted parking features utilizing real-time video analysis and, in some instances, real-time feedback to an operator of a vehicle.
FIG. 1 is a block diagram of anenvironment 10 in which automated parking lot digital map generation and use thereof may be practiced according to one embodiment. Theenvironment 10 includes aparking lot 12. Theparking lot 12 comprises a plurality of parking spots 14-1-14-19 (generally, parking spots 14). While theparking lot 12 has a rectangular shape, the embodiments have applicability to any size and shape of parking lot, as well as to parking structures with multiple floors of parking lots. Theenvironment 10 includes at least onevideo camera 16. Thevideo camera 16 is positioned such that theentire parking lot 12 is within a field of view of the video camera 16-1. In some implementations, thevideo camera 16 may be positioned on a structure, such as a pole, a wall, a roof, or some other fixed surface. It is noted that, while solely for purposes of illustration the parking spots 14 are perpendicular, the embodiments disclosed herein are applicable to any type of parking spots, including, by way of non-limiting example, parallel and angled parking spots. - The
video camera 16 continuously provides imagery of theparking lot 12, in the form of avideo stream 17, to acomputing device 18. While for purposes of illustration and simplicity, the embodiments will be described as being implemented by thesingle computing device 18, it is understood that, in practice, the functionality described herein may be implemented by any number of processes executing on any number of different processor devices associated with any number of different computing devices. Such computing devices may be communicatively coupled to one another, and to thevideo camera 16 via one ormore networks 20. One or more of such computing devices may be physically near thevideo camera 16, may be geographically remote from thevideo camera 16, and/or may be located in a cloud computing environment. The one ormore networks 20 may comprise any one or a combination of wired, wireless, Wi-Fi®, and cellular networks. - The
computing device 18 includes aprocessor device 22 and amemory 24. In some embodiments, thememory 24 may include a registereduser database 26 that includes information about registered users of theparking lot 12, such as one or more license plates that correspond to the registered user, contact information for the registered user, billing information for the registered user, and the like. - A
controller 28 receives thevideo stream 17. Amap generator 30 extracts one or more images from thevideo stream 17 and analyzes the one or more images to generate a parking lotdigital map 36 that comprises data that defines a location and dimensions of each parking spot 14. The parking lotdigital map 36 may be stored in thememory 24 and/or other locations, such as a persistent memory, such as on a hard drive or the like. - The analysis of the images to identify the plurality of parking spots 14 may be done in any suitable manner. In some embodiments, the
map generator 30 utilizes aCanny edge detector 34 to identify the lines in the images that define the parking spots 14. Based on the lines detected by theCanny edge detector 34, themap generator 30 generates the parking lotdigital map 36 that includes a plurality of geofence structures 38-1-38-19 (generally, geofence structures 38), each of which corresponds to a parking spot 14-1-14-19. Each geofence structure 38 identifies the dimensions and location of the corresponding parking spot 14. The geofence structure 38 may identify the dimensions of the corresponding parking spot 14 via, for instance, X and Y coordinates that define a polygon that matches the exact size of the corresponding parking spot 14. - The parking lot
digital map 36 may also include a reference location for each geofence structure 38 with respect to the imagery contained in thevideo stream 17 such that the polygon defined by each geofence structure 38 aligns with the corresponding parking spot 14 in thevideo stream 17. In some embodiments, the parking lotdigital map 36 may include information that identifies a desired parking area within each parking spot 14. The desired parking area may comprise, for example, an offset value, such as 8 inches, that can be applied to each polygon to help ensure a vehicle is substantially centered in a parking spot 14. In other embodiments, the desired parking area may be identical to the parking spot 14. - In some implementations, the
parking lot 12 may be substantially larger than 19 parking spots and/or may be irregularly shaped, such thatmultiple video cameras 16 are positioned at different locations about theparking lot 12 to cover theentire parking lot 12. Each of thevideo cameras 16 may generate video streams comprising images of different portions of theparking lot 12. In such implementations, thecontroller 28 may first extract one or more images from each of thevideo cameras 16 and stich together, or otherwise merge, the plurality of images to generate a merged image that depicts theentire parking lot 12. Thecontroller 28 may then generate the parking lotdigital map 36 from the merged image. - The
controller 28 may store the image, or merged image, from which the parking lotdigital map 36 is generated as areference image 40. Periodically, intermittently, or in response to the occurrence of some event, thecontroller 28 may extract one or more images from thevideo stream 17 and compare the one or more images to thereference image 40 to determine if the orientation of thevideo camera 16 differs from the orientation of thevideo camera 16 when the parking lotdigital map 36 was generated. The orientation of thevideo camera 16 may differ, for example, because of wind, an impact by some vehicle or other object, or other reasons. If thecontroller 28 determines that the orientation of thevideo camera 16 differs from the orientation of thevideo camera 16 when the parking lotdigital map 36 was generated, thecontroller 28 may generate a new parking lotdigital map 36 based on the new imagery, and replace the original parking lotdigital map 36 with the new parking lotdigital map 36. - In some embodiments, the
video camera 16 may include or be coupled to a wind sensor that provides wind speeds to thecontroller 28, and thecontroller 28 may utilize such information to compare the current orientation of thevideo camera 16 to the previous orientation of thevideo camera 16. In some embodiments, thevideo camera 16 may periodically access weather information to utilize to make such determinations. In some embodiments, operator input may cause thevideo camera 16 to generate a new parking lotdigital map 36. - It is noted that, because the
controller 28 is a component of thecomputing device 18, functionality implemented by thecontroller 28 may be attributed to thecomputing device 18 generally. Moreover, in examples where thecontroller 28 comprises software instructions that program theprocessor device 22 to carry out functionality discussed herein, functionality implemented by thecontroller 28 may be attributed herein to theprocessor device 22. -
FIG. 2 is a method for automated parking lot digital map generation according to one embodiment.FIG. 2 will be discussed in conjunction withFIG. 1 . Thecomputing device 18 receives, from thevideo camera 16, imagery of theparking lot 12, the imagery depicting lines that define the plurality of parking spots 14 (FIG. 2 , block 1000). Thecomputing device 18 generates, based on the imagery, the parking lotdigital map 36 comprising data that defines a location and dimensions of each parking spot 14 (FIG. 2 , block 1002). Thecomputing device 18 stores the parking lotdigital map 36 in the memory 24 (FIG. 2 , block 1006). -
FIGS. 3A-3B illustrate the automated parking lot digital map generation and use thereof according to another embodiment. Referring first toFIG. 3A , avehicle 42 enters theparking lot 12 and begins to park in the parking spot 14-9. Thecontroller 28 continuously analyzes thevideo stream 17 to detect events, such as the entry or departure of vehicles. Thecontroller 28 detects thevehicle 42 and determines that thevehicle 42 is attempting to park in the parking spot 14-9. Referring now toFIG. 3B , an enlarged view of the parking spot 14-9 is illustrated at three different points in time, T1, T2, and T3. Thecontroller 28 accesses the geofence structure 38-9 to identify the dimensions of the parking spot 14-9. Thecontroller 28 may overlay the polygon defined by the geofence structure 38-9 onto the images that make up thevideo stream 17. In some embodiments, thecontroller 28 may determine avehicle boundary box 44 that surrounds thevehicle 42. Anindicator 46 that is wirelessly or otherwise communicatively coupled to thecomputing device 18 is positioned in front of the parking spot 14-9. Theindicator 46 contains three visual indicators 48-1-48-3 that theindicator 46 can activate upon the receipt of a control signal from thecomputing device 18. The visual indicator 48-1 comprises an arrow pointing from left to right, the visual indicator 48-2 comprises a circle, and the visual indicator 48-3 comprises an arrow pointing from right to left. - Based on the geofence structure 38-9, the
controller 28 may utilize an offset, in this example, 6 inches, to generate a desiredparking area 50 whose borders are within the parking spot 14-9. In other embodiments, the desiredparking area 50 may be congruent with the parking spot 14-9. At a time T1, thecontroller 28 compares thevehicle boundary box 44 to the desiredparking area 50 and determines that thevehicle 42 is outside of the desiredparking area 50. Thecontroller 28 sends a control signal to theindicator 46 instructing theindicator 46 to emit the visual indicator 48-1. Theindicator 46 turns on the visual indicator 48-1, thus indicating to a driver of thevehicle 42 that the driver should move thevehicle 42 to the right. - At a time T2, the
controller 28 compares thevehicle boundary box 44 to the desiredparking area 50 and determines that thevehicle 42 is outside of the desiredparking area 50. Thecontroller 28 sends a control signal to theindicator 46 instructing theindicator 46 to emit the visual indicator 48-3. Theindicator 46 turns on the visual indicator 48-3, thus indicating to the driver that the driver should move thevehicle 42 to the left. - At a time T3, the
controller 28 compares thevehicle boundary box 44 to the desiredparking area 50 and determines that thevehicle 42 is within the desiredparking area 50. Thecontroller 28 sends a control signal to theindicator 46 instructing theindicator 46 to emit the visual indicator 48-2. Theindicator 46 turns on the visual indicator 48-2, thus indicating to the driver that the driver is properly parking thevehicle 42 within the desiredparking area 50. - The visual indicators 48 may comprise any suitable shape or color suitable for indicating to a driver of the
vehicle 42 that the vehicle is inside or outside the desiredparking area 50. - In some embodiments, individuals may register or otherwise subscribe to an automatic billing mechanism associated with the
parking lot 12. Thecontroller 28 may analyze thevideo stream 17 and detect alicense plate number 52 of a license plate on thevehicle 42. Thecontroller 28 accesses the registereduser database 26 and determines that thelicense plate number 52 is associated with a registered user, and initiates a parking charge to the registered user. -
FIG. 4 is a diagram of theenvironment 10 according to another embodiment. In this embodiment, thecontroller 28 analyzes thevideo stream 17 and notes which parking spots 14 are taken and which parking spots 14 are available. Thecontroller 28 maintains and updates, upon the arrivals and departures of vehicles,availability information 54 that identifies, at any instance in time, what parking spots 14 are available. As avehicle 42 approaches theparking lot 12, awireless controller 56 component of thecontroller 28 may detect the presence of thevehicle 42, and initiate a predetermined wireless communication with thevehicle 42 to determine if thevehicle 42 is capable of receiving information from thecontroller 28. If thewireless controller 56 receives a wireless communication from thevehicle 42 that indicates thevehicle 42 can receive information, thecontroller 28 generates, based on the parking lotdigital map 36 and theavailability information 54, anavailability map 58 that contains information that identifies a set of the parking spots 14 that are available, and causes thewireless controller 56 to send theavailability map 58 to thevehicle 42. Thevehicle 42 presents theavailability map 58 on adisplay device 60 in thevehicle 42 to the driver. - In some embodiments, the
controller 28 may determine, based on thevideo stream 17, that thevehicle 42 has parked in a manner that encroaches on two parking spots 14. In response, thecontroller 28 may initiate a parking charge to the registered user for both parking spots 14. In some embodiments, thecontroller 28 may first send a message to thevehicle 42 indicating that thevehicle 42 is encroaching on two parking spots, and thus will be invoiced for two parking spots to give the driver an opportunity to move thevehicle 42 within a single parking spot 14. -
FIG. 5 is a diagram of theenvironment 10 according to another embodiment during inclement weather. In this embodiment, thevehicle 42 is approaching or entering theparking lot 12 during inclement weather. A recent snowfall has covered theparking lot 12 such that the lines of the parking spots 14 are not visible to the driver. As discussed with regard toFIG. 4 , thecontroller 28 may determine that thevehicle 42 is capable of receiving information from thecontroller 28. Thecontroller 28 may communicate to thevehicle 42 the dimensions and location of the parking spots 14 based on the parking lotdigital map 36. Thevehicle 42 includes a forward camera that presents, on thedisplay device 60, real-time video imagery 62 of the environment in front of thevehicle 42. Thevehicle 42 receives the dimensions and location of the parking spots 14 and overlaysparking spot lines 64 onto the real-time video imagery 62 presented on thedisplay device 60, so that the driver can maneuver thevehicle 42 into the parking spot 14-9, for example, even though the driver cannot see the actual parking spot lines of the parking spot 14-9 due to the snow. - In some embodiments, the
vehicle 42 may be configured to integrate the dimensions and location of the parking spots 14 with existing guidelines presented by thevehicle 42 on thedisplay device 60 that identify the forward path of thevehicle 42 given its current location and orientation of the wheels. - The
vehicle 42 can compare the existing guidelines to the dimensions and location of a particular parking spot 14 and, if thevehicle 42 is moving in a forward direction that is inconsistent with correctly parking within the parking spot 14, provide an alert to the driver. - In some embodiments, the
vehicle 42 may be capable of autonomous driving. Thevehicle 42 may receive information from thecontroller 28 that identifies the locations and dimensions of the parking spots 14, as well as the locations of available parking spots 14, and park itself into an available parking spot 14. -
FIG. 6 is a diagram of theenvironment 10 according to yet another embodiment. In this embodiment, thecontroller 28 operates to notify registered users of certain events that occur. In this example, thecontroller 28, based on the imagery in thevideo stream 17, determines that a vehicle 42-1 has impacted a vehicle 42-2. Thecontroller 28 detects alicense plate number 66 of the vehicle 42-2. Thecontroller 28 determines, based on the registereduser database 26, that thelicense plate number 66 is associated with a registereduser 68. The registereduser 68 is associated with amobile computing device 70. Thecontroller 28 sends, to a destination address associated with the registereduser 68, such as an email address or a telephone number that corresponds to the registereduser 68, amessage 72 identifying the event. The message may comprise, for example, an email or an SMS message. - In some embodiments, the message may include a selectable link 74 that, when selected, causes a
live video stream 76 generated by thevideo camera 16 to be streamed to themobile computing device 70 from which the selectable link 74 was selected. - In other embodiments, the
controller 28 may continuously access weather information and, upon a determination that inclement weather is approaching, such as a hail storm, an electrical storm, or the like, determine the license plate of eachvehicle 42 in theparking lot 12, access the registereduser database 26 to determine which of thevehicles 42 correspond to registered users of theparking lot 12, and send messages to destination addresses associated with each of such registered users warning the registered users of the imminent inclement weather. In some embodiments, thecontroller 28 may include in the message an opportunity to reply to the message in a manner that authorizes an attendant to move avehicle 42 from an uncovered parking spot to a covered parking spot. - In some embodiments, the registered
user 68 may access a first uniform resource identifier (URI) that corresponds to theparking lot 12. In response, thecontroller 28 may generate imagery of a current state of theparking lot 12, including information that identifies which parking spots 14 are available, and provide the imagery to themobile computing device 70 so that the registereduser 68 can, from any location, determine a current status of theparking lot 12. - In some embodiments, the registered
user 68 may access a second URI that corresponds to thevideo camera 16. In response, thecontroller 28 causes a video stream from thevideo camera 16 to be provided to the device from which the second URI was accessed, allowing the registereduser 68 to view real-time imagery of the vehicle 42-2 associated with the registereduser 68. -
FIG. 7 is a block diagram of thecomputing device 18 suitable for implementing examples according to one example. Thecomputing device 18 may comprise any computing or electronic device capable of including firmware, hardware, and/or executing software instructions to implement the functionality described herein, such as a computer server, a desktop computing device, a laptop computing device, or the like. Thecomputing device 18 includes theprocessor device 22, thesystem memory 24, and asystem bus 78. Thesystem bus 78 provides an interface for system components including, but not limited to, thesystem memory 24 and theprocessor device 22. - The
system bus 78 may be any of several types of bus structures that may further interconnect to a memory bus (with or without a memory controller), a peripheral bus, and/or a local bus using any of a variety of commercially available bus architectures. Thesystem memory 24 may include non-volatile memory 80 (e.g., read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), etc.), and volatile memory 82 (e.g., random-access memory (RAM)). A basic input/output system (BIOS) 84 may be stored in thenon-volatile memory 80 and can include the basic routines that help to transfer information between elements within thecomputing device 18. The volatile memory 82 may also include a high-speed RAM, such as static RAM, for caching data. - The
computing device 18 may further include or be coupled to a non-transitory computer-readable storage medium such as thestorage device 86, which may comprise, for example, an internal or external hard disk drive (HDD) (e.g., enhanced integrated drive electronics (EIDE) or serial advanced technology attachment (SATA)), HDD (e.g., EIDE or SATA) for storage, flash memory, or the like. Thestorage device 86 and other drives associated with computer-readable media and computer-usable media may provide non-volatile storage of data, data structures, computer-executable instructions, and the like. - A number of modules can be stored in the
storage device 86 and in the volatile memory 82, including an operating system and one or more program modules, such as thecontroller 28, which may implement the functionality described herein in whole or in part. - All or a portion of the examples may be implemented as a
computer program product 88 stored on a transitory or non-transitory computer-usable or computer-readable storage medium, such as thestorage device 86, which includes complex programming instructions, such as complex computer-readable program code, to cause theprocessor device 22 to carry out the steps described herein. Thus, the computer-readable program code can comprise software instructions for implementing the functionality of the examples described herein when executed on theprocessor device 22. Theprocessor device 22, in conjunction with thecontroller 28 in the volatile memory 82, may serve as a controller, or control system, for thecomputing device 18 that is to implement the functionality described herein. - An operator may also be able to enter one or more configuration commands through a keyboard (not illustrated), a pointing device such as a mouse (not illustrated), or a touch-sensitive surface such as a display device. Such input devices may be connected to the
processor device 22 through an input device interface 90 that is coupled to thesystem bus 78 but can be connected by other interfaces such as a parallel port, an Institute of Electrical and Electronic Engineers (IEEE) 1394 serial port, a Universal Serial Bus (USB) port, an IR interface, and the like. Thecomputing device 18 may also include acommunications interface 92, such as an Ethernet transceiver, suitable for communicating with the network(s) 20 as appropriate or desired. - Those skilled in the art will recognize improvements and modifications to the preferred embodiments of the disclosure. All such improvements and modifications are considered within the scope of the concepts disclosed herein and the claims that follow.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/122,367 US11769409B2 (en) | 2020-12-15 | 2020-12-15 | Automated parking lot digital map generation and use thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/122,367 US11769409B2 (en) | 2020-12-15 | 2020-12-15 | Automated parking lot digital map generation and use thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
US20220189305A1 true US20220189305A1 (en) | 2022-06-16 |
US11769409B2 US11769409B2 (en) | 2023-09-26 |
Family
ID=81942761
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/122,367 Active 2041-03-04 US11769409B2 (en) | 2020-12-15 | 2020-12-15 | Automated parking lot digital map generation and use thereof |
Country Status (1)
Country | Link |
---|---|
US (1) | US11769409B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220237543A1 (en) * | 2021-01-28 | 2022-07-28 | Ncr Corporation | Intelligent order pickup processing |
CN115574804A (en) * | 2022-11-18 | 2023-01-06 | 北京集度科技有限公司 | Method, device and equipment for building parking lot map |
CN115797585A (en) * | 2022-12-19 | 2023-03-14 | 北京百度网讯科技有限公司 | Parking lot map generation method and device |
Citations (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010017591A1 (en) * | 2000-02-29 | 2001-08-30 | Hisashi Kuriya | Vehicle backward movement assisting apparatus for in-line parking |
US20150081212A1 (en) * | 2013-09-16 | 2015-03-19 | Fleetmatics Irl Limited | System and method for automated correction of geofences |
US20160284217A1 (en) * | 2015-03-24 | 2016-09-29 | Lg Electronics Inc. | Vehicle, mobile terminal and method for controlling the same |
US9547796B2 (en) * | 2012-03-30 | 2017-01-17 | Panasonic Intellectual Property Management Co., Ltd. | Parking assistance device and parking assistance method |
US9557741B1 (en) * | 2015-08-24 | 2017-01-31 | Ford Global Technologies, Llc | System and method for autonomous valet parking using plenoptic cameras |
US20180082588A1 (en) * | 2016-09-21 | 2018-03-22 | Dura Operating, Llc | System and method for autonomous parking of a vehicle |
US20180095474A1 (en) * | 2016-09-30 | 2018-04-05 | Faraday&Future Inc. | Methods and systems for camera-based autonomous parking |
US20180099661A1 (en) * | 2016-10-12 | 2018-04-12 | Lg Electronics Inc. | Parking assistance apparatus and vehicle having the same |
US20180218582A1 (en) * | 2016-10-25 | 2018-08-02 | 725-1 Corporation | Monitoring an Area using Multiple Networked Video Cameras |
US20180253108A1 (en) * | 2015-11-02 | 2018-09-06 | Starship Technologies Oü | Mobile robot system and method for generating map data using straight lines extracted from visual images |
US20180334189A1 (en) * | 2017-05-18 | 2018-11-22 | Ford Global Technologies, Llc | Method for assisting a parking procedure of a motor vehicle, electronic parking assistance system, and motor vehicle |
US20190049977A1 (en) * | 2017-08-10 | 2019-02-14 | Patroness, LLC | System and methods for sensor integration in support of situational awareness for a motorized mobile system |
US10311731B1 (en) * | 2014-09-16 | 2019-06-04 | Knightscope, Inc. | Autonomous parking monitor |
US20190375409A1 (en) * | 2018-06-12 | 2019-12-12 | Rivian Ip Holdings, Llc | Systems and methods for operating an autonomous vehicle in a guardian mode |
US20200017099A1 (en) * | 2016-10-13 | 2020-01-16 | Nissan Motor Co., Ltd. | Parking Assistance Method and Parking Assistance Device |
US20200062242A1 (en) * | 2015-10-22 | 2020-02-27 | Nissan Motor Co., Ltd. | Parking Support Method and Parking Support Device |
US20200108824A1 (en) * | 2018-10-04 | 2020-04-09 | Ford Global Technologies, Llc | Monitoring and adjustment of vehicle parking positions |
US20200211400A1 (en) * | 2018-12-28 | 2020-07-02 | Hyundai Motor Company | System, method, infrastructure, and vehicle for automated valet parking |
US20200219390A1 (en) * | 2019-01-04 | 2020-07-09 | Auto Park Hawaii, Inc. | Method for managing vehicle parking within a parking structure |
US20200262417A1 (en) * | 2017-09-29 | 2020-08-20 | Volkswagen Aktiengesellschaft | Parking a motor vehicle |
US20200353914A1 (en) * | 2019-03-20 | 2020-11-12 | Clarion Co., Ltd. | In-vehicle processing device and movement support system |
US20210056848A1 (en) * | 2018-03-30 | 2021-02-25 | Hitachi Automotive Systems, Ltd. | Parking assistance device |
US20210233408A1 (en) * | 2020-01-24 | 2021-07-29 | Continental Automotive Systems, Inc. | Parking lot safety apparatus and method |
US11183064B2 (en) * | 2019-07-03 | 2021-11-23 | Charles Isgar | Area reservation system |
US20210370916A1 (en) * | 2020-05-28 | 2021-12-02 | Faurecia Clarion Electronics Co., Ltd. | Parking assist apparatus and a method of controlling the parking assist apparatus |
US20220303719A1 (en) * | 2021-03-19 | 2022-09-22 | Ford Global Technologies, Llc | Dynamic geofencing hysteresis |
-
2020
- 2020-12-15 US US17/122,367 patent/US11769409B2/en active Active
Patent Citations (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010017591A1 (en) * | 2000-02-29 | 2001-08-30 | Hisashi Kuriya | Vehicle backward movement assisting apparatus for in-line parking |
US9547796B2 (en) * | 2012-03-30 | 2017-01-17 | Panasonic Intellectual Property Management Co., Ltd. | Parking assistance device and parking assistance method |
US20150081212A1 (en) * | 2013-09-16 | 2015-03-19 | Fleetmatics Irl Limited | System and method for automated correction of geofences |
US10311731B1 (en) * | 2014-09-16 | 2019-06-04 | Knightscope, Inc. | Autonomous parking monitor |
US20160284217A1 (en) * | 2015-03-24 | 2016-09-29 | Lg Electronics Inc. | Vehicle, mobile terminal and method for controlling the same |
US9557741B1 (en) * | 2015-08-24 | 2017-01-31 | Ford Global Technologies, Llc | System and method for autonomous valet parking using plenoptic cameras |
US20200062242A1 (en) * | 2015-10-22 | 2020-02-27 | Nissan Motor Co., Ltd. | Parking Support Method and Parking Support Device |
US20180253108A1 (en) * | 2015-11-02 | 2018-09-06 | Starship Technologies Oü | Mobile robot system and method for generating map data using straight lines extracted from visual images |
US20180082588A1 (en) * | 2016-09-21 | 2018-03-22 | Dura Operating, Llc | System and method for autonomous parking of a vehicle |
US20180095474A1 (en) * | 2016-09-30 | 2018-04-05 | Faraday&Future Inc. | Methods and systems for camera-based autonomous parking |
US20180099661A1 (en) * | 2016-10-12 | 2018-04-12 | Lg Electronics Inc. | Parking assistance apparatus and vehicle having the same |
US20200017099A1 (en) * | 2016-10-13 | 2020-01-16 | Nissan Motor Co., Ltd. | Parking Assistance Method and Parking Assistance Device |
US20180218582A1 (en) * | 2016-10-25 | 2018-08-02 | 725-1 Corporation | Monitoring an Area using Multiple Networked Video Cameras |
US20180334189A1 (en) * | 2017-05-18 | 2018-11-22 | Ford Global Technologies, Llc | Method for assisting a parking procedure of a motor vehicle, electronic parking assistance system, and motor vehicle |
US20190049977A1 (en) * | 2017-08-10 | 2019-02-14 | Patroness, LLC | System and methods for sensor integration in support of situational awareness for a motorized mobile system |
US20200262417A1 (en) * | 2017-09-29 | 2020-08-20 | Volkswagen Aktiengesellschaft | Parking a motor vehicle |
US20210056848A1 (en) * | 2018-03-30 | 2021-02-25 | Hitachi Automotive Systems, Ltd. | Parking assistance device |
US20190375409A1 (en) * | 2018-06-12 | 2019-12-12 | Rivian Ip Holdings, Llc | Systems and methods for operating an autonomous vehicle in a guardian mode |
US20200108824A1 (en) * | 2018-10-04 | 2020-04-09 | Ford Global Technologies, Llc | Monitoring and adjustment of vehicle parking positions |
US20200211400A1 (en) * | 2018-12-28 | 2020-07-02 | Hyundai Motor Company | System, method, infrastructure, and vehicle for automated valet parking |
US20200219390A1 (en) * | 2019-01-04 | 2020-07-09 | Auto Park Hawaii, Inc. | Method for managing vehicle parking within a parking structure |
US20200353914A1 (en) * | 2019-03-20 | 2020-11-12 | Clarion Co., Ltd. | In-vehicle processing device and movement support system |
US11183064B2 (en) * | 2019-07-03 | 2021-11-23 | Charles Isgar | Area reservation system |
US20210233408A1 (en) * | 2020-01-24 | 2021-07-29 | Continental Automotive Systems, Inc. | Parking lot safety apparatus and method |
US20210370916A1 (en) * | 2020-05-28 | 2021-12-02 | Faurecia Clarion Electronics Co., Ltd. | Parking assist apparatus and a method of controlling the parking assist apparatus |
US20220303719A1 (en) * | 2021-03-19 | 2022-09-22 | Ford Global Technologies, Llc | Dynamic geofencing hysteresis |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220237543A1 (en) * | 2021-01-28 | 2022-07-28 | Ncr Corporation | Intelligent order pickup processing |
CN115574804A (en) * | 2022-11-18 | 2023-01-06 | 北京集度科技有限公司 | Method, device and equipment for building parking lot map |
CN115797585A (en) * | 2022-12-19 | 2023-03-14 | 北京百度网讯科技有限公司 | Parking lot map generation method and device |
Also Published As
Publication number | Publication date |
---|---|
US11769409B2 (en) | 2023-09-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11769409B2 (en) | Automated parking lot digital map generation and use thereof | |
US11958476B2 (en) | Intelligent parking method and apparatus | |
US20220245720A1 (en) | Accident reconstruction implementing unmanned aerial vehicles (uavs) | |
CN109934086A (en) | It cooperates between vehicle for physical Foreign damage detection | |
US10757376B1 (en) | Image creation using geo-fence data | |
US9111145B2 (en) | Parking lot information system using image technology for identifying available parking spaces | |
US11069257B2 (en) | System and method for detecting a vehicle event and generating review criteria | |
US10322801B1 (en) | Unmanned aerial vehicle based surveillance as a service | |
US9323993B2 (en) | On-street parking management methods and systems for identifying a vehicle via a camera and mobile communications devices | |
US11273841B2 (en) | Method and apparatus for spoofing prevention | |
US9877011B2 (en) | Image display apparatus and image display method | |
GB2553650A (en) | Heads up display for observing vehicle perception activity | |
US11093765B2 (en) | Systems and methods for locating target vehicles | |
US9852405B1 (en) | System and method for managing waste services | |
US20160280132A1 (en) | Method and system for providing a collision alert | |
CN114067295A (en) | Method and device for determining vehicle loading rate and vehicle management system | |
CN111783595B (en) | Vehicle parking method and device, vehicle-mounted equipment and storage medium | |
CA3113494A1 (en) | Parking lot management system based on real-time computer vision processing | |
US20180260638A1 (en) | Systems and methods for providing updatable roadway codes | |
US11930146B2 (en) | Electronic device and operation method thereof, and server and operation method thereof in system for providing location-based service based on object detected from video | |
CN113848826A (en) | Automatic vehicle offline method, device, equipment and storage medium | |
Shreyas et al. | IOT Based Smart Signal | |
CN112766138A (en) | Positioning method, device and equipment based on image recognition and storage medium | |
US20220270484A1 (en) | Parking lot control server, parking lot control method and vehicle control apparatus | |
CN113721621B (en) | Vehicle control method, device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: CHARTER COMMUNICATIONS OPERATING, LLC, MISSOURI Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HEIKAL, HANY A.;HMIMY, HOSSAM H.;DAOUD, MOHAMED;REEL/FRAME:055180/0630 Effective date: 20201214 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |