US20090040070A1 - Real-time, three-dimensional synthetic vision display of sensor-validated terrain data - Google Patents
Real-time, three-dimensional synthetic vision display of sensor-validated terrain data Download PDFInfo
- Publication number
- US20090040070A1 US20090040070A1 US12/060,732 US6073208A US2009040070A1 US 20090040070 A1 US20090040070 A1 US 20090040070A1 US 6073208 A US6073208 A US 6073208A US 2009040070 A1 US2009040070 A1 US 2009040070A1
- Authority
- US
- United States
- Prior art keywords
- data
- terrain
- sensor
- database
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000004044 response Effects 0.000 claims abstract description 5
- 238000000034 method Methods 0.000 claims description 23
- 230000004927 fusion Effects 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 description 27
- 238000005259 measurement Methods 0.000 description 19
- 230000008569 process Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000010200 validation analysis Methods 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000001788 irregular Effects 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012876 topography Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- SEIGJEJVIMIXIU-UHFFFAOYSA-J aluminum;sodium;carbonate;dihydroxide Chemical compound [Na+].O[Al+]O.[O-]C([O-])=O SEIGJEJVIMIXIU-UHFFFAOYSA-J 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C23/00—Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
Definitions
- the invention relates generally to Synthetic Vision systems. In particular it relates to real-time updating and three-dimensional visualization of Synthetic Vision terrain data.
- GPS global positioning system
- Radar altimetry is an example of an active sensor for detecting height above terrain.
- a radar altimeter emits radio waves and times how long they take to return to the aircraft after reflecting off the ground. The time delay is converted into distance.
- Radar altimeters are often used as a numerical aid during a precision approach to a runway. Radar altimeters have limited range, generally point straight down, and offer only one data point for each aircraft position. Radar, lidar and other types of ranging sensors can give a pilot a reasonable “picture” of objects in his immediate vicinity. However, skill and experience are needed to interpret radar images.
- Synthetic Vision a three-dimensional perspective view of the outside world rendered on artificial display. Synthetic Vision uses computer graphics to show terrain and man-made objects in the same position, orientation and perspective as they would appear if one were looking at them on a bright, clear day.
- the Synthetic Vision system has to “know” where the terrain is and also where the aircraft is.
- GPS sensors and microelectromechanical gyroscopes and accelerometers are often used to obtain the position and spatial orientation (“attitude”) of an aircraft.
- the location of terrain and objects on the ground is stored in a database that contains latitude, longitude and altitude (e.g. height above mean sea level) information for the ground, buildings, towers, etc.
- latitude, longitude and altitude e.g. height above mean sea level
- SRTM Shuttle Radar Topography Mission
- NASA has released version 2 of the SRTM digital topographic data (also known as the “finished” version).
- the new data set is sampled at 3 arc-seconds, which is 1/1200th of a degree of latitude and longitude, or about 90 meters (295 feet).
- Researcher Maqarten Uijt de Haag has disclosed a database validation system that involves comparing radar altimeter measurements, GPS altitude and a terrain database to find places where the database is inaccurate or unreliable.
- the altitude of the airplane is measured by GPS and the radar altitude. The difference in those two altitudes should be equal to the terrain elevation stored in the database. If the system finds a significant difference then a warning signal is sent to the pilot.
- This approach serves the function of monitoring the accuracy and reliability of the terrain database, but it does not update the database with the sensor measurements or morph the terrain skin shown to the pilot in real time on a Synthetic Vision display. (See, for example: M.
- radar any kind of ranging sensor.
- lidar any kind of ranging sensor.
- Such a system can display images of the outside world as built up from real-time ranging measurements.
- radar systems are helpful, they have fundamental limitations. First of all, radar shows an image of what it sees at the moment, but it doesn't remember what it saw before. The radar transmitter must be pointed in the direction one wants to see. Also, radar does not see around a corner in a valley, or over a ridge. Finally, radar necessarily involves the transmission of high power electromagnetic energy which may be detected by an enemy; or worse provides a homing signal for enemy weapons.
- Synthetic Vision systems should instead treat their databases as information that changes dynamically. Visualization of the database (i.e. on a three-dimensional perspective Synthetic Vision display) should provide cues as to the reliability of the data presented.
- Synthetic Vision To reach the full potential of Synthetic Vision, a system must be created that displays a Synthetic Vision database in three-dimensional perspective according to a user's attitude and position while simultaneously providing intuitive cues that help the user understand which data has been validated.
- FIG. 1 shows a Synthetic Vision terrain grid displayed in three-dimensional perspective.
- FIG. 2 shows a three-dimensional perspective image of part of a Synthetic Vision terrain grid that has been validated by sensor measurement.
- FIG. 3 shows a three-dimensional perspective image of a Synthetic Vision terrain grid, part of which has been validated by sensor measurement.
- FIG. 4 shows a three-dimensional perspective image of a Synthetic Vision terrain grid (part of which has been validated by sensor measurement) with vehicle state symbology superimposed.
- FIG. 5 is a block diagram of the components of a terrain display system.
- FIG. 6 is a flow chart for a terrain display system.
- FIG. 7 shows a graph of various influence functions.
- FIG. 8 is a schematic illustration of a synthetic terrain grid with a graph of an influence function superimposed for discussion.
- the system provides a synthetic view of terrain and obstacles in the vicinity of a moving vehicle.
- the synthetic view is a computer rendering, in three-dimensional perspective, of objects in a terrain database.
- the database is updated in real-time in response to data obtained by a ranging sensor.
- the database may be stored and shared with other vehicles.
- the synthetic view displays terrain around the vehicle in the same position, orientation and perspective in which it would appear on a bright, clear day (i.e. in the absence of any restrictions to vision).
- the synthetic view may therefore be used in darkness or low-visibility conditions to replace one's normal vision with Synthetic Vision.
- the location of terrain and obstacles is stored in a computer database.
- a Synthetic Vision system mounted in a helicopter provides the helicopter pilot with a synthetic view of the helicopter's surroundings.
- a radar system in the helicopter is integrated with the Synthetic Vision system to update a terrain or obstacle database in real-time.
- a Synthetic Vision system mounted in a submarine provides the helmsman with a synthetic view of the submarine's surroundings.
- a sonar system in the submarine is integrated with the Synthetic Vision system to update a sea floor or obstacle database in real-time.
- FIG. 1 shows a Synthetic Vision terrain grid displayed in three-dimensional perspective.
- the grid image 105 represents, as an example, terrain below and in front of a helicopter.
- the terrain in the foreground of the image is relatively flat, perhaps representing a plain or desert area, while hills appear in the distance.
- the terrain grid shown in FIG. 1 is a synthetic representation of the actual “out the helicopter window” view one would have of the corresponding area on earth.
- the image may be displayed on a graphic display in a helicopter cockpit. Despite its apparent simplicity there are several features of the displayed image that are important to note.
- the data itself is a large collection of numerical values that is stored by any one or a combination of conventional means such as dynamic random access computer memory, flash memory, magnetic recording, etc.
- the image on the other hand is the representation of the data in graphical form for easy human interpretation.
- the data represented in the image in FIG. 1 comprises elevation information for an array of positions on Earth that are laid out in a grid.
- Each point in the grid i.e. each place where grid lines cross, has latitude, longitude and altitude coordinates. It is possible to associate additional variables, such as temperature or update time, with the grid points if needed.
- grid illustrated in FIG. 1 is rectangular, other layouts such as triangular, hexagonal, etc., may be used with the methods disclosed herein. Irregular grids, such as triangular irregular networks, are desirable for situations where the area density of grid points to varies from place to place. A grid could have more points in areas where higher resolution sensor data is available, for example. As used in this application, “grid” means an arrangement of points; “grid” does not necessarily imply a regularly spaced array.
- Real world terrain features such as peaks and valleys may occur anywhere.
- the grid points shown in FIG. 1 therefore are necessarily the result of interpolation of data collected at arbitrary locations between grid points.
- the interpolation of randomly spaced data to fit a grid results in some information loss.
- a grid cannot represent terrain fluctuations that occur at spatial frequencies greater than the reciprocal of twice the grid spacing.
- a grid is scalable. No matter how many times new terrain information is added by interpolation, the number of grid points remains constant. This property is important in practice because it keeps the problem of rendering the grid data computationally tractable.
- Visual characteristics of the image in FIG. 1 contribute to making an easily viewable and interpretable display of grid data.
- First of all the view is a three-dimensional perspective view rather than, for example, an overhead, two-dimensional map.
- the perspective view is inherently intuitive to interpret. It duplicates the view that one sees with normal vision.
- solid grid lines (contrasted with dashed lines, for example) contribute to making a display easy to understand.
- grid lines in the foreground are rendered as sharp lines while those in the distance are blurred. This anti-aliasing is necessary because the distant lines should be represented by lines on a display that are less than one display pixel wide. Attempts to represent thin lines by duty cycle modulation of pixels results in undesirable and visually grating artifacts. Intentional blurring on the other hand conveys the natural sensation of loss of detail in the distance.
- FIG. 2 shows a three-dimensional perspective image of part of a Synthetic Vision terrain grid that has been validated by sensor measurement.
- the quality of terrain databases for Synthetic Vision is improving, the data is not presently reliable enough to use for close-in collision avoidance.
- a database may not include changes to terrain features that have occurred after the database was created. Therefore a Synthetic Vision system must be able to validate terrain data whenever possible. Details of how sensor measurements are used to update terrain data in real time are discussed below.
- terrain grid image 205 represents a section of Synthetic Vision terrain data that has been validated. Typically this means that the system has high confidence that the data represents the position of actual terrain faithfully.
- the data could be validated by sensor measurements such as onboard radar returns. Or it could have been validated by another vehicle and received via a data link. Or it could have been validated by people on the ground transmitting position and elevation data. “Validated” may be extended to mean simply “from a different source” or “obtained at a different time” than existing database information. It is information that the system designer wants to point out to the user.
- validated data is brought to attention by displaying it differently from other data.
- One of the most effective ways to distinguish validated data is to show it in a distinctive color. Often validated data is shown in green, for example, to convey a sense of safety and security.
- brightness and texture are qualities that are effective to distinguish validate data. Validated data is more easily interpreted if it is brighter than its surroundings and if it has a texture. When color separation is not available, for example on a monochrome display, texture and brightness can still be effective visual cues.
- grid image 205 has a distinctive texture and is also rendered brighter (on paper brighter is represented by more ink used) than the a priori image of FIG. 1 .
- FIG. 3 shows a three-dimensional perspective image of a Synthetic Vision terrain grid.
- the plain grid 305 represents data that has not been validated
- the textured and colored grid 310 represents validated data. It is intuitively clear that something is different about the validated area in FIG. 3 compared to the plain area, and a pilot using a display showing the image would not have to think twice or be told that he could rely on the validated areas of the scene with higher confidence than the plain areas.
- the validated area 310 may show that perhaps unexpected terrain has been detected. Intuitively the significant revision to the picture provided by the validated data throws into question the reliability of the rest of the plain data. In contrast, if the elevation of the validated terrain is little changed from the previous data, then the opposite effect may occur; the plain area may be viewed with more confidence.
- FIG. 3 Another way to understand images such as FIG. 3 is that a Synthetic Vision system coupled to a database that is updated and validated in real-time effectively performs cartography on the fly.
- a Synthetic Vision system coupled to a database that is updated and validated in real-time effectively performs cartography on the fly.
- a ranging sensor When a ranging sensor is used as a source for validation data, it can “paint” a detailed terrain map on top of old or less reliable information.
- Synthetic Vision display shows only two validation states of data, validated and not, is very effective.
- a scene might comprise pre-existing terrain data, validated terrain, and warning areas.
- warning areas might be depicted in an alert color such as red or yellow.
- FIG. 4 shows a three-dimensional perspective image of a Synthetic Vision terrain grid (part of which has been validated by sensor measurement) with vehicle state symbology superimposed.
- 405 is an area of pre-existing terrain data
- 410 is an area of validated terrain data
- symbols 415 , 420 , 425 , 430 , 435 , and 440 provide, in generic terms, vehicle state data.
- the symbols shown in FIG. 4 are appropriate to a helicopter application.
- symbol 415 is an altitude readout (with an accompanying radar altimeter readout) while symbol 420 shows airspeed.
- symbol 425 is part of a pitch ladder, 430 is a horizon line, and 440 is a heading indicator.
- Symbol 435 represents the pitch attitude of the helicopter; in the figure it is five degrees nose down for forward flight.
- the combination of vehicle state symbology with the synthetic view of the outside is analogous to the view through a “head-up” display of the real outside world.
- the displayed image could be further enhanced with navigational data.
- numerical distance to a planned fix could be displayed or more complex information such as “highway-in-the-sky” guidance could be provided.
- FIG. 5 is a block diagram of the components of a terrain display system.
- This processor combines data from vehicle position and attitude sensors 510 , terrain database 515 , and ranging sensor(s) 520 to create an image rendered on display 525 .
- item 530 is a storage unit for sensor and state data; 535 is a source of vehicle state information such as airspeed.
- Block 540 represents controls for the fusion and graphics processor such as controls to turn radar validation on and off, or to turn Synthetic Vision database terrain on and off. These controls may also adjust the relative brightness of synthetic and validated terrain.
- Display controls 545 include adjustments such as brightness and zoom.
- Data-links 550 and 555 transmit and receive, respectively, data to and from other vehicles and users represented in block 560 .
- Fusion and graphics processor (“the processor”) 505 may be implemented in off-the-shelf or custom computer processing hardware.
- the processor performs the algorithm outlined in FIG. 6 as described below. In most cases the processor interacts with the other block components via one-directional information flow. For example, ranging sensor(s) 520 , position and attitude sensors 510 , vehicle state information for symbology 535 and fusion system controls 540 all send information to the processor.
- the processor similarly sends information to display 525 .
- the processor both receives terrain data from the database and sends updated data to the database as it is created.
- the database is a dynamic entity, the contents of which are constantly changing.
- Database 515 may comprise both low and high access speed memory devices. For example, it can include magnetic disk storage as well as random access memory (RAM). Information for a large region can be moved from disk to RAM as needed. The database is updated in response to information obtained by ranging sensor(s) 520 .
- RAM random access memory
- Ranging sensor(s) 520 may include radar, lidar, sonar, or other technologies.
- a ranging sensor provides the range to the nearest obstacle in a particular direction (i.e. azimuth, elevation, radius).
- a practical ranging sensor emits a beam of finite angular width; thus the farther the beam travels the more area it encompasses perpendicular to the direction of travel. Long distance measurements cover more area than close measurements.
- the ranging sensor usually includes a scanning system so that an image can be built up from point measurements.
- the database may also be updated by data received via datalink 555 .
- helicopters returning from a mission may transmit recent database information to helicopters leaving to go to the same place.
- Position and attitude sensors 510 provide position and orientation data to processor 505 .
- This sensor suite may include GPS receivers, heading sensors, gyroscopes and accelerometers among other sensors.
- the sensor data may also be sent to outbound data-link 550 and data storage unit 530 .
- Storage unit 530 may comprise RAM, disk or other memory devices.
- Additional vehicle state information is provided to processor 505 by sensors in block 535 .
- This information is in addition to position and attitude and may include parameters such as airspeed, radio-navigation data, temperature, etc.
- Control blocks 540 and 545 comprise all adjustments and inputs that a user can present to the processor and the display respectively.
- FIG. 6 is a flow chart for a terrain fusion and display system.
- FIG. 6 shows steps 605 - 650 which the processor follows; however, these steps are not always performed in the order indicated. It is easiest to present an algorithm in loop form as shown in FIG. 6 , but it may also be implemented in an interrupt-driven scheme where the loop elements are accomplished as required rather than sequentially.
- step 605 is the initialization of the display unit; in step 610 communications with sensors and state data providers are initialized. Local area synthetic terrain data is loaded into the processor in step 615 .
- step 620 the processor receives new state data. In other words this is the step where the processor gets the latest information on position and attitude of the vehicle (e.g. a helicopter) in which the system is mounted.
- Attitude as well as position is needed because the perspective view of the surrounding terrain depends upon how the vehicle is oriented. This is in contrast to a simple map system where only position is necessary.
- Ranging sensor measurements for example radar information
- These measurements include range (i.e. distance) information and the azimuth and elevation angles that the sensor was pointing at the time of the measurement. These angles and the range are measured with respect to the vehicle.
- range i.e. distance
- azimuth, elevation, range To compare these data with database data the (azimuth, elevation, range) triad must be transformed from vehicle-relative coordinates to global-relative coordinates (latitude, longitude, altitude). This process is referred to as a [III][II][I] or Yaw, Pitch, Roll coordinate transform, the principles of which are well known in the art.
- step 635 the sensor information is compared with terrain database data.
- the processor determines which topography grid points contained in the database should be updated.
- the updating operation includes saving updated database information. Further details of how the sensor data is interpolated to update the elevation of grid points are provided in connection with FIGS. 7 and 8 .
- the updated terrain information is rendered into a computer graphic image in step 640 .
- This operation encompasses all the graphics rendering calculations.
- additional symbology such as attitude and heading information is overlaid onto the image in step 645 .
- the processor checks to see if further operation is required. If it is, the process just described repeats itself starting at step 620 ; otherwise the processor stops in step 650 .
- a regular or irregular network of grid points in a synthetic terrain view is a useful feature because it forms a scalable system.
- new terrain elevation data for an arbitrary position on the ground is obtained by a ranging sensor, that data is used to adjust the height of nearby grid points.
- the number of grid points and their lateral locations do not change however. Therefore, no matter how much new terrain elevation data arrives, the number of computations required to display the synthetic view does not change.
- Incoming ranging sensor data can be incorporated into a grid terrain database through interpolation with an influence function.
- the influence function specifies how much effect new elevation data received for an arbitrary location has on nearby grid points.
- the influence function may be related to the sensor's beamwidth and/or be appropriately modified to account for other system requirements, such as, for example, database grid structure and spacing.
- FIG. 7 shows a graph 705 of various influence functions.
- influence, I is plotted versus radius, r.
- Three influence functions 710 , 715 and 720 are shown.
- radius r 0 On the r axis radius r 0 and also the radii for points Y and Z (discussed below) are marked.
- I axis On the I axis, 1 (unit influence) and influence value I Y are marked.
- Influence functions 710 , 715 and 720 share the properties:
- I is not defined for r ⁇ 0.
- Function 720 could be a cubic approximation to a Gaussian function, for example.
- FIG. 8 shows a schematic illustration of a synthetic terrain grid 805 with a graph 810 of an influence function superimposed for discussion.
- terrain grid points Y and Z are labeled for clarity.
- Point A is a sensor data point and circle 815 represents a radius r 0 from it.
- a ranging sensor e.g. 520 in FIG. 5
- a processor e.g. 505 in FIG. 5
- the processor must now determine how much to adjust the elevation of grid points near point A.
- Point A as reported by the sensor is located in space by the processor in terms of latitude, longitude and altitude: lat A , lon A , alt A,sensor .
- the processor first uses existing grid database points to calculate an altitude for point A based on prior data: alt A,database . This is done by interpolating the altitudes of nearby grid points. Next the difference, ⁇ alt, between the measured and interpolated altitudes at point A is calculated:
- I Y is the value of the influence function (e.g. function 720 in FIG. 7 ) at the radius corresponding to the distance between points A and Y.
- alt Y,database is the altitude at point Y previously existing in the database while alt Y updated is the updated altitude at point Y.
- alt Y,updated may now be stored in the database.
- r 0 is related to the properties of the imaging sensor and level of terrain detail required. If the ranging sensor has a wide beam width then sensor measurements are derived from large areas of terrain. One simple method is to determine r 0 as:
- r 0 (sensor beam half-angle) ⁇ (sensed range to terrain point)
- r 0 should be prevented from being too large or else too many grid adjustment calculations will be required and the processor will not be able to keep up with the arrival of new data. Therefore r 0 is constrained to be less than a constant r MAX which is determined by graphics hardware considerations. Although r 0 is illustrated in FIG. 8 as being only slightly larger than the grid spacing, in general r 0 could be significantly greater than the grid spacing.
- ranging sensor data In most applications ranging sensor data is considered reflect the true state of the outside world. In other words it takes precedence over database information. However it is also possible to tag grid database and ranging sensor data with time information and to weight the importance of data according to time. For example, it might be appropriate to reduce the effect of ranging sensor data on very recently updated grid database data compared to its effect on older grid database data. This could be useful when one has high confidence in the database and only noisy sensor data.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Geometry (AREA)
- Radar, Positioning & Navigation (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Computer Graphics (AREA)
- Processing Or Creating Images (AREA)
- Traffic Control Systems (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
Description
- The invention relates generally to Synthetic Vision systems. In particular it relates to real-time updating and three-dimensional visualization of Synthetic Vision terrain data.
- Consider the predicament of a helicopter pilot flying in darkness or low-visibility weather conditions. Equipped with conventional navigation systems today's pilot is forced to fly slowly and find a way through the murk.
- Perhaps the helicopter has a modern global positioning system (GPS) receiver on board coupled to a “moving map” display. This system shows the position of the aircraft as a symbol on a two-dimensional electronic map. It provides the same type of situational awareness that the pilot could achieve using a paper map, although much more easily and accurately.
- Conventional moving maps do not show altitude above the ground, however. Rapid progress is being made in developing maps that change color as height over the ground changes, but while these systems offer an improvement in situational awareness, they are more suited for avoiding a mountain range than for threading one's way between peaks.
- Radar altimetry is an example of an active sensor for detecting height above terrain. A radar altimeter emits radio waves and times how long they take to return to the aircraft after reflecting off the ground. The time delay is converted into distance. Radar altimeters are often used as a numerical aid during a precision approach to a runway. Radar altimeters have limited range, generally point straight down, and offer only one data point for each aircraft position. Radar, lidar and other types of ranging sensors can give a pilot a reasonable “picture” of objects in his immediate vicinity. However, skill and experience are needed to interpret radar images.
- A new approach to vehicle control in low visibility is being developed. The concept is to replace the view a pilot sees out his cockpit window, i.e. his conventional vision, with Synthetic Vision, a three-dimensional perspective view of the outside world rendered on artificial display. Synthetic Vision uses computer graphics to show terrain and man-made objects in the same position, orientation and perspective as they would appear if one were looking at them on a bright, clear day.
- Of course, the Synthetic Vision system has to “know” where the terrain is and also where the aircraft is. For example, GPS sensors and microelectromechanical gyroscopes and accelerometers are often used to obtain the position and spatial orientation (“attitude”) of an aircraft. The location of terrain and objects on the ground is stored in a database that contains latitude, longitude and altitude (e.g. height above mean sea level) information for the ground, buildings, towers, etc. Clearly the utility of a Synthetic Vision system depends critically on the accuracy and precision of its database.
- One source of terrain data for Synthetic Vision is the Shuttle Radar Topography Mission (SRTM) which employed a specially modified radar system that flew onboard the Space Shuttle Endeavour during an 11-day mission in February, 2000. The mission obtained elevation data on a global scale to generate a nearly complete high-resolution digital topographic database of Earth. NASA has released version 2 of the SRTM digital topographic data (also known as the “finished” version). For regions outside the United States the new data set is sampled at 3 arc-seconds, which is 1/1200th of a degree of latitude and longitude, or about 90 meters (295 feet).
- Version 2 is the result of a substantial editing effort by the National Geospatial Intelligence Agency and exhibits well-defined water bodies and coastlines and the absence of spikes and wells (single pixel errors), although some areas of missing data (‘voids’) are still present. Therefore, while the SRTM provides an excellent baseline it is still imperative that Synthetic Vision databases be checked for accuracy before pilots depend on them for terrain clearance.
- Researcher Maqarten Uijt de Haag has disclosed a database validation system that involves comparing radar altimeter measurements, GPS altitude and a terrain database to find places where the database is inaccurate or unreliable. The altitude of the airplane is measured by GPS and the radar altitude. The difference in those two altitudes should be equal to the terrain elevation stored in the database. If the system finds a significant difference then a warning signal is sent to the pilot. This approach serves the function of monitoring the accuracy and reliability of the terrain database, but it does not update the database with the sensor measurements or morph the terrain skin shown to the pilot in real time on a Synthetic Vision display. (See, for example: M. Uijt de Haag et al., “Terrain Database Integrity Monitoring for Synthetic Vision Systems”, IEEE Transactions on Aerospace and Electronic Systems, vol. 41, p. 386-406, April 2005; A. Vadlamani et al., “Improved Downward-Looking Terrain Database Integrity Monitor and Terrain Navigation,” Proc. IEEE Aerospace Conf., p. 1594-1607, March 2004; and, A. Vadlamani et al., “A 3-D Spatial Integrity Monitor for Terrain Databases,” Proc. 23rd IEEE/AIAA Digital Avionics Systems Conf. (DASC), p. 4.C.2-1-4.C.2-13, October 2004; all of which are incorporated herein by reference.)
- Suppose that an elevation database is available for the area in which the rescue helicopter mentioned earlier is flying. In low visibility conditions a Synthetic Vision display showing a three-dimensional computer graphic depiction of nearby terrain would be very valuable. But what level of database reliability does the pilot require in order to believe that when his Synthetic Vision shows no obstacles, there really is nothing out there?
- Alternatively, suppose the helicopter is equipped with radar, lidar, or generically, any kind of ranging sensor. Such a system can display images of the outside world as built up from real-time ranging measurements. Although radar systems are helpful, they have fundamental limitations. First of all, radar shows an image of what it sees at the moment, but it doesn't remember what it saw before. The radar transmitter must be pointed in the direction one wants to see. Also, radar does not see around a corner in a valley, or over a ridge. Finally, radar necessarily involves the transmission of high power electromagnetic energy which may be detected by an enemy; or worse provides a homing signal for enemy weapons.
- Clearly Synthetic Vision and radar each have limitations that the other could help overcome. Unfortunately no system exists that combines the best characteristics of each technology in an intuitive presentation that any pilot can understand.
- A helicopter flight in poor visibility is only an example of one scenario where Synthetic Vision is valuable. Boats, ships, hovercraft, airplanes, submarines, cars and trucks all find themselves in situations where a clear view outside, albeit a synthetic view, could spell the difference between successfully completing a mission or a disastrous collision. In each case, knowledge that the synthetic view had been validated by a ranging sensor (e.g. sonar on a submarine) would increase the confidence of the user of the display. In situations where stealth is required users might be satisfied if they knew that their synthetic database view had been recently updated by a friendly vehicle.
- Reliance on static databases is a shortcoming of present Synthetic Vision systems. Synthetic Vision systems should instead treat their databases as information that changes dynamically. Visualization of the database (i.e. on a three-dimensional perspective Synthetic Vision display) should provide cues as to the reliability of the data presented.
- To reach the full potential of Synthetic Vision, a system must be created that displays a Synthetic Vision database in three-dimensional perspective according to a user's attitude and position while simultaneously providing intuitive cues that help the user understand which data has been validated.
-
FIG. 1 shows a Synthetic Vision terrain grid displayed in three-dimensional perspective. -
FIG. 2 shows a three-dimensional perspective image of part of a Synthetic Vision terrain grid that has been validated by sensor measurement. -
FIG. 3 shows a three-dimensional perspective image of a Synthetic Vision terrain grid, part of which has been validated by sensor measurement. -
FIG. 4 shows a three-dimensional perspective image of a Synthetic Vision terrain grid (part of which has been validated by sensor measurement) with vehicle state symbology superimposed. -
FIG. 5 is a block diagram of the components of a terrain display system. -
FIG. 6 is a flow chart for a terrain display system. -
FIG. 7 shows a graph of various influence functions. -
FIG. 8 is a schematic illustration of a synthetic terrain grid with a graph of an influence function superimposed for discussion. - An advanced Synthetic Vision system is disclosed. The system provides a synthetic view of terrain and obstacles in the vicinity of a moving vehicle. The synthetic view is a computer rendering, in three-dimensional perspective, of objects in a terrain database. The database is updated in real-time in response to data obtained by a ranging sensor. The database may be stored and shared with other vehicles.
- The synthetic view displays terrain around the vehicle in the same position, orientation and perspective in which it would appear on a bright, clear day (i.e. in the absence of any restrictions to vision). The synthetic view may therefore be used in darkness or low-visibility conditions to replace one's normal vision with Synthetic Vision. The location of terrain and obstacles is stored in a computer database.
- As an example, a Synthetic Vision system mounted in a helicopter provides the helicopter pilot with a synthetic view of the helicopter's surroundings. A radar system in the helicopter is integrated with the Synthetic Vision system to update a terrain or obstacle database in real-time. In a different example, a Synthetic Vision system mounted in a submarine provides the helmsman with a synthetic view of the submarine's surroundings. A sonar system in the submarine is integrated with the Synthetic Vision system to update a sea floor or obstacle database in real-time.
-
FIG. 1 shows a Synthetic Vision terrain grid displayed in three-dimensional perspective. Thegrid image 105 represents, as an example, terrain below and in front of a helicopter. The terrain in the foreground of the image is relatively flat, perhaps representing a plain or desert area, while hills appear in the distance. The terrain grid shown inFIG. 1 is a synthetic representation of the actual “out the helicopter window” view one would have of the corresponding area on earth. The image may be displayed on a graphic display in a helicopter cockpit. Despite its apparent simplicity there are several features of the displayed image that are important to note. - For discussion purposes it may be helpful to distinguish between terrain data and the display of that data in an image. The data itself is a large collection of numerical values that is stored by any one or a combination of conventional means such as dynamic random access computer memory, flash memory, magnetic recording, etc. The image on the other hand is the representation of the data in graphical form for easy human interpretation.
- The data represented in the image in
FIG. 1 comprises elevation information for an array of positions on Earth that are laid out in a grid. Each point in the grid, i.e. each place where grid lines cross, has latitude, longitude and altitude coordinates. It is possible to associate additional variables, such as temperature or update time, with the grid points if needed. - Although the grid illustrated in
FIG. 1 is rectangular, other layouts such as triangular, hexagonal, etc., may be used with the methods disclosed herein. Irregular grids, such as triangular irregular networks, are desirable for situations where the area density of grid points to varies from place to place. A grid could have more points in areas where higher resolution sensor data is available, for example. As used in this application, “grid” means an arrangement of points; “grid” does not necessarily imply a regularly spaced array. - Real world terrain features such as peaks and valleys may occur anywhere. The grid points shown in
FIG. 1 therefore are necessarily the result of interpolation of data collected at arbitrary locations between grid points. The interpolation of randomly spaced data to fit a grid results in some information loss. According to the Nyquist criterion a grid cannot represent terrain fluctuations that occur at spatial frequencies greater than the reciprocal of twice the grid spacing. On the other hand a grid is scalable. No matter how many times new terrain information is added by interpolation, the number of grid points remains constant. This property is important in practice because it keeps the problem of rendering the grid data computationally tractable. - Visual characteristics of the image in
FIG. 1 contribute to making an easily viewable and interpretable display of grid data. First of all the view is a three-dimensional perspective view rather than, for example, an overhead, two-dimensional map. The perspective view is inherently intuitive to interpret. It duplicates the view that one sees with normal vision. Although not required, solid grid lines (contrasted with dashed lines, for example) contribute to making a display easy to understand. Finally it is apparent that grid lines in the foreground are rendered as sharp lines while those in the distance are blurred. This anti-aliasing is necessary because the distant lines should be represented by lines on a display that are less than one display pixel wide. Attempts to represent thin lines by duty cycle modulation of pixels results in undesirable and visually grating artifacts. Intentional blurring on the other hand conveys the natural sensation of loss of detail in the distance. -
FIG. 2 shows a three-dimensional perspective image of part of a Synthetic Vision terrain grid that has been validated by sensor measurement. Although the quality of terrain databases for Synthetic Vision is improving, the data is not presently reliable enough to use for close-in collision avoidance. Furthermore a database may not include changes to terrain features that have occurred after the database was created. Therefore a Synthetic Vision system must be able to validate terrain data whenever possible. Details of how sensor measurements are used to update terrain data in real time are discussed below. - In
FIG. 2 terrain grid image 205 represents a section of Synthetic Vision terrain data that has been validated. Typically this means that the system has high confidence that the data represents the position of actual terrain faithfully. The data could be validated by sensor measurements such as onboard radar returns. Or it could have been validated by another vehicle and received via a data link. Or it could have been validated by people on the ground transmitting position and elevation data. “Validated” may be extended to mean simply “from a different source” or “obtained at a different time” than existing database information. It is information that the system designer wants to point out to the user. - Regardless of what the significance of validated data may be, it is brought to attention by displaying it differently from other data. One of the most effective ways to distinguish validated data is to show it in a distinctive color. Often validated data is shown in green, for example, to convey a sense of safety and security. In combination with color, brightness and texture are qualities that are effective to distinguish validate data. Validated data is more easily interpreted if it is brighter than its surroundings and if it has a texture. When color separation is not available, for example on a monochrome display, texture and brightness can still be effective visual cues. In
FIG. 2 ,grid image 205 has a distinctive texture and is also rendered brighter (on paper brighter is represented by more ink used) than the a priori image ofFIG. 1 . - A combination of preexisting and validated data is displayed in
FIG. 3 which shows a three-dimensional perspective image of a Synthetic Vision terrain grid. InFIG. 3 part of the image has been validated by sensor measurement. Theplain grid 305 represents data that has not been validated, while the textured andcolored grid 310 represents validated data. It is intuitively clear that something is different about the validated area inFIG. 3 compared to the plain area, and a pilot using a display showing the image would not have to think twice or be told that he could rely on the validated areas of the scene with higher confidence than the plain areas. - In
FIG. 3 the validatedarea 310 may show that perhaps unexpected terrain has been detected. Intuitively the significant revision to the picture provided by the validated data throws into question the reliability of the rest of the plain data. In contrast, if the elevation of the validated terrain is little changed from the previous data, then the opposite effect may occur; the plain area may be viewed with more confidence. - Another way to understand images such as
FIG. 3 is that a Synthetic Vision system coupled to a database that is updated and validated in real-time effectively performs cartography on the fly. When a ranging sensor is used as a source for validation data, it can “paint” a detailed terrain map on top of old or less reliable information. - Simplicity and clarity are desirable attributes of a Synthetic Vision display and, as in
FIG. 3 , showing only two validation states of data, validated and not, is very effective. However, it is certainly possible to display more than two types of data. For example, a scene might comprise pre-existing terrain data, validated terrain, and warning areas. As an example, warning areas might be depicted in an alert color such as red or yellow. -
FIG. 4 shows a three-dimensional perspective image of a Synthetic Vision terrain grid (part of which has been validated by sensor measurement) with vehicle state symbology superimposed. InFIG. 4 , 405 is an area of pre-existing terrain data, 410 is an area of validated terrain data, andsymbols FIG. 4 are appropriate to a helicopter application. - In
FIG. 4 symbol 415 is an altitude readout (with an accompanying radar altimeter readout) whilesymbol 420 shows airspeed.Symbol 425 is part of a pitch ladder, 430 is a horizon line, and 440 is a heading indicator.Symbol 435 represents the pitch attitude of the helicopter; in the figure it is five degrees nose down for forward flight. The combination of vehicle state symbology with the synthetic view of the outside is analogous to the view through a “head-up” display of the real outside world. - Although not shown in
FIG. 4 the displayed image could be further enhanced with navigational data. For example, numerical distance to a planned fix could be displayed or more complex information such as “highway-in-the-sky” guidance could be provided. -
FIG. 5 is a block diagram of the components of a terrain display system. At the center of the system is fusion andgraphics processor 505. This processor combines data from vehicle position andattitude sensors 510,terrain database 515, and ranging sensor(s) 520 to create an image rendered ondisplay 525. - In
FIG. 5 ,item 530 is a storage unit for sensor and state data; 535 is a source of vehicle state information such as airspeed.Block 540 represents controls for the fusion and graphics processor such as controls to turn radar validation on and off, or to turn Synthetic Vision database terrain on and off. These controls may also adjust the relative brightness of synthetic and validated terrain. Display controls 545 include adjustments such as brightness and zoom. Data-links - Fusion and graphics processor (“the processor”) 505 may be implemented in off-the-shelf or custom computer processing hardware. The processor performs the algorithm outlined in
FIG. 6 as described below. In most cases the processor interacts with the other block components via one-directional information flow. For example, ranging sensor(s) 520, position andattitude sensors 510, vehicle state information forsymbology 535 and fusion system controls 540 all send information to the processor. The processor similarly sends information to display 525. - Two-way communication is required between the processor and
terrain database 515. The processor both receives terrain data from the database and sends updated data to the database as it is created. Thus the database is a dynamic entity, the contents of which are constantly changing. -
Database 515 may comprise both low and high access speed memory devices. For example, it can include magnetic disk storage as well as random access memory (RAM). Information for a large region can be moved from disk to RAM as needed. The database is updated in response to information obtained by ranging sensor(s) 520. - Ranging sensor(s) 520 may include radar, lidar, sonar, or other technologies. In general however, a ranging sensor provides the range to the nearest obstacle in a particular direction (i.e. azimuth, elevation, radius). A practical ranging sensor emits a beam of finite angular width; thus the farther the beam travels the more area it encompasses perpendicular to the direction of travel. Long distance measurements cover more area than close measurements. The ranging sensor usually includes a scanning system so that an image can be built up from point measurements.
- The database may also be updated by data received via
datalink 555. As an example, helicopters returning from a mission may transmit recent database information to helicopters leaving to go to the same place. - Position and
attitude sensors 510 provide position and orientation data toprocessor 505. This sensor suite may include GPS receivers, heading sensors, gyroscopes and accelerometers among other sensors. The sensor data may also be sent to outbound data-link 550 anddata storage unit 530.Storage unit 530 may comprise RAM, disk or other memory devices. - Additional vehicle state information is provided to
processor 505 by sensors inblock 535. This information is in addition to position and attitude and may include parameters such as airspeed, radio-navigation data, temperature, etc. Control blocks 540 and 545 comprise all adjustments and inputs that a user can present to the processor and the display respectively. - Although the processor performs many functions, not all of which are described here, its main job is to perform the algorithm shown in
FIG. 6 which is a flow chart for a terrain fusion and display system.FIG. 6 shows steps 605-650 which the processor follows; however, these steps are not always performed in the order indicated. It is easiest to present an algorithm in loop form as shown inFIG. 6 , but it may also be implemented in an interrupt-driven scheme where the loop elements are accomplished as required rather than sequentially. - In
FIG. 6 ,step 605 is the initialization of the display unit; instep 610 communications with sensors and state data providers are initialized. Local area synthetic terrain data is loaded into the processor instep 615. Instep 620 the processor receives new state data. In other words this is the step where the processor gets the latest information on position and attitude of the vehicle (e.g. a helicopter) in which the system is mounted. - Based on the latest position and attitude information appropriate synthetic terrain data for the surrounding area is loaded (“paged-in”) to the processor in
step 625. Attitude as well as position is needed because the perspective view of the surrounding terrain depends upon how the vehicle is oriented. This is in contrast to a simple map system where only position is necessary. - Ranging sensor measurements, for example radar information, are received by the processor in
step 630. These measurements include range (i.e. distance) information and the azimuth and elevation angles that the sensor was pointing at the time of the measurement. These angles and the range are measured with respect to the vehicle. To compare these data with database data the (azimuth, elevation, range) triad must be transformed from vehicle-relative coordinates to global-relative coordinates (latitude, longitude, altitude). This process is referred to as a [III][II][I] or Yaw, Pitch, Roll coordinate transform, the principles of which are well known in the art. - In
step 635 the sensor information is compared with terrain database data. In this step the processor determines which topography grid points contained in the database should be updated. The updating operation includes saving updated database information. Further details of how the sensor data is interpolated to update the elevation of grid points are provided in connection withFIGS. 7 and 8 . - The updated terrain information is rendered into a computer graphic image in
step 640. This operation encompasses all the graphics rendering calculations. Finally, additional symbology such as attitude and heading information is overlaid onto the image instep 645. At this point the processor checks to see if further operation is required. If it is, the process just described repeats itself starting atstep 620; otherwise the processor stops instep 650. - As mentioned earlier, a regular or irregular network of grid points in a synthetic terrain view is a useful feature because it forms a scalable system. When new terrain elevation data for an arbitrary position on the ground is obtained by a ranging sensor, that data is used to adjust the height of nearby grid points. The number of grid points and their lateral locations do not change however. Therefore, no matter how much new terrain elevation data arrives, the number of computations required to display the synthetic view does not change.
- Contrast this situation with a system that added a new grid point at the location of each new sensor measurement. The number of grid points would grow quickly and the computational burden would become so large that real-time processing would not be feasible.
- Incoming ranging sensor data can be incorporated into a grid terrain database through interpolation with an influence function. The influence function specifies how much effect new elevation data received for an arbitrary location has on nearby grid points. The influence function may be related to the sensor's beamwidth and/or be appropriately modified to account for other system requirements, such as, for example, database grid structure and spacing.
-
FIG. 7 shows agraph 705 of various influence functions. In the figure, influence, I, is plotted versus radius, r. Three influence functions 710, 715 and 720 are shown. On the r axis radius r0 and also the radii for points Y and Z (discussed below) are marked. On the I axis, 1 (unit influence) and influence value IY are marked. Point A, which lies at r=0 is discussed in connection withFIG. 8 . - Influence functions 710, 715 and 720 share the properties:
- I=0 for all r>r0; and,
- I is not defined for r<0.
-
Function 710 is a “top hat” function in which I=1 for r≦r0.Function 715 decreases linearly from I=1 at r=0 to I=0 at r=r0.Function 720 decreases monotonically from I=1 at r=0 to I=0 at r=r0.Function 720 could be a cubic approximation to a Gaussian function, for example. - Although influence functions 710, 715 and 720 decrease monotonically from r=0 to r=r0 this is not a requirement for all influence functions. Similarly, although influence functions 710, 715 and 720 are equal to one at r=0 this is not a requirement for all influence functions. However all influence functions must obey the properties: I=0 for all r>r0; and, I is not defined for r<0.
- Further understanding of the use of an influence function may be obtained by inspection of
FIG. 8 .FIG. 8 shows a schematic illustration of asynthetic terrain grid 805 with agraph 810 of an influence function superimposed for discussion. In the figure, terrain grid points Y and Z are labeled for clarity. Point A is a sensor data point andcircle 815 represents a radius r0 from it. - Suppose that a ranging sensor (e.g. 520 in
FIG. 5 ) has reported raw data to a processor (e.g. 505 inFIG. 5 ) and that the processor has performed a coordinate transformation to determine that terrain exists at a certain elevation at point A. The processor must now determine how much to adjust the elevation of grid points near point A. - Point A as reported by the sensor is located in space by the processor in terms of latitude, longitude and altitude: latA, lonA, altA,sensor. The processor first uses existing grid database points to calculate an altitude for point A based on prior data: altA,database. This is done by interpolating the altitudes of nearby grid points. Next the difference, Δalt, between the measured and interpolated altitudes at point A is calculated:
-
Δalt=altA,sensor−altA,database - An influence function is now used to determine how much to adjust the elevation of points that lie a distance r0 or less away from point A. Consider point Y, for example. Point Y is less than r0 away from A and its elevation is updated according to:
-
altY,updated=altY,database+Δalt·IY - IY is the value of the influence function (e.g. function 720 in
FIG. 7 ) at the radius corresponding to the distance between points A and Y. altY,database is the altitude at point Y previously existing in the database while altY updated is the updated altitude at point Y. altY,updated may now be stored in the database. - The process is repeated for any other grid points that lie within a distance r0 from point A. After all the grid points within r0 from point A have been updated, there is no longer any need for the system to remember anything about point A and all information about it (latA, lonA, altA,sensor) can be discarded. In this way the system adjusts and validates dynamic terrain based on sensor data.
- Physically, r0 is related to the properties of the imaging sensor and level of terrain detail required. If the ranging sensor has a wide beam width then sensor measurements are derived from large areas of terrain. One simple method is to determine r0 as:
-
r 0=(sensor beam half-angle)·(sensed range to terrain point) - r0 should be prevented from being too large or else too many grid adjustment calculations will be required and the processor will not be able to keep up with the arrival of new data. Therefore r0 is constrained to be less than a constant rMAX which is determined by graphics hardware considerations. Although r0 is illustrated in
FIG. 8 as being only slightly larger than the grid spacing, in general r0 could be significantly greater than the grid spacing. - In most applications ranging sensor data is considered reflect the true state of the outside world. In other words it takes precedence over database information. However it is also possible to tag grid database and ranging sensor data with time information and to weight the importance of data according to time. For example, it might be appropriate to reduce the effect of ranging sensor data on very recently updated grid database data compared to its effect on older grid database data. This could be useful when one has high confidence in the database and only noisy sensor data.
- As one skilled in the art will readily appreciate from the disclosure of the embodiments herein, processes machines, manufacture, means, methods, or steps, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding embodiments described herein may be utilized according to the present invention. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, means, methods, or steps.
- The above description of illustrated embodiments of the systems and methods is not intended to be exhaustive or to limit the systems and methods to the precise form disclosed. While specific embodiments of, and examples for, the systems and methods are described herein for illustrative purposes, various equivalent modifications are possible within the scope of the systems and methods, as those skilled in the relevant art will recognize. The teachings of the systems and methods provided herein can be applied to other systems and methods, not only for the systems and methods described above.
- In general, in the following claims, the terms used should not be construed to limit the systems and methods to the specific embodiments disclosed in the specification and the claims, but should be construed to include all systems that operate under the claims. Accordingly, the systems and methods are not limited by the disclosure, but instead the scope of the systems and methods are to be determined entirely by the claims.
Claims (17)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/060,732 US20090040070A1 (en) | 2006-01-20 | 2008-04-01 | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/336,519 US7352292B2 (en) | 2006-01-20 | 2006-01-20 | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data |
US12/060,732 US20090040070A1 (en) | 2006-01-20 | 2008-04-01 | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/336,519 Continuation US7352292B2 (en) | 2006-01-20 | 2006-01-20 | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090040070A1 true US20090040070A1 (en) | 2009-02-12 |
Family
ID=38284998
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/336,519 Active 2026-08-03 US7352292B2 (en) | 2006-01-20 | 2006-01-20 | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data |
US12/060,732 Abandoned US20090040070A1 (en) | 2006-01-20 | 2008-04-01 | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/336,519 Active 2026-08-03 US7352292B2 (en) | 2006-01-20 | 2006-01-20 | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data |
Country Status (3)
Country | Link |
---|---|
US (2) | US7352292B2 (en) |
EP (1) | EP1974331B1 (en) |
WO (1) | WO2008018906A2 (en) |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100145610A1 (en) * | 2008-09-05 | 2010-06-10 | Thales | Viewing device for aircraft comprising radio navigation beacon display means and associated method |
US20100161158A1 (en) * | 2008-12-18 | 2010-06-24 | Honeywell International Inc. | Systems and methods for enhancing terrain elevation awareness |
US20110095913A1 (en) * | 2009-10-26 | 2011-04-28 | L-3 Communications Avionics Systems, Inc. | System and method for displaying runways and terrain in synthetic vision systems |
US8049644B1 (en) * | 2007-04-17 | 2011-11-01 | Rcokwell Collins, Inc. | Method for TAWS depiction on SVS perspective displays |
DE102010022726A1 (en) * | 2010-06-04 | 2011-12-08 | Eads Deutschland Gmbh | Device for displaying terrain on a display device of a missile |
US20120035789A1 (en) * | 2010-08-03 | 2012-02-09 | Honeywell International Inc. | Enhanced flight vision system for enhancing approach runway signatures |
US20120271546A1 (en) * | 2011-04-19 | 2012-10-25 | Honeywell International Inc. | Systems and methods for navigation in a gps-denied environment |
CN103017759A (en) * | 2012-12-22 | 2013-04-03 | 中国人民解放军第四军医大学 | Method to overcome space unorientation and delusions |
WO2013068821A2 (en) | 2011-11-09 | 2013-05-16 | Abyssal S.A. | System and method of operation for remotely operated vehicles with superimposed 3d imagery |
US20130155093A1 (en) * | 2011-12-20 | 2013-06-20 | Honeywell International Inc. | System and method for displaying enhanced vision and synthetic images |
US8477062B1 (en) * | 2009-09-29 | 2013-07-02 | Rockwell Collins, Inc. | Radar-based system, module, and method for presenting steering symbology on an aircraft display unit |
US20130257852A1 (en) * | 2012-04-02 | 2013-10-03 | Honeywell International Inc. | Synthetic vision systems and methods for displaying detached objects |
US9347794B1 (en) * | 2012-09-21 | 2016-05-24 | Rockwell Collins, Inc. | Image data combining systems and methods of multiple vision systems |
US9354633B1 (en) | 2008-10-31 | 2016-05-31 | Rockwell Collins, Inc. | System and method for ground navigation |
US9384586B1 (en) | 2013-04-05 | 2016-07-05 | Rockwell Collins, Inc. | Enhanced flight vision system and method with radar sensing and pilot monitoring display |
CN105823475A (en) * | 2014-12-12 | 2016-08-03 | 泰勒斯公司 | Method of three-dimensional representation of a scene |
US9733349B1 (en) | 2007-09-06 | 2017-08-15 | Rockwell Collins, Inc. | System for and method of radar data processing for low visibility landing applications |
US9939526B2 (en) | 2007-09-06 | 2018-04-10 | Rockwell Collins, Inc. | Display system and method using weather radar sensing |
US10032311B1 (en) * | 2014-09-29 | 2018-07-24 | Rockwell Collins, Inc. | Synthetic image enhancing system, device, and method |
US10228460B1 (en) | 2016-05-26 | 2019-03-12 | Rockwell Collins, Inc. | Weather radar enabled low visibility operation system and method |
US10353068B1 (en) | 2016-07-28 | 2019-07-16 | Rockwell Collins, Inc. | Weather radar enabled offshore operation system and method |
WO2020139469A1 (en) * | 2018-12-28 | 2020-07-02 | Intel Corporation | Real-time, three-dimensional vehicle display |
US10705201B1 (en) | 2015-08-31 | 2020-07-07 | Rockwell Collins, Inc. | Radar beam sharpening system and method |
US20210004004A1 (en) * | 2019-07-05 | 2021-01-07 | Liebherr Mining Equipment Newport News Co. | Method for autonomously controlling a vehicle |
US10928510B1 (en) | 2014-09-10 | 2021-02-23 | Rockwell Collins, Inc. | System for and method of image processing for low visibility landing applications |
Families Citing this family (70)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8130222B1 (en) | 2004-10-19 | 2012-03-06 | Rockwell Collins Simulation And Training Solutions Llc | System and method for resolving visual priority among coincident primitives |
US8271150B2 (en) * | 2005-12-22 | 2012-09-18 | The Boeing Company | Methods and systems for displaying enroute moving maps |
US7667621B2 (en) * | 2006-02-06 | 2010-02-23 | Avidyne Corporation | Primary flight display (PFD) including weather information and terrain awareness |
US8032267B1 (en) | 2006-04-03 | 2011-10-04 | Honeywell International Inc. | Aviation navigational and flight management systems and methods with emergency landing guidance and radar vectoring |
US7885733B1 (en) | 2006-04-03 | 2011-02-08 | Honeywell International Inc. | Aviation navigational and flight management systems and methods utilizing radar vectoring |
US20080158256A1 (en) * | 2006-06-26 | 2008-07-03 | Lockheed Martin Corporation | Method and system for providing a perspective view image by intelligent fusion of a plurality of sensor data |
US8185301B1 (en) * | 2006-07-26 | 2012-05-22 | Honeywell International Inc. | Aircraft traffic awareness system and methods |
US7715978B1 (en) * | 2007-01-31 | 2010-05-11 | Rockwell Collins, Inc. | Method of positioning perspective terrain on SVS primary flight displays using terrain database and radio altitude |
US8379087B1 (en) * | 2007-05-01 | 2013-02-19 | The United States Of America As Represented By The Secretary Of The Navy | Attitude estimation using ground imagery |
US7609200B1 (en) * | 2007-05-29 | 2009-10-27 | Rockwell Collins, Inc. | Radar derived perspective display system |
US8232910B1 (en) * | 2007-08-31 | 2012-07-31 | Rockwell Collins, Inc. | RTAWS active tower hazard detection system |
US8095249B2 (en) * | 2007-09-04 | 2012-01-10 | Honeywell International Inc. | System and method for displaying a digital terrain |
US8977491B1 (en) | 2007-09-06 | 2015-03-10 | Rockwell Collins, Inc. | System and method for verifying displayed terrain information |
US7825831B2 (en) * | 2007-11-14 | 2010-11-02 | Universal Avionics Systems Corp. | Aircraft flight display with a non-linear pitch scale |
US7869943B1 (en) | 2007-12-21 | 2011-01-11 | Honeywell International Inc. | Flight management systems and methods for use with an aerial vehicle |
US8264498B1 (en) * | 2008-04-01 | 2012-09-11 | Rockwell Collins, Inc. | System, apparatus, and method for presenting a monochrome image of terrain on a head-up display unit |
US8099201B1 (en) * | 2008-08-29 | 2012-01-17 | Rockwell Collins, Inc. | Vertical profile display with enhanced temporal depiction of navigation information |
FR2935824B1 (en) * | 2008-09-09 | 2010-09-03 | Thales Sa | VISUALIZATION DEVICE FOR AIRCRAFT COMPRISING MEANS FOR DISPLAYING AIRCRAFT HAVING COLLISION RISK |
US9146132B2 (en) * | 2008-09-29 | 2015-09-29 | Honeywell International Inc. | Systems and methods for displaying images of terrain data |
US8188891B2 (en) * | 2008-10-13 | 2012-05-29 | The Boeing Company | Method and system for depicting visually predominant features on a flight display |
US8466874B1 (en) | 2009-02-10 | 2013-06-18 | Rockwell Collins, Inc. | System and method for graphical rendering of point primitives |
US8350753B2 (en) * | 2009-02-16 | 2013-01-08 | Honeywell International Inc. | Methods and systems for displaying an object having an associated beacon signal |
US8175761B2 (en) * | 2009-02-17 | 2012-05-08 | Honeywell International Inc. | System and method for rendering a synthetic perspective display of a designated object or location |
US8264379B2 (en) * | 2009-03-10 | 2012-09-11 | Honeywell International Inc. | Methods and systems for correlating data sources for vehicle displays |
US20100238165A1 (en) * | 2009-03-17 | 2010-09-23 | Harris Corporation | Geospatial modeling system for colorizing images and related methods |
US8140260B2 (en) * | 2010-02-12 | 2012-03-20 | Honeywell International Inc. | System for enhancing a vehicle operator's orientation and ability to navigate |
FR2957447B1 (en) | 2010-03-15 | 2012-10-26 | Eurocopter France | METHOD AND APPARATUS FOR FLYING WITH LOW ALTITUDE AIRCRAFT IN A SECURE MANNER |
US20110254706A1 (en) * | 2010-04-20 | 2011-10-20 | Sikorsky Aircraft Corporation | Methods and Systems Involving Viewing Angles in Aircraft Displays |
FR2960634B1 (en) * | 2010-05-27 | 2012-06-22 | Sysnav | DEVICE AND METHOD FOR DETERMINING DEPTH INFORMATION FROM AN OPTICAL SENSOR LIKELY TO BE MOVED |
US8649915B2 (en) * | 2010-05-28 | 2014-02-11 | The Clear View Group Llc | Method and apparatus to facilitate providing a synthetic view of terrain for use in a moving vehicle |
US9494447B2 (en) * | 2010-07-28 | 2016-11-15 | Honeywell International Inc. | Methods and systems for attitude differentiation in enhanced vision images |
EP2418510B1 (en) | 2010-07-30 | 2014-01-29 | EADS Deutschland GmbH | Method for evaluating the suitability of a piece of land for a landing zone or taxi surface for airplanes |
US8400330B2 (en) | 2010-09-07 | 2013-03-19 | Honeywell International Inc. | System for displaying multiple overlaid images to a pilot of an aircraft during flight |
US8493241B2 (en) | 2010-11-30 | 2013-07-23 | Honeywell International Inc. | Systems, methods and computer readable media for displaying multiple overlaid images to a pilot of an aircraft during flight |
US9037600B1 (en) | 2011-01-28 | 2015-05-19 | Yahoo! Inc. | Any-image labeling engine |
US9218364B1 (en) * | 2011-01-28 | 2015-12-22 | Yahoo! Inc. | Monitoring an any-image labeling engine |
US8825391B1 (en) | 2011-08-04 | 2014-09-02 | Google Inc. | Building elevation maps from laser data |
KR101193115B1 (en) * | 2011-10-07 | 2012-10-19 | 한국항공우주산업 주식회사 | Three dimention digital map system |
US8698654B2 (en) | 2011-12-28 | 2014-04-15 | Honeywell International Inc. | System and method for selecting images to be displayed |
US9165366B2 (en) | 2012-01-19 | 2015-10-20 | Honeywell International Inc. | System and method for detecting and displaying airport approach lights |
US20130300587A1 (en) | 2012-05-14 | 2013-11-14 | Honeywell International Inc. | System and method for displaying runway approach texture objects |
US9020876B2 (en) | 2012-06-07 | 2015-04-28 | International Business Machines Corporation | On-demand suggestion for vehicle driving |
FR3001826B1 (en) * | 2013-02-06 | 2016-05-06 | Airbus Operations Sas | METHOD FOR AIDING THE CONTROL OF AN AIRCRAFT BY DISPLAY ADAPTED FOR SYMBOLS |
US9633272B2 (en) | 2013-02-15 | 2017-04-25 | Yahoo! Inc. | Real time object scanning using a mobile phone and cloud-based visual search engine |
US9390559B2 (en) | 2013-03-12 | 2016-07-12 | Honeywell International Inc. | Aircraft flight deck displays and systems and methods for enhanced display of obstacles in a combined vision display |
FR3010516B1 (en) * | 2013-09-06 | 2015-09-25 | Thales Sa | THREE-DIMENSIONAL SYNTHETIC REPRESENTATION METHOD IN ACCORDANCE WITH FIELD MAPPING BASED ON VISIBILITY |
FR3021771B1 (en) | 2014-05-28 | 2016-06-10 | Airbus Helicopters | METHOD OF CONTRIBUTING THE SECURITY OF A SYNTHETIC GRAPHIC REPRESENTATION OF THE OUTER VIEW OF AN AIRCRAFT |
US10410531B2 (en) | 2014-11-05 | 2019-09-10 | Sierra Nevada Corporation | Systems and methods for generating improved environmental displays for vehicles |
FR3030097B1 (en) * | 2014-12-16 | 2021-04-02 | Bull Sas | DEVICE AND METHOD FOR AIDING THE PILOTING OF AN AIRCRAFT DURING A LANDING PHASE |
US9434480B2 (en) * | 2015-01-13 | 2016-09-06 | Honeywell International Inc. | Display systems and methods for generating a display providing runway illusion alleviation |
US10001376B1 (en) * | 2015-02-19 | 2018-06-19 | Rockwell Collins, Inc. | Aircraft position monitoring system and method |
WO2016149039A1 (en) * | 2015-03-17 | 2016-09-22 | Sikorsky Aircraft Corporation | Trajectory control of a vehicle |
IL239148A0 (en) * | 2015-06-02 | 2015-11-30 | Elbit Systems Ltd | Method and system for calculating and presenting terrain-clearance reachable regions |
US9582857B1 (en) * | 2015-06-30 | 2017-02-28 | Rockwell Collins, Inc. | Terrain relief shading enhancing system, device, and method |
US10308371B1 (en) | 2016-03-18 | 2019-06-04 | Rockwell Collins, Inc. | Spatially modulated and temporally sequenced multi-stream vision system |
WO2018002910A1 (en) * | 2016-06-28 | 2018-01-04 | Cognata Ltd. | Realistic 3d virtual world creation and simulation for training automated driving systems |
IL251189A0 (en) | 2017-03-15 | 2017-06-29 | Ophir Yoav | Gradual transitioning between two-dimensional and theree-dimensional augmented reality images |
US10546503B2 (en) | 2017-08-22 | 2020-01-28 | Honeywell International Inc. | Method and system for real-time validation of an operational flight path for an aircraft |
US10089894B1 (en) | 2017-08-30 | 2018-10-02 | Honeywell International Inc. | Apparatus and method of implementing an augmented reality processed terrain and obstacle threat scouting service |
CN107767451B (en) * | 2017-11-10 | 2021-08-24 | 长江三峡勘测研究院有限公司(武汉) | 3DEC complex terrain modeling method based on GOCAD grid model |
US20200357289A1 (en) * | 2018-01-25 | 2020-11-12 | Saab Ab | Method and system for updating a pilot situational awareness system |
US11359931B2 (en) * | 2018-10-11 | 2022-06-14 | Bombardier Inc. | Vision guidance systems and methods for aircraft |
US11327155B2 (en) | 2018-12-21 | 2022-05-10 | Robert Bosch Gmbh | Radar sensor misalignment detection for a vehicle |
US11348468B1 (en) | 2019-03-15 | 2022-05-31 | Rockwell Collins, Inc. | Systems and methods for inhibition of terrain awareness and warning system alerts |
EP3730901A3 (en) * | 2019-04-01 | 2020-12-30 | Bombardier Inc. | Aircraft system and method for assisting a pilot during flight |
IL267211A (en) | 2019-06-10 | 2019-08-29 | Elbit Systems Ltd | A video display system and method |
US11914053B2 (en) | 2021-01-11 | 2024-02-27 | Honeywell International Inc. | Vehicle location accuracy enhancement system |
FR3124602A1 (en) * | 2021-06-24 | 2022-12-30 | Thales | Field database validation process |
US11861865B2 (en) | 2021-12-02 | 2024-01-02 | Argo AI, LLC | Automated vehicle pose validation |
FR3132777A1 (en) * | 2022-02-11 | 2023-08-18 | Thales | Aircraft navigational aid electronic system, method and computer program therefor |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5355442A (en) * | 1992-12-16 | 1994-10-11 | Loral Aerospace Corp. | Terrain visualization by ray tracing a conical height field transformation |
US5638282A (en) * | 1992-04-07 | 1997-06-10 | Dassault Electronique | Method and device for preventing collisions with the ground for an aircraft |
US20020069019A1 (en) * | 2000-12-04 | 2002-06-06 | Ching-Fang Lin | Positioning and proximity warning method and system thereof for vehicle |
US6985091B2 (en) * | 1999-04-01 | 2006-01-10 | Chelton Flight Systems, Inc. | Electronic flight instrument displays |
US7120540B2 (en) * | 2002-12-17 | 2006-10-10 | Thales | Onboard terrain anticollision display device |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6061068A (en) * | 1998-06-30 | 2000-05-09 | Raytheon Company | Method and apparatus for providing synthetic vision using reality updated virtual image |
CA2453031A1 (en) * | 2001-07-06 | 2003-01-16 | Goodrich Avionics Systems, Inc. | System and method for synthetic vision terrain display |
US7239311B2 (en) * | 2002-09-26 | 2007-07-03 | The United States Government As Represented By The Secretary Of The Navy | Global visualization process (GVP) and system for implementing a GVP |
US7982767B2 (en) * | 2003-11-11 | 2011-07-19 | Supersonic Aerospace International, Llc | System and method for mounting sensors and cleaning sensor apertures for out-the-window displays |
US20050232512A1 (en) * | 2004-04-20 | 2005-10-20 | Max-Viz, Inc. | Neural net based processor for synthetic vision fusion |
-
2006
- 2006-01-20 US US11/336,519 patent/US7352292B2/en active Active
-
2007
- 2007-01-19 WO PCT/US2007/001625 patent/WO2008018906A2/en active Application Filing
- 2007-01-19 EP EP07835677.1A patent/EP1974331B1/en active Active
-
2008
- 2008-04-01 US US12/060,732 patent/US20090040070A1/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5638282A (en) * | 1992-04-07 | 1997-06-10 | Dassault Electronique | Method and device for preventing collisions with the ground for an aircraft |
US5355442A (en) * | 1992-12-16 | 1994-10-11 | Loral Aerospace Corp. | Terrain visualization by ray tracing a conical height field transformation |
US6985091B2 (en) * | 1999-04-01 | 2006-01-10 | Chelton Flight Systems, Inc. | Electronic flight instrument displays |
US20020069019A1 (en) * | 2000-12-04 | 2002-06-06 | Ching-Fang Lin | Positioning and proximity warning method and system thereof for vehicle |
US7120540B2 (en) * | 2002-12-17 | 2006-10-10 | Thales | Onboard terrain anticollision display device |
Cited By (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8049644B1 (en) * | 2007-04-17 | 2011-11-01 | Rcokwell Collins, Inc. | Method for TAWS depiction on SVS perspective displays |
US9939526B2 (en) | 2007-09-06 | 2018-04-10 | Rockwell Collins, Inc. | Display system and method using weather radar sensing |
US9733349B1 (en) | 2007-09-06 | 2017-08-15 | Rockwell Collins, Inc. | System for and method of radar data processing for low visibility landing applications |
US20100145610A1 (en) * | 2008-09-05 | 2010-06-10 | Thales | Viewing device for aircraft comprising radio navigation beacon display means and associated method |
US9354633B1 (en) | 2008-10-31 | 2016-05-31 | Rockwell Collins, Inc. | System and method for ground navigation |
US20100161158A1 (en) * | 2008-12-18 | 2010-06-24 | Honeywell International Inc. | Systems and methods for enhancing terrain elevation awareness |
US8477062B1 (en) * | 2009-09-29 | 2013-07-02 | Rockwell Collins, Inc. | Radar-based system, module, and method for presenting steering symbology on an aircraft display unit |
US20110095913A1 (en) * | 2009-10-26 | 2011-04-28 | L-3 Communications Avionics Systems, Inc. | System and method for displaying runways and terrain in synthetic vision systems |
WO2011053552A1 (en) * | 2009-10-26 | 2011-05-05 | L-3 Communications Avionics Systems, Inc. | System and method for displaying runways and terrain in synthetic vision systems |
US8531315B2 (en) | 2009-10-26 | 2013-09-10 | L-3 Communications Avionics Systems, Inc. | System and method for displaying runways and terrain in synthetic vision systems |
US8823555B2 (en) | 2010-06-04 | 2014-09-02 | Eads Deutschland Gmbh | Apparatus for displaying terrain on a display apparatus of an airborne vehicle |
WO2012006983A2 (en) | 2010-06-04 | 2012-01-19 | Eads Deutschland Gmbh | Apparatus for displaying terrain on a display apparatus of an airborne vehicle |
DE102010022726B4 (en) | 2010-06-04 | 2019-05-16 | Hensoldt Sensors Gmbh | Device for displaying terrain on a display device of a missile |
WO2012006983A3 (en) * | 2010-06-04 | 2012-04-19 | Eads Deutschland Gmbh | Apparatus for displaying terrain on a display apparatus of an airborne vehicle |
DE102010022726A1 (en) * | 2010-06-04 | 2011-12-08 | Eads Deutschland Gmbh | Device for displaying terrain on a display device of a missile |
US8914166B2 (en) * | 2010-08-03 | 2014-12-16 | Honeywell International Inc. | Enhanced flight vision system for enhancing approach runway signatures |
US20120035789A1 (en) * | 2010-08-03 | 2012-02-09 | Honeywell International Inc. | Enhanced flight vision system for enhancing approach runway signatures |
US20120271546A1 (en) * | 2011-04-19 | 2012-10-25 | Honeywell International Inc. | Systems and methods for navigation in a gps-denied environment |
US8457882B2 (en) * | 2011-04-19 | 2013-06-04 | Honeywell International Inc. | Systems and methods for navigation in a GPS-denied environment |
WO2013068821A2 (en) | 2011-11-09 | 2013-05-16 | Abyssal S.A. | System and method of operation for remotely operated vehicles with superimposed 3d imagery |
US8654149B2 (en) * | 2011-12-20 | 2014-02-18 | Honeywell International Inc. | System and method for displaying enhanced vision and synthetic images |
US20130155093A1 (en) * | 2011-12-20 | 2013-06-20 | Honeywell International Inc. | System and method for displaying enhanced vision and synthetic images |
US20130257852A1 (en) * | 2012-04-02 | 2013-10-03 | Honeywell International Inc. | Synthetic vision systems and methods for displaying detached objects |
US9347793B2 (en) * | 2012-04-02 | 2016-05-24 | Honeywell International Inc. | Synthetic vision systems and methods for displaying detached objects |
US9347794B1 (en) * | 2012-09-21 | 2016-05-24 | Rockwell Collins, Inc. | Image data combining systems and methods of multiple vision systems |
CN103017759A (en) * | 2012-12-22 | 2013-04-03 | 中国人民解放军第四军医大学 | Method to overcome space unorientation and delusions |
US9384586B1 (en) | 2013-04-05 | 2016-07-05 | Rockwell Collins, Inc. | Enhanced flight vision system and method with radar sensing and pilot monitoring display |
US10928510B1 (en) | 2014-09-10 | 2021-02-23 | Rockwell Collins, Inc. | System for and method of image processing for low visibility landing applications |
US10032311B1 (en) * | 2014-09-29 | 2018-07-24 | Rockwell Collins, Inc. | Synthetic image enhancing system, device, and method |
US9619935B2 (en) * | 2014-12-12 | 2017-04-11 | Thales | Method of three-dimensional representation of a scene |
CN105823475A (en) * | 2014-12-12 | 2016-08-03 | 泰勒斯公司 | Method of three-dimensional representation of a scene |
US10705201B1 (en) | 2015-08-31 | 2020-07-07 | Rockwell Collins, Inc. | Radar beam sharpening system and method |
US10228460B1 (en) | 2016-05-26 | 2019-03-12 | Rockwell Collins, Inc. | Weather radar enabled low visibility operation system and method |
US10955548B1 (en) | 2016-05-26 | 2021-03-23 | Rockwell Collins, Inc. | Weather radar enabled low visibility operation system and method |
US10353068B1 (en) | 2016-07-28 | 2019-07-16 | Rockwell Collins, Inc. | Weather radar enabled offshore operation system and method |
WO2020139469A1 (en) * | 2018-12-28 | 2020-07-02 | Intel Corporation | Real-time, three-dimensional vehicle display |
US20210004004A1 (en) * | 2019-07-05 | 2021-01-07 | Liebherr Mining Equipment Newport News Co. | Method for autonomously controlling a vehicle |
US11703859B2 (en) * | 2019-07-05 | 2023-07-18 | Liebherr Mining Equipment Newport News Co. | Method for autonomously controlling a vehicle |
Also Published As
Publication number | Publication date |
---|---|
US7352292B2 (en) | 2008-04-01 |
EP1974331A2 (en) | 2008-10-01 |
US20070171094A1 (en) | 2007-07-26 |
EP1974331B1 (en) | 2019-06-19 |
EP1974331A4 (en) | 2016-03-23 |
WO2008018906A2 (en) | 2008-02-14 |
WO2008018906A3 (en) | 2008-06-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7352292B2 (en) | Real-time, three-dimensional synthetic vision display of sensor-validated terrain data | |
US8296056B2 (en) | Enhanced vision system for precision navigation in low visibility or global positioning system (GPS) denied conditions | |
EP2413101B1 (en) | Method and system for attitude differentiation in enhanced vision images of an aircraft cockpit display | |
EP2228626B1 (en) | Method and system for correlating data sources for on-board vehicle displays | |
US9384586B1 (en) | Enhanced flight vision system and method with radar sensing and pilot monitoring display | |
US20100113149A1 (en) | Methods and systems for displaying sensor-based images of an external environment | |
US20140285661A1 (en) | Methods and systems for colorizing an enhanced image during alert | |
EP2101155A1 (en) | Method and apparatus for displaying flight path information in rotocraft | |
US8188890B2 (en) | Systems and methods for enhancing obstacles and terrain profile awareness | |
EP3438614B1 (en) | Aircraft systems and methods for adjusting a displayed sensor image field of view | |
US9558674B2 (en) | Aircraft systems and methods to display enhanced runway lighting | |
EP1896798A1 (en) | System for enhancing computer-generated images of terrain on aircraft displays | |
EP2037216B1 (en) | System and method for displaying a digital terrain | |
US10304242B1 (en) | Transparent display terrain representation systems and methods | |
US11112249B1 (en) | Systems and methods for four-dimensional routing around concave polygon avoidances | |
CN107591031B (en) | Method for automatically adjusting the visible range in a three-dimensional composite representation of an external landscape | |
US8170789B2 (en) | Method for providing search area coverage information | |
US7907132B1 (en) | Egocentric display | |
Bailey et al. | Aspects of synthetic vision display systems and the best practices of the NASA's SVS project | |
US10559212B1 (en) | Systems and methods for actionable avionics event-based communications | |
CN114510146A (en) | System and method for augmented reality visualization based on sensor data | |
O'Brien et al. | Helicopter synthetic vision based DVE processing for all phases of flight |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: HONEYWELL INTERNATIONAL INC., NEW JERSEY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MERCURY COMPUTER SYSTEMS INC.;REEL/FRAME:021051/0039 Effective date: 20080501 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: SILICON VALLEY BANK,CALIFORNIA Free format text: SECURITY AGREEMENT;ASSIGNOR:MERCURY COMPUTER SYSTEMS, INC.;REEL/FRAME:023963/0227 Effective date: 20100212 Owner name: SILICON VALLEY BANK, CALIFORNIA Free format text: SECURITY AGREEMENT;ASSIGNOR:MERCURY COMPUTER SYSTEMS, INC.;REEL/FRAME:023963/0227 Effective date: 20100212 |
|
AS | Assignment |
Owner name: MERCURY COMPUTER SYSTEMS, INC., MASSACHUSETTS Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:SILICON VALLEY BANK;REEL/FRAME:029119/0355 Effective date: 20121012 |