WO2006087709A1

WO2006087709A1 - Personal navigation system

Info

Publication number: WO2006087709A1
Application number: PCT/IL2006/000195
Authority: WO
Inventors: Zvi Lapidot; Abraham Aharoni
Original assignee: Lumus Ltd.
Priority date: 2005-02-17
Filing date: 2006-02-15
Publication date: 2006-08-24
Also published as: EP1848966A1; US8140197B2; US20120179369A1; US20090112469A1; US8301319B2

Abstract

There is provided a personal navigation system, including a head-mounted orientatio sensor, a coordinate position sensor, a head-mounted display, and a processor receiving a input from the head-mounted orientation sensor and an input from the coordinate positio sensor and providing a visually sensible output for displaying on the head-mounted display.

Description

PERSONAL NAVIGATION SYSTEM Field of the Invention

The present invention relates to navigation systems generally and more particularly to visual navigational aids. Specifically, the present invention is concerned with personal aviation navigation systems. Background of the Invention

The following U.S. Patents are believed to represent the current state of the art: 6,809,724; 6,798,391; 6,771,423; 6,757,068; 6,747,611; 6,727,865; 6,681,629; 6,661,438; 6,608,884; 6,563,648; 6,559,872; 6,474,159; 6,408,257; 6,384,982; 6,380,923; 6,359,609; 6,356,392; 6,353,503; 6,304,303; 6,222,677; 6,204,974; 6,157,533; 6,140,981 ; 6,127,990; 6,108,197; 6,094,242; 6,057,966; 6,050,717; 5,886,822; 5,880,773; 5,844,656; 5,798,733; 5,764,280; 5,581,492 and 5,757,339.

The following patent publications are also believed to be of interest:

Published PCT Applications: WO04015369; WO02086590; WO0180736; WO0156007; WOOl 16929; WO0109636; WO0023815; WO0010156; WO9733270; WO9725646; WO9637798; WO9636898; WO9607947; WO9605532; ^"WO9600406; WO9521395; WO9510106; WO9510061; WO9424658; WO9414152; WO9411855; WO9407161 and WO9301683.

Foreign Patent Publications: EP1310859; EP1280457; EP1267197; EP1248180; EP1223729; EP1220080; EP1185142; EP1176449; EP1135765; EP1042698; EP1022644; EP0935183; EP0904560; EP0902312; EP0889346; EP0825470; EP0802440; EP0775327; -EP07-72-7-90_T-EP-07-7-14-33-; EE0224.75S; EP_Q221614;. EP0716329; EP0694196; EP0670537; EP0672286; EP0627644; EP0592591 and EP0344881. Summary of the Invention

The present invention relates to a personal navigation system including a head- mounted orientation sensor, a coordinate position sensor, a head-mounted display and a processor receiving an input from the head-mounted orientation sensor and an input from the coordinate position sensor and providing a visually sensible output for displaying on the head-mounted display.

Preferably, the display is at least partially transparent. Additionally or alternatively, the coordinate position sensor is a portable coordinate position sensor. Additionally, the portable coordinate position sensor includes at least one of a user-worn sensor and a user- carried sensor.

Preferably, the processor does not receive any inputs from navigational instrumentation of an aircraft. Alternatively, the processor receives input from a coordinate position sensor onboard a carrier vehicle such as an aircraft, in addition to the inputs from the coordinate position sensor.

Preferably, the processor is a portable processor. Additionally or alternatively, the portable processor includes at least one of a user-worn processor and a user-carried processor.

Preferably, the coordinate position sensor includes a GPS receiver. Additionally or alternatively, the personal aviation system is mounted onto a headset.

Preferably, the head-mounted orientation sensor includes an inertial sensor.

Preferably, the processor and the display provide location indication functionality. Additionally, the location indication functionality includes landing strip designation functionality.

Alternatively or additionally, the processor and the display provide approaching aircraft warning and designation functionality. Additionally, the approaching aircraft warning and designation functionality includes an audio warning. Additionally, the approaching aircraft warning and designation functionality includes a visual warning. Additionally, the visual warning includes a flashing visual warning.

-Preferabh^-t-he-pi-Qcessoi-and-the-dispJay-provide airport approach path designation functionality. Additionally or alternatively, the processor and the display provide temporary flight restriction zone designation functionality. Additionally or alternatively, the processor and the display provide user head turning direction designation functionality.

Preferably, the head-mounted display is operative to display visually sensible navigation outputs overlaid on a view of a scene, which is seen through the head-mounted display. Additionally or alternatively, the head-mounted display is operative to display a visual symbol, which can be used to designate a location on the ground in the line-of-sight of a pilot, and thereby identify the designated location. Brief Description of the Drawings

The invention will now be described in connection with certain preferred embodiments with reference to the following illustrative figures so that it may be more fully understood.

With specific reference now to the figures in detail, it is stressed that the particulars shown are by way of example and for purpose of illustrative discussion of the preferred embodiments of the present invention only and are presented in the cause of providing what is believed to be the most useful and readily understood description of the principles and conceptual aspects of the invention. In this regard, no attempt is made to show structural details of the invention in more detail than is necessary for a fundamental understanding of the invention, the description taken with the drawings making apparent to those skilled in the art how the several forms of the invention may be embodied in practice.

In the drawings:

Figs. IA and IB are illustrations of a user-carried personal aviation navigation and orientation system, constructed and operative in accordance with a preferred embodiment of the present invention;

Figs. 2A and 2B are illustrations of an application of the personal aviation navigation and orientation system of Fig. 1, constructed and operative in accordance with a preferred embodiment of the present invention, shown in two alternative operative orientations;

Figs. 3A and 3B are illustrations of another application of the personal aviation navigation and orientation system of Figs. IA and IB, constructed and operative in -ac.C-ordaac_e_mth_a preferred embodiment of the present invention, shown in two alternative operative orientations;

Figs. 4A and 4B are illustrations of yet another application of the personal aviation navigation and orientation system of Figs. IA and IB, constructed and operative in accordance with a preferred embodiment of the present invention, shown in two alternative operative orientations; and

Figs. 5A and 5B pictorial illustrations of yet another application of the personal aviation navigation and orientation system of Figs. IA and IB, constructed and operative in accordance with a preferred embodiment of the present invention, shown in two alternative operative orientations.

Detailed Description of the Preferred Embodiments

Reference is made to Figs. IA and IB₅ which are pictorial illustrations of a preferred embodiment of a user carrying and using a personal navigation and orientation system 100, e.g., a personal aviation navigation and orientation system. For further understanding, the following description will specifically relate to aviation navigation, which merely constitutes a non-limiting example of the most common use of the subject navigational system, which is also utilizable on land and at sea. The personal aviation navigation and orientation system 100 is mountable on a user's head and preferably comprises a head position and orientation sensor 102 and a display 104, which displays visually sensible navigation outputs overlaid or superimposed on a view of a scene 105, seen through display 104. The orientation sensor 102 is firmly mounted onto the display 104, thereby allowing the user to readjust the personal aviation navigation and orientation system 100 on the head, while maintaining the accuracy of orientation sensor measurement of the line-of-sight through the display to the desired location.

The display 104 may additionally display flight information, such as a Primary Flight Display including artificial horizon, air speed and height, as well as secondary information including squawk frequency, airfield data and the like. Additionally, the personal aviation navigation and orientation system 100 may have access to database information, such as the locations of airstrips and landing procedures for each, as well as major landscape waypoints, such that identification information may be generated for display on display 104. Moreover, -the-svstem-l-QO-is-preferably_connected to a collision avoidance system (not shown), such as a Traffic Collision Avoidance System (TCAS)₅ for generating information relating to a possible collision situation. The system may further be connected to an active information system (not shown) capable of dynamically generating information concerning Temporaiy Flight Restriction (TFR) zones in close proximity to the aircraft.

The visually sensible navigation outputs displayed on display 104 are provided by a processor 106, preferably a portable processor, which is advantageously head mounted, but may alternatively be earned or worn by the user. The processor 106 receives a head orientation output from sensor 102 and also receives a user location input from a coordinate position sensor 108, such as a GPS receiver. Coordinate position sensor 108 is preferably a portable coordinate position sensor, such as a head-mounted, user-carried or worn, GPS receiver. Alternatively or additionally, personal aviation navigation and orientation system 100 may receive user location input from an onboard aircraft coordinate position sensor.

It is a particular feature of the present invention that the visually sensible navigation outputs displayed on display 104 do not require any interface with the navigation or other instrumentation of an aircraft, thus substantially simplifying the design of system 100, alleviating the need for installation expertise and certification, and thereby lowering its cost. It is appreciated, however, that where user location inputs from aircraft-installed instrumentation are available, this data can additionally or alternatively be obtained through an interface to the aircraft-installed instrumentation.

In accordance with a preferred embodiment of the present invention, the personal aviation navigation and orientation system 100 is mounted onto a conventional pilot's headset 110. The sensor 102 is preferably a commercially available inertial sensor, such as an InertiaCube, commercially available from Intersense Inc. of Bedford, Massachusetts, U.S.A. The display 104 is preferably an at least partially transparent display, and the processor generated visually sensible navigation outputs are superimposed over an external view seen by the user. The display is preferably a display of the type described in any of the following published patent documents of the applicant/assignee, the disclosures of which are hereby incorporated by reference: U.S. Patent No. 6,829,095, European Patent Numbers EP1485747A1 and EP 1295163 A2 and Published PCT Application Numbers

Alternatively, display 104 may be opaque, and personal aviation navigation and orientation system 100 may be operative to generate a display of an external scene 105 that would be seen by the user with the visually sensible navigation outputs superimposed thereupon.

The processor 106 is preferably a commercially available microcontroller and is operative to combine the inputs of sensor 102 and of coordinate position sensor 108 and to provide visually sensible navigation indications, having the functionality described hereinbelow with reference to Figs. 2 A to 5B. It is noted that although in the illustrated embodiment_., the processor 106 is shown to communicate via a wired communication link with coordinate position sensor 108 communication between processor 106 and coordinate position sensor 108 may be via a wireless communication link. It is further noted that although in the illustrated embodiment processor 106 and coordinate position sensor 108 are shown as individual components, processor 106 and coordinate position sensor 108 may be incorporated into a single component which may be either head mounted or user carried or worn.

Referring to Figs. 2A and 2B, in the illustrated embodiment, the processor 106 is operative to generate a location indicator symbol, such as crosshairs or frames, designated by reference numeral 112, to coincide with the line-of-sight of the user to a desired location and thereby indicate a desired location, such as a landing strip 114. Fig. 2A shows what the user sees when the desired location is positioned within the field-of-view of the display 104. When the desired location is outside the field-of-view of the display 104, as illustrated in Fig. 2B, suitable symbols or text, such as an arrow, designated by reference numeral 116, is generated on display 104 indicating the direction in which the user should turn his head in order to see the desired location, here indicated by crosshairs 112 in phantom lines. In addition to the symbolic indication of the location of the desired position, a suitable label such as the name and/or ground coordinates location of the position, may also be displayed on display 104.

In addition to the mode of operation described above, personal aviation navigation and orientation system 100 of Fig. 1 may also be operative in a locate mode. In this mode, -the-sy-stem-is-Qperative_to_provide information concerning a user-designated location. In this mode of operation, processor 106 is operative to generate a location indicator symbol, such as crosshairs 112, at the center of display 104. The user then moves his head to overlay the line-of-sight of the location indicator symbol over a desired location on the ground, and activates processor 106 to identify this location. Processor 106 uses the coordinates of the coordinate position sensor 108 and the orientation sensor 102 to calculate the location to which the user is pointing and provides to the user the information on the location to which he has pointed to.

It is noted that system 100 is preferably calibrated automatically by correlating the time-evolved measurements of the coordinate position sensor 108 and the measurements obtained by the head-mounted orientation sensor 102. Alternatively, the system 100 may be calibrated manually by entering a calibration mode upon startup. In the calibration mode, similar to the locate mode described above, a location indicator symbol is positioned at the center of display 104. The user then positions the location indicator symbol, preferably by turning his head, at at least one, and preferably three or more, distant, preprogrammed locations spread over a wide azimuthal range, approving each location as it is acquired by processor 106. The system processor 106 can then analyze the data to average out measurement eiτors and provide a baseline orientation for orientation sensor 102. Performing such a calibration within the cockpit of the plane can serve to alleviate any potential interference in the measurement of orientation sensor 102 as a result of magnetic effects due to the plane's structural metal components.

Reference is now made to Figs. 3A and 3B, which are simplified pictorial illustrations of another application of the personal aviation navigation and orientation system 100 of Fig. 1, constructed and operative in accordance with a preferred embodiment of the present invention, shown in two alternative operative orientations. In the illustrated embodiment, the processor 106 is operative to generate a location indicator, such as a series of symbols, designated by reference numeral 118, to indicate a Temporary Flight Restriction (TFR) zone boundary. Fig. 3 A shows what the user sees on display 104 when the TFR zone boundary is positioned within the field-of-view of the display 104. When the desired TFR zone boundary is outside the field-of-view of the display 104, as illustrated in Fig. 3B, -suitable-symbols— or— text._such as an arrow, designated by reference numeral 120, is generated on display 104 indicating to the direction in which the user should turn his head in order to see the boundary of the TFR zone, here indicated by a series of symbols 118 shown in phantom. In addition to the symbolic indication of the TFR zone, a suitable label such as the name and/or ground the name and or coordinate location of the TFR zone and other information, such as its validity times, may also be displayed on display 104.

Reference is now made to Figs. 4A and 4B, which are simplified pictorial illustrations of yet another application of the personal aviation navigation and orientation system 100 of Fig. 1, constructed and operative in accordance with yet another preferred embodiment of the present invention, shown in two alternative operative orientations. In the illustrated embodiment, the processor 106 is operative to generate a location indicator symbol, such as a pair of chevrons, designated by reference numeral 122, to indicate an approaching aircraft on display 104 and a potentially dangerous collision situation. Fig. 4A shows what the user sees on display 104 when the approaching aircraft is positioned within the field-of-view of the display 104. When the approaching aircraft is outside the field-of- view of the display 104, as illustrated in Fig. 4B, suitable symbols or text, such as an arrow, designated by reference numeral 124, is generated on display 104 indicating the direction in which the user should turn his head in order to see the approaching aircraft, here indicated by chevrons 122 shown in phantom. Typically, audio and other visual warnings, such as flashing symbols 126 may also be provided to alert the user to the potential danger of an approaching aircraft. In addition to the symbolic indication of the approaching aircraft, a suitable label, such as the name and or communication channels relevant to the approaching aircraft can also be displayed on display 104.

Reference is now made to Figs. 5A and 5B, which are simplified pictorial illustrations of still another application of the personal aviation navigation and orientation system 100 of Fig. 1, constructed and operative in accordance with a preferred embodiment of the present invention, shown in two alternative operative orientations. In the illustrated embodiment, the processor 106 is operative to generate a location indicator symbol, such as a series of converging rectangular frames, designated by reference numeral 130, to indicate a landing approach path to an airport. Fig. 5 A shows what the user sees on display 104 when -the-dinection of the approach path is positioned within the field-of-view of the display 104. When the direction of the approach path is outside the field-of-view of the display 104, as illustrated in Fig. 5B, suitable symbols or text, such as an arrow, designated by reference numeral 132, is generated on display 104 indicating the direction in which the user should turn his head in order to see the approach path, here indicated by frames 130 shown in phantom. In addition to the symbolic indication of the approach, the name, calling frequencies and other relevant information may also be displayed on display 104.

It is noted that although the examples brought hereinabove are oriented towards pilots, the present invention could be equally useful for other functional operators in airborne applications, such as equipment operators, gunners and the like, as well as users of other navigational applications such as found in sailing, coordinated operations in safety and military applications, and audio-visual personal guides.

It is also noted that in the system of the present invention the position of the aircraft is received from coordinate position sensor measurements, while the orientation of the user's line-of-sight is measured at the user's head. Alternatively, the coordinate position measurements may be combined with an input from Wide Area Augmentation System (WAAS) to provide for improved height measurement accuracy compared to standard GPS measurements. Alternatively or additionally, the coordinate position sensor measurements may be combined with data from a Pitot tube of the aircraft for improved height data, or coordinate position measurements may be received from instruments within the aircraft. Additionally, as a consequence of the large distance to the points of interest, the effect of possible separation between the location of the coordinate position sensor 108 and the orientation sensor 102 is negligible. In other cases, where the separation of the orientation sensor 102 and the coordinate positioning sensor 108 is significant, it can be accounted for or measured by introducing additional sensors.

It is further noted that the system of the present invention a user may enter a series of waypoints to assist in navigation along a planned route. The waypoints can be given names and can be called up in sequence onto display 104 to assist navigation. Navigation may also be assisted by use of database information, such as displaying the location of the nearest possible landing strip in a case of emergency landing.

-It-w-ill-be-app.re.ciate_dJ)v_ persons skilled in_the_art that the present invention is not limited by what has been particularly shown and described hereinabove. Rather the scope of the present invention includes both combinations and sub-combinations of the various features described hereinabove as well as modifications thereof which would occur to a person of ordinaiy skill in the art upon reading the foregoing description, and which are not in the prior art.

Claims

WHAT IS CLAIMED IS:

1. A personal navigation system, comprising: a head-mounted orientation sensor; a coordinate position sensor; a head-mounted display, and a processor receiving an input from said head-mounted orientation sensor and an input from said coordinate position sensor and providing a visually sensible output for displaying on said head-mounted display.

2. The personal navigation system according to claim 1, wherein said display is an at least partially transparent display.

3. The personal navigation system according to claim 1, wherein said coordinate position sensor is a portable coordinate position sensor.

4. The personal navigation system according to claim 3, wherein said portable coordinate position sensor includes at least one of a user-worn sensor and a user-carried sensor.

5. The personal navigation system according to claim 1, wherein said processor operates autonomously from any inputs from navigational instrumentation of a carrier vehicle.

6. The personal navigation system according to claim 1, wherein said coordinate position sensor is an onboard carrier vehicle coordinate position sensor.

7. The personal navigation system according to claim 6, wherein said carrier vehicle is an aircraft and said system is an aviation navigation system.

8. The personal navigation system according to claim 1, whereirr^~satd^~pro^~cessOr- comprises a portable processor.

9. The personal navigation system according to claim 8, wherein said portable processor comprises at least one of a user- worn processor and a user carried processor.

10. The personal navigation system according to claim 1, wherein said coordinate position sensor comprises a GPS receiver.

11. The personal navigation system according to claim I₅ wherein said personal system is coupled with a headset.

12. The personal navigation system according claim 1, wherein said head-mounted orientation sensor comprises an inertial sensor.

13. The personal navigation system according to claim 1, wherein said processor and said display provide location indication functionality.

14. The personal navigation system according to claim 13, wherein said location indication functionality comprises landing strip designation functionality.

15. The personal navigation system according to claim 1, wherein said processor and said display provide approaching vehicle warning and designation functionality.

16. The personal navigation system according to claim 15, wherein said approaching vehicle warning and designation functionality comprises an audio warning.

17. The personal navigation system according to claim 15, wherein said approaching vehicle warning and designation functionality comprises a visual warning.

18. The personal navigation system according to claim 17, wherein said visual warning comprises a flashing visual warning.

19. The personal navigation system according to claim 1, wherein said processor and said display provide airport approach path designation functionality.

20. The personal navigation system according to claim 1, wherein said processor and said display provide temporary flight restriction zone designation functionality.

21. The personal navigation system according to claim 1, wherein said processor and said display provide user head-tuming direction designation functionality.

22. The personal navigation system according to claim 1, wherein said head-mounted display is operative to display visually sensible navigation outputs superimposed on a view -α£a-scene^s£en.through said head mounted display.

23. The personal navigation system according to claim 1, wherein said head-mounted display is operative to display a visual symbol utilizable to designate a location on the ground in the line-of-sight of a pilot, for identifying a designated location.

24. The personal navigation system according to claim 11, wherein said head-mounted display is configured to be located in front of an eye of a user.