Obstacle detection system providing context awareness

Patent metadata

Field	Value
Publication number	US-9472109-B2
Application number	US-201414149482-A
Country	US
Kind code	B2
Filing date	Jan 7, 2014
Priority date	Jan 7, 2014
Publication date	Oct 18, 2016
Grant date	Oct 18, 2016

Abstract

In sonic examples, an obstacle detection system is configured to generate and display a graphical user interface (GUI) that includes an overhead image of an area in which a vehicle is positioned, a graphical representation of the vehicle, and graphical representations of one or more obstacles, The graphical representations of the one or more obstacles and vehicle can be arranged relative to the overhead image to indicate determined real-world positions of the one or more obstacles and vehicle, respectively, relative to other features shown in the overhead (e.g., airport structure or other buildings).

First claim

What is claimed is:

1. A method comprising:
determining, by a processor, a location of at least one obstacle proximate an aircraft;
determining, by the processor, a location of the aircraft;
generating, by the processor, a graphical user interface based on the location of the at least one obstacle and the location of the aircraft, the graphical user interface comprising a graphical representation of the aircraft and a graphical representation of the at least one obstacle overlaid on an overhead image of an area in which the aircraft and the at least one obstacle are positioned, wherein the overhead image is an image of a real-world environment in which the aircraft is positioned, and wherein generating the graphical user interface comprises spatially registering, by the processor, the graphical representation of the aircraft and the graphical representation of the at least one obstacle with the overhead image to indicate a position of the aircraft and the at least one obstacle relative to a feature shown in the overhead image; and
displaying, by the processor, the graphical user interface via a display device on the aircraft or on a device external to the aircraft.

2. The method of claim 1 , wherein determining the location of the at least one obstacle comprises receiving, by the processor, sensor data indicative of the location of the at least one obstacle, and wherein spatially registering the graphical representation of the aircraft and the graphical representation of the at least one obstacle with the overhead image comprises geo-registering the graphical representation of the at least one obstacle to a portion of the overhead image based on the sensor data.

3. The method of claim 2 , wherein receiving sensor data indicative of the location of at least one obstacle comprises receiving at least one of Global Positioning System (GPS) sensor data, radar sensor data, or data from a camera.

4. The method of claim 1 , wherein determining the location of the aircraft comprises receiving, by the processor, sensor data indicative of the location of the aircraft, and wherein spatially registering the graphical representation of the aircraft and the graphical representation of the at least one obstacle with the overhead image comprises geo-registering the graphical representation of the aircraft to a portion of the overhead image based on the sensor data indicative of the location of the portion of the aircraft.

5. The method of claim 4 , wherein the sensor data indicates the location of each of a plurality of different portions of the aircraft, and wherein geo-registering the graphical representation of the aircraft to the portion of the overhead image comprises geo-registering each portion of the plurality of different portions of the aircraft to respective portions of the overhead image based on the sensor data.

6. The method of claim 4 , wherein receiving sensor data indicative of the location the aircraft comprises receiving at least one of Global Positioning System (GPS) sensor data or an inertial navigation system of the aircraft.

7. The method of claim 1 , wherein the overhead image comprises a satellite image.

8. The method of claim 1 , further comprising receiving, by the processor, sensor data indicative of a location of a user, wherein generating the graphical user interface comprises generating, based on the sensor data, the graphical user interface comprising a graphical representation of the user on the overhead image.

9. The method of claim 1 , further comprising:
determining, by processor, a threat level of the at least one obstacle based on the location of the at least one obstacle; and
generating, by the processor, the graphical representation of the at least one obstacle to include a characteristic that represents the determined threat level of the at least one of the at least one obstacle or the area of unknown.

10. The method of claim 1 , wherein determining the location of the at least one obstacle comprises receiving, by the processor, sensor data indicative of the location of the at least one obstacle or the aircraft, wherein spatially registering the graphical representation of the aircraft and the graphical representation of the at least one obstacle with the overhead image comprises:
determining global coordinates of at least a portion of the aircraft or the at least one obstacle based on the sensor data;
determining global coordinates of two or more reference points in the overhead image or a coordinate system of the overhead image; and
mapping the graphical representation of the aircraft or the graphical representation of the at least one obstacle to the overhead image by at least matching up the global coordinates of a respective one of the aircraft or the at least one obstacle to the overhead image based on the determined global coordinates of the two or more reference points in the overhead image or the coordinate system of the overhead image.

11. An aircraft system comprising:
a display; and
a processor configured to determine a location of at least one obstacle proximate an aircraft, determine a location of the aircraft, generate a graphical user interface based on the location of the at least one obstacle and the location of the aircraft, and display the graphical user interface via the display, the graphical user interface comprising a graphical representation of the aircraft and a graphical representation of the at least one obstacle overlaid on an overhead image of area in which the aircraft and the at least one obstacle are positioned, wherein the overhead image is an image of a real-world environment in which the aircraft is positioned, and wherein the processor is configured to generate the graphical user interface by at least spatially registering the graphical representation of the aircraft and the graphical representation of the at least one obstacle with the overhead image to indicate a position of the aircraft and the at least one obstacle relative to a feature shown in the overhead image.

12. The aircraft system of claim 11 , further comprising at least one sensor configured to generate sensor data indicative of the location of the at least one obstacle, wherein the processor is configured to determine the location of the at least one obstacle based on the sensor data, and spatially register the graphical representation of the aircraft and the graphical representation of the at least one obstacle with the overhead image by at least geo-registering the graphical representation of the at least one obstacle to a portion of the overhead image based on the sensor data.

13. The aircraft system of claim 12 , wherein e at least one sensor comprises at least one of a Global Positioning System (GPS) sensor, a radar sensor, or a camera.

14. The aircraft system of claim 11 , further comprising at least one sensor configured to generate sensor data indicative of the location of the aircraft, and wherein the processor is configured to determine the location of the aircraft based on the sensor data, and spatially register the graphical representation of the aircraft and the graphical representation of the at least one obstacle with the overhead image by at least geo-registering the graphical representation of the aircraft to a portion of the overhead image based on the sensor data indicative of the location of the portion of the aircraft.

15. The aircraft system of claim 14 , wherein the sensor data indicates the location of each of a plurality of different portions of the aircraft, and wherein the processor is configured to geo-register the graphical representation of the aircraft to the portion

Assignees

• Honeywell Int Inc

Inventors

• Starr Jeffrey W
• Lamkin Andrew F
• Buster Duke

Classifications

• G01S13/934

  on airport surfaces, e.g. while taxiing · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G08G5/70

  Arrangements for monitoring traffic-related situations or conditions · CPC title

• G08G5/51

  for control when on the ground, e.g. taxiing or rolling · CPC title

• G08G5/20 Primary

  Arrangements for acquiring, generating, sharing or displaying traffic information (arrangements for monitoring traffic G08G5/72) · CPC title