Aircraft visual sensor system

Patent metadata

Field	Value
Publication number	US-10243647-B2
Application number	US-201715608968-A
Country	US
Kind code	B2
Filing date	May 30, 2017
Priority date	May 30, 2017
Publication date	Mar 26, 2019
Grant date	Mar 26, 2019

Abstract

In one embodiment, an apparatus comprises a processing device configured to: obtain sensor data from one or more sensors associated with an aircraft, wherein the one or more sensors are configured to detect information associated with an operating environment of the aircraft; detect an object near the aircraft based on the sensor data; obtain a camera feed from a camera associated with the aircraft, wherein the camera feed comprises a camera view of at least a portion of the aircraft; generate a display output based on the camera feed and the sensor data, wherein the display output comprises a visual perspective of the object relative to the aircraft; and cause the display output to be displayed on a display device.

First claim

What is claimed is:

1. An apparatus, comprising:
a processing device configured to:
obtain sensor data from one or more sensors associated with a rotorcraft, wherein the one or more sensors are configured to detect information associated with an operating environment of the rotorcraft;
detect an object near the rotorcraft based on the sensor data;
obtain a camera feed from a camera associated with the rotorcraft, wherein the camera feed comprises a camera view of at least a portion of the rotorcraft;
generate a display output based on the camera feed and the sensor data, wherein the display output comprises a visual perspective of the object relative to the rotorcraft;
cause the display output to be displayed on a display device;
determine a physical characteristic of the object based on the sensor data; and
automatically adjust operation of the rotorcraft based on the determined physical characteristic of the object.

2. The apparatus of claim 1 , wherein the processing device is further configured to determine a location of the object relative to the rotorcraft based on the sensor data.

3. The apparatus of claim 2 , wherein the processing device configured to generate the display output based on the camera feed and the sensor data is further configured to:
determine, based on the location of the object relative to the rotorcraft as indicated by the sensor data, that the object is outside the camera view; and
generate a visual representation of the object on the display view based on the location of the object relative to the rotorcraft.

4. The apparatus of claim 1 , wherein the processing device is further configured to determine a size of the object based on the sensor data.

5. The apparatus of claim 1 , wherein the processing device is further configured to determine a type of the object based on the sensor data.

6. The apparatus of claim 5 :
wherein the one or more sensors comprises a plurality of sensors associated with a plurality of sensor technologies; and
wherein the processing device configured to determine the type of the object based on the sensor data is further configured to determine the type of the object based on the sensor data from the plurality of sensor technologies.

7. The apparatus of claim 6 , wherein the plurality of sensors comprises:
a distance sensor configured to detect a distance of the object from the rotorcraft;
an optical sensor configured to detect one or more visual attributes of the object; and
a thermal sensor configured to detect heat emitted from the object.

8. The apparatus of claim 1 , wherein the processing device configured to detect the object near the rotorcraft based on the sensor data is further configured to detect the object near a rotor of the rotorcraft.

9. The apparatus of claim 8 , wherein the rotor comprises a tail rotor, and wherein the processing device is further configured to cause the tail rotor to generate a thrust towards the object.

10. The apparatus of claim 1 , wherein the processing device is further configured to trigger a warning to indicate that the object is detected near the rotorcraft.

11. The apparatus of claim 10 , wherein the warning comprises an audible notification.

12. The apparatus of claim 10 , wherein the warning comprises a visual notification.

13. The apparatus of claim 10 , wherein the warning comprises a vibration in a component of the rotorcraft.

14. The apparatus of claim 10 , wherein the processing device is further configured to deploy a safety barrier between the rotorcraft and the object.

15. The apparatus of claim 1 , wherein the processing device is further configured to adjust a flight path of the rotorcraft based on the object detected near the rotorcraft.

16. A non-transitory machine accessible storage medium having instructions stored thereon, wherein the instructions, when executed on a machine, cause the machine to:
obtain sensor data from one or more sensors associated with a rotorcraft, wherein the one or more sensors are configured to detect information associated with an operating environment of the rotorcraft;
detect an object near the rotorcraft based on the sensor data;
obtain a camera feed from a camera associated with the rotorcraft, wherein the camera feed comprises a camera view of at least a portion of the rotorcraft;
generate a display output based on the camera feed and the sensor data, wherein the display output comprises a visual perspective of the object relative to the rotorcraft;
cause the display output to be displayed on a display device;
determine a physical characteristic of the object based on the sensor data; and
automatically adjust operation of the rotorcraft based on the determined physical characteristic of the object.

17. The storage medium of claim 16 , wherein the instructions further cause the machine to determine a location of the object relative to the rotorcraft based on the sensor data.

18. The storage medium of claim 17 , wherein the instructions that cause the machine to generate the display output based on the camera feed and the sensor data further cause the machine to:
determine, based on the location of the object relative to the rotorcraft as indicated by the sensor data, that the object is outside the camera view; and
generate a visual representation of the object on the display view based on the location of the object relative to the rotorcraft.

19. The storage medium of claim 16 , wherein the instructions further cause the machine to determine a type of the object based on the sensor data.

20. The storage medium of claim 19 :
wherein the one or more sensors comprises a plurality of sensors associated with a plurality of sensor technologies; and
wherein the instructions that cause the machine to determine the type of the object based on the sensor data further cause the machine to determine the type of the object based on the sensor data from the plurality of sensor technologies.

21. The storage medium of claim 20 , wherein the plurality of sensors comprises:
a distance sensor configured to detect a distance of the object from the rotorcraft;
an optical sensor configured to detect one or more visual attributes of the object; and
a thermal sensor configured to detect heat emitted from the object.

22. The storage medium of claim 16 , wherein the instructions that cause the machine to detect the object near the rotorcraft based on the sensor data further cause the machine to detect the object near a rotor of the rotorcraft.

23. The storage medium of claim 16 , wherein the instructions further cause the machine to adjust a flight path of the rotorcraft based on the object detected near the rotorcraft.

24. A method, comprising:
obtaining sensor data from one or more sensors associated with an rotorcraft a rotorcraft, wherein the one or more sensors are configured to detect information associated with an operating environment of the rotorcraft;
detecting an object near the rotorcraft based on the sensor data;
obtaining a camera feed from a camera associated with the rotorcraft, wherein the camera feed comprises a camera view of at least a portion of the rotorcraft;
generating a display output based on the camera feed and the sensor data, wherein the display output comprises a visual perspective of the object relative to the rotorcraft;
causing the display output to be displayed on a display device;
determining a physical characteristic of the object b

Assignees

• Bell Helicopter Textron Inc

Inventors

• Ryan Michael John
• Drennan Joseph Scott

Classifications

• G08B5/00

  Visible signalling systems, e.g. visible personal calling systems or remote indication of seats occupied · CPC title

• H04N2201/0087

  Image storage device · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• H04N2201/0089

  Image display device · CPC title

• H04B7/18506 Primary

  Communications with or from aircraft, i.e. aeronautical mobile service · CPC title