Drone systems for pre-trip inspection and assisted backing

Patent metadata

Field	Value
Publication number	US-2016129999-A1
Application number	US-201414536446-A
Country	US
Kind code	A1
Filing date	Nov 7, 2014
Priority date	Nov 7, 2014
Publication date	May 12, 2016
Grant date	—

Abstract

Embodiments relate to using a UAV for assisting drivers of large wheeled vehicles when backing up in reverse and for conducting pre-trip inspections of the wheeled vehicle prior to driving. The UAV can be a multirotor copter using simultaneous localization and mapping technology to maneuver autonomously. Alternatively, the driver of the wheeled vehicle may use remote control to maneuver the UAV.

First claim

1 . A backup system for a wheeled vehicle, comprising:
a wheeled vehicle comprising a cab; an unmanned aerial vehicle comprising a camera; a controller configured to communicate to and from the unmanned aerial vehicle while in flight; a human machine interface within the cab, wherein the human machine interface is configured to communicate with the controller, and an electronic display device within the cab configured to display visual images sent from the unmanned aerial vehicle while in flight, and the controller is further configured to transmit input signals received via the human machine interface to the unmanned aerial vehicle; and wherein the unmanned aerial vehicle is configured to maneuver autonomously or under driver remote control based on the input signals received from the human machine interface, and wherein the unmanned aerial vehicle is configured to send real-time video images while in flight from different viewing angles of a rear of the wheeled vehicle during a period when the wheeled vehicle is operating in reverse.

2 . The system of claim 1 , wherein the unmanned aerial vehicle comprises stereo vision cameras.

3 . The system of claim 1 , wherein the camera on the unmanned aerial vehicle is configured to be controlled via the human machine interface.

4 . The system of claim 1 , wherein the unmanned aerial vehicle is configured to maneuver autonomously while in flight.

5 . The system of claim 1 , wherein the unmanned aerial vehicle is configured to maneuver via driver remote control while in flight.

6 . The system of claim 1 , wherein the wheeled vehicle comprises a tractor and trailer.

7 . A method of backing up a wheeled vehicle, comprising:
deploying an unmanned aerial vehicle to take flight; maneuvering the unmanned aerial vehicle autonomously or under driver remote control to a rear of the wheeled vehicle; directing a camera onboard the unmanned aerial vehicle to capture images of a rear of the wheeled vehicle; and sending the images from the camera onboard the unmanned aerial vehicle to an electronic display device within a cab of the wheeled vehicle while the wheeled vehicle is operating in reverse.

8 . The method of claim 7 , further comprising displaying on the electronic display device, distances to objects that appear in the images.

9 . The method of claim 7 , further comprising maneuvering the unmanned aerial vehicle to maintain a constant distance to the wheeled vehicle.

10 . The method of claim 7 , further comprising maneuvering the unmanned aerial vehicle to different sides of the wheeled vehicle.

11 . The method of claim 7 , further comprising maintaining the unmanned aerial vehicle at a fixed position, and maneuvering the camera to maintain a rear of the wheeled vehicle within a field of view of the camera.

12 . An inspection system for a wheeled vehicle, comprising:
a wheeled vehicle comprising a cab; an unmanned aerial vehicle comprising a camera; a controller configured to communicate to and from the unmanned aerial vehicle while in flight; a human machine interface within the cab, wherein the human machine interface is configured to communicate with the controller; and an electronic display device within the cab configured to display visual images sent from the unmanned aerial vehicle while in flight, and the controller is further configured to transmit input signals received via the human machine interface to the unmanned aerial vehicle; and wherein the unmanned aerial vehicle is configured to maneuver autonomously or under driver remote control based on the input signals received from the human machine interface, and wherein the unmanned aerial vehicle is configured to send real-time video images while in flight of a plurality of inspection points located on the wheeled vehicle when the wheeled vehicle is in a parked condition, and wherein each inspection point relates to a condition affecting whether the wheeled vehicle is in a drivable condition.

13 . The system of claim 12 , wherein the wheeled vehicle comprises a tractor and trailer.

14 . The system of claim 12 , wherein the unmanned aerial vehicle comprises stereo vision cameras.

15 . The system of claim 12 , wherein the unmanned aerial vehicle comprises one or more instruments selected from infrared detectors, position-determining indicators, altimeters, gas detectors, global positioning systems, range detection lasers, ultrasonic range detectors, radio position detectors, and inertial measurement units.

16 . The system of claim 12 , wherein the unmanned aerial vehicle is configured to maneuver to the plurality of inspection points autonomously.

17 . The system of claim 12 , wherein the unmanned aerial vehicle is configured to maneuver to the plurality of inspection points under driver remote control.

18 . A method for inspecting a wheeled vehicle prior to driving the wheeled vehicle, comprising:
deploying an unmanned aerial vehicle to take flight; maneuvering the unmanned aerial vehicle autonomously or under driver remote control to a plurality of inspection points on the wheeled vehicle in sequence; after maneuvering the unmanned aerial vehicle to an inspection point, testing whether the inspection point is operational or not operational; and after testing whether the inspection point is operational or not operational, maneuvering the unmanned aerial vehicle to another inspection point.

19 . The method of claim 18 , further comprising autonomously maneuvering the unmanned aerial vehicle.

20 . The method of claim 18 , further comprising remotely maneuvering the unmanned aerial vehicle.

21 . The method of claim 18 , further comprising logging results after testing whether the inspection point is operational or not operational.

22 . The method of claim 18 , further comprising preventing ignition of the wheeled vehicle until each of the inspection points is confirmed to be operational.

Assignees

• Mays Wesley
• Paccar Inc

Inventors

• Mays Wesley

Classifications

• B64U2201/10

  autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS] · CPC title

• B64U2201/20

  Remote controls · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• G05D1/0038

  by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation (images analyzed by a computer and used for automatic navigation G05D1/0246) · CPC title

• B60R1/00

  Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles · CPC title