Controlling unmanned aerial vehicles to avoid obstacle collision

Patent metadata

Field	Value
Publication number	US-2017193830-A1
Application number	US-201615394647-A
Country	US
Kind code	A1
Filing date	Dec 29, 2016
Priority date	Jan 5, 2016
Publication date	Jul 6, 2017
Grant date	—

Abstract

A method, device, framework, and system provide the ability to control an unmanned aerial vehicle (UAV) to avoid obstacle collision. Range data of a real-world scene is acquired using range sensors (that provide depth data to visible objects). The range data is combined into an egospace representation (consisting of pixels in egospace). An apparent size of each of the visible objects is expanded based on a dimension of the UAV. An assigned destination in the real world scene based on world space is received and transformed into egospace coordinates in egospace. A trackable path from the UAV to the assigned destination through egospace that avoids collision with the visible objects (based on the expanded apparent sizes of each of the visible objects) is generated. Inputs that control the UAV to follow the trackable path are identified.

First claim

What is claimed is:

1 . A method for controlling an unmanned aerial vehicle (UAV) to avoid obstacle collision, comprising:
(a) acquiring range data of a real-world scene using one or more range sensors, wherein the range data comprises depth data to one or more visible objects; (b) combining the range data into an egospace representation comprising one or more pixels in egospace, wherein egospace comprises a coordinate system; (c) expanding an apparent size of each of the one or more visible objects based on a dimension of the UAV; (d) receiving an assigned destination in the real world scene based on world space; (e) transforming the assigned destination into egospace coordinates in egospace; (f) generating a trackable path from the UAV to the assigned destination through egospace that avoids collision with the one or more visible objects based on the expanded apparent sizes of each of the one or more visible objects; and (g) identifying one or more inputs that control the UAV to follow the trackable path.

2 . The method of claim 1 , wherein for each of the one or more pixels of the egospace representation, a value is assigned that uniquely encodes a distance to one of the one or more visible objects from a defined focal point, wherein the defined focal point is an arbitrary origin.

3 . The method of claim 1 , wherein the generating the trackable path comprises:
generating one or more predefined maneuvers simultaneously in egospace and world space; and selecting and linking one or more of the predefined maneuvers to generate the trackable path.

4 . The method of claim 1 , wherein the generating the trackable path comprises:
generating one or more waypoints in egospace; and searching for a sequence of the one or more waypoints that define the trackable path; and wherein the searching comprises comparing the depth of the one or more visible objects to egospace coordinates of the one or more waypoints to determine whether the one or more waypoints and segments connecting the one or more waypoints are valid.

5 . The method of claim 4 , wherein the searching is performed dynamically on the fly on board the UAV.

6 . The method of claim 1 , wherein the generating the trackable path comprises:
(a) determining an acceptable time to contact; (b) checking if the assigned destination in egospace is collision free within the acceptable time to contact, wherein the checking comprises:
(1) converting the acceptable time to contact to an acceptable depth value; and
(2) comparing the acceptable depth value against a depth value corresponding to one of the one or more visible objects that occlude the assigned destination;
(c) repeating (b) for each of the one or more pixels of the egospace representation; (d) selecting one of the one or more pixels in the egospace representation that is collision free as a target; and (e) configuring the UAV wherein a velocity vector of the UAV aligns with the target.

7 . The method of claim 1 , wherein the UAV comprises a configuration flat vehicle (CFV), wherein a UAV with state variables x, control inputs u, and state equations {dot over (x)}=f (x,u) comprises a CFV if there exists a set of flat outputs
z =α( x,u,{dot over (u)}, . . . ,u (k) ,
that are a smooth function α of the state variables and control inputs, smooth functions β and γ such that
x =β( z,ż, . . . ,z (j) ),

u =γ( z,ż, . . . ,z (j) ),

and obstacle and configuration spaces O, C⊂{z} such that C={z}\O.

8 . A navigation framework in an unmanned aerial vehicle that avoids obstacle collision:
(a) an embedded flight computer integrated into the UAV that enables the UAV to maneuver, wherein the UAV:
(1) acquires range data of a real-world scene using one or more range sensors mounted on the UAV, wherein the range data comprises depth data to one or more visible objects;
(2) combines the range data into an egospace representation comprising one or more pixels in egospace, wherein egospace comprises a coordinate system;
(3) expands an apparent size of each of the one or more visible objects based on a dimension of the UAV;
(4) receives an assigned destination in the real world scene based on world space;
(5) transforms the assigned destination into egospace coordinates in egospace;
(6) generates a trackable path from the UAV to the assigned destination through egospace that avoids collision with the one or more visible objects based on the expanded apparent sizes of each of the one or more visible objects; and
(7) identifies one or more inputs that control the UAV to follow the trackable path.

9 . The navigation framework of claim 8 , wherein for each of the one or more pixels of the egospace representation, a value is assigned that uniquely encodes a distance to one of the one or more visible objects from a defined focal point, wherein the defined focal point is an arbitrary origin.

10 . The navigation framework of claim 8 , wherein the embedded flight computer generates the trackable path by:
generating one or more predefined maneuvers simultaneously in egospace and world space; and selecting and linking one or more of the predefined maneuvers to generate the trackable path.

11 . The navigation framework of claim 8 , wherein the embedded flight computer generates the trackable path by:
generating one or more waypoints in egospace; and searching for a sequence of the one or more waypoints that define the trackable path; and wherein the searching comprises comparing the depth of the one or more visible objects to egospace coordinates of the one or more waypoints to determine whether the one or more waypoints and segments connecting the one or more waypoints are valid.

12 . The navigation framework of claim 11 , wherein the embedded flight computer searches dynamically on the fly on board the UAV.

13 . The navigation framework of claim 8 , wherein the embedded flight computer generates the trackable path by:
(a) determining an acceptable time to contact; (b) checking if the assigned destination in egospace is collision free within the acceptable time to contact, wherein the checking comprises:
(1) converting the acceptable time to contact to an acceptable depth value; and
(2) comparing the acceptable depth value against a depth value corresponding to one of the one or more visible objects that occlude the assigned destination;
(c) repeating (b) for each of the one or more pixels of the egospace representation; (d) selecting one of the one or more pixels in the egospace representation that is collision free as a target; and (e) configuring the UAV wherein a velocity vector of the UAV aligns with the target.

14 . The navigation framework of claim 8 , wherein the UAV comprises a configuration flat vehicle (CFV), wherein a UAV with state variables x, control inputs u, and state equations {dot over (x)}=f(x,u) comprises a CFV if there exists a set of flat outputs
z =α( x,u,{dot over (u)}, . . . ,u (k) ),
that are a smooth function α of the state variables and control inputs, smooth functions β and γ such that
x =β( z,ż, . . . ,z (j) ),

u =γ( z,ż, . . . ,z (j) ),

and obstacle and configuration spaces O, C⊂{z} such that C={z}\O.

Assignees

• California Inst Of Techn

Inventors

• Fragoso Anthony T S
• Matthies Larry H
• Brockers Roland
• Murray Richard M

Classifications

• B64U2201/10

  autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS] · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title

• G01C21/005

  with correlation of navigation data from several sources, e.g. map or contour matching (G01C21/30 takes precedence) · CPC title