Magic wand interface and other user interaction paradigms for a flying digital assistant

Patent metadata

Field	Value
Publication number	US-12007763-B2
Application number	US-202318162122-A
Country	US
Kind code	B2
Filing date	Jan 31, 2023
Priority date	Jun 19, 2014
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.

First claim

What is claimed is:

1. A method for controlling an unmanned aerial vehicle (UAV), the method comprising:
defining, by a processing system, a virtual line extending from a mobile device to the UAV; and
causing the UAV to autonomously maneuver towards a point along the virtual line.

2. The method of claim 1 , further comprising:
receiving an input indicating an intent to control the UAV.

3. The method of claim 2 , further comprising:
responsive to the input, causing the UAV to maintain its current distance relative to a reference point.

4. The method of claim 3 , further comprising:
responsive to the input, causing the UAV to maintain its current position and/or orientation relative to the reference point.

5. The method of claim 4 , wherein the reference point comprises a location of the mobile device in the physical environment.

6. The method of claim 2 , further comprising:
responsive to the input, causing the UAV to autonomously maneuver to a pre-defined position and/or orientation relative to a reference point.

7. The method of claim 6 , further comprising:
tracking, by the processing system, a location of the mobile device in the physical environment;
wherein the reference point comprises the location of the mobile device.

8. The method of claim 6 , wherein the reference point is at or associated with a physical object in physical space.

9. The method of claim 1 , further comprising:
receiving an input indicating an intent to adjust a distance between the UAV and a reference point while maintaining a same angle of elevation.

10. The method of claim 9 , wherein the input is received via a touch screen of the mobile device.

11. The method of claim 10 , wherein the adjustment to the distance between the UAV and the reference point can be manipulated via a slider bar on the touch screen.

12. A system for controlling an unmanned aerial vehicle (UAV), the system comprising:
a display;
one or more processors; and
one or more memory units having instructions stored thereon which, when executed by the one or more processors, cause the system to:
define a virtual line extending from the system to the UAV; and
generate control commands configured to cause the UAV to autonomously maneuver towards a point along the virtual line; and
transmit the control commands to the UAV.

13. The system of claim 12 , further comprising:
an input mechanism configured to receive an input indicating an intent to control the UAV.

14. The system of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the system to:
responsive to the input, generate instructions configured to cause the UAV to maintain its current distance relative to a reference point; and
transmit the instructions to the UAV.

15. The system of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the system to:
responsive to the input, generate instructions configured to cause the UAV to maintain its current position and/or orientation relative to the reference point; and
transmit the instructions to the UAV.

16. The system of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the system to:
responsive to the input, generate instructions configured to cause the UAV to autonomously maneuver to a pre-defined position and/or orientation relative to a reference point; and
transmit the instructions to the UAV.

17. The system of claim 13 , wherein the input mechanism is further configured to receive an input indicating an intent to adjust a distance between the UAV and a reference point while maintaining a same angle of elevation.

18. The system of claim 17 , wherein the input mechanism comprises a touch screen.

19. The system of claim 18 , wherein the adjustment to the distance between the UAV and the reference point is manipulated via a slider bar presented on the touch screen.

20. An unmanned aerial vehicle (UAV) configured for autonomous flight through a physical environment, the UAV comprising:
a first image capture device configured to capture images of the physical environment;
a propulsion system configured to maneuver the UAV through the physical environment;
a processing system; and
an autonomous navigation system configured to:
define a virtual line extending from a mobile device to the UAV; and
cause the propulsion system to autonomously maneuver the UAV towards a point along the virtual line.

Assignees

• Skydio Inc

Inventors

• Bachrach Abraham
• Bry Adam
• Donahoe Matthew

Classifications

• G05D1/692

  involving a plurality of disparate vehicles · CPC title

• G05D1/223

  Command input arrangements on the remote controller, e.g. joysticks or touch screens · CPC title

• G05D1/225

  operated by off-board computers · CPC title

• G05D1/689

  Pointing payloads towards fixed or moving targets (positioning towed, pushed or suspended implements G05D1/672) · CPC title

• B64D47/08

  Arrangements of cameras · CPC title