Apparatus and methods for controlling attention of a robot

Patent metadata

Field	Value
Publication number	US-11867599-B2
Application number	US-202217749863-A
Country	US
Kind code	B2
Filing date	May 20, 2022
Priority date	Aug 31, 2012
Publication date	Jan 9, 2024
Grant date	Jan 9, 2024

Abstract

An automated control system including an unmanned aerial vehicle (UAV) and an input device. The UAV includes: a sensor, a receiver; and memory. The memory includes a task association data including one or more tasks for execution by the UAV. The input device includes a tagging block. The tagging block allows an operator to tag an object of interest and send a tag regarding the object of interest to the UAV, via the receiver, wherein the object of interest is located within a visual field of the UAV. The sensor processes data within the visual field and the input device is configured to communicate the object of interest from the visual field tagged by the operator. The task is selected from the task association data and the UAV executes the task with respect to the object of interest from the visual field.

First claim

What is claimed is:

1. An automated control system comprising:
a cloud-based repository; and
an unmanned aerial vehicle (UAV) comprising:
a sensor;
a receiver; and
a memory comprising task association data including one or more tasks for execution by the UAV; and

an input device comprising a tagging block configured to:
select an object of interest with the tagging block;
send a tag, from the tagging block, regarding the object of interest to the UAV, via the receiver;
connect to the cloud-based repository to save, load, update, and/or perform operations within the cloud-based repository; and
store images on the cloud-based repository so that the images stored may be downloaded by one or more other devices;

wherein the object of interest is located within a visual field of the UAV;
wherein the sensor processes data within the visual field;
wherein a task is selected from the task association data and the UAV is controlled to execute the task with respect to the object of interest; and
wherein the task is a command that the UAV follows the object of interest selected with the tagging block.

2. The automated control system of claim 1 , wherein the UAV is configured to provide an acknowledgement feedback that the task selected from the task association data has been received.

3. The automated control system of claim 1 , wherein the sensor is part of a digital camera.

4. The automated control system of claim 1 , wherein the tag may also provide a context and the context is configured to cause the UAV to perform another task associated with the context, wherein the context relates to a queue that includes a current command, and wherein the current command includes a particular discrete category of commands issued by a user to the UAV.

5. A method comprising:
receiving a task from an input device associated with an unmanned aerial vehicle (UAV);
tagging an object of interest with a tagging block of the input device;
providing context regarding the task and the object of interest tagged to the UAV;
executing, with the UAV, the task associated with the context;
following, with the UAV, the object of interest selected with the tagging block;
connecting the UAV to a cloud-based repository;
saving on the cloud-based repository; and
storing images on the cloud-based repository so that the images stored may be downloaded by one or more other devices.

6. The method of claim 5 , further comprising sending the context from the input device to the UAV.

7. The method of claim 5 , further comprising sending the context from a remote user device wirelessly to the UAV.

8. The method of claim 7 , wherein a signal is transmitted from the UAV to the remote user device.

9. The method of claim 8 , wherein the remote user device is a smartphone and the signal is an image.

10. The method of claim 6 , wherein the object of interest tagged is a portion of an environment around the UAV, and wherein the context relates to an image context that comprises a spatial map resulting from a learned feature being updated dynamically by the UAV.

11. A method comprising:
receiving an input signal from a sensor associated with an unmanned aerial vehicle (UAV);
selecting a task from task association data;
tagging an object of interest with a tagging block of an input device;
providing the object of interest tagged to the UAV to cause the UAV to perform the task from the task association data to the object of interest tagged by the tagging block of the input device;
following, with the UAV, the object of interest selected with the tagging block;
connecting the UAV to a cloud-based repository; and
storing images on the cloud-based repository so that the images stored may be downloaded by one or more other devices.

12. The method of claim 11 , further comprising providing feedback that the task cannot be completed or a resource is unavailable to complete the task.

13. The method of claim 11 , wherein the UAV is configured to proceed to a location of the object of interest tagged.

14. The method of claim 11 , wherein the UAV is configured to obtain digitized images of an area surrounding the object of interest tagged.

15. The method of claim 11 , further comprising providing context regarding the object of interest tagged to the UAV, wherein the context includes a spatial map that is dynamically updated and relates the spatial map of the object of interest to the spatial map prior to being dynamically updated.

16. The method of claim 15 , further comprising providing the context from a remote user device wirelessly to the UAV.

17. The method of claim 11 , wherein an automated control system controls the UAV once the task is selected and the object of interest is tagged.

18. The method of claim 11 , wherein the task is a selection of a path that the UAV travels along.

19. The automated control system of claim 4 , wherein the context relates to an image context that comprises a spatial map resulting from a learned feature being updated dynamically by the UAV.

20. The method of claim 5 , wherein the context relates to a queue that includes a current command, and wherein the current command includes a particular discrete category of commands issued by a user to the UAV.

Assignees

• Gopro Inc

Inventors

• Meier Philip

Classifications

• G01N1/2273 Primary

  Atmospheric sampling · CPC title

• B25J9/163

  learning, adaptive, model based, rule based expert control · CPC title

• B25J9/1656 Primary

  characterised by programming, planning systems for manipulators · CPC title

• B25J9/1694

  characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion · CPC title

• B60K11/02

  with liquid cooling · CPC title