Framework for robotic assistants

Patent metadata

Field	Value
Publication number	US-12491639-B2
Application number	US-202318212613-A
Country	US
Kind code	B2
Filing date	Jun 21, 2023
Priority date	Jun 29, 2022
Publication date	Dec 9, 2025
Grant date	Dec 9, 2025

Abstract

According to one aspect, a method includes obtaining a request to remotely operate a robotic assistant, the robotic assistant including at least one sensor configured to collect data associated with an environment around the robotic assistant. The method also includes identifying a first teleoperations system to remotely operate the robotic assistant in response to the request, the first teleoperations system being one of a plurality of teleoperations systems, and assigning the first teleoperations system to remotely operate the robotic assistant. At least one privacy-related instruction is implemented with respect to the first teleoperations system.

First claim

What is claimed is:

1 . A method comprising:
obtaining a request to remotely operate a robotic assistant, the robotic assistant including at least one sensor configured to collect data associated with an environment around the robotic assistant; identifying a first teleoperations system to remotely operate the robotic assistant in response to the request, the first teleoperations system being one of a plurality of teleoperations systems; assigning the first teleoperations system to remotely operate the robotic assistant; and implementing at least one privacy-related instruction with respect to the first teleoperations system.

2 . The method of claim 1 wherein the at least one sensor configured to collect data is configured to obtain at least one image of the environment, and wherein the at least one privacy-related instruction is an instruction relating to a rendering of the image such that at least a portion of the image is obfuscated when displayed on a visual interface of the first teleoperations system.

3 . The method of claim 1 wherein identifying the first teleoperations system includes:
identifying a task to be completed by the robotic assistant, the task being specified in the request; and
determining whether the first teleoperations system is suited to remotely operate the robotic assistant to perform the task, wherein each teleoperations system of the plurality of teleoperations systems is configured to remotely operate the robotic assistant.

4 . The method of claim 3 wherein determining whether the first teleoperations system is suited to remotely operate the robotic assistant to perform the task includes determining whether a first operator associated with the first teleoperations system has skills to remotely operate the robotic assistant to perform the task.

5 . The method of claim 1 wherein implementing at least one privacy-related instruction with respect to the first teleoperations system includes providing the at least one privacy-related instruction to the first teleoperations system on a network.

6 . The method of claim 1 wherein the environment is a first location, and wherein the first teleoperations system is located at a second location and assigning the first teleoperations system to remotely operate the robotic assistant includes a management system assigning the first teleoperations system to remotely operate the robotic assistant, the management system being separate from the teleoperations system and separate from the robotic assistant.

7 . Logic encoded in one or more tangible non-transitory, computer-readable media for execution and when executed operable to:
obtain a request to remotely operate a robotic assistant, the robotic assistant including at least one sensor configured to collect data associated with an environment around the robotic assistant; identify a first teleoperations system to remotely operate the robotic assistant in response to the request, the first teleoperations system being one of a plurality of teleoperations systems; assign the first teleoperations system to remotely operate the robotic assistant; and implement at least one privacy-related instruction with respect to the first teleoperations system.

8 . The logic of claim 7 wherein the at least one sensor configured to collect data is configured to obtain at least one image of the environment, and wherein the at least one privacy-related instruction is an instruction relating to the rendering of the image such that at least a portion of the image is obfuscated when displayed on a visual interface of the first teleoperations system.

9 . The logic of claim 7 wherein the logic operable to identify the first teleoperations system is operable to:
identify a task to be completed by the robotic assistant, the task being specified in the request; and
determine whether the first teleoperations system is suited to remotely operate the robotic assistant to perform the task, wherein each teleoperations system of the plurality of teleoperations systems is configured to remotely operate the robotic assistant.

10 . The logic of claim 9 wherein the logic operable to determine whether the first teleoperations system is suited to remotely operate the robotic assistant to perform the task is operable to determine whether a first operator associated with the first teleoperations system has skills to remotely operate the robotic assistant to perform the task.

11 . The logic of claim 7 wherein the logic operable to implement at least one privacy-related instruction with respect to the first teleoperations system is operable to provide the at least one privacy-related instruction to the first teleoperations system on a network.

12 . A framework comprising:
a plurality of robotic assistants, the plurality of robotic assistants including a first robotic assistant located at a first location associated with an owner of the first robotic assistant; a plurality of teleoperations systems, the plurality of teleoperations systems including a first teleoperations system; and a management system, the management system arranged to obtain at least one request to remotely operate the first robotic assistant, the management system further arranged to assign the first teleoperations system to remotely operate the first robotic assistant and to provide the first teleoperations system with at least one privacy-related instruction associated with the first robotic assistant.

13 . The framework of claim 12 wherein the first robotic assistant includes at least one sensor configured to provide image data of the first location to the first teleoperations system, and wherein the at least one request includes a task to be performed by the first robotic assistant, the first robotic assistant configured to provide the image data as the first teleoperations system remotely operates the first robotic assistant to perform the task.

14 . The framework of claim 13 wherein the first teleoperations system includes a visual interface configured to render the image data, and wherein the at least one privacy-related instruction causes at least one item depicted in the image data to be obfuscated when the image data is rendered.

15 . The framework of claim 14 wherein the at least one item depicted in the image is obfuscated by substituting the at least one item with a replacement object when the image data is rendered.

16 . The framework of claim 12 wherein the first robotic assistant is configured to operate autonomously at the first location, and wherein the management system obtains the at least one request to remotely operate the first robotic assistant from the first robotic assistant when the first robotic assistant encounters an issue while operating autonomously.

17 . The framework of claim 12 wherein the first location is an indoor location, and wherein the first teleoperations system is located at a second location, the first teleoperations system being configured to provide commands to the first robotic assistant on a network.

18 . The framework of claim 17 wherein the privacy-related instruction defines a geofenced area at the indoor location, wherein the first teleoperations system operates the first robotic assistant within the geofenced area.

19 . The framework of claim 17 wherein the first robotic assistant includes at least one sensor configured to provide image data of the indoor location to the first teleoperations system on the network, and wherein the first teleoperations system includes a visual interface conf

Assignees

• Nuro Inc

Inventors

• Ferguson David
• Zhu Jiajun

Classifications

• B25J9/1661

  characterised by task planning, object-oriented languages · CPC title

• G05B2219/40174

  Robot teleoperation through internet · CPC title

• B25J9/1689 Primary

  Teleoperation · CPC title