Smart tools and workspaces for do-it-yourself tasks

Patent metadata

Field	Value
Publication number	US-10580211-B2
Application number	US-201514968767-A
Country	US
Kind code	B2
Filing date	Dec 14, 2015
Priority date	Dec 15, 2014
Publication date	Mar 3, 2020
Grant date	Mar 3, 2020

Abstract

One embodiment of the invention disclosed herein provides techniques for assisting with performing a task within a smart workspace environment. A smart workspace system includes a memory that includes a workspace management application. The smart workspace system further includes a processor that is coupled to the memory and, upon executing the workspace management application, is configured to perform various steps. The processor detects that a first step included in a plurality of steps associated with a task is being performed. The processor displays one or more information panels associated with performing the current step. The processor further communicates with augmented safety glasses, augmented tools, and an augmented toolkit to safely and efficiently through a series of steps to complete the task.

First claim

What is claimed is:

1. An augmented workbench, comprising:
a memory that includes a workspace management application; and
a processor that is coupled to the memory and executes the workspace management application to:
detect a first physical action being performed by a user,
identify a first predefined physical step included in a list of predefined physical steps defined in a first predefined task, wherein a completion of the first predetermined physical step requires operation of at least one augmented tool;
determine, based on the first physical action, that the user is attempting to perform the first predefined task, wherein the first physical action matches the first predefined physical step,
receive an indication of an operating condition associated with the at least one augmented tool, and
display, on a first display included in the augmented workbench, one or more information panels associated with performing the first predefined task with the at least one augmented tool.

2. The augmented workbench of claim 1 , wherein the processor further executes the workspace management application to display, within a first information panel included in the one or more information panels, an overview of a list of steps defined in the first predefined task, wherein the list of steps includes the list of predefined physical steps.

3. The augmented workbench of claim 1 , wherein the processor further executes the workspace management application to display, within a first information panel included in the one or more information panels, information explaining how to complete the first predefined physical step with the at least one augmented tool.

4. The augmented workbench of claim 3 , wherein the processor further executes the workspace management application to retrieve a video clip of domain knowledge explaining how to complete the first predefined physical step with the at least one augmented tool, wherein the video clip is displayed in the first information panel.

5. The augmented workbench of claim 1 , wherein a first information panel included in the one or more information panels includes a safety goggles status panel, and the processor further executes the workspace management application to:
determine that safety goggles should be worn when performing the first predefined physical step,
receive an indication that of augmented safety goggles are not being worn by the user when the user is performing the first physical action, and
in response, display within the safety goggles status panel a warning message indicating that the augmented safety goggles should be worn when the user is attempting to perform the first predefined physical step.

6. The augmented workbench of claim 5 , wherein determining that safety goggles should be worn when performing the first predefined physical step includes determining that safety goggles should be worn when using the at least one augmented tool.

7. The augmented workbench of claim 1 , wherein the processor further executes the workspace management application to:
determine that safety goggles should be worn when performing the first predefined physical step,
receive an indication that augmented safety goggles are not being worn by the user when the user is performing the first physical action, and
in response, display within a first information panel included in the one or more information panels a warning message indicating that the augmented safety goggles should be worn when the user is attempting to perform the first predefined physical step.

8. The augmented workbench of claim 1 , wherein a first information panel included in the one or more information panels includes a tool status panel, and the processor further executes the workspace management application to:
determine, based on the indication, the operating condition of the at least one augmented tool, and
in response, display within the tool status panel the operating condition to specify at least one of:
a first status indicating that the at least one augmented tool is ready for use,
a second status indicating that the at least one augmented tool is not ready for use, or
a third status indicating that the at least one augmented tool is performing a first operation.

9. The augmented workbench of claim 1 , wherein a first information panel included in the one or more information panels includes a tool information panel, and the processor further executes the workspace management application to, display within the tool information panel information explaining how to operate the at least one augmented tool to perform the first predefined physical step.

10. The augmented workbench of claim 1 , wherein the processor further executes the workspace management application to:
determine that a first tool is to be used when performing the first predefined physical step, wherein the first tool is to be used in addition to the at least one augmented tool;
determine that the first tool is stored in a first bin included in an augmented toolkit; and
in response, transmit a message to the augmented toolkit that causes an indicator associated with the first bin to illuminate.

11. One or more non-transitory computer-readable storage media, including instructions that, when executed by one or more processors within an augmented workbench, cause the one or more processors to perform the steps of:
detecting a first physical action being performed by a user;
identifying a first predefined physical step included in a list of predefined physical steps defined in a first predefined task, wherein a completion of the first predetermined physical step requires operation of at least one augmented tool;
determining, based on the first physical action, that the user is attempting to perform the first predefined task, wherein the first physical action matches the first predefined physical step;
receiving an indication of an operating condition associated with the at least one augmented tool; and
displaying, on a first display included in the augmented workbench, one or more information panels associated with performing the first predefined task with the at least one augmented tool.

12. The one or more non-transitory computer-readable storage media of claim 11 , further including instructions that cause the one or more processors to perform the step of displaying, within a first information panel included in the one or more information panels, an overview of a list of steps defined in the first predefined task, wherein the list of steps includes the list of predefined physical steps.

13. The one or more non-transitory computer-readable storage media of claim 11 , wherein a first information panel included in the one or more information panels includes information explaining how to complete the first predefined physical step with the at least one augmented tool.

14. The one or more non-transitory computer-readable storage media of claim 11 , wherein a first information panel included in the one or more information panels includes a safety goggles status panel, and further including instructions that cause the one or more processors to perform the steps of:
determining that safety goggles should be worn when performing the first predefined physical step,
receiving an indication that augmented safety goggles are not being worn by the user when the user is performing the first physical action, and
in response, displaying within the safety goggles status panel a warning message indicating that the augmented safety goggles should be worn when the user is attempting to perform the first predefined physical step.

15. The one

Assignees

• Autodesk Inc

Inventors

• Grossman Tovi
• Fitzmaurice George
• Knibbe Jarrod

Classifications

• A61F9/029

  Additional functions or features, e.g. protection for other parts of the face such as ears, nose or mouth; Screen wipers or cleaning devices · CPC title

• F16P3/147

  using electro-magnetic technology, e.g. tags or radar · CPC title

• G08B21/24

  Reminder alarms, e.g. anti-loss alarms · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G09B19/003

  Repetitive work cycles; Sequence of movements · CPC title