Providing live feedback using a wearable computing device

Patent metadata

Field	Value
Publication number	US-10600329-B2
Application number	US-201615063904-A
Country	US
Kind code	B2
Filing date	Mar 8, 2016
Priority date	Sep 25, 2015
Publication date	Mar 24, 2020
Grant date	Mar 24, 2020

Abstract

In an approach to providing feedback to a user using a wearable computing device, a computer records an activity being performed by a user operating a wearable computing device, and identifies the activity being performed by the user. The computer retrieves performance data corresponding to the activity being performed by the user, and determines, based on the retrieved performance data and the recorded activity being performed by the user, whether the user deviates from the retrieved performance data. Responsive to determining the user deviates from the retrieved performance data, the computer transmits, based on the retrieved performance data, performance feedback to the user.

First claim

What is claimed is:

1. A method for providing feedback to a user using a wearable computing device, the method comprising:
identifying, by one or more computer processors, an activity being performed by a user operating a wearable computing device, wherein identifying the activity includes retrieving sensor data from one or more sensors, the sensor data including real time skeletal tracking of the user, and wherein identifying the activity further includes identifying at least a comparison of an audio recording of the activity to known audio of a performance;
retrieving, by one or more computer processors, performance data associated with an ideal performance of the activity being performed by the user;
determining, by one or more computer processors, based on the retrieved performance data and the activity being performed by the user, whether the user deviates from the retrieved performance data; and
responsive to determining the user deviates from the retrieved performance data, transmitting, by one or more computer processors, based on the retrieved performance data, performance feedback to the user, the performance feedback including a display of an ideal motion of skeletal coordination corresponding to an ideal position needed to perform the activity properly.

2. The method of claim 1 , further comprising:
determining, by one or more computer processors, whether at least one hand of the user is visible in the activity being performed by the user operating the wearable computing device; and
responsive to determining at least one hand is visible in the activity, displaying, by one or more computer processors, a proper hand placement in a display of the wearable computing device.

3. The method of claim 1 , wherein the performance feedback to the user is transmitted to a display of the wearable computing device.

4. The method of claim 1 , wherein the performance feedback to the user further includes an audio feedback.

5. The method of claim 1 , further comprising:
overlaying, by one or more computer processors, the retrieved sensor data in a display of the wearable computing device.

6. The method of claim 1 , wherein the ideal performance data is one or more of: an original performance by another or provided instructions on a performance.

7. The method of claim 1 , wherein transmitting performance feedback to the user further includes displaying a delta between the retrieved performance data and the activity being performed by the user.

Assignees

• IBM

Inventors

• Dow Eli M
• Fitzsimmons Thomas D
• Schmidt Steven K
• Stocker Iv Charles J

Classifications

• G09B5/065

  Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems · CPC title

• G09B5/02 Primary

  with visual presentation of the material to be studied, e.g. using film strip · CPC title

• H04B1/385

  Transceivers carried on the body, e.g. in helmets · CPC title

• G09B7/02

  of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student · CPC title

• H04L41/22

  comprising specially adapted graphical user interfaces [GUI] · CPC title