Gesture recognition

Patent metadata

Field	Value
Publication number	US-11861073-B2
Application number	US-202217973899-A
Country	US
Kind code	B2
Filing date	Oct 26, 2022
Priority date	Aug 7, 2013
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

An athletic performance monitoring system, including a gesture recognition processor configured to execute gesture recognition processes. Interaction with the athletic performance monitoring system may be based, at least in part, on gestures performed by a user, and may offer an alternative to making selections on the athletic performance monitoring system using physical buttons, which may be cumbersome and/or inconvenient to use while performing an athletic activity. Additionally, recognized gestures may be used to select one or more operational modes for the athletic performance monitoring system, such that a reduction in power consumption may be achieved.

First claim

What is claimed is:

1. A method comprising:
causing, by a device comprising a processor, gesture training to recognize a gesture, wherein the gesture training comprises:
sampling, at a plurality of different sampling rates, first raw sensor data associated with performance of a training gesture;
identifying, from the sampled first raw sensor data, one or more characteristics of the training gesture;
identifying, from the sampled first raw sensor data, a sampling rate, of the plurality of different sampling rates, that is lower than an upper sampling rate, of the plurality of different sampling rates, and at which the one or more characteristics of the training gesture are recognized as if sampled at the upper sampling rate; and
storing the one or more characteristics of the training gesture as a gesture sample for a first gesture and storing the lower sampling rate together with the gesture sample, wherein the stored gesture sample is one of a plurality of stored gesture samples;

recognizing, from a first portion of second raw sensor data, that the device is in proximity to a beacon;
recognizing, from a second portion of the second raw sensor data and based on comparing one or more characteristics of the second portion to the plurality of stored gesture samples, the first gesture; and
causing, based on the proximity to the beacon and the first gesture, the device to sample data at the lower sampling rate.

2. The method of claim 1 , further comprising recognizing the first gesture further based on one or more of: a motion pattern, a pattern of touches of the device, or an orientation of the device.

3. The method of claim 2 , wherein the pattern of touches comprises a series of taps of the device.

4. The method of claim 1 , wherein the beacon is associated with a second device worn by a second user.

5. The method of claim 1 , further comprising:
registering, based on the proximity to the beacon, the device with a location associated with the beacon.

6. The method of claim 1 , further comprising:
recognizing, from a third portion of the second raw sensor data, an activity being performed; and
updating, based on the proximity to the beacon, a progress time associated with the recognized activity.

7. The method of claim 1 , further comprising:
adjusting, based on recognizing a second gesture:
a quantity of sensors from which to receive additional raw sensor data, or
a type of sensor from which to receive additional raw sensor data.

8. The method of claim 1 , further comprising:
receiving the first raw sensor data and the second raw sensor data from one or more sensors, wherein the one or more sensors comprise one or more of: an accelerometer, a gyroscope, a force sensor, a magnetic field sensor, a global positioning system sensor, or a capacitance sensor.

9. The method of claim 1 , wherein causing the device to sample the data at the lower sampling rate causes the device to enter a hibernation mode configured to cause the processor to use a low level of power.

10. A device comprising:
a processor; and
memory storing instructions that, when executed by the processor, cause the device to:
cause gesture training to recognize a gesture by causing the device to:
sample, at a plurality of different sampling rates, first raw sensor data associated with performance of a training gesture;
identify, from the sampled first raw sensor data, one or more characteristics of the training gesture;
identify, from the sampled first raw sensor data, a sampling rate, of the plurality of different sampling rates, that is lower than an upper sampling rate, of the plurality of different sampling rates, and at which the one or more characteristics of the training gesture are recognized as if sampled at the upper sampling rate; and
store the one or more characteristics of the training gesture as a gesture sample for a first gesture and storing the lower sampling rate together with the gesture sample, wherein the stored gesture sample is one of a plurality of stored gesture samples;

recognize, from a first portion of second raw sensor data, that the device is in proximity to a beacon;
recognize, from a second portion of the second raw sensor data and based on comparing one or more characteristics of the second portion to the plurality of stored gesture samples, the first gesture; and
sample, based on the the proximity to the beacon and the first gesture, data at the lower sampling rate.

11. The device of claim 1 , wherein the beacon is associated with a second device worn by a second user.

12. The device of claim 1 , wherein the instructions, when executed by the processor, further cause the device to:
based on the proximity to the beacon:
register with a location associated with the beacon; or
update a progress time associated with an activity recognized from a third portion of the second raw sensor data.

13. The device of claim 1 , wherein the instructions, when executed by the processor, further cause the device to:
adjust, based on recognizing a second gesture:
a quantity of sensors from which to receive additional raw sensor data, or
a type of sensor from which to receive additional raw sensor data.

14. The device of claim 1 , wherein the instructions, when executed by the processor, further cause the device to:
receive the first raw sensor data and the second raw sensor data from one or more sensors, wherein the one or more sensors comprise one or more of: an accelerometer, a gyroscope, a force sensor, a magnetic field sensor, a global positioning system sensor, or a capacitance sensor.

15. The device of claim 1 , wherein the instructions, when executed by the processor, cause the device to, when the data is sampled at the lower sampling rate further, enter a hibernation mode configured to cause the processor to use a low level of power.

16. A non-transitory, computer-readable medium storing instructions that, when executed by a processor of a device, cause:
causing gesture training to recognize a gesture, wherein the gesture training comprises:
sampling, at a plurality of different sampling rates, first raw sensor data associated with performance of a training gesture;
identifying, from the sampled first raw sensor data, one or more characteristics of the training gesture;
identifying, from the sampled first raw sensor data, a sampling rate, of the plurality of different sampling rates, that is lower than an upper sampling rate, of the plurality of different sampling rates, and at which the one or more characteristics of the training gesture are recognized as if sampled at the upper sampling rate; and
storing the one or more characteristics of the training gesture as a gesture sample for a first gesture and storing the lower sampling rate together with the gesture sample, wherein the stored gesture sample is one of a plurality of stored gesture samples;

recognizing, from a first portion of second raw sensor data, that the device is in proximity to a beacon;
recognizing, from a second portion of the second raw sensor data and based on comparing one or more characteristics of the second portion to the plurality of stored gesture samples, the first gesture; and
causing, based on recognizing that the device is in proximity to the beacon and the first gesture, the device to sample data at the lower sampling rate.

17. The non-transitory, computer-readable medium of claim 16 , wherein the beacon is associated with a second device worn by a second user.

18. The non-transitory, computer-readable medium of claim 16 , wherein

Assignees

• Nike Inc

Inventors

• Goel Manan
• Cummings Kate
• Laigar Peter
• Switzer David
• Imlay Sebastian
• Lapinsky Michael

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G06F1/3231

  Monitoring the presence, absence or movement of users · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title