Selecting and correlating physical activity data with image data

Patent metadata

Field	Value
Publication number	US-12046347-B2
Application number	US-202117495071-A
Country	US
Kind code	B2
Filing date	Oct 6, 2021
Priority date	Feb 17, 2011
Publication date	Jul 23, 2024
Grant date	Jul 23, 2024

Abstract

Example embodiments may relate systems, methods, apparatuses, and computer readable media configured to correlate image data of a user performing physical activity with data collected during the user's performance. Data may include sensor data measuring, force, acceleration, speed, and/or processed sensor data from one or more sensors. Certain embodiments may determine whether the user is within a performance zone based on user attributes. Correlation of the image data with physical activity data may be based, at least in part, whether the user is within a performance zone.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving a first set of physical activity data corresponding to an athletic performance comprising at least a first activity performed by a first user, wherein the first set of physical activity data is generated by or derived from a first sensor;
capturing, by an image capturing device, image data corresponding to at least the first activity performed by the first user;
receiving, from a second user, an input identifying a first activity threshold,
determining, by a processor, whether a portion of the physical activity is indicative of the first user satisfying the first activity threshold;
correlating, in response to determining that the portion of the physical activity data indicates that the first user has satisfied the first activity threshold, the image data in accordance with the portion of the physical activity data;
overlaying, on the correlated image data, the portion of the physical activity data;
displaying, on a display device, the correlated image data with the overlaid portion of the physical activity data in real-time;
storing, as a single file, the correlated image data with the overlaid portion of the physical activity data, and
transmitting the stored correlated image data with the overlaid portion of the physical activity data to a computing device.

2. The computer-implemented method of claim 1 , wherein the first activity threshold is speed or vertical jump.

3. The computer-implemented method of claim 1 , wherein the image data comprises a plurality of frames, and wherein the correlating the image data further comprises:
associating a first number of frames of the image data with a corresponding time period of the first set of physical activity data.

4. The computer-implemented method of claim 1 , wherein the image data comprises a plurality of frames, the computer-implemented method further comprising:
determining, by the processor, a plurality of activity values for a first activity metric corresponding to the portion of the first set of physical activity data; and
adjusting the plurality of activity values to be associated with at least a first frame of the image data.

5. The computer-implemented method of claim 1 , further comprising:
establishing a communication channel with the first sensor, wherein the first sensor comprises a force sensor; and
in response to establishing the communication channel, outputting, to the display device, a communication prompting the user to perform the first activity.

6. The computer-implemented method of claim 5 , further comprising:
receiving, from the force sensor, a first set of data relating to the performance of the first activity by the first user.

7. The computer-implemented method of claim 6 , wherein the first set of data further comprises at least one of: a shoe type, a shoe color, or a shoe size.

8. The computer-implemented method of claim 1 , further comprising:
receiving an input selection identifying the first user; and
in response to receiving the input selection, initiating the correlation of the image data in accordance with the portion of the first set of physical activity data.

9. The computer-implemented method of claim 1 , further comprising:
determining, based on the portion of the first set of physical activity data, a second activity performed by the first user; and
in response to the determining the second activity, initiating the correlation of the image data in accordance with the portion of the first set of physical activity data.

10. The computer-implemented method of claim 1 , further comprising:
receiving a second set of physical activity data corresponding to one or more previous athletic performances where the first user performed the first activity; and
correlating the image data in accordance with the second set of physical activity data.

11. One or more non-transitory computer readable media storing instructions that, when executed by at least one processor, cause the at least one processor to:
receive a first set of physical activity data corresponding to an athletic performance comprising at least a first activity performed by a first user, wherein the first set of physical activity data is generated by or derived from a first sensor;
receive, from a second user, an input identifying a first activity threshold;
capture, by an image capturing device, image data corresponding to at least the first activity performed by the user;
determine that a portion of the physical activity data is indicative of the first user satisfying a first activity threshold;
correlate the image data in accordance with the portion of the first set of physical activity data;
overlay, on the correlated image data, the portion of the physical activity data;
display, on a display device, the correlated image data with the overlaid portion of the physical activity data in real-time;
store, as a single file, the correlated image data with the overlaid portion of the physical activity data, and
transmit the stored correlated image data with the overlaid portion of the physical activity data to a computing device.

12. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:
receive a second set of physical activity data corresponding to one or more previous athletic performances where the first user performed the first activity; and
correlate the image data in accordance with the second set of physical activity data.

13. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:
establish a communication channel with the first sensor, wherein the first sensor comprises a force sensor; and
in response to establishing the communication channel, output, to thea display device, a communication prompting the first user to perform the first activity.

14. The one or more non-transitory computer readable media of claim 13 , wherein the instructions, when executed, further cause the at least one processor to:
receive, from the force sensor, a first set of data relating to the first user performing the first activity.

15. The one or more non-transitory computer readable media of claim 14 , wherein the first set of data further comprises at least one of: a shoe type, a shoe color, or a shoe size.

16. The one or more non-transitory computer readable media of claim 11 , wherein the instructions, when executed, further cause the at least one processor to:
determine, based on the portion of the first set of physical activity data, a second activity performed by the first user; and
in response to the determining the second activity, initiate the correlation of the image data in accordance with the portion of the first set of physical activity data.

17. A computer-implemented method comprising:
receiving physical activity data corresponding to an athletic performance for a plurality of players, the physical activity data comprising data generated by or derived from a plurality of sensors;
receiving, from a user, an input identifying a first activity threshold,
determining, by a processor, that one or more portions of the physical activity data is indicative of one or more players, of the plurality of players, satisfying the first activity threshold;
capturing, by an image capturing device, image data relating to the athletic performance;
correlating the captured image data with the corresponding one or more porti

Assignees

• Nike Inc

Inventors

• Burroughs Brandon S
• Engelberg Richard J
• Rice Jordan M
• Sweet Bob
• Weast Aaron B
• Convay Wade
• Rooke-Ley Joshua

Classifications

• H04N7/183

  for receiving images from a single remote source · CPC title

• A63B24/0062

  Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance · CPC title

• G16Z99/00

  Subject matter not provided for in other main groups of this subclass · CPC title

• G09B19/0038 Primary

  Sports · CPC title

• A63B71/0622

  Visual, audio or audio-visual systems for entertaining, instructing or motivating the user · CPC title