Reflective video display apparatus for interactive training and demonstration and methods of using same

Patent metadata

Field	Value
Publication number	US-11383147-B2
Application number	US-202117562498-A
Country	US
Kind code	B2
Filing date	Dec 27, 2021
Priority date	May 29, 2018
Publication date	Jul 12, 2022
Grant date	Jul 12, 2022

Abstract

A method includes capturing real-time video of a user participating in a first exercise class, using an Internet of Things (IoT) device. The real-time video is displayed concurrently with video of an instructor via a display in communication with the IoT device, to provide a visual comparison of the user to the instructor. The method also includes analyzing the real-time video to determine a performance of the user, and causing display of a warning, via the display, in response to determining the performance of the user. Biometric data associated with the user is received at the IoT device from a wearable device, at multiple times. Heart rates of the user are identified based on the biometric data, and scores based on the heart rates are identified and displayed. A recommendation for a second exercise class is determined based on a profile of the user and displayed via the display.

First claim

The invention claimed is:

1. A method, comprising:
capturing, using an Internet of Things (IoT) device, real-time video of a user performing an exercise associated with a first exercise class;
causing display of the real-time video of the user via a display in communication with the IoT device while video of an instructor is displayed via the display, to provide a visual comparison of the user to the instructor;
performing image analysis of the real-time video of the user to determine a performance of the user when the user is performing the exercise;
causing display of a warning, via the display, in response to determining the performance of the user;
receiving, at the IoT device and from a wearable device including a biometric sensor, first biometric data associated with the user;
identifying, at the IoT device, at a first time, and based on the first biometric data associated with the user, a first heart rate of the user;
identifying, at the IoT device and after the first time, a first score for the user based on the first heart rate of the user;
causing display of the first score via the display;
receiving, at the IoT device and from the wearable device, second biometric data associated with the user;
identifying, at the IoT device, at a second time, and based on the second biometric data associated with the user, a second heart rate of the user;
identifying, at the IoT device and after the second time, a second score for the user based on the second heart rate of the user;
causing display of the second score via the display;
determining a recommendation for a second exercise class different from the first exercise class based on a profile of the user; and
causing display of a representation of the recommendation via the display.

2. The method of claim 1 , wherein the IoT device includes a spatial motion sensing camera.

3. The method of claim 1 , wherein the IoT device includes a camera configured to track an individual extremity of the user.

4. The method of claim 1 , further comprising causing display, via the display, of a number of calories burned.

5. The method of claim 1 , wherein the wearable device is positioned on an extremity of the user when the IoT device receives at least one of the first biometric data associated with the user or the second biometric data associated with the user.

6. The method of claim 1 , further comprising:
identifying a heart rate zone associated with the user; and
causing display of the heart rate zone via the display.

7. The method of claim 1 , wherein at least one of the identifying the first score or the identifying the second score is performed using machine learning.

8. The method of claim 1 , wherein the display is controllable via voice commands.

9. The method of claim 1 , further comprising causing display, via the display, of a representation of a percentage of a peak heart rate of the user.

10. The method of claim 1 , further comprising causing display, via the display, of a horizontal heart range bar and a representation of at least one of the first heart rate of the user or the second heart rate of the user.

11. A method, comprising:
capturing, using an Internet of Things (IoT) device, real-time video of a user performing an exercise associated with a first exercise class;
causing display of (1) the real-time video of the user and (2) a representation of a target heart rate range, via a display in communication with the IoT device, while video of an instructor is displayed via the display, to provide a visual comparison of the user to the instructor;
performing image analysis of the real-time video of the user to determine a performance of the user when the user is performing the exercise;
modifying the representation of the target heart rate range in response to determining the performance of the user;
receiving, at the IoT device and from a wearable device including a biometric sensor, first biometric data associated with the user;
identifying, at the IoT device, at a first time, and based on the first biometric data associated with the user, a first heart rate of the user;
identifying, at the IoT device and after the first time, a first score for the user based on the first heart rate of the user;
causing display of the first score via the display;
receiving, at the IoT device and from the wearable device, second biometric data associated with the user;
identifying, at the IoT device, at a second time, and based on the second biometric data associated with the user, a second heart rate of the user;
identifying, at the IoT device and after the second time, a second score for the user based on the second heart rate of the user;
causing display of the second score via the display;
determining a recommendation for a second exercise class different from the first exercise class based on a profile of the user; and
causing display of a representation of the recommendation via the display.

12. The method of claim 11 , wherein the IoT device includes a spatial motion sensing camera.

13. The method of claim 11 , wherein the image analysis includes tracking an individual extremity of the user using the camera.

14. The method of claim 11 , wherein the display is controllable via voice commands.

15. The method of claim 11 , further comprising causing display, via the display, of a representation of a percentage of a peak heart rate of the user.

16. The method of claim 11 , further comprising causing display, via the display, of a horizontal heart range bar.

17. The method of claim 11 , further comprising:
identifying a heart rate zone associated with the user; and
causing display of the heart rate zone via the display.

18. The method of claim 11 , further comprising causing display, via the display, of a number of calories burned.

19. The method of claim 11 , further comprising causing display of a warning, via the display, in response to determining the performance of the user.

20. The method of claim 11 , further comprising modifying the display of the real-time video of the user based on the performance of the user.

21. A method, comprising:
receiving, at a processor operably coupled to a camera, real-time video captured by the camera of a user performing an exercise associated with a first exercise class;
causing display of the real-time video of the user via a display operably coupled to the processor while video of an instructor is displayed via the display, to provide a visual comparison of the user to the instructor;
receiving, at the processor and from a wearable device including a biometric sensor, biometric data associated with the user;
analyzing, at the processor and using machine learning, the biometric data associated with the user and the real-time video of the user, to determine a performance of the user;
identifying a score for the user based on the performance of the user;
causing display of at least one of the score or an indication of the performance via the display;
determining a recommendation for a second exercise class different from the first exercise class; and
causing display of a representation of the recommendation via the display.

22. The method of claim 21 , wherein the camera is a spatial motion sensing camera.

23. The method of claim 21 , wherein the display is controllable via voice commands.

24. The method of claim 21 , further comprising tracking an individual extremity of the user using the camera.

Assignees

• Curiouser Products Inc

Inventors

• Putnam Brynn

Classifications

• H04M1/724095

  Worn on the wrist, hand or arm · CPC title

• H04M1/72412

  using two-way short-range wireless interfaces · CPC title

• H04M1/72409

  by interfacing with external accessories (hands-free H04M1/60) · CPC title

• H04N21/4415

  using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning {(cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861)} · CPC title

• H04N21/44

  Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs · CPC title