User attention-based user experience

Patent metadata

Field	Value
Publication number	US-11675414-B2
Application number	US-202117469575-A
Country	US
Kind code	B2
Filing date	Sep 8, 2021
Priority date	Dec 27, 2019
Publication date	Jun 13, 2023
Grant date	Jun 13, 2023

Abstract

Various systems and methods for adapting a computer based on user attentiveness are described herein. A system for attention-based gesture recognition includes processing circuitry to: access an image of a user, the user proximate to a computing device; determine, based on the image, whether user is attentive to the computing device; and selectively enable or disable a function of the computing device depending on whether the user is attentive.

First claim

What is claimed is:

1. A system for attention-based gesture recognition comprising:
processing circuitry to:
access an image of a user;
determine, based on the image, whether the user is attentive to a display of a computing device; and
enable a gesture recognition function of the system if the user is attentive or disable the gesture recognition function if the user is determined to be inattentive.

2. The system of claim 1 , wherein to determine whether the user is attentive, the processing circuitry is to:
determine a head pose of the user from the image;
determine a direction angle of the head pose with respect to the display; and
determine that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the display, and the second threshold angle is measured in a second direction with respect to the display, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

3. The system of claim 1 , wherein to determine whether the user is attentive, the processing circuitry is to:
determine a direction angle of eye gaze of the user with respect to the display based on the image; and
determine that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the display, and the second threshold angle is measured in a second direction with respect to the display, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

4. The system of claim 1 , wherein to disable the gesture recognition function, the processing circuitry is to place gesture recognition circuitry corresponding to the gesture recognition function in a lower-power mode.

5. The system of claim 1 , wherein to disable the gesture recognition function, the processing circuitry is to disable gesture recognition circuitry corresponding to the gesture recognition function.

6. The system of claim 1 , wherein gesture recognition circuitry corresponding to the gesture recognition function is enabled when the user is attentive.

7. The system of claim 1 , wherein gesture recognition circuitry corresponding to the gesture recognition function comprises a subcomponent of a system-on-chip (SOC).

8. The system of claim 1 , wherein gesture recognition circuitry corresponding to the gesture recognition function comprises an IP block of a system-on-chip (SOC).

9. The system of claim 1 , wherein the processing circuitry is to disable a camera used for the gesture recognition function when the gesture recognition function is disabled.

10. A method of attention-based gesture recognition comprising:
accessing an image of a user;
determining, based on the image, whether the user is attentive to a display of a computing device; and
enabling a gesture recognition function of the computing device if the user is attentive or disabling the gesture recognition function if the user is determined to be inattentive.

11. The method of claim 10 , wherein determining whether the user is attentive comprises:
determining a head pose of the user from the image;
determining a direction angle of the head pose with respect to the display; and
determining that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the display, and the second threshold angle is measured in a second direction with respect to the display, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

12. The method of claim 10 , wherein determining whether the user is attentive comprises:
determining a direction angle of eye gaze of the user with respect to the display based on the image; and
determining that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the display, and the second threshold angle is measured in a second direction with respect to the display, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

13. The method of claim 10 , wherein disabling the gesture recognition function comprises placing gesture recognition circuitry corresponding to the gesture recognition function in a lower-power mode.

14. The method of claim 10 , wherein disabling the gesture recognition function comprises disabling gesture recognition circuitry corresponding to the gesture recognition function.

15. The method of claim 10 , wherein gesture recognition circuitry corresponding to the gesture recognition function is enabled when the user is attentive.

16. The method of claim 10 , wherein gesture recognition circuitry corresponding to the gesture recognition function comprises a subcomponent of a system-on-chip (SOC).

17. The method of claim 10 , wherein gesture recognition circuitry corresponding to the gesture recognition function comprises an IP block of a system-on-chip (SOC).

18. The method of claim 10 , comprising disabling a camera used for the gesture recognition function when the gesture recognition function is disabled.

19. At least one non-transitory machine-readable medium including instructions for attention-based gesture recognition, which when executed by a machine, cause the machine to perform operations comprising:
accessing an image of a user;
determining, based on the image, whether the user is attentive to a display of a computing device; and
enabling a gesture recognition function of the machine if the user is attentive or disabling the gesture recognition function if the user is determined to be inattentive.

20. The at least one non-transitory machine-readable medium of claim 19 , wherein gesture recognition circuitry corresponding to the gesture recognition function comprises a subcomponent of a system-on-chip (SOC).

21. The at least one non-transitory machine-readable medium of claim 19 , wherein gesture recognition circuitry corresponding to the gesture recognition function comprises an IP block of a system-on-chip (SOC).

22. The at least one non-transitory machine-readable medium of claim 19 , comprising disabling a camera used for the gesture recognition function when the gesture recognition function is disabled.

Assignees

• Intel Corp

Inventors

• Magi Aleksander
• Bui Kathy
• Diefenbaugh Paul
• Bartscherer Marko

Classifications

• G06F1/1686 Primary

  the I/O peripheral being an integrated camera · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• Y02D10/00

  Energy efficient computing, e.g. low power processors, power management or thermal management · CPC title

• G06F1/3231

  Monitoring the presence, absence or movement of users · CPC title