Attention detection service

Patent metadata

Field	Value
Publication number	US-11675412-B2
Application number	US-202117377843-A
Country	US
Kind code	B2
Filing date	Jul 16, 2021
Priority date	Jun 3, 2017
Publication date	Jun 13, 2023
Grant date	Jun 13, 2023

Abstract

In an embodiment, a device may include an attention detection service. The attention detection service may monitor various peripheral devices in the device for indications that a user is paying attention to the device. Various clients may register for notification of attention detection and attention lost (attention no longer detected) events, or may poll the service for the events. If a user is not paying attention to the device, it may be possible to take various actions to permit reduced energy consumption.

First claim

What is claimed is:

1. A method comprising:
monitoring a plurality of peripheral devices in a system for a plurality of events, wherein the plurality of peripheral devices include a first one or more peripheral devices and a second one or more peripheral devices, and wherein each of the first one or more peripheral devices consumes more power during use than each of the second one or more peripheral devices, and wherein, during a sample timeout interval, the first one or more peripheral devices are not sampled;
responsive to a first event of the plurality of events from one of the second one or more peripheral devices, communicating an indication to one or more clients of a plurality of clients executable on the system;
responsive to an expiration of the sample timeout interval without detecting events from the second one or more peripheral devices, sampling the first one or more peripheral devices;
detecting a second event from one of the first one or more peripheral devices during the sampling; and
responsive to detecting the second event, communicating a second indication to the one or more clients.

2. The method as recited in claim 1 wherein the first one or more peripheral devices comprise a camera configured to detect a face of a user.

3. The method as recited in claim 1 wherein the first one or more peripheral devices comprise one or more passive sensors.

4. The method as recited in claim 1 further comprising, responsive to detecting the first event from one of the second one or more peripheral devices, updating a current timeout to a sample length timeout.

5. The method as recited in claim 1 further comprising:
responsive to not detecting the second event, updating an attention lost timeout;
detecting expiration of the attention lost timeout associated with a first client of the one or more clients; and
communicating an indication of the attention lost timeout to the first client responsive to detecting the expiration of the attention lost timeout.

6. The method as recited in claim 1 further comprising:
receiving a poll request from a second client of the one or more clients, wherein the poll request specifies an indication of current engagement and a poll duration during which potential user engagement is to be reported to the second client;
detecting that a user is currently engaged with the system responsive to a fourth event in the plurality of events; and
communicating the indication of the current engagement to the second client responsive to detecting that the user is currently engaged.

7. The method as recited in claim 6 further comprising:
detecting a third event of the plurality of events during the poll duration, wherein the third event is specified in the poll request as one of the plurality of events that the second client interprets as indicative of engagement; and
communicating the indication of engagement to the second client responsive to detecting the third event and not having detected that the user was currently engaged with the system at the time the poll request was received.

8. The method as recited in claim 6 further comprising:
detecting a timeout during a time period subsequent to receiving the poll request without detecting the plurality of events during the poll duration; and
communicating an indication of engagement lost to the second client responsive to detecting the timeout.

9. The method as recited in claim 6 further comprising:
detecting that the poll duration has expired; and
discontinuing communication of the indication of current engagement and an indication of engagement lost to the second client responsive to detecting that the poll duration has expired.

10. The method as recited in claim 6 wherein the poll request further includes an active polling interval, and the method further comprises polling for the plurality of events during the active polling interval.

11. A non-transitory computer accessible storage medium storing instructions which, when executed on a system:
monitor a plurality of peripheral devices in the system for a plurality of events, wherein the plurality of peripheral devices include a first one or more peripheral devices and a second one or more peripheral devices, and wherein each of the first one or more peripheral devices consumes more power during use than each of the second one or more peripheral devices, and wherein, during a sample timeout interval, the first one or more peripheral devices are not sampled;
responsive to a first event of the plurality of events from one of the second one or more peripheral devices, communicate an indication to one or more clients of a plurality of clients executable on the system;
responsive to an expiration of the sample timeout interval without detecting events from the second one or more peripheral devices, sample the first one or more peripheral devices;
detect a second event in the sample from one of the first one or more peripheral devices; and
responsive to detecting the second event, communicate a second indication to the one or more clients.

12. The non-transitory computer accessible storage medium as recited in claim 11 wherein the instructions, when executed responsive to detecting the first event, update a current timeout to a sample length timeout.

13. The non-transitory computer accessible storage medium as recited in claim 11 wherein the instructions, when executed responsive to not detecting the second event:
update an attention lost timeout;
detect expiration of the attention lost timeout associated with a first client of the one or more clients; and
communicate an indication of lost engagement to the first client.

14. The non-transitory computer accessible storage medium as recited in claim 11 wherein the instructions, when executed:
receive a poll request from a second client of the one or more clients, wherein the poll request specifies an indication of current engagement and a poll duration during which potential user engagement is to be reported to the second client;
detect that a user is currently engaged with the system responsive to a fourth event in the plurality of events; and
communicate the indication of the current engagement to the second client responsive to detecting that the user is currently paying attention.

15. The non-transitory computer accessible storage medium as recited in claim 14 wherein the instructions, when executed:
detect a fifth event of the plurality of events during the poll duration, wherein the fifth event is specified in the poll request as one of the plurality of events that the second client interprets as indicative of engagement; and
communicate the indication of engagement to the second client responsive to detecting the fifth event and not having detected that a user was currently engaged with the system at the time the poll request was received.

16. The non-transitory computer accessible storage medium as recited in claim 14 wherein the instructions, when executed:
detect a timeout during a time period subsequent to receiving the poll request without detecting the plurality of events during the poll duration; and
communicate an indication of engagement lost to the second client responsive to detecting the timeout.

17. The non-transitory computer accessible storage medium as recited in claim 14 wherein the instructions, when executed:
detect that the poll duration has expired; and
discontinue communication of the indication of current engagement and an indication of engagement lost to the second client responsive to detecting that the poll duration h

Assignees

• Apple Inc

Inventors

• Biron Benjamin
• Misra Ronnie G
• Thomas Christopher K
• Zhang Weijie
• Yepez Roberto G
• Guetta Anthony J
• Ho Kelsey Y
• Chinn Paul W
• Haggerty Myra
• Rothert Curtis
• Anton Peter D
• Drummond Jonathan E
• Cato Andrew B

Classifications

• G06F1/3265

  Power saving in display device · CPC title

• G06F1/3287

  by switching off individual functional units in the computer system · CPC title

• G06F1/3231 Primary

  Monitoring the presence, absence or movement of users · CPC title

• Y02D10/00

  Energy efficient computing, e.g. low power processors, power management or thermal management · CPC title

• G06F1/3296

  by lowering the supply or operating voltage · CPC title