Adaptive learning environment driven by real-time identification of engagement level

Patent metadata

Field	Value
Publication number	US-10013892-B2
Application number	US-201414325740-A
Country	US
Kind code	B2
Filing date	Jul 8, 2014
Priority date	Oct 7, 2013
Publication date	Jul 3, 2018
Grant date	Jul 3, 2018

Abstract

Computer-readable storage media, computing devices, and methods associated with an adaptive learning environment associated with an adaptive learning environment are disclosed. In embodiments, a computing device may include an instruction module and an adaptation module operatively coupled with the instruction module. The instruction module may selectively provide instructional content of one of a plurality of instructional content types to a user of the computing device via one or more output devices coupled with the computing device. The adaptation module may determine, in real-time, an engagement level associated with the user of the computing device and may cooperate with the instruction module to dynamically adapt the instructional content provided to the user based at least in part on the engagement level determined. Other embodiments may be described and/or claimed.

First claim

What is claimed is:

1. A computing device comprising:
an instruction module to selectively provide instructional content of one of a plurality of instructional content types to a user of the computing device via one or more output devices coupled with the computing device; and
an adaptation module operatively coupled with the instruction module and with one or more sensors provided in, or communicatively coupled to, the computing device, to:
receive real-time sensor data associated with the user of the computing device, including one or more of 2D image data, 3D depth data or eye tracking sensor data;
determine, in real-time, an emotional engagement level associated with the user of the computing device based, at least in part, on a calculation of interestingness of the instructional content to the user, the calculation based on gaze based parameters of the user as to one or more pre-defined areas of interest of displayed content to the user, based on the real-time sensor data; and
cooperate with the instruction module to dynamically adapt the instructional content provided to the user based at least in part on the emotional engagement level determined.

2. The computing device of claim 1 , wherein the gaze based parameters include one or more of: gaze duration on a tagged object in an image or text, number of fixations on an area of interest of a display element or text, proportion of gazes on an area of interest of a tagged object versus other areas in a photo or text, or time to first fixation on an area of interest in a display element or text.

3. The computing device of claim 1 , wherein at least one of the sensors is an integral part of the computing device.

4. The computing device of claim 1 , wherein the one or more sensors may include, but are not limited to, one or more cameras capable of capturing images or video in two dimensions or three dimensions, one or more microphones, a skin conductance sensor, an eye tracking sensor, and/or a heart rate sensor.

5. A computer-implemented method comprising:
receiving, by an adaptive learning platform of a computing device, real-time user state data associated with a user of the computing device, the real-time state data including one or more of 2D image data, 3D depth data, or eye tracking sensor data;
determining, by the adaptive learning platform, a current emotional engagement level of the user based, at least in part, on a calculation of interestingness of the instructional content to the user, the calculation based on gaze based parameters of the user as to one or more pre-defined areas of interest of displayed content to the user, based on the real-time user state data; and
dynamically adapting, by the adaptive learning platform, instructional content output by the adaptive learning platform, based at least in part on a current learner state,
wherein the real-time user state data is based, at least in part, on real-time sensor data acquired by one or more sensors provided in, or communicatively coupled to, the computing device.

6. The computer-implemented method of claim 5 , wherein the gaze based parameters include one or more of: gaze duration on a tagged object in an image or text, number of fixations on an area of interest of a display element or text, proportion of gazes on an area of interest of a tagged object versus other areas in a photo or text, or time to first fixation on an area of interest in a display element or text.

7. The method of claim 5 , wherein dynamically adapting the instructional content further comprises dynamically adapting the instructional content when the engagement level determined indicates a change in the level of engagement of the user from a previous level of engagement.

8. The method of claim 5 , wherein the instructional content is selected from an instructional content type group consisting of: linear content, multimedia content, or interactive content.

9. The computer-implemented method of claim 5 , wherein at least one of the one or more sensors is an integral part of the computing device.

10. The computer-implemented method of claim 5 , wherein the one or more sensors may include, but are not limited to, one or more cameras capable of capturing images or video in two dimensions or three dimensions, one or more microphones, a skin conductance sensor, an eye tracking sensor, and/or a heart rate sensor.

11. One or more non-transitory computer-readable storage media having a plurality of instructions stored thereon, which, when executed by a processor of a computing device, provide the computing device with an adaptive learning platform to:
receive real-time user state data associated with a user of the computing device, the real-time user state data including one or more of 2D image data, 3D depth data, or eye tracking sensor data;
determine a current emotional engagement level of the user based, at least in part, on the real-time user state data, the emotional engagement level determined based on a calculation of interestingness of the instructional content to the user, the calculation based on gaze based parameters of the user as to one or more pre-defined areas of interest of displayed content to the user, based on the real-time user state data; and
dynamically adapt instructional content output by the adaptive learning platform, based at least in part on the current emotional engagement level,
wherein the real-time user state data is based, at least in part, on real-time sensor data acquired by one or more sensors provided in, or communicatively coupled to, the computing device.

12. The non-transitory computer-readable media of claim 11 , wherein the gaze based parameters include one or more of: gaze duration on a tagged object in an image or text, number of fixations on an area of interest of a display element or text, proportion of gazes on an area of interest of a tagged object versus other areas in a photo or text, or time to first fixation on an area of interest in a display element or text.

13. The non-transitory computer-readable media of claim 11 , wherein the adaptive learning platform is further to receive user state data, and wherein to determine the engagement level is based, at least in part, on the user state data.

14. The one or more non-transitory computer-readable storage media of claim 11 , wherein at least one of the one or more sensors is an integral part of the computing device.

15. The one or more non-transitory computer-readable storage media of claim 11 , wherein the one or more sensors may include, but are not limited to, one or more cameras capable of capturing images or video in two dimensions or three dimensions, one or more microphones, a skin conductance sensor, an eye tracking sensor, and/or a heart rate sensor.

Assignees

• Intel Corp

Inventors

• Aslan Sinem
• Esme Asli Arslan
• Kamhi Gila
• Ferens Ron
• Diner Itai

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• H04L67/22

  Electricity · mapped topic

• G06Q50/01

  Physics · mapped topic

• H04L67/30

  Profiles · CPC title

• G09B19/00

  Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) · CPC title