Adaptive learning environment driven by real-time identification of engagement level

Patent metadata

Field	Value
Publication number	US-11610500-B2
Application number	US-201816019182-A
Country	US
Kind code	B2
Filing date	Jun 26, 2018
Priority date	Oct 7, 2013
Publication date	Mar 21, 2023
Grant date	Mar 21, 2023

Abstract

Computer-readable storage media, computing devices, and methods associated with an adaptive learning environment associated with an adaptive learning environment are disclosed. In embodiments, a computing device may include an instruction module and an adaptation module operatively coupled with the instruction module. The instruction module may selectively provide instructional content of one of a plurality of instructional content types to a user of the computing device via one or more output devices coupled with the computing device. The adaptation module may determine, in real-time, an engagement level associated with the user of the computing device and may cooperate with the instruction module to dynamically adapt the instructional content provided to the user based at least in part on the engagement level determined. Other embodiments may be described and/or claimed.

First claim

What is claimed is:

1. A computing device comprising:
an instruction module to selectively provide instructional content of one of a plurality of instructional content types to a user of the computing device via one or more output devices coupled with the computing device; and
an adaptation module operatively coupled with the instruction module to:
determine, in real-time, an engagement level associated with the user of the computing device, the engagement level based upon measurable external indicators of one or more of behavioral engagement, cognitive engagement, or emotional engagement; and
cooperate with the instruction module to dynamically adapt the instructional content, by changing a type of the instructional content, provided to the user based at least in part on the engagement level determined,
wherein the engagement level is further based at least in part on a calculation of interestingness of the instructional content to the user, the calculation based on gaze based parameters of the user as to one or more pre-defined areas of interest of the provided instructional content to the user, and
wherein the type of the instructional content is selected from interactive and non-interactive types of content.

2. The computing device of claim 1 , wherein behavioral engagement corresponds with an amount of effort, persistence, attention, or participation exerted by the user, cognitive engagement corresponds with a commitment by the user to understand the instructional content, and emotional engagement corresponds with feelings of the user with respect to a learning process.

3. The computing device of claim 1 , wherein the engagement level is selected from one of the following engagement levels:
fully engaged, indicating the user is completely engaged;
mostly engaged, indicating the user is engaged a majority of the time;
partly engaged, indicating the user's engagement is unpredictable;
fleetingly engaged, indicating the user's engagement is low; or
not engaged, indicating the user is inattentive or unresponsive.

4. The computing device of claim 1 , wherein to determine the engagement level includes to calculate an engagement score based upon a set of engagement characteristics, and wherein the engagement characteristics are indicative of positive body language, consistent focus, verbal participation, confidence, or enjoyment.

5. The computing device of claim 4 , wherein to calculate an engagement score includes to multiply a mathematical value associated with each of the engagement characteristics by a respective engagement coefficient associated with the respective engagement characteristic, wherein the engagement coefficient is indicative of a weight to assign to the respective engagement characteristic.

6. The computing device of claim 4 , wherein an engagement characteristic indicative of:
positive body language is based on one or more of observed body posture, head pose, or hand gesture;
consistent focus is based on eye tracking data;
verbal participation is based on a quality of lesson summary or vocal indicators of engagement;
student confidence is based on a number of times the user utilizes a tutoring resource; and
enjoyment is based on one or more metrics of facial expressions, skin conductance, pupil dilation, or heart rate.

7. One or more computer-readable storage media having a plurality of instructions stored thereon, which, when executed by a processor of a computing device, provide the computing device with an adaptive learning platform to:
receive real-time user state data associated with a user of the computing device;
determine a current engagement level of the user based, at least in part, on the real-time user state data; and
dynamically adapt instructional content output by the adaptive learning platform, by changing a type of the instructional content, based at least in part on the current engagement level,
wherein the user state data includes one or more of:
environmental data associated with an environment in which the user is located,
perceptual data associated with a current state of the user, or
user profile data associated with characterizing parameters of the user; and
wherein the engagement level is further based at least in part on a calculation of interestingness of the instructional content to the user, the calculation based on gaze based parameters of the user as to one or more pre-defined areas of interest of the provided instructional content to the user, and
wherein the type of the instructional content is selected from interactive and non-interactive types of content.

8. The computer-readable media of claim 7 , wherein the user state data includes perceptual data, and wherein the perceptual data includes real-time data associated with one or more of: body posture, head pose, hand gestures, eye tracking, facial expressions, skin conductance, pupil dilation, or heart rate.

9. The computer-readable media of claim 7 , wherein the user state data includes environmental data, and wherein the environmental data includes data associated with one or more of time, date, lighting conditions, noise level, location, temperature, humidity, or weather conditions.

10. The computer-readable media of claim 7 , wherein the adaptive learning platform is further to incorporate the user state data into an evolving user state model associated with the user, wherein the evolving user state model is learned from previously collected user state data.

11. The computer-readable media of claim 10 , wherein to determine an engagement level is further based on the evolving user state model.

12. The computer-readable media of claim 7 , wherein the instructional content is selected from an instructional content type group consisting of: linear content, multimedia content, or interactive content.

13. The computer-readable media of claim 12 , wherein the plurality of instructions, when executed, are further to:
change the instructional content from a current instructional content selected from the instructional content group to another instructional content selected from the instructional content group, wherein the current instructional content and the another instructional content are different from one another.

14. The computer-readable media of claim 7 , wherein the plurality of instructions, when executed, are further to emphasize a portion of the instructional content to draw the user's attention to the portion of instructional content.

15. The computer-readable media of claim 7 , wherein the plurality of instructions, when executed, are further to initiate tutoring of the user to complement the instructional content, wherein the tutoring of the user it at least one of machine tutoring, peer tutoring or expert tutoring.

16. The computer-readable media of claim 15 , wherein the tutoring is peer tutoring or expert tutoring, and wherein to initiate tutoring of the user further comprises to send a notification to a selected computing device of a plurality of computing devices, the selected computing device being associated with either a peer tutor or an expert tutor selected to tutor the user.

17. The computer-readable media of claim 16 , wherein the tutoring is peer tutoring and the selected computing device is associated with a peer tutor indicated as having a mastery of a subject matter of the instructional content.

18. A computing device comprising:
a communication module to communicatively couple the computing device with a plurality of other computing devices each respectively associated with an individual of a plur

Assignees

• Tahoe Res Ltd

Inventors

• Aslan Sinem
• Esme Asli Arslan
• Kamhi Gila
• Ferens Ron
• Diner Itai

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• H04L67/535

  Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34) · CPC title

• G09B19/00

  Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) · CPC title

• G09B5/08 Primary

  providing for individual presentation of information to a plurality of student stations · CPC title

• H04L67/30

  Profiles · CPC title