Adaptive feedback timing system

Patent metadata

Field	Value
Publication number	US-12197307-B2
Application number	US-202117404304-A
Country	US
Kind code	B2
Filing date	Aug 17, 2021
Priority date	Aug 17, 2021
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

An adaptive feedback timing system and method includes receiving, by a performance observation system, monitoring data associated with electronically monitoring a lesson by a variable feedback teaching device. Adaptive feedback timing also includes receiving, by the performance observation system, error detection data associated with the variable feedback teaching device automatically detecting an error made by a student during the lesson. After receiving the error detection data, a feedback pattern is automatically selected based on a performance history criterion. Feedback data is then communicated to the variable feedback teaching device for presentation to the student according to the automatically selected feedback pattern.

First claim

What is claimed is:

1. A method comprising:
receiving, by a performance observation system, monitoring data associated with electronically monitoring a lesson by a variable feedback teaching device;
receiving, by the performance observation system, error detection data associated with the variable feedback teaching device automatically detecting an error made by a student during the lesson;
after receiving the error detection data, automatically selecting a feedback pattern based on a performance history criterion, wherein the performance history criterion comprises a past performance metric associated with the student at a point in the lesson at which the error was automatically detected, and wherein the past performance metric indicates whether the student has previously committed the error, and wherein automatically selecting the feedback pattern comprises automatically selecting, from a plurality of feedback patterns, a particular feedback pattern that causes feedback to be provided to the student according to a particular timing based on whether the student has previously committed the error; and
communicating feedback data to the variable feedback teaching device for presentation to the student according to the automatically selected feedback pattern.

2. The method of claim 1 , wherein the feedback pattern is automatically selected from among an immediate feedback pattern, a breakpoint feedback pattern, and an end-of-lesson feedback pattern, further comprising, after automatically detecting the error, classifying the error according to an error category, wherein the error category is one of an incorrect answer category, an out of sequence category, or a wrong state category, wherein the performance history criterion further comprises a second past performance metric associated with the student for the lesson, a second past performance metric associated with the student for a second lesson, or a combination thereof.

3. The method of claim 1 , wherein the feedback pattern is automatically selected from among an immediate feedback pattern, a breakpoint feedback pattern, and an end-of-lesson feedback pattern.

4. The method of claim 1 , wherein the variable feedback teaching device is incorporated into a cockpit simulator.

5. The method of claim 1 , wherein the performance history criterion further comprises a second past performance metric associated with the student for the lesson.

6. The method of claim 5 , wherein the second past performance metric indicates whether the student has previously performed below a success threshold for the lesson, and wherein automatically selecting the feedback pattern comprises automatically selecting, from a plurality of feedback patterns, a particular feedback pattern that causes feedback to be provided to the student according to a particular timing based on whether the student has previously performed below the success threshold.

7. The method of claim 1 , wherein the performance history criterion further comprises a second past performance metric associated with the student for a second lesson.

8. The method of claim 7 , wherein the second past performance metric indicates whether the student has made a second error in the second lesson, wherein the second error is thematically similar to the error, and wherein automatically selecting the feedback pattern comprises, in response to determining that the error is thematically similar to the second error, automatically selecting, from a plurality of feedback patterns, a particular feedback pattern that causes feedback to be provided to the student according to a particular timing based on whether the student committed the second error.

9. The method of claim 8 , further comprising determining that the error is thematically similar to the second error based on the error occurring during a portion of the lesson having the same subject matter as a portion of the second lesson during which the student made the second error.

10. The method of claim 1 , wherein the performance history criterion further comprises a second past performance metric associated with a plurality of students at a point in the lesson at which the error was automatically detected.

11. The method of claim 10 , wherein the second past performance metric indicates a count of additional students that have committed the error, and wherein automatically selecting the feedback pattern comprises automatically selecting, from a plurality of feedback patterns, a particular feedback pattern that causes feedback to be provided to the student according to a particular timing based on a comparison of the count of additional students that committed the error to a group performance threshold.

12. The method of claim 1 , wherein the performance history criterion further comprises a second past performance metric associated with a plurality of students for the lesson or with a plurality of students for a second lesson.

13. The method of claim 1 , further comprising, after automatically detecting the error, classifying the error according to an error category, wherein the error category is one of an incorrect answer category, an out of sequence category, or a wrong state category.

14. The method of claim 13 , wherein the performance history criterion further comprises a second past performance metric associated with a student's performance in the error category.

15. The method of claim 14 , wherein the second past performance metric indicates whether the student has previously performed below a success threshold associated with the error category, and wherein automatically selecting the feedback pattern comprises automatically selecting, from a plurality of feedback patterns, a particular feedback pattern that causes feedback to be provided to the student according to a particular timing based on whether the student has previously performed below the success threshold associated with the error category.

16. A non-transient, computer-readable medium storing instructions executable by one or more processors to perform operations comprising:
receiving, by a performance observation system, monitoring data associated with electronically monitoring a lesson by a variable feedback teaching device;
receiving, by the performance observation system, error detection data associated with the variable feedback teaching device automatically detecting an error made by a student during the lesson;
after receiving the error detection data, automatically selecting a feedback pattern based on a performance history criterion, wherein the performance history criterion comprises a past performance metric associated with the student at a point in the lesson at which the error was automatically detected, and wherein the past performance metric indicates whether the student has previously committed the error, and wherein automatically selecting the feedback pattern comprises automatically selecting, from a plurality of feedback patterns, a particular feedback pattern that causes feedback to be provided to the student according to a particular timing based on whether the student has previously committed the error; and
communicating feedback data to the variable feedback teaching device for presentation to the student according to the automatically selected feedback pattern.

17. The non-transient, computer-readable medium of claim 16 , wherein the feedback pattern is automatically selected from among an immediate feedback pattern, a breakpoint feedback pattern, and an end-of-lesson feedback pattern.

18. A system comprising:
a memory configured to store instr

Assignees

• Boeing Co
• The Boieng Company

Inventors

• Boyer Cristina

Classifications

• G09B7/00

  Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F) · CPC title

• G09B9/301

  by computer-processed or -generated image · CPC title

• G06F11/3457

  Performance evaluation by simulation · CPC title

• G09B5/065

  Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems · CPC title

• G09B7/08

  characterised by modifying the teaching program in response to a wrong answer, e.g. repeating the question or supplying further information · CPC title