Asynchronous oral assessment

Patent metadata

Field	Value
Publication number	US-2026018074-A1
Application number	US-202519264124-A
Country	US
Kind code	A1
Filing date	Jul 9, 2025
Priority date	Jul 9, 2024
Publication date	Jan 15, 2026
Grant date	—

Abstract

A system may include a web server to receive an input associated with a first user, where the input includes an assessment question and associates the assessment question with a rubric, where the rubric includes a set of criteria, where each criterion of the set of criteria includes a description and a scale with a set of scale values. The system may further include a media server to receive an audiovisual input associated with a second user. The web server may be further configured to generate an evaluation tool accessible by the first user, where the audiovisual recording is embedded in the evaluation tool, and where the evaluation tool further includes a transcript of the audiovisual recording, an analysis of communication metrics associated with the audiovisual recording, and the rubric. The media server may also enable streaming of the audiovisual recording embedded in the evaluation tool.

First claim

What is claimed is:

1 . A system comprising at least one processor and memory, wherein the memory stores instructions that, when executed by the processor, cause the processor to:
receive association input associated with a first user, wherein the association input associates an assessment question with a rubric, wherein the rubric includes a set of criteria, wherein each criterion of the set of criteria includes a criterion description and a scale that associates a set of scale descriptions with a set of scale values; receive an audiovisual input associated with a second user, wherein the audiovisual input includes an audiovisual recording; generate an evaluation tool output accessible by the first user, wherein the evaluation tool output includes an evaluation tool, wherein the audiovisual recording is embedded in the evaluation tool, and wherein the evaluation tool includes a transcript of the audiovisual recording, an analysis of communication metrics associated with the audiovisual recording, and the rubric.

2 . The system of claim 1 , wherein the instructions further cause the processor to receive an assessment creation input associated with the first user, wherein the assessment creation input includes the assessment question.

3 . The system of claim 2 , wherein the assessment creation input further includes an assessment name, a start date, a start time, an end date, an end time, a number of points associated with the assessment question, a preparation duration associated with the assessment question, a response duration associated with the assessment question, or a combination thereof.

4 . The system of claim 3 , wherein the assessment creation input further includes at least one additional assessment question, an additional number of points associated with the at least one additional assessment question, an additional preparation duration associated with the at least one additional assessment question, and an additional response duration associated with the at least one additional assessment question.

5 . The system of claim 1 , wherein the instructions further cause the processor to generate an assessment question based on stored writings associated with a second user using an artificial intelligence model.

6 . The system of claim 1 , wherein the instructions further cause the processor to:
generate the transcript of the audiovisual recording; extract linguistic metrics from the transcript; extract paralinguistic metrics from audio associated with the audiovisual recording; generate the analysis of the communication metrics based on the transcript, the linguistic metrics, the paralinguistic metrics, or a combination thereof.

7 . The system of claim 6 , wherein the instructions further cause the processor to:
extract nonverbal metrics from video associated with the audiovisual recording; and generate the analysis of the communication metrics based further on the nonverbal metrics.

8 . The system of claim 1 , wherein the instructions further cause the processor to:
receive a rubric input corresponding to the first user, wherein the rubric input includes a rubric title, a rubric description, and for each of the set of criteria, the criterion description, at least one scale description, and at least one scale value; generate the rubric based on the rubric input; and store the rubric with a set of rubrics, wherein associating the assessment question with the rubric includes selecting the rubric from the set of rubrics.

9 . The system of claim 1 , wherein the rubric is automatically generated by an artificial intelligence model.

10 . The system of claim 1 , wherein the instructions further cause the processor to generate an assessment output accessible by the second user, the assessment output including a reveal question button, a preparation timer, a start recording button, a response timer, a video feed, a stop recording button, or any combination thereof.

11 . The system of claim 10 , wherein the assessment output is incorporated into a scientific data collection interface module.

12 . The system of claim 10 , wherein the instructions further cause the processor to receive access input corresponding to the first user wherein the access input includes a set of user identities, wherein access to the assessment output is limited to users whose identities are in the set of user identities.

13 . The system of claim 1 , wherein the instructions further cause the processor to:
receive a score input corresponding to the first user, wherein the score input includes a selection of scale values for each criterion of the set of criteria; and generate a score output accessible by the second user, wherein the score output includes a score based at least partially on the selection scale values.

14 . The system of claim 1 , wherein the receiving the audiovisual input and generating the evaluation tool output are performed asynchronously, wherein multiple additional inputs may be received from multiple additional users simultaneously with the second input, wherein the multiple additional inputs include multiple additional audiovisual recordings.

15 . A system comprising:
a web server configured to receive an association input associated with a first user, wherein the association input associates an assessment question with a rubric, wherein the rubric includes a set of criteria, wherein each criterion of the set of criteria includes a criterion description and a scale that associates a set of scale descriptions with a set of scale values; a media server configured to receive an audiovisual input associated with a second user, wherein the audiovisual input includes an audiovisual recording, wherein the web server is further configured to generate an evaluation tool output, wherein the evaluation tool output includes an evaluation tool, accessible by the first user, wherein the audiovisual recording is embedded in the evaluation tool, and wherein the evaluation tool further includes a transcript of the audiovisual recording, an analysis of communication metrics associated with the audiovisual recording, and the rubric, and wherein the media server enables streaming of the audiovisual recording embedded in the evaluation tool.

16 . The system of claim 15 , wherein the web server is configured to receive assessment creation input associated with the first user, wherein the assessment creation input includes the assessment question.

17 . The system of claim 15 , further comprising an artificial intelligence and machine learning engine configured to be used to generate the assessment question based on stored writings associated with the second user using an artificial intelligence model.

18 . The system of claim 15 , wherein the web server is configured to generate an assessment output, and wherein the assessment output is incorporated into a scientific data collection interface module.

19 . The system of claim 15 , further comprising a video storage and analytics module configured to:
perform at least one of the following:
generate the transcript of the audiovisual recording;
extract linguistic metrics from the transcript;
extract paralinguistic metrics from audio associated with the audiovisual recording; or
extract nonverbal metrics from video associated with the audiovisual recording; and
generate the analysis of the communication metrics based on the transcript, the linguistic metrics, the paralinguistic metrics, the nonverbal metrics, or any combination thereof.

Assignees

• Univ Boise State

Inventors

• Pentland Steven

Classifications

• G09B5/12

  different stations being capable of presenting different information simultaneously (G09B5/14 takes precedence) · CPC title

• G09B5/065 Primary

  Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems · CPC title

• G09B7/02

  of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student · CPC title