Creating assessment model for educational assessment system

Patent metadata

Field	Value
Publication number	US-9824604-B2
Application number	US-201213602375-A
Country	US
Kind code	B2
Filing date	Sep 4, 2012
Priority date	Sep 4, 2012
Publication date	Nov 21, 2017
Grant date	Nov 21, 2017

Abstract

A method, a system, and a computer program product for creating an assessment model are disclosed. Marked regions in an electronic document are identified. Thereafter, mark-ups within the marked regions are identified. Based on the identified marked regions and mark-ups the assessment model is created.

First claim

What is claimed is:

1. A method for creating an assessment model for an educational assessment system, the method comprising:
scanning, by one or more processors, a master document to generate an electronic document, wherein the master document is marked by a user;
identifying, by the one or more processors, one or more marked regions in the electronic document, wherein a first type of marked region that comprises a first predetermined indicator is associated with a first type of answer input and a second type of marked region that comprises a second predetermined indicator is associated with a hand-written answer input;
identifying, by the one or more processors, one or more mark-ups within the one or more marked regions, the one or more mark-ups corresponding to contents within the one or more marked regions, the identifying being performed using a chain-code image processing algorithm, wherein:
the first predetermined indicator comprises a first predetermined shape in a first predetermined color, and the mark-ups within the first type of marked region are identified using the chain-code image processing algorithm based on the first type of answer input, first predetermined shape, and the first predetermined color, and
the second predetermined indicator comprises a second predetermined shape in a second predetermined color, and the mark-ups within the second type of marked region are identified using the chain-code image processing algorithm such that handwriting recognition techniques are used to identify hand written mark-ups in a third predetermined color based on the second predetermined shape and the second predetermined color;

creating, by the one or more processors, the assessment model based on the one or more marked regions and the one or more mark-ups using the chain-code image processing algorithm, wherein
the assessment model comprises one or more key regions corresponding to the one or more marked regions that are used to assess answers contained in one or more assessment documents, and
for a key region that corresponds to the first type of marked region, answers are assessed based on the first type of answer input, and for a key region that corresponds to a second type of marked region, answers are assessed based on the hand-written answer input;

editing, by a user, the created assessment model via a graphical user interface (GUI) such that at least one of the key regions is edited by adjusting a value of the key region;
removing, by the one or more processors, the one or more marked regions and the one or more mark-ups from the electronic document to generate the one or more assessment documents;
receiving a completed assessment document generated by the removing, wherein the completed assessment document comprises mark-ups that correspond to answers; and
assessing the accuracy of the mark-ups of the completed assessment document based on the created and edited assessment model, wherein
the assessment model is used to identify locations for the mark-ups of the completed assessment document based on the one or more identified marked regions used to create the assessment model,
the at least one edited key region of the assessment model is used to assess the accuracy of at least one of the mark-ups of the completed assessment document by comparing the adjusted value of the key region with a value corresponding to the at least one mark-up of the completed assessment document, and
for at least one key region that corresponds to the second type of marked region and the hand-written answer input, performing handwriting recognition techniques on the answer such that the recognized handwriting is compared to the key region that correspond to the at least one key region.

2. The method of claim 1 , wherein the electronic document is a digital image.

3. The method of claim 1 , wherein the electronic document is a digital image and the one or more marked regions comprise one or more regions highlighted with one or more colors.

4. The method of claim 1 , wherein removing the one or more marked regions and the one or more mark-ups comprises removing any mark from the electronic document that does not match a predefined color.

5. The method of claim 1 , wherein
the first type of answer input indicated by the predetermined first indicator comprises a multiple choice answer input.

6. An educational assessment system for creating an assessment model, the educational assessment system comprising:
one or more processors configured to:
identify one or more marked regions in an electronic document, wherein the electronic document is obtainable by scanning a master document marked by a user, wherein a first type of marked region that comprises a first predetermined indicator is associated with a first type of answer input and a second type of marked region that comprises a second predetermined indicator is associated with a hand-written answer input;
identify one or more mark-ups within the one or more marked regions, the one or more mark-ups corresponding to contents within the one or more marked regions, the identifying being performed using a chain-code image processing algorithm, wherein
the first predetermined indicator comprises a first predetermined shape in a first predetermined color, and the mark-ups within the first type of marked region are identified using the chain-code image processing algorithm based on the first type of answer input, first predetermined shape, and the first predetermined color, and
the second predetermined indicator comprises a second predetermined shape in a second predetermined color, and the mark-ups within the second type of marked region are identified using the chain-code image processing algorithm such that handwriting recognition techniques are used to identify hand written mark-ups in a third predetermined color based on the second predetermined shape and the second predetermined color;

create the assessment model based on the one or more marked regions and the one or more mark-ups using the chain-code image processing algorithm, wherein
the assessment model comprises one or more key regions corresponding to the one or more marked regions that are used to assess answers contained in one or more assessment documents, and
for a key region that corresponds to the first type of marked region, answers are assessed based on the first type of answer input, and for a key region that corresponds to the second type of marked region, answers are assessed based on the hand-written answer input;

edit, by a user, the created assessment model via a graphical user interface (GUI) such that at least one of the key regions is edited by adjusting a value of the key region; and
remove the one or more marked regions and the one or more mark-ups from the electronic document to generate the one or more assessment documents;
receive a completed assessment document generated by the removing, wherein the completed assessment document comprises mark-ups that correspond to answers; and
assess the accuracy of the mark-ups of the completed assessment document based on the created and edited assessment model, wherein
the assessment model is used to identify locations for the mark-ups of the completed assessment document based on the one or more identified marked regions used to create the assessment model,
the at least one edited key region of the assessment model is used to assess the accuracy of at least one of the mark-ups of the completed assessment document by comparing the adjusted value of the key region with a value corresponding to the at least one mark-up of the completed assessment document, and
for at least one key region that corresponds to the second type of marked region and the hand-written answer input, performing handwriting recognition techniqu

Assignees

• Venable Dennis L
• Conduent Business Services Llc

Inventors

• Venable Dennis L

Classifications

• G09B7/00

  Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F) · CPC title

• G09B7/06 Primary

  of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers · CPC title