Systems and methods for validating localized assessments in an external system

Patent metadata

Field	Value
Publication number	US-11430346-B2
Application number	US-202117443869-A
Country	US
Kind code	B2
Filing date	Jul 28, 2021
Priority date	Dec 1, 2019
Publication date	Aug 30, 2022
Grant date	Aug 30, 2022

Abstract

Disclosed are some implementations of systems, apparatus, methods and computer program products for facilitating the validation of assessments in an eLearning environment. Validation is facilitated using an assessment definition that includes one or more application programming interfaces (APIs) and identifies, for each of the APIs, a corresponding plugin and handler. Each of the APIs is configurable to obtain at least one user response to a corresponding challenge task via the corresponding plugin and each handler is configurable to validate the user response returned via the corresponding API. The accuracy of the user response to each challenge task is determined via the corresponding handler identified within the assessment definition. APIs can include a third party API, enabling validation of user responses across different systems. The user's knowledge may be assessed based upon the accuracy of the user's responses to all of the challenge tasks.

First claim

What is claimed is:

1. A system comprising:
one or more processors; and
a database system implemented using a server system, the database system configurable to cause:
identifying an assessment definition for an assessment for a user, the assessment definition identifying, for an interface, a plugin and a handler, the handler configurable to validate user responses using at least one of data or metadata;
obtaining, via the interface, at least one of data or metadata pertaining to a user response to a corresponding challenge task via the plugin;
providing, to a service external to the database system, the handler and the user response;
processing an indication, received from the service, that the user response is correct;
determining, using the handler and based at least in part on a result of processing the indication, that the at least one of the data or metadata indicates that the user response is correct;
updating aggregated challenge task results based at least in part on a result of the determining that the at least one of the data or metadata indicates that the user response is correct; and
assessing knowledge of the user based at least in part on the aggregated challenge task results.

2. The system as recited in claim 1 , the interface including a third party interface, and the plugin being configured to obtain the at least one of the data or metadata from a computing system external to the database system.

3. The system as recited in claim 1 , the assessment definition including:
a first interface corresponding to a first plugin configured to obtain data or metadata pertaining to at least one user response from a first computing system, and
a second interface corresponding to a second plugin configured to obtain data or metadata pertaining to at least one user response from a second computing system different from the first computing system, at least one of the first computing system or the second computing system being external to the database system.

4. The system as recited in claim 1 , the interface configured to query a corresponding computing system for the user response or a particular response requested from the user for the corresponding challenge task.

5. The system as recited in claim 1 , the database system further configurable to cause:
ascertaining a locale of the user; and
replacing during runtime a variable of a parameter in the assessment definition with a value corresponding to the locale of the user.

6. The system as recited in claim 1 , the database system further configurable to cause:
obtaining a response from the handler; and
translating, during runtime, the response or a portion thereof according to a locale of the user.

7. The system as recited in claim 1 , the interface including one or more application programming interfaces (APIs).

8. A method comprising:
identifying an assessment definition for an assessment for a user, the assessment definition identifying, for an interface, a plugin and a handler, the handler configurable to validate user responses using at least one of data or metadata;
obtaining, via the interface, at least one of data or metadata pertaining to a user response to a corresponding challenge task via the plugin;
providing, to a service external to a database system, the handler and the user response;
processing an indication, received from the service, that the user response is correct;
determining, using the handler and based at least in part on a result of processing the indication, that the at least one of the data or metadata indicates that the user response is correct;
updating aggregated challenge task results based at least in part on a result of the determining that the at least one of the data or metadata indicates that the user response is correct; and
assessing knowledge of the user based at least in part on the aggregated challenge task results.

9. The method as recited in claim 8 , the interface including a third party interface, and the plugin being configured to obtain the at least one of the data or metadata from a computing system external to the database system.

10. The method as recited in claim 8 , the assessment definition including:
a first interface corresponding to a first plugin configured to obtain data or metadata pertaining to at least one user response from a first computing system, and
a second interface corresponding to a second plugin configured to obtain data or metadata pertaining to at least one user response from a second computing system different from the first computing system, at least one of the first computing system or the second computing system being external to the database system.

11. The method as recited in claim 8 , the interface configured to query a corresponding computing system for the user response or a particular response requested from the user for the corresponding challenge task.

12. The method as recited in claim 8 , further comprising:
ascertaining a locale of the user; and
replacing during runtime a variable of a parameter in the assessment definition with a value corresponding to the locale of the user.

13. The method as recited in claim 8 , further comprising:
obtaining a response from the handler; and
translating, during runtime, the response or a portion thereof according to a locale of the user.

14. A computer program product comprising a non-transitory computer-readable medium storing computer-readable program code capable of being executed by one or more processors, the program code comprising computer-readable instructions configurable to cause:
identifying an assessment definition for an assessment for a user, the assessment definition identifying, for an interface, a plugin and a handler, the handler configurable to validate user responses using at least one of data or metadata;
obtaining, via the interface, at least one of data or metadata pertaining to a user response user to a corresponding challenge task via the plugin;
providing, to a service external to a database system, the handler and the user response;
processing an indication, received from the service, that the user response is correct;
determining, using the handler and based at least in part on a result of processing the indication, that the at least one of the data or metadata indicates that the user response is correct;
updating aggregated challenge task results based at least in part on a result of the determining that the at least one of the data or metadata indicates that the user response is correct; and
assessing knowledge of the user based at least in part on the aggregated challenge task results.

15. The computer program product as recited in claim 14 , the interface including a third party interface, and the plugin being configured to obtain the at least one of the data or metadata from a computing system external to the database system.

16. The computer program product as recited in claim 14 , the assessment definition including:
a first interface corresponding to a first plugin configured to obtain data or metadata pertaining to at least one user response from a first computing system, and
a second interface corresponding to a second plugin configured to obtain data or metadata pertaining to at least one user response from a second computing system different from the first computing system, at least one of the first computing system or the second computing system being external to the database system.

17. The computer program product as recited in claim 14 , the interface configured to query a corresponding computing system

Assignees

• Salesforce Com Inc
• Salesforce Inc

Inventors

• Douglas Jeff
• Powers Justin Scott
• Yeh Joyce
• Cocron Stephan
• Torman Adam
• Bitting Douglas

Classifications

• G06F9/547 Primary

  Remote procedure calls [RPC]; Web services · CPC title

• G06F9/54

  Interprogram communication · CPC title

• G09B7/02

  of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student · CPC title

• G09B7/00 Primary

  Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F) · CPC title

• G06F9/44526

  Plug-ins; Add-ons · CPC title