Mission-based developer certification system and method

Patent metadata

Field	Value
Publication number	US-10747530-B2
Application number	US-201816006567-A
Country	US
Kind code	B2
Filing date	Jun 12, 2018
Priority date	Jun 12, 2018
Publication date	Aug 18, 2020
Grant date	Aug 18, 2020

Abstract

The present disclosure relates to enabling clients to identify qualified developers for software development projects. An example method of operating a developer exchange server includes updating stored progress of developers for mission-related activities, wherein the mission-related activities correspond to features of a software platform, and determining, based on the stored progress of each of the developers, a confidence score for each of the developers for each of the features. The method includes receiving a search request that indicates a subset of the features and corresponding confidence thresholds for each of the subset of features, and in response, determining a ranked listing of qualified developers based on the subset of the features, the corresponding confidence thresholds, and the respective confidence score of each of the developers for each of the subset of features. The method further includes providing the ranked listing of qualified developers in response to the search request.

First claim

What is claimed is:

1. A computing system hosting a developer exchange server that is configured to communicatively couple to a client instance and a developer system, wherein the computing system is configured to perform operations, comprising:
receiving, from the developer system, a request for a training activity;
providing the training activity to the developer system, wherein the training activity comprises documentation associated with a feature of a software platform, an instructional video corresponding to the feature, a coding example utilizing the feature, or a combination thereof, wherein the feature comprises a function of the software platform;
receiving, from the developer system, an indication of progress regarding the training activity, wherein the training activity corresponds to the feature of the software platform associated with the client instance, wherein the request for the training activity is received before receiving the indication of progress;
storing developer progress for the training activity based on the received indication of progress;
receiving, from the client instance, a search request that indicates the feature and a corresponding confidence threshold;
determining a ranked listing of qualified developers based on the feature, the corresponding confidence threshold indicated in the search request, and the stored developer progress, wherein the ranked listing of qualified developers is sorted before being provided in response to the search request; and
providing, to the client instance, the ranked listing of qualified developers.

2. The system of claim 1 , wherein the developer exchange server is communicatively coupled to a database that comprises the stored developer progress.

3. The system of claim 1 , wherein the developer system is configured to present the training activity to a user of the developer system.

4. The system of claim 1 , wherein, to determine the ranked listing of qualified developers, the computer system is configured to perform operations, comprising:
determining a respective confidence score for each of a plurality of developers based on the stored developer progress of the plurality of developers for training activities corresponding to the feature of the software platform;
selecting qualified developers from the plurality of developers, wherein the respective confidence score of each of the qualified developers is greater than the corresponding confidence threshold; and
sorting the qualified developers based on the respective confidence score of each of the qualified developers to generate the ranked list of qualified developers.

5. The system of claim 4 , wherein, to determine the respective confidence score for each of the plurality of developers, the computer system is configured to perform operations, comprising:
determining a respective weight associated with each of the training activities for each of the plurality of developers;
determining a respective percent completion associated with each of the training activities for each of the plurality of developers;
multiplying the respective weight and the respective percent completion associated with each of the training activities to generate a respective partial confidence score for each of the plurality of developers; and
summing the respective partial confidence scores for each of the plurality of developers to generate the respective confidence score for each of the plurality of developers.

6. The system of claim 1 , wherein the ranked listing of qualified developers comprises a respective name and the respective confidence score of each of the qualified developers.

7. The system of claim 1 , wherein, to update the stored developer progress, the computer system is configured to perform operations, comprising:
determining that the training activity is a final training activity of a training mission associated with the feature;
determining that the final training activity of the training mission has been completed; and
updating the stored developer progress to indicate completion of the training activity and the training mission.

8. A method of operating a developer exchange server, comprising:
receiving, from one or more developer systems communicatively coupled to the developer exchange server, requests for mission-related training activities;
in response to the requests, providing the mission-related training activities to the one or more developer systems;
receiving, from the one or more developer systems, indications of developer progress for the mission-related training activities
updating a stored progress of developers for the mission-related training activities based on the received indications of the developer progress, wherein the mission-related training activities comprise documentation associated with a feature of a software platform, instructional videos corresponding to the feature, coding examples utilizing the feature, or a combination thereof, wherein the feature comprises a function of the software platform; wherein the indications of the developer progress are received before updating the stored progress of the developers;
determining, for each of the developers, a respective confidence score for each of a plurality of features, based on the stored progress of each of the developers;
receiving a search request that indicates a subset of features of the plurality of features of the software platform and corresponding confidence thresholds for each of the subset of features;
determining a ranked listing of qualified developers based on the subset of features, the corresponding confidence thresholds indicated in the search request, and the respective confidence score of each of the developers for each of the subset of features; wherein the ranked listing of qualified developers is sorted before being provided in response to the search request; and
providing the ranked listing of qualified developers in response to the search request.

9. The method of claim 8 , wherein determining the ranked listing of qualified developers comprises:
determining a combined confidence score for each of the developers by summing the respective confidence score of each of the developers for each of the subset of features; and
determining the ranked listing of qualified developers by sorting the developers based on the combined confidence score.

10. The method of claim 8 , comprising:
analyzing applications of developers to identify features of the plurality of features; and
updating the stored progress of developers for mission-related training activities based on the identified features.

11. The method of claim 8 , comprising: updating the stored progress of developers for the mission-related training activities based on an amount of time that has passed since the indications of developer progress were received, since the mission-related training activities were updated, or a combination thereof.

12. The method of claim 8 , wherein the search request is received from a communicatively coupled client instance that is associated with the software platform, and wherein the ranked listing of qualified developers is provided to the client instance in response to the search request.

13. The method of claim 8 , wherein determining the respective confidence score for each of the developers for each of the plurality of features comprises:
determining, for each of the developers, a respective weight associated with each of the mission-related training activities for each of the plurality of features;
determining, for each of the developers, a respective percent completion associated with each of the mission-related train

Assignees

• Servicenow Inc

Inventors

• Gupta Sanjay Kumar
• Paul Sarup
• Bellamane Harish Kumar Balachandra

Classifications

• G06Q10/1053

  Employment or hiring · CPC title

• G06F16/90335 Primary

  Query processing · CPC title

• G06F16/24578

  using ranking · CPC title

• G06F8/77 Primary

  Software metrics · CPC title

• G06Q10/063112

  Skill-based matching of a person or a group to a task · CPC title