Methods, systems, and computer readable media for automated behavioral assessment

Patent metadata

Field	Value
Publication number	US-11158403-B1
Application number	US-201615141391-A
Country	US
Kind code	B1
Filing date	Apr 28, 2016
Priority date	Apr 29, 2015
Publication date	Oct 26, 2021
Grant date	Oct 26, 2021

Abstract

The subject matter described herein includes methods, systems, and computer readable media for automated behavioral assessment. According to one aspect, a method for automated behavioral assessment is provided. The method occurs at a computing platform including a processor and memory. The method includes providing at least one stimulus for eliciting a response from a user. The method also includes obtaining, using a camera or sensor communicatively coupled to the computing platform, the at least one response. The method also includes determining, using the at least one response, a behavioral assessment associated with the user.

First claim

What is claimed is:

1. A method for automated behavioral assessment, the method comprising:
at a computing platform including a processor and memory:
identifying skills and risk factors associated with a user based on user interactions;
providing at least one stimulus for eliciting at least one response from the user, wherein the at least one stimulus includes a first stimulus determined using the skills and the risk factors associated with the user, wherein the at least one stimulus includes an assessment video containing a non-social component and a social component;
obtaining, using a camera or sensor communicatively coupled to the computing platform, at least one response, wherein the camera or sensor records the at least one response from the user; and
determining, using the at least one response, a behavioral assessment associated with the user, wherein determining the behavioral assessment associated with the user includes analyzing video of the user for determining whether the at least one response is indicative of a behavioral disorder, wherein analyzing the video of the user comprises:
identifying, using a response recognition algorithm, a facial area using identifiable facial landmarks at various angles and/or head positions;
detecting changes to the identified facial area using the response recognition algorithm, wherein detecting changes includes detecting an amount of time the user spent attending to the non-social component or the social component of the assessment video, wherein detecting changes includes analyzing, using a pose-invariant dictionary, the at least one response to identify one or more facial expressions of the user during the at least one response, wherein the pose-invariant dictionary contains three dimensional (3D) shape and morphological information derived from a first dataset and two dimensional (2D) texture and geometric information derived from a second dataset, wherein the pose-invariant dictionary contains 3D features for a plurality of subjects and 2D features based on synthesized head poses for the plurality of subjects; and
determining, based on the changes, that the at least one response is indicative of a behavioral disorder, wherein determining that the at least one response is indicative of the behavioral disorder includes determining, by comparing the at least one response from the user to at least one baseline response associated with the at least one stimulus, that the at least one response from the user is indicative of the behavioral disorder, wherein comparing the at least one response from the user to at least one baseline response associated with the at least one stimulus includes determining that the amount of time the user spent attending to the non-social component or the social component meets or exceeds an assessment threshold indicative of the behavior disorder, wherein comparing the at least one response from the user to at least one baseline response associated with the at least one stimulus includes detecting a user's lack of expressiveness as compared to an expressiveness baseline, wherein comparing the at least one response from the user to at least one baseline response associated with the at least one stimulus includes:
measuring a first response delay between when a video-based non-social stimulus of the at least one stimulus is provided and when a first response of the at least one response from the user is detected,
determining, using a first baseline response delay indicative of normal behavior associated with the video-based non-social stimulus, whether the first response delay meets or exceeds a second assessment threshold indicative of the behavioral disorder,
measuring a second response delay between when a video-based social stimulus of the at least one stimulus is provided and when a second response of the at least one response from the user is detected, and
determining, using a second baseline response delay indicative of normal behavior associated with the video-based social stimulus, whether the second response delay meets or exceeds a third assessment threshold indicative of the behavioral disorder, wherein the first baseline response delay is different from the second baseline response delay and wherein the second assessment threshold is different from the third assessment threshold.

2. The method of claim 1 comprising:
providing the behavioral assessment or related data to the user, a medical records system, a service provider, a healthcare provider, a caregiver of the user, or any combination thereof; or
providing follow-up information for contacting a service provider, wherein the follow-up information may include a list of service providers, a hyperlink associated with a service provider, an email address associated with a service provider, a chat identifier associated with a service provider, a phone number associated with a service provider, a name associated with a service provider, an address associated with a service provider, a website associated with a service provider, or any combination thereof.

3. The method of claim 1 wherein the at least one stimulus includes game mechanics, a video, an image, text, a sound, a color, or any combination thereof.

4. The method of claim 1 wherein the at least one stimulus is associated with one or more baseline responses for comparison to the at least one response from the user.

5. The method of claim 1 wherein the at least one stimulus is generated for eliciting the at least one response from the user based on historical information, psychological information, clinical information, personal information, or any combination thereof.

6. The method of claim 1 wherein the at least one response includes a facial expression, a tongue movement, a facial movement, an eye movement, a vocal response, a heartrate change, blinking, blushing, a behavioral response, an emotional response, a physical response, a response delay, a lack of response, or any combination thereof.

7. The method of claim 1 wherein providing the at least one stimulus for eliciting the at least one response from the user includes utilizing a stimuli-feedback loop involving different, additional, or dynamic stimuli based on one or more prior user responses.

8. The method of claim 1 wherein the camera or sensor includes a two dimensional camera, a three dimensional camera, a heat-sensor camera, an infrared camera, a gyroscope sensor, a motion sensor, a light sensor, or any combination thereof.

9. The method of claim 1 wherein the behavioral assessment includes a behavioral coding, a mental health screening or diagnosis, an autism diagnosis, an attention deficient hyperactivity disorder (ADHD), an anxiety disorder diagnosis, an aggressiveness disorder diagnosis, an indicator indicating a likelihood of the behavioral disorder, a score or weight associated with the at least one stimulus or the at least one response, a recommendation, a referral to a service provider, a mental health related report, or any combination thereof.

10. The method of claim 1 wherein the third assessment threshold is based on a statistically significant deviation of the second baseline response delay.

11. The method of claim 1 wherein the computing platform includes a mobile device, a smartphone, a tablet computer, a laptop computer, a computer, a behavioral assessment device, or a medical device.

12. A system for automated behavioral assessment, the system comprising:
a computing platform including a processor and memory, the computing platform including:
a behavioral assessment module (BAM) implemented using the processor and the memory configured to identify skills and risk factors associated with a user

Assignees

• Univ Duke

Inventors

• Sapiro Guillermo
• Egger Helen
• Dawson Geraldine
• Calderbank Robert
• Baker Jeffrey
• Carpenter Kimberly
• Harris Adrianne
• Campbell Kathleen
• Hashemi Jordan
• Qiu Qiang
• Tepper Mariano

Classifications

• G16H50/30 Primary

  for calculating health indices; for individual health risk assessment · CPC title

• G16H50/20

  for computer-aided diagnosis, e.g. based on medical expert systems · CPC title

• G16H40/60

  for the operation of medical equipment or devices · CPC title

• G16H30/40

  for processing medical images, e.g. editing · CPC title

• G16H10/60 Primary

  for patient-specific data, e.g. for electronic patient records · CPC title