Image analysis for attendance query evaluation

Patent metadata

Field	Value
Publication number	US-2016191995-A1
Application number	US-201615061385-A
Country	US
Kind code	A1
Filing date	Mar 4, 2016
Priority date	Sep 30, 2011
Publication date	Jun 30, 2016
Grant date	—

Abstract

Facial evaluation is performed on one or more videos captured from an individual viewing a display. The images are evaluated to determine whether the display was viewed by the individual. The individual views a media presentation that includes incorporated tags and is rendered on the display. Based on the tags, video of the individual is captured and evaluated using a classifier. The evaluating includes determining whether the individual is in front of the screen, facing the screen, and gazing at the screen. An engagement score and emotional responses are determined for media and images provided on the display.

First claim

What is claimed is:

1 . A computer-implemented method for analysis comprising:
receiving a plurality of images of an individual viewing an electronic display; identifying a face of the individual wherein:
the identifying is based on a plurality of image classifiers;
the identifying occurs for at least one of the plurality of images; and
the plurality of image classifiers are used to perform head pose estimation; and
evaluating the plurality of images to determine that the electronic display was attended by the individual with the face.

2 . The method of claim 1 wherein the receiving is in response to tagging of media rendered on the electronic display.

3 . The method of claim 1 wherein being attended by the individual includes viewing of the electronic display.

4 . The method of claim 3 wherein determination that the electronic display was attended is used in determining viewership.

5 . The method of claim 3 wherein the electronic display renders an object and the viewing includes viewing the object.

6 . The method of claim 1 wherein being attended by the individual includes determining viewability of digital media content from the electronic display.

7 . The method of claim 6 wherein viewability includes evaluation of presence of digital media content and whether the digital media content is viewable by the individual.

8 . The method of claim 7 wherein the evaluating the plurality of images includes scoring the digital media content.

9 . The method of claim 8 wherein the scoring includes scoring for emotional reaction by the individual.

10 . The method of claim 9 wherein the emotional reaction includes engagement.

11 . The method of claim 8 wherein the digital media content includes an advertisement.

12 . The method of claim 7 further comprising modifying the digital media content based on the viewability.

13 . The method of claim 6 further comprising modifying the digital media content based on viewership.

14 . The method of claim 1 further comprising performing eye gaze detection using the plurality of image classifiers.

15 . The method of claim 1 wherein the evaluating the plurality of images is accomplished without eye tracking.

16 . The method of claim 1 wherein the electronic display renders an advertisement and the advertisement has tagging incorporated.

17 . The method of claim 16 further comprising invoking the evaluating based on the tagging that was incorporated.

18 - 19 . (canceled)

20 . The method of claim 1 further comprising determining an engagement score for the individual.

21 . (canceled)

22 . The method of claim 1 wherein an image classifier from the plurality of image classifiers is used to evaluate head pose for the individual.

23 . The method of claim 1 wherein the evaluating is used as part of a viewership determination across a plurality of people.

24 . The method of claim 1 further comprising evaluating emotional responses by the individual.

25 . The method of claim 1 further comprising opting in by the individual for collection of the plurality of images.

26 . The method of claim 25 wherein the opting in is persistent and was accomplished before an advertisement is rendered on the electronic display.

27 - 28 . (canceled)

29 . The method of claim 1 further comprising receiving a second plurality of images of a second individual viewing a second electronic display; identifying a second face of the second individual wherein the identifying the second face is based on the plurality of image classifiers and wherein the identifying the second face occurs for at least one of the second plurality of images; evaluating the second plurality of images to determine that the second electronic display was attended by the second individual; and determining a viewership score based on the evaluating the plurality of images and the evaluating the second plurality of images.

30 . The method of claim 1 wherein the evaluating comprises: determining regions within the face of the individual and evaluating the regions for emotional content.

31 . A computer program product embodied in a non-transitory computer readable medium for analysis, the computer program product comprising:
code for receiving a plurality of images of an individual viewing an electronic display; code for identifying a face of the individual wherein:
the identifying is based on a plurality of image classifiers;
the identifying occurs for at least one of the plurality of images; and
the plurality of image classifiers are used to perform head pose estimation; and
code for evaluating the plurality of images to determine that the electronic display was attended by the individual.

32 . A computer system for analysis comprising:
a memory which stores instructions; one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to:
receive a plurality of images of an individual viewing an electronic display;
identify a face of the individual wherein:
identification is based on a plurality of image classifiers;
identification occurs for at least one of the plurality of images; and
the plurality of image classifiers are used to perform head pose estimation; and

evaluate the plurality of images to determine that the electronic display was attended by the individual with the face.

Assignees

• Affectiva Inc

Inventors

• El Kaliouby Rana
• Langeveld Nicholas
• Mcduff Daniel
• Mavadati Seyedmohammad

Classifications

• G16H50/70

  for mining of medical data, e.g. analysing previous cases of other patients · CPC title

• A61B5/163

  by tracking eye movement, gaze, or pupil change · CPC title

• G16H50/30

  for calculating health indices; for individual health risk assessment · CPC title

• G06T2207/30201

  Face · CPC title

• H04N21/4532

  involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18) · CPC title