Display orientation adjustment using facial landmark information

Patent metadata

Field	Value
Publication number	US-10890965-B2
Application number	US-201213586307-A
Country	US
Kind code	B2
Filing date	Aug 15, 2012
Priority date	Aug 15, 2012
Publication date	Jan 12, 2021
Grant date	Jan 12, 2021

Abstract

Systems and methods disclosed herein may operate to adjust display orientation of a user device based on facial landmark information. In various embodiments, information identifying and describing a facial landmark of a user may be received via a user device corresponding to the user. Head orientation of the user may be determined based at least in part on the information identifying and describing the facial landmark. A display unit of the user device may be automatically signaled to align display orientation of contents being presented with the head orientation as determined based at least in part on the information identifying and describing the facial landmark.

First claim

What is claimed is:

1. An apparatus comprising:
a display unit to display contents; and
one or more processors to execute a display management module, the display management module configured to:
detect a change in a device orientation of the apparatus;
receive information identifying and describing a facial landmark of a user, in response to the change in the device orientation;
perform a comparison of the information identifying and describing the facial landmark of the user with preregistered facial feature recognition information associated with the user;
determine a facial expression and a head orientation of the user based at least in part on the information identifying and describing the facial landmark, in response to the comparison of the information identifying and describing the facial landmark with the preregistered facial feature recognition information associated with the user;
determine the head orientation transgresses a threshold time value;
access a function of the apparatus associated with the facial expression and the head orientation, in response to the head orientation transgressing the threshold time value, the function including a security function; and
perform the security function associated with the facial expression and the head orientation, wherein the security function includes locking the display unit of the user device based on determining that the facial expression matches a facial expression from among the preregistered facial feature recognition information associated with the user.

2. The apparatus of claim 1 , wherein the information identifying and describing the facial landmark comprises:
information identifying and describing at least one of hairs, eyebrows, eyes, glasses, ears, a forehead, a nose or a mouth of the user.

3. The apparatus of claim 1 , wherein the display management module is configured to determine the head orientation based at least in part on shape and position information included in the information identifying and describing the facial landmark.

4. The apparatus of claim 1 , further comprising:
memory to store data identifying and describing facial landmarks of a plurality of other users.

5. The apparatus of claim 4 , wherein the display management module is configured to determine the head orientation based at least in part on comparing the facial landmark of the user with at least a portion of facial landmarks of the plurality of other users.

6. The apparatus of claim 1 , further comprising: a camera to capture the information identifying and describing the facial landmark.

7. The apparatus of claim 1 , wherein the display management module is further configured to:
receive information identifying and describing a plurality of facial landmarks of the user;
calculate, based on the information identifying and describing the plurality of facial landmarks of the user, a relative location for each of the plurality of facial landmarks; and
determine the head orientation based at least in part on the relative location for each of the plurality of facial landmarks.

8. A method comprising:
detecting a change in a device orientation;
receiving, via a user device corresponding to a user, information identifying and describing a facial landmark of the user, in response to the change in the device orientation;
performing a comparison of the information identifying and describing the facial landmark of the user with preregistered facial feature recognition information associated with the user;
determining a facial expression and a head orientation of the based at least in part on the information identifying and describing the facial landmark, in response to the comparison of the information identifying and describing the facial landmark with the preregistered facial feature recognition information associated with the user;
determining the head orientation transgresses a threshold time value;
accessing a function of the user device associated with the facial expression and the head orientation, in response to the head orientation transgressing the threshold time value, the function including a security function; and
performing the security function associated with the facial expression and the head orientation at the user device, wherein the security function includes locking or unlocking the display unit of the user device based on determining that the facial expression matches a facial expression from among the preregistered facial feature recognition information associated with the user.

9. The method of claim 8 , wherein the function is a first function, and the method further comprises:
determining the facial expression of the user based on the information identifying and describing the facial landmark;
activating the first function of the user device based on determining that the facial expressions matches a first facial expression from among the preregistered facial feature recognition information associated with the user; and
activating a second function of the user device based on determining that the facial expression matches a second facial expression from among the preregistered facial feature recognition information associated with the user.

10. The method of claim 9 , wherein the determining the facial expression comprises:
identifying at least one of a wink, a squint, a frown, or a smile.

11. The method of claim 8 , further comprising:
determining a facial expression of the user based on the information identifying and describing the facial landmark; and
activating a user interface to receive a feedback from the user based on determining that the facial expression matches a facial expression from among the preregistered facial feature recognition information associated with the user.

12. The method of claim 8 , further comprising:
determining a facial expression of the user based on the information identifying and describing the facial landmark; and
adjusting the size of the presentation of the content based on determining that the facial expression matches a facial expression from among the preregistered facial feature recognition information associated with the user.

13. The method of claim 8 , further comprising:
processing the information identifying and describing the facial landmark to identify a facial expression; and
adjusting brightness of the display unit based on matching the facial expression to a squint or a frown.

14. The method of claim 13 , wherein the adjusting comprises:
determining a size of pupils of the user based on the information identifying and describing the facial landmark of the user.

15. The method of claim 8 , further comprising:
calculating a distance between the display unit and eyes of the user based at least in part on the information identifying and describing the facial landmark.

16. The method of claim 15 , wherein the calculating comprises:
presenting a notification via the user device based on determining that the distance is less than a threshold time value.

17. A non-transitory machine-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
detecting a change in a device orientation;
receiving, via a user device corresponding to a user, information identifying and describing a facial landmark of the user, in response to the change in the device orientation;
performing a comparison of the information identifying and describing the facial landmark of the user with preregistered facial feature recognition information assoc

Assignees

• Tobin John Patrick Edgar
• Ebay Inc

Inventors

• Tobin John Patrick Edgar

Classifications

• G06F2200/1614

  Image rotation following screen orientation, e.g. switching from landscape to portrait mode · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title