Camera-based orientation fix from portrait to landscape

Patent metadata

Field	Value
Publication number	US-9565365-B2
Application number	US-201414581324-A
Country	US
Kind code	B2
Filing date	Dec 23, 2014
Priority date	Sep 8, 2010
Publication date	Feb 7, 2017
Grant date	Feb 7, 2017

Abstract

A portable electronic device includes a camera and a display switchable between a portrait mode and a landscape mode in response to an inertial sensor. When it is determined that the display mode should be switched in response to movement of the device, a feature of a user of the device, such as the user's face, is imaged with the camera. If the imaged feature changes orientation with respect to the display by less than a threshold amount, then the switch in display mode is disabled and the display remains in its current mode. Other embodiments are also described and claimed.

First claim

What is claimed is:

1. A method for use in a portable electronic device having a camera, an inertial sensor, a processor and a display screen, the method comprising:
detecting, from inertial sensor data, an orientation of the device relative to gravity;
capturing, by the camera, an image of a user of the device;
determining an orientation of the device relative to the user from the captured image;
comparing the detected orientation of the device from the inertial sensor data to the determined orientation of the device relative to the user; and
displaying by the display screen a user interface in a selected one of a portrait or landscape display mode based on the comparison.

2. The method of claim 1 , further comprising analyzing by the processor the captured image to determine an orientation of a user feature relative to an axis of the device.

3. The method of claim 2 , wherein the user feature includes at least a part of a face of the user.

4. The method of claim 2 , wherein the orientation of the user feature includes an angle of a line passing through the user feature to the axis of the device.

5. The method of claim 2 , further comprising:
capturing by the camera a second image of the user before the detecting; and
comparing by the processor an orientation of the user feature in the captured image to an orientation of a user feature in the second captured image,
wherein the displaying is further based on the comparing of the orientation of the user feature in the captured image to the orientation of the user feature in the second captured image.

6. The method of claim 2 , wherein the displaying maintains a display mode that the display screen displays prior to the detecting if the orientation of the user feature does not change relative to an orientation of a user feature in a second image captured by the camera before the detecting by more than a threshold amount.

7. The method of claim 2 , wherein the displaying switches from a display mode that the display screen displays prior to the detecting if the orientation of the user feature changes relative to an orientation of a user feature in a second image captured by the camera before the detecting by more than a threshold amount.

8. A portable electronic device, comprising:
a camera;
an inertial sensor;
a display screen; and
a processor, wherein the processor is configured to:
detect, from inertial sensor data, an orientation of the device relative to gravity;
control the camera to capture an image of a user of the device;
determine an orientation of the device relative to the user from the image;
compare the orientation of the device from the inertial sensor data to the orientation of the device relative to the user; and
control the display to display a user interface in a selected one of a portrait or landscape display mode based on the comparison.

9. The portable electronic device of claim 8 , wherein the processor is configured to analyze the captured image to determine an orientation of a user feature relative to an axis of the device.

10. The portable electronic device of claim 9 , wherein the user feature includes at least a part of a face of the user.

11. The portable electronic device of claim 9 , wherein the orientation of the user feature includes an angle of a line passing through the user feature to an axis of the device.

12. The portable electronic device of claim 9 , wherein the processor is configured to control the camera and display screen to:
capture a second image of the user before the detecting; and
compare an orientation of the user feature in the captured image to an orientation of a user feature in the second captured image,
wherein the displaying is further based on the comparing of the orientation of the user feature in the captured image to the orientation of the user feature in the second captured image.

13. The portable electronic device of claim 9 , wherein the displaying maintains a display mode that the display screen displays prior to the detecting if the orientation of the user feature does not change relative to an orientation of a user feature in a second image captured by the camera before the detecting by more than a threshold amount.

14. The portable electronic device of claim 9 , wherein the displaying switches from a display mode that the display screen displays prior to the detecting if the orientation of the user feature changes relative to an orientation of a user feature in a second image captured by the camera before the detecting by more than a threshold amount.

15. A non-transitory machine-readable storage medium having program instructions, which when executed by a processor perform a method for use in a portable electronic device having a camera, an inertial sensor, the processor and a display screen, the method comprising:
detecting, from inertial sensor data, an orientation of the device relative to gravity;
capturing an image of a user of the device;
determining an orientation of the device relative to the user from the image;
comparing the orientation of the device from the inertial sensor data to the orientation of the device relative to the user; and
displaying a user interface in a selected one of a portrait or landscape display mode based on the comparison.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the method further comprises analyzing the captured image to determine an orientation of a user feature relative to an axis of the device.

17. The non-transitory machine-readable storage medium of claim 16 , wherein the user feature includes at least a part of a face of the user.

18. The non-transitory machine-readable storage medium of claim 16 , wherein the orientation of the user feature includes an angle of a line passing through the user feature to an axis of the device.

19. The non-transitory machine-readable storage medium of claim 16 , wherein the method further comprises:
capturing a second image of the user before the detecting; and
comparing an orientation of the user feature in the captured image to an orientation of a user feature in the second captured image,
wherein the displaying is further based on the comparing of the orientation of the user feature in the captured image to the orientation of the user feature in the second captured image.

20. The non-transitory machine-readable storage medium of claim 16 , wherein the displaying maintains a display mode that the display screen displays prior to the detecting if the orientation of the user feature does not change relative to an orientation of a user feature in a second image captured by the camera before the detecting by more than a threshold amount.

21. The non-transitory machine-readable storage medium of claim 16 , wherein the displaying switches from a display mode that the display screen displays prior to the detecting if the orientation of the user feature changes relative to an orientation of a user feature in a second image captured by the camera before the detecting by more than a threshold amount.

Assignees

• Apple Inc

Inventors

• Gardiner Koji
• Chang E-Cheng
• Rukes Jason

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F2200/1637

  Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer · CPC title

• G06F2200/1614

  Image rotation following screen orientation, e.g. switching from landscape to portrait mode · CPC title

• G06F1/1626 Primary

  with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs] · CPC title

• H04M2250/52

  including functional features of a camera · CPC title