Automatic display image enhancement based on user's visual perception model

Patent metadata

Field	Value
Publication number	US-2016110846-A1
Application number	US-201414520236-A
Country	US
Kind code	A1
Filing date	Oct 21, 2014
Priority date	Oct 21, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

In an aspect of the disclosure, a method, a computer program product, and an apparatus are provided. An apparatus determines whether a vision-altering object is present between the apparatus and at least one eye of a user. The apparatus identifies the vision-altering object as corresponding to a previously characterized object in response to determining that the vision-altering object is present between the device and the at least one eye of the user. The apparatus adjusts an image displayed at the apparatus based on one or more characteristics of the previously characterized object. Accordingly, the presence of the vision-altering object is compensated to allow the user to perceive an image that is closer to the image despite the presence of the vision-altering object.

First claim

What is claimed is:

1 . A method of operating a device, comprising:
determining whether a vision-altering object is present between the device and at least one eye of a user; identifying the vision-altering object as corresponding to a previously characterized object in response to determining that the vision-altering object is present between the device and the at least one eye of the user; and adjusting an image displayed at the device based on one or more characteristics of the previously characterized object.

2 . The method of claim 1 , wherein the adjusting the displayed image comprises adjusting at least one of a brightness, a color palette, a contrast, or a font size of the displayed image.

3 . The method of claim 2 , wherein the adjusting the at least one of the brightness, the color palette, the contrast, or the font size of the displayed image comprises increasing at least one of the brightness, the contrast, or the font size of the displayed image.

4 . The method of claim 2 , wherein the adjusting the at least one of the brightness, the color palette, the contrast, or the font size of the displayed image comprises compensating for at least one color of the color palette to enhance perception of a Red (R), Green (G) or Blue (B) channel.

5 . The method of claim 1 , wherein the adjusting the displayed image comprises sensing an ambient brightness.

6 . The method of claim 1 , wherein the vision-altering object comprises at least one of sunglasses, three-dimensional (3D) glasses, a response of a pupil at the at least one eye, or a privacy filter disposed over at least a portion of the device.

7 . The method of claim 6 , wherein the vision-altering object comprises the sunglasses, and wherein the method further comprises characterizing a level of transparency of a lens of the sunglasses.

8 . The method of claim 7 , wherein the characterizing the level of transparency comprises determining a tint color of the lens.

9 . The method of claim 7 , wherein the characterizing the level of transparency comprises:
capturing a first image using a camera of the device; requesting the user to position the sunglasses within a field of view of the camera after capturing the first image; detecting that the sunglasses are positioned within the field of view of the camera; capturing a second image using the camera in response to detecting that the sunglasses are positioned within the field of view of the camera; and estimating a transmission level of the lens based on Commission on Illumination (CIE) XYZ color space characteristics or Red Green Blue (RGB) color model characteristics of the captured first image and the captured second image.

10 . The method of claim 9 ,
wherein the first image and the second image are captured using a same auto exposure level and a same auto white balance level of the camera, wherein the device remains stationary between capturing the first image and capturing the second image.

11 . The method of claim 9 , wherein the adjusting the displayed image comprises calculating a display image adjustment factor based on the estimated transmission level.

12 . The method of claim 11 , wherein the adjusting the displayed image further comprises selecting at least a display image tone adjustment curve or one or more display image tone adjustment values based on the calculated display image adjustment factor.

13 . The method of claim 9 , further comprising storing the estimated transmission level of the lens as a characteristic of the sunglasses.

14 . The method of claim 7 , wherein the characterizing the level of transparency comprises:
comparing a skin tone of an exposed portion of a face of the user with a skin tone of a covered portion of the face, the covered portion being covered by the sunglasses.

15 . The method of claim 1 , wherein the one or more characteristics of the previously characterized object are stored at the device.

16 . A method of operating a device, comprising:
receiving a base image for display at the device; sensing a presence of one or more vision-altering objects located between the device and at least one eye of a user; processing the base image for the display at the device, to reduce distortion perceived by the user when viewing the display of the base image, in response to sensing the presence of the one or more vision-altering objects, wherein the distortion is induced by at least two of a plurality of sources, the plurality of sources comprising the one or more vision-altering objects, ambient light, and physiology of an eye of the user; and displaying the processed base image.

17 . The method of claim 16 , wherein the processing the base image comprises applying a calculated transform to the base image to reduce the distortion perceived by the user.

18 . The method of claim 17 ,
wherein the calculated transform is calculated by applying a first transform of a plurality of transforms to a second transform of the plurality of transforms, wherein the first transform is for compensating for a first component of the distortion, the first component caused by a first source of the at least two of the plurality of sources, and wherein the second transform is for compensating for a second component of the distortion, the second component caused by a second source of the at least two of the plurality of sources.

19 . The method of claim 18 , further comprising applying a third transform to the base image to which the calculated transform is applied, in order to reduce the occurrence of image saturation.

20 . The method of claim 19 , wherein the third transform is a nonlinear function.

21 . The method of claim 18 , further comprising selecting the third transform from among a second plurality of transforms based on a pixel profile of the base image.

22 . The method of claim 21 , wherein the pixel profile of the base image includes at least an average brightness, a histogram, a range, an overall contrast or a sharpness level of the base image.

23 . The method of claim 17 , wherein the calculated transform is for a Red (R) channel, a Green (G) channel or a Blue (B) channel of the base image.

24 . The method of claim 16 , wherein the one or more vision-altering objects comprise at least a filter disposed at a display of the device or eyewear worn by the user.

25 . An apparatus comprising:
a memory; and at least one processor coupled to the memory and configured to: determine whether a vision-altering object is present between the apparatus and at least one eye of a user; identify the vision-altering object as corresponding to a previously characterized object in response to determining that the vision-altering object is present between the apparatus and the at least one eye of the user; and adjust an image displayed at the apparatus based on one or more characteristics of the previously characterized object.

26 . The apparatus of claim 25 ,
wherein the vision-altering object comprises sunglasses, and wherein the at least one processor is further configured to estimate a transmission level of a lens of the sunglasses.

27 . The apparatus of claim 26 , wherein the at least one processor is further configured to select at least a display image tone adjustment curve or one or more display image tone adjustment values based on the estimated transmission level of the len

Assignees

• Qualcomm Inc

Inventors

• Park Hee Jun
• Woo Jeong-Ho
• Jang Woonyoung

Classifications

• G09G5/02 Primary

  characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} · CPC title

• G09G2360/144

  the light being ambient light · CPC title

• G09G5/10

  Intensity circuits · CPC title

• G06T5/006

  Physics · mapped topic

• G06T5/00 Primary

  Image enhancement or restoration · CPC title