Reconfigurable user device screen compensating problematic sources of reflection

Patent metadata

Field	Value
Publication number	US-11636792-B2
Application number	US-202217680769-A
Country	US
Kind code	B2
Filing date	Feb 25, 2022
Priority date	Mar 1, 2021
Publication date	Apr 25, 2023
Grant date	Apr 25, 2023

Abstract

A method, apparatus and computer program are described to determine a configuration of a reconfigurable screen of a user device, identify potentially problematic sources of reflection from a scene around a user device based, at least in part, on the determined configuration, and compensate for the potentially problematic sources of reflection.

First claim

The invention claimed is:

1. An apparatus comprising:
at least one processor; and
at least one memory including computer program code, the at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
determine a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration, identify one or more potentially problematic sources of reflection from a scene around the user device that cause one or more potentially problematic reflection areas of the reconfigurable screen;
determine a distorted shape of the one or more potentially problematic reflection areas based on the determined configuration of the screen; and
compensate for the one or more potentially problematic sources of reflection by applying a compensation pattern that selectively adjusts one or more display characteristics of portions of the screen based on the determined distorted shape of the one or more potentially problematic reflection areas.

2. The apparatus as claimed in claim 1 , wherein the configuration of the reconfigurable screen comprises a fold angle of the screen.

3. The apparatus as claimed in claim 1 , wherein determining said one or more potentially problematic sources of reflection comprises:
based on the determined configuration, determining or retrieving geometric distortion information for the screen.

4. The apparatus as claimed in claim 1 , wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine at least one of: one or more illumination sources that impact on the screen or objects that impact on the screen,
wherein identifying said one or more potentially problematic sources of reflection is further based, at least in part, on one or more respective locations of the determined at least one of: one or more illumination sources or objects.

5. The apparatus as claimed in claim 4 , wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
based, at least in part, on the one or more respective locations of the determined at least one of: one or more illumination sources or objects, identify the one or more potentially problematic reflection areas of the screen.

6. The apparatus as claimed in claim 4 , further comprising one or more imaging devices configured to determine the at least one of: one or more illumination sources or objects.

7. The apparatus as claimed in claim 4 , wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, cause the apparatus to:
determine said at least one of: one or more illumination sources or objects by performing corneal reflection imaging.

8. The apparatus as claimed in claim 4 , wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine at least one of an angle or a colour of illumination of the determined at least one of: one or more illumination sources or objects relative to the screen for use in at least one of identifying said one or more potentially problematic sources of reflection or for use in compensating for said one or more potentially problematic sources of reflection.

9. The apparatus as claimed in claim 1 , wherein compensation for said one or more potentially problematic sources of reflection comprises specular reflection correction.

10. The apparatus as claimed in claim 1 , wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine a gaze direction of a viewer of the screen of the user device.

11. The apparatus as claimed in claim 10 , wherein identifying said one or more potentially problematic sources of reflection is further based, at least in part, on the determined gaze direction.

12. The apparatus as claimed in claim 10 , wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine a compensation for said one or more potentially problematic sources of reflection based, at least in part, on the determined gaze direction.

13. A user device comprising a reconfigurable screen and an apparatus, wherein the apparatus comprises:
at least one processor; and
at least one memory including computer program code, the at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
determine a configuration of the reconfigurable screen of the user device;
based, at least in part, on the determined configuration, identify one or more potentially problematic sources of reflection from a scene around the user device that cause one or more potentially problematic reflection areas of the reconfigurable screen;
determine a distorted shape of the one or more potentially problematic reflection areas based on the determined configuration of the screen; and
compensate for the one or more potentially problematic sources of reflection by applying a compensation pattern that selectively adjusts one or more display characteristics of portions of the screen based on the determined distorted shape of the one or more potentially problematic reflection areas.

14. A method comprising:
determining a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration, identifying one or more potentially problematic sources of reflection from a scene around the user device that cause one or more potentially problematic reflection areas of the reconfigurable screen;
determining a distorted shape of the one or more potentially problematic reflection areas based on the determined configuration of the screen; and
compensating for the one or more potentially problematic sources of reflection by applying a compensation pattern that selectively adjusts one or more display characteristics of portions of the screen based on the determined distorted shape of the one or more potentially problematic reflection areas.

15. The method as claimed in claim 14 , wherein the configuration of the reconfigurable screen comprises a fold angle of said screen.

16. The method as claimed in claim 14 , wherein determining said one or more potentially problematic sources of reflection comprises:
based on the determined configuration, determining or retrieving geometric distortion information for the screen.

17. The method as claimed in claim 14 , further comprising:
determining at least one of: one or more illumination sources that impact on the screen or objects that impact on the screen,
wherein identifying said one or more potentially problematic sources of reflection is further based, at least in part, on one or more respective locations of the determined at least one of: one or more illumination sources or objects.

18. A non-transitory computer readable medium comprising program instructions stored thereon for causing an apparatus to perform at least the following:
determine a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration, identify one or more potentially problematic sources of reflection from a scene around the user; device that cause one or more potentially problematic reflection areas of the re

Assignees

• Nokia Technologies Oy

Inventors

• Cronin Harry
• Wright Christopher
• Catton Phil
• Schnabel William

Classifications

• G09G2340/14

  Solving problems related to the presentation of information to be displayed · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G2360/144

  the light being ambient light · CPC title

• G06F3/0418 Primary

  for error correction or compensation, e.g. based on parallax, calibration or alignment · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title