Adaptive display environment for dynamic applications

Patent metadata

Field	Value
Publication number	US-10623724-B2
Application number	US-201715654283-A
Country	US
Kind code	B2
Filing date	Jul 19, 2017
Priority date	Jul 19, 2017
Publication date	Apr 14, 2020
Grant date	Apr 14, 2020

Abstract

A system, computer program product and computer-implemented method for presenting data. The system includes a sensor that obtains a measurement related to a viewing parameter of a viewer in the environment, a presentation surface that provides data for viewing by the viewer, and a processor. The viewing parameter of the viewer indicates the viewer's ability to perceive the data. The processor determines the viewing parameter of the viewer from the obtained measurement and dynamically alters a presentation parameter of the presentation surface based at least in part on the viewing parameter of the viewer.

First claim

What is claimed is:

1. A computer-implemented method for presenting data, the method comprising:
reading, using facial recognition software run on a processor, a facial expression of a viewer to determine a level of understanding of the viewer of the data being presented at a presentation surface;
receiving, using the processor, a measurement of a viewer obtained using a light detection and ranging (LIDAR) sensor in order to determine a viewing parameter of the viewer that affects the viewer's ability to understand the data, wherein the viewer moves around a room and wherein the obtained measurement of the viewer includes at least user's location within the room and user's viewing direction;
dynamically altering, using the processor, a presentation parameter of the presentation surface based at least in part on the viewing parameter of the viewer to accommodate at least user's viewing location within the room and viewing direction; and
presenting, using the presentation surface, the data to the viewer when the facial recognition software determines that the altered presentation parameter of the presentation surface enhances the viewer's ability to understand the data.

2. The computer-implemented method of claim 1 , wherein the viewing parameter of the viewer is selected from the group consisting of a height, a primary language, an age, a location, a gesture, and a facial expression.

3. The computer-implemented method of claim 1 , wherein altering the presentation parameter further comprises one selected from the group consisting of adjusting a height of the presentation surface, adjusting a proximity of the presentation surface to the viewer, adjusting an orientation of the presentation surface, adjusting a size of data presented at the presentation surface, altering a brightness of the presentation surface, selecting a color of data at the presentation surface, adjusting a volume of an audio presentation, and selecting the presentation surface for data presentation.

4. The computer-implemented method of claim 1 , wherein the at least one presentation surface includes a holographic display surface at an end of an adjustable support arm.

5. The computer-implemented method of claim 1 further comprising synchronizing a wearable device by the viewer with the presentation surface to provide a three-dimensional perspective of an object that can be observed throughout 360 degrees of viewing.

6. The computer-implemented method of claim 1 further comprising projecting an image onto a horizontal surface from a projector above the horizontal surface.

7. The computer-implemented method of claim 1 , wherein the viewing parameter is an affective viewing parameter indicative of an internal state of the viewer.

8. A system for data presentation, comprising:
a presentation surface that provides data for viewing by a viewer;
a LIDAR sensor that obtains a viewing parameter of the viewer, wherein the viewing parameter affects a viewer's ability to understand data at the presentation surface;
a camera for obtaining a facial image of the viewer; and
a processor configured to:
determine, using facial recognition software, a level of understanding of a viewer of the data being presented at a presentation surface;
receive the viewing parameter of the viewer from the LIDAR sensor, wherein the viewer moves around a room and wherein the viewer parameter includes at least user's location within the room and user's viewing direction;
dynamically alter a presentation parameter of the presentation surface based at least in part on the viewing parameter of the viewer to accommodate at least user's viewing location within the room and viewing direction; and
present the data at the presentation surface to the viewer when the facial recognition software determines that the altered presentation parameter of the presentation surface enhances the viewer's ability to understand the data.

9. The system of claim 8 , wherein the viewing parameter of the viewer is selected from the group consisting of a height, a primary language, an age, a location, a gesture, and a facial expression.

10. The system of claim 8 , wherein the presentation parameter is selected from the group consisting of: a height of the presentation surface, a proximity of the presentation surface to the viewer, an orientation of the presentation surface, a size of data presented at the presentation surface, a brightness of the presentation surface, a color of data at the presentation surface, a volume of an audio presentation, and a selection of the presentation surface for data presentation.

11. The system of claim 8 , wherein the presentation surface includes a holographic display surface at an end of an adjustable support arm.

12. The system of claim 8 , wherein the processor adjusts the presentation parameter in order to reduce an effort required of the viewer to perceive the data.

13. The system of claim 8 further comprising a wearable device by the viewer that are synchronized with the presentation surface to provide a three-dimensional perspective of an object to the viewer that can be observed throughout 360 degrees of viewing.

14. The system of claim 8 , further comprising a horizontal surface and a projector above the horizontal surface for projecting an image onto the horizontal surface.

15. A computer program product for data presentation, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:
receive a facial image of the viewer;
read a viewer's facial expression from the facial image to determine a level of understanding of a viewer of the data being presented at a presentation surface;
receive a measurement of a viewer obtained using a LIDAR sensor in order to determine a viewing parameter of the viewer that affects the viewer's ability to understand the data wherein the viewer moves around a room and wherein the obtained measurement of the viewer includes at least user's location within the room and user's viewing direction;
dynamically alter a presentation parameter of the presentation surface based at least in part on the viewing parameter of the viewer to accommodate at least user's viewing location within the room and viewing direction; and
present, using the presentation surface, the data to the viewer when the viewer's facial expression indicates that the altered presentation parameter of the presentation surface improves the viewer's ability to understand the data.

16. The computer program product of claim 15 , wherein the viewing parameter of the viewer is selected from the group consisting of a height, a primary language, an age, a location, a gesture, and a facial expression.

17. The computer program product of claim 15 , wherein dynamically altering the presentation parameter further comprising one selected from the group consisting of adjusting a height of the presentation surface, adjusting a proximity of the presentation surface to the viewer, adjusting an orientation of the presentation surface, adjusting a size of data presented at the presentation surface, altering a brightness of the presentation surface, selecting a color of data at the presentation surface, adjusting a volume of an audio presentation, and selecting the presentation surface for data presentation.

18. The computer program product of claim 15 , wherein the presentation surface includes a holographic display surface attached to an end of an adjustable support arm.

Assignees

• IBM

Inventors

• Aaron Andrew S
• Deligianni Hariklia
• Melville David O S
• Podlaseck Mark E
• Seo Hyun Kyu

Classifications

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• H04N13/366 Primary

  using viewer tracking · CPC title

• H04N13/39

  the picture elements emitting light at places where a pair of light beams intersect in a transparent material · CPC title

• G06K9/00362

  Physics · mapped topic