Context aware projection

Patent metadata

Field	Value
Publication number	US-10511818-B2
Application number	US-201715472497-A
Country	US
Kind code	B2
Filing date	Mar 29, 2017
Priority date	Mar 29, 2017
Publication date	Dec 17, 2019
Grant date	Dec 17, 2019

Abstract

In some embodiments, the disclosed subject matter involves a system for mapping projection of content to surfaces in an environment. Groups of users in the environment are identified and surfaces in the environment are selected/assigned for projection and/or touch input based on user preferences, ranking of surfaces for projectability or touchability, content to be displayed, proximity of user groups to one another and surfaces, and user feedback and control. Other embodiments are described and claimed.

First claim

What is claimed is:

1. A system for context aware projection in an environment, comprising:
a processor, when in operation, communicatively coupled to:
a camera in the environment, and a database for storing user preferences; and
surface mapping logic coupled to the processor, the surface mapping logic to access an image corresponding to a user in the environment, the image to identify a position of the user with respect to the camera and to a plurality of possible display surfaces in the environment, wherein each possible display surface has an associated projectability ranking, the surface mapping logic to select a display surface of the plurality of possible display surfaces in the environment as an assigned surface, the assigned surface to be used in projection, wherein the assigned surface is selected based on the projectability ranking for the assigned surface with respect to projectability ranking of other surfaces in the environment, and wherein selection of the assigned surface is further based on preferences of the user stored in the database as user preferences, wherein the user preferences include at least one of a preferred display surface, preferred method for providing control and feedback input, preferred privacy settings, preferred height of the display surface, preferred device for display, user audio signature, or preferred handedness,
wherein the surface mapping logic is further to assign a touchability ranking for each of the plurality of display surfaces, and wherein selection of the assigned surface is based on the touchability ranking in combination with the projectability ranking and the user preferences.

2. The system as recited in claim 1 , wherein the selection of the assigned surface is further based on content to be displayed and proximity of the assigned surface to the user to view the projection.

3. The system as recited in claim 1 , wherein the projectability ranking includes criteria selected from the group consisting of: user position and orientation with respect to the surface, lighting conditions, reflectivity of the surface, line of sight occlusions of the surface, and readability from perspective of the user.

4. The system as recited in claim 1 , wherein the surface mapping logic is further to assign an input device as an assigned input device for the user to provide commands or feedback to the context aware projection system, wherein the assigned input device is one of a touch surface in the environment or an alternative device, wherein the alternative device is to accept at least one of touch or audio input, wherein to assign an input device is based on a touchability ranking of a plurality of touch surfaces in the environment, availability of the alternative device, and preferences of the user stored in the database.

5. The system as recited in claim 1 , further comprising group detection logic coupled to the processor, to identify a location of the user in the environment and determine whether the user is proximate to another user, where proximate users form a cluster, the group detection logic to determine whether the cluster is a group, wherein the group includes members authorized to view a same projection, and when detecting presence of the group in the environment, include user preferences of users in the group when assigning the surface for projection.

6. The system as recited in claim 5 , wherein the group detection logic is to use signals captured by at least one of the camera or a microphone to identify a cluster of users and location of the cluster in the environment.

7. The system as recited in claim 6 , further comprising conversation detection logic to access audio signals from the microphone, the conversation detection logic further to detect speech within the audio signals using automatic speech recognition and natural language processing, wherein the detected speech is to assist in identification of whether users in a cluster are members of a group.

8. The system as recited in claim 7 , wherein the conversation detection logic is to identify a conversation within the group, and based on the conversation, to identify a leader of the group, and weight the leader's preferences more heavily than other users' preferences, in assigning at least one of the projection surface and a touch surface for input.

9. The system as recited in claim 5 , further comprising change logic coupled to the surface mapping logic to determine whether elements of at least one of the environment or identified groups has changed, the change logic to provide change information to the surface mapping logic to prompt the surface mapping logic to determine whether a projection surface is to be reassigned, based on the change information.

10. The system as recited in claim 5 , wherein responsive to the group detection logic having determined that there is more than one group in the environment, the surface mapping logic to assign a first surface to a first group and to assign a second surface to a second group, wherein to assign the first surface depends on projectability of the first surface and user preferences of members of the first group, and proximity of the first surface to both the first and second group, and wherein to assign the second surface depends on projectability of the second surface and user preferences of members of the second group, and proximity of the second surface to both the first and second group.

11. A method for context aware projection in an environment, comprising:
selecting a surface of a plurality of possible display surfaces in the environment as an assigned surface, wherein each possible display surface has an associated projectability ranking, the assigned surface to be used in projection, wherein selecting the surface further comprises:
identifying the projectability ranking for the assigned surface with respect to projectability ranking of other surfaces in the environment,
assigning a touchability ranking of each of the plurality of possible display surfaces, identifying content to be displayed including authorization to view the content by a user in the environment,
determining proximity of the assigned surface to the user to view the projection, the determining proximity using an image of the environment captured by a camera in the environment, the image to identify a position and orientation of the user with respect to the camera and to the plurality of surfaces in the environment,
identifying preferences of the user stored in a database with respect to viewability parameters, as user preferences, wherein the user preferences include at least one of a preferred display surface, preferred method for providing control and feedback input, preferred privacy settings, preferred height of the display surface, preferred device for display, user audio signature, or preferred handedness, and
determining the assigned surface based on at least one of the user preferences, content to be displayed, surface projectability ranking, touchability ranking, and proximity of the user to the assigned surface.

12. The method as recited in claim 11 , further comprising projecting the content on the assigned surface by a projector in the environment.

13. The method as recited in claim 11 , wherein the projectability ranking includes criteria selected from the group consisting of: user position and orientation with respect to the surface, lighting conditions, reflectivity of the surface, line of sight occlusions of the surface, and readability from perspective of the user.

14. The method as recited in claim 11 , further comprising:
assigning an input device as an assigned input device for the user to pro

Assignees

• Intel Corp

Inventors

• Raffa Giuseppe
• Marshall Carl S
• Panneer Selvakumar
• Anderson Glen J
• Shi Meng
• Sharma Sangita Ravi

Classifications

• H04N9/3179

  Video signal processing therefor · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G10L25/78

  Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10) · CPC title

• G10L15/02

  Feature extraction for speech recognition; Selection of recognition unit · CPC title

• G10L15/18

  using natural language modelling · CPC title