Directing user attention

Patent metadata

Field	Value
Publication number	US-10922889-B2
Application number	US-201816249319-A
Country	US
Kind code	B2
Filing date	Nov 19, 2018
Priority date	Nov 20, 2017
Publication date	Feb 16, 2021
Grant date	Feb 16, 2021

Abstract

Systems and methods for drawing attention to points of interest within inserted content are provided. For example, the inserted content may include augmented reality content that is inserted into a physical space or a representation of the physical space such as an image. An example system and method may include receiving an image and identifying content to display over the image. The system and method may also include identifying a location within the image to display the content and identifying a point of interest of the content. Additionally, the example system and method may also include triggering display of the content overlaid on the image by identifying a portion of the content based on the point of interest, rendering the portion of the content using first shading parameters; and rendering the content other than the portion using second shading parameters.

First claim

What is claimed is:

1. A method comprising:
receiving an image;
identifying content to display over the image;
identifying a location within the image to display the content;
identifying a point of interest located on the content; and
triggering display of the content overlaid on the image by:
identifying a portion of the content based on the point of interest located on the content;
inserting the portion of the content including the point of interest in the image using first shading parameters; and
inserting the content other than the portion in the image using second shading parameters, wherein the first shading parameters correspond to a higher level of lighting than the second shading parameters.

2. The method of claim 1 , further comprising:
generating a pointing entity directed at the point of interest; and
triggering display of the pointing entity overlaid on the image.

3. The method of claim 1 , wherein the point of interest is associated with a three-dimensional coordinate and identifying the portion of the content includes identifying the portion of the content disposed within a predetermined threshold distance of the three-dimensional coordinate.

4. The method of claim 3 , wherein the content includes a three-dimensional mesh that includes a plurality of facets defined by a plurality of vertices.

5. The method of claim 4 , wherein the identifying the portion of the content disposed within the predetermined threshold distance includes identifying vertices within the pre-determined threshold distance of the three-dimensional coordinate.

6. The method of claim 3 , wherein the identifying the portion of the content disposed within the predetermined threshold distance includes identifying pixels corresponding to portions of the content within the predetermined threshold distance of the three-dimensional coordinate.

7. A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by at least one processor, are configured to cause a computing system to at least:
receive an image;
identify content to display over the image;
identify a location within the image to display the content;
identify a point of interest located on the content;
trigger display of the content overlaid on the image by:
identifying a portion of the content based on the point of interest located on the content,
inserting the portion of the content including the point of interest in the image using first shading parameters, and
inserting the content other than the portion in the image using second shading parameters, wherein the first shading parameters correspond to a higher level of lighting than the second shading parameters;

generate a pointing entity directed at the point of interest; and
trigger display of the pointing entity overlaid on the image.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the pointing entity is a conical structure having an axis along a line passing through the point of interest.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the conical vertex of the conical structure is further from the point of interest than the conical base of the conical structure.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the conical base of the conical structure is separated from the point of interest by an offset distance.

11. The non-transitory computer-readable storage medium of claim 9 , wherein the instructions configured to cause the computing system to trigger display of the pointing entity include instructions configured to cause the computing system to render at least a portion of the pointing entity with partial transparency.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the instructions configured to cause the computing system to render at least the portion of the pointing entity with partial transparency include instructions configured to cause the computing system to render the conical structure using a transparency gradient, wherein the conical base is more transparent than the conical vertex.

13. The non-transitory computer-readable storage medium of claim 7 , wherein the instructions configured to cause the computing system to generate the pointing entity directed at the point of interest include instruction configured to cause the computing system to:
determine a surface normal direction of the content based on the point of interest; and
orient the pointing entity based on the surface normal direction.

14. The non-transitory computer-readable storage medium of claim 7 , wherein the pointing entity is oriented based on a position of a user.

15. A system comprising:
at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the system to:
receive an image;
identify content to display over the image;
identify a location within the image to display the content;
identify a point of interest located on the content;
identify a portion of the content based on the point of interest located on the content;
insert the portion of the content including the point of interest in the image using first shading parameters;
insert the content other than the portion in the image using second shading parameters, wherein the first shading parameters correspond to a higher level of lighting than the second shading parameters; and
trigger display of the inserted content overlaid on the image.

16. The system of claim 15 , wherein the point of interest is associated with a three-dimensional coordinate and the instructions that cause the system to identify the portion of the content includes instructions that cause the system to identify the portion of the content disposed within a predetermined threshold distance of the three-dimensional coordinate.

17. The system of claim 15 , wherein the instructions further cause the system to:
generate a pointing entity directed at the point of interest; and
trigger display of the pointing entity overlaid on the image.

Assignees

• Google Llc

Inventors

• Palos Xavier Benavides
• Barros Brett
• Bechard Paul

Classifications

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T15/80

  Shading · CPC title

• G06T17/20

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title