Positioning of projected augmented reality content

Patent metadata

Field	Value
Publication number	US-9721391-B2
Application number	US-201514709267-A
Country	US
Kind code	B2
Filing date	May 11, 2015
Priority date	May 13, 2014
Publication date	Aug 1, 2017
Grant date	Aug 1, 2017

Abstract

A method of displaying augmented reality content on a physical surface is disclosed. A surface complexity measure is determined for the physical surface from a captured image of the physical surface. A content complexity measure is determined for the augmented reality content to be applied to the physical surface. The content complexity measure represents an amount of fine detail in the augmented reality content. The method determines if the amount of fine detail in the augmented reality content is to be modified, based on a function of the surface complexity measure and said content complexity measure. A display attribute of the augmented reality content is adjusted to modify the fine detail in the augmented reality content. The modified augmented reality content is displayed on the physical surface.

First claim

The invention claimed is:

1. A method of displaying augmented reality content on a physical surface, the method comprising:
determining a surface complexity measure for said physical surface from a captured image of said physical surface, said surface complexity measure representing an amount of fine detail in said captured image;
determining a content complexity measure for the augmented reality content to be applied to said physical surface, said content complexity measure representing an amount of fine detail in said augmented reality content;
adjusting a display attribute of said augmented reality content, based on a comparison of said surface complexity measure and said content complexity measure, to modify the fine detail in said augmented reality content thereby improving the legibility of the augmented reality content against said physical surface; and
displaying the modified augmented reality content on said physical surface.

2. The method according to claim 1 , wherein the display attribute is a size of the content.

3. The method according to claim 1 , further comprising capturing an image of a portion of the physical surface.

4. The method according to claim 3 , further comprising dividing the image into tiles.

5. The method according to claim 1 , further comprising selecting a region of the physical surface for displaying the modified augmented reality content.

6. The method according to claim 5 , further comprising determining a geometric centre of the region.

7. The method according to claim 5 , further comprising identifying an image on a printed document.

8. The method according to claim 5 , wherein the region is based on a user gesture.

9. The method according to claim 1 , further comprising comparing the surface complexity measure to the content complexity measure to determine if the amount of fine detail in said augmented reality content is to be modified.

10. The method according to claim 1 , further comprising projecting the modified augmented reality content.

11. The method according to claim 1 , wherein the modified augmented reality content is displayed on the physical surface within a selected region of said physical surface.

12. The method according to claim 1 , wherein the content complexity measure is standard deviation.

13. The method according to claim 1 , wherein the content complexity measure is entropy.

14. A system for displaying augmented reality content on a physical surface, the system comprising:
a memory for storing data and a computer program;
a processor coupled to the memory for executing said computer program, said computer program comprising instructions for:
determining a surface complexity measure for said physical surface from a captured image of said physical surface, said surface complexity measure representing an amount of fine detail in said captured image;
determining a content complexity measure for the augmented reality content to be applied to said physical surface, said content complexity measure representing an amount of fine detail in said augmented reality content;
adjusting a display attribute of said augmented reality content, based on a comparison of said surface complexity measure and said content complexity measure, to modify the fine detail in said augmented reality content thereby improving the legibility of the augmented reality content against said physical surface; and
displaying the modified augmented reality content on said physical surface.

15. A non-transitory computer readable medium having a computer program stored thereon for displaying augmented reality content on a physical surface, the program comprising:
code for determining a surface complexity measure for said physical surface from a captured image of said physical surface, said surface complexity measure representing an amount of fine detail in said captured image;
code for determining a content complexity measure for the augmented reality content to be applied to said physical surface, said content complexity measure representing an amount of fine detail in said augmented reality content;
code for adjusting a display attribute of said augmented reality content, based on a comparison of said surface complexity measure and said content complexity measure, to modify the fine detail in said augmented reality content thereby improving the legibility of the augmented reality content against said physical surface; and
code for displaying the modified augmented reality content on said physical surface.

Assignees

• Canon Kk

Inventors

• Monaghan David Robert James
• Yee Belinda Margaret
• De Lellis Oscar Alejandro

Classifications

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G09G3/002

  to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G06T7/41

  based on statistical description of texture · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title