Method and apparatus for generating augmented reality content

Patent metadata

Field	Value
Publication number	US-9317133-B2
Application number	US-90099010-A
Country	US
Kind code	B2
Filing date	Oct 8, 2010
Priority date	Oct 8, 2010
Publication date	Apr 19, 2016
Grant date	Apr 19, 2016

Abstract

An approach is provided for providing augmented reality based on tracking. Information, including location information, orientation information, or a combination thereof of a device is determined. A representation of a location indicated based, at least in part, on the information is determined. One or more items are selected to associate with one or more points within the representation. Display information is determined to be generated, the display information including the one or more items overlaid on the representation based, at least in part, on the one or more points.

First claim

What is claimed is:

1. A method comprising:
determining information including location information, orientation information, or a combination thereof of a device;
determining a representation of a location indicated based on the information and pre-processed world data;
selecting one or more items to associate with one or more points within the representation;
determining to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points;
determining to capture one or more images of the location;
determining one or more elements of the one or more captured images; and
determining to generate one or more other representations of the one or more elements for inclusion in the display information,
wherein the representation is a model and includes a real-time moving object blended into the model, and
wherein the selecting one or more items selected comprises a user selecting a category or a keyword regarding a point-of-interest.

2. A method of claim 1 , wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points, the one or more points being associated with the one or more symmetrical or repetitive physical features.

3. A method of claim 2 , further comprising:
determining to cause at least in part a tracking of the location, the orientation, or a combination thereof in relation to the spatial layout; and
determining to update the display information based, at least in part, on the tracking.

4. A method of claim 3 , further comprising:
determining one or more portions of the spatial layout; and
determining to filter the one or more items based, at least in part, on whether the respective one or more points are within the one or more portions,
wherein filtered ones of the one or more items are not processed for inclusion in the display information.

5. A method of claim 1 , further comprising:
determining to generate the display information based, at least in part, on a semantic blending of the one or more elements, the one or more other representations, the representation, or a combination.

6. A method of claim 1 , further comprising:
determining a time parameter and a weather parameter associated with location; and
determining to augment the displaying information based on the time parameter and the weather parameter,
wherein the spatial layout is a rendering of the representation of the location indicated, and
wherein the rendering is augmented to match current lighting/shadowing and weather based on the time parameter.

7. A method of claim 1 , wherein the representation substitutes for a real-time image of the location, and wherein the representation is at least an approximation of the location, the one or more items, tracking information of the device or the one or more items relative to the location, or a combination thereof.

8. An apparatus comprising:
at least one processor; and
at least one memory including computer program code for one or more programs,
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,
determine information including location information, orientation information, or a combination thereof of a device;
determine a representation of a location indicated based on the information and pre-processed world data;
select one or more items to associate with one or more points within representation;
determine to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points;
determine to capture one or more images of the location;
determine one or more elements of the one or more captured images; and
determine to generate one or more other representations of the one or more elements for inclusion in the display information,
wherein the representation is a model and includes a real-time moving object blended into the model, and
wherein the selecting one or more items selected comprises a user selecting a category or a keyword regarding a point-of-interest.

9. An apparatus of claim 8 , wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points, the one or more points being associated with the one or more symmetrical or repetitive physical features.

10. An apparatus of claim 9 , wherein the apparatus is further caused to:
determine to cause at least in part a tracking of the location, the orientation, or a combination thereof in relation to the spatial layout; and
determine to update the display information based, at least in part, on the tracking.

11. An apparatus of claim 10 , wherein the apparatus is further caused to:
determine one or more portions of the spatial layout; and
determine to filter the one or more items based, at least in part, on whether the respective one or more points are within the one or more portions,
wherein filtered ones of the one or more items are not processed for inclusion in the display information.

12. An apparatus of claim 8 , wherein the apparatus is further caused to:
determine to generate the display information based, at least in part, on a semantic blending of the one or more elements, the one or more other representations, the representation, or a combination.

13. An apparatus of claim 8 , wherein the apparatus is further caused to:
determine a time parameter and a weather parameter associated with location; and
determine to augment the displaying information based on the time parameter and the weather parameter,
wherein the spatial layout is a rendering of the representation of the location indicated, and
wherein the rendering is augmented to match current lighting/shadowing and weather based on the time parameter.

14. An apparatus of claim 8 , wherein the representation substitutes for a real-time image of the location, and wherein the representation is at least an approximation of the location, the one or more items, tracking information of the device or the one or more items relative to the location, or a combination thereof.

15. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:
determining information including location information, orientation information, or a combination thereof of a device;
determining a representation of a location indicated based on the information and pre-processed world data;
selecting one or more items to associate with one or more points within the representation;
determining to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points;
determining to capture one or more images of the location;
determining one or more elements of the one or more captured images; and
determining to generate one or more other representations of the one or more elements for inclusion in the display information,
wherein the representation is a model and includes a real-time moving object blended into the model, and
wherein the selecting one or more items selected comprises a user selecting a category or a keyword regarding a point-of-interest.

16. A computer-readable storage medium of claim 15 , wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points, the one

Assignees

• Korah Thommen
• Azuma Ronald
• Nokia Technologies Oy

Inventors

• Korah Thommen
• Azuma Ronald

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/03 Primary

  Arrangements for converting the position or the displacement of a member into a coded form · CPC title