Method, apparatus and computer program product for providing navigation information in relation to augmented reality guidance

Patent metadata

Field	Value
Publication number	US-2016349062-A1
Application number	US-201514722913-A
Country	US
Kind code	A1
Filing date	May 27, 2015
Priority date	May 27, 2015
Publication date	Dec 1, 2016
Grant date	—

Abstract

A method, apparatus and computer program product are provided to provide navigational information in conjunction with augmented reality guidance. In the context of a method, the position of a mobile terminal is determined. The method also includes determining an orientation of the mobile terminal. Based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, the method further includes providing for augmentation of a display of at least a portion of an image associated with the position. The method provides for augmentation of the display of at least the portion of the image by causing navigational information to be presented upon a sidewall surface of a structure within the image. A corresponding apparatus and computer program product are also provided.

First claim

What is claimed is:

1 . A method comprising:
determining a position of a mobile terminal; determining an orientation of the mobile terminal; and based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, providing for augmentation of a display of at least a portion of an image associated with the position, wherein providing for augmentation of the display of at least the portion of the image comprises causing navigational information to be presented upon a sidewall surface of a structure within the image.

2 . A method according to claim 1 further comprising:
determining whether the orientation of the mobile terminal has changed to a different orientation; and
in an instance in which the orientation of the mobile terminal has changed, providing for augmentation of the display of a different portion of the image captured by the mobile terminal based at least in part upon the different orientation of the mobile terminal.

3 . A method according to claim 1 further comprising:
determining that the position of the mobile terminal has changed to a different position; and
providing for augmentation of the display of at least a portion of the image captured by the mobile terminal at the different position by causing the navigational information to be presented upon the sidewall surface of the structure within the image captured by the mobile terminal at the different position.

4 . A method according to claim 1 wherein causing navigational information to be presented upon the sidewall surface of the structure within the image comprises causing a directional arrow or a sign to be presented upon the sidewall surface of the structure within the image.

5 . A method according to claim 4 wherein causing the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image comprises causing a perspective view of the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image.

6 . A method according to claim 1 wherein causing navigational information to be presented upon the sidewall surface of the structure within the image comprises causing navigational information to be presented a predefined distance above street level upon the sidewall surface of the structure within the image.

7 . A method according to claim 1 wherein causing navigational information to be presented upon the sidewall surface of the structure within the image comprises causing navigational information to be presented upon the sidewall surface of a building within the image, wherein the building is laterally offset to a side of a street within the image.

8 . An apparatus comprising at least one processor and at least one memory including computer program code, wherein the memory and computer program code are configured to, with the processor, cause the apparatus to:
determine a position of a mobile terminal; determine an orientation of the mobile terminal; and based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, provide for augmentation of a display of at least a portion of an image associated with the position, wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to provide for augmentation of the display of at least the portion of the image by causing navigational information to be presented upon a sidewall surface of a structure within the image.

9 . An apparatus according to claim 8 wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to:
determine whether the orientation of the mobile terminal has changed to a different orientation; and
in an instance in which the orientation of the mobile terminal has changed, provide for augmentation of the display of a different portion of the image captured by the mobile terminal based at least in part upon the different orientation of the mobile terminal.

10 . An apparatus according to claim 8 wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to:
determine that the position of the mobile terminal has changed to a different position; and
provide for augmentation of the display of at least a portion of the image captured by the mobile terminal at the different position by causing the navigational information to be presented upon the sidewall surface of the structure within the image captured by the mobile terminal at the different position.

11 . An apparatus according to claim 8 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause navigational information to be presented upon the sidewall surface of the structure within the image by causing a directional arrow or a sign to be presented upon the sidewall surface of the structure within the image.

12 . An apparatus according to claim 11 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image by causing a perspective view of the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image.

13 . An apparatus according to claim 8 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause navigational information to be presented upon the sidewall surface of the structure within the image by causing navigational information to be presented a predefined distance above street level upon the sidewall surface of the structure within the image.

14 . An apparatus according to claim 8 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause navigational information to be presented upon the sidewall surface of the structure within the image by causing navigational information to be presented upon the sidewall surface of a building within the image, wherein the building is laterally offset to a side of a street within the image.

15 . A computer program product comprising at least one non-transitory computer readable medium having program code portions stored thereon, wherein the program code portions are configured, upon execution, to:
determine a position of a mobile terminal; determine an orientation of the mobile terminal; and based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, provide for augmentation of a display of at least a portion of an image associated with the position, wherein the program code portions configured to provide for augmentation of the display of at least the portion of the image comprise program code portions configured to cause navigational information to be presented upon a sidewall surface of a structure within the image.

16 . A computer program product according to claim 15 wherein the program code portions are further configured, upon execution, to:
determine whether the orientation of the mobile terminal has changed to a different orientation; and
in an instance in which the orientation of the mobile terminal has changed, provide for augmentation of the display of a different portion of the image captured by the mobile terminal based at least in part upon the different orientation of the mobile terminal.

17 . A computer progra

Assignees

• Here Global Bv

Inventors

• Campan Marius
• Delitsyn Igor
• Jagoda Michal
• Koblenz Johannes

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G01C21/265 Primary

  constructional aspects of navigation devices, e.g. housings, mountings, displays (G01C21/3688 takes precedence) · CPC title

• G01C21/28

  with correlation of data from several navigational instruments · CPC title

• G01C21/26

  specially adapted for navigation in a road network · CPC title

• G01C21/3647

  Guidance involving output of stored or live camera images or video streams · CPC title