Method and system for projecting text onto surfaces in geographic imagery

Patent metadata

Field	Value
Publication number	US-9361283-B2
Application number	US-201113307381-A
Country	US
Kind code	B2
Filing date	Nov 30, 2011
Priority date	Nov 30, 2011
Publication date	Jun 7, 2016
Grant date	Jun 7, 2016

Abstract

A user interface for viewing imagery associated with a geographic area, such as street level imagery is disclosed. The interface includes at least one text annotation projected in the three-dimensional space defined by the imagery onto a surface, such as a generally vertical surface, of an object depicted in the imagery. For example, the text annotation can be rendered such that the annotation appears to be located along the façade of a building depicted in the imagery. The projection of text annotations in the three-dimensional space can provide a more immersive, augmented reality-style view of the geographic area of interest.

First claim

What is claimed is:

1. A computer-implemented method for displaying imagery, comprising:
receiving at a computing device at least a portion of an image of a geographic area over a network interface, the image defining a three-dimensional space and depicting at least one object captured by a camera;
presenting a viewport in the display of the computing device that displays at least a portion of the image;
obtaining instructions to render a text annotation associated with the object depicted in the image, the instructions specifying text effects for the text annotation, the text effects being determined based at least in part on surface information data providing a geographic position of a surface of the object in the geographic area; and
rendering a text annotation pursuant to the instructions with text effects such that the text annotation appears to be located in the three-dimensional space along at least a portion of the surface of the object depicted in the image, wherein the text annotation comprises at least a portion of travel directions;
wherein the text annotation is interactive.

2. The method of claim 1 , wherein the text effects specify varying character sizes for the text annotation.

3. The method of claim 1 , wherein the text effects specify an orientation of the text annotation such that the text annotation is rendered on a baseline positioned along at least a portion of the surface of the object depicted in the image.

4. The method of claim 1 , wherein the text annotation is rendered in a fixed location relative the image such that as a user navigates the image, the text annotation remains in a fixed location along at least a portion of the surface of the object depicted in the image.

5. The method of claim 1 , wherein the text annotation is rendered such that the text annotation appears to be located along the façade of a building depicted in the image.

6. The method of claim 1 , wherein the text annotation comprises information associated with the object on which the text annotation is rendered.

7. The method of claim 1 , wherein upon user interaction with the text annotation, the method comprises presenting additional information to the user.

8. The method of claim 7 , wherein upon user interaction with the text annotation, the method presents imagery associated with the next step in the travel directions.

9. The method of claim 1 , wherein the image comprises street level imagery.

10. The method of claim 1 , wherein the method comprises:
rendering a virtual object in the three-dimensional space defined by the image; and
rendering a text annotation such that the text annotation appears to be located along a surface of the virtual object.

11. The computer-implemented method of claim 1 , wherein the image comprises a plurality of pixels, the surface information data comprising a value stored for each of the plurality of pixels, the value representing the geographic position of the surface of the object illustrated in the pixel.

12. The computer-implemented method of claim 1 , wherein the surface information data is determined based at least in part on a three-dimensional model associated with the image.

13. The computer-implemented method of claim 1 , wherein the surface information data comprises latitude, longitude, and altitude coordinates associated with the surface of the object.

14. A system for displaying imagery, comprising:
a display device;
one or more processors; and
at least one memory coupled to the one or more processors, the at least one memory comprising computer-readable instructions for execution by the one or more processors to cause said one or more processors to perform operations, comprising:
receiving at least a portion of an image of a geographic area over a network interface, the image defining a three-dimensional space and depicting at least one object captured by a camera;
presenting a viewport on the display device that displays at least a portion of the image;
receiving, via the network interface, instructions to render an interactive text annotation associated with the object depicted in the image, the instructions specifying text effects for the interactive text annotation, the text effects being determined at a remote server based at least in part on surface information data stored at a remote surface information database, the surface information data being associated with the image by the remote server prior to receiving the at least a portion of the image of the geographic area over the network interface; and
rendering an interactive text annotation pursuant to the instructions with text effects such that the text annotation appears to be located in the three-dimensional space along at least a portion of a surface of the object depicted in the image.

15. The system of claim 14 , wherein the text effects specify an orientation of the text annotation such that the text annotation is rendered on a baseline positioned along at least a portion of the surface of the object depicted in the image.

16. The system of claim 14 , wherein the text annotation is fixed relative the image such that as a user navigates the image, the text annotation remains in a fixed location along at least a portion of the surface of the object depicted in the image.

17. The system of claim 14 , wherein the text annotation comprises at least a portion of travel directions.

18. The system of claim 14 , wherein the text annotation comprises at least a portion of travel directions, wherein upon user interaction with the text annotation, the system is configured to present imagery associated with the next step in the travel directions.

19. The system of claim 14 , wherein the surface information data comprises distance data representing the distance of the surface of the object to a camera.

20. A system for providing geographic images, the system comprising a processing device and a network interface, the processing device configured to:
receive a request for an image of a geographic area, the image defining a three dimensional space and depicting at least one object captured by a camera;
access a three-dimensional model associated with the geographic area depicted in the image to identify the location of a surface of the at least one object depicted in the image;
obtain instructions to render a text annotation with text effects such that the text annotation appears to be located in the three dimensional space along the surface of the at least one object, the text effects being determined based at least in part on the location of the surface identified in three-dimensional model; and
provide, via the network interface, at least a portion of the image and the instructions to another processing device.

21. The system of claim 20 , wherein the text annotation is interactive.

22. The system of claim 21 , wherein the text annotation comprises at least a portion of travel directions, wherein upon user interaction with the text annotation, the system is configured to present imagery associated with the next step in the travel directions.

23. A computer-implemented method for displaying panoramic imagery, comprising:
receiving at a computing device at least a portion of a panoramic image of a geographic area, the panoramic image defining a three-dimensional space and depicting at least one object captured by a camera;
presenting a viewport in the display of the computing device that displays at least a portion of the panoramic image;
o

Assignees

• Jones Jonah
• Simpson Matthew Robert
• Google Inc

Inventors

• Jones Jonah
• Simpson Matthew Robert

Classifications

• G06T2219/004

  Annotating, labelling · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G08G1/0969

  having a display in the form of a map · CPC title

• H04N21/6547

  comprising parameters, e.g. for client setup · CPC title

• H04N21/25841 Primary

  involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00) · CPC title