Placing and presenting virtual objects in an augmented reality environment

Patent metadata

Field	Value
Publication number	US-10115236-B2
Application number	US-201615271409-A
Country	US
Kind code	B2
Filing date	Sep 21, 2016
Priority date	Sep 21, 2016
Publication date	Oct 30, 2018
Grant date	Oct 30, 2018

Abstract

Systems described herein allow for placement and presentation of virtual objects using mobile devices with a single camera lens. A device receives, from a first mobile device, a target image captured from a camera and target image data collected contemporaneously with the target image. The target image data includes a geographic location, a direction heading, and a tilt. The device receives, from the first mobile device, a first virtual object definition that includes an object type, a size, and a mobile device orientation for presenting a first virtual object within a video feed. The device generates a simplified model of the target image, and stores the first virtual object definition associated with the target image data and the simplified model of the target image. The device uploads the first virtual object definition and the target image data, so the first virtual object is discoverable by a second mobile device.

First claim

What is claimed is:

1. A method performed by a computing device, the method comprising:
receiving, from a first mobile device, a target image captured from a camera;
receiving, from the first mobile device, target image data collected contemporaneously with the target image, wherein the target image data defines a reference position that includes a geo-location, a direction heading, and a tilt for the first mobile device;
generating a simplified model of the target image;
receiving, from the first mobile device, a first virtual object definition that includes an object type, an object size, and a mobile device orientation for presenting a first virtual object within a video feed;
storing, based on the receiving the first virtual object definition, an augmented reality (AR) sphere that includes a sphere radius extending from the reference position, the first virtual object definition associated with the reference position and the simplified model of the target image;
uploading, to a memory location accessible to other mobile devices, the AR sphere;
sending, to a second mobile device, coordinates of the reference position for the AR sphere;
receiving, from the second mobile device, an indication that the second mobile device is in the reference position;
receiving, from the second mobile device, a video feed while the second mobile device is in the reference position;
detecting a match between an image from the video feed and the simplified model;
unlocking the AR sphere for the second mobile device based on the detecting; and
instructing the second mobile device to present the first virtual object over the image when the match is detected and the AR sphere is unlocked.

2. The method of claim 1 , further comprising:
providing, to the first mobile device, an augmented reality application that includes a user interface to enable a user to provide the first virtual object definition.

3. The method of claim 1 , wherein the mobile device orientation includes a different direction heading and a different tilt of the mobile device that is collected contemporaneously with a user's placement of the first virtual object.

4. The method of claim 1 , wherein the first virtual object is a two-dimensional representation of a three-dimensional object.

5. The method of claim 1 , wherein the generating further comprises:
detecting multiple edges in the target image;
selecting a statistically significant number of edges from the multiple edges; and
storing the selected edges as the simplified model.

6. The method of claim 1 , further comprising:
receiving, from the first mobile device, another virtual object definition that includes an object type and a size of another virtual object;
receiving, from the first mobile device, other mobile device data collected contemporaneously with placement of the other virtual object, wherein the other mobile device data includes the geo-location, a different direction heading, and a different tilt; and
storing, associated with the AR sphere, the other mobile device data and the other virtual object definition.

7. The method of claim 1 , further comprising:
receiving, from the first mobile device, another virtual object definition that includes an object type and a size of another virtual object;
receiving, from the first mobile device, other mobile device data collected contemporaneously with placement of the other virtual object, wherein the other mobile device data includes the geo-location, a different direction heading, and a different tilt;
storing, with the AR sphere, the other mobile device data associated with the other virtual object definition;
receiving, from the second mobile device, an indication that the second mobile device is in a position that corresponds to the other mobile device data; and
instructing the second mobile device to present the other virtual object over the image in response to the indication that the second mobile device is in the position that corresponds to the other mobile device data.

8. The method of claim 7 , further comprising:
providing, to the second mobile device, an augmented reality application that includes a user interface to enable the second mobile device to obtain the first virtual object definition.

9. The method of claim 1 , wherein the first mobile device includes a single camera facing an opposite direction to a display screen, and wherein the computing device includes a server device for a service provider network.

10. A device comprising:
one or more memories to store instructions; and
one or more processors to execute the instructions to:
receive, from a first mobile device, a target image captured from a camera;
receive, from the first mobile device, target image data collected contemporaneously with the target image, wherein the target image data defines a reference position that includes a geo-location, a direction heading, and a tilt for the first mobile device;
generate a simplified model of the target image;
receive, from the first mobile device, a first virtual object definition that includes an object type, an object size, and a mobile device orientation for presenting a first virtual object within a video feed;
store, based on receiving the first virtual object definition, an augmented reality (AR) sphere that includes a sphere radius extending from the reference position, the first virtual object definition associated with the reference position and the simplified model of the target image;
upload, to a memory location accessible to other mobile devices, the AR sphere;
send, to a second mobile device, coordinates of the reference position for the AR sphere;
receive, from the second mobile device, an indication that the second mobile device is in the reference position;
receive, from the second mobile device, a video feed while the second mobile device is in the reference position;
detect a match between an image from the video feed and the simplified model;
unlock the AR sphere for the second mobile device based on the detecting; and
instruct the second mobile device to present the first virtual object over the image when the match is detected and the AR sphere is unlocked.

11. The device of claim 10 , wherein the one or more processors are further to execute the instructions to:
provide, to the first mobile device, an augmented reality application that includes a user interface to enable a user to provide the first virtual object definition, and wherein the user interface provides access to a catalog of virtual objects.

12. The device of claim 10 , wherein the first virtual object definition further includes an orientation for a two-dimensional rendering of the first virtual object.

13. The device of claim 10 , wherein, when generating the simplified model of the target image, the one or more processors are further to execute the instructions to:
detect multiple edges in the target image;
select a group of edges from the multiple edges; and
store the selected group of edges as the simplified model.

14. The device of claim 10 , wherein, when detecting the match between the image from the video feed and the simplified model, the one or more processors are further to execute the instructions to:
detect edges in the image from the video feed; and
compare the edges in the image from the video feed with the selected group of edges in the simplified model.

15. The device of claim 10 , wherein the one or more processors are further to execute the instructions to:
receive, from the first mobile device, another virtual object definition that includes an object type and a siz

Assignees

• Verizon Patent & Licensing Inc

Inventors

• Sharma Manish
• Prakash Anand
• Blong Devin
• Zhang Qing
• Nagaraj Chetan Mugur
• Rangarajan Srivatsan
• Miller Eric

Classifications

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G09G5/006

  Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04) · CPC title

• G06F3/147

  using display panels · CPC title

• G09G2370/16

  Use of wireless transmission of display information · CPC title

• G06T7/13

  Edge detection · CPC title