Augmented reality system method and appartus for displaying an item image in acontextual environment

Patent metadata

Field	Value
Publication number	US-2016019723-A1
Application number	US-201514868105-A
Country	US
Kind code	A1
Filing date	Sep 28, 2015
Priority date	Dec 22, 2009
Publication date	Jan 21, 2016
Grant date	—

Abstract

Method, apparatus, and system for providing an item image to a client for display in a contextual environment are described. In some embodiments, the user may select an item for display in the contextual environment, and the user may position a camera coupled to a processing system to capture the contextual environment. A placeholder may be generated and associated with an item selected by a user. In an embodiment, the generated placeholder may be placed in a location within the contextual environment, and the user's processing system may send a visual data stream of the camera-captured environment to a server. In an embodiment, the user's processing device may receive a modified data stream including an image of the item, and the user's processing device may display the item image in the same location as the placeholder.

First claim

1 . A computer-implemented method comprising:
receiving visual data from a camera of a client device, the visual data including placeholder information associated with a placeholder; determining placement information using a first portion of the placeholder, the determining of the placement information comprising determining an orientation of the placeholder and a distance of the placeholder from the camera; identifying a particular item corresponding to the placeholder based on a second portion of the placeholder; retrieving, from a networked database, an image of the item from among a plurality of images of the item based on the determined placement information, the retrieved image of the item being a best fit image according to physical dimensions of the item and the determined placement information; and modifying, using a processor of a machine, the received visual data to include image data associated with the retrieved image with reference to the placeholder.

2 . The method of claim 1 , further comprising:
receiving an input including an item selection; and providing generation information for generating the placeholder based on the received input.

3 . The method of claim 1 , wherein the determining of the placement information further comprises determining a scale factor based on the placement information.

4 . The method of claim 3 , wherein the retrieving of the image of the item associated with the placeholder further comprises selecting the image with reference to the determined scale factor.

5 . The method of claim 1 , wherein the retrieving of the image of an item comprises:
determining dimensions of the item; and modifying the retrieved image of the item in reference to the determined dimensions and the determined scale factor of the item.

6 . The method of claim 3 , wherein the determining of the scale factor further comprises detecting at least one of a change in contrast and edge portions of the placeholder.

7 . The method of claim 1 , wherein the retrieving of the image of the item comprises:
accessing a database of images; and selecting the image of the item from a plurality of images based on the placement information.

8 . The method of claim 1 , wherein the modifying of the received visual data further comprises replacing the placeholder information with item image information.

9 . The method of claim 1 , wherein the determining of placement information further comprises:
determining a scale factor based on a distance of the placeholder from a camera; and determining an orientation factor based on an angle of the placeholder in relation to the camera.

10 . The method of claim 9 , wherein the modifying of the received visual data to include the retrieved image with reference to the placement information further comprises:
modifying the retrieved image with reference to the scale factor and the orientation factor; and modifying the received visual data with modified retrieved image data.

11 . A system comprising:
a processor implemented visual data receiver module to receive visual data from a camera of a client device, the visual data including placeholder information associated with a placeholder; a processor-implemented placement determination module to determine placement information using a first portion of the placeholder, the determination module to determine the placement information by performing operations comprising determining an orientation of the placeholder and a distance of the placeholder from the camera; a processor-implemented retrieval module to identify a particular item corresponding to the placeholder based on a second portion of the placeholder, the retrieval module further to retrieve an image of the item from among a plurality of images of the item based on the determined placement information, the retrieved image of the item being a best fit image according to physical dimensions of the item and the determined placement information; and a processor-implemented modification module to modify the received visual data to include image data associated with the retrieved image with reference to the placeholder.

12 . The system of claim 11 , further comprising:
a processor-implemented input receiver module to receive an input including an item selection; and a processor-implemented information provider module to provide generation information for generating the placeholder based on the received input.

13 . The system of claim 11 , wherein the processor-implemented placement determination module is further to determine a scale factor.

14 . The system of claim 11 , wherein the processor-implemented retrieval module is further to detect a unique marker in the second portion of the placeholder.

15 . The system of claim 13 , wherein the processor-implemented retrieval module is further to:
determine dimensions of the item; and modify the retrieved image of the item utilizing the determined dimensions and the determined scale factor of the item.

16 . The system of claim 11 , wherein the processor-implemented detection module is further to detect at least one of a change in contrast of the placeholder and edges of the placeholder.

17 . The system of claim 11 wherein the processor-implemented modification module is further to retrieve information associated with the item for display with the item image.

18 . The system of claim 11 , wherein the processor-implemented retrieval module is to access a database of images, and select the image of the item from a plurality of images of the item based on determined placement information.

19 . The system of claim 11 , wherein the processor-implemented placement determination module is further to determine a scale factor based on a distance of the placeholder from a camera, and to determine an orientation factor based on an angle of the placeholder in relation to the camera.

20 . A machine-readable medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:
receiving visual data from a camera of a client device, the visual data including placeholder information associated with a placeholder; determining placement information using a first portion of the placeholder, the determining of the placement information comprising determining an orientation of the placeholder and a distance of the placeholder from the camera; identifying a particular item corresponding to the placeholder based on a second portion of the placeholder; retrieving, from a networked database, an image of the item from among a plurality of images of the item based on the determined placement information, the retrieved image of the item being a best fit image according to physical dimensions of the item and the determined placement information; and modifying the received visual data to include image data associated with the retrieved image with reference to the placeholder.

Assignees

• Ebay Inc

Inventors

• Tapley John
• Farraro Eric J

Classifications

• G06F3/0325

  using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image · CPC title

• G06F16/58

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F16/587

  using geographical or spatial information, e.g. location · CPC title