Method system and medium for generating virtual contexts from three dimensional models

Patent metadata

Field	Value
Publication number	US-10475113-B2
Application number	US-201414581351-A
Country	US
Kind code	B2
Filing date	Dec 23, 2014
Priority date	Dec 23, 2014
Publication date	Nov 12, 2019
Grant date	Nov 12, 2019

Abstract

Techniques for generated and presenting images of items within user selected context images are presented herein. In an example embodiment, an access module can be configured to receive a first environment model and a first wearable item model. A simulation module coupled to the access module may process the environment model to identify placement volumes within the environment model and to place a clothed body model within the placement volume to generate a context model. A rendering module may then generate a context image from the context model. In various embodiments, the environment model used for the context, the wearable item positioned within the environment model, and rendering values used to generate context images may be changed in response to user inputs to generate new context images that are displayed to a user.

First claim

What is claimed is:

1. A system comprising:
a computing device comprising one or more processors and a memory coupled to the one or more processors;
an access module implemented using the one or more processors of the computing device configured to:
access, based on user input and from memory of the computing device, a set of context data, the set of context data comprising a first environment model of a first environment in which to view a wearable item;
access, based on user input and from memory of the computing device, a three-dimensional wearable item model of the wearable item, the three-dimensional wearable item model including a group of vertices associated with wearable item points that represent a tesselated surface of the wearable item; and
access, based on user input that provides a plurality of body measurements, a three-dimensional body model comprising a three dimensional digital representation of a body, at least a portion of the three-dimensional body model being configured to be placed inside the wearable item points of the three-dimensional wearable item model;

a simulation module coupled to the access module and configured to:
determine at least a first placement volume and a first perspective of the first placement volume within the first environment model based on a first set of placement cues, the first perspective being determined based on a score-based approach in which a score is computed for a plurality of placement points as a function of visibility characteristics associated with placement cues distributed around the first placement volume, and said first perspective is determined based on selection of a placement point based on the selected placement point's score; and
position at least a portion of the generated three-dimensional body model inside the wearable item points to generate a clothed body model by iteratively solving a system of force-based equations that simulate forces that act upon the wearable item points, wherein the force-based equations consider position and one or more variables of the vertices to produce a defined state of the wearable item; and
position the clothed body model within first placement volume of the model of the environment to generate a first context model; and

a rendering module configured to generate a first context image using the first context model and the first perspective associated with the first placement volume.

2. The system of claim 1 wherein configuration of the simulation module to determine at least the first placement volume comprises configuration to:
identify a plurality of unobstructed portions of a first ground area;
for each of the plurality of unobstructed portions of the first ground area, determine an unobstructed distance from the unobstructed portion toward a ceiling segment;
identify a plurality of placement volumes comprising the first placement volume from the plurality of unobstructed portions of the first ground area and the associated unobstructed distance toward the ceiling segment for each unobstructed portions;
select the first placement volume from plurality of placement volumes based at least in part on a proximity of the placement volume to a set of obstruction objects and a set of relevant context objects of the context model.

3. The system of claim 1 further comprising:
a server computer comprising at least one processor and a memory coupled to the at least one processor, wherein the server computer further comprises a server portion of the access module, the simulation module, and the rendering module; and
wherein the computing device is communicatively coupled to the server computer.

4. The system of claim 1 further comprising a display module coupled to the rendering module, wherein the display module is configured to output the first context image on a display of the computing device.

5. The system of claim 4 wherein the computing device further comprises a user interface module configured to:
receive a first user input selecting the wearable item from a virtual marketplace interface of the user interface module; and
receive a second user input selecting a second wearable item from the virtual marketplace interface of the user interface module.

6. The system of claim 5 , wherein the access module is further configured to:
receive the three-dimensional wearable item model from a network; and
receive a second wearable item model from the network, wherein the second wearable item image represents the second wearable item, and wherein the second wearable item is different than the wearable item.

7. The system of claim 6 wherein the simulation module is further configured to, in response to the second user input:
position at least a portion of the generated three-dimensional body model inside second wearable item points of the second wearable item model to generate a second clothed body model; and
position the clothed body model within first placement volume of the model of the environment to generate a second context model.

8. The system of claim 7 wherein the rendering module is further configured to, in response to the second user input, generate a second context image using the second context model and the first perspective associated with the first placement volume.

9. The system of claim 1 , wherein:
the computing device comprises the rendering module and a display module that outputs the first context image to a display of the computing device;
a server computer communicatively coupled to the computing device via a network, the server computer comprising the access module and the simulation module.

10. The system of claim 9 wherein the set of context data further comprises a second environment model depicting a second environment different than the first environment;
wherein the simulation module is further configured to determine at least a second placement volume and a second perspective of the second placement volume within the first environment model based on a first set of placement cues.

11. The system of claim 10 wherein the computing device further comprises a user interface module configured to:
receive a first user input selecting the first environment, wherein the first context image is generated and displayed on the display in response to the first user input; and
receive a second user input, following display of the first context image, selecting the second environment, wherein in response to the second user input:
the simulation module is configured to position the clothed body model within the second placement volume of the second environment model to generate a second context model; and
the rendering module is configured to generate a second context image from the second environment model and the second perspective; and
the display module is configured to output the second context image to replace the first context image on the display.

12. The system of claim 1 , wherein at least one of the forces comprises a gravitational force, an elastic force, a friction force, or an aerodynamic force.

13. A computing device implemented method for generating information, the method comprising:
capturing, using a camera device of the computing device coupled to one or more processors of the computing device, a first environment image;
generating, by a simulation module, a first environment model from the first environment image;
selecting, by an access module, the first environment model based on an analysis of the first environment image;
accessing, based on user input and from memory of the computing device by an access module of the computing device, a set of context data, the set of conte

Assignees

• Ebay Inc

Inventors

• Naware Mihir
• Chhugani Jatin
• Su Jonathan

Classifications

• G06F2113/12

  Cloth · CPC title

• G06F30/23

  using finite element methods [FEM] or finite difference methods [FDM] · CPC title

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title