Fast 3d model fitting and anthropometrics using synthetic data

Patent metadata

Field	Value
Publication number	US-2022327854-A1
Application number	US-202217846509-A
Country	US
Kind code	A1
Filing date	Jun 22, 2022
Priority date	Oct 17, 2014
Publication date	Oct 13, 2022
Grant date	—

Abstract

Disclosed are methods and systems for displaying items of clothing on a model having a similar body shape to that of an ecommerce user. In one aspects, a system includes one or more hardware processors configured to perform operations comprising receiving, by one or more hardware processors, an image, the image representing a user height, user weight, and user gender, causing display, by the one or more hardware processors, of a second image via a computer interface, the second image representing a model, the model selected based on a comparison of a model height, weight, and gender with the user height, weight, and gender respectively, receiving, by the one or more hardware processors, a selection of an item of clothing; and causing display, by the one or more hardware processors, of a representation of the selected model wearing the selected item of clothing.

First claim

What is claimed is:

1 . A method comprising:
receiving, by one or more hardware processors, an indication of a height and a weight of a subject; receiving, by the one or more hardware processors, an image of the subject, the image depicting at least the height of the subject; determining, by the one or more hardware processors, one or more physical features of the subject based at least in part on the weight of the subject and a comparison of the height of the subject depicted in the image with the one or more physical features of the subject depicted in the image; generating, by the one or more hardware processors, a multi-dimensional feature vector representing at least the one or more physical features of the subject; selecting a three-dimensional model from a plurality of three-dimensional models based at least in part on the height, the weight, and a comparison of the multi-dimensional feature vector with a plurality of multi-dimensional feature vectors associated with the plurality of three-dimensional models; receiving, by the one or more hardware processors, a selection of an item of clothing; and displaying a representation of the selected three-dimensional model wearing the item of clothing.

2 . The method of claim 1 , further comprising:
obtaining rigging data associated with the selected three-dimensional model; and animating the representation of the selected three-dimensional model wearing the item of clothing in a plurality of poses based at least in part on the rigging data.

3 . The method of claim 1 , further comprising:
receiving an additional image of the subject, wherein the additional image is received prior to the image; determining a relative degree that the subject is depicted as standing straight in the additional image; and transmitting a prompt for the subject to pose for the image based at least in part on the relative degree satisfying a threshold, wherein the image of the subject is received in response to the prompt.

4 . The method of claim 1 , further comprising:
selecting a size of the item of clothing from a plurality of sizes of the item of clothing in response to receiving the selection of the item of clothing and based at least in part on one or more body measurements associated with the selected three-dimensional model, the selected size corresponding to the one or more body measurements of the selected three-dimensional model, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing is based at least in part on the size of the item of clothing.

5 . The method of claim 1 , further comprising:
determining one or more measurements associated with a size of the item of clothing based at least in part on receiving the selection of the item of clothing, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing comprises rendering a model of the item of clothing on top of the selected three-dimensional model.

6 . The method of claim 1 , wherein the item of clothing is displayed on the representation of the selected three-dimensional model with one or more wrinkles.

7 . The method of claim 1 , wherein the one or more physical features comprise a shoulder width, a hip width, a length of sleeve, a length of leg, or any combination thereof.

8 . A system comprising:
one or more processors; and a non-transitory computer-readable medium storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
receiving an indication of a height and a weight of a subject;
receiving an image of the subject, the image depicting at least the height of the subject;
determining one or more physical features of the subject based at least in part on the weight of the subject and a comparison of the height of the subject depicted in the image with the one or more physical features of the subject depicted in the image;
generating a multi-dimensional feature vector representing at least the one or more physical features of the subject;
selecting a three-dimensional model from a plurality of three-dimensional models based at least in part on the height, the weight, and a comparison of the multi-dimensional feature vector with a plurality of multi-dimensional feature vectors associated with the plurality of three-dimensional models;
receiving a selection of an item of clothing; and
displaying a representation of the selected three-dimensional model wearing the item of clothing.

9 . The system of claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
obtaining rigging data associated with the selected three-dimensional model; and animating the representation of the selected three-dimensional model wearing the item of clothing in a plurality of poses based at least in part on the rigging data.

10 . The system of claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
receiving an additional image of the subject, wherein the additional image is received prior to the image; determining a relative degree that the subject is depicted as standing straight in the additional image; and transmitting a prompt for the subject to pose for the image based at least in part on the relative degree satisfying a threshold, wherein the image of the subject is received in response to the prompt.

11 . The system of claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
selecting a size of the item of clothing from a plurality of sizes of the item of clothing in response to receiving the selection of the item of clothing and based at least in part on one or more body measurements associated with the selected three-dimensional model, the selected size corresponding to the one or more body measurements of the selected three-dimensional model, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing is based at least in part on the size of the item of clothing.

12 . The system of claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
determining one or more measurements associated with a size of the item of clothing based at least in part on receiving the selection of the item of clothing, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing comprises rendering a model of the item of clothing on top of the selected three-dimensional model.

13 . The system of claim 8 , wherein the item of clothing is displayed on the representation of the selected three-dimensional model with one or more wrinkles.

14 . The system of claim 8 , wherein the one or more physical features comprise a shoulder width, a hip width, a length of sleeve, a length of leg, or any combination thereof.

15 . A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause a system to perform operations comprising:
receiving an indication of a height and a weight of a subject; receiving an image of the subject, the image depicting at least the height of the subject; determining one or more physical features of the subject based at least in part on the weight of the subject and a comparison of the height of the subject depicted in the image with the one or more physical features of the subject d

Assignees

• Ebay Inc

Inventors

• Wang Qiaosong
• Piramuthu Robinson
• Jagadeesh Vignesh
• Ressler Bryan Kent

Classifications

• G06V40/107 Primary

  Static hand or arm · CPC title

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• A41H1/02

  Devices for taking measurements on the human body · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title