Method, medium, and system for fast 3D model fitting and anthropometrics

Patent metadata

Field	Value
Publication number	US-9928412-B2
Application number	US-201514883419-A
Country	US
Kind code	B2
Filing date	Oct 14, 2015
Priority date	Oct 17, 2014
Publication date	Mar 27, 2018
Grant date	Mar 27, 2018

Abstract

A large synthetic 3D human body model dataset using real-world body size distributions is created. The model dataset may follow real-world body parameter distributions. Depth sensors can be integrated into mobile devices such as tablets, cellphones, and wearable devices. Body measurements for a user are extracted from a single frontal-view depth map using joint location information. Estimates of body measurements are combined with local geometry features around joint locations to form a robust multi-dimensional feature vector. A fast nearest-neighbor search is performed using the feature vector for the user and the feature vectors for the synthetic models to identify the closest match. The retrieved model can be used in various applications such as clothes shopping, virtual reality, online gaming, and others.

First claim

What is claimed is:

1. A method comprising:
accessing an image of a user;
based on the image of the user, determining a physical attribute of the user by a processor of a machine;
selecting a model from a set of models, based on a match between the physical attribute of the user and a corresponding attribute of the model; and
causing presentation of the selected model on a display device;
wherein the match between the physical attribute of the user and the corresponding attribute of the model is found as part of a comparison of a feature vector of the user and a feature vector of the model, each of the feature vectors including a height value, a weight value, and a gender value;
receiving a selection of an item of clothing from the user;
wherein the causing of the presentation of the selected model on the display device comprises presenting a representation of the selected model wearing the item of clothing on the display device.

2. The method of claim 1 , further comprising synthesizing the set of models based on a population distribution of an attribute.

3. The method of claim 2 , wherein the population distribution of the attribute includes a mean and a standard deviation of the attribute for each gender.

4. The method of claim 1 , wherein each of the feature vectors further includes a girth of neck value, a girth of shoulder value, a girth of chest value, a girth of waist value, and a girth of hip value.

5. The method of claim 1 , wherein:
the image of the user comprises a depth map; and
the determining of the physical attribute of the user is based on the depth map.

6. The method of claim 1 , wherein the determining of the physical attribute of the user comprises determining principal axes of the user.

7. The method of claim 1 , further comprising:
determining a size for the item of clothing based on the selected model.

8. The method of claim 7 , further comprising:
generating the representation of the model wearing the item of clothing based on the size of the item of clothing.

9. A system comprising:
one or more processors configured to perform operations comprising:
accessing an image of a user;
based on the image of the user, determining a physical attribute of the user;
selecting a model from a set of models, based on a match between the physical attribute of the user and a corresponding attribute of the model; and
causing presentation of the selected model on a display device;
wherein the match between the physical attribute of the user and the corresponding attribute of the model is found as part of a comparison of a feature vector of the user and a feature vector of the model, each of the feature vectors including a height value, a weight value, and a gender value;
receiving a selection of an item of clothing from the user;
wherein the causing of the presentation of the selected model on the display device comprises presenting a representation of the selected model wearing the item of clothing on the display device.

10. The system of claim 9 , wherein the operations further comprise:
synthesizing the set of models based on a population distribution of an attribute.

11. The system of claim 10 , wherein the population distribution of the attribute includes a mean and a standard deviation of the attribute for each gender.

12. The system of claim 9 , wherein each of the feature vectors further includes a girth of neck value, a girth of shoulder value, a girth of chest value, a girth of waist value, and a girth of hip value.

13. The system of claim 9 , wherein:
the image of the user comprises a depth map; and
the determining of the physical attribute of the user is based on the depth map.

14. The system of claim 9 , wherein the determining of the physical attribute of the user comprises determining principal axes of the user.

15. The system of claim 9 , wherein the operations further comprise:
determining a size for the item of clothing based on the selected model.

16. The system of claim 15 , wherein the operations further comprise:
generating the representation of the model wearing the item of clothing based on the size of the item of clothing.

17. A non-transitory machine-readable medium having instructions embodied thereon, the instructions executable by a processor of a machine to perform operations comprising:
accessing an image of a user;
based on the image of the user, determining a physical attribute of the user;
selecting a model from a set of models, based on a match between the physical attribute of the user and a corresponding attribute of the model; and
causing presentation of the selected model on a display device;
wherein the match between the physical attribute of the user and the corresponding attribute of the model is found as part of a comparison of a feature vector of the user and a feature vector of the model, each of the feature vectors including a height value, a weight value, and a gender value;
receiving a selection of an item of clothing from the user; and
wherein the causing of the presentation of the selected model on the display device comprises presenting a representation of the selected model wearing the item of clothing on the display device.

18. The non-transitory machine-readable medium of claim 17 , wherein the operations further comprise synthesizing the set of models based on a population distribution of an attribute.

Assignees

• Ebay Inc

Inventors

• Wang Qiaosong
• Piramuthu Robinson
• Jagadeesh Vignesh
• Ressler Bryan Kent

Classifications

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06V40/107

  Static hand or arm · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06K9/52

  Physics · mapped topic

• G06K9/00375 Primary

  Physics · mapped topic