Modification of three-dimensional garments using gestures

Patent metadata

Field	Value
Publication number	US-10310616-B2
Application number	US-201514675241-A
Country	US
Kind code	B2
Filing date	Mar 31, 2015
Priority date	Mar 31, 2015
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

Techniques for modifying a garment based on gestures are presented herein. An access module can access a first set of sensor data from a first sensor, and a second set of sensor data from a second sensor. A garment simulation module can generate a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data. A display module can cause a presentation, on a display of a device, of the 3D garment model draped on the avatar. Additionally, the garment simulation module can determine a modification gesture associated with the 3D garment model draped on the avatar based on the first set of sensor data and the second set of sensor data. Furthermore, the garment simulation module can modify the 3D garment model based on the determined modification gesture.

First claim

What is claimed is:

1. A method comprising:
accessing a first set of sensor data from a first sensor;
accessing a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor;
generating a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data;
causing a presentation, on a display of a device, of the 3D garment model draped on the avatar;
detecting a section-specific garment-fit modification gesture in relation to a section of the 3D garment model draped on the avatar based on the first set of sensor data and the second set of sensor data, including:
identifying a difference between initial and final sensor data of the first set of sensor data with respect to the section of the 3D garment model, the initial sensor data received at a first time and the final sensor data received at a second time; and
determining the section specific garment-fit modification gesture based on the identified difference; and
modifying the 3D garment model by tailoring the section of the 3D garment model as draped on the avatar according to the detected section-specific garment-fit modification gesture, the tailoring including at least one alteration effective to modify the section of the 3D garment model to produce a custom size from a manufacturer-predefined size.

2. The method of claim 1 , wherein generating the 3D garment model draped on the avatar includes:
generating the avatar based on the first set of sensor data and the second set of sensor data; and
draping the 3D garment model of the garment available for sale on the generated avatar.

3. The method of claim 2 , further comprising:
accessing the 3D garment model from a garment model database included as part of an electronic marketplace, the 3D garment model having a material property; and
calculating a simulated force acting on the 3D garment model based on the material property, the 3D garment model being draped on the avatar based on the calculated simulated force.

4. The method of claim 2 , further comprising determining a size for the garment available for sale based on the generated avatar.

5. The method of claim 1 , further comprising updating the presentation, on the display of the device, of the modified 3D garment model draped on the avatar.

6. The method of claim 5 , further comprising:
determining a confirmation gesture for the modified 3D garment model based on the first set of sensor data and the second set of sensor data; and
transmitting a request to modify the garment available for sale based on the determined confirmation gesture.

7. The method of claim 1 , wherein the first sensor includes a depth sensor, a red-green-blue (RGB) camera, and a microphone.

8. The method of claim 1 , further comprising:
accessing a third set of sensor data from a third sensor, wherein the first sensor, the second sensor, and the third sensor are positioned in a triangle configuration;
wherein generating the 3D garment model draped on the avatar is further based on the third set of sensor data; and
wherein detecting the section-specific garment-fit modification gesture is further based on the third set of sensor data.

9. The method of claim 1 , wherein the first set of sensor data includes a two-dimensional (2D) range image, the 2D range image having pixel values corresponding to distance information for depicted objects in relation to the first sensor.

10. The method of claim 1 , wherein generating the 3D garment model draped on the avatar is performed by a graphics processing unit.

11. The method of claim 1 , wherein accessing the first set of sensor data from the first sensor is performed by a wireless transceiver.

12. The method of claim 1 , wherein the section-specific garment-fit modification gesture includes at least one of a hand pulling gesture, a hand stretching gesture, a hand pinching gesture, a pinching and pulling gesture, and a pinching and tucking gesture.

13. The method of claim 12 , wherein the at least one alteration includes at least one of elongating the section of the 3D garment model based on the hand pulling gesture, elongating the section of the 3D garment model based on the hand stretching gesture, shortening the section of the 3D garment model based on the hand stretching gesture, converting the 3D garment model to a smaller size that is not predefined by a manufacturer based on the pinching and pulling gesture, or converting the 3D garment model to a larger size that is not predefined by the manufacturer based on the pinching and tucking gesture.

14. The method of claim 1 , further comprising:
determining at least one garment fit for the avatar based on the first set of sensor data and the second set of sensor data;
determining that manufacturer-predefined sizes of the garment available for sale do not fit the avatar based on the determined at least one garment fit; and
responsive to determining that the manufacturer-predefined sizes do not fit the avatar, performing at least one of:
communicating custom sizing information indicative of the at least one garment fit to the manufacturer; and
modifying the 3D garment model by tailoring the 3D garment model from the manufacturer-predefined size to the custom size based on the at least one garment fit.

15. A system comprising:
an access module configured to:
access a first set of sensor data from a first sensor; and
access a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor;

at least one processor of a garment simulation module configured to generate a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data;
a display module configured to cause a presentation, on a display of a device, of the 3D garment model draped on the avatar; and
the garment simulation module further configured to:
identify, with respect to a section of the 3D garment model draped on the avatar, a difference between initial sensor data and final sensor data of the first set of sensor data, the initial sensor data received at a first time and the final sensor data received at a second time;
determine a section-specific garment-fit modification gesture in relation to the section based on the identified difference; and
modify the 3D garment model by tailoring the section of the 3D garment model as draped on the avatar according to the determined section-specific garment-fit modification gesture, the tailoring including at least one alteration in relation to the section effective to modify the 3D garment model from a manufacturer-predefined size to a custom size.

16. The system of claim 15 , wherein the display module is further configured to update the presentation, on the display of the device, of the modified 3D garment model draped on the avatar.

17. The system of claim 15 , wherein the garment simulation module is further configured to:
determine a confirmation gesture for the modified 3D garment model based on the first set of sensor data and the second set of sensor data; and
transmit a request to modify the garment available for sale based on the determined confirmation gesture.

18. The system of claim 15 , wherein the section-specific garment-fit modification gesture includes at least one of a hand pulling gesture, a hand stretching gesture, a hand pinching gesture, a pinching and pulling gesture, an

Assignees

• Ebay Inc

Inventors

• Rose Kyle Smith
• Sapra Pooja
• Blue Vivienne Melody
• Barnum Chuck
• Singam Giridhar
• Miller Chris
• Minenno Rachel Maxine
• Perrine James Stephen

Classifications

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title

• G06F2113/12

  Cloth · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title