System and method for providing an interactive shopping experience via webcam

Patent metadata

Field	Value
Publication number	US-9652654-B2
Application number	US-201213488020-A
Country	US
Kind code	B2
Filing date	Jun 4, 2012
Priority date	Jun 4, 2012
Publication date	May 16, 2017
Grant date	May 16, 2017

Abstract

A system and method for providing an interactive shopping experience via webcam is disclosed. A particular embodiment includes enabling a user to select from a plurality of items of virtual apparel; obtaining an image of a user via a web-enabled camera (webcam); using a data processor to perform facial detection on the image to isolate an image of a face of the user; estimating the user's position according to a position and a size of the image of the user's face; modifying an image corresponding to the selected item of virtual apparel based on the size of the image of the user's face; and auto-fitting the modified image corresponding to the selected item of virtual apparel to the image of the user's face.

First claim

We claim:

1. A method comprising:
displaying a plurality of items of virtual apparel for a user to select from, each of the items of virtual apparel comprising a pre-stored image of the respective item;
receiving a selection of one of the items of virtual apparel;
obtaining a first image of a user via a web-enabled camera (webcam);
performing, using a processor, facial detection, the performing comprising:
identifying an available set of classifiers, each classifier in the available set of classifiers including a feature that provides differentiation between a face image and a non-face image;
extracting a subset of classifiers from the available set of classifiers and assigning a specific weight to each classifier of the subset;
identifying a second image from the first image, the second image being a region of the first image and identified based on a score associated with the region of the first image transgressing a threshold score relative to a total weight of the subset of classifiers;
determining, based on the transgressing of the threshold score, that the second image includes a face; and
isolating the second image from the first image;

estimating, based on the isolating of the second image, a position of a body of the user relative to a position and a size of the second image, the body of the user and the estimated position of the body of the user being separate from and below the second image;
modifying a pre-stored image corresponding to the selected item of virtual apparel, the modifying being relative to a portion of the body of the user that is separate from and below the second image and based on the size of the second image; and
auto-fitting the modified image corresponding to the selected item of virtual apparel to the estimated position of the body of the user to appear separate from and below the second image.

2. The method as claimed in claim 1 wherein the facial detection includes searching the first image of the user in a plurality of pixel regions.

3. The method as claimed in claim 1 , further comprising:
performing skin detection and skin color tracking.

4. The method as claimed in claim 1 , further comprising:
converting RGB pixels to YCbCr color space.

5. The method as claimed in claim 1 , further comprising:
providing a virtual button click for the user to modify the auto-fitted image corresponding to the selected item of virtual apparel.

6. The method as claimed in claim 1 , further comprising:
providing gesture recognition, the gesture recognition including a gesture move function.

7. The method as claimed in claim 1 , further comprising:
providing gesture recognition, the gesture recognition including a gesture stretch horizontally function.

8. The method as claimed in claim 1 , further comprising:
providing gesture recognition, the gesture recognition including a gesture stretch diagonally function.

9. A system comprising:
one or more processors and executable instructions accessible on a computer-readable medium that, when executed, cause the one or more processors to perform operations comprising:
displaying a plurality of items of virtual apparel for a user to select from, each of the items of virtual apparel comprising a pre-stored image of the respective item;
receiving a selection of one of the items of virtual apparel;
obtaining a first image of a user via a web-enabled camera (webcam);
performing facial detection, the performing comprising:
identifying an available set of classifiers, each classifier in the available set of classifiers including a feature that provides differentiation between a face image and a non-face image;
extracting a subset of classifiers from the available set of classifiers and assigning a specific weight to each classifier of the subset;
identifying a second image from the first image, the second image being a region of the first image and identified based on a score associated with the region of the first image transgressing a threshold score relative to a total weight of the subset of classifiers;
determining, based on the transgressing of the threshold score, that the second image includes a face; and
isolating the second image from the first image;

estimating, based on the isolating of the second image, a position of a body of the user relative to a position and a size of the second image, the body of the user and the estimated position of the body of the user being separate from and below the second image;
modifying a pre-stored image corresponding to the selected item of virtual apparel, the modifying being relative to a portion of the body of the user that is separate from and below the second image and based on the size of the second image; and
auto-fitting the modified image corresponding to the selected item of virtual apparel to the estimated position of the body of the user to appear separate from and below the second image.

10. The system as claimed in claim 9 wherein the performing the facial detection further comprises searching the first image of the user in a plurality of pixel regions.

11. The system as claimed in claim 9 , wherein the operations further comprise performing skin detection and skin color tracking.

12. The system as claimed in claim 9 , wherein the operations further comprise converting RGB pixels to YCbCr color space.

13. The system as claimed in claim 9 , wherein the operations further comprise providing a virtual button click for the user to modify the auto-fitted image corresponding to the selected item of virtual apparel.

14. The system as claimed in claim 9 , wherein the operations further comprise providing gesture recognition, the gesture recognition including a gesture stretch horizontally function.

15. The system as claimed in claim 9 , wherein the operations further comprise providing gesture recognition, the gesture recognition including a gesture stretch diagonally function.

16. A hardware storage device having stored therein instructions which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
displaying a plurality of items of virtual apparel for a user to select from, each of the items of virtual apparel comprising a pre-stored image of the respective item;
receiving a selection of one of the items of virtual apparel;
obtaining a first image of a user via a web-enabled camera (webcam);
performing facial detection, the performing comprising:
identifying an available set of classifiers, each classifier in the available set of classifiers including a feature that provides differentiation between a face image and a non-face image;

extracting a subset of classifiers from the available set of classifiers and assigning a specific weight to each classifier of the subset;
identifying a second image from the first image, the second image being a region of the first image and identified based on a score associated with the region of the first image transgressing a threshold score relative to a total weight of the subset of classifiers;
determining, based on the transgressing of the threshold score, that the second image includes a face; and
isolating the second image from the first image;
estimating, based on the isolating of the second image, a position of a body of the user relative to a position and a size of the second image, the body of the user and the estimated position of the body of the user being separate from and below the second image;
modifying a pre-stored image corresponding to the selected item of virtual apparel, the modifying being relative to a portion of the

Assignees

• Li Bin
• Yun Xiaohan
• Tan Zehong
• Ebay Inc

Inventors

• Li Bin
• Yun Xiaohan
• Tan Zehong

Classifications

• G06Q30/0241 Primary

  Advertisements · CPC title

• G06V40/165

  using facial parts and geometric relationships · CPC title

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06K9/00 Primary

  Physics · mapped topic

• G06Q30/0601

  Electronic shopping [e-shopping] · CPC title