System and method for providing an interactive shopping experience via webcam

Patent metadata

Field	Value
Publication number	US-2017213072-A1
Application number	US-201715483700-A
Country	US
Kind code	A1
Filing date	Apr 10, 2017
Priority date	Jun 4, 2012
Publication date	Jul 27, 2017
Grant date	—

Abstract

A system and method for providing an interactive shopping experience via webcam is disclosed. A particular embodiment includes enabling a user to select from a plurality of items of virtual apparel; obtaining an image of a user via a web-enabled camera (webcam); using a data processor to perform facial detection on the image to isolate an image of a face of the user; estimating the user's position according to a position and a size of the image of the user's face; modifying an image corresponding to the selected item of virtual apparel based on the size of the image of the user's face; and auto-fitting the modified image corresponding to the selected item of virtual apparel to the image of the user's face.

First claim

1 - 20 . (canceled)

21 . A computing device, comprising:
a processor; and a memory coupled to the processor and storing instructions that, when executed by the processor, performs a method, comprising: obtaining an image using a camera associated with the computing device; performing facial recognition on the image; tracking, in real-time, a position of a face in the image; receiving a selection of an image overlay; and providing the image overlay on the face within the image, wherein providing the image overlay on the face within the image comprises automatically fitting the image overlay on the face within the image.

22 . The computing device of claim 21 , further comprising instructions for receiving input to choose a different image overlay.

23 . The computing device of claim 21 , further comprising instructions for detecting a gesture in the image to alter an appearance of the image overlay.

24 . The computing device of claim 21 , wherein tracking, in real-time, a position of the face in the image comprises tracking an area of skin in the image.

25 . The computing device of claim 21 , further comprising instructions for isolating the face in the image from other portions of the image during the facial recognition.

26 . The computing device of claim 21 , further comprising instructions for distinguishing between facial portions of the image and non-facial portions of the image.

27 . The computing device of claim 21 , wherein the image overlay is a pre-stored image.

28 . A method, comprising:
receiving, by a camera associated with a computing device, an image in real-time; using a set of rules to isolate a first portion of the image from a second portion of the image to determine a face portion of the image; receiving a selection of one or more pre-stored image overlays; determining a position of the face portion of the image; and applying the image overlay to one or more of the first portion of the image and the second portion of the image in real-time.

29 . The method of claim 28 , further comprising tracking movement contained within the image and causing the image overlay to move accordingly.

30 . The method of claim 28 , further comprising altering the image based on a detected movement within the image.

31 . The method of claim 28 , wherein applying the image over to the image comprises auto-fitting the image overlay to one or more of the first portion of the image and the second portion of the image.

32 . The method of claim 28 , further comprising determining a size of the face portion of the image.

33 . The method of claim 32 , wherein further comprising automatically adjusting a size of the image overlay based, at least in part, on the determined size of the face portion of the image.

34 . The method of claim 28 , wherein the image overlay is an item of virtual apparel.

35 . The method of claim 28 , wherein determining a position of the face portion of the image comprises tracking skin color associated with the face portion of the image.

36 . A computer-readable storage medium encoding computer executable instructions that, when executed by a processing unit, performs a method, comprising:
displaying an image as it is received by camera of a computing device; performing facial recognition on the image to isolate a face portion of the image from other portions of the image; determining one or more features of the face portion of the image; receiving a selection of one or more image overlays; automatically adjusting a size of the image overlay based, at least in part, on a size of the face portion of the image; applying, in real-time, the image overlay to the image; and displaying the image overlay on the image.

37 . The computer-readable storage medium of claim 36 , further comprising instructions for tracking movement of one or more portions of the image.

38 . The computer-readable storage medium of claim 37 , further comprising instructions for changing the appearance of the image overlay based, at least in part, on the movement of the one or more portions of the image.

39 . The computer-readable storage medium of claim 36 , further comprising instructions for:
modifying a pre-stored image; and using the pre-stored image as the image overlay.

40 . The computer-readable storage medium of claim 36 , further comprising instructions for altering a size of the image overlay based, at least in part, on a determined size of the face portion of the image.

Assignees

• Ebay Inc

Inventors

• Li Bin
• Yun Xiaohan
• Tan Zehong

Classifications

• G06Q30/0241 Primary

  Advertisements · CPC title

• G06V40/165

  using facial parts and geometric relationships · CPC title

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• H04N5/265

  Mixing · CPC title

• G06Q30/0641

  utilising user interfaces specially adapted for shopping · CPC title