Interactive clothes and accessories fitting method and display system thereof

Patent metadata

Field	Value
Publication number	US-10373333-B2
Application number	US-201715458943-A
Country	US
Kind code	B2
Filing date	Mar 14, 2017
Priority date	Nov 1, 2016
Publication date	Aug 6, 2019
Grant date	Aug 6, 2019

Abstract

An interactive clothes and accessories fitting method, a display system and a computer-readable recording medium thereof are provided, where the method includes the following steps. While the user is wearing a first apparel, images of the user are continuously captured by using an image capturing device to generate a first image sequence, wherein each first image that forms the first image sequence respectively corresponds to a different pose of the user. While the user is wearing a second apparel, images of the user are continuously captured by using the image capturing device. When a second comparison image corresponding to a specific pose of the user is captured by the image capturing device, a first comparison image corresponding to the specific pose is searched from the first image sequence, and the first comparison image and the second comparison image are simultaneously displayed on a screen.

First claim

What is claimed is:

1. An interactive clothes and accessories fitting method, adapted to a display system having an image capturing device and a screen, and comprising the following steps:
while a user is wearing a first apparel, capturing a plurality of images of the user wearing the first apparel by using the image capturing device to generate a first image sequence, wherein each first image that forms the first image sequence respectively corresponds to a different pose of the user;
obtaining a pose angle and a reference distance corresponding to the pose of the user in each of the first images through image analysis to accordingly construct a first codebook; and
while the user is wearing a second apparel:
capturing a plurality of images of the user wearing the second apparel by using the image capturing device; and
when a second comparison image corresponding to a specific pose of the user is captured by the image capturing device, obtaining a specific pose angle and a specific reference distance of the specific pose of the user through image analysis, searching for a first comparison image corresponding to the specific pose from the first image sequence according to the first codebook, and displaying the first comparison image and the second comparison image simultaneously on the screen, wherein the first comparison image is the first image with the pose angle and the reference distance respectively being closest to the specific pose angle and the specific reference distance.

2. The interactive clothes and accessories fitting method according to claim 1 , wherein the step of constructing the first codebook comprises:
determining whether a pose angle variation in each of the first images is greater than or equal to a pose angle variation threshold;
setting each of the first images with the pose angle variation being greater than or equal to the pose angle variation threshold as a critical image; and
recording each of the critical images as well as the pose angle and the reference distance thereof in the first codebook.

3. The interactive clothes and accessories fitting method according to claim 2 , wherein the step of obtaining the pose angle variation threshold comprises:
obtaining two extreme pose angles from the pose angles;
obtaining an average pose angle variation of the first images according to the extreme pose angles and the total number of the first images; and
setting the pose angle variation threshold according to the average pose angle variation.

4. The interactive clothes and accessories fitting method according to claim 1 , wherein the step of obtaining the pose angle and the reference distance corresponding to the pose of the user in each of the first images comprises:
defining a reference line by using at least two fixed reference points in each of the first images; and
calculating a distance between a fixed comparison point and the reference line in each of the first image to obtain the reference distance corresponding to each of the first images.

5. The interactive clothes and accessories fitting method according to claim 1 , wherein before the step of capturing the images of the user wearing the first apparel by using the image capturing device, the interactive clothes and accessories fitting method further comprises:
playing a demonstration video with a plurality of demonstrated poses on the screen.

6. The interactive clothes and accessories fitting method according to claim 1 , wherein while the user is wearing the first apparel, when a first preset image corresponding to a preset pose of the user is captured by the image capturing device, the interactive clothes and accessories fitting method further comprises:
shooting the first preset image by using the image capturing device.

7. The interactive clothes and accessories fitting method according to claim 1 , wherein after the step of generating the first image sequence, the interactive clothes and accessories fitting method further comprises:
performing at least one of facial expression recognition and heartbeat recognition on the user in each of the first images to accordingly determine a preference level of the user on the first apparel.

8. The interactive clothes and accessories fitting method according to claim 7 , wherein when the preference level of the user on the first apparel is high, suggesting other apparels related to the first apparel.

9. A display system comprising:
an image capturing device, configured to capturing images;
a screen, configured to display images, wherein the image capturing device is disposed at a same side as the screen;
a memory, configured to store data; and
a processor, coupled to the image capturing device, the screen, and the memory, and configured to execute the following steps:
while a user is wearing a first apparel, capturing a plurality of images of the user wearing the first apparel by using the image capturing device to generate a first image sequence, wherein each first image that forms the first image sequence respectively corresponds to a different pose of the user;
obtaining a pose angle and a reference distance corresponding to the pose of the user in each of the first images through image analysis to accordingly construct a first codebook; and
while the user is wearing a second apparel:
capturing a plurality of images of the user wearing the second apparel by the image capturing device; and
when a second comparison image corresponding to a specific pose of the user is captured by the image capturing device, obtaining a specific pose angle and a specific reference distance of the specific pose of the user through image analysis, searching for a first comparison image corresponding to the specific pose from the first image sequence according to the first codebook, and displaying the first comparison image and the second comparison image simultaneously on the screen, wherein the first comparison image is the first image with the pose angle and the reference distance respectively being closest to the specific pose angle and the specific reference distance.

10. The display system according to claim 9 , wherein the processor determines whether a pose angle variation in each of the first images is greater than or equal to a pose angle variation threshold, sets each of the first images with the pose angle variation being greater than or equal to the pose angle variation threshold as a critical image, and records each of the critical images as well as the pose angle and the reference distance thereof in the first codebook.

11. The display system according to claim 10 , wherein the processor obtains two extreme pose angles from the pose angles, obtains an average pose angle variation of the first images according to the extreme pose angles and the total number of the first images, and sets the pose angle variation threshold according to the average pose angle variation.

12. The display system according to claim 9 , wherein the processor defines a reference line by using at least two fixed reference points in each of the first images, and calculates a distance between a fixed comparison point and the reference line in each of the first image to obtain the reference distance corresponding to each of the first images.

13. The display system according to claim 9 , wherein the memory prestores a demonstration video with a plurality of demonstrated poses, and wherein the processor further plays the demonstration video on the screen.

14. The display system according to claim 9 , wherein while the user is wearing the first apparel, when a first preset image corresponding to a preset pose of the user i

Assignees

• Wistron Corp

Inventors

• Yang Jie-Ci
• Kao Meng-Chao
• Lin Ting-Wei
• Lin Hui-Chen
• Li Yu-Ting

Classifications

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/50

  Constructional details · CPC title

• H04N5/232

  Electricity · mapped topic

• G06T2207/30196

  Human being; Person · CPC title