Augmented reality product selection

Patent metadata

Field	Value
Publication number	US-10540776-B2
Application number	US-201816161063-A
Country	US
Kind code	B2
Filing date	Oct 16, 2018
Priority date	Mar 7, 2016
Publication date	Jan 21, 2020
Grant date	Jan 21, 2020

Abstract

Systems and methods are disclosed for recommending products or services by receiving a three-dimensional (3D) model of one or more products; performing motion tracking and understanding an environment with points or planes using accelerometer sensor and estimating light or color in the environment using one video camera without a depth sensor in a mobile phone; acquiring sensor data from sensors and optimizing features extracted from each image and sensor data, where a feature conveys data unique to the image at a specific pixel location; and projecting the product in the environment.

First claim

What is claimed is:

1. A method for recommending products, comprising:
with a camera and an accelerometer, performing motion tracking and understanding an environment with points or planes;
acquiring sensor data from sensors and optimizing features extracted from each image and sensor data;
selecting products each with dimensions from a 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products;
recommending a new product by looking up the correspondences among different manufacturer products; and
rendering the product in an augmented reality environment.

2. The method of claim 1 , further comprising:
iteratively changing product position until satisfied;
identifying a best fitting product;
setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products; and
generating an augmented or virtual reality display of the new product in the environment.

3. The method of claim 1 , comprising receiving images from an infrared camera.

4. The method of claim 1 , wherein the product comprises an appliance or furniture.

5. The method of claim 1 , wherein the product comprises a wearable item, a jean, or a shirt.

6. The method of claim 5 , comprising rendering an image of the product on a mannequin.

7. The method of claim 5 , comprising monitoring user health by analyzing changes in the 3D model over time.

8. The method of claim 5 , comprising analyzing a user anatomical portion and selecting a best fit from apparel variations.

9. The method of claim 1 , wherein the product comprises cosmetic product, a facial makeup product, a hair product.

10. The method of claim 1 , comprising area learning and depth sensing the product.

11. The method of claim 1 , comprising creating a 3D model using infrared images.

12. The method of claim 1 , comprising identifying one or more best fitting products to the environment and displaying recommendations with one or more best fitting products in the environment.

13. The method of claim 12 , wherein the best fitting products comprise clothing, shoes, cosmetics, appliances or furniture.

14. The method of claim 1 , comprising:
capturing 3D model of user's feet and identifying the subject's current best fitting shoe products;
setting each best fitting shoe product's inside dimension with dimensions from the 3D model plus a predetermined gap and correlating different manufacturer's shoe sizes and creating correspondences among different manufacturer shoe products.

15. A system, comprising:
a camera and an accelerometer for performing motion tracking and understanding an environment with points or planes;
a processor for:
acquiring sensor data from sensors and optimizing features extracted from each image and sensor data;
selecting products each with dimensions from a 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products;
recommending a new product by looking up the correspondences among different manufacturer products; and
rendering the product in an augmented reality environment.

16. A method for recommending a service, comprising:
with a camera and an accelerometer, performing motion tracking and understanding an environment with points or planes;
acquiring sensor data from sensors and optimizing features extracted from each image and sensor data;
selecting products each with dimensions from a 3D model plus a predetermined gap;
creating correspondences among different services;
recommending a service by looking up the correspondences among different service providers; and
rendering the resulting service in an augmented reality environment.

17. The method of claim 16 , comprising applying the service to a product from one of: a cosmetic product, a plastic surgery medical device, a facial makeup product, a hair product.

18. The method of claim 16 , comprising:
capturing images of a face and a reference object from a plurality of angles using a mobile camera;
creating a 3D model of the face from the images with dimensions based on dimensions of the reference object;
selecting a makeup pattern or color from a plurality of makeup product variations;
blending the makeup pattern or color onto the 3D model; and
displaying the makeup color on the face.

19. The method of claim 16 , wherein the target object comprises a breast implant, comprising recommending a breast augmentation sizing to a patient.

20. The method of claim 16 , wherein the products are facial make-ups, comprising:
capturing images of a face from a plurality of angles using a mobile camera;
detecting a skin tone from the face images;
selecting a makeup pattern or color from a plurality of makeup product variations;
modeling the makeup pattern or color interaction with the skin tone; and
displaying a makeup on the face.

Assignees

• Tran Bao
• Tran Ha

Inventors

• Tran Bao
• Tran Ha

Classifications

• A43D1/025 Primary

  comprising optical means, e.g. mirrors, photo-electric cells, for measuring or inspecting feet · CPC title

• G06T7/62 Primary

  of area, perimeter, diameter or volume · CPC title

• B33Y80/00

  Products made by additive manufacturing · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• A45D2044/007

  Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment · CPC title