Augmented reality system

Patent metadata

Field	Value
Publication number	US-10157503-B2
Application number	US-201815972149-A
Country	US
Kind code	B2
Filing date	May 5, 2018
Priority date	Mar 7, 2016
Publication date	Dec 18, 2018
Grant date	Dec 18, 2018

Abstract

Systems and methods are disclosed for recommending products or services by receiving a three-dimensional (3D) model of one or more products; performing motion tracking and understanding an environment with points or planes using accelerometer sensor and estimating light or color in the environment using one video camera without a depth sensor in a mobile phone; acquiring sensor data from sensors and optimizing features extracted from each image and sensor data, where a feature conveys data unique to the image at a specific pixel location; and projecting the product in the environment.

First claim

What is claimed is:

1. A method for recommending products, comprising:
receiving a three-dimensional (3D) model of one or more products;
performing motion tracking and understanding an environment with points or planes and estimating light or color in the environment;
acquiring sensor data from sensors and optimizing features extracted from each image and sensor data; and
iteratively changing product position until satisfied to identify a best fitting product;
setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products; and
recommending a new product by looking up the correspondences among different manufacturer products; and
projecting the product in the environment.

2. The method of claim 1 , comprising receiving images from an infrared camera.

3. The method of claim 1 , wherein the product comprises an appliance or furniture.

4. The method of claim 1 , wherein the product comprises a wearable item, a jean, or a shirt.

5. The method of claim 4 , comprising rendering an image of the product on a mannequin.

6. The method of claim 4 , comprising monitoring user health by analyzing changes in the 3D model over time.

7. The method of claim 4 , comprising analyzing a user anatomical portion and selecting a best fit from apparel variations.

8. The method of claim 1 , wherein the product comprises cosmetic product, a facial makeup product, a hair product.

9. The method of claim 1 , comprising motion tracking, area learning and depth sensing the product.

10. The method of claim 1 , comprising creating a 3D model using infrared images.

11. The method of claim 1 , comprising identifying one or more best fitting products to the environment and displaying recommendations with one or more best fitting products in the environment.

12. The method of claim 11 , wherein the best fitting products comprise clothing, shoes, cosmetics, appliances or furniture.

13. The method of claim 1 , comprising:
capturing 3D model of user's feet and identifying the subject's current best fitting shoe products;
setting each best fitting shoe product's inside dimension with dimensions from the 3D model plus a predetermined gap and correlating different manufacturer's shoe sizes and creating correspondences among different manufacturer shoe products.

14. A method for best fitting product variations to an environment, comprising:
receiving a three-dimensional (3D) model of one or more products;
performing motion tracking and understanding an and estimating light or color in the environment;
iteratively changing product position until satisfied to identify a best fitting product;
setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products;
recommending a new product by looking up the correspondences among different manufacturer products; and
generating an augmented or virtual reality display of the product in the environment.

15. A method for recommending a service, comprising:
receiving a three-dimensional (3D) model of a service to be applied to a target object;
performing motion tracking and understanding an and estimating light or color in the environment;
determining one or more dimensions of an environment of the target object;
generating the 3D model of the service as applied to the target object;
iteratively changing product position until satisfied to identify a best fitting product;
setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products; and
recommending a new product by looking up the correspondences among different manufacturer products;
creating correspondences among alternative services to apply the target object and scaling the 3D model of the generated 3D model based on dimensions of the environment and the service; and
generating an augmented or virtual reality display of the service as applied to the target object in the environment.

16. The method of claim 15 , comprising applying the service to a product from one of: a cosmetic product, a plastic surgery medical device, a facial makeup product, a hair product.

17. The method of claim 15 , comprising:
capturing images of a face and a reference object from a plurality of angles using a mobile camera;
creating a 3D model of the face from the images with dimensions based on dimensions of the reference object;
selecting a makeup pattern or color from a plurality of makeup product variations; and
blending the makeup pattern or color onto the 3D model; and
displaying the makeup color on the face.

18. The method of claim 15 , wherein the target object comprises a breast implant, comprising recommending a breast augmentation sizing to a patient.

19. The method of claim 15 , wherein the products are facial make-ups, comprising:
capturing images of a face from a plurality of angles using a mobile camera;
detecting a skin tone from the face images;
selecting a makeup pattern or color from a plurality of makeup product variations; and
modeling the makeup pattern or color interaction with the skin tone; and
displaying a makeup on the face.

Assignees

• Tran Bao

Inventors

• Tran Bao
• Tran Ha

Classifications

• A43D1/025 Primary

  comprising optical means, e.g. mirrors, photo-electric cells, for measuring or inspecting feet · CPC title

• G06T7/62

  of area, perimeter, diameter or volume · CPC title

• G06V10/17

  using hand-held instruments · CPC title

• G06V10/462

  Salient features, e.g. scale invariant feature transforms [SIFT] · CPC title

• G06V10/754

  involving a deformation of the sample pattern or of the reference pattern; Elastic matching · CPC title