Assisting users in visualizing dimensions of a product

Patent metadata

Field	Value
Publication number	US-12282948-B2
Application number	US-202218047099-A
Country	US
Kind code	B2
Filing date	Oct 17, 2022
Priority date	May 13, 2020
Publication date	Apr 22, 2025
Grant date	Apr 22, 2025

Abstract

A computer readable medium for sizing a product includes instructions, that when executed by at least one processor, cause a computing device to: retrieve from a webpage information on a product including product dimensions; present on a display of a client device a graphical button that upon access by a user activates a camera for capturing an image of an object positioned at a focal distance from the camera, the object having a surface; prompt the user to enter boundary information of an imaginary housing to be placed on the surface; generate the imaginary housing dimensions in two dimensions (2D) based on the boundary information and the focal distance; and determine whether the product fits within the imaginary housing by comparing the product dimensions against the imaginary housing dimensions.

First claim

What is claimed is:

1. A non-transitory computer readable medium for sizing a product comprising instructions that, when executed by at least one processor, cause a computing device to:
retrieve from a website information on a product including product dimensions;
retrieve a Web page as a product page for the product;
augment the product page to generate an augmented product page including a graphical button so that selection of the graphical button by a user activates a physical camera for capturing a background image of a background;
present the background image on a display;
prompt the user to manually mark an imaginary housing on the presented background image by performing a manual marking of a first corner point of a two-dimensional (2D) boundary rectangle followed immediately by a second corner point of the 2D boundary rectangle opposite the first corner point on a display screen of the computing device, where the imaginary housing is a space to place the product;
use the physical camera to capture frames, identify and track points in the imaginary housing in the frames as anchors and determine spatial dimensions of the space in two dimensions from the anchors and a focal length of the physical camera;
use a Simultaneous Localization and Mapping (SLAM) algorithm to dynamically update the spatial dimensions and a position of the imaginary housing in real-time based on data sensed from the camera and screen dimensions of the computing device;
determine whether the product fits within the space by comparing the retrieved product dimensions in the two dimensions against the updated spatial dimensions of the space in the two dimensions;
extract a product image part from a two-dimensional (2D) image of the product retrieved from the website, scale the product image part according to the retrieved product dimensions and the updated spatial dimensions, and draw the imaginary housing on the display;
draw the imaginary housing on the display in a first color and draw the scaled product image part in a center of the imaginary housing without overlap when it is determined the product fits within the space; and
draw the imaginary housing on the display in a second color different than the first color to overlap the scaled product image part when it is determined the product does not fit within the space.

2. A system to enable a user to visualize a product size, the system comprising:
a server configured to store a plurality of Web pages for each of a plurality of products; and
a client device comprising:
a Web browser configured to interface with the server over a computer network to retrieve from a website information from one of the Web pages on a given product including product dimensions among the products; and
an application configured to control the Web browser to retrieve one of the Web pages as a product page for the given product, augment the product page to generate an augmented product page including a graphical button so that selection of the graphical button activates a physical camera of the client device for capturing a background image of a background to display the background image, and prompt the user to perform a manual marking of an imaginary housing on the displayed background image by performing a manual marking of a first corner point of a two-dimensional (2D) boundary rectangle followed immediately by a second corner point of the 2D boundary rectangle opposite the first corner point on a display screen of the client device, where the imaginary housing is a space to place the product,

wherein the application uses the physical camera to capture frames, identifies and tracks points in the imaginary housing in the frames as anchors and determines spatial dimensions of the space in two dimensions from the anchors and a focal length of the physical camera,
wherein the application uses a Simultaneous Localization and Mapping (SLAM) algorithm to dynamically update the spatial dimensions and a position of the imaginary housing in real-time based on data sensed from the camera, a position of the client device and screen dimensions of the client device,
wherein the application determines whether the given product fits within the space by comparing the retrieved product dimensions in the two dimensions against the updated spatial dimensions,
wherein the application extracts a product image part from a two-dimensional (2D) image of the product retrieved from the website, scales the product image part according to the retrieved product dimensions and the updated spatial dimensions, draws the imaginary housing on the display, and draws the imaginary housing on the display in a first color and draws the scaled product image part in a center of the imaginary housing without overlap to surround a product image of the product when it is determined the product fits within the space, and
wherein the application draws the imaginary housing on the display in a second color different than the first color to overlap the scaled product image part when it is determined the product does not fit within the space.

3. The system of claim 2 , wherein the application uses the SLAM algorithm during the marking to determine the spatial dimensions.

4. The system of claim 2 , wherein the application determines whether the given product will fit by dividing a product width of the product dimensions by a boundary width of the updated spatial dimensions to generate a first scale factor, dividing a product height of the product dimensions by a boundary height of the updated spatial dimensions to generate a second scale factor, and determining that the given product will fit when both scale factors are less than one.

5. The system of claim 2 , where the application extracts the product image part using a GrabCut algorithm.

6. The system of claim 2 , wherein an interface of the application includes a graphical button that inserts an image of an alternative product into the imaginary housing that fits within the imaginary housing, upon a user selecting the graphical button.

7. A computer-implemented method for visualizing a product within a desired space, the method comprising:
augmenting, by a web service, a product page for the product to include a graphical button, the product page being a Web page;
launching, by an application of a client device, an interface that activates a physical camera to capture background image of a background, causes display of the background image and prompts a user to perform a manual mark of an imaginary housing on the displayed background image by performing a manual marking of a first corner point of a two-dimensional (2D) boundary rectangle followed immediately by a second corner point of the 2D boundary rectangle opposite the first corner point on a display screen of the client device, in response to selection of the graphical button, where the imaginary housing is a space to place the product,
wherein the application uses the physical camera to capture frames, identifies and tracks points in the imaginary housing in the frames as anchors and determines spatial dimensions of the space in two dimensions from the anchors and a focal length of the physical camera,
wherein the application uses a Simultaneous Localization and Mapping (SLAM) algorithm to dynamically update the spatial dimensions and a position of the imaginary housing in real-time based on data sensed from the camera, a position of the client device and screen dimensions of the client device,
wherein the application determines whether the product fits within the space by comparing product dimensions of the product retrieved from the Web page in the two dimensions against the updated spatial dimensions,
wherein the application extracts a product image part from a two-dimensional (2D) image

Assignees

• Adobe Inc

Inventors

• Singhal Gourav
• Gupta Sourabh
• Sharma Mrinal Kumar

Classifications

• G06V10/751

  Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06V10/267

  by performing operations on regions, e.g. growing, shrinking or watersheds · CPC title

• G06V10/235

  based on user input or interaction · CPC title

• G06Q30/0623

  by investigating goods or services · CPC title