Method, medium, and system for planning image sensor deployment

Patent metadata

Field	Value
Publication number	US-11443337-B2
Application number	US-202117372162-A
Country	US
Kind code	B2
Filing date	Jul 9, 2021
Priority date	Jun 1, 2020
Publication date	Sep 13, 2022
Grant date	Sep 13, 2022

Abstract

A method for planning deployment of image sensors may include determining a location of a store shelf within a retail store and obtaining a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type. The method may also include accessing a database to determine a first height of products of the first product type and a second height of products of the second product type, and determining a position for placing a camera configured to capture images of at least a portion of the store shelf by analyzing the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height. The method may further include providing, to a user interface of a user device, information relating to the determined position of the camera.

First claim

What is claimed is:

1. A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for planning deployment of image sensors, the method comprising:
determining a location of a store shelf within a retail store;
obtaining a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type;
accessing a database to determine a first height of products of the first product type and a second height of products of the second product type;
determining, by analyzing the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height, a position for placing a camera that enables image recognition of products represented in an image captured by the camera, the determined position being expressed relative to a coordinate system or an object in the retail store; and
providing, to a user interface of a user device, information relating to the determined position for placing the camera, the provided information including an indication of a particular store shelf to mount the camera to.

2. The non-transitory computer-readable medium of claim 1 , wherein determining the location of the store shelf comprises:
obtaining a store plan; and
determining a location of store shelf based on the store plan.

3. The non-transitory computer-readable medium of claim 2 , wherein the store plan includes a three-dimensional (3D) model of the retail store.

4. The non-transitory computer-readable medium of claim 2 , wherein the store plan is determined based on an analysis of images captured from the retail store to identify store shelves and products placed on the store shelves.

5. The non-transitory computer-readable medium of claim 1 , wherein the first coverage parameter corresponding to the first product type comprises at least one of a depth within a shelf on which a plurality of products of the first product type are planned to be placed, a percent of the plurality of products of the first product type that have been to be captured in an image to enable recognition, a capturing resolution, or a capturing frequency.

6. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises determining the first product type and the second product type based on a planogram.

7. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises determining an orientation of the camera.

8. The non-transitory computer-readable medium of claim 7 , wherein the method further comprises:
receiving updated information relating to a product type associated with products placed on the store shelf;
determining an updated orientation of the camera based on the updated information; and
providing, to the user interface of the user device, the updated orientation of the camera.

9. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises determining a capturing frequency for a usage of the camera.

10. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises generating a simulated image corresponding to a field of view of the camera.

11. The non-transitory computer-readable medium of claim 1 , wherein the information relating to the determined position for placing the camera is provided through an augmented reality (AR) system.

12. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:
receiving updated information relating to a product type associated with products placed on the store shelf;
determining an updated position for placing the camera based on the updated information; and
providing, to the user interface of the user device, the updated position for placing the camera.

13. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:
receiving updated information relating to the store shelf;
determining an update to at least one of a position for placing the camera and an orientation of the camera based on the updated information; and
providing, to the user interface of the user device, information relating to the update to at least one of the position for placing the camera and the orientation of the camera.

14. The non-transitory computer-readable medium of claim 1 , wherein:
the store shelf comprises a first store shelf; and
the method further comprises:
determining a location of a second store shelf within a retail store; and
determining the position for placing the camera by analyzing the location of the store shelf, the location of the second store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height.

15. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:
determining at least one dimension of the store shelf within a retail store; and
determining the position for placing the camera analyzing the location of the store shelf, the at least one dimension of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height.

16. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:
receiving at least one property of the camera; and
determining the position for placing the camera by analyzing the at least one property of the camera, the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height.

17. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:
selecting a camera among a plurality of cameras as the camera based on properties of each one of the plurality of cameras, the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height; and
providing an indication of the selected camera to the user.

18. A system for planning deployment of image sensors, the system comprising:
at least one processor programmed to:
determine a location of a store shelf within a retail store;
obtain a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type;
access a database to determine a first height of products of the first product type and a second height of products of the second product type;
determine, by analyzing the location of the store shelf, the first coverage parameter, the second coverage parameter, the first height, and the second height, a position for placing a camera that enables image recognition of products represented in an image captured by the camera, the determined position being expressed relative to a coordinate system or an object in the retail store; and
provide, to a user interface of a user device, information relating to the determined position for placing the camera, the provided information including an indication of a particular store shelf to mount the camera to.

19. A method for planning deployment of image sensors, the method comprising:
determining a location of a store shelf within a retail store;
obtaining a first coverage parameter corresponding to a first product type and a second coverage parameter corresponding to a second product type;
accessing a database to determine a first height of products of the first product type and a second height of products o

Assignees

• Trax Technology Solutions Pte Ltd

Inventors

• Bronicki Youval
• Arev David Dedi
• Paneth Odi
• Merkado Ido
• Mordechay May Masha

Classifications

• G06V10/82

  using neural networks · CPC title

• G06Q30/0208 Primary

  Trade or exchange of goods or services in exchange for incentives or rewards · CPC title

• G06Q10/06395 Primary

  Quality analysis or management · CPC title

• G06F18/285

  Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system · CPC title

• G06F18/253

  of extracted features · CPC title