Computer vision system and method for automatic checkout

Patent metadata

Field	Value
Publication number	US-2020193507-A1
Application number	US-202016803229-A
Country	US
Kind code	A1
Filing date	Feb 27, 2020
Priority date	May 9, 2016
Publication date	Jun 18, 2020
Grant date	—

Abstract

A system and method for computer vision driven applications in an environment that can include collecting image data across an environment; maintaining an environmental object graph from the image data whereby maintaining the environmental object graph is an iterative process that includes: classifying objects, tracking object locations, detecting interaction events, instantiating object associations in the environmental object graph, and updating the environmental object graph by propagating change in at least one object instance across object associations; and inspecting object state for at least one object instance in the environmental object graph and executing an action associated with the object state. The system and method can be applied to automatic checkout, inventory management, and/or other system integrations.

First claim

We claim:

1 . A method for expediting a checkout process comprising:
collecting image data across an environment; maintaining an environmental object graph from the image data wherein the environmental object graph is a data representation of computer vision classified objects in space and time across the environment, the environmental object graph comprising at least a subset of objects having probabilistic object associations; wherein maintaining the environmental object graph comprises at least one instance of:
in a first region captured in the image data, classifying a first object and at least a shopper object,
in the first region, detecting an interaction event between the first object and the shopper object, and
updating the environmental object graph whereby the first object is probabilistically associated with the shopper object;
inspecting objects that are probabilistically associated with the shopper object and thereby generating a checkout list.

Assignees

• Grabango Co

Inventors

• Glaser William
• Van Osdol Brian

Classifications

• G07G1/0036

  Checkout procedures · CPC title

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06Q20/203

  Inventory monitoring · CPC title

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• G06Q30/0635

  replenishment orders; recurring orders · CPC title