Portable computing device installed in or mountable to a shopping cart

Patent metadata

Field	Value
Publication number	US-11532161-B2
Application number	US-202016831742-A
Country	US
Kind code	B2
Filing date	Mar 26, 2020
Priority date	Mar 6, 2017
Publication date	Dec 20, 2022
Grant date	Dec 20, 2022

Abstract

A computing device installed in or mountable to a shopping cart, includes a camera configured to capture an image, and a processor configured to acquire commodity data of a registered commodity, when an object is placed in the shopping cart, perform object recognition on an image of the object captured by the camera, and determine whether the recognized object is a commodity corresponding to the acquired commodity data, and upon determining that the recognized object is not the commodity corresponding to the acquired commodity data, issue a request for displaying a message instructing registration of the recognized object as a registered commodity.

First claim

What is claimed is:

1. A computing device installed in or mountable to a shopping cart, comprising:
a camera configured to capture an image; and
a processor configured to:
acquire commodity data of a commodity that has been registered as a registered commodity to be purchased by a customer,
when an object is placed in the shopping cart, perform object recognition on an image of the object captured by the camera, and determine whether the recognized object is a commodity corresponding to the acquired commodity data,
upon determining that the recognized object is not the commodity corresponding to the acquired commodity data, issue a request for displaying a message instructing the customer to register the recognized object as a registered commodity, and
after the message is displayed,
when another object is placed in the shopping cart, perform object recognition on an image of the other object captured by the camera, and determine whether the recognized object is the registered commodity, and
upon determining that the recognized object is the registered commodity, issue a request for cancelling the display of the message.

2. The computing device according to claim 1 , further comprising:
a display, wherein the message is displayed on the display.

3. The computing device according to claim 1 , further comprising:
a network interface, wherein the request is transmitted to another device via the network interface.

4. The computing device according to claim 1 , further comprising:
a network interface, wherein the commodity data is received from another device via the network interface.

5. The computing device according to claim 4 , wherein said another device is a wireless terminal configured to display information about registered commodities.

6. The computing device according to claim 1 , further comprising:
an interface connectable to a sensor configured to weigh objects in the shopping cart, wherein
the processor is configured to perform the object recognition upon detection of changes in weight of the objects in the shopping cart by the sensor.

7. The computing device according to claim 1 , wherein an imaging area of the camera includes an entire perimeter of the shopping cart.

8. The computing device according to claim 1 , further comprising:
a wireless tag reader having a communication range to detect a wireless tag attached to an object placed in the shopping cart.

9. The computing device according to claim 1 , further comprising:
a wireless tag reader having a communication range to detect a wireless tag attached to an object displayed on a commodity shelf.

10. The computing device according to claim 1 , wherein
the computing device is mounted on a handle of the shopping cart.

11. A method performed by a computing device installed in or mountable to a shopping cart, the method comprising:
acquiring commodity data of a commodity that has been registered as a registered commodity to be purchased by a customer;
when an object is placed in the shopping cart, capturing an image of the object with a camera, performing object recognition on the image, and determining whether the recognized object is a commodity corresponding to the acquired commodity data;
upon determining that the recognized object is not the commodity corresponding to the acquired commodity data, issuing a request for displaying a message instructing the customer to register the recognized object as a registered commodity, the message including a name of the recognized object; and
after the message is displayed,
when another object is placed in the shopping cart, performing object recognition on an image of the other object captured by the camera, and determining whether the recognized object is the registered commodity, and
upon determining that the recognized object is the registered commodity, issuing a request for cancelling the display of the message.

12. The method according to claim 11 , further comprising:
displaying the message on a display.

13. The method according to claim 11 , further comprising:
transmitting the request to another device via a network interface.

14. The method according to claim 11 , further comprising:
receiving the commodity data from another device via a network interface.

15. The method according to claim 14 , wherein said another device is a wireless terminal configured to display information about registered commodities.

16. The method according to claim 11 , wherein
the object recognition is performed upon detection of changes in weight of objects in the shopping cart by a sensor.

17. The method according to claim 11 , wherein an imaging area of the camera includes an entire perimeter of the shopping cart.

18. The method according to claim 11 , further comprising:
detecting a wireless tag attached to the object placed in the shopping cart by a wireless tag reader.

19. The method according to claim 11 , further comprising:
detecting a wireless tag attached to an object displayed on a commodity shelf by a wireless tag reader.

20. The method according to claim 19 , wherein
a location of the shopping cart can be determined based on information acquired from the detected wireless tag.

21. A computing device installed in or mountable to a shopping cart, comprising:
a camera configured to capture an image; and
a processor configured to:
acquire commodity data of a commodity that has been registered as a registered commodity to be purchased by a customer,
when an object is placed in the shopping cart, perform object recognition on an image of the object captured by the camera, and determine whether the recognized object is a commodity corresponding to the acquired commodity data, and
upon determining that the recognized object is not the commodity corresponding to the acquired commodity data, issue a request for displaying a message instructing the customer to register the recognized object as a registered commodity, wherein the processor is further configured to:

when an object is removed from the shopping cart, perform object recognition on an image of the object captured by the camera, and determine whether the recognized object is a registered commodity, and
upon determining that the recognized object is a registered commodity, issue a request for displaying a message instructing the customer to unregister the registered commodity.

Assignees

• Toshiba Tec Kk

Inventors

• Hiramatsu Kenya
• Susaki Akiko
• Gotanda Tsuyoshi
• Nakajima Takashi

Classifications

• G07G1/0045

  with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader · CPC title

• G07G1/0072

  with means for detecting the weight of the article of which the code is read, for the verification of the registration (weighing combined with recording means, e.g. in weighing scale, G01G19/415) · CPC title

• G06Q30/0601 Primary

  Electronic shopping [e-shopping] · CPC title

• H04N7/183

  for receiving images from a single remote source · CPC title

• G07G1/14

  Systems including one or more distant stations co-operating with a central processing unit · CPC title