Monitoring apparatus, settlement apparatus, and programs

Patent metadata

Field	Value
Publication number	US-12488349-B2
Application number	US-202218085423-A
Country	US
Kind code	B2
Filing date	Dec 20, 2022
Priority date	Feb 14, 2022
Publication date	Dec 2, 2025
Grant date	Dec 2, 2025

Abstract

A monitoring apparatus includes a camera interface, a terminal interface, a communication interface, and a processor. The processor is configured to recognize actions of a settler at a point-of-sale terminal based on images from a camera, recognize input operations performed at the point-of-sale terminal by the settler based on information from the point-of-sale terminal and detect fraudulent acts based on a recognized action and a recognized input operation at the point-of-sale terminal. The processor outputs a fraud detection image corresponding to a detected fraudulent act to at least one of the point-of-sale terminal and an attendant terminal.

First claim

What is claimed is:

1 . A monitoring apparatus, comprising:
a camera interface for connecting to a camera; a terminal interface for connecting to a point-of-sale terminal; a communication interface for connecting to an attendant terminal; and a processor configured to:
recognize actions of a settler at the point-of-sale terminal based on images from the camera;
recognize input operations performed at the point-of-sale terminal by the settler based on information from the point-of-sale terminal;
detect fraudulent acts of the settler based on a recognized action of the settler at the point-of-sale terminal and a recognized input operation of the settler at the point-of-sale terminal; and
output a fraud detection image corresponding to a detected fraudulent act to the point-of-sale terminal, wherein
the fraud detection image is output to a display device of the point-of-sale terminal.

2 . The monitoring apparatus according to claim 1 , wherein the fraud detection image is acquired from the camera.

3 . The monitoring apparatus according to claim 1 , wherein the fraud detection image is acquired from a commodity scanner of the point-of-sale terminal.

4 . The monitoring apparatus according to claim 1 , wherein the actions of the settler recognized by the processor include a taking-out action by which the settler picks up an item from a shopping basket placed on a first table of the point-of-sale terminal and a bagging action by which the settler places an item into a shopping bag placed on a second table of the point-of-sale terminal.

5 . The monitoring apparatus according to claim 4 , wherein the processor recognizes a registration input operation in which an item is registered at the point-of-sale terminal by a scanning of a barcode on the item at the point-of-sale terminal.

6 . The monitoring apparatus according to claim 5 , wherein the processor detects a fraudulent act if the taking-out action and the bagging action are recognized without the registration input operation being recognized between the time of the taking-out action and the bagging action.

7 . The monitoring apparatus according to claim 6 , wherein the fraud detection image depicts the item bagged in the bagging action.

8 . The monitoring apparatus according to claim 1 , wherein
the actions of the settler recognized by the processor includes a registering action in which the settler holds an item in front of a scanner of the point-of-sale terminal, the processor recognizes a registration input operation in which an item is registered at the point-of-sale terminal by a scanning of a barcode at the point-of-sale terminal with the scanner, the processor detects a fraudulent act if the registering action is recognized but the scanning of the barcode fails, and the fraud detection image depicts the item held in front of the scanner during the recognized registering action.

9 . The monitoring apparatus according to claim 1 , wherein the processor is further configured to:
output the fraud detection image corresponding to the detected fraudulent act to the attendant terminal.

10 . A point-of-sale terminal, comprising:
a first table on which a settler can place items to be registered in a sales transaction; a second table on which the settler can place items registered in the sales transaction; a display screen for displaying information to the settler; a scanner for reading a barcode on an item to be purchased in the sales transaction; a camera interface for connecting to a camera; a communication interface for connecting to an attendant terminal; and a processor configured to:
recognize actions of a settler at the point-of-sale terminal based on images from the camera;
recognize input operations performed at the point-of-sale terminal by the settler;
detect fraudulent acts of the settler based on a recognized action of the settler at the point-of-sale terminal and a recognized input operation of the settler at the point-of-sale terminal;
output a fraud detection image corresponding to a detected fraudulent act to at least one of the display screen and the attendant terminal.

11 . The point-of-sale terminal according to claim 10 , wherein the fraud detection image is acquired from the camera.

12 . The point-of-sale terminal according to claim 10 , wherein the fraud detection image is acquired from a commodity scanner of the point-of-sale terminal.

13 . The point-of-sale terminal according to claim 10 , wherein
the actions of the settler recognized by the processor include a taking-out action by which the settler picks up an item from a shopping basket placed on the first table of and a bagging action by which the settler places an item into a shopping bag placed on the second table, the processor recognizes a registration input operation in which an item is registered by a scanning of a barcode on the item with the scanner, the processor detects a fraudulent act if the taking-out action and the bagging action are recognized without the registration input operation being recognized between the time of the taking-out action and the bagging action, and the fraud detection image depicts the item bagged in the bagging action.

14 . The point-of-sale terminal according to claim 10 , wherein
the actions of the settler recognized by the processor includes a registering action in which the settler holds an item in front of the scanner, the processor recognizes a registration input operation in which an item is registered at the point-of-sale terminal by a scanning of a barcode with the scanner, the processor detects a fraudulent act if the registering action is recognized but the scanning of the barcode fails, and the fraud detection image depicts the item held in front of the scanner during the recognized registering action.

15 . The point-of-sale terminal according to claim 10 , wherein the processor is further configured to:
register the item to be purchased in the sales transaction based on a reading of the barcode by the scanner.

16 . The point-of-sale terminal according to claim 10 , wherein the fraud detection image is output to the display screen.

17 . A non-transitory, computer-readable medium storing program instructions which when executed by a processor of a monitoring apparatus causes the monitoring apparatus to perform a method comprising:
recognize an action of a settler at a point-of-sale terminal based on images from a camera; recognize an input operation performed at the point-of-sale terminal by the settler based on information from the point-of-sale terminal; detect a fraudulent act of the settler based on a recognized action of the settler at the point-of-sale terminal and a recognized input operation of the settler at the point-of-sale terminal; and output a fraud detection image corresponding to a detected fraudulent act to a display device of the point-of-sale terminal.

18 . The non-transitory, computer-readable medium according to claim 17 , wherein the fraud detection image is acquired from the camera.

19 . The non-transitory, computer-readable medium according to claim 17 , wherein the fraud detection image is acquired from a commodity scanner of the point-of-sale terminal.

20 . The non-transitory, computer-readable medium according to claim 17 , wherein the fraud detection image is also output to the attendant terminal.

Assignees

• Toshiba Tec Kk

Inventors

• Gotanda Tsuyoshi
• Mimura Yusuke
• Takeuchi Daisuke
• Tanaka Yoshio
• Tsuboi Anna

Classifications

• G06Q20/208

  Input by product or record sensing, e.g. weighing or scanner processing · CPC title

• G07G1/0009

  Details of the software in the checkout register, electronic cash register [ECR] or point of sale terminal [POS] · CPC title

• G07G1/0018

  Constructional details, e.g. of drawer, printing means, input means · CPC title

• G06Q20/209

  Specified transaction journal output feature, e.g. printed receipt or voice output · CPC title

• G06Q20/204

  comprising interface for record bearing medium or carrier for electronic funds transfer or payment credit · CPC title