Fraud behavior recognition device, control program thereof, and fraud behavior recognition method

Patent metadata

Field	Value
Publication number	US-12033128-B2
Application number	US-202318325947-A
Country	US
Kind code	B2
Filing date	May 30, 2023
Priority date	Jan 14, 2021
Publication date	Jul 9, 2024
Grant date	Jul 9, 2024

Abstract

A detection device for detecting a fraud behavior of a customer at a point-of-sale (POS) terminal in a store, including a first interface circuit configured to receive a first image of the customer from a camera, a second interface circuit configured to receive a second image that is displayed on the POS terminal, and a processor configured to acquire one or more first images via the first interface circuit and determine one or more behaviors of the customer based on the acquired first images, acquire one or more second images via the second interface circuit and determine, based on the acquired second images, one or more operations that have been made by the customer on the POS terminal, and determine that one of the behaviors is fraudulent based on one or more of the operations that have been made by the customer before said one of the behaviors.

First claim

What is claimed is:

1. A detection device for detecting fraudulent behaviors by a customer at a self-service point-of-sale (POS) terminal in a store and determining a message to be displayed on an attendant terminal, wherein a screen displayed on the POS terminal is also displayed on the attendant terminal by a display control device connected between the POS terminal and the attendant terminal, the detection device comprising:
a camera interface circuit connectable to a camera installed in the store and configured to capture a customer image of the customer operating the POS terminal to perform checkout processing in a sales transaction;
a network interface circuit configured to receive from the display control device a screen image of the screen displayed on the POS terminal;
a memory that stores a plurality of messages each corresponding to a fraudulent behavior; and
a processor configured to:
acquire one or more customer images via the camera interface circuit and determine one or more behaviors of the customer based on the acquired customer images,
acquire one or more screen images via the network interface circuit and determine, based on the acquired screen images, one or more operations that have been made by the customer on the POS terminal,
determine whether one of the behaviors of the customer is fraudulent based on the determined behaviors and the determined operations, and
upon determining that one of the behaviors of the customer is fraudulent, select one of the messages corresponding to said one of the behaviors, generate a notification command indicating the selected message, and control the network interface circuit to transmit to the display control device the notification command, in response to which the attendant terminal displays the selected message before completing the sales transaction.

2. The detection device according to claim 1 , wherein the processor is configured to determine an operation that has been made by the customer based on a difference between two of the screen images that have been sequentially received.

3. The detection device according to claim 1 , wherein the processor is configured to recognize a predetermined character string in the screen images to determine said one or more operations.

4. The detection device according to claim 1 , wherein the processor determines that said one of the behaviors is fraudulent when one or more of the operations that have been made by the customer before said one of the behaviors contradicts said one of the behaviors.

5. The detection device according to claim 1 , wherein the processor is configured to:
count a first number of predetermined behaviors of the customer,
count a second number of predetermined operations corresponding to the predetermined behaviors, and
determine that one of the predetermined behaviors is fraudulent when the first number is not identical with the second number.

6. The detection device according to claim 1 , wherein
the processor is configured to determine a location of a component of the POS terminal and a location of a body part of the customer in each of the customer images, and
the behaviors of the customer are determined based on the determined location of the component and the body part.

7. A method carried out by a detection device for detecting fraudulent behaviors by a customer at a self-service point-of-sale (POS) terminal in a store and determining a message to be displayed on an attendant terminal, wherein a screen displayed on the POS terminal is also displayed on the attendant terminal by a display control device connected between the POS terminal and the attendant terminal, the method comprising:
storing in a memory a plurality of messages each corresponding to a fraudulent behavior;
acquiring, from a camera installed in the store, one or more customer images of the customer operating the POS terminal to perform checkout processing in a sales transaction, and determining one or more behaviors of the customer based on the acquired customer images;
acquiring from the display control device one or more screen images displayed on the POS terminal, and determining, based on the acquired screen images, one or more operations that have been made by the customer on the POS terminal;
determine whether one of the behaviors of the customer is fraudulent based on the determined behaviors and the determined operations; and
upon determining that one of the behaviors of the customer is fraudulent, selecting one of the messages corresponding to said one of the behaviors, generating a notification command indicating the selected message, and transmitting to the display control device the notification command, in response to which the attendant terminal displays the selected message before completing the sales transaction.

8. The method according to claim 7 , further comprising:
determining an operation that has been made by the customer based on a difference between two of the screen images that have been sequentially received.

9. The method according to claim 7 , further comprising:
recognizing a predetermined character string in the screen images to determine said one or more operations.

10. The method according to claim 7 , wherein said one of the behaviors is determined to be fraudulent when one or more of the operations that have been made by the customer before said one of the behaviors contradicts said one of the behaviors.

11. The method according to claim 7 , further comprising:
counting a first number of predetermined behaviors of the customer;
counting a second number of predetermined operations corresponding to the predetermined behaviors; and
determining that one of the predetermined behaviors is fraudulent when the first number is not identical with the second number.

12. The method according to claim 7 , further comprising:
determining a location of a component of the POS terminal and a location of a body part of the customer in each of the customer images, wherein
the behaviors of the customer are determined based on the determined location of the component and the body part.

13. A point-of-sale (POS) system for managing sales transactions in a store, comprising:
a self-service POS terminal configured to perform checkout processing in a sales transaction in the store;
a camera configured to capture a customer image of a customer operating the POS terminal;
an attendant terminal;
a display control device connected between the POS terminal and the attendant terminal and configured to output a screen displayed on the POS terminal to the attendant terminal; and
a detection device configured to:
store a plurality of messages each corresponding to a fraudulent behavior,
acquire one or more customer images from the camera and determine one or more behaviors of the customer based on the acquired customer images,
acquire one or more screen images of the screen displayed on the POS terminal from the display control device and determine, based on the acquired screen images, one or more operations that have been made by the customer on the POS terminal,
determine whether one of the behaviors of the customer is fraudulent based on the determined behaviors and the determined operations, and
upon determining that one of the behaviors of the customer is fraudulent, select one of the messages corresponding to said one of the behaviors, generate a notification command indicating the selected message, and transmit to the display control device the notification command, wherein

the display control device is configured to, upon receipt of the notification command from the detection device, control the attendant t

Assignees

• Toshiba Tec Kk

Inventors

• Okamura Atsushi

Classifications

• G06Q20/202

  Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G08B13/00

  Burglar, theft or intruder alarms · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title