Fraud behavior recognition device, control program thereof, and fraud behavior recognition method

Patent metadata

Field	Value
Publication number	US-11704651-B2
Application number	US-202117528064-A
Country	US
Kind code	B2
Filing date	Nov 16, 2021
Priority date	Jan 14, 2021
Publication date	Jul 18, 2023
Grant date	Jul 18, 2023

Abstract

A detection device for detecting a fraud behavior of a customer at a point-of-sale (POS) terminal in a store, including a first interface circuit configured to receive a first image of the customer from a camera, a second interface circuit configured to receive a second image that is displayed on the POS terminal, and a processor configured to acquire one or more first images via the first interface circuit and determine one or more behaviors of the customer based on the acquired first images, acquire one or more second images via the second interface circuit and determine, based on the acquired second images, one or more operations that have been made by the customer on the POS terminal, and determine that one of the behaviors is fraudulent based on one or more of the operations that have been made by the customer before said one of the behaviors.

First claim

What is claimed is:

1. A detection device for detecting fraudulent behaviors by a customer at a self-service point-of-sale (POS) terminal in a store and determining a message to be displayed on the self-service POS terminal by a display control device via a store network in the store, comprising:
a camera interface circuit connectable to a camera installed in the store and configured to capture a first image of the customer operating the self-service POS terminal to perform checkout processing in a sales transaction;
a network interface circuit connectable to the display control device via the store network and configured to receive a second image that is displayed on the self-service POS terminal from the display control device;
a memory that stores a plurality of messages each corresponding to a fraudulent behavior; and
a processor configured to:
acquire one or more first images from the camera via the camera interface circuit and determine one or more behaviors of the customer based on the acquired first images,
acquire one or more second images from the display control device via the network interface circuit and determine, based on the acquired second images, one or more operations that have been made by the customer on the self-service POS terminal,
determine whether one of the behaviors of the customer is fraudulent based on one or more of the operations that have been made by the customer before said one of the behaviors, and
upon determining that one of the behaviors of the customer is fraudulent, select one of the messages corresponding to said one of the behaviors, generate a notification command indicating the selected message, and control the network interface circuit to transmit to the display control device the notification command, in response to which the self-service POS terminal displays the selected message before completing the sales transaction.

2. The detection device according to claim 1 , wherein said one of the behaviors is determined to be fraudulent when said one or more of the operations contradict said one of the behaviors.

3. The detection device according to claim 1 , wherein the processor is further configured to:
count a first number of predetermined behaviors of the customer,
count a second number of predetermined operations corresponding to the predetermined behaviors, and
determine that one of the predetermined behaviors is fraudulent when the first number is not identical with the second number.

4. The detection device according to claim 1 , wherein
the processor is further configured to determine a location of a component of the self-service POS terminal and a location of a body part of the customer in each of the first images, and
the behaviors of the customer are determined based on the determined location of the component and the body part.

5. The detection device according to claim 1 , wherein the processor is further configured to determine an operation that has been made by the customer based on a difference between two of the second images that have been sequentially received.

6. The detection device according to claim 1 , wherein the processor is further configured to recognize a predetermined character string in the second images to determine said one or more operations.

7. The detection device according to claim 1 , wherein
the camera interface circuit is further connectable to another camera installed in the store and configured to capture a third image of another customer operating another self-service POS terminal to perform checkout processing in another sales transaction,
the network interface circuit is further configured to receive a fourth image that is displayed on said another self-service POS terminal from the display control device via the store network, and
the processor is further configured to:
acquire one or more third images from said another camera via the camera interface circuit and determine one or more behaviors of said another customer based on the acquired third images,
acquire one or more fourth images from the display control device via the network interface circuit and determine, based on the acquired fourth images, one or more operations that have been made by said another customer on said another self-service POS terminal,
determine whether one of the behaviors of said another customer is fraudulent based on one or more of the operations that have been made by said another customer before said one of the behaviors, and
upon determining that one of the behaviors of said another customer is fraudulent, select one of the messages corresponding to said one of the behaviors of said another customer, generate another notification command indicating the selected message, and control the network interface circuit to transmit to the display control device said another notification command, in response to which said another self-service POS terminal displays the selected message before completing said another sales transaction.

8. The detection device according to claim 1 , wherein the notification command further causes an external terminal connected to the store network and operated by a store clerk to display the selected message.

9. A method performed by a detection device for detecting fraudulent behaviors by a customer at a self-service point-of-sale (POS) terminal in a store and determining a message to be displayed on the self-service POS terminal by a display control device via a store network in the store, the method comprising:
storing in a memory a plurality of messages each corresponding to a fraudulent behavior;
acquiring one or more first images of the customer operating the self-service POS terminal to perform checkout processing in a sales transaction from a camera and determining one or more behaviors of the customer based on the acquired first images;
acquiring one or more second images that are displayed on the self-service POS terminal from the display control device via the store network and determining, based on the acquired second images, one or more operations that have been made by the customer on the self-service POS terminal;
determining whether one of the behaviors of the customer is fraudulent based on one or more of the operations that have been made by the customer before said one of the behaviors; and
upon determining that one of the behaviors of the customer is fraudulent, selecting one of the messages corresponding to said one of the behaviors, generating a notification command indicating the selected message, and transmitting to the display control device the notification command, in response to which the self-service POS terminal displays the selected message before completing the sales transaction.

10. The method according to claim 9 , wherein said one of the behaviors is determined to be fraudulent when said one or more of the operations contradict said one of the behaviors.

11. The method according to claim 9 , further comprising:
counting a first number of predetermined behaviors of the customer;
counting a second number of predetermined operations corresponding to the predetermined behaviors; and
determining that one of the predetermined behaviors is fraudulent when the first number is not identical with the second number.

12. The method according to claim 9 , further comprising:
determining a location of a component of the self-service POS terminal and a location of a body part of the customer in each of the first images, wherein
the behaviors of the customer are determined based on the determined location of the component and the body part.

13. The method according to claim 9 , wherein one of the operations tha

Assignees

• Toshiba Tec Kk

Inventors

• Okamura Atsushi

Classifications

• G06Q20/206 Primary

  comprising security or operator identification provisions, e.g. password entry · CPC title

• G06Q20/202

  Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G07G1/0009 Primary

  Details of the software in the checkout register, electronic cash register [ECR] or point of sale terminal [POS] · CPC title

• H04N7/188 Primary

  Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253) · CPC title