Systems and methods for automated object recognition

Patent metadata

Field	Value
Publication number	US-2023419185-A1
Application number	US-202318460014-A
Country	US
Kind code	A1
Filing date	Sep 1, 2023
Priority date	Jun 23, 2016
Publication date	Dec 28, 2023
Grant date	—

Abstract

A method for recognizing an object in a video stream may include receiving a video stream comprising a plurality of video frames from a video source. The method may also select at least one video frame from the video frames according to a frame selection rate. The method may also partition the selected video frame into a first plurality of image blocks, and recognize, out of the first plurality of image blocks, a second plurality of image blocks which comprise an image of an object, the recognition being based on an image recognition parameter determined by a machine-learning algorithm. The method may also determine that at least one of the second plurality of image blocks corresponds to the object based on a likelihood metric, the likelihood metric being determined by the processor based on at least the frame selection rate, and display, on a display, information identifying the object.

First claim

What is claimed is:

1 . A system for providing an object list based on objects identified in a video stream, comprising:
a memory storing instructions; and a processor configured to execute the stored instructions to:
select a video frame from the video stream based on a frame selection value;
identify within one or more image blocks of the selected video frame, a region comprising an image of one or more objects, based on a machine learning model for determining regions characterized by an image recognition parameter;
update the object list comprising the one or more objects based on a likelihood metric indicating that the region is associated with the one or more objects; and
generate for display, on a user interface, information related to the object list.

2 . The system of claim 1 , wherein the processor is further configured to:
identify, within the region, one or more descriptive elements indicating a value associated with the one or more objects.

3 . The system of claim 1 , wherein updating the object list further comprises:
identifying a first descriptive element within the region indicating a user identifier of a user; identifying a second descriptive element within the region indicating a value associated with the one or more objects; and updating the object list using the user identifier and the value such that the object list (i) is associated with the user identifier and (ii) indicates the value associated with the one or more objects.

4 . The system of claim 3 , wherein the object list is transactionally-related to an account of the user.

5 . The system of claim 1 , wherein the processor is further configured to execute the stored instructions to:
compare the likelihood metric to a predetermined threshold; and determine that the identified region is associated with the one or more objects when the likelihood metric exceeds or equals the predetermined threshold.

6 . The system of claim 1 , wherein the processor is further configured to execute the stored instructions to store the region comprising the image of the one or more objects in a database.

7 . The system of claim 1 , wherein the processor is further configured to execute the stored instructions to determine the likelihood metric based on information identifying the object.

8 . The system of claim 1 , wherein the machine learning model is further configured to detect information related to the one or more objects, wherein the information includes descriptions of the one or more objects.

9 . The system of claim 8 , wherein the description of the one or more objects includes information related to a monetary value associated with the one or more objects.

10 . A computer-implemented method for recognizing an object in a video stream, comprising:
selecting a video frame from the video stream based on a frame selection value; identifying within one or more image blocks of the selected video frame, a region comprising an image of one or more objects, based on a machine learning model for determining regions characterized by an image recognition parameter; updating an object list comprising the one or more objects based on a likelihood metric indicating that the region is associated with the one or more objects; and generating for displaying, on a user interface, information related to the object list.

11 . The computer-implemented method of claim 10 , further comprising:
identifying, within the region, one or more descriptive elements indicating a value associated with the one or more objects.

12 . The computer-implemented method of claim 10 , wherein updating the object list further comprises:
identifying a first descriptive element within the region indicating a user identifier of a user; identifying a second descriptive element within the region indicating a value associated with the one or more objects; and updating the object list using the user identifier and the value such that the object list (i) is associated with the user identifier and (ii) indicates the value associated with the one or more objects.

13 . The computer-implemented method of claim 12 , wherein the object list is transactionally-related to an account of the user.

14 . The computer-implemented method of claim 10 , wherein the machine learning model is further configured to detect information related to the one or more objects, wherein the information includes descriptions of the one or more objects.

15 . The computer-implemented method of claim 14 , wherein the description of the one or more objects includes information related to a monetary value associated with the one or more objects.

16 . A non-transitory computer-readable medium storing instructions which, when executed, cause at least one processor to perform operations for recognizing an object in a video stream, the operations comprising:
selecting a video frame from the video stream based on a frame selection value; identifying within one or more image blocks of the selected video frame, a region comprising an image of one or more objects, based on a machine learning model for determining regions characterized by an image recognition parameter; updating an object list comprising the one or more objects based on a likelihood metric indicating that the region is associated with the one or more objects; and generating for displaying, on a user interface, information related to the object list.

17 . The non-transitory computer-readable medium of claim 16 , wherein the operations further comprise:
identifying, within the region, one or more descriptive elements indicating a value associated with the one or more objects.

18 . The non-transitory computer-readable medium of claim 16 , wherein updating the object list further comprises:
identifying a first descriptive element within the region indicating a user identifier of a user; identifying a second descriptive element within the region indicating a value associated with the one or more objects; and updating the object list using the user identifier and the value such that the object list (i) is associated with the user identifier and (ii) indicates the value associated with the one or more objects.

19 . The non-transitory computer-readable medium of claim 18 , wherein the object list is transactionally-related to an account of the user.

20 . The non-transitory computer-readable medium of claim 16 , wherein the machine learning model is further configured to detect information related to the one or more objects, and wherein the information includes information related to a monetary value associated with the one or more objects.

Assignees

• Capital One Services Llc

Inventors

• Jouhikainen Hannes Mikael
• Jacobs Drew

Classifications

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/09

  Supervised learning · CPC title

• G06N20/00 Primary

  Machine learning · CPC title

• G06T7/11

  Region-based segmentation · CPC title

• H04N21/23418

  involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title