Augmented reality techniques to identify a merchant category code associated with a transaction

Patent metadata

Field	Value
Publication number	US-12406446-B2
Application number	US-202318188693-A
Country	US
Kind code	B2
Filing date	Mar 23, 2023
Priority date	Mar 23, 2023
Publication date	Sep 2, 2025
Grant date	Sep 2, 2025

Abstract

In some implementations, an augmented reality device may establish a link with a transaction device. The augmented reality device may scan a surrounding environment to identify one or more objects in the surrounding environment using computer vision. The augmented reality device may determine, based on a notification that the transaction device was used to perform a transaction, a category associated with one or more objects that were identified in the surrounding environment at a time that the transaction was performed. The augmented reality device may send, to a transaction backend system, information that identifies a merchant category code (MCC) associated with the transaction based on the category associated with the one or more objects that were identified in the surrounding environment at the time that the transaction was performed.

First claim

What is claimed is:

1. An augmented reality device for categorizing a transaction, comprising:
one or more memories; and
one or more processors, coupled to the one or more memories, configured to:
establish a link with a transaction device;
scan a surrounding environment to identify one or more objects in the surrounding environment using computer vision;
determine, based on a notification that the transaction device was used to perform a transaction, a category associated with one or more objects that were identified in the surrounding environment at a time that the transaction was performed;
predict, using machine learning techniques, based on the surrounding environment, and based on the determined category, a merchant category code (MCC) associated with the transaction; and
send, to a transaction backend system and based on predicting the MCC, information that identifies the MCC.

2. The augmented reality device of claim 1 , wherein the link is established using near-field communication when the augmented reality device is in proximity to the transaction device or by reading information from the transaction device.

3. The augmented reality device of claim 1 , wherein the one or more processors are configured to:
determine, based on the notification that the transaction device was used to perform the transaction, information that indicates a geolocation associated with the surrounding environment at the time that the transaction was performed; and
correlate the information that indicates the geolocation associated with the surrounding environment at the time that the transaction was performed with one or more data sources that indicate an establishment present at the geolocation,
wherein the information that identifies the MCC associated with the transaction is further based on the establishment present at the geolocation.

4. The augmented reality device of claim 1 , wherein the one or more processors are configured to:
scan the surrounding environment to identify one or more visual characteristics associated with the surrounding environment using computer vision,
wherein the information that identifies the MCC associated with the transaction is further based on the one or more visual characteristics associated with the surrounding environment at the time that the transaction was performed.

5. The augmented reality device of claim 1 , wherein the information that identifies the MCC is associated with one or more attributes that correspond to the transaction.

6. The augmented reality device of claim 1 , wherein the notification is received from the transaction device, a point-of-sale terminal, or the transaction backend system.

7. The augmented reality device of claim 1 , wherein the augmented reality device and the transaction device are integrated within a single electronic device.

8. A method for categorizing a transaction, comprising:
scanning, by an augmented reality device, a surrounding environment;
determining, by the augmented reality device, based on a notification that a transaction device linked to the augmented reality device was used to perform a transaction, a category associated with one or more objects that were identified in the surrounding environment at a time that the transaction was performed;
predicting, by the augmented reality device, using machine learning techniques, based on the surrounding environment, and based on the determined category, a merchant category code (MCC) associated with the transaction; and
sending, by the augmented reality device, to a transaction backend system, information that identifies the MCC associated with the transaction based on predicting the MCC.

9. The method of claim 8 , wherein the augmented reality device is linked to the transaction device using near-field communication when the augmented reality device is in proximity to the transaction device or by reading information from the transaction device.

10. The method of claim 8 , wherein the one or more objects that were identified in the surrounding environment at the time that the transaction was performed are identified using computer vision.

11. The method of claim 8 , comprising:
determining, based on the notification that the transaction device was used to perform the transaction, information that indicates a geolocation associated with the surrounding environment at the time that the transaction was performed; and
correlating the information that indicates the geolocation associated with the surrounding environment at the time that the transaction was performed with one or more data sources that indicate an establishment present at the geolocation,
wherein the information that identifies the MCC associated with the transaction is further based on the establishment present at the geolocation.

12. The method of claim 8 , comprising:
scanning the surrounding environment to identify one or more visual characteristics associated with the surrounding environment using computer vision,
wherein the information that identifies the MCC associated with the transaction is further based on the one or more visual characteristics associated with the surrounding environment at the time that the transaction was performed.

13. The method of claim 8 , wherein the information that identifies the MCC is associated with one or more attributes that correspond to the transaction.

14. The method of claim 8 , wherein the notification is received from the transaction device, a point-of-sale terminal, or the transaction backend system.

15. A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of an augmented reality device, cause the augmented reality device to:
scan a surrounding environment to identify one or more objects in the surrounding environment using computer vision;
determine, based on a notification that a transaction device was used to perform a transaction, a category associated with one or more objects that were identified in the surrounding environment at a time that the transaction was performed;
predict, using machine learning techniques, based on the surrounding environment, and based on the determined category, a merchant category code (MCC) associated with the transaction; and
send, to a transaction backend system, information that identifies the MCC associated with the transaction based on predicting the MCC.

16. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions further cause the augmented reality device to:
establish a link with the transaction device using near-field communication when the augmented reality device is in proximity to the transaction device or by reading information from the transaction device.

17. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions further cause the augmented reality device to:
determine, based on the notification that the transaction device was used to perform the transaction, information that indicates a geolocation associated with the surrounding environment at the time that the transaction was performed; and
correlate the information that indicates the geolocation associated with the surrounding environment at the time that the transaction was performed with one or more data sources that indicate an establishment present at the geolocation,
wherein the information that identifies the MCC associated with the transaction is further based on the establishment present at the geoloca

Assignees

• Capital One Services Llc

Inventors

• Rapowitz Samuel
• Choi Ashleigh
• Jones John
• Martinez Stone Armando
• Shelton Andrew

Classifications

• G06N3/08

  Learning methods · CPC title

• G06N20/00

  Machine learning · CPC title

• G06Q20/3278

  RFID or NFC payments by means of M-devices · CPC title

• G06V10/44 Primary

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06Q20/42

  Confirmation, e.g. check or permission by the legal debtor of payment · CPC title