Systems and methods for generating augmented reality-based profiles

Patent metadata

Field	Value
Publication number	US-11087539-B2
Application number	US-201816107205-A
Country	US
Kind code	B2
Filing date	Aug 21, 2018
Priority date	Aug 21, 2018
Publication date	Aug 10, 2021
Grant date	Aug 10, 2021

Abstract

An augmented reality (AR) system for generating AR-based profiles using an AR computing device and an AR display device is provided. The AR system is configured to detect a consumer computing device located at a predefined distance from the AR display device, and transmit an electronic request message to an electronic computer application stored on the consumer computing device. The AR system is also configured to receive an electronic response message from the consumer computing device, wherein the electronic response message includes AR consumer data, and retrieve, from a database, an AR-based profile associated with the consumer based on the AR consumer identifier. The AR system is further configured to transmit the AR-based profile in the form of AR data to the AR display device, and display the AR data on a display screen of the AR display device.

First claim

What is claimed is:

1. An augmented reality (AR) system for generating AR-based profiles using an AR computing device and an AR display device controlled by a merchant, the AR computing device being communicatively coupled to the AR display device, a camera device, and a database, the AR system configured to:
receive, by the AR computing device from a payment processor computing device, transaction data corresponding to a plurality of payment transactions between a consumer and a plurality of merchants, the transaction data associated with a payment processing network and including, for each of the payment transactions, consumer account data corresponding to one of a plurality of consumers, a merchant ID corresponding to one of a plurality of merchants and data descriptive of a corresponding purchase;
generate, by the AR computing device using the transaction data for a consumer registered for a consumer profile (CP) service, an AR-based profile including information of the consumer comprising historical spend data associated with the consumer;
detect, using at least one network connection via the AR display device, a consumer computing device located at a predefined distance from the AR display device, the consumer computing device associated with a consumer;
transmit, via the AR display device, an electronic request message to an electronic computer application stored on the consumer computing device, the electronic request message including a request to confirm that the consumer associated with the consumer computing device is registered in the consumer profile (CP) service;
receive, by the AR computing device via the AR display device, an electronic response message from the consumer computing device, wherein the electronic response message includes AR consumer data including an AR consumer identifier and confirmation of registration of the consumer in the CP service, and wherein the electronic response message is received in response to the electronic request message;
in response to receiving the confirmation that the consumer is registered in the CP service, retrieve, by the AR computing device from the database, the AR-based profile associated with the consumer based on the AR consumer identifier;
transmit, by the AR computing device to the AR display device, the AR-based profile in the form of AR data; and
display, on the AR display device, the AR data on a see-through display screen of the AR display device, the AR data being superimposed near the consumer in response to the consumer being visible in a field of view of the see-through display screen to a representative of the merchant, the AR data displaying i) the information of the consumer to the representative of the merchant, and ii) hot zone data generated from the historical spend data, wherein the displayed hot zone data includes one or more computer-generated (CG) elements comprising at least one icon, the at least one icon displayed to the representative of the merchant in response to the consumer moving towards, or being in, an area within a location of the merchant, the area associated with at least one item that the consumer has purchased before.

2. The AR system of claim 1 further configured to:
receive, by the AR computing device, an electronic registration message from the consumer computing device, wherein the electronic registration message includes registration consumer data, wherein the registration consumer data includes a registration consumer identifier associated with the consumer; and
store, by the AR computing device, the registration consumer data within the database.

3. The AR system of claim 2 further configured to:
receive, by the AR computing device, the registration consumer data;
match, by the AR computing device, the registration consumer identifier to the AR consumer identifier; and
identify, by the AR computing device, the AR-based profile based on the matching.

4. The AR system of claim 2 further configured to:
perform a look up, by the AR computing device within multiple data sources, for data associated with the registration consumer identifier;
collect, by the AR computing device from the multiple data sources, the data associated with the registration consumer identifier;
store, by the AR computing device, the collected data within the database; and
generate, by the AR computing device based on the stored data, the AR-based profile for the consumer.

5. The AR system of claim 4 , wherein the multiple data sources include at least one of the AR display device, a payment processor computing device, at least one public record computing device, at least one social network computing device associated with social networks, and at least one merchant computing device, at least one consumer computing device.

6. The AR system of claim 4 further configured to:
update the AR data by performing at least one of receiving, by the AR computing device via the AR display device, user input data, and parsing, by the AR computing device, the multiple data sources; and
display, on the AR display device, the AR data that has been updated, the updated AR data displayed as the CG elements in the form of an updated icon indicating that the consumer has been helped by at least one of the representative of the merchant and another representative of the merchant.

7. The AR system of claim 5 , wherein the AR computing device is communicatively coupled to the payment processor computing device, and wherein the payment processor computing device is configured to transmit transaction data associated with the consumer to the AR computing device.

8. The AR system of claim 1 , wherein the AR display device includes a see-through, near-eye, mixed reality display device.

9. The AR system of claim 1 , wherein the AR display device is configured to display the AR data in the form of a plurality of computer-generated (CG) elements, wherein the AR display device is in communication with a security system associated with the merchant, wherein the security system captures a video including the area within the location of the merchant, and wherein the AR display device displays the video on the see-through display screen to the representative of the merchant.

10. The AR system of claim 1 , wherein the AR data includes at least one of consumer spend history data, consumer product return data, public record data, social network data, customer service data, hot zone data, online cart shopping data, and image data.

11. A computer-implemented method for generating augmented reality (AR)-based profiles using an augmented reality (AR) system including an AR computing device and an AR display device controlled by a merchant, the AR computing device being communicatively coupled to the AR display device, a camera device, and a database, the method comprising:
receiving, by the AR computing device from a payment processor computing device, transaction data corresponding to a plurality of payment transactions between a consumer and a plurality of merchants, the transaction data associated with a payment processing network and including, for each of the payment transactions, consumer account data corresponding to one of a plurality of consumers, a merchant ID corresponding to one of a plurality of merchants and data descriptive of a corresponding purchase;
generating, by the AR computing device using the transaction data for a consumer registered for a consumer profile (CP) service, an AR-based profile including information of the consumer comprising historical spend data associated with the consumer;
detecting, using at least one network connection via the AR display device, a consumer computing device located at a predefined distance

Assignees

• Mastercard International Inc

Inventors

• Unnerstall Rick
• Chen Ping X
• Williams Brian
• Thompson Emily Marie
• Zhou Ke
• Hu Zhenni
• Mullen Christopher Eric

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06Q20/3821

  Electronic credentials · CPC title