Interactive 3D image projection systems and methods

Patent metadata

Field	Value
Publication number	US-11288733-B2
Application number	US-201816191072-A
Country	US
Kind code	B2
Filing date	Nov 14, 2018
Priority date	Nov 14, 2018
Publication date	Mar 29, 2022
Grant date	Mar 29, 2022

Abstract

A 3D interface generator computing device (“3D device”) is provided. The 3D device includes at least one sensor, a projector, and a memory that stores (i) a 3D image including 3D elements, (ii) identification for individuals, each associated with an element, and (iii) list data associated with an individual and purchase options. The 3D device includes at least one processor coupled to the memory, the projector, and the sensor. The processor is configured to project the 3D image into a real-world space. The 3D device also receives a first interaction with a 3D element, retrieves the individual associated with the 3D element and a set of list data associated with the individual. The 3D device overlays purchase option images onto the 3D image, each representing an option in the list data, receives a second interaction with a purchase option image, and generates a purchase transaction request for the purchase option.

First claim

What is claimed is:

1. A 3D interface generator computing device comprising:
at least one sensor;
a projector;
a memory device configured to store (i) 3D image data corresponding to a 3D image, wherein the 3D image includes a plurality of 3D elements, (ii) a plurality of user profiles each including identification information for a respective one of a plurality of individuals, wherein each of the plurality of user profiles is associated with a respective one of the 3D elements, (iii) sets of list data, each set of list data associated with a respective one of the plurality of individuals and identifying a plurality of purchase options; and (iv) a library of gestures indicating a pattern of physical interactions performed by a user; and
at least one processor communicatively coupled to the memory device, the projector, and the at least one sensor, the at least one processor configured to:
collect registration data from the plurality of individuals, wherein the registration data for each of the individuals defines gift items that the respective individual wishes to receive;
generate the sets of list data for the plurality of user profiles based on the gift items in the registration data collected from the plurality of individuals;
store the generated sets of list data in the memory device in association with the user profiles for the plurality of individuals;
command the projector to project the 3D image into a real-world space;
detect, using the at least one sensor, a physical interaction by the user in the real-world space;
compare, in response to the detection, a location of the physical interaction with respect to the 3D image data to determine that the location is within a threshold distance of a first of the 3D elements within the 3D image, the first of the 3D elements associated with a first user profile of the plurality of user profiles;
perform a lookup in the library of gestures stored in the memory device in response to the detection to determine, based on the determination that the location of the physical interaction is within the threshold distance of the first of the 3D elements, that the physical interaction corresponds to a selection of the first of the 3D elements;
retrieve, from the memory device in response to the selection of the first of the 3D elements, a first of the sets of list data associated with the first user profile corresponding to the first of the 3D elements;
command, in response to the selection of the first of the 3D elements, the projector to overlay a plurality of purchase option images onto the 3D image in the real-world space, each of the purchase option images representing a respective one of the purchase options in the first set of list data;
receive, from the at least one sensor, an indication of a second physical interaction by the user with one of the purchase option images in the real-world space; and
generate, in response to the second physical interaction, a purchase transaction request by the user for a gift item defined in the registration data of the first individual, the gift item associated with the one of the purchase options.

2. The computing device of claim 1 , wherein the at least one processor is configured to generate the purchase transaction request by commanding the projector to project a QR code associated with the one of the purchase options.

3. The computing device of claim 1 , wherein the at least one processor is configured to generate the purchase transaction request by transmitting a push notification for the one of the purchase options to a user computing device and causing the user computing device to execute a payment transaction for the one of the purchase options.

4. The computing device of claim 1 , wherein the at least one processor is configured to generate the purchase transaction request includes transmitting account information and the one of the purchase options to a merchant.

5. The computing device of claim 1 , wherein the at least one processor is further configured to identify the user based on input from the at least one sensor.

6. The computing device of claim 1 , wherein the at least one processor is further configured to retrieve, from a merchant, account information associated with the user.

7. The computing device of claim 1 , wherein the 3D image data further includes a reference date associated with a calendar event, and the at least one processor is further configured to select the 3D image data by comparing the reference date to a current date.

8. A computer-implemented method, the method executed by a 3D interface generator computing device that includes:
at least one sensor;
a projector;
a memory device configured to store (i) 3D image data corresponding to a 3D image, wherein the 3D image includes a plurality of 3D elements, (ii) a plurality of user profiles each including identification information for a respective one of a plurality of individuals, wherein each of the plurality of user profiles is associated with a respective one of the 3D elements, and (iii) sets of list data, each set of list data associated with a respective one of the plurality of individuals and a respective one of the plurality of user profiles, each set of list data identifying a plurality of purchase options; and
at least one processor communicatively coupled to the memory device, the projector, and the at least one sensor, the method comprising:
collecting registration data from the plurality of individuals, wherein the registration data for each of the individuals defines gift items that the respective individual wishes to receive;
generating the sets of list data for the plurality of user profiles based on the gift items in the registration data collected from the plurality of individuals;
storing the generated sets of list data in the memory device in association with the user profiles for the plurality of individuals;
commanding the projector to project the 3D image into a real-world space;
detecting, using the at least one sensor, a physical interaction by a user in the real-world space;
comparing, in response to the detection, a location of the physical interaction with respect to the 3D image data to determine that the location is within a threshold distance of a first of the 3D elements within the 3D image, the first of the 3D elements associated with a first user profile of the plurality of user profiles;
performing a lookup in the library of gestures stored in the memory device in response to the detection to determine, based on the determination that the location of the physical interaction is within the threshold distance of the first of the 3D elements, that the physical interaction corresponds to a selection of the first of the 3D elements;
retrieving, from the memory device in response to the selection of the first of the 3D elements, a first of the sets of list data associated with the first user profile corresponding to the first of the 3D elements;
commanding, in response to the selection of the first of the 3D elements, the projector to overlay a plurality of purchase option images onto the 3D image in the real-world space, each of the purchase option images representing a respective one of the purchase options in the first set of list data;
receiving, from the at least one sensor, an indication of a second physical interaction by the user with one of the purchase option images in the real-world space; and
generating, in response to the second physical interaction, a purchase transaction request by the user for a gift item defined in the registration data of the first individual, the gift item associated with the one of the purchase options.

9. The computer-implemented method of claim 8 , wherein generating the purchase

Assignees

• Mastercard International Inc

Inventors

• Scholl Christopher T
• Barkhurst James W

Classifications

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06Q30/0633

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title