System and method for augmented reality gaming

Patent metadata

Field	Value
Publication number	US-9858754-B2
Application number	US-201314407670-A
Country	US
Kind code	B2
Filing date	Jun 14, 2013
Priority date	Jun 14, 2012
Publication date	Jan 2, 2018
Grant date	Jan 2, 2018

Abstract

Disclosed is a method for enabling an augmented reality interaction system and a mobile device to overlay a virtual 3D component over a physical 3D component with which the virtual 3D component interacts. The method includes: enabling a user to capture a live camera image of a gaming machine cabinet via a camera on the mobile device; determining if there are image tags on the gaming machine cabinet in the live camera image; producing a virtual rendering of the gaming machine cabinet; determining virtual 3D components to be displayed over an image of a virtual gaming machine cabinet; comparing a virtual depth rendering of the virtual 3D components to a virtual depth rendering of the virtual gaming machine cabinet; and overlaying virtual 3D components without the subtracted elements onto a live camera image of the virtual gaming machine cabinet on a display of the mobile device.

First claim

What is claimed is:

1. A method of enabling an augmented reality interaction system and a mobile device to overlay a virtual 3D component over a physical 3D component with which the virtual 3D component interacts, the method comprising:
controlling a camera on the mobile device using the augmented reality interaction system;
enabling a user to capture a live camera image of a gaming machine cabinet via the camera;
determining if there are image tags on the gaming machine cabinet in the live camera image;
in response to identifying images tags on the gaming machine cabinet, producing a rendering of a virtual gaming machine cabinet;
determining virtual 3D components to be displayed over an image of the virtual gaming machine cabinet, wherein the virtual 3D components include a plurality of virtual 3D component elements each having a depth value and the virtual gaming machine cabinet includes a plurality of virtual gaming machine cabinet elements each having a depth value;
comparing a virtual depth rendering of the virtual 3D components to a virtual depth rendering of the virtual gaming machine cabinet;
in response to the comparison, subtracting the virtual 3D component elements that have a lower depth value from the virtual gaming machine cabinet elements at corresponding spatial positions; and
overlaying virtual 3D components without the subtracted elements onto the live camera image of the gaming machine cabinet on a display of the mobile device.

2. The method of claim 1 , further comprising: using a depth buffer to determine which virtual 3D component elements are visible to a virtual camera.

3. The method of claim 2 , further comprising: determining a z-value of each element is compared against an existing depth buffer z-value at a same screen co-ordinate, wherein if the existing z-value is greater, the pixel is drawn, and wherein if the existing z-value is less than an existing depth buffer z-value at the same screen co-ordinate, then the pixel is discarded.

4. The method of claim 2 , further comprising: rendering the virtual gaming machine cabinet by mapping an image tag co-ordinates to a gaming machine cabinet co-ordinates using vector subtraction.

5. The method of claim 4 , further comprising: combining a camera video image with a rendering of an additional virtual 3D component minus the virtual gaming machine cabinet.

6. The method of claim 1 , wherein a CAD model having spatial parameters is associated with an image tag.

7. The method of claim 1 , wherein the rendering of the virtual gaming machine cabinet is a virtual depth-only rendering of the gaming machine cabinet.

8. The method of claim 1 , wherein the rendering of the virtual gaming machine cabinet extracts 2D information from a display in the gaming machine cabinet to produce a 3D image of the gaming machine.

9. The method of claim 1 , further comprising: overlaying virtual graphics in a position within 3D space on the display of the mobile device that augment a display in the gaming machine cabinet with 3D to create complex augmented reality.

10. The method of claim 1 , wherein an object recognition system of the augmented reality interaction system establishes a communication channel between the augmented reality interaction system and the gaming machine cabinet enabling game content to be augmented on the mobile device, and the game content to be influenced by the augmented reality interaction system.

11. The method of claim 1 , wherein an augmented reality translation system of the augmented reality interaction system extracts a first language from a display in the gaming machine cabinet and translates the first language into a second language that is visible to the user in place of the first language.

12. A method of enabling an augmented reality interaction system and a mobile device to overlay a virtual 3D component over a physical 3D component with which the virtual 3D component interacts, the method comprising:
enabling a user to capture a live camera image of a 3D object via a camera on the mobile device;
determining if there are image tags on the 3D object in the live camera image;
in response to identifying images tags on the 3D object, producing a rendering of a virtual 3D object;
determining virtual 3D components to be displayed over an image of the 3D object, wherein the virtual 3D components include a plurality of virtual 3D component elements each having a virtual 3D component depth value and the virtual 3D object includes a plurality of virtual 3D object elements each having a virtual 3D object depth value;
comparing a virtual depth rendering of the virtual 3D components to a virtual depth rendering of the virtual 3D object;
in response to the comparison, subtracting the virtual 3D component elements that have a lower depth value from the virtual 3D object elements at corresponding spatial positions; and
overlaying virtual 3D components without the subtracted elements onto the live camera image of the 3D object on a display of the mobile device.

13. A method of enabling a user in an augmented reality gaming venue to use a complex augmented reality system and a mobile device to display complex augmented reality on a display device, the method comprising:
determining if there are one or more image tags within a video display on the display device that are viewable in a live camera image;
using the one or more image tags to access information used by the augmented reality system; and
overlaying virtual graphics in a position within 3D space on a display of the mobile device that augment the video display of the display device with 3D effects to create complex augmented reality, when one or more image tags are detected within the video display on the display device that are viewable in the live camera image.

14. A method of enabling an augmented reality interaction system and a mobile device to overlay a virtual 3D component over a physical 3D component with which the virtual 3D component interacts, the method comprising:
determining if there are image tags on a 3D object in a live camera image on the mobile device;
in response to identifying images tags on the 3D object, producing a virtual rendering of the 3D object;
determining virtual 3D components to be displayed over an image of a 3D object, wherein the virtual 3D components include a plurality of elements each having a depth value and the virtual 3D object includes a plurality of elements each having a depth value;
subtracting the elements of the virtual 3D components that have a lower depth value than elements of the virtual 3D object at corresponding spatial positions; and
overlaying virtual 3D components without the subtracted elements onto a live camera image of the virtual 3D object on a display of the mobile device to produce augmented reality effects, wherein the virtual 3D components deliver targeted content to a user that assists in performing maintenance on the gaming machine.

15. The method of claim 14 , wherein the maintenance to be performed on the gaming machine includes reconnecting a loose wire, filling a ticket printer, filling a hopper, directing a technician where to insert a key, directing a technician which buttons to select, directing a technician which connections to check, and combinations thereof.

16. The method of claim 14 , wherein maintenance assistance provided includes displaying text, displaying a pre-recorded video, displaying an augmented virtual ticket printer overlaid over a real ticket printer with animation of virtual tickets being inserted into this virtual printer, displaying an augmented virtual componen

Assignees

• Bally Gaming Inc

Inventors

• Lyons Martin S
• Jackson Brett
• Ang Roderick
• Hedrick Joseph R

Classifications

• G07F17/3204

  Player-machine interfaces · CPC title

• G07F17/3211

  Display means · CPC title

• G07F17/3218

  wherein at least part of the system is portable · CPC title

• G07F17/3209

  Input means, e.g. buttons, touch screen · CPC title

• G07F17/323 Primary

  wherein the player is informed, e.g. advertisements, odds, instructions · CPC title