Toy construction system for augmented reality

Patent metadata

Field	Value
Publication number	US-9827507-B2
Application number	US-201214119556-A
Country	US
Kind code	B2
Filing date	May 22, 2012
Priority date	May 23, 2011
Publication date	Nov 28, 2017
Grant date	Nov 28, 2017

Abstract

A toy construction system comprising toy construction elements, the toy construction elements comprising coupling means for releasably interconnecting the toy construction elements, comprising one or more marker construction elements comprising such coupling means and each having a visual appearance recognizable by an image processing means, and a data processing system comprising image capturing means, image processing means, and display means, wherein the data processing system is adapted to capture an image of a toy construction model constructed from the toy construction elements, to process the captured image to detect at least a presence of at least one of the marker construction elements within the captured image; responsive to the detected marker construction element, to generate a computer-generated image; and to display on said display means a composite image comprising the captured image having superimposed the generated computer-generated image.

First claim

The invention claimed is:

1. A computer-implemented method for generating an image of a toy construction model constructed from toy construction elements of a toy construction system, the toy construction elements comprising coupling means for releasably interconnecting the toy construction elements, the toy construction system comprising one or more marker construction elements comprising such coupling means and each having a visual appearance recognisable by an image processing system; the method comprising:
capturing, by a digital camera, an image of a toy construction model constructed from the toy construction elements;
processing, by a digital processor, the captured image to detect a position of at least one of the marker construction elements within the captured image;
responsive to the detected position of the marker construction element, generating a computer-generated image;
augmenting or replacing the captured image with the generated computer-generated image; and
displaying, by a display, the generated computer-generated image or the captured image augmented with the generated computer-generated image.

2. A method according to claim 1 , wherein the toy construction system comprises at least two marker construction elements, where the two marker construction elements are releasably connectable with each other via their respective coupling means, so as to form a composite marker element.

3. A method according to claim 2 , further comprising detecting the composite marker element and generating the computer-generated image selectively responsive to the detection of the composite marker element.

4. A method according to claim 3 , wherein each marker construction element comprises an insignia indicative of a code symbol of a code for encoding information; and wherein the method comprises determining, from the visual appearance of the composite marker element, an encoded set of code symbols, and decoding the determined set of code symbols to obtain decoded information.

5. A method according to claim 1 , wherein the toy construction system comprises a gaming dice comprising a body part comprising at least six sides on which the gaming dice may sit steadily when on a plane support, and wherein at least one or more of such sides is/are provided with coupling means for mounting of one of said at least one marker construction elements.

6. A method according to claim 1 , wherein the coupling means define a regular grid restricting a position and/or orientation of the toy constructing elements in a toy construction model to discrete positions and/or discrete orientations relative to said regular grid.

7. A method according to claim 6 , wherein the toy construction system comprises at least two marker construction elements, and wherein the method comprises detecting respective positions and/or orientations of the two marker construction elements in a toy construction model relative to said regular grid, and generating the computer-generated image responsive to the detected respective positions and/or orientations.

8. A method according to claim 7 , further comprising determining grid locations of a regular image grid from the detected locations of the marker construction elements, and generating an image feature of the computer-generated image at a location relative to the detected image grid.

9. A method according to claim 1 , wherein the toy construction elements have at least one property, wherein each marker construction element of the toy construction system has a value of said property, said value being chosen from a predetermined set of discrete values of said property.

10. A method according to claim 1 , wherein the marker construction element comprises an insignia and a movable element movable between a first and a second position, wherein the movable element, when positioned in the first position, causes the insignia to be visible and, when positioned in the second position, obstructs the insignia from view; and wherein the method comprises detecting at least the visibility of said insignia, and generating the computer-generated image responsive to the detected visibility of the insignia.

11. A method according to claim 1 , wherein the coupling means are arranged in one or more regular planar grids defining the direction of connection; and wherein each marker construction element comprises an insignia visible, when the marker construction element is connected to at least one other toy construction element of the toy construction system, from a direction parallel to at least one of the planar grids or from a direction normal to at least one of the planar grids.

12. A method according to claim 11 , wherein each of the marker construction elements has a top surface, a bottom surface, and at least one side surface; wherein said coupling means are placed on at least one of the top and the bottom surface; and wherein the marker construction element comprises at least a first surface without coupling means, where the first surface comprises said insignia.

13. A method according to claim 1 , wherein the coupling means comprise one or more protrusions and one or more cavities, each cavity adapted to receive at least one of the protrusions in a frictional engagement.

14. A data processing system comprising an image capturing device, a processor, and a display, wherein the data processing system comprises a computer program configured to cause the data processing system, when executed by the data processing system, to perform the steps of the method according to claim 1 .

15. A computer program product comprising program code adapted to cause, when executed by a data processing system, said data processing system to perform the steps of the method according to claim 1 .

16. A computer program product according to claim 15 , comprising user instructions for installing, on a data processing system comprising an image capturing device, a processor, and a display, the computer program code.

17. A method according to claim 1 , further comprising displaying a composite image comprising the captured image having superimposed the generated computer-generated image.

Assignees

• Muthyala Siddharth
• Van Beek Harm Jan
• Guyon Nicolas David Alain
• Lasorne Frantz
• Jensen Mikkel Holm
• Lego As

Inventors

• Muthyala Siddharth
• Van Beek Harm Jan
• Guyon Nicolas David Alain
• Lasorne Frantz
• Jensen Mikkel Holm

Classifications

• A63F13/69

  by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions · CPC title

• A63F13/65

  automatically by game devices or servers from real world data, e.g. measurement in live racing competition · CPC title

• A63H33/042 Primary

  Mechanical, electrical, optical, pneumatic or hydraulic arrangements; Motors · CPC title

• G06T19/00 Primary

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• A63F2250/287

  Cameras therefor · CPC title