System and method for projecting images on a marked surface

Patent metadata

Field	Value
Publication number	US-10009586-B2
Application number	US-201715459617-A
Country	US
Kind code	B2
Filing date	Mar 15, 2017
Priority date	Nov 11, 2016
Publication date	Jun 26, 2018
Grant date	Jun 26, 2018

Abstract

A system, method and computer readable medium for projecting images on a marked surface. The system includes a memory storage unit, a projector, a camera, an input device for receiving input data to align correspondence points in a template image with features on a marked surface, a computing device for calculating a correction model, and a rendering device for generating image data. The method involves projecting a template image to generate a camera image, receiving input data, calculating a correction model based on the input data and generating and projecting image data. The computer readable medium is encoded with codes to direct a processor to carry out the method.

First claim

What is claimed is:

1. A system for projecting images on a marked surface, the system comprising:
a memory storage unit for storing a template database, wherein the template database includes a template image associated with the marked surface, the template image including a plurality of correspondence points representing a plurality of features on the marked surface;
a projector configured to project the template image onto the marked surface;
a camera for generating a camera image based on the template image projected onto the marked surface;
an input device for receiving input data, the input data configured to align the plurality of correspondence points with the plurality of features on the marked surface in the camera image;
a computing device for calculating a correction model based on the input data, wherein the correction model is configured to generate pose data automatically based on object data, the object data including received content for projecting on a portion of the marked surface; and
a rendering device for generating image data based on the pose data using the correction model, wherein the image data is sent to the projector for projecting the received content associated with the object data onto the portion of the marked surface.

2. The system of claim 1 , wherein the marked surface is a flat marked surface.

3. The system of claim 2 , wherein the flat marked surface is a playing surface of a sports arena and the plurality of features are plurality of markings.

4. The system of claim 3 , wherein the template image includes model markings of the playing surface.

5. The system of claim 1 , wherein the input device is a mouse.

6. The system of claim 5 , wherein the mouse is configured to align the plurality of correspondence points with the plurality of features on the marked surface in the camera image using drag and drop functionality.

7. The system of claim 1 , further comprising an image recognition engine configured to recognize the plurality of features on the marked surface in the camera image.

8. The system of claim 7 , wherein the input data is automatically generated based on the plurality of features on the marked surface in the camera image recognized by the image recognition engine.

9. The system of claim 1 , wherein the input data is further configured to warp the template image.

10. A method of projecting images on a marked surface, the method comprising:
projecting a template image onto the marked surface with a projector, wherein the template image is selected from a template database stored on a memory storage unit;
generating a camera image from a camera, the camera image based on the template image projected onto the marked surface, wherein the template image includes a plurality of correspondence points representing a plurality of features on the marked surface;
receiving input data via an input device, the input data configured to align the plurality of correspondence points with the plurality of features on the marked surface in the camera image;
calculating, using a computing device, a correction model based on the input data, wherein the correction model is configured to generate pose data automatically based on object data, the object data including received content for projecting on a portion of the marked surface;
generating image data based on the pose data using a rendering device to apply the correction model; and
projecting the received content associated with the object data and represented by the image data onto the portion of the marked surface using the projector.

11. The method of claim 10 , wherein the surface is a flat surface.

12. The method of claim 11 , wherein the flat surface is a playing surface of a sports arena and the plurality of features are plurality of markings.

13. The method of claim 12 , wherein the template image includes model markings of the playing surface.

14. The method of claim 10 , wherein receiving input data comprises receiving data from a mouse.

15. The method of claim 14 , further comprising aligning the plurality of correspondence points with the plurality of features on the surface in the camera image using drag and drop functionality.

16. The method of claim 10 , further comprising recognizing, using an image recognition engine, the plurality of features on the surface in the camera image.

17. The method of claim 16 , further comprising automatically generating the input data based on the plurality of features on the surface in the camera image recognized by the image recognition engine.

18. The method of claim 10 , further comprising warping the template image using the input data.

19. A non-transitory computer readable medium encoded with codes, the codes for directing a processor to:
project a template image onto a marked surface with a projector, wherein the template image is selected from a template database stored on a memory storage unit;
generate a camera image from a camera, the camera image based on the template image projected onto the marked surface, wherein the template image includes a plurality of correspondence points representing a plurality of features on the marked surface;
receive input data via an input device, the input data configured to align the plurality of correspondence points with the plurality of features on the marked surface in the camera image;
calculate a correction model based on the input data, wherein the correction model is configured to generate pose data automatically based on object data, the object data including received content for projecting on a portion of the marked surface;
generate image data based on the pose data using a rendering device to apply the correction model; and
project the received content associated with the object data and represented by the image data onto the portion of the marked surface using the projector.

20. The non-transitory computer readable medium system of claim 19 , wherein the input device is configured to align the plurality of correspondence points with the plurality of features on the marked surface in the camera image using drag and drop functionality.

Assignees

• Christie Digital Systems Usa

Inventors

• Mutter Curtis Gordon
• Faragher Ian Chadwyck
• Urquhart Daniel Thomson

Classifications

• G06V10/40

  Extraction of image or video features · CPC title

• G06V10/757

  Matching configurations of points or features · CPC title

• G06V10/225

  based on a marking or identifier characterising the area · CPC title

• G06F3/03543

  Mice or pucks (G06F3/03541 takes precedence) · CPC title

• G06T3/0093

  Physics · mapped topic