Resilient dynamic projection mapping system and methods

Patent metadata

Field	Value
Publication number	US-12283059-B2
Application number	US-202318377579-A
Country	US
Kind code	B2
Filing date	Oct 6, 2023
Priority date	Dec 26, 2018
Publication date	Apr 22, 2025
Grant date	Apr 22, 2025

Abstract

Systems and methods for dynamically tracking objects, and projecting rendered 3D content onto said objects in real-time. The methods described herein further include image data capture performed by various image-capturing devices, wherein said data is segmented into various components to identify one or more projectors for rendering and projecting 3D content components onto one or more objects.

First claim

What is claimed is:

1. An system comprising:
one or more image capturing devices;
a plurality of projection devices; and
a computing device comprising:
one or more processors; and
memory operatively coupled to the one or more processors and storing instructions that, when executed, cause the computing device to:
obtain, from the one or more image capturing devices, image data associated with an object;
for one or more contours of the object:
determine position information or angle information for a contour of the object;

determine, based on the position information or angle information, a three-dimensional representation of the object; and

wherein the plurality of projection devices output for display the three-dimensional representation of the object, and wherein the three-dimensional representation is aligned with and projected onto the object.

2. The system of claim 1 , wherein the position information or the angle information for the one or more contours of the object is determined by the computing device in real-time.

3. The system of claim 1 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
determine updated position information or updated angle information for one or more contours of the object; and
select a set of projection devices, of the plurality of projection devices, to output an updated three-dimensional representation of the object.

4. The system of claim 1 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
send, to one or more of the plurality of projection devices, a message to not output the three-dimensional representation of the object.

5. The system of claim 1 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to determine the position information or the angle information for the contour of the object by causing the one or more image capturing devices to:
monitor, during a first time period, the position information or the angle information for the contour of the object.

6. The system of claim 1 , wherein the three-dimensional representation of the object comprises a footwear design.

7. The system of claim 1 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
determine, based on a stored three-dimensional model, a first set of contours;
determine position information and angle information for each contour in the first set of contours; and
compare, based on respective position information and angle information, the one or more contours of the object with the first set of contours.

8. The system of claim 1 , wherein the plurality of projection devices outputting for display the three-dimensional representation of the object further comprises:
projecting, onto the object, one or more images indicating surface regions associated with the three-dimensional representation of the object.

9. The system of claim 1 , further comprising an image capturing device, wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to determine the position information or the angle information for the contour of the object by causing the image capturing device to:
monitor, during a first time period, the position information or the angle information for the contour of the object.

10. An system comprising:
a plurality of projection devices; and
a first computing device comprising:
one or more processors; and
memory operatively coupled to the one or more processors and storing instructions that, when executed, cause the first computing device to:
obtain image data associated with an object;
determine position information or angle information for one or more contours of the object;
based on the position information or angle information, selecting a first set of projection devices, of the plurality of projection devices, to output a three-dimensional representation of the object; and

wherein the first set of projection devices output for display the three-dimensional representation of the object, and wherein the three-dimensional representation is aligned with and projected onto the object.

11. The system of claim 10 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
determine, based on the position information or angle information, the three-dimensional representation of the object.

12. The system of claim 10 , wherein the position information or the angle information for the one or more contours of the object is determined by the computing device in real-time.

13. The system of claim 10 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
determine updated position information or updated angle information for one or more contours of the object; and
select a second set of projection devices, of the plurality of projection devices, to output an updated three-dimensional representation of the object.

14. The system of claim 10 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
send, to a second set of projection devices of the plurality of projection devices, a message to not output the three-dimensional representation of the object.

15. The system of claim 10 , wherein the three-dimensional representation of the object comprises a footwear design.

16. The system of claim 10 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
determine, based on a stored three-dimensional model, a first set of contours;
determine position information and angle information for each contour in the first set of contours; and
compare, based on respective position information and angle information, the one or more contours of the object with the first set of contours.

17. The system of claim 10 , wherein the first set of projection devices outputting for display the three-dimensional representation of the object further comprises:
projecting, onto the object, one or more images indicating surface regions associated with the three-dimensional representation of the object.

18. The system of claim 10 , wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
use one or more point clouds to generate a two-dimensional representation of a tracking space comprising the object.

19. The system of claim 10 , further comprising an image capturing device, wherein the instructions stored in the memory of the computing device, when executed by the one or more processors of the computing device, cause the computing device to:
determine that the object has been monitored by the image capturing device for a threshold period of time; and
use the first

Assignees

• Nike Inc

Inventors

• Legaye Robert G
• Coyle Ian
• Leblanc Ian
• Purdy Ben
• Wester Thomas

Classifications

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T17/20

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title

• G01B11/2504

  Calibration devices · CPC title

• G06T7/251 Primary

  involving models · CPC title

• G06T7/246 Primary

  using feature-based methods, e.g. the tracking of corners or segments · CPC title