Automated generation of camera paths

Patent metadata

Field	Value
Publication number	US-11451757-B2
Application number	US-201817253188-A
Country	US
Kind code	B2
Filing date	Sep 28, 2018
Priority date	Sep 28, 2018
Publication date	Sep 20, 2022
Grant date	Sep 20, 2022

Abstract

Methods, systems and apparatuses may provide for technology that automatically determines, based on camera calibration data and trajectory data associated with a projectile in a game, a plurality of camera angles. The technology may also automatically generate, based on the plurality of camera angles, a camera path for a volumetric content replay of a three-dimensional (3D) region of interest around a highlight moment in the game.

First claim

We claim:

1. An immersive content computing system comprising: a network controller;
a processor coupled to the network controller; and
a memory coupled to the processor, the memory including a set of instructions, which when executed by the processor, cause the computing system to:
receive player location data, a highlight moment, and trajectory data associated with a position of a projectile in a live game played at a game site;
partition the trajectory data into pre-highlight trajectory data and post-highlight trajectory data, the pre-highlight trajectory data including the trajectory of the projectile before the highlight moment and the post-highlight trajectory data including the trajectory of the projectile after the highlight moment;
automatically determine a physical camera coverage of a pre-highlight to post-highlight time period; and
select cameras from a candidate camera set for a pre-highlight camera angle and a post-highlight camera angle;
determine one or more intermediate camera angles between the pre-highlight camera angle and the post-highlight camera angle;
determine a three-dimensional (3D) region of interest around the location of the highlight moment;
re-project the 3D region of interest to two dimensional (2D) views; and
wherein after re-projecting the 3D region of interest to 2D views, the memory including the set of instructions, which when executed by the processor, cause the computing system to automatically generate and store a virtual camera path.

2. The immersive content computing system of claim 1 , wherein the one or more intermediate camera angles are determined based on the-camera calibration data, the pre-highlight camera angle, and the post-highlight camera angle.

3. The immersive content computing system of claim 1 , wherein:
the pre-highlight camera angle shows a context in the game before action in the highlight moment occurs, and
the post-highlight camera angle shows a result in the game after the action in the highlight moment occurs.

4. The immersive content computing system of claim 1 , wherein the one or more intermediate camera angles are selected for a longest angular distance between the pre-highlight camera angle and the post-highlight camera angle.

5. The immersive content computing system of claim 1 , wherein the trajectory data includes 3D projectile positions on a frame-by-frame basis.

6. The immersive content computing system of claim 1 , wherein the player location data includes 3D player positions on a frame-by-frame basis.

7. A semiconductor apparatus comprising: one or more substrates; and
logic coupled to the one or more substrates, wherein the logic is implemented at least partly in one or more of configurable logic or fixed-functionality hardware logic, the logic coupled to the one or more substrates to:
receive player location data, a highlight moment, and trajectory data associated with a position of a projectile in a live game played at a game site;
partition the trajectory data into pre-highlight trajectory data and post-highlight trajectory data, the pre-highlight trajectory data including the trajectory of the projectile before the highlight moment and the post-highlight trajectory data including the trajectory of the projectile after the highlight moment;
automatically determine a physical camera coverage of a pre-highlight to post-highlight time period;
select cameras from a candidate camera set for a pre-highlight camera angle and a post-highlight camera angle;
determine one or more intermediate camera angles between the pre-highlight camera angle and the post-highlight camera angle;
determine a three-dimensional (3D) region of interest around the location of the highlight moment;
re-project the 3D region of interest to two dimensional (2D) views; and
wherein after re-projecting the 3D region of interest to 2D views, the logic coupled to the one or more substrates is to automatically generate and store a virtual camera path.

8. The semiconductor apparatus of claim 7 , wherein the one or more intermediate camera angles are determined based on the-camera calibration data, the pre-highlight camera angle, and the post-highlight camera angle.

9. The semiconductor apparatus of claim 7 , wherein:
the pre-highlight camera angle shows a context in the game before action in the highlight moment occurs, and
the post-highlight camera angle shows a result in the game after the action in the highlight moment occurs.

10. The semiconductor apparatus of claim 7 , wherein the one or more intermediate camera angles are selected for a longest angular distance between the pre-highlight camera angle and the post-highlight camera angle.

11. The semiconductor apparatus of claim 7 , wherein the trajectory data includes 3D projectile positions on a frame-by-frame basis.

12. The semiconductor apparatus of claim 7 , wherein the player location data includes 3D player positions on a frame-by-frame basis.

13. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
receive player location data, a highlight moment, and trajectory data associated with a position of a projectile in a live game played at a game site;
partition the trajectory data into pre-highlight trajectory data and post-highlight trajectory data, the pre-highlight trajectory data including the trajectory of the projectile before the highlight moment and the post-highlight trajectory data including the trajectory of the projectile after the highlight moment;
automatically a physical camera coverage of a pre-highlight to post-highlight time period;
select cameras from a candidate camera set for a pre-highlight camera angle and a post-highlight camera angle;
determine one or more intermediate camera angles between the pre-highlight camera angle and the post-highlight camera angle;
determine a three-dimensional (3D) region of interest around the location of the highlight moment;
re-project the 3D region of interest to two dimensional (2D) views; and
wherein after re-projecting the 3D region of interest to 2D views, the instructions, when executed, cause the computing system to automatically generate and store a virtual camera path.

14. The least one non-transitory computer readable storage medium of claim 13 , wherein:
the pre-highlight camera angle shows a context in the game before action in the highlight moment occurs, and
the post-highlight camera angle shows a result in the game after the action in the highlight moment occurs.

15. The least one non-transitory computer readable storage medium of claim 13 , wherein the one or more intermediate camera angles are selected for a longest angular distance between the pre-highlight camera angle and the post-highlight camera angle.

16. The least one non-transitory computer readable storage medium of claim 13 , wherein the trajectory data includes 3D projectile positions on a frame-by-frame basis.

17. The least one non-transitory computer readable storage medium of claim 13 , wherein the player location data includes 3D player positions on a frame-by-frame basis.

18. A method comprising:
receiving player location data, a highlight moment, and trajectory data associated with a position of a projectile in a live game played at a game site;
partitioning the trajectory data into pre-highlight trajectory data and post-highlight trajectory data, the pre-highlight trajectory data including the trajectory of the projectile before the highlight moment and the post-high

Assignees

• Intel Corp

Inventors

• Li Qiang
• Li Wenlong
• Houminer Doron T
• Ling Chen
• Prilusky Diego

Classifications

• H04N13/111 Primary

  Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation · CPC title

• H04N13/167

  Synchronising or controlling image signals · CPC title

• H04N13/243

  using three or more two-dimensional [2D] image sensors · CPC title