Technology to automatically locate ball-holding players in multi-camera video feeds

Patent metadata

Field	Value
Publication number	US-2022292825-A1
Application number	US-201917626994-A
Country	US
Kind code	A1
Filing date	Aug 13, 2019
Priority date	Aug 13, 2019
Publication date	Sep 15, 2022
Grant date	—

Abstract

Methods, systems and apparatuses may provide for technology that selects a player from a plurality of players based on an automated analysis of two-dimensional (2D) video data associated with a plurality of cameras, wherein the selected player is nearest to a projectile depicted in the 2D video data. The technology may also track a location of the selected player over a subsequent plurality of frames in the 2D video data and estimate a location of the projectile based on the location of the selected player over the subsequent plurality of frames.

First claim

1 - 24 . (canceled)

25 . A performance-enhanced computing system comprising:
a plurality of cameras to generate two-dimensional (2D) video data; a processor coupled to the plurality of cameras; and a memory coupled to the processor, the memory including a set of instructions, which when executed by the processor, cause the computing system to: select a player from a plurality of players based on an automated analysis of the 2D video data, wherein the selected player is to be nearest to a projectile depicted in the 2D video data, track a location of the selected player over a subsequent plurality of frames in the 2D video data, and estimate a location of the projectile based on the location of the selected player over the subsequent plurality of frames.

26 . The computing system of claim 1 , wherein the projectile is to be occluded from view in one or more of the subsequent plurality of frames.

27 . The computing system of claim 1 , wherein the instructions, when executed, further cause the computing system to conduct the automated analysis over a buffered initial plurality of frames occurring before the subsequent plurality of frames in the 2D video data.

28 . The computing system of claim 1 , wherein the instructions, when executed, further cause the computing system to conduct the automated analysis in response to a height of the projectile being less than a height threshold.

29 . The computing system of claim 1 , wherein instructions, when executed, further cause the computing system to conduct the automated analysis in response to a distance between the projectile and one or more of the plurality of players being less than a distance threshold.

30 . The computing system of claim 1 , wherein the instructions, when executed, further cause the computing system to estimate, via an artificial neural network, the location of the projectile and locations of a plurality of body parts in a bounding box associated with the location of the selected player.

31 . A semiconductor apparatus comprising:
one or more substrates; and logic coupled to the one or more substrates, wherein the logic is implemented at least partly in one or more of configurable logic or fixed-functionality hardware logic, the logic coupled to the one or more substrates to: select a player from a plurality of players based on an automated analysis of two-dimensional (2D) video data associated with a plurality of cameras, wherein the selected player is to be nearest to a projectile depicted in the 2D video data, track a location of the selected player over a subsequent plurality of frames in the 2D video data, and estimate a location of the projectile based on the location of the selected player over the subsequent plurality of frames.

32 . The semiconductor apparatus of claim 7 , wherein the projectile is to be occluded from view in one or more of the subsequent plurality of frames.

33 . The semiconductor apparatus of claim 7 , wherein the logic coupled to the one or more substrates is to conduct the automated analysis over a buffered initial plurality of frames occurring before the subsequent plurality of frames in the 2D video data.

34 . The semiconductor apparatus of claim 7 , wherein the logic coupled to the one or more substrates is to conduct the automated analysis in response to a height of the projectile being less than a height threshold.

35 . The semiconductor apparatus of claim 7 , wherein the logic coupled to the one or more substrates is to conduct the automated analysis in response to a distance between the projectile and one or more of the plurality of players being less than a distance threshold.

36 . The semiconductor apparatus of claim 7 , wherein the logic coupled to the one or more substrates is to estimate, via an artificial neural network, the location of the projectile and locations of a plurality of body parts in a bounding box associated with the location of the selected player.

37 . At least one computer readable storage medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
select a player from a plurality of players based on an automated analysis of two-dimensional (2D) video data associated with a plurality of cameras, wherein the selected player is to be nearest to a projectile depicted in the 2D video data; track a location of the selected player over a subsequent plurality of frames in the 2D video data; and estimate a location of the projectile based on the location of the selected player over the subsequent plurality of frames.

38 . The at least one computer readable storage medium of claim 13 , wherein the projectile is to be occluded from view in one or more of the subsequent plurality of frames.

39 . The at least one computer readable storage medium of claim 13 , wherein the instructions, when executed, further cause the computing system to conduct the automated analysis over a buffered initial plurality of frames occurring before the subsequent plurality of frames in the 2D video data.

40 . The at least one computer readable storage medium of claim 13 , wherein the instructions, when executed, further cause the computing system to conduct the automated analysis in response to a height of the projectile being less than a height threshold.

41 . The at least one computer readable storage medium of claim 13 , wherein instructions, when executed, further cause the computing system to conduct the automated analysis in response to a distance between the projectile and one or more of the plurality of players being less than a distance threshold.

42 . The at least one computer readable storage medium of claim 13 , wherein the instructions, when executed, further cause the computing system to estimate, via an artificial neural network, the location of the projectile and locations of a plurality of body parts in a bounding box associated with the location of the selected player.

43 . A method of operating a performance-enhanced computing system, comprising:
selecting a player from a plurality of players based on an automated analysis of two-dimensional (2D) video data associated with a plurality of cameras, wherein the selected player is nearest to a projectile depicted in the 2D video data; tracking a location of the selected player over a subsequent plurality of frames in the 2D video data; and estimating a location of the projectile based on the location of the selected player over the subsequent plurality of frames.

44 . The method of claim 19 , wherein the projectile is occluded from view in one or more of the subsequent plurality of frames.

45 . The method of claim 19 , further including conducting the automated analysis over a buffered initial plurality of frames occurring before the subsequent plurality of frames in the 2D video data.

46 . The method of claim 19 , further including conducting the automated analysis in response to a height of the projectile being less than a height threshold.

47 . The method of claim 19 , further including conducting the automated analysis in response to a distance between the projectile and one or more of the plurality of players being less than a distance threshold.

48 . The method of claim 19 , further including estimating, via an artificial neural network, the location of the projectile and locations of a plurality of body parts in a bounding box associated with the location of the

Assignees

• Intel Corp

Inventors

• Fang Yikai
• Li Qiang
• Li Wenlong
• Lin Haihua
• Ling Chen
• Lu Ming
• Tao Hongzhi
• Tong Xiaofeng
• Wang Yumeng

Classifications

• G06V2201/07

  Target detection · CPC title

• G06V20/42 Primary

  of sport video content · CPC title

• G06V20/47

  Detecting features for summarising video content · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title