Data processing method and apparatus for capturing and analyzing images of sporting events

Patent metadata

Field	Value
Publication number	US-11514678-B2
Application number	US-202017110718-A
Country	US
Kind code	B2
Filing date	Dec 3, 2020
Priority date	Dec 13, 2019
Publication date	Nov 29, 2022
Grant date	Nov 29, 2022

Abstract

A data processing method comprising obtaining information identifying a position of an object in a scene at a time during a sporting event; obtaining an image of the scene captured at the time during the sporting event; projecting the position of the object in the scene onto an image plane of the image; and outputting information based on the projection.

First claim

The invention claimed is:

1. A data processing method comprising:
obtaining information identifying a position of an object in a scene at a time during a sporting event;
obtaining an image of the scene captured at the time during the sporting event;
projecting the position of the object in the scene onto an image plane of the image;
outputting information based on the projection;
obtaining information indicating a visual characteristic of the object which distinguishes it from one or more other objects in the scene; and
determining if the object is in the image using the visual characteristic of the object, wherein
the determining if the object is in the image includes:
projecting the position of the object in the scene onto a plurality of candidate image planes of the image,
for each candidate image plane, determining if a portion of the image at the projected position of the object has the visual characteristic of the object, and
determining the object is in the image if, for one candidate image plane, the portion of the image at the projected position of the object has the visual characteristic of the object, and

the one candidate image plane is determined as the image plane of the image.

2. The data processing method according to claim 1 , wherein the output information indicates the image.

3. The data processing method according to claim 1 , wherein the output information indicates one or more camera parameters associated with the one candidate image plane.

4. The data processing method according to claim 1 , wherein the visual characteristic of the object comprises a pose of the object or a visual marking on the object.

5. The data processing method according to claim 1 , wherein the position of the object in the scene is determined using a plurality of images of the object simultaneously captured by a plurality of respective cameras each calibrated with respect to the scene.

6. The data processing method according to claim 1 , wherein the information identifying the position of the object in the scene comprises Global Navigation Satellite System GNSS coordinates of the object.

7. The data processing method according to claim 6 , wherein
the object is in the image, and
the method comprises:
comparing the projected position of the GNSS coordinates of the object on the image plane of the image with the position of the object in the image; and
if there is a discrepancy between the projected position of the GNSS coordinates of the object on the image plane of the image and the position of the object in the image:
adjusting the GNSS coordinates of the object to reduce the discrepancy; and
including the adjusted GNSS coordinates in the output information.

8. The data processing method according to claim 1 , wherein the sporting event is a ball game and the object is a ball game participant or a ball.

9. The data processing method according to claim 8 , wherein the sporting event is a soccer match.

10. The data processing method according to claim 8 , wherein the sporting event is an American football game.

11. The data processing method according to claim 1 , wherein the sporting event is a race and the object is a race participant.

12. The data processing method according to claim 11 , wherein the sporting event is a horse race.

13. A non-transitory storage medium storing a program for controlling a computer to perform the method according to claim 1 .

Assignees

• Sony Europe Bv
• Sony Group Corp

Inventors

• Richards Mathew
• Hawke Edward
• Dodd Luke
• Hironori Hattori

Classifications

• G01S19/485

  whereby the further system is an optical system or imaging system · CPC title

• G06T7/292 Primary

  Multi-camera tracking · CPC title

• H04N9/3141

  Constructional details thereof (details not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• G01S19/42

  Determining position · CPC title

• G06V20/44

  Event detection · CPC title