Camera movement correction apparatus, method and system

Patent metadata

Field	Value
Publication number	US-9589332-B2
Application number	US-201213667601-A
Country	US
Kind code	B2
Filing date	Nov 2, 2012
Priority date	Nov 11, 2011
Publication date	Mar 7, 2017
Grant date	Mar 7, 2017

Abstract

A camera movement correction apparatus for use in a system which detects the position of a sporting projectile within a scene, the apparatus comprising: an interface operable to receive a first and second image of the scene captured by a camera; a reference marker determiner operable to determine the position of a reference marker within the first and second image of the scene, the reference marker being static within the scene; a difference determination device operable to determine the difference between the position of the reference marker in the first and second image of the scene; and a corrective transformer operable to apply a corrective transform to the second image on the basis of said determined difference.

First claim

The invention claimed is:

1. A camera movement correction apparatus for use in a system which detects a position of a sporting projectile within a scene, the apparatus comprising:
circuitry configured to:
receive a first image of the scene and a second image of the scene captured by a camera;
determine a position of a reference marker within the first image of the scene and a position of the reference marker within the second image of the scene, the reference marker being static within the scene;
determine a difference between the position of the reference marker in the first image of the scene and the position of the reference marker in the second image of the scene; and
apply a corrective transform, that corrects for the difference between the position of the reference marker in the first image of the scene and the position of the reference marker in the second image of the scene, to pixels of the second image of the scene to create a corrected second image of the scene on the basis of said determined difference.

2. The camera movement correction apparatus according to claim 1 , wherein the corrective transform corrects for movement of the camera.

3. A system for detecting a position of a ball within the scene, the system comprising:
the camera movement correction apparatus according to claim 1 ;
the camera operable to capture the first image of the scene and the second image of the scene and provide the first image of the scene and the second image of the scene to the camera movement correction apparatus; and
the reference marker positioned within the scene within a field of view of the camera.

4. The system according to claim 3 , wherein the reference marker is configured to be seen from a substantially frontal perspective within the field of view of the camera.

5. The system according to claim 3 , wherein at least a portion of the reference marker is reflective.

6. The system according to claim 3 , wherein the scene comprises a goal post and the reference marker is placed on the goal post close to an end of the goal post which is in contact with the ground.

7. The system according to claim 3 , wherein the scene comprises a goal net holder and the reference marker is placed on the goal net holder at a predetermined height above the ground.

8. The system according to claim 3 , further comprising a casing around the camera, the casing configured to deflect wind from the camera.

9. The system according to claim 3 , further comprising:
a controller including circuitry configured to:
receive the corrected second image of the scene, and
determine the position of the ball within the scene based upon the corrected second image of the scene.

10. A camera movement correction method when capturing a scene in which a position of a sporting projectile is to be determined, the method comprising:
receiving a first image of the scene and second image of the scene captured by a camera;
determining a position of a reference marker within the first image of the scene and a position of the reference marker within the second image of the scene, the reference marker being static within the scene;
determining a difference between the position of the reference marker in the first image of the scene and the position of the reference marker in the second image of the scene; and
applying a corrective transform, that corrects for the difference between the position of the reference marker in the first image of the scene and the position of the reference marker in the second image of the scene, to pixels of the second image of the scene to create a corrected second image of the scene on the basis of said determined difference.

11. The method according to claim 10 , further comprising;
capturing the first image of the scene and the second image of the scene and providing the first image of the scene and the second image of the scene to a camera movement correction apparatus; and
positioning the reference marker within the scene within a field of view of the camera.

12. The method according to claim 11 , wherein the reference marker is configured to be seen from a substantially frontal perspective within the field of view of the camera.

13. The method according to claim 11 , wherein at least a portion of the reference marker is reflective.

14. The method according to claim 11 , wherein the scene comprises a goal post and the reference marker is placed on the goal post close to an end of the goal post which is in contact with the ground.

15. The method according to claim 11 , wherein the scene comprises a goal net holder and the reference marker is placed on the goal net holder at a predetermined height above the ground.

16. The method according to claim 11 , wherein the camera includes a casing configured to deflect wind from the camera.

17. The method according to claim 11 , further comprising:
receiving the corrected second image of the scene, and
determining the position of the ball within the scene based upon the corrected second image of the scene.

18. The method according to claim 10 , wherein the corrective transform corrects for movement of the camera.

19. A non-transitory computer program product containing computer readable instructions which, when loaded onto a computer, cause the computer to perform the method according to claim 10 .

Assignees

• Sony Corp
• Sony Europe Ltd

Inventors

• Daniels Anthony
• Hawkins Paul

Classifications

• G06T2207/30204

  Marker · CPC title

• G06T7/187

  involving region growing; involving region merging; involving connected component labelling · CPC title

• G06T2207/30228

  Playing field · CPC title

• G06T7/80 Primary

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G06T7/181

  involving edge growing; involving edge linking · CPC title