Automated or assisted umpiring of baseball game using computer vision

Patent metadata

Field	Value
Publication number	US-12290737-B2
Application number	US-202418627783-A
Country	US
Kind code	B2
Filing date	Apr 5, 2024
Priority date	May 17, 2016
Publication date	May 6, 2025
Grant date	May 6, 2025

Abstract

Methods and systems for use in automating or assisting umpiring of a baseball or softball game are described herein. A location of a strike zone is determined based on video images of a batter standing next to home plate captured by a camera. Locations of a ball traveling towards the batter, and locations of the bat being held by the batter, are autonomously tracked using computer vision based on video images captured by at least two cameras having different positions. Additionally, there are autonomous determinations of whether a location of the ball intersects with the strike zone, and whether the batter made a genuine attempt to swing the bat at the ball, and based one at least one of these determinations, there is an autonomous determination of whether a “strike” or a “ball” occurred. Additionally, an indication of whether a “strike” or a “ball” occurred is autonomously output.

First claim

The invention claimed is:

1. A system for automating umpiring or automatically assisting umpiring of a baseball game or a softball game comprising:
at least two cameras configured to capture images of a ball;
at least one processor in communication with the at least two cameras, wherein the at least one processor is configured to:
determine a location of a strike zone based on at least one image of a batter;
add a visual representation of the strike zone to a video or an image from a video;
track locations of the ball;
determine at least one location of the ball;
determine whether at least one location of the ball intersected with the strike zone based on the determined location of the strike zone and the tracked locations of the ball;
transmit an auditory indication and/or a visual indication of whether the ball intersected with the strike zone; and
associate the location of the strike zone with a batter and save the location of the strike zone for reuse for subsequent at-bats for the batter.

2. The system of claim 1 , wherein at least one Vertical Interval Time Code (VITC) inserter is associated with at least one of the at least two cameras, wherein the at least one VITC inserter is operable to add time codes, time stamps, camera IDs, and/or combinations thereof to images captured by the at least two cameras.

3. The system of claim 1 , wherein the at least one processor is further configured to add an animated trail representing the locations of the ball on the video or the image from the video.

4. The system of claim 1 , wherein the visual representation of the strike zone comprises a 3D box representing a 3D strike zone, wherein the visual representation of the strike zone further comprises a two-dimensional (2D) box representing a front plane of the strike zone toward a mound of a pitcher.

5. The system of claim 1 , wherein the visual representation of the strike zone indicates the at least one location where the ball intersected with the strike zone and/or a speed of the ball.

6. The system of claim 1 , wherein an output device is configured to display the visual representation of the strike zone.

7. The system of claim 1 , wherein the at least one processor determines the location of the ball using radar.

8. The system of claim 1 , wherein the auditory indication is transmitted through headphones to a determining individual.

9. A method for automating umpiring or automatically assisting umpiring of a baseball game or a softball game comprising:
receiving at least one image of a batter;
determining a location of a strike zone at least based on the at least one image of the batter;
receiving a plurality of images of a ball from at least two cameras;
a computer adding a visual representation of the strike zone to a video or image from a video;
tracking locations of the ball;
determining whether at least one location of the ball intersected with the strike zone based on the determined location of the strike zone and the tracked locations of the ball; and
associating the location of the strike zone with the batter and saving the location of the strike zone for reuse for subsequent at-bats for the batter.

10. The method of claim 9 , further comprising adding an animated trail representing the locations of the ball on the video and/or the image including the batter.

11. The method of claim 9 , further comprising displaying the visual representation of the strike zone on a display device.

12. The method of claim 9 , wherein the visual representation of the strike zone indicates the at least one location where the ball intersected with the strike zone and/or a speed of the ball.

13. The method of claim 9 , wherein the visual representation of the strike zone comprises a 3D box representing a 3D strike zone, wherein the visual representation of the strike zone further comprises a two-dimensional (2D) box representing a front plane of the strike zone toward a mound of a pitcher.

14. The method of claim 9 , wherein an indication of whether the ball intersected with the strike zone is a visual indication on a display device or an auditory indication.

15. The method of claim 9 , wherein tracking the locations of the ball is performed using radar.

16. A system for automating umpiring or automatically assisting umpiring of a baseball game or a softball game comprising:
at least two cameras configured to capture images of a ball;
at least one processor in communication with the at least two cameras, wherein the at least one processor is configured to:
determine a location of a strike zone based on at least one image of a batter;
add a visual representation of the strike zone to a video or an image from the video;
track locations of the ball;
determine whether at least one location of the ball intersected with the strike zone based on the determined location of the strike zone and the tracked locations of the ball; and
associate the location of the strike zone with the batter and save the location of the strike zone for reuse for subsequent at-bats for the batter.

17. The system of claim 16 , wherein the at least one processor is further configured to add an animated trail representing the locations of the ball on the video or the image from the video.

18. The system of claim 16 , wherein the visual representation of the strike zone indicates the at least one location where the ball intersected with the strike zone and/or a speed of the ball.

19. The system of claim 16 , wherein the at least one processor determines the location of the ball using radar.

20. The system of claim 16 , wherein the visual representation of the strike zone comprises a 3D box representing a 3D strike zone, wherein the visual representation of the strike zone further comprises a two-dimensional (2D) box representing a front plane of the strike zone toward a mound of a pitcher.

Assignees

• Sportsmedia Tech Corp

Inventors

• Spivak Josh D
• Goldbeck Graham W
• Zander Ryan A
• Chen Ted C
• Amyx Robert C
• Painter James G

Classifications

• G06V40/23

  Recognition of whole body movements, e.g. for sport training · CPC title

• G06V20/42

  of sport video content · CPC title

• G06T7/254

  involving subtraction of images · CPC title

• G06T7/246 Primary

  using feature-based methods, e.g. the tracking of corners or segments · CPC title

• G06T2207/30241

  Trajectory · CPC title