Camera calibration and distance measurement based on homography

Patent metadata

Field	Value
Publication number	US-12412307-B2
Application number	US-202318516131-A
Country	US
Kind code	B2
Filing date	Nov 21, 2023
Priority date	Nov 23, 2022
Publication date	Sep 9, 2025
Grant date	Sep 9, 2025

Abstract

Example implementations include a method, apparatus and computer-readable medium for estimating a real world height in an image, comprising obtaining two images of an object, with known height, wherein each image depicts the object at a different position that is estimated using a homography matrix. The homography matrix transforms an image plane associated with the image to a real world plane. The implementations include generating a first vector that intersects with the object and points to a real world ground plane using the first image and a second vector that intersects with the same point on the object and points to the real world ground plane using the second image. Additionally, the implementations further include calibrating the camera by determining a height of the center of a camera lens of the camera using an intersection of the first vector and the second vector.

First claim

What is claimed is:

1. A method for estimating a real world height in an image, comprising:
obtaining a first image from a camera installed at an unknown height in an environment, wherein the first image includes a first object at a first location in the environment, wherein the first object has a known object height;
estimating, using a homography matrix that transforms an image plane associated with the image to a real world plane, a first position of a first point on the first object in the first image based on a real world ground plane;
determining, based on the known object height, a first vector that intersects with a second point on the first object and points to the real world ground plane;
obtaining a second image from the camera, wherein the second image includes the first object at a second location in the environment;
estimating, using the homography matrix, a second position of the first point on the first object in the second image based on the real world ground plane;
determining, based on the known object height, a second vector that intersects with the second point on the first object in the second image and points to the real world ground plane; and
calibrating the camera by determining a height of the center of a camera lens of the camera using an intersection of the first vector and the second vector.

2. The method of claim 1 , wherein the second point on the first object has a known second point height based on the known object height.

3. The method of claim 1 , wherein the first point is associated with a base of the first object, and the second point is associated with a top of the first object.

4. The method of claim 1 , wherein the first object is a person, the first point is associated with a foot of the person, and the second point is associated with a head of the person.

5. The method of claim 1 , further comprising:
obtaining a third image from the camera, wherein the third image includes a second object without a known height in the environment; and
determining a height metric of the second object using the homography matrix and the height of the center of the camera lens.

6. The method of claim 5 , wherein determining the height metric of the second object comprises:
estimating, using the homography matrix, a third position of a third point on the second object based on the real world ground plane;
determining, based on the height of the center of the camera lens, a third vector that intersects with a fourth point on the second object and points to the ground plane; and
determining the height metric between the third point and the fourth point on the second object based on a distance between the third point and the fourth point relative to the height of the center of the camera lens.

7. The method of claim 6 , wherein the third point is associated with a base of the second object, and the fourth point is associated with a top of the second object.

8. An apparatus for estimating a real world height in an image, comprising:
one or more memories; and
one or more processors coupled with the one or more memories, wherein the one or more processors are configured, individually or in combination, to:
obtain a first image from a camera installed at an unknown height in an environment, wherein the first image includes a first object at a first location in the environment, wherein the first object has a known object height;
estimate, using a homography matrix that transforms an image plane associated with the image to a real world plane, a first position of a first point on the first object in the first image based on a real world ground plane;
determine, based on the known object height, a first vector that intersects with a second point on the first object and points to the real world ground plane;
obtain a second image from the camera, wherein the second image includes the first object at a second location in the environment;
estimate, using the homography matrix, a second position of the first point on the first object in the second image based on the real world ground plane;
determine, based on the known object height, a second vector that intersects with the second point on the first object in the second image and points to the real world ground plane; and
calibrate the camera by determining a height of the center of a camera lens of the camera using an intersection of the first vector and the second vector.

9. The apparatus of claim 8 , wherein the second point on the first object has a known second point height based on the known object height.

10. The apparatus of claim 8 , wherein the first point is associated with a base of the first object, and the second point is associated with a top of the first object.

11. The apparatus of claim 8 , wherein the first object is a person, the first point is associated with a foot of the person, and the second point is associated with a head of the person.

12. The apparatus of claim 8 , wherein the one or more processors are further configured to:
obtain a third image from the camera, wherein the third image includes a second object without a known height in the environment; and
determine a height metric of the second object using the homography matrix and the height of the center of the camera lens.

13. The apparatus of claim 12 , wherein to determine the height metric of the second object comprises to:
estimate, using the homography matrix, a third position of a third point on the second object based on the real world ground plane;
determine, based on the height of the center of the camera lens, a third vector that intersects with a fourth point on the second object and points to the ground plane; and
determine the height metric between the third point and the fourth point on the second object based on a distance between the third point and the fourth point relative to the height of the center of the camera lens.

14. The apparatus of claim 13 , wherein the third point is associated with a base of the second object, and the fourth point is associated with a top of the second object.

15. A non-transitory” computer-readable medium storing instructions for estimating a real world height in an image, wherein the instructions are executable by one or more processors to:
obtain a first image from a camera installed at an unknown height in an environment, wherein the first image includes a first object at a first location in the environment, wherein the first object has a known object height;
estimate, using a homography matrix that transforms an image plane associated with the image to a real world plane, a first position of a first point on the first object in the first image based on a real world ground plane;
determine, based on the known object height, a first vector that intersects with a second point on the first object and points to the real world ground plane;
obtain a second image from the camera, wherein the second image includes the first object at a second location in the environment;
estimate, using the homography matrix, a second position of the first point on the first object in the second image based on the real world ground plane;
determine, based on the known object height, a second vector that intersects with the second point on the first object in the second image and points to the real world ground plane; and
calibrate the camera by determining a height of the center of a camera lens of the camera using an intersection of the first vector and the second vector.

16. The non-transitory” computer-readable medium of claim 15 , wherein the second point on the first object has a

Assignees

• Tyco Fire & Security Gmbh

Inventors

• Rozner Amit
• Falik Yohay
• DOTAN Calanit

Classifications

• G06T7/73

  using feature-based methods · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title

• G06T2207/30201

  Face · CPC title

• H04N17/002 Primary

  for television cameras · CPC title

• G06T2207/30244

  Camera pose · CPC title