Viewing distance estimation method, viewing distance estimation device, and non-transitory computer-readable recording medium recording viewing distance estimation program

Patent metadata

Field	Value
Publication number	US-12118736-B2
Application number	US-202217836316-A
Country	US
Kind code	B2
Filing date	Jun 9, 2022
Priority date	Dec 22, 2020
Publication date	Oct 15, 2024
Grant date	Oct 15, 2024

Abstract

A viewing distance estimation method includes: acquiring a first image captured by an image capturing device and including a face of a person who watches a target; detecting a size of an iris of the person from the first image; calculating a first value indicating a pixel number for the detected size of the iris; acquiring a resolution of the first image; calculating, based on the first value and a second value indicating a predetermined inherent dimension for the size of the iris, a third value indicating an actual dimension of one pixel; estimating a viewing distance corresponding to the acquired resolution and the calculated third value, based on relational information representing a relation among the resolution, the third value, and the viewing distance; and outputting estimative information including the estimated viewing distance.

First claim

The invention claimed is:

1. A viewing distance estimation method for a viewing distance estimation device which estimates a viewing distance between a target and an eye of a person, comprising:
by a computer included in the viewing distance estimation device,
acquiring a first image captured by an image capturing device and including a face of the person who watches the target;
detecting a size of an iris of the person from the first image;
calculating a first value indicating a pixel number for the detected size of the iris;
acquiring a resolution of the first image;
calculating, based on the first value and a second value indicating a predetermined inherent dimension for the size of the iris, a third value indicating an actual dimension of one pixel;
estimating a viewing distance corresponding to the acquired resolution and the calculated third value, based on relational information representing a relation among the resolution, the third value, and the viewing distance; and
outputting estimative information including the estimated viewing distance.

2. The viewing distance estimation method according to claim 1 , wherein
the viewing distance estimation device is a portable terminal device including a camera and a display,
the target is the display, and
the first image is captured by the camera.

3. The viewing distance estimation method according to claim 1 , further comprising:
detecting, based on the first image, an orientation of the face; and
correcting the viewing distance in accordance with the detected orientation of the face.

4. The viewing distance estimation method according to claim 3 , wherein,
in the correction of the viewing distance, the viewing distance is corrected by multiplying the viewing distance by a correction factor of decreasing the viewing distance as the orientation of the face deviates away from a forward direction.

5. The viewing distance estimation method according to claim 1 , wherein, in the detection of the size of the iris,
a second image including an eye region of the person is generated from the first image,
a third image is generated after the second image is binarized, the third image including pixels each having a gradation value smaller than a threshold and represented by a first luminance and pixels each having a gradation value equal to or larger than the threshold and represented by a second luminance,
a fourth image is generated by replacing a pixel coming into existence in a first luminance area having the first luminance, and having the second luminance and satisfying a predetermined criterion with a pixel having the first luminance in the third image, and
the iris is detected by using the fourth image.

6. The viewing distance estimation method according to claim 1 , wherein
a center position of an iris of each of left and right eyes of the person is detected in the detection of the size of the iris,
the method further comprising calculating, based on the detected center position of the iris of each of the left and right eyes of the person and the estimated viewing distance, a convergence angle between the eyes of the person.

7. The viewing distance estimation method according to claim 6 , wherein,
in the calculation of the convergence angle,
a middle point representing a center between respective eye inner corners of the left and right eyes of the person is detected, based on the first image,
a first distance from the middle point between the eye inner corners to the center position of the iris of the left eye and a second distance from the middle point between the eye inner corners to the center position of the iris of the right eye are calculated,
a first convergence half-angle is calculated, based on the first distance and the estimated viewing distance, and a second convergence half-angle is calculated, based on the second distance and the estimated viewing distance, and
a sum of the first convergence half-angle and the second convergence half-angle is calculated as the convergence angle.

8. The viewing distance estimation method according to claim 1 , further comprising displaying the estimative information by superimposing the estimative information on the first image.

9. The viewing distance estimation method according to claim 1 , wherein
the estimative information superimposed on the first image for displaying includes a gauge object generated, based on the first value and the second value, to represent an actual dimension of a subject in the first image.

10. The viewing distance estimation method according to claim 1 , wherein, in the detection of the size of the iris, the size of the iris of each of the left and right eyes is detected, and,
in the estimation of the viewing distance, determination as to whether a detection result of the iris for each of the left and right eyes is appropriate is made, based on the detected size of the iris, and the viewing distance is estimated by using the third value for one of the left and right eyes that is determined to be appropriate.

11. The viewing distance estimation method according to claim 1 , wherein the relational information includes a regression equation whose explanatory variable is each of the resolution and the third value and whose response variable is the viewing distance.

12. A viewing distance estimation device which estimates a viewing distance between a target and an eye of a person, comprising:
an image acquisition part which acquires a first image captured by an image capturing device and including a face of the person who watches the target;
an iris detection part which detects a size of an iris of the person from the first image;
a pixel number calculation part which calculates a first value indicating a pixel number for the detected size of the iris;
a resolution acquisition part which acquires a resolution of the first image;
an actual dimension calculation part which calculates, based on the first value and a second value indicating a predetermined inherent dimension for the size of the iris, a third value indicating an actual dimension of one pixel;
an estimation part which estimates a viewing distance corresponding to the resolution acquired by the resolution acquisition part and the third value calculated by the actual dimension calculation part, based on relational information representing a relation among the resolution, the third value, and the viewing distance; and
an output part which outputs estimative information including the viewing distance estimated by the estimation part.

13. A non-transitory computer-readable recording medium recording a viewing distance estimation program for causing a computer to serve as a viewing distance estimation device which estimates a viewing distance between a target and an eye of a person, the program further causing the computer to serve as:
an image acquisition part which acquires a first image captured by an image capturing device and including a face of the person who watches the target;
an iris detection part which detects a size of an iris of the person from the first image;
a pixel number calculation part which calculates a first value indicating a pixel number for the detected size of the iris;
a resolution acquisition part which acquires a resolution of the first image;
an actual dimension calculation part which calculates, based on the first value and a second value indicating a predetermined inherent dimension for the size of the iris, a third value indicating an actual dimension of one pixel;
an estimation part which estimates a viewing distance corresponding to the resolution acquired by the resolution acquisition part and

Assignees

• Swallow Incubate Co Ltd
• Panasonic Holdings Corp

Inventors

• Ohno Toshikazu

Classifications

• G06T2207/30201

  Face · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title

• G06V10/28

  Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns · CPC title

• G06V40/18

  Eye characteristics, e.g. of the iris · CPC title

• G06T7/73 Primary

  using feature-based methods · CPC title