Image based assessment for dental treatment monitoring

Patent metadata

Field	Value
Publication number	US-12402983-B2
Application number	US-202318340793-A
Country	US
Kind code	B2
Filing date	Jun 23, 2023
Priority date	Aug 20, 2015
Publication date	Sep 2, 2025
Grant date	Sep 2, 2025

Abstract

Systems and methods for monitoring a dental patient's progress during treatment. A first teeth mask for a captured 2D image of teeth at a particular time during treatment and a second teeth mask for an expected 2D image of the teeth may be generated. The expected 2D image may be generated from an expected 3D model representing an expected configuration of the teeth at the particular time. The captured 2D image and the expected 2D image may be compared, with the first and second teeth masks aligned, to determine whether the teeth are within a threshold level of correspondence to the expected configuration. An indication as to whether the dental treatment is proceeding as expected based on whether the configuration of the teeth is within the threshold level of correspondence may be provided.

First claim

What is claimed is:

1. A dental treatment monitoring system comprising:
one or more processors; and
a memory coupled to the one or more processors, the memory configured to store computer-program instructions, that, when executed by the one or more processors, perform a computer-implemented method comprising:
accessing a captured two-dimensional (2D) image of a patient's teeth taken at a particular time during a course of dental treatment;
generating a first teeth mask for the captured 2D image, wherein the first teeth mask is configured to distinguish between tooth and non-tooth regions of the captured 2D image;
accessing an expected three-dimensional (3D) model representing an expected configuration of the patient's teeth at the particular time;
determining a set of virtual camera parameters of a virtual camera for the expected 3D model corresponding to the captured 2D image;
generating an expected 2D image from the expected 3D model by mapping points from a surface of the expected 3D model to points on an image plane of the virtual camera;
generating a second teeth mask for the expected 2D image, wherein the second teeth mask is configured to distinguish between tooth and non-tooth regions of the expected 2D image;
aligning the first teeth mask with the second teeth mask, wherein aligning the first teeth mask with the second teeth mask includes taking a distance transform of the first teeth mask, and determining a minimal-cost overlay between the second teeth mask and the distance transform of the first teeth mask;
comparing the captured 2D image with the expected 2D image, with the first and second teeth masks aligned, to determine whether a configuration of the patient's teeth is within a threshold level of correspondence to the expected configuration of the patient's teeth; and
providing an indication that the dental treatment is proceeding as expected or not proceeding as expected based on the determination as to whether the configuration of the patient's teeth is within the threshold level of correspondence.

2. The system of claim 1 , wherein a virtual lens of the virtual camera is centered at a focal point having the same camera coordinates of a camera coordinate system and world coordinates of a world coordinate system.

3. The system of claim 2 , wherein when a point in the world coordinate system is in focus, a distance between an origin and the focal point is a focal length of the virtual camera.

4. The system of claim 2 , wherein positions of the surface of the expected three-dimensional model are inverted through the focal point and mapped to the image plane of the virtual camera.

5. The system of claim 1 , wherein lengths of similar sides of similar triangles are used to derive expressions for image-plane coordinates for an imaged point in three-dimensional space with world coordinates.

6. The system of claim 1 , further comprising aligning a camera coordinate system to be coincident with a world coordinate system including implementing a forward transformation from world coordinate points to image points and an inverse transformation.

7. The system of claim 1 , wherein the expected 3D model representing the expected configuration of the patient's teeth at the particular time is a time-projected 3D model corresponding to an estimated configuration of the patient's teeth at the particular time.

8. The system of claim 1 , wherein the expected 3D model represents the expected configuration of the patient's teeth at an intermediate stage of the dental treatment.

9. The system of claim 1 , wherein the expected 3D model represents the expected configuration of the patient's teeth at a final stage of the dental treatment.

10. The system of claim 1 , wherein the captured 2D image of the patient's teeth is a picture from a smart phone camera.

11. The system of claim 1 , wherein a plurality of captured 2D images are received and compared to a corresponding plurality of expected 2D images.

12. A method of dental treatment monitoring, the method comprising:
accessing a captured two-dimensional (2D) image of a patient's teeth taken at a particular time during a course of dental treatment;
generating a first teeth mask for the captured 2D image, wherein the first teeth mask is configured to distinguish between tooth and non-tooth regions of the captured 2D image;
accessing an expected three-dimensional (3D) model representing an expected configuration of the patient's teeth at the particular time;
determining a set of virtual camera parameters of a virtual camera for the expected 3D model corresponding to the captured 2D image;
generating an expected 2D image from the expected 3D model by mapping points from a surface of the expected 3D model to points on an image plane of the virtual camera;
generating a second teeth mask for the expected 2D image, wherein the second teeth mask is configured to distinguish between tooth and non-tooth regions of the expected 2D image;
aligning the first teeth mask with the second teeth mask, wherein aligning the first teeth mask with the second teeth mask includes taking a distance transform of the first teeth mask, and determining a minimal-cost overlay between the second teeth mask and the distance transform of the first teeth mask;
comparing the captured 2D image with the expected 2D image, with the first and second teeth masks aligned, to determine whether a configuration of the patient's teeth is within a threshold level of correspondence to the expected configuration of the patient's teeth; and
providing an indication that the dental treatment is proceeding as expected or not proceeding as expected based on the determination as to whether the configuration of the patient's teeth is within the threshold level of correspondence.

13. The method of claim 12 , wherein a plurality of two-dimensional images are received and compared to a corresponding plurality of expected two-dimensional images, wherein determining whether the configuration of the patient's teeth is within the threshold level of correspondence comprises providing correlation coefficients for individual images of the plurality of two-dimensional images, and aggregating the correlation coefficients to generate a single correlation value.

14. The method of claim 12 , wherein a virtual lens of the virtual camera is centered at a focal point having the same camera coordinates of a camera coordinate system and world coordinates of a world coordinate system.

15. The method of claim 14 , wherein when a point in the world coordinate system is in focus, a distance between an origin and the focal point is a focal length of the virtual camera.

16. The method of claim 14 , wherein positions of the surface of the expected three-dimensional model are inverted through the focal point and mapped to the image plane of the virtual camera.

17. The method of claim 12 , further comprising aligning a camera coordinate system to be coincident with a world coordinate system including implementing a forward transformation from world coordinate points to image points and an inverse transformation.

18. The method of claim 12 , wherein determining whether the configuration of the patient's teeth is within the threshold level of correspondence to the expected configuration of the patient's teeth comprises comparing contour lines on a pixel basis.

19. A non-transitory computer-readable storage medium storing a set of instructions capable of being executed by one or more processors that, when executed, causes the one or more processors to perform a metho

Assignees

• Align Technology Inc

Inventors

• Borovinskih Artem
• Derakhshan Mitra
• Morik Carina
• Meyer Eric
• Tolstaya Ekaterina
• Brailov Yury

Classifications

• G06V2201/03

  Recognition of patterns in medical or anatomical images · CPC title

• G06V10/76

  based on eigen-space representations, e.g. from pose or different illumination conditions; Shape manifolds · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06T3/06

  Topological mapping of higher dimensional structures onto lower dimensional surfaces · CPC title

• G06V30/1831

  using gradient analysis · CPC title