Automated, generation of dental features in digital models

Patent metadata

Field	Value
Publication number	US-12062180-B2
Application number	US-202017124366-A
Country	US
Kind code	B2
Filing date	Dec 16, 2020
Priority date	Sep 4, 2019
Publication date	Aug 13, 2024
Grant date	Aug 13, 2024

Abstract

In embodiments, a processing device generates a three-dimensional model of a dental site from scan data, the three-dimensional model comprising a representation of a tooth, wherein a portion of the three-dimensional model comprises an interfering surface that obscures a portion of the tooth. The processing device receives or generates an image of the tooth, wherein the image depicts the interfering surface. The processing device processes the image to generate a modified image, wherein the portion of the tooth that was obscured by the interfering surface in the image is shown in the modified image. The processing device updates the three-dimensional model of the dental site by replacing, using the modified image, the portion of the three-dimensional model that comprises the interfering surface that obscures the portion of the tooth, wherein the portion of the tooth that was obscured in the three-dimensional model is shown in an updated three-dimensional model.

First claim

The invention claimed is:

1. A computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
generating a three-dimensional model of a dental site from scan data of the dental site, the three-dimensional model comprising a representation of a tooth, wherein a portion of the three-dimensional model comprises an interfering surface that obscures a portion of the tooth;
receiving or generating an image of the tooth, wherein the image depicts the interfering surface;
performing automatic processing of the image to generate a modified image, wherein the portion of the tooth that was obscured by the interfering surface in the image is shown in the modified image, and wherein performing the automatic processing of the image comprises inputting data from the image into a trained machine learning model that has been trained to modify images of teeth, wherein the trained machine learning model outputs data for the modified image;
updating the three-dimensional model of the dental site by replacing, using the modified image, the portion of the three-dimensional model that comprises the interfering surface that obscures the portion of the tooth, wherein the portion of the tooth that was obscured in the three-dimensional model is shown in an updated three-dimensional model;
displaying at least one of the three-dimensional model or the updated three-dimensional model; and
receiving input as to whether to accept the updated three-dimensional model.

2. The computer readable medium of claim 1 , wherein the image comprises a height map, and wherein the modified image comprises a modified height map.

3. The computer readable medium of claim 1 , wherein an input to the trained machine learning model comprises data from the image and at least one of a first identifier of a dental practitioner that generated the scan data or a second identifier of a laboratory that will manufacture a dental prosthetic from the updated three-dimensional model.

4. The computer readable medium of claim 1 , wherein the image is a monochrome image that comprises height information, and wherein an input to the trained machine learning model comprises first data from the image and second data from a two-dimensional color image that lacks height information.

5. The computer readable medium of claim 1 , the operations further comprising:
receiving an indication that the updated three-dimensional model does not comprise an accurate depiction of the tooth;
receiving one or more new intraoral images generated by an intraoral scanner; and
updating the three-dimensional model using the one or more new intraoral images.

6. The computer readable medium of claim 1 , wherein the tooth is a preparation tooth comprising a margin line, wherein the interfering surface obscures a segment of the margin line, wherein the segment of the margin line that was obscured by the interfering surface in the image is shown in the modified image, and wherein the segment of the margin line that was obscured in the three-dimensional model is shown in an updated three-dimensional model.

7. The computer readable medium of claim 1 , wherein the interfering surface comprises at least one of blood or saliva.

8. A system comprising:
a memory; and
a processing device operatively connected to the memory, the processing device to:
generate a three-dimensional model of a dental site from scan data of the dental site, the three-dimensional model comprising a representation of a tooth, wherein a portion of the three-dimensional model comprises an interfering surface that obscures a portion of the tooth;
receive or generate an image of the tooth, wherein the image depicts the interfering surface and comprises height information;
process, using a trained machine learning model that has been trained to modify images of teeth, the image to generate a modified image, wherein the trained machine learning model outputs data for the modified image, wherein the portion of the tooth that was obscured by the interfering surface in the image is shown in the modified image, and wherein the modified image comprises modified height information; and
update the three-dimensional model of the dental site by replacing, using the modified image, the portion of the three-dimensional model that comprises the interfering surface that obscures the portion of the tooth, wherein the portion of the tooth that was obscured in the three-dimensional model is shown in an updated three-dimensional model.

9. The system of claim 8 , wherein an input to the trained machine learning model comprises data from the image and at least one of a first identifier of a dental practitioner that generated the scan data or a second identifier of a laboratory that will manufacture a dental prosthetic from the updated three-dimensional model.

10. The system of claim 8 , wherein the image is a monochrome image, and wherein an input to the trained machine learning model comprises first data from the image and second data from a two-dimensional color image that lacks height information.

11. The system of claim 8 , further comprising:
a display;
wherein the processing device is further to:
output the updated three-dimensional model to the display;
receive an indication that the updated three-dimensional model does not comprise an accurate depiction of the tooth;
receive one or more new intraoral images generated by an intraoral scanner; and
update the three-dimensional model using the one or more new intraoral images.

12. The system of claim 8 , wherein the tooth is a preparation tooth comprising a margin line, wherein the interfering surface obscures a segment of the margin line, wherein the segment of the margin line that was obscured by the interfering surface in the image is shown in the modified image, and wherein the segment of the margin line that was obscured in the three-dimensional model is shown in an updated three-dimensional model.

13. The system of claim 8 , wherein the interfering surface comprises at least one of blood or saliva.

Assignees

• Align Technology Inc

Inventors

• Weiss Assaf
• Volgin Maxim
• Agniashvili Pavel
• Brown Chad Clayton
• Raskhodchikov Alexander
• Kopelman Avi
• Sabina Michael
• Ben-Dov Moti
• Farkash Shai
• Makiewsky Igor
• Moshe Maayan
• Saphier Ofer

Classifications

• G06N3/0455

  Auto-encoder networks; Encoder-decoder networks · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/0475

  Generative networks · CPC title

• G06N3/0495

  Quantised networks; Sparse networks; Compressed networks · CPC title

• G06N3/09

  Supervised learning · CPC title