Area of interest overlay on dental site using augmented reality

Patent metadata

Field	Value
Publication number	US-12070375-B2
Application number	US-202318151260-A
Country	US
Kind code	B2
Filing date	Jan 6, 2023
Priority date	Dec 16, 2016
Publication date	Aug 27, 2024
Grant date	Aug 27, 2024

Abstract

A system comprises an image capture device, an augmented reality (AR) display to display, and a processing device. The processing deice receives image data of a dental arch from the image capture device and processes the image data using a plurality of detection rules, where each detection rule detects one or more dental conditions. The processing device determines a dental condition for the dental arch based on the processing, determines a position of an area of interest on the dental arch, wherein the area of interest is associated with the dental condition, generates a visual overlay comprising an indication of the dental condition at the position of the area of interest, and outputs the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

First claim

What is claimed is:

1. A method comprising:
receiving image data of a dental arch from an image capture device associated with an augmented reality (AR) display;
processing, by a processing device, the image data using a plurality of detection rules, where each detection rule of the plurality of detection rules detects one or more dental conditions;
determining, by the processing device, a dental condition for the dental arch based on the processing;
determining, by the processing device, a position of an area of interest on the dental arch, wherein the area of interest is associated with the dental condition;
generating, by the processing device, a visual overlay comprising an indication of the dental condition at the position of the area of interest; and
outputting the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

2. The method of claim 1 , wherein processing the image data using a detection rule of the plurality of detection rules comprises:
processing the image data of the dental arch using a dental condition profile based on a first plurality of images of dental arches that have the dental condition and a second plurality of images of dental arches that lack the dental condition; and
determining whether the dental arch in the image data is more similar to dental arches in the first plurality of images or to dental arches in the second plurality of images.

3. The method of claim 1 , wherein the dental condition comprises at least one of gum recession, tooth wear, a plaque deposit, a cracked tooth, gum disease, tooth decay, a stain, a malocclusion, tooth crowding, or oral cancer.

4. The method of claim 1 , further comprising:
identifying an area in the image data associated with an oral cavity comprising the dental arch;
determining a light enhancement to increase a visibility of the oral cavity, wherein the light enhancement comprises at least one of an amplification in a brightness of the area in the image data associated with the oral cavity or a darkening of an additional area in the image data that surrounds the area in the image data associated with the oral cavity; and
adding the light enhancement to the visual overlay.

5. The method of claim 1 , wherein the image data comprises three-dimensional image data.

6. The method of claim 1 , further comprising:
determining an identity of one or more tooth of the dental arch visible in the image data; and
adding to the visual overlay a label for each of the one or more tooth.

7. The method of claim 1 , further comprising:
causing a light source to emit a light at a specified wavelength;
receiving additional image data of the dental arch, the additional image data comprising the specified wavelength; and
processing the additional image data using at least one detection rule of the plurality of detection rules, wherein the at least one detection rule uses the additional image data comprising the specified wavelength to improve detection of a particular dental condition.

8. The method of claim 1 , wherein at least one detection rule of the plurality of detection rules performs a color analysis of the dental arch.

9. A non-transitory computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
receiving image data of a dental arch from an image capture device associated with an augmented reality (AR) display;
processing, by the processing device, the image data using a plurality of detection rules, where each detection rule of the plurality of detection rules detects one or more dental conditions;
determining, by the processing device, a dental condition for the dental arch based on the processing;
determining, by the processing device, a position of an area of interest on the dental arch, wherein the area of interest is associated with the dental condition;
generating, by the processing device, a visual overlay comprising an indication of the dental condition at the position of the area of interest; and
outputting the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

10. The non-transitory computer readable medium of claim 9 , wherein processing the image data using a detection rule of the plurality of detection rules comprises:
processing the image data of the dental arch using a dental condition profile based on a first plurality of images of dental arches that have the dental condition and a second plurality of images of dental arches that lack the dental condition; and
determining whether the dental arch in the image data is more similar to dental arches in the first plurality of images or to dental arches in the second plurality of images.

11. The non-transitory computer readable medium of claim 9 , wherein the dental condition comprises at least one of gum recession, tooth wear, a plaque deposit, a cracked tooth, gum disease, tooth decay, a stain, a malocclusion, tooth crowding, or oral cancer.

12. The non-transitory computer readable medium of claim 9 , the operations further comprising:
identifying an area in the image data associated with an oral cavity comprising the dental arch;
determining a light enhancement to increase a visibility of the oral cavity, wherein the light enhancement comprises at least one of an amplification in a brightness of the area in the image data associated with the oral cavity or a darkening of an additional area in the image data that surrounds the area in the image data associated with the oral cavity; and
adding the light enhancement to the visual overlay.

13. The non-transitory computer readable medium of claim 9 , wherein the image data comprises three-dimensional image data.

14. The non-transitory computer readable medium of claim 9 , the operations further comprising:
determining an identity of one or more tooth of the dental arch visible in the image data; and
adding to the visual overlay a label for each of the one or more tooth.

15. The non-transitory computer readable medium of claim 9 , the operations further comprising:
causing a light source to emit a light at a specified wavelength;
receiving additional image data of the dental arch, the additional image data comprising the specified wavelength; and
processing the additional image data using at least one detection rule of the plurality of detection rules, wherein the at least one detection rule uses the additional image data comprising the specified wavelength to improve detection of a particular dental condition.

16. The non-transitory computer readable medium of claim 9 , wherein at least one detection rule of the plurality of detection rules performs a color analysis of the dental arch.

17. A system comprising:
an image capture device to generate image data of a dental arch;
an augmented reality (AR) display; and
a processing device to:
receive image data of the dental arch from the image capture device;
process the image data using a plurality of detection rules, where each detection rule of the plurality of detection rules detects one or more dental conditions;
determine a dental condition for the dental arch based on the processing;
determine a position of an area of interest on the dental arch, wherein the area of interest is associated with the dental condition;
generate a visual overlay comprising an indication of the dental condition a

Assignees

• Align Technology Inc

Inventors

• Kopelman Avi
• Levin Adi
• Meyer Eric Paul
• Zeiri Elad
• Ashkenazi Amir
• Ganot Ron
• Ozerov Sergei
• Karapetyan Inna

Classifications

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/09

  Supervised learning · CPC title

• G09B23/283

  for dentistry or oral hygiene (G09B23/286 takes precedence) · CPC title

• G06T2210/41

  Medical · CPC title

• G06T2207/30036

  Dental; Teeth · CPC title