Augmented reality enhancements for dental practitioners

Patent metadata

Field	Value
Publication number	US-11051914-B2
Application number	US-202016851035-A
Country	US
Kind code	B2
Filing date	Apr 16, 2020
Priority date	Dec 16, 2016
Publication date	Jul 6, 2021
Grant date	Jul 6, 2021

Abstract

A method of using AR for dentistry and orthodontics is provided. An image of a dental arch is received, the image having been generated by an image capture device associated with an augmented reality (AR) display. A processing device registers the image to previous image data associated with the dental arch, compares one or more areas of the dental arch from the image to one or more corresponding areas of the dental arch from the previous image data, determines a position of an area of interest on the dental arch based on the comparing, generates a visual overlay comprising an indication of the area of interest, and outputs the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

First claim

The invention claimed is:

1. A method comprising:
receiving an image of a dental arch, the image having been generated by an image capture device associated with an augmented reality (AR) display;
registering, by a processing device, the image of the dental arch to previous image data associated with the dental arch;
comparing, by the processing device, one or more areas of the dental arch from the image to one or more corresponding areas of the dental arch from the previous image data;
determining, by the processing device, a position of an area of interest on the dental arch based on the comparing;
generating, by the processing device, a visual overlay comprising an indication of the area of interest; and
outputting the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

2. The method of claim 1 , wherein the previous image data associated with the dental arch comprises a three-dimensional model of the dental arch, and wherein registering the image of the dental arch to the three-dimensional model of the dental arch comprises:
generating a plurality of perspective view images of the three-dimensional model of the dental arch; and
comparing the image of the dental arch to the plurality of perspective view images to identify a perspective view image for which the three-dimensional model in the perspective view image most closely matches the dental arch in the image.

3. The method of claim 1 , wherein the previous image data comprises at least one of an optical image of at least a portion of the dental arch, an x-ray image of at least the portion of the dental arch, or a three-dimensional model of the dental arch, and wherein determining the position of the area of interest comprises:
determining a difference between an area of the dental arch in the image and a corresponding area of the dental arch in the previous image data, wherein the position of the area of interest corresponds to a position at which the difference occurred.

4. The method of claim 3 , wherein the difference indicates at least one of wear on a tooth, movement of a tooth, gum swelling, gum recess, a cavity, oral cancer, a plaque deposit, or a tooth crack.

5. The method of claim 3 , further comprising:
determining a previous date associated with the previous image data;
determining a current date;
computing an amount of time between the previous date and the current date;
determining a magnitude of change of a condition for a tooth or gum between the previous image data and the image; and
computing, based on the amount of time and the magnitude of change, a rate of change of the condition for the tooth or gum.

6. The method of claim 5 , further comprising:
determining a target rate of change of the condition for the tooth or gum;
determining that a difference between the target rate of change and the rate of change exceeds a rate of change threshold; and
adding to the visual overlay an indication that the difference between the target rate of change and the rate of change exceeds the rate of change threshold.

7. The method of claim 3 , wherein the visual overlay comprises a contour of the difference.

8. The method of claim 1 , wherein the previous image data associated with the dental arch is from an orthodontic treatment plan for the dental arch that comprises a plurality of treatment stages, each treatment stage of the plurality of treatment stages comprising target positions and orientations for teeth of the dental arch, the method further comprising:
determining a current treatment stage of the orthodontic treatment plan;
determining whether a tooth at the area of interest deviates from the orthodontic treatment plan for the current treatment stage; and
adding, to the visual overlay, an indication of whether the tooth at the area of interest deviates from the orthodontic treatment plan.

9. The method of claim 8 , further comprising:
determining whether the deviation exceeds a deviation threshold;
determining one or more treatment plan alterations in response to determining whether the deviation exceeds the deviation threshold; and
outputting a suggestion of the one or more treatment plan alterations.

10. The method of claim 8 , further comprising:
determining whether one or more additional teeth have target positions and orientations indicated for the current treatment stage of the orthodontic treatment plan; and
adding to the visual overlay indications of whether the one or more additional teeth have the target positions and orientations.

11. The method of claim 8 , further comprising:
determining a clinical history for a patient that identifies an additional area of interest;
determining a position of the additional area of interest in the image of the dental arch; and
adding information about the additional area of interest to the visual overlay.

12. The method of claim 1 , further comprising:
identifying one or more malocclusions on the dental arch based on a result of the comparing, wherein the one or more malocclusions are indicated in the visual overlay.

13. The method of claim 1 , further comprising:
determining a difference between the image and the previous image data at the position of the dental arch; and
assessing the position of the dental arch for one or more malocclusions.

14. A system comprising:
a memory device; and
a processing device operatively coupled to the memory device, the processing device to:
receive an image of a dental arch, the image having been generated by an image capture device associated with an augmented reality (AR) display;
register the image of the dental arch to previous image data associated with the dental arch;
make a comparison between one or more areas of the dental arch from the image and one or more corresponding areas of the dental arch from the previous image data;
determine a position of an area of interest on the dental arch based on the comparison;
generate a visual overlay comprising an indication of the area of interest; and
output the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

15. The system of claim 14 , wherein the previous image data associated with the dental arch comprises a three-dimensional model of the dental arch, and wherein to register the image of the dental arch to the three-dimensional model of the dental arch the processing device is further to:
generate a plurality of perspective view images of the three-dimensional model of the dental arch; and
compare the image of the dental arch to the plurality of perspective view images to identify a perspective view image for which the three-dimensional model in the perspective view image most closely matches the dental arch in the image.

16. The system of claim 14 , wherein the previous image data comprises at least one of an optical image of at least a portion of the dental arch, an x-ray image of at least the portion of the dental arch, or a three-dimensional model of the dental arch, and wherein to determine the position of the area of interest the processing device is further to:
determine a difference between an area of the dental arch in the image and a corresponding area of the dental arch in the previous image data, wherein the position of the area of interest corresponds to a position at which the difference occurred.

17. The system of claim 16 , wherein the difference indicates at l

Assignees

• Align Technology Inc

Inventors

• Kopelman Avi
• Levin Adi
• Meyer Eric Paul
• Zeiri Elad
• Ashkenazi Amir
• Ganot Ron
• Ozerov Sergei
• Karapetyan Inna

Classifications

• G06V10/758

  Involving statistics of pixels or of feature values, e.g. histogram matching · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/09

  Supervised learning · CPC title

• A61B1/000096

  using artificial intelligence · CPC title

• A61B1/000094

  extracting biological structures · CPC title