Augmented reality enhancements for dental practitioners

Patent metadata

Field	Value
Publication number	US-11559377-B2
Application number	US-202117344858-A
Country	US
Kind code	B2
Filing date	Jun 10, 2021
Priority date	Dec 16, 2016
Publication date	Jan 24, 2023
Grant date	Jan 24, 2023

Abstract

An image of a dental arch comprising a preparation tooth is generated by an image capture device associated with an augmented reality (AR) display. The image of the dental arch is registered to previous image data associated with the dental arch. A visual overlay associated with a dental prosthetic to be placed on the preparation tooth is generated based on the registering of the image of the dental arch to the previous image data associated with the dental arch. The visual overlay is output to the AR display, wherein the visual overlay is superimposed over a view of the preparation tooth on the AR display.

First claim

What is claimed is:

1. A method comprising:
receiving an image of a dental arch comprising a preparation tooth, the image having been generated by an image capture device associated with an augmented reality (AR) display;
registering, by a processing device, the image of the dental arch to previous image data associated with the dental arch;
generating, by the processing device, a visual overlay associated with a dental prosthetic to be placed on the preparation tooth based on the registering of the image of the dental arch to the previous image data associated with the dental arch; and
outputting the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the preparation tooth on the AR display.

2. The method of claim 1 , wherein the previous image data associated with the dental arch comprises a three-dimensional model of the dental arch, and wherein registering the image of the dental arch to the three-dimensional model of the dental arch comprises:
generating a plurality of perspective view images of the three-dimensional model of the dental arch; and
comparing the image of the dental arch to the plurality of perspective view images to identify a perspective view image for which the three-dimensional model in the perspective view image most closely matches the dental arch in the image.

3. The method of claim 1 , wherein the dental prosthetic is a crown or bridge.

4. The method of claim 1 , wherein the visual overlay comprises an insertion path for inserting the dental prosthetic onto the preparation tooth.

5. The method of claim 1 , wherein the image of the dental arch comprises the dental arch in a patient's oral cavity.

6. The method of claim 1 , wherein the visual overlay comprises a depiction of an original geometry of a tooth corresponding to the preparation tooth that is superimposed over the preparation tooth.

7. The method of claim 1 , further comprising:
determining, by the processing device, a position of the preparation tooth on the dental arch.

8. The method of claim 1 , further comprising:
receiving a new image;
identifying a change to the preparation tooth based on a comparison of the new image to the image; and
determining an update to the visual overlay based on the change to the preparation tooth.

9. A non-transitory computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
receiving an image of a dental arch comprising a preparation tooth, the image having been generated by an image capture device associated with an augmented reality (AR) display;
registering, by the processing device, the image of the dental arch to previous image data associated with the dental arch;
determining, by the processing device, a position on the dental arch of an area of interest associated with the preparation tooth;
generating, by the processing device, a visual overlay associated with a dental prosthetic to be placed on the preparation tooth; and
outputting the visual overlay to the AR display, wherein the visual overlay is output in accordance with the position on the dental arch of the area of interest such that the visual overlay is superimposed over a view of the preparation tooth on the AR display.

10. The non-transitory computer readable medium of claim 9 , wherein the previous image data associated with the dental arch comprises a three-dimensional model of the dental arch.

11. The non-transitory computer readable medium of claim 10 , wherein registering the image of the dental arch to the three-dimensional model of the dental arch comprises:
generating a plurality of perspective view images of the three-dimensional model of the dental arch; and
comparing the image of the dental arch to the plurality of perspective view images to identify a perspective view image for which the three-dimensional model in the perspective view image most closely matches the dental arch in the image.

12. The non-transitory computer readable medium of claim 9 , wherein the dental prosthetic is a crown or bridge.

13. The non-transitory computer readable medium of claim 9 , wherein the visual overlay comprises an insertion path for inserting the dental prosthetic onto the preparation tooth.

14. The non-transitory computer readable medium of claim 9 , wherein the image of the dental arch comprises the dental arch in a patient's oral cavity.

15. The non-transitory computer readable medium of claim 9 , wherein the visual overlay comprises a depiction of an original geometry of a tooth corresponding to the preparation tooth that is superimposed over the preparation tooth.

16. The non-transitory computer readable medium of claim 9 , the operations further comprising:
determining where to place the visual overlay on the AR display based on the position on the dental arch of the area of interest such that the visual overlay is superimposed over the view of the preparation tooth on the AR display.

17. A system comprising:
an image capture device to generate an image of at least a portion of a dental arch;
an augmented reality (AR) display to display the image of at least the portion of the dental arch; and
a processing device to:
receive the image of at least the portion of the dental arch;
register the image of at least the portion of the dental arch to previous image data associated with the dental arch;
determine a position on at least the portion of the dental arch of an area of interest;
generate a visual overlay associated with a dental prosthetic to be placed at the area of interest; and
output the visual overlay to the AR display, wherein the visual overlay is superimposed over the image at the area of interest.

18. The system of claim 17 , wherein the previous image data associated with the dental arch comprises a three-dimensional model of the dental arch, and wherein registering the image of at least the portion of the dental arch to the three-dimensional model of the dental arch comprises:
generating a plurality of perspective view images of the three-dimensional model of the dental arch; and
comparing the image of at least the portion of the dental arch to the plurality of perspective view images to identify a perspective view image for which the three-dimensional model in the perspective view image most closely matches at least the portion of the dental arch in the image.

19. The system of claim 17 , wherein the dental prosthetic is a crown or bridge.

20. The system of claim 17 , wherein the visual overlay comprises an insertion path for inserting the dental prosthetic onto a preparation tooth at the area of interest.

21. The system of claim 17 , wherein the image of the at least the portion of the dental arch comprises the dental arch in a patient's oral cavity.

Assignees

• Align Technology Inc

Inventors

• Kopelman Avi
• Levin Adi
• Meyer Eric Paul
• Zeiri Elad
• Ashkenazi Amir
• Ganot Ron
• Ozerov Sergei
• Karapetyan Inna

Classifications

• A61B6/466

  adapted to display 3D data · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• A61B2034/254

  being adapted depending on the stage of the surgical procedure · CPC title

• A61B2090/365

  augmented reality, i.e. correlating a live optical image with another image · CPC title

• A61B6/5247

  combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound · CPC title