Apparatus and methods for augmented reality measuring of equipment

Patent metadata

Field	Value
Publication number	US-11587315-B2
Application number	US-202016880827-A
Country	US
Kind code	B2
Filing date	May 21, 2020
Priority date	Jun 19, 2019
Publication date	Feb 21, 2023
Grant date	Feb 21, 2023

Abstract

Methods, apparatus, systems and articles of manufacture are disclosed for augmented reality measuring of equipment. An example apparatus disclosed herein includes an image comparator to compare camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data, and an inspection image analyzer to, in response to the image comparator identifying the vehicle part, measure the vehicle part by causing an interface generator to generate an overlay representation of the reference vehicle part on the camera data displayed on a user interface, and determining, based on one or more user inputs to adjust the overlay representation, a measurement corresponding to the vehicle part.

First claim

What is claimed is:

1. An apparatus comprising:
an image comparator to compare camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data; and
an inspection image analyzer to, in response to the image comparator identifying the vehicle part as a tire:
cause an interface generator to generate an overlay representation of the reference vehicle part on the camera data displayed on a user interface; and
determine based on one or more user inputs to adjust the overlay representation, a measurement of the vehicle part corresponding to at least one of a diameter, a radius, a tread depth, or a thickness.

2. The apparatus of claim 1 , wherein the inspection image analyzer is to, when prior inspection data for the vehicle part exists, compare the measurement corresponding to the vehicle part with a prior measurement corresponding to the vehicle part in the prior inspection data.

3. The apparatus of claim 2 , wherein the inspection image analyzer is to determine a wear metric of the vehicle part based on the comparison of the measurement with the prior measurement.

4. The apparatus of claim 1 , further including an inspection profile manager to, responsive to identifying an inspection profile including a first inspection location corresponding to the vehicle part, determine whether a second inspection location corresponding to the vehicle part is available.

5. The apparatus of claim 1 , further including an inspection profile manager to:
access an inspection profile corresponding to the vehicle part; and
generate a navigation instruction to cause a user to move to position a camera at a location to view the vehicle part based on the inspection profile and a location of the camera.

6. The apparatus of claim 1 , further including model management circuitry to identify the reference information by selecting an available model from a plurality of available models.

7. The apparatus of claim 1 , wherein the inspection image analyzer is to, when prior inspection data for the vehicle part exists, generate predictive analytics based on an analyses of the prior inspection data for the vehicle part, the predictive analytics associated with a prediction of an amount of time for a measure of wear to occur.

8. A non-transitory computer readable storage medium comprising instructions that, when executed, cause a processor to at least:
compare camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data; and
in response to identifying the vehicle part as a tire:
generate an overlay representation of the reference vehicle part over the camera data displayed on a user interface; and
determine, based on one or more user inputs to adjust the overlay representation, a measurement of the vehicle part corresponding to at least one of a diameter, a radius, a tread depth, or a thickness.

9. The non-transitory computer readable storage medium of claim 8 , wherein, when prior inspection data for the vehicle part exists, the instructions, when executed, cause the processor to compare the measurement corresponding to the vehicle part with a prior measurement corresponding to the vehicle part in the prior inspection data.

10. The non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed, cause the processor to determine a wear metric of the vehicle part based on the comparison of the measurement with the prior measurement.

11. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the processor to transmit the measurement or a wear metric based on the measurement to an inspection manager.

12. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the processor to:
access an inspection profile corresponding to the vehicle part; and
generate a navigation instruction to cause a user to move to position a camera at a location to view the vehicle part based on the inspection profile and a location of the camera.

13. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the processor to identify the reference information by selecting an available model from a plurality of available models.

14. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, cause the processor to, when prior inspection data for the vehicle part exists, generate predictive analytics based on an analyses of the prior inspection data for the vehicle part, the predictive analytics associated with a prediction of an amount of time for a measure of wear to occur.

15. A method comprising:
comparing camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data; and
measuring, in response to identifying the vehicle part as a tire, the vehicle part by:
causing an interface generator to generate an overlay representation of the reference vehicle part on the camera data displayed on a user interface; and
determining, based on one or more user inputs to adjust the overlay representation, a measurement of the vehicle part corresponding to at least one of a diameter, a radius, a tread depth, or a thickness.

16. The method of claim 15 , further including comparing, when prior inspection data for the vehicle part exists, the measurement corresponding to the vehicle part with a prior measurement corresponding to the vehicle part in the prior inspection data.

17. The method of claim 16 , further including determining a wear metric of the vehicle part based on the comparison of the measurement with the prior measurement.

18. The method of claim 15 , further including, responsive to identifying an inspection profile including a first inspection location corresponding to the vehicle part, determining whether a second inspection location corresponding to the vehicle part is available.

19. The method of claim 15 , further including:
accessing an inspection profile corresponding to the vehicle part; and
generating a navigation instruction to cause a user to move to position a camera at a location to view the vehicle part based on the inspection profile and a location of the camera.

20. The method of claim 15 , further including identifying the reference information by selecting an available model from a plurality of available models.

Assignees

• Deere & Co
• Univ Iowa State Res Found Inc

Inventors

• Gilbert Stephen
• Winer Eliot
• Miller Jack
• Renner Alex
• Sepich Nathan
• Sankaranthi Vinodh
• Gallant Chris
• Wehr David
• Radkowski Rafael
• Song Cheng

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06V2201/12

  Acquisition of 3D measurements of objects · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title