Devices and methods for measuring using augmented reality

Patent metadata

Field	Value
Publication number	US-11073375-B2
Application number	US-202016841550-A
Country	US
Kind code	B2
Filing date	Apr 6, 2020
Priority date	May 7, 2018
Publication date	Jul 27, 2021
Grant date	Jul 27, 2021

Abstract

An electronic device displays an application user interface that includes a representation of a field of view of one or more cameras. The representation of the field of view is updated over time based on changes to current visual data detected by the one or more cameras, and the field of view includes a physical object in a three-dimensional space. While the device is a first distance from the physical object, the device displays a representation of a measurement that corresponds to the physical object, and one or more first scale markers along the representation of the measurement at a first scale. After the device has moved to a second distance from the physical object, the device displays, at a second scale that is different from the first scale, one or more second scale markers along at least a portion of the representation of the measurement.

First claim

What is claimed is:

1. A method, comprising:
at an electronic device with a display, an input device, and one or more cameras:
displaying, on the display, a user interface of an application, wherein:
the user interface includes a representation of a field of view of at least one of the one or more cameras;
the representation of the field of view is updated over time based on changes to current visual data detected by at least one of the one or more cameras; and
the field of view includes a physical object in a three-dimensional space;

while the electronic device is a first distance from the physical object, displaying, over the representation of the field of view, a representation of a measurement that corresponds to the physical object, including displaying one or more first scale markers along the representation of the measurement at a first scale;
detecting movement of the electronic device that moves the electronic device to a second distance from the physical object, wherein the second distance is different from the first distance; and
while the electronic device is the second distance from the physical object, displaying, at a second scale that is different from the first scale, one or more second scale markers along at least a portion of the representation of the measurement.

2. The method of claim 1 , wherein displaying the one or more first scale markers at the first scale includes displaying the one or more first scale markers at a first interval along the representation of the measurement, wherein the first interval corresponds to a first physical distance in the three-dimensional space, and displaying the one or more second scale markers at the second scale includes displaying the one or more second scale markers at a second interval along at least the portion of the representation of the measurement, wherein the second interval corresponds to a second physical distance, different from the first physical distance, in the three-dimensional space.

3. The method of claim 1 , wherein:
in accordance with a determination that the second distance is less than the first distance, the second scale is finer than the first scale; and
in accordance with a determination that the first distance is less than the second distance, the first scale is finer than the second scale.

4. The method of claim 1 , wherein:
the first distance from the physical object is a first distance between the electronic device and the physical object, and the second distance from the physical object is a second distance between the electronic device and the physical object;
displaying the one or more first scale markers at the first scale is performed in accordance with a determination that the first distance between the electronic device and the physical object is greater than a first threshold distance; and
displaying the one or more second scale markers at the second scale is performed in accordance with a determination that the second distance between the electronic device and the physical object is less than the first threshold distance.

5. The method of claim 1 , wherein the first distance and the second distance are less than a second threshold distance, and the method includes:
detecting movement of the electronic device that moves the electronic device to a third distance from the physical object, wherein the third distance is greater than the second threshold distance; and
while the electronic device is the third distance from the physical object, displaying the representation of the measurement without displaying one or more scale markers along the representation of the measurement.

6. The method of claim 1 , including:
concurrently displaying, with the representation of the measurement, a label that describes the measurement, wherein:
while the electronic device is the first distance from the physical object, the label is displayed at a first size; and
while the electronic device is the second distance from the physical object, the label is displayed at a second size that is different from the first size.

7. An electronic device, comprising:
a display;
an input device;
one or more cameras;
one or more processors; and
memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, on the display, a user interface of an application, wherein:
the user interface includes a representation of a field of view of at least one of the one or more cameras;
the representation of the field of view is updated over time based on changes to current visual data detected by at least one of the one or more cameras; and
the field of view includes a physical object in a three-dimensional space;

while the electronic device is a first distance from the physical object, displaying, over the representation of the field of view, a representation of a measurement that corresponds to the physical object, including displaying one or more first scale markers along the representation of the measurement at a first scale;
detecting movement of the electronic device that moves the electronic device to a second distance from the physical object, wherein the second distance is different from the first distance; and
while the electronic device is the second distance from the physical object, displaying, at a second scale that is different from the first scale, one or more second scale markers along at least a portion of the representation of the measurement.

8. The electronic device of claim 7 , wherein displaying the one or more first scale markers at the first scale includes displaying the one or more first scale markers at a first interval along the representation of the measurement, wherein the first interval corresponds to a first physical distance in the three-dimensional space, and displaying the one or more second scale markers at the second scale includes displaying the one or more second scale markers at a second interval along at least the portion of the representation of the measurement, wherein the second interval corresponds to a second physical distance, different from the first physical distance, in the three-dimensional space.

9. The electronic device of claim 7 , wherein:
in accordance with a determination that the second distance is less than the first distance, the second scale is finer than the first scale; and
in accordance with a determination that the first distance is less than the second distance, the first scale is finer than the second scale.

10. The electronic device of claim 7 , wherein:
the first distance from the physical object is a first distance between the electronic device and the physical object, and the second distance from the physical object is a second distance between the electronic device and the physical object;
displaying the one or more first scale markers at the first scale is performed in accordance with a determination that the first distance between the electronic device and the physical object is greater than a first threshold distance; and
displaying the one or more second scale markers at the second scale is performed in accordance with a determination that the second distance between the electronic device and the physical object is less than the first threshold distance.

11. The electronic device of claim 7 , wherein the first distance and the second distance are less than a second threshold distance, and the one or more programs include instructions for:
detecting movement of the electronic device that moves the electronic device to a third distance from the physical object, wherein the third distance is greater th

Assignees

• Apple Inc

Inventors

• Dryer Allison W
• Paul Grant R
• Lemay Stephen O
• Yerkes Giancarlo
• Lyons Richard D

Classifications

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title

• H04N23/631

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title