Presenting Labels In Augmented Reality

Patent metadata

Field	Value
Publication number	US-2024355058-A1
Application number	US-202418735861-A
Country	US
Kind code	A1
Filing date	Jun 6, 2024
Priority date	Jun 6, 2021
Publication date	Oct 24, 2024
Grant date	—

Abstract

In some implementations, a computing device can present augmented reality (AR) labels in an AR video stream. For example, the computing device can obtain route information for a route requested by a user and can determine locations along the route for placing candidate AR labels. The computing device can determine the precise location of the computing device using camera depth information obtained in response to the user scanning the local real-world environment with a camera of the computing device. The computing device can select an AR label and/or label placement location for presentation in an AR video stream based on various criteria, including the distance between the candidate AR labels and the precise location of the computing device, priorities assigned to each candidate AR label, and/or whether a clear line of sight exists between the precise location of the computing device and the candidate AR label location.

First claim

1 . (canceled)

2 . A method of comprising:
presenting, by a navigation application executing on a computing device, an augmented reality video stream displaying a portion of a route to a destination; presenting a destination label, pertaining to the destination, in the augmented reality video stream; determining that the computing device is within a threshold distance of the destination; and responsive to determining that the computing device is within a threshold distance of the destination: animating the destination label.

3 . The method of claim 2 , wherein animating the destination label comprises one of causing the destination label to bounce or causing the destination label to spin.

4 . The method of claim 2 , wherein the augmented reality video stream includes video data captured by a camera of the computing device.

5 . The method of claim 2 , wherein determining that the computing device is within the threshold distance of the destination comprises determining that the computing device has arrived at the destination.

6 . The method of claim 2 , wherein animating the destination label indicates arrival at the destination.

7 . The method of claim 2 , wherein presenting a destination label, pertaining to the destination, in the augmented reality video stream comprises one of presenting the destination label in an entrance to a structure associated with the destination or presenting the destination label on a same side of a street as the destination location.

8 . The method of claim 2 , wherein the destination label has an appearance that represents a location associated with the destination.

9 . A non-transitory computer readable medium including one or more sequences of instructions that, when executed by one or more processors, cause the processors to perform operations comprising:
presenting, by a navigation application executing on a computing device, an augmented reality video stream displaying a portion of a route to a destination; presenting a destination label, pertaining to the destination, in the augmented reality video stream; determining that the computing device is within a threshold distance of the destination; and responsive to determining that the computing device is within a threshold distance of the destination: animating the destination label.

10 . The non-transitory computer readable medium of claim 9 , wherein animating the destination label comprises one of causing the destination label to bounce or causing the destination label to spin.

11 . The non-transitory computer readable medium of claim 9 , wherein the augmented reality video stream includes video data captured by a camera of the computing device.

12 . The non-transitory computer readable medium of claim 9 , wherein determining that the computing device is within the threshold distance of the destination comprises determining that the computing device has arrived at the destination.

13 . The non-transitory computer readable medium of claim 9 , wherein animating the destination label indicates arrival at the destination.

14 . The non-transitory computer readable medium of claim 9 , wherein presenting a destination label, pertaining to the destination, in the augmented reality video stream comprises one of presenting the destination label in an entrance to a structure associated with the destination or presenting the destination label on a same side of a street as the destination location.

15 . The non-transitory computer readable medium of claim 9 , wherein the destination label has an appearance that represents a location associated with the destination.

16 . A computing device comprising:
one or more processors; and a non-transitory computer readable medium including one or more sequences of instructions that, when executed by the one or more processors, cause the processors to perform operations comprising: presenting, by a navigation application executing on a computing device, an augmented reality video stream displaying a portion of a route to a destination; presenting a destination label, pertaining to the destination, in the augmented reality video stream; determining that the computing device is within a threshold distance of the destination; and responsive to determining that the computing device is within a threshold distance of the destination: animating the destination label.

17 . The computing device of claim 16 , wherein animating the destination label comprises one of causing the destination label to bounce or causing the destination label to spin.

18 . The computing device of claim 16 , wherein the augmented reality video stream includes video data captured by a camera of the computing device.

19 . The computing device of claim 16 , wherein determining that the computing device is within the threshold distance of the destination comprises determining that the computing device has arrived at the destination.

20 . The computing device of claim 16 , wherein animating the destination label indicates arrival at the destination.

21 . The computing device of claim 16 , wherein presenting a destination label, pertaining to the destination, in the augmented reality video stream comprises one of presenting the destination label in an entrance to a structure associated with the destination or presenting the destination label on a same side of a street as the destination location.

Assignees

• Apple Inc

Inventors

• Wu ting-yuan
• Pasek Lukasz J
• Bhutani Ishan
• Hasan Syed Mohsin
• Uzum Vella Isil
• Sturm Eugene P
• Bangu Razvan
• Ahrens Paul F
• Ball Matthew B
• Coleman Patrick J
• Dreyer Benjamin R
• West Roy E
• Andrich Brian J
• Magharious George

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T17/20

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title

• G06T15/06

  Ray-tracing · CPC title

• G06T19/003 Primary

  Navigation within 3D models or images · CPC title

• H04W4/02 Primary

  Services making use of location information · CPC title