Context-aware voice guidance

Patent metadata

Field	Value
Publication number	US-11956609-B2
Application number	US-202117160746-A
Country	US
Kind code	B2
Filing date	Jan 28, 2021
Priority date	Jun 5, 2012
Publication date	Apr 9, 2024
Grant date	Apr 9, 2024

Abstract

A context-aware voice guidance method is provided that interacts with other voice services of a user device. The voice guidance does not provide audible guidance while the user is making a verbal request to any of the voice-activated services. Instead, the voice guidance transcribes its output on the screen while the verbal requests from the user are received. In some embodiments, the voice guidance only provides a short warning sound to get the user's attention while the user is speaking on a phone call or another voice-activated service is providing audible response to the user's inquires. The voice guidance in some embodiments distinguishes between music that can be ducked and spoken words, for example from an audiobook, that the user wants to pause instead of being skipped. The voice guidance ducks music but pauses spoken words of an audio book in order to provide voice guidance to the user.

First claim

What is claimed is:

1. A method of presenting navigation instructions for a route from a starting location to a destination location, the method implemented by a computing device, the method comprising:
determining that the computing device is traveling toward an upcoming maneuver of the route;
based on the determination, presenting, on a display, a first representation of a first navigation sign associated with the upcoming maneuver, the first representation having a first appearance;
while presenting the first representation, determining that a current location of the computing device is within a threshold distance of the upcoming maneuver; and
in response to the determination that the current location is within the threshold distance, generating a second representation of the first navigation sign by modifying the first representation of the first navigation sign to highlight the first navigation sign, the second representation having a second appearance that is different from the first appearance; and
presenting the second representation of the first navigation sign on the display;
wherein highlighting the first navigation sign comprises at least one of:
(a) modifying, in a first sequence, a brightness level for each display segment of a contiguous subset of a plurality of display segments of the first navigation sign from a first brightness level to a second brightness level;
(b) modifying the first representation of the first navigation sign in a second sequence that begins from a center location of the first navigation sign and extends outwards to a border of the first navigation sign;
(c) a rotation of the first navigation sign, or
(d) a movement of the first navigation sign toward and off a side of the display.

2. The method of claim 1 , wherein modifying the first representation further comprises:
modifying the first representation for a first time period;
determining that the first time period has elapsed; and
in response to the determination that the first time period has elapsed, presenting the first navigation sign at the first brightness level.

3. The method of claim 1 , wherein the modifying is initiated at a threshold time before the upcoming maneuver is executed, further comprising:
detecting a current speed of the computing device;
determining, based on the current speed and the threshold time, a first distance from the upcoming maneuver; and
detecting that the current location is approaching the first distance; and
responsive to detecting that the current location is approaching the first distance, modifying the first representation to highlight the first navigation sign.

4. The method of claim 3 , further comprising:
determining a speed limit associated with a road segment that is currently being traveled by the computing device;
determining, based on the determined speed limit and the threshold time, a second distance from the upcoming maneuver; and
detecting that the current location is approaching the second distance; and
responsive to detecting that the current location is approaching the second distance, modifying the first representation to highlight the first navigation sign.

5. The method of claim 1 , further comprising:
presenting the first representation of the first navigation sign at a fourth distance from the upcoming maneuver, the fourth distance being greater than the threshold distance.

6. The method of claim 1 , wherein highlighting the first navigation sign comprises (a) the modifying, in the first sequence, the brightness level for each display segment of the contiguous subset of the plurality of display segments of the first navigation sign from the first brightness level to the second brightness level.

7. The method of claim 1 , wherein highlighting the first navigation sign comprises (b) the modifying of the first representation of the first navigation sign in the second sequence that begins from the center location of the first navigation sign and extends outwards to the border of the first navigation sign.

8. The method of claim 1 , wherein highlighting the first navigation sign comprises (c) the rotation of the first navigation sign.

9. The method of claim 1 , wherein highlighting the first navigation sign comprises (d) the movement of the first navigation sign toward and off a side of the display.

10. A method of presenting navigation instructions for a route from a starting location to a destination location, the method implemented by a computing device, the method comprising:
storing a plurality of distance values in association with a plurality of maneuver types, wherein each distance value of the plurality of distance values represents a distance at which a modification is initiated for navigation signs corresponding respectively to upcoming maneuvers of one of the plurality of maneuver types;
determining that the computing device is traveling toward an upcoming maneuver of the route: presenting, on a display, a first representation of a first navigation sign associated with the upcoming maneuver, the first representation having a first appearance;
determining that the upcoming maneuver has a first maneuver type of the plurality of maneuver types;
determining a threshold distance, for modifying the first representation of the first navigation sign, based on a distance value of the plurality of distance values that is stored in association with the first maneuver type;
while presenting the first representation, determining that a current location of the computing device is within the threshold distance of the upcoming maneuver; and
in response to the determination that the current location is within the threshold distance, generating a second representation of the first navigation sign by modifying the first representation of the first navigation sign, the second representation having a second appearance that is different from the first appearance; and
presenting the second representation of the first navigation sign on the display.

11. A non-transitory machine readable medium storing a program for presenting navigation instructions for a route from a starting location to a destination location on a computing device, the program for execution by at least one processing unit of the computing device, the program comprising sets of instructions for:
determining that the computing device is traveling toward an upcoming maneuver of the route;
based on the determination, presenting, on a display, a first representation of a first navigation sign associated with the upcoming maneuver, the first representation having a first appearance;
while presenting the first representation, determining that a current location of the computing device is within a threshold distance of the upcoming maneuver; and
in response to the determination that the current location is within the threshold distance, generating a second representation by modifying the first representation of the first navigation sign to highlight the first navigation sign, the second representation having a second appearance that is different from the first appearance; and
presenting the second representation of the first navigation sign on the display;
wherein highlighting the first navigation sign comprises at least one of:
(a) modifying, in a first sequence, a brightness level for each display segment of a contiguous subset of a plurality of display segments of the first navigation sign from a first brightness level to a second brightness level;
(b) modifying the first representation of the first navigation sign in a second sequence that begins from a center location of the first navigation sign and extends outwards to a border of the first navigation si

Assignees

• Apple Inc

Inventors

• Bennett Jonathan A
• Lemay Stephen O
• Van Os Marcel
• Forstall Scott
• Moore Bradford A
• Vulcano Emanuele
• Pylappan Seejo K

Classifications

• H04R5/04 Primary

  Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} · CPC title

• G01C21/3629

  Guidance using speech or audio output, e.g. text-to-speech (text to speech systems per se G10L13/00) · CPC title

• G01C21/3667

  Display of a road map (G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635) · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L21/00

  Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence) · CPC title