User interface for managing input techniques

Patent metadata

Field	Value
Publication number	US-12535941-B2
Application number	US-202318519979-A
Country	US
Kind code	B2
Filing date	Nov 27, 2023
Priority date	Jun 1, 2019
Publication date	Jan 27, 2026
Grant date	Jan 27, 2026

Abstract

The present disclosure generally relates to managing input devices. In some embodiments, keyboards are resized. In some embodiments, visual feedback of an audio input is provided.

First claim

What is claimed is:

1 . An electronic device, comprising:
a display device; an audio input device; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
while not displaying, on the display device, a text entry field and a first transcription affordance, receiving a request;
in response to receiving the request, concurrently displaying, on the display device:
the text entry field, and
the first transcription affordance at a first location;

detecting a first user input; and
in response to detecting the first user input:
in accordance with a determination that the first user input is directed to the first transcription affordance:
displaying, on the display device, a first visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device without displaying a keyboard, wherein the first visual object overlays at least a portion of the text entry field;

in accordance with a determination that the first user input is directed to the text entry field:
displaying, on the display device concurrently with the text entry field and the first transcription affordance, a keyboard with a second transcription affordance that is different from the first transcription affordance, wherein the second transcription affordance is displayed at a second location that is different from the first location;

after displaying the keyboard with the second transcription affordance:
detecting a second user input; and
in accordance with a determination that the second user input is directed to the second transcription affordance:
replacing, on the display device, display of at least a portion of the keyboard with a second visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device.

2 . The electronic device of claim 1 , the one or more programs further including instructions for:
while displaying the first visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device:
detecting, using the audio input device, audio input; and
in response to detecting audio input, displaying text in the text entry field, wherein the text is based on the detected audio input.

3 . The electronic device of claim 1 , the one or more programs further including instructions for:
while displaying the first visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device:
determining that audio levels received for a threshold duration of time do not exceed a threshold audio level; and
in response to the determination that audio levels received for the threshold duration of time do not exceed the threshold audio level, ceasing to display the first visual object.

4 . The electronic device of claim 1 , the one or more programs further including instructions for:
in accordance with the determination that a first set of transcription criteria is satisfied, wherein the first set of transcription criteria includes a first transcription criterion that is satisfied when the first user input is directed to the first transcription affordance:
ceasing to display the first transcription affordance.

5 . The electronic device of claim 4 , the one or more programs further including instructions for:
in accordance with a determination that the first set of transcription criteria are not satisfied:
forgoing displaying the first visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device while maintaining display of the text entry field.

6 . The electronic device of claim 1 , the one or more programs further including instructions for:
concurrently displaying, on the display device with the text entry field and the first transcription affordance:
a second text entry field, and
a third transcription affordance;
detecting activation of the third transcription affordance; and in response to detecting activation of the third transcription affordance:
displaying, at a location on the display device that is proximate to the second text entry field, a third visual object that provides visual feedback based on audio detected using the audio input device.

7 . The electronic device of claim 1 , wherein replacing display of at least a portion of the keyboard with the second visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device comprises:
ceasing display of the keyboard; and replacing display of the keyboard with the second visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device.

8 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display device and an audio input device, the one or more programs including instructions for:
while not displaying, on the display device, a text entry field and a first transcription affordance, receiving a request; in response to receiving the request, concurrently displaying, on the display device:
the text entry field, and
the first transcription affordance at a first location;
detecting a first user input; and in response to detecting the first user input:
in accordance with a determination that the first user input is directed to the first transcription affordance:
displaying, on the display device, a first visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device without displaying a keyboard, wherein the first visual object overlays at least a portion of the text entry field;

in accordance with a determination that the first user input is directed to the text entry field:
displaying, on the display device concurrently with the text entry field and the first transcription affordance, a keyboard with a second transcription affordance that is different from the first transcription affordance, wherein the second transcription affordance is displayed at a second location that is different from the first location;

after displaying the keyboard with the second transcription affordance:
detecting a second user input; and
in accordance with a determination that the second user input is directed to the second transcription affordance:
replacing, on the display device, display of at least a portion of the keyboard with a second visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device.

9 . The non-transitory computer-readable storage medium of claim 8 , the one or more programs further including instructions for:
while displaying the first visual object that provides visual feedback based on audio detected using the audio input device and varies based on volume of the audio detected using the audio input device:
detecting, using the audio input device, audio input; and
in response to detecting audio input, displaying text in the text entry fi

Assignees

• Apple Inc

Inventors

• Edwards Dylan Ross
• Coffman Patrick L

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/04886

  by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus · CPC title

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0485

  Scrolling or panning · CPC title

• G06F3/04845 Primary

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title