User interfaces integrating hardware buttons

Patent metadata

Field	Value
Publication number	US-2025238128-A1
Application number	US-202418898441-A
Country	US
Kind code	A1
Filing date	Sep 26, 2024
Priority date	Jan 18, 2024
Publication date	Jul 24, 2025
Grant date	—

Abstract

User interfaces integrating variable hardware inputs are described, including user interfaces that perform different operations in response to presses of different intensities with and without movement, user interfaces that perform different media capture operations based on presses of different lengths with and without movement, user interfaces with controls that can be customized by swiping near a hardware control, user interfaces for media playback with dynamic speed adjustments, and user interfaces that perform adjustments before and after contact with a hardware control ends.

First claim

What is claimed is:

1 . A computer system configured to communicate with one or more display generation components and a plurality of input devices that includes at least a first hardware input device and a second hardware input device different from the first hardware input device, comprising:
one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the one or more display generation components, a user interface;
while displaying the user interface, detecting, via one or more of the plurality of input devices, a set of one or more inputs; and
in response to detecting the set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more deformations, wherein displaying the user interface with the one or more deformations includes:
in accordance with a determination that the set of one or more inputs includes a first press input directed to the first hardware input device, displaying the user interface with a first deformation at a first region, wherein the first region corresponds to a location of the first hardware input device; and
in accordance with a determination that the set of one or more inputs includes a second press input directed to the second hardware input device, displaying the user interface with a second deformation at a second region, different from the first region, wherein the second region corresponds to a location of the second hardware input device.

2 . The computer system of claim 1 , wherein:
displaying the user interface with the first deformation at the first region includes bending a portion of an edge of the user interface within the first region.

3 . The computer system of claim 1 , wherein:
displaying the user interface with the first deformation at the first region includes displaying, via the one or more display generation components, a graphical element of a solid color replacing a respective portion of the user interface within the first region.

4 . The computer system of claim 1 , wherein:
displaying the user interface with the first deformation at the first region includes displaying, via the one or more display generation components, a graphical element of a respective color replacing a respective portion of the user interface within the first region, wherein the respective color represents a color of a portion of a hardware component of the computer system located near the first region.

5 . The computer system of claim 4 , wherein the portion of a hardware component of the computer system located near the first region includes a portion of at least one of the one or more display generation components.

6 . The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the user interface with the first deformation at the first region, detecting an end of the first press input directed to the first hardware input device; and in response to detecting the end of the first press input directed to the first hardware input device, reducing a magnitude of the first deformation.

7 . The method of claim 6 , wherein reducing the magnitude of the first deformation includes gradually changing an appearance of the first deformation.

8 . The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the user interface with the one or more deformations, changing a magnitude of a respective deformation of the one or more deformations.

9 . The computer system of claim 8 , wherein changing the magnitude of the respective deformation of the one or more deformations includes:
while detecting the first press input directed to the first hardware input device, changing the magnitude of the first deformation at the first region based on a current duration of the first press input.

10 . The computer system of claim 8 , wherein changing the magnitude of the respective deformation of the one or more deformations includes:
while detecting the first press input directed to the first hardware input device, detecting a change in an intensity of the first press input; and in response to detecting the change in the intensity of the first press input, changing the magnitude of the first deformation at the first region based on the change in the intensity of the first press input.

11 . The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the user interface with the one or more deformations, detecting an end of the set of one or more inputs; in response to detecting the end of the set of one or more inputs, displaying the user interface without the one or more deformations; while displaying the user interface without the one or more deformations, detecting, via one or more of the plurality of input devices, a second set of one or more inputs; and in response to detecting the second set of one or more inputs, displaying, via the one or more display generation components, the user interface with one or more additional deformations, wherein displaying the user interface with the one or more additional deformations includes:
in accordance with a determination that the set of one or more inputs includes a first additional press input directed to the first hardware input device, displaying the user interface with a first additional deformation at the first region; and
in accordance with a determination that the set of one or more inputs includes a second additional press input directed to the second hardware input device, displaying the user interface with a second additional deformation at the second region.

12 . The computer system of claim 1 , wherein:
the user interface includes a set of one or more user interface elements including a first user interface element displayed at the first region; and displaying the user interface with the first deformation at the first region includes changing a location of the first user interface element.

13 . The computer system of claim 12 , wherein the first user interface element includes a visual representation of a custom operation associated with the first hardware input device.

14 . The computer system of claim 12 , wherein the first user interface element includes a volume indicator element.

15 . The computer system of claim 12 , the one or more programs further including instructions for:
receiving a request to perform a secure operation; and in response to receiving the request to perform the secure operation, displaying, via the one or more display generation components, the first user interface element, wherein the first user interface element includes a confirmation element for the secure operation.

16 . The computer system of claim 1 , wherein displaying the user interface with the one or more deformations includes:
in accordance with a determination that the first press input directed to the first hardware input device and the second press input directed to the second hardware input device are concurrently detected, displaying the user interface with both the first deformation at the first region and the second deformation at the second region.

17 . The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the user interface with the first deformation at the first region:
in accordance with a determination that the set of one or more inputs does not include a resp

Assignees

• Apple Inc

Inventors

• Manzari Johnnie B
• Dye Alan C
• De Vries Nathan
• Alonso Marcos
• Zumbrunnen Adrian
• Karunamuni Chanaka G
• Foss Christopher P
• Soetaert Michael S
• Souza Dos Santos Andre

Classifications

• G11B27/34

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G11B27/005

  Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783) · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title