Methods for interacting with user interfaces based on attention

Patent metadata

Field	Value
Publication number	US-2024272782-A1
Application number	US-202318473187-A
Country	US
Kind code	A1
Filing date	Sep 22, 2023
Priority date	Sep 24, 2022
Publication date	Aug 15, 2024
Grant date	—

Abstract

A gaze virtual object is displayed that is selectable based on attention directed to the gaze virtual object to perform an operation associated with a selectable virtual object. An indication of attention of a user is displayed. An enlarged view of a region of a user interface is displayed. A value of a slider element is adjusted based on attention of a user. A user interface element is moved at a respective rate based on attention of a user. Text is entered into a text entry field in response to speech inputs. A value for a value selection user interface object is updated based on attention of a user. Movement of a virtual object is facilitated based on direct touch interactions. A user input is facilitated for displaying a selection refinement user interface object. A visual indicator is displayed indicating progress toward selecting a virtual object when criteria are met.

First claim

1 - 75 . (canceled)

76 . A method comprising:
at a computer system in communication with a display generation component and one or more input devices:
displaying, via the display generation component, a user interface including a selectable object having an area;
while displaying the user interface including the selectable object, detecting, via the one or more input devices, an attention of a user of the computer system;
in response to detecting the attention of the user, in accordance with a determination that the attention of the user is directed to a first position in the area of the selectable object, displaying, via the display generation component, a visual indication in the area of the selectable object that emphasizes the first position in the area of the selectable object;
while displaying the visual indication in the area of the selectable object, detecting, via the one or more input devices, movement of the attention of the user; and
in response to detecting the movement of the attention of the user, in accordance with a determination that the attention of the user is directed to a second position in the area of the selectable object, changing an appearance of the visual indication in the area of the selectable object so as to emphasize the second position in the area of the selectable object.

77 . The method of claim 76 , wherein the visual indication concurrently emphasizes the first position in the area of the selectable object and the second position in the area of the selectable object.

78 . The method of claim 76 , wherein:
displaying, via the display generation component, the visual indication in the area of the selectable object that emphasizes the first position in the area of the selectable object includes displaying the visual indication emphasizing the first position in the area of the selectable object without emphasizing the second position in the area of the selectable object; and changing the appearance of the visual indication in the area of the selectable object so as to emphasize the second position in the area of the selectable object includes displaying the visual indication emphasizing the second position in the area of the selectable object without emphasizing the first position in the area of the selectable object.

79 . The method of claim 76 , wherein the attention of the user is based on a finger of the user.

80 . The method of claim 76 , wherein the attention of the user is based on a gaze of the user.

81 . The method of claim 76 , wherein the attention of the user is at least in part detected via input from a touch-sensitive surface in communication with the computer system.

82 . The method of claim 76 , wherein the visual indication in the area of the selectable object has a shape resulting from masking a first shape corresponding to the attention of the user and a second shape of the selectable object.

83 . The method of claim 76 , wherein displaying, via the display generation component, the visual indication in the area of the selectable object that emphasizes the first position in the area of the selectable object includes:
in accordance with a determination that a size of the selectable object is a first size, the visual indication has a second size based on the first size; and in accordance with a determination that the size of the selectable object is a third size, different from the first size, the visual indication has a fourth size based on the third size, wherein the fourth size is different from the second size.

84 . The method of claim 83 , wherein displaying, via the display generation component, the visual indication in the area of the selectable object that emphasizes the first position in the area of the selectable object includes:
in accordance with a determination that the size of the selectable object is greater than a threshold size, wherein the first size and the third size are less than the threshold size, the visual indication has a maximum size that is not based on the size of the selectable object.

85 . The method of claim 83 , wherein displaying, via the display generation component, the visual indication in the area of the selectable object that emphasizes the first position in the area of the selectable object includes:
in accordance with a determination that the size of the selectable object is less than a threshold size, wherein the first size and the third size are greater than the threshold size, the visual indication has a minimum size that is not based on the size of the selectable object.

86 . The method of claim 83 , wherein a size of the visual indication is greater than a size of a smallest dimension of the selectable object.

87 . The method of claim 76 , wherein the visual indication is partially transparent.

88 . The method of claim 76 , wherein in response to detecting the movement of the attention of the user, in accordance with the determination that the attention of the user is directed to the second position in the area of the selectable object, changing the appearance of the visual indication in the area of the selectable object so as to emphasize the second position in the area of the selectable object includes smoothly moving the visual indication from the first position in the area of the selectable object to the second position in the area of the selectable object, wherein one or more characteristics of the movement of the visual indication from the first position in the area of the selectable object to the second position in the area of the selectable object are different from one or more characteristics of the movement of the attention of the user from the first position to the second position.

89 . The method of claim 76 , wherein:
displaying the visual indication in the area of the selectable object that emphasizes the first position in the area of the selectable object includes displaying the visual indication with a first portion of the visual indication masked by the selectable object, and changing an appearance of the visual indication in the area of the selectable object so as to emphasize the second position in the area of the selectable object includes displaying the visual indication with a second portion of the visual indication masked by the selectable object, different from the first portion of the visual indication.

90 . The method of claim 76 , comprising:
in response to detecting the movement of the attention of the user, and in accordance with a determination that the attention of the user is directed to a third position in a second area of a second selectable object, different from the selectable object:
ceasing display of the visual indication in the selectable object; and
displaying, via the display generation component, the visual indication at the third position in the second area of the second selectable object that emphasizes the third position in the second area of the second selectable object.

91 . The method of claim 90 , wherein:
the selectable object is a first selectable object, displaying the visual indication in the area of the first selectable object that emphasizes the first position in the area of the first selectable object includes displaying the visual indication with a first portion of the visual indication masked by the first selectable object, and displaying the visual indication at the third position in the second area of the second selectable object that emphasizes the third position in the second area of the second selectable object includes displaying the visual indication with a second portion of the visua

Assignees

• Apple Inc

Inventors

• Pastrana Vicente Israel
• Krivoruchko Evgenii
• Price Danielle M
• Dascola Jonathan R
• Bauerly Kristi E
• Alonso Marcos
• Verweij Hugo D
• Pazmino Lorena S
• Ravasz Jonathan
• Taylor Zoey C
• Estany Rodriguez Miquel
• Owen James J

Classifications

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06F3/04812

  Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects · CPC title