Selectively activating a handheld device to control a user interface displayed by a wearable device

Patent metadata

Field	Value
Publication number	US-12340036-B2
Application number	US-202318218938-A
Country	US
Kind code	B2
Filing date	Jul 6, 2023
Priority date	Sep 30, 2019
Publication date	Jun 24, 2025
Grant date	Jun 24, 2025

Abstract

Systems, devices, media, and methods are presented for selectively activating and suspending control of a graphical user interface by two or more electronic devices. A portable eyewear device includes a display projected onto at least one lens assembly and a primary touchpad through which the user may access a graphical user interface (GUI) on the display. A handheld accessory device, such as a ring, includes an auxiliary touchpad that is configured to emulate the primary touchpad. The eyewear processor temporarily suspends inputs from one touchpad when it detects an activation signal from the other touchpad.

First claim

What is claimed is:

1. A method of controlling an eyewear device comprising a processor, a memory, a touch module stored in the memory, a touchpad comprising a primary input surface configured to detect a finger input, and a display, the method comprising:
detecting, using the touch module, a primary finger touch relative to the primary input surface, wherein the primary finger touch comprises at least one of a touch, a tap, or a double tap;
presenting a graphical content on the display responsive to the primary finger touch;
identifying a finger gesture relative the primary input surface;
adjusting the graphical content in res se to the finger gesture;
detecting, using the touch module, an activation signal associated with an auxiliary touchpad supported by a handheld device, wherein the handheld device is in wireless communication with the eyewear device;
in response to detecting the activation signal, selectively suspending operation of the primary input surface and activating operation of the auxiliary touchpad; and
presenting a subsequent graphical content on the display based on an auxiliary finger touch relative to the auxiliary touchpad.

2. The method of claim 1 , wherein the touchpad comprises a boundary defining the primary input surface, wherein the boundary comprises a tactile edge, and
wherein identifying the finger gesture comprises sensing the primary input surface over time, wherein the finger gesture comprises at least one of a touch, a tap, a double tap, a slide, a swipe or a moving touch.

3. The method of claim 1 , wherein the handheld device comprises a microcontroller and a local memory, the method further comprising:
selectively storing the touch module in the local memory, such that the touch module is stored in at least one of the memory or the local memory;
detecting, using the touch module, a reactivation signal associated with the primary input surface; and
selectively suspending operation of the auxiliary touchpad in response to detecting the reactivation signal.

4. The method of claim 1 , further comprising:
detecting a position of the primary finger touch relative to a primary coordinate system;
presenting on the display a first virtual input surface corresponding in shape and time to the primary input surface; and
displaying a virtual cursor relative to the first virtual input surface in a virtual position corresponding in location and time to the position of the primary finger touch.

5. The method of claim 1 , further comprising:
detecting a position of the auxiliary finger touch associated with the auxiliary touchpad relative to a touchpad coordinate system;
presenting on the display an auxiliary virtual input surface corresponding in shape and time to the auxiliary touchpad; and
displaying a virtual auxiliary cursor relative to the auxiliary virtual input surface in a virtual position corresponding in location and time to the position of the auxiliary finger touch.

6. The method of claim 5 , wherein displaying the virtual auxiliary cursor further comprises:
collecting track data associated with a segment traversed by the auxiliary finger touch relative to the touchpad coordinate system; and
displaying the virtual auxiliary cursor in accordance with the track data.

7. The method of claim 1 , wherein the eyewear device further comprises a structure including a frame, a right temple extending from a right lateral side of the frame and supporting the touchpad, and a left temple extending from a left lateral side of the frame and supporting a secondary touchpad comprising a secondary input surface, and wherein the method further comprises:
detecting a left-side activation signal associated with the secondary input surface;
selectively suspending the primary input surface in response to the left-side activation signal;
detecting a left-side finger touch associated with the secondary input surface; and
presenting on the display a new graphical content responsive to the left-side finger touch.

8. The method of claim 1 , wherein detecting the activation signal further comprises:
detecting, using the touch module, an input action relative to the auxiliary touchpad selected from a group consisting of a single finger tap, two or more finger taps relative to a timer, and a finger touch and release associated with a duration relative to the timer.

9. The method of claim 1 , wherein presenting the graphical content comprises presenting a graphical user interface, and
wherein presenting the subsequent graphical content comprises presenting a subsequent graphical user interface.

10. A system comprising:
an eyewear device comprising a processor, a memory, a touch module stored in the memory, a touchpad comprising a primary input surface configured to detect a finger input, and a display;
programming in the memory, wherein execution of the programming by the processor configures the eyewear device to perform functions, including functions to:
detect, using the touch module, a primary finger touch relative to the primary input surface, wherein the primary finger touch comprises at least one of a touch, a tap or a double tap;
present a graphical content on the display responsive to the primary finger touch;
identify a finger gesture relative to the primary input surface;
adjust the graphical content in response to the finger gesture;
detect, using the touch module, an activation signal associated with an auxiliary touchpad supported by a handheld device, wherein the handheld device is in wireless communication with the eyewear device;
in response to detecting the activation signal, selectively suspend operation of the primary input surface and activate operation of the auxiliary touchpad; and
present a subsequent graphical content on the display based on an auxiliary finger touch relative to the auxiliary touchpad.

11. The system of claim 10 , wherein the touchpad comprises a boundary defining the primary input surface wherein the boundary comprises a tactile edge, and
wherein the function to identify the finger gesture comprises a function to sense the primary input surface over time, wherein the finger gesture comprises at least one of a touch, a tap, a double tap, a slide, a swipe, or a moving touch.

12. The system of claim 10 , wherein the handheld device comprises a microcontroller, a local memory, and the auxiliary touchpad, the system further comprising:
local programming in the local memory, wherein execution of the local programming by the microcontroller configures the handheld device to perform local functions, including local functions to:
selectively store the touch module in the local memory, such that the touch module is stored in at least one of the memory or the local memory;
detect, using the touch module, a reactivation signal associated with the primary input surface; and
selectively suspend, using the touch module, operation of the auxiliary touchpad in response to the reactivation signal.

13. The system of claim 10 , wherein the execution further configures the eyewear device to:
detect a position of the primary finger touch relative to a primary coordinate system;
present on the display a first virtual input surface corresponding in shape and time to the primary input surface; and
display a virtual cursor relative to the first virtual input surface in a virtual position corresponding in location and time to the position of the primary finger touch.

14. The system of claim 10 , wherein the execution further configures the eyewear device to:
detect a position of the auxiliary finger touch associated with the auxiliary touchpad relative to

Assignees

• Snap Inc

Inventors

• Tham Yu Jiang
• Pomes Stephen
• Rodriguez Ii Jonathan M
• Daube Nir

Classifications

• G06F3/038

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• G06F2203/0382

  Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC · CPC title

• G06F2203/0384

  Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices · CPC title

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title

• G06F2203/0331

  Finger worn pointing device · CPC title