Remote user interface

Patent metadata

Field	Value
Publication number	US-11604571-B2
Application number	US-201816147523-A
Country	US
Kind code	B2
Filing date	Sep 28, 2018
Priority date	Jul 21, 2014
Publication date	Mar 14, 2023
Grant date	Mar 14, 2023

Abstract

Target electronic devices can be remotely controlled using a personal electronic device are disclosed. The personal electronic device can identify target devices that are responsive to remote control. The personal electronic device displays graphical user interface objects that, when selected, cause the personal electronic device to instruct the target electronic device to perform an operation.

First claim

What is claimed is:

1. An electronic device, comprising:
a touch-sensitive display;
one or more processors;
a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
detecting a first target device;
while the first target device is detected, in accordance with a determination that a second target device is detected and responsive to remote control:
determining a location of the second target device relative to the electronic device;
displaying, on the touch-sensitive display, a user interface object representing the second target device,
wherein the second target device is nearby, and
wherein a display position of the user interface object, on the touch-sensitive display, is based on the location of the second target device relative to the electronic device;

detecting a first tap input corresponding to the user interface object representing the second target device;
in response to detecting the first tap input, displaying at least one affordance corresponding to a remotely controllable operation associated with the second target device;
detecting a second tap input corresponding to the at least one affordance corresponding to the remotely controllable operation associated with the second target device;
in response to detecting the second tap input performing the remotely controllable operation associated with the second target device; and

while the first target device is detected, in accordance with a determination that the second target device is detected and not responsive to remote control, forgo displaying, on the touch-sensitive display, the user interface object representing the second target device, and display a user interface for registering a new target device.

2. The electronic device of claim 1 , wherein the user interface object is displayed on a top half of the touch-sensitive display when the location of the second target device is in front of a user of the electronic device.

3. The electronic device of claim 1 , the one or more programs further including instructions for:
determining a distance between the second target device and the electronic device,
wherein a size of the displayed user interface object is inversely proportional to the determined distance.

4. The electronic device of claim 1 , further in accordance with the determination that the second target device is detected:
in accordance with a determination that the remotely controllable operation is associated with at least a third target device, wherein at least the third target device is different from the second target device and the electronic device, performing the remotely controllable operation associated with at least the third target device.

5. A method, comprising:
at an electronic device with a touch-sensitive display:
detecting a first target device;
while the first target device is detected, in accordance with a determination that a second target device is detected and responsive to remote control:
determining a location of the second target device relative to the electronic device;
displaying, on the touch-sensitive display, a user interface object representing the second target device,
wherein the second target device is nearby, and
wherein a display position of the user interface object, on the touch-sensitive display, is based on the location of the second target device relative to the electronic device;

detecting a first tap input corresponding to the user interface object representing the second target device;
in response to detecting the first tap input, displaying at least one affordance corresponding to a remotely controllable operation associated with the second target device;
detecting a second tap input corresponding to the at least one affordance corresponding to the remotely controllable operation associated with the second target device;
in response to detecting the second tap input performing the remotely controllable operation associated with the second target device; and

while the first target device is detected, in accordance with a determination that the second target device is detected and not responsive to remote control, forgo displaying, on the touch-sensitive display, the user interface object representing the second target device, and display a user interface for registering a new target device.

6. The method of claim 5 , wherein the user interface object is displayed on a top half of the touch-sensitive display when the location of the second target device is in front of a user of the electronic device.

7. The method of claim 5 , further comprising:
determining a distance between the second target device and the electronic device,
wherein a size of the displayed user interface object is inversely proportional to the determined distance.

8. The method of claim 5 , further in accordance with the determination that the second target device is detected:
in accordance with a determination that the remotely controllable operation is associated with at least a third target device, wherein at least the third target device is different from the second target device and the electronic device, performing the remotely controllable operation associated with at least the third target device.

9. A non-transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a touch-sensitive display, the one or more programs including instructions for:
detecting a first target device;
while the first tar et device is detected, in accordance with a determination that a second target device is detected and responsive to remote control:
determining a location of the second target device relative to the electronic device;
displaying, on the touch-sensitive display, a user interface object representing the second target device,
wherein the second target device is nearby, and
wherein a display position of the user interface object, on the touch-sensitive display, is based on the location of the second target device relative to the electronic device;

detecting a first tap input corresponding to the user interface object representing the second target device;
in response to detecting the first tap input, displaying at least one affordance corresponding to a remotely controllable operation associated with the second target device;
detecting a second tap input corresponding to the at least one affordance corresponding to the remotely controllable operation associated with the second target device;
in response to detecting the second tap input performing the remotely controllable operation associated with the second target device; and

while the first target device is detected, in accordance with a determination that the second target device is detected and not responsive to remote control, forgo displaying, on the touch-sensitive display, the user interface object representing the second target device, and display a user interface for registering a new target device.

10. The non-transitory computer readable storage medium of claim 9 , wherein the user interface object is displayed on a top half of the touch-sensitive display when the location of the second target device is in front of a user of the electronic device.

11. The non-transitory computer readable storage medium of claim 9 , the one or more programs further including instructions for:
determining a distance between the second target device and the electronic device,
wherein a size of the displayed user interface object is inversely proportional to the de

Assignees

• Apple Inc

Inventors

• Chaudhri Imran
• Lemay Stephen O
• Dye Alan C
• Foss Christopher Patrick
• Yang Lawrence Y
• Graham David Chance
• Ive Jonathan P

Classifications

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G06F1/1626

  with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs] · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F1/1694 Primary

  the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer · CPC title

• H04M1/72415

  for remote control of appliances · CPC title