User interface including content from a remote device

Patent metadata

Field	Value
Publication number	US-9285968-B2
Application number	US-201414222302-A
Country	US
Kind code	B2
Filing date	Mar 21, 2014
Priority date	May 13, 2008
Publication date	Mar 15, 2016
Grant date	Mar 15, 2016

Abstract

A user interface displayed by an electronic device can include a first user-interface portion generated by the electronic device and a second user interface portion generated by a remote device. The electronic device can detect received input and determine whether the input corresponds to an interactive element in the first user-interface portion or an interactive element in the second user interface portion. If the input corresponds to an interactive element in the first user-interface portion, the electronic device can generate a response to the input. If the input corresponds to an interactive element in the second user-interface portion, the electronic device can transmit information indicative of the input to the remote device.

First claim

What is claimed is:

1. An electronic device, comprising:
one or more processors;
a touchscreen display;
one or more input devices;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, on the touchscreen display having a designated area for displaying a second user-interface portion received from a remote device, a user interface, wherein the user interface includes a first user-interface portion generated by the electronic device and the second user-interface portion generated by the remote device, wherein the second user-interface portion is displayed in the designated area;

detecting input from an input device of the one or more input devices; and
in response to detecting the input:
determining whether the input is detected on the touchscreen display within the designated area or outside of the designated area
in accordance with a determination that the input is detected on the touchscreen outside of the designated area, conditionally generating a response to the input based on a location of the input; and
in accordance with a determination that the input is received on the touchscreen within the designated area:
transmitting information indicative of the input to the remote device;
after transmitting the information indicative of the input to the remote device, receiving, from the remote device, one or more graphical elements; and
responding to the input by updating the second user-interface portion to display the one or more graphical elements received from the remote device,
wherein the information indicative of the input transmitted to the remote device includes location information indicating a location within the designated area of the touchscreen display at which a touch was detected.

2. The device of claim 1 , wherein the information indicative of the input transmitted to the remote device includes pixel coordinates of a location within the designated area of the touchscreen display.

3. The device of claim 1 , wherein the information indicative of the input transmitted to the remote device includes information identifying a control with which an interaction occurred.

4. The device of claim 1 , wherein the information indicative of the input transmitted to the remote device includes information indicating an operation associated with the input.

5. The device of claim 1 , wherein the transmitting of information indicative of the input to the remote device occurs without interpretation by the remote device.

6. The device of claim 1 , wherein, in response to receiving information indicative of the input transmitted to the remote device, the remote device is configured to perform at least one action.

7. The device of claim 6 , wherein the at least one action performed by the remote device includes at least one of: updating a user interface of the remote device, providing instructions to the electronic device to update a user interface of the electronic device, initiating playback of a media file; pausing playback of a media file, modifying a setting of the remote device; and sending instructions to the electronic device to modify a setting of the electronic device.

8. The device of claim 2 , wherein the remote device is configured to interpret the pixel coordinates of the location within the designated area of the touchscreen display and perform at least one action based on the interpretation of the pixel coordinates.

9. The device of claim 2 , wherein the one or more graphical elements are selected by the remote device in accordance with the pixel coordinates of the location within the designated area of the touchscreen display.

10. The device of claim 1 , wherein the one or more graphical elements are selected by the remote device in accordance with the location information indicating the location within the designated area of the touchscreen display at which a touch was detected.

11. The device of claim 1 , wherein the one or more graphical elements are generated by the remote device without any intervention by the electronic device.

12. The device of claim 1 , wherein at least one of the one or more graphical elements indicate a functionality of the remote device that was invoked in response to interpretation of the input by the remote device.

13. The device of claim 1 , wherein the electronic device is an in-vehicle media control unit and the remote device is a portable media device.

14. A method comprising:
at an electronic device with one or more processors, a touchscreen display, one or more input devices, memory:
displaying, on the touchscreen display having a designated area for displaying a second user-interface portion received from a remote device, a user interface, wherein the user interface includes a first user-interface portion generated by the electronic device and the second user-interface portion generated by the remote device, wherein the second user-interface portion is displayed in the designated area;
detecting input from an input device of the one or more input devices; and
in response to detecting the input:
determining whether the input is detected on the touchscreen display within the designated area or outside of the designated area;
in accordance with a determination that the input is detected on the touchscreen outside of the designated area, conditionally generating a response to the input based on a location of the input; and
in accordance with a determination that the input is received on the touchscreen within the designated area:
transmitting information indicative of the input to the remote device;
after transmitting the information indicative of the input to the remote device, receiving, from the remote device, one or more graphical elements; and
responding to the input by updating the second user-interface portion to display the one or more graphical elements received from the remote device,
wherein the information indicative of the input transmitted to the remote device includes location information indicating a location within the designated area of the touchscreen display at which a touch was detected.

15. The method of claim 14 , wherein the information indicative of the input transmitted to the remote device includes pixel coordinates of a location within the designated area of the touchscreen display.

16. The method of claim 14 , wherein the information indicative of the input transmitted to the remote device includes information identifying a control with which an interaction occurred.

17. The method of claim 14 , wherein the information indicative of the input transmitted to the remote device includes information indicating an operation associated with the input.

18. The method of claim 14 , wherein the transmitting of information indicative of the input to the remote device occurs without interpretation by the remote device.

19. The method of claim 14 , wherein, in response to receiving information indicative of the input transmitted to the remote device, the remote device is configured to perform at least one action.

20. The method of claim 19 , wherein the at least one action performed by the remote device includes at least one of: updating a user interface of the remote device, providing instructions to the electronic device to update a user interface of the electronic device, initiating playback of a media file; pausing playback of a media file, modifying a setting of

Assignees

• Apple Inc

Inventors

• Schubert Emily Clark
• Langenfeld Peter T

Classifications

• H04L67/025

  for remote control or remote monitoring of applications · CPC title

• G06F3/048

  Interaction techniques based on graphical user interfaces [GUI] · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F9/4445

  Physics · mapped topic

• G06F3/04842 Primary

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title