User interfaces for devices with multiple displays

Patent metadata

Field	Value
Publication number	US-11972164-B2
Application number	US-202117389041-A
Country	US
Kind code	B2
Filing date	Jul 29, 2021
Priority date	Sep 30, 2017
Publication date	Apr 30, 2024
Grant date	Apr 30, 2024

Abstract

In some embodiments, an electronic device displays and allows user interaction with content on multiple displays. In some embodiments, an electronic device displays three-dimensional content using coordinated views on multiple displays. In some embodiments, an electronic device shares content while displaying a video conferencing user interface. In some embodiments, an electronic device facilitates the display or keeping private of content on multiple displays. In some embodiments, an electronic device facilitates the display of information from applications using a shared graphical input coordinate space. In some embodiments, an electronic device presents indications of notifications. In some embodiments, an electronic device presents representations of items of content that are related to content presented on the one or more electronic devices. In some embodiments, an electronic device presents user interfaces including a soft keyboard.

First claim

The invention claimed is:

1. A method comprising:
at a first electronic device in communication with a first display and one or more input devices:
displaying respective content on the first display; and
after displaying the respective content on the first display, receiving a request to share the respective content with a user of a second electronic device;
in response to receiving the request to share the respective content;
initiating display of a video conference user interface of a video conference on the first display and initiating sharing of the respective content with the user of the second electronic device; and
displaying the respective content on a second display in communication with the first electronic device;

while displaying the video conference user interface and sharing the respective content:
receiving, at the first electronic device, an indication of interaction by a user of the second electronic device with the respective content at the second electronic device; and
in response to receiving the indication of the interaction by the user of the second electronic device with the respective content at the second electronic device, generating, at the first electronic device, an indication of one or more characteristics of the interaction of the user of the second electronic device with the respective content at the second electronic device;

while displaying the video conference user interface on the first display and the respective content on the second display, receiving a request to end the video conference; and
in response to receiving the request to end the video conference, displaying the respective content on the first display.

2. The method of claim 1 , further comprising:
at the first electronic device:
displaying the respective content in a shared space on the first display, wherein the shared space is displayed as visually between the first electronic device and the second electronic device; and
displaying first private content not shared with the user of the second electronic device in a first private space visually extending in a first direction from the shared space towards the first electronic device.

3. The method of claim 2 , wherein:
the first electronic device displays the respective content in the shared space from a first perspective, and
the second electronic device displays the respective content in the shared space from a second perspective.

4. The method of claim 1 , wherein:
the respective content is displayed on a second display in communication with the first electronic device in a shared space, the shared space comprising a first visual representation of a table between the first electronic device and the second electronic device on which the respective content is placed.

5. The method of claim 1 , further comprising:
receiving, at the first electronic device, an indication of whether the user of the second electronic device is looking at a visual representation of the respective content displayed on the second electronic device; and
in response to receiving the indication of whether the user of the second electronic device is looking at the visual representation of the respective content displayed on the second electronic device:
generating, at the first electronic device, an indication of whether the user of the second electronic device is looking at the respective content, wherein the indication is separate from the video conference user interface.

6. The method of claim 1 , further comprising:
receiving, at the first electronic device, a user input comprising a touch on a portion of the respective content displayed by the first electronic device; and
in response to receiving the user input, displaying a visual indication at the portion of the respective content that corresponds to the touch received on the portion of the respective content.

7. The method of claim 1 , further comprising:
receiving an input corresponding to a user of the first electronic device pointing, with an elongated object, at a respective location in a three-dimensional representation of the respective content displayed at the first electronic device; and
displaying, at the first electronic device, a visual distinction at the respective location of the respective content.

8. The method of claim 1 , wherein:
the interaction by the user of the second electronic device with the respective content at the second electronic device comprises a touch input received at a location of the respective content, and
generating, at the first electronic device, the indication of the one or more characteristics of the interaction of the user of the second electronic device with the respective content at the second electronic device comprises displaying a visual indication at the location in the respective content displayed by the first electronic device at which the touch input was received at the second electronic device.

9. The method of claim 1 , wherein the respective content is displayed on the first display in the video conference user interface overlaid over video conference content.

10. The method of claim 9 , wherein:
displaying the respective content on the first display over the video conference user interface comprises displaying the respective content on a transparent plane over the video conference user interface.

11. The method of claim 1 , wherein:
the indication of the interaction by the user of the second electronic device with the respective content at the second electronic device comprises an indication of a location within the respective content at which the user of the second electronic device is looking, and
generating, at the first electronic device, the indication of the one or more characteristics of the interaction of the user of the second electronic device with the respective content at the second electronic device comprises visually differentiating the location within the respective content corresponding to the location at which the user of the second electronic device is looking from a remainder of the respective content.

12. The method of claim 1 , wherein:
in accordance with a determination that a first respective display of the first display and a second display in communication with the first electronic device is in a first orientation, initiating display of a video conference user interface on the first display includes displaying the video conference user interface on the first respective display; and
in accordance with a determination that a second respective display of the first display and the second display is in a second orientation, different than the first orientation, initiating sharing of the respective content with the user of the second electronic device includes displaying the respective content on the second respective display.

13. The method of claim 1 , further comprising:
while displaying, on the first display, the video conference user interface including video conference content, displaying the respective content on a second display in communication with the first electronic device.

14. The method of claim 1 , further comprising:
prior to receiving the request to share the respective content with the user of the second electronic device, displaying the respective content on the first display, wherein the request to share the respective content is received while displaying the respective content on the first display,
wherein initiating the display of the video conference user interface on the first display and initiating the sharing of the respective content with the user of the second electronic device comprises:
ceasing the di

Assignees

• Apple Inc

Inventors

• Hulbert Thomas Steven
• Cordier Madeleine
• Kim Seung Wook
• Lamberson Brigit E
• Roper Gemma
• Mccarthy Max L L
• Silvanto Mikael

Classifications

• G06F3/1423 Primary

  controlling a plurality of local displays, e.g. CRT and flat panel display · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/0485

  Scrolling or panning · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title