User interfaces for managing visual content in media

Patent metadata

Field	Value
Publication number	US-12200342-B2
Application number	US-202117484856-A
Country	US
Kind code	B2
Filing date	Sep 24, 2021
Priority date	Apr 19, 2021
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

The present disclosure generally relates to methods and user interfaces for managing visual content at a computer system. In some embodiments, methods and user interfaces for managing visual content in media are described. In some embodiments, methods and user interfaces for managing visual indicators for visual content in media are described. In some embodiments, methods and user interfaces for inserting visual content in media are described. In some embodiments, methods and user interfaces for identifying visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described.

First claim

What is claimed is:

1. A computer system configured to communicate with one or more cameras, one or more input devices, and a display generation component, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying a first user interface that includes a text entry region;
while displaying the first user interface that includes the text entry region, detecting a request to display a camera user interface;
in response to detecting the request to display the camera user interface while displaying the first user interface that includes the text entry region, displaying, via the display generation component, a camera user interface that includes:
a representation of a field-of-view of the one or more cameras; and
in accordance with a determination that the representation of the field-of-view of the one or more cameras includes detected text that satisfies one or more criteria, displaying a text insertion user interface object that is selectable to insert at least a portion of the detected text into the text entry region, wherein the detected text includes a plurality of text characters that are visible in the field-of-view of the one or more cameras;

while concurrently displaying the text entry region of the first user interface, the camera user interface that includes the representation of the field-of-view, the detected text that satisfies the one or more criteria, and the text insertion user interface object, detecting, via the one or more input devices, an input corresponding to selection of the text insertion user interface object; and
in response to detecting the input corresponding to selection of the text insertion user interface object that is selectable to insert at least the portion of the detected text into the text entry region of the first user interface and that was displayed in response to detecting the request to display the camera user interface while displaying the first user interface that includes the text entry region, inserting at least a portion of the detected text from the representation of the field of view into the text entry region of the first user interface that was displayed concurrently with the portion of the detected text includes the plurality of text characters that are visible in the field-of-view of the one or more cameras.

2. The computer system of claim 1 , wherein displaying the camera user interface in response to detecting the request to display the camera user interface includes:
in accordance with a determination that the representation of the field-of-view of the one or more cameras does not include detected text that satisfies one or more criteria, forgoing displaying the text insertion user interface object.

3. The computer system of claim 1 , wherein displaying the camera user interface in response to detecting the request to display the camera user interface includes:
in accordance with a determination that the representation of the field-of-view of the one or more cameras includes detected text that satisfies one or more criteria and that the representation of the field-of-view of the one or more cameras does not include detected text that satisfies one or more criteria, displaying the text insertion user interface object, wherein the text insertion user interface object is not selectable.

4. The computer system of claim 3 , wherein displaying the camera user interface in response to detecting the request to display the camera user interface includes:
in accordance with a determination that the text insertion user interface object is not selectable, displaying the text insertion user interface object with a visual appearance that indicates that text insertion user interface object is disabled.

5. The computer system of claim 1 , wherein the camera user interface is not displayed before the request to display the camera user interface is detected.

6. The computer system of claim 1 , wherein the first user interface includes an input entry user interface element, the input entry user interface element including a first user interface object that is displayed at a location in the input entry user interface element.

7. The computer system of claim 1 , wherein the one or more programs further include instructions for:
while displaying the first user interface that includes the text entry region and before detecting the request to display the camera user interface, detecting, via the one or more input devices, an input directed to the text entry region; and
in response to detecting the input directed to the text entry region, displaying, via the display generation component, a first user interface object.

8. The computer system of claim 7 , wherein a second user interface object that, when selected, causes the computer system to display copied text is concurrently displayed with the first user interface object.

9. The computer system of claim 1 , wherein:
before detecting the request to display the camera user interface, the first user interface includes a keyboard that is displayed at a first location in the first user interface; and
displaying the camera user interface includes replacing display of the keyboard at the first location with the display of the camera user interface at the first location.

10. The computer system of claim 1 , wherein the camera user interface is displayed at a first size, and wherein the one or more programs further include instructions for:
while displaying the camera user interface at a first size, detecting, via the one or more input devices, an input directed to the camera user interface; and
in response to detecting the input directed to the camera user interface, changing a size of the camera user interface from a first size to a second size that is different from the first size.

11. The computer system of claim 1 , wherein:
the detected text includes a first portion of text and a second portion of text; and
at least the inserted portion of the detected text:
in accordance with a determination that the saliency of the first portion of text is greater than a saliency threshold and the saliency of the second portion of text in the representation of the field-of-view of the one or more cameras is less than the saliency threshold, includes the first portion of the text and does not include the second portion of the text.

12. The computer system of claim 1 , wherein the text entry region is associated with a first type of text and the one or more criteria includes a respective criterion that is satisfied when a respective portion of the detected text is detected to be the first type of text.

13. The computer system of claim 12 , wherein:
in response to detecting the input corresponding to selection of the text insertion user interface object and in accordance with a determination that the representation of the field-of-view of the one or more cameras includes detected text that satisfies one or more criteria, wherein a first portion of the detected text satisfies the respective criterion and a second portion of the detected text does not satisfy the respective criterion, the at least a portion of the detected text includes the first portion of the detected text but does not include the second portion of the detected text.

14. The computer system of claim 1 , wherein:
the text entry region is associated with a second particular type of text;
the representation of the field-of-view includes the detected text; and
wherein the one or more programs further include instructions for:
in accordance with a d

Assignees

• Apple Inc

Inventors

• De Vries Nathan
• Deselaers Thomas
• Jones James N
• Manzari Johnnie B
• Paul Grant
• Santos Ron C
• Siblini Aya
• Wang Xin
• Corey Brandon J

Classifications

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• H04N23/631

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• G06F3/04886

  by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus · CPC title