Triggering presentation of an object based on saliency

Patent metadata

Field	Value
Publication number	US-12340554-B1
Application number	US-202217709987-A
Country	US
Kind code	B1
Filing date	Mar 31, 2022
Priority date	Apr 16, 2021
Publication date	Jun 24, 2025
Grant date	Jun 24, 2025

Abstract

In some implementations, a device includes one or more processors and a non-transitory memory. In some implementations, a method includes obtaining an object that includes a plurality of portions including a first portion and a second portion. In some implementations, the method includes determining a first saliency value for the first portion of the object and a second saliency value for the second portion of the object. In some implementations, the method includes triggering presentation of the first portion of the object in accordance with a first display characteristic that is based on the first saliency value and the second portion of the object in accordance with a second display characteristic that is based on the second saliency value.

First claim

What is claimed is:

1. A method comprising:
at a device including one or more processors and a non-transitory memory:
receiving a first user input directed to an object generation environment;
in response to receiving the first user input, generating an object that includes a plurality of portions including a first portion and a second portion;
determining a first saliency value for the first portion of the object and a second saliency value for the second portion of the object;
generating, based on the first and second saliency values, an extended reality (XR) environment object that represents the object, wherein the XR environment object includes a first portion associated with the first portion of the object, and wherein the XR environment object includes a second portion associated with the second portion of the object; and
triggering presentation, within an XR environment, of the first portion of the XR environment object in accordance with a first display characteristic that is based on the first saliency value and the second portion of the XR environment object in accordance with a second display characteristic that is based on the second saliency value.

2. The method of claim 1 , wherein determining the first saliency value comprises determining the first saliency value based on a first characteristic value associated with the first portion of the object; and
wherein determining the second saliency value comprises determining the second saliency value based on a second characteristic value associated with the second portion of the object.

3. The method of claim 1 , wherein the first saliency value is a function of a first amount of resources associated with the first portion of the object and the second saliency value is a function of a second amount of resources associated with the second portion of the object.

4. The method of claim 1 , wherein the first saliency value is a function of a first amount of time associated with generating the first portion of the object and the second saliency value is a function of a second amount of time associated with generating the second portion of the object.

5. The method of claim 1 , wherein the first saliency value is a function of a first amount of computational resources associated with generating the first portion of the object and the second saliency value is a function of a second amount of computational resources associated with generating the second portion of the object.

6. The method of claim 1 , wherein the first saliency value is a function of a first amount of computational resources associated with presenting the first portion of the object and the second saliency value is a function of a second amount of computational resources associated with presenting the second portion of the object.

7. The method of claim 1 , wherein the first saliency value is a function of a first number of polygons in a first portion of a texture map that corresponds to the first portion of the object and the second saliency value is a function of a second number of polygons in a second portion of the texture map that corresponds to the second portion of the object.

8. The method of claim 1 , wherein the first saliency value is a function of a first level of interaction with the first portion of the object and the second saliency value is a function of a second level of interaction with the second portion of the object.

9. The method of claim 1 , wherein the first saliency value is a function of a first number of revisions made to the first portion of the object and the second saliency value is a function of a second number of revisions made to the second portion of the object.

10. The method of claim 1 , wherein the first saliency value is a function of a first gaze duration associated with the first portion of the object and the second saliency value is a function of a second gaze duration associated with the second portion of the object.

11. The method of claim 1 , wherein the first saliency value is a function of a first level of detail associated with the first portion of the object and the second saliency value is a function of a second level of detail associated with the second portion of the object.

12. The method of claim 1 , wherein the first saliency value is a function of a first number of colors associated with the first portion of the object and the second saliency value is a function of a second number of colors associated with the second portion of the object.

13. The method of claim 1 , wherein the first saliency value is a function of a first resolution associated with the first portion of the object and the second saliency value is a function of a second resolution associated with the second portion of the object.

14. The method of claim 1 , wherein the first saliency value is a function of a first amount of movement that the first portion of object is capable of performing and the second saliency value is a function of a second amount of movement that the second portion of the object is capable of performing.

15. The method of claim 1 , wherein determining the first saliency value and the second saliency value comprises obtaining a user input indicative of the first saliency value or the second saliency value.

16. The method of claim 1 , wherein triggering the presentation comprises associating the object with a saliency map that indicates the first saliency value for the first portion of the object and the second saliency value for the second portion of the object.

17. The method of claim 16 , wherein the object includes a plurality of pixels; and
wherein the saliency map includes respective pixel characterization vectors for the plurality of pixels, each pixel characterization vector including a saliency value for a corresponding one of the plurality of pixels.

18. The method of claim 1 , wherein triggering the presentation comprises:
triggering display of the first portion of the object with a first pixel density that is a function of the first saliency value; and
triggering display of the second portion of the object with a second pixel density that is a function of the second saliency value.

19. A device comprising:
one or more processors;
a non-transitory memory; and
one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:
receive a first user input directed to an object generation environment;
in response to receiving the first user input, generate obtain an object that includes a plurality of portions including a first portion and a second portion;
determine a first saliency value for the first portion of the object and a second saliency value for the second portion of the object;
generate, based on the first and second saliency values, an extended reality (XR) environment object that represents the object, wherein the XR environment object includes a first portion associated with the first portion of the object, and wherein the XR environment object includes a second portion associated with the second portion of the object; and
trigger presentation, within an XR environment, of the first portion of the XR environment object in accordance with a first display characteristic that is based on the first saliency value and the second portion of the XR environment object in accordance with a second display characteristic that is based on the second saliency value.

20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of

Assignees

• Apple Inc

Inventors

• Jotwani Payal
• Feng Dan
• MORGAN Bo
• Sivapurapu Siva Chandra Mouli
• Qiao Mu
• Mahasseni Behrooz
• Drummond Mark E

Classifications

• G06V10/235

  based on user input or interaction · CPC title

• G06V10/462 Primary

  Salient features, e.g. scale invariant feature transforms [SIFT] · CPC title