Method and devices for presenting and manipulating conditionally dependent synthesized reality content threads

Patent metadata

Field	Value
Publication number	US-12412348-B2
Application number	US-202418679836-A
Country	US
Kind code	B2
Filing date	May 31, 2024
Priority date	Feb 19, 2018
Publication date	Sep 9, 2025
Grant date	Sep 9, 2025

Abstract

In one implementation, a method includes presenting, via a display device, a first synthesized reality (SR) view of an event that includes SR content associated with the event. The SR content includes a plurality of related layers of SR content that perform actions associated with the event. The method includes detecting, via one or more input devices, selection of a respective layer among the plurality of related layers of SR content associated with the event. The method includes presenting, via the display device, a second SR view of the event that includes the respective layer of SR content in response to the selection of the respective layer. The second SR view corresponds to a point-of-view of the respective layer.

First claim

What is claimed is:

1. A method comprising:
at a computing system including non-transitory memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices coupled with the non-transitory memory:
presenting, via the display device, a first synthesized reality (SR) view of a segment of an event that includes SR content associated with the event, wherein the SR content includes a plurality of related layers of SR content that perform actions associated with the segment of the event, wherein the plurality of related layers is concurrently played out whether they are presented or not;
detecting, via the one or more input devices during presentation of the first SR view, selection of a respective layer among the plurality of related layers of SR content associated with the segment of the event; and
presenting, via the display device, a second SR view of the segment of the event that includes the respective layer of SR content in response to the selection of the respective layer, wherein the second SR view corresponds to a point-of-view of the respective layer.

2. The method of claim 1 , wherein the first SR view corresponds to an omniscient third-person view of the segment of the event, and the second SR view corresponds to a first-person view of a specific element within the segment of the event.

3. The method of claim 1 , further comprising:
while presenting the first SR view of the segment of the event, receiving a user input to modify perspective of the first SR view; and
in response to receiving the user input, modifying the perspective of the first SR view of the segment of the event based on the user input.

4. The method of claim 3 , wherein modifying the perspective of the first SR view of the segment of the event includes panning around the SR content associated with the first SR view of the segment of the event based on the user input.

5. The method of claim 3 , wherein modifying the perspective of the first SR view of the segment of the event includes zooming in or out the SR content associated with the first SR view of the segment of the event based on the user input.

6. The method of claim 1 , further comprising:
while presenting the second SR view of the segment of the event, receiving a user input to control an element associated with the respective layer; and
in response to receiving the user input, controlling the element associated with the respective layer based on the user input.

7. The method of claim 1 , further comprising:
while presenting the first SR view of the segment of the event, receiving a user input to remove one or more layers from the SR content; and
in response to receiving the user input, removing the one or more layers from the SR content while maintaining display of the first SR view of the segment of the event.

8. The method of claim 1 , further comprising:
while presenting the first SR view of the segment of the event, receiving a user input to add one or more layers from the SR content; and
in response to receiving the user input, adding the one or more layers from the SR content while maintaining display of the first SR view of the segment of the event.

9. The method of claim 1 , further comprising:
while presenting the first SR view of the segment of the event, receiving a user input to modify environmental conditions associated with the segment of the event; and
in response to receiving the user input, modifying the environmental conditions associated with the segment of the event while maintaining display of the first SR view of the segment of the event.

10. The method of claim 1 , further comprising:
while presenting the first SR view of the segment of the event, receiving a user input to modify terrain associated with the segment of the event; and
in response to receiving the user input, modifying the terrain associated with the segment of the event while maintaining display of the first SR view of the segment of the event.

11. A computing system comprising:
one or more processors;
a non-transitory memory;
an interface for communicating with a display device and one or more input devices; and
one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the computing system to:
present, via the display device, a first synthesized reality (SR) view of a segment of an event that includes SR content associated with the segment of the event, wherein the SR content includes a plurality of related layers of SR content that perform actions associated with the segment of the event, wherein the plurality of related layers is concurrently played out whether they are presented or not;
detect, via the one or more input devices during presentation of the first SR view, selection of a respective layer among the plurality of related layers of SR content associated with the segment of the event; and
present, via the display device, a second SR view of the segment of the event that includes the respective layer of SR content in response to the selection of the respective layer, wherein the second SR view corresponds to a point-of-view of the respective layer.

12. The computing system of claim 11 , wherein the first SR view corresponds to an omniscient third-person view of the segment of the event, and the second SR view corresponds to a first-person view of a specific element within the segment of the event.

13. The computing system of claim 11 , wherein the one or more programs further cause the computing system to:
while presenting the first SR view of the segment of the event, receive a user input to modify perspective of the first SR view; and
in response to receiving the user input, modify the perspective of the first SR view of the segment of the event based on the user input.

14. The computing system of claim 13 , wherein modifying the perspective of the first SR view of the segment of the event includes panning around the SR content associated with the first SR view of the segment of the event based on the user input.

15. The computing system of claim 13 , wherein modifying the perspective of the first SR view of the segment of the event includes zooming in or out the SR content associated with the first SR view of the segment of the event based on the user input.

16. The computing system of claim 11 , wherein the one or more programs further cause the computing system to:
while presenting the second SR view of the segment of the event, receive a user input to control an element associated with the respective layer; and
in response to receiving the user input, control the element associated with the respective layer based on the user input.

17. The computing system of claim 11 , wherein the one or more programs further cause the computing system to:
while presenting the first SR view of the segment of the event, receive a user input to remove one or more layers from the SR content; and
in response to receiving the user input, remove the one or more layers from the SR content while maintaining display of the first SR view of the segment of the event.

18. The computing system of claim 11 , wherein the one or more programs further cause the computing system to:
while presenting the first SR view of the segment of the event, receive a user input to add one or more layers from the SR content; and
in response to receiving the user input, add the one or more layers from the SR content while maintaining display of the first SR view of the segment of the event.

Assignees

• Apple Inc

Inventors

• Richter Ian M
• Rockwell Michael J
• Saini Amritpal Singh
• Soares Olivier

Classifications

• G06N3/09

  Supervised learning · CPC title

• G06N3/092

  Reinforcement learning · CPC title

• G06N3/0442

  characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] · CPC title

• G06N3/08

  Learning methods · CPC title

• G06N3/04

  Architecture, e.g. interconnection topology · CPC title