Generating customized summaries of virtual actions and events

Patent metadata

Field	Value
Publication number	US-2025061716-A1
Application number	US-202418933948-A
Country	US
Kind code	A1
Filing date	Oct 31, 2024
Priority date	Jul 21, 2022
Publication date	Feb 20, 2025
Grant date	—

Abstract

A method and system for generating a customized summary of virtual actions and events. Gameplay data sent over a communication network from a client device of the player engaged in a current activity of the respective interactive content title within a current gameplay session may be monitored. A trigger in the monitored gameplay data is detected and associated with a request for a summary that encapsulates actions and events of past gameplay associated with the trigger. A subset of the actions and events of the past gameplay for the summary is selected based on one or more selected customized tags associated with the trigger. The summary is generated based on the selected subset of the actions and events and provided to the client device for presentation.

First claim

What is claimed is:

1 . A computer-implemented method for generating customized summary of virtual actions and events, the computer-implemented method comprising:
tracking gaze data via a camera associated with a client device during a current interactive session to identify a point of focus within a stream of a three-dimensional virtual environment of a respective interactive content title towards which one or both eyes of a player are focused; identifying a period of distraction during which the point of focus is determined not to be focused within the three-dimensional virtual environment, wherein a set of events occurred within the three-dimensional virtual environment during the period of distraction; selecting a subset of events from among the set of events that occurred within the three-dimensional virtual environment during the period of distraction, wherein each of the events in the selected subset is associated with a portion of the stream; and generating customized content for the client device in accordance with the gaze data, wherein generating the customized content is based on one or more portions of the stream associated with the selected subset of events.

2 . The computer-implemented method of claim 1 , further comprising assigning one or more customized tags to one or more portions of the stream associated with the period of distraction based on the associated events meeting a threshold of significance in an identified storyline of the interactive content title, wherein selecting the subset of event is based on the customized tags.

3 . The computer-implemented method of claim 2 , wherein the threshold of significance is met by one of the events when the event is determined to have adjusted a storyline of the interactive content title.

4 . The computer-implemented method of claim 1 , wherein the customized content includes a custom flashback sequence regarding a storyline specific to a user of the client device, and wherein the customized content further includes a display regarding one or more combos or cheat codes input by the user during one of the events in the selected subset.

5 . The computer-implemented method of claim 4 , further comprising:
tracking combos that have been input by the user to implement one of the actions within the virtual environment; and generating the display including instructions for input of the combos into the client device.

6 . The computer-implemented method of claim 4 , wherein the customized content is presented during a testing period, wherein the customized content includes data regarding on previously played combos associated with the respective event.

7 . The computer-implemented method of claim 2 , further comprising:
storing one or more captured media clips associated with the customized tags; and deleting one or more other captured media clips that are not associated with the customized tags.

8 . The computer-implemented method of claim 7 , wherein the customized content includes a highlight reel based on the stored captured media clips.

9 . The computer-implemented method of claim 1 , wherein the customized content includes generated virtual effects indicators correlated with directional sounds during the period of distraction.

10 . The computer-implemented method of claim 1 , wherein the customized content includes an overlay that superimposes a ghost version of a previous interactive session over a display of the current interactive session.

11 . The computer-implemented method of claim 1 , wherein generating the customized content includes restoring a status or setting from a previous interactive session of a user of the client device.

12 . The computer-implemented method of claim 1 , further comprising detecting a trigger during the current interactive session, wherein detecting the trigger is based on the player not moving for a period of time that passes a threshold limit, and wherein selecting the subset of events is responsive to the detected trigger.

13 . A system for generating a customized summary of virtual actions and events, the system comprising:
a communication interface that communicates with a client device over a communication network, wherein the communication interface receives gaze data captured via a camera associated with the client device during a current interactive session to identify a point of focus within a stream of a three-dimensional virtual environment of a respective interactive content title towards which one or both eyes of a player are focused; memory that tracks the received gaze data; and one or more processors that execute instructions stored in memory, wherein the processors execute the instructions to:
identifying a period of distraction during which the point of focus is determined not to be focused within the three-dimensional virtual environment, wherein a set of events occurred within the three-dimensional virtual environment during the period of distraction,
select a subset of events from among the set of events that occurred within the three-dimensional virtual environment during the period of distraction, wherein each of the events in the selected subset is associated with a portion of the stream, and
generate customized content for the client device in accordance with the gaze data, wherein generating the customized content is based on one or more portions of the stream associated with the selected subset of events.

14 . The system of claim 13 , wherein the processors execute further instructions to assign one or more customized tags to one or more portions of the stream associated with the period of distraction based on the associated events meeting a threshold of significance in an identified storyline of the interactive content title, wherein selecting the subset of event is based on the customized tags.

15 . The system of claim 14 , wherein the threshold of significance is met by one of the events when the event is determined to have adjusted a storyline of the interactive content title.

16 . The system of claim 13 , wherein the customized content includes a custom flashback sequence regarding a storyline specific to a user of the client device, and wherein the customized content further includes a display regarding one or more combos or cheat codes input by the user during one of the events in the selected subset.

17 . The system of claim 16 , wherein the processors execute further instructions to:
track combos that have been used and associated objects; and generate instructions regarding entry of the combos into the client device.

18 . The system of claim 16 , wherein the customized content is presented during a testing period, wherein the customized content includes data regarding on previously played combos associated with the respective event.

19 . The system of claim 14 , wherein the memory further:
stores one or more captured media clips associated with the customized tags; and deletes one or more other captured media clips that are not associated with the customized tags.

20 . The system of claim 19 , wherein the customized content includes a highlight reel based on the stored captured media clips.

21 . The system of claim 13 , wherein the customized content includes generated virtual effects indicators correlated with directional sounds during the period of distraction.

22 . The system of claim 13 , wherein the customized content includes an overlay that superimposes a ghost version of a previo

Assignees

• Sony Interactive Entertainment LLC
• Sony Interactive Entertainment Inc

Inventors

• Bartolome Angela
• Dan Supriti
• Luluquisin Genie-Rose
• Patel Benaisha
• Bean Celeste

Classifications

• A63F13/85

  Providing additional services to players · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• A63F13/53

  involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game · CPC title

• A63F13/533

  for prompting the player, e.g. by displaying a game menu · CPC title

• A63F13/86

  Watching games played by other players · CPC title