Random access of scene description in ISO base media file format (ISOBMFF) files

Patent metadata

Field	Value
Publication number	US-12530834-B2
Application number	US-202218148931-A
Country	US
Kind code	B2
Filing date	Dec 30, 2022
Priority date	Jan 11, 2022
Publication date	Jan 20, 2026
Grant date	Jan 20, 2026

Abstract

An apparatus includes a memory and a processor operably coupled to the memory. The processor is configured to identify a file track carrying scene description data. The processor is also configured to identify a subsequent sync sample in the file track after an initial sync sample. The processor is further configured to process the subsequent sync sample as a non-sync sample scene update.

First claim

What is claimed is:

1 . An apparatus comprising:
memory; and a processor operably coupled to the memory, the processor configured to:
identify a file track carrying scene description data and including a plurality of non-sync samples;
identify a subsequent sync sample in the file track after an initial sync sample, wherein the initial sync sample includes a first scene description that defines a first full status of nodes at a presentation time of the initial sync sample, wherein the subsequent sync sample includes a second scene description that defines a second full status of nodes at a presentation time of the subsequent sync sample, and wherein the second scene description included in the subsequent sync sample used to update the first scene description is not in a form of a JavaScript object notation (JSON) patch; and
update the first scene description by processing the subsequent sync sample that includes the second scene description as a non-sync sample scene update.

2 . The apparatus of claim 1 , wherein the processor is further configured to, when a currently active scene does not include a node stored in the subsequent sync sample, add the node and request new content as part of the non-sync sample scene update.

3 . The apparatus of claim 1 , wherein the processor is further configured to, when a currently active scene includes a node not stored in the subsequent sync sample, remove the node from the currently active scene.

4 . The apparatus of claim 1 , wherein the processor is further configured to, when a currently active scene includes a node that corresponds to a node stored in the subsequent sync sample, update a status of the node in the currently active scene to a status of the nodes stored in the subsequent sync sample.

5 . The apparatus of claim 1 , wherein the processor is further configured to:
identify a non-sync sample with a sample_has_redundancy flag indicating that the non-sync sample is a redundant sample; and extend a duration of a sample that occurs immediately preceding the redundant sample.

6 . The apparatus of claim 1 , wherein the second scene description included in the subsequent sync sample used to update the first scene description is in a form of a graphics language transmission format (glTF) JSON document.

7 . A method for processing files, the method comprising:
identifying a file track carrying scene description data and including a plurality of non-sync samples; identifying a subsequent sync sample in the file track after an initial sync sample, wherein the initial sync sample includes a first scene description that defines a first full status of nodes at a presentation time of the initial sync sample, wherein the subsequent sync sample includes a second scene description that defines a second full status of nodes at a presentation time of the subsequent sync sample, and wherein the second scene description included in the subsequent sync sample used to update the first scene description is not in a form of a JavaScript object notation (JSON) patch; and updating the first scene description by processing the subsequent sync sample that includes the second scene description as a non-sync sample scene update.

8 . The method of claim 7 , further comprising:
when a currently active scene does not include a node stored in the subsequent sync sample, adding the node and request new content as part of the non-sync sample scene update.

9 . The method of claim 7 , further comprising:
when a currently active scene includes a node not stored in the subsequent sync sample, removing the node from the currently active scene.

10 . The method of claim 7 , further comprising:
when a currently active scene includes a node that corresponds to a node stored in the subsequent sync sample, updating a status of the node in the currently active scene to a status of the nodes stored in the subsequent sync sample.

11 . The method of claim 7 , further comprising:
identifying a non-sync sample with a sample_has_redundancy flag indicating that the non-sync sample is a redundant sample; and extending a duration of a sample that occurs immediately preceding the redundant sample.

12 . The method of claim 7 , wherein the second scene description included in the subsequent sync sample used to update the first scene description is in a form of a graphics language transmission format (glTF) JSON document.

13 . An apparatus comprising:
memory; and a processor operably coupled to the memory, the processor configured to:
identify scene description data;
generate a subsequent sync sample for a file track after an initial sync sample wherein the initial sync sample includes a first scene description that defines a first full status of nodes at a presentation time of the initial sync sample, wherein the subsequent sync sample includes a second scene description that defines a second full status of nodes at a presentation time of the subsequent sync sample, wherein the second scene description included in the subsequent sync sample used to update the first scene description is not in a form of a JavaScript object notation (JSON) patch, and wherein the subsequent sync sample is generated as a non-sync sample scene update for updating the first scene description by processing the subsequent sync sample that includes the second scene description as a non-sync sample scene update; and
output the file track carrying the scene description data.

14 . The apparatus of claim 13 , wherein the processor is further configured to, when a node is to be added to a scene, store the node in the subsequent sync sample.

15 . The apparatus of claim 13 , wherein the processor is further configured to, when a node is to be removed from a scene, omit the node in the subsequent sync sample.

16 . The apparatus of claim 13 , wherein the processor is further configured to:
identify a non-sync sample as a redundant sample; and set a sample_has_redundancy flag to indicate that the non-sync sample is the redundant sample.

17 . The apparatus of claim 13 , wherein the second scene description included in the subsequent sync sample used to update the first scene description is in a form of a graphics language transmission format (gITF) JSON document.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lim Youngkwon

Classifications

• H04N21/816

  involving special video data, e.g 3D video · CPC title

• H04N21/43072

  of multiple content streams on the same device · CPC title

• H04N21/44012

  involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs · CPC title

• H04N21/23412

  for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects · CPC title

• H04N21/6131

  involving transmission via a mobile phone network (wireless downlink channel access H04W74/006) · CPC title