Systems and Methods for Creating, Updating, And Sharing Novel File Structures for Persistent 3D Object Model Markup Information

Patent metadata

Field	Value
Publication number	US-2024394967-A1
Application number	US-202218694574-A
Country	US
Kind code	A1
Filing date	Sep 21, 2022
Priority date	Sep 24, 2021
Publication date	Nov 28, 2024
Grant date	—

Abstract

Techniques are disclosed for rendering graphical content, e.g., in an extended reality (XR) environment, that provide for a creator (or recipient) of a 3D object markup file, e.g., a user operating an electronic device configured to be aware of the structure and organization of the 3D object markup file's format, to: create a 3D object markup file; reproduce a 3D object for display, along with its corresponding markup information; toggle the markup information on or off for display; and/or make further updates to such markup information with complete reproduction fidelity and accuracy. Techniques herein also provide for the sharing of 3D object markup files (including any persistent markup information) with other users, e.g., asynchronously or in real-time, allowing for collaboration in the process of marking up virtual 3D objects. The 3D object markup file may also be exported, such that the markups are no longer editable or toggleable for display.

First claim

1 . A three-dimensional (3D) object graphical markup method, comprising:
obtaining, at a first device, a 3D object file specifying a 3D object; displaying, at the first device, the 3D object; receiving, from a user of the first device, an indication of a first markup at a first location corresponding to the 3D object; displaying, at the first device, the first markup at the first location corresponding to the 3D object; creating, at the first device, a 3D object markup file, wherein the 3D object markup file comprises a 3D object information portion and a markup information portion, wherein the 3D object information portion comprises information from the 3D object file specifying the 3D object, and wherein the markup information portion comprises information specifying one or more characteristics of the first markup and the first location.

2 . The method of claim 1 , wherein the 3D object markup file comprises a hierarchical file structure, and wherein the 3D object information is stored under a 3D object information node within the hierarchical file structure, and wherein the markup information is stored under a markup information node within the hierarchical file structure.

3 . The method of claim 2 , wherein the markup information portion further comprises a first group of strokes stored as a node under the markup information node in the 3D object markup file.

4 . The method of claim 3 , wherein the first group of strokes comprises two or more individual strokes, wherein each of the two or more individual strokes are stored as nodes under the first group of strokes node in the 3D object markup file.

5 . The method of claim 1 , further comprising:
receiving, from the user of the first device, an indication to toggle on or off the display of one or more markups specified by the markup information portion.

6 . The method of claim 1 , wherein the markup information portion comprises information encoding: one or more direct marks; and one or more indirect marks.

7 . The method of claim 6 , wherein the one or more direct marks are rendered to display with at least one different characteristic than the one or more indirect marks.

8 . The method of claim 1 , wherein the markup information portion further comprises metadata related to one or more of the markups corresponding to the 3D object.

9 . The method of claim 8 , wherein the metadata comprises one or more of the following:
stroke shape, stroke thickness, stroke material, stroke style, line caps, or point thickness.

10 . The method of claim 1 , wherein the markup information further comprises information specifying one or more markups corresponding to the 3D object, and wherein each of the one or more markups comprises information specifying its location relative to a point on the 3D object.

11 . The method of claim 1 , further comprising:
exporting the 3D object information portion and the markup information portion of the 3D object markup file to a second digital content creation (DCC)-compatible file format, wherein, once exported, the markup information will be viewable but no longer editable in the second DCC-compatible file format.

12 . The method of claim 1 , further comprising:
exporting, at a predetermined or specified time, only the markup information portion of the 3D object markup file to a second file; and transmitting the second file to a third party or a network location.

13 . The method of claim 12 , further comprising:
exporting, at a predetermined or specified time, only the 3D object information portion of the 3D object markup file to a third file; and transmitting the third file to a third party or a network location.

14 . The method of claim 1 , further comprising:
exporting, in response to an update to the markup information portion of the 3D object markup file, only the markup information portion of the 3D object markup file to a second file; and transmitting, in response to the exporting of the second file, the second file to a third party or a network location.

15 . The method of claim 14 , further comprising:
exporting, in response to an update to the 3D object information portion of the 3D object markup file, only the 3D object information portion of the 3D object markup file to a third file; and transmitting, in response to the exporting of the third file, the third file to a third party or a network location.

16 . The method of claim 1 , further comprising:
receiving, from the user of the first device, an indication of a second markup at a second location corresponding to the 3D object; displaying, at the first device, the second markup at the second location corresponding to the 3D object; and updating the markup information portion of the 3D object markup file based, at least in part, on one or more characteristics of the second markup and the second location.

17 . A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
obtain, at a first device, a 3D object file specifying a 3D object; display, at the first device, the 3D object; receive, from a user of the first device, an indication of a first markup at a first location corresponding to the 3D object; display, at the first device, the first markup at the first location corresponding to the 3D object; create, at the first device, a 3D object markup file, wherein the 3D object markup file comprises a 3D object information portion and a markup information portion, wherein the 3D object information portion comprises information from the 3D object file specifying the 3D object, and wherein the markup information portion comprises information specifying one or more characteristics of the first markup and the first location.

18 . The non-transitory computer readable medium of claim 17 , further comprising computer readable code executable by the one or more processors to:
receive, from the user of the first device, an indication of a second markup at a second location corresponding to the 3D object; display, at the first device, the second markup at the second location corresponding to the 3D object; and update the markup information portion of the 3D object markup file based, at least in part, on one or more characteristics of the second markup and the second location.

19 . A system, comprising:
a display device; one or more processors; and one or more non-transitory computer readable media comprising computer readable code executable by the one of more processors to:
obtain a 3D object file specifying a 3D object;
display the 3D object on the display device;
receive, from a user, an indication of a first markup at a first location corresponding to the 3D object;
display, on the display device, the first markup at the first location corresponding to the 3D object;
create a 3D object markup file, wherein the 3D object markup file comprises a 3D object information portion and a markup information portion,
wherein the 3D object information portion comprises information from the 3D object file specifying the 3D object, and
wherein the markup information portion comprises information specifying one or more characteristics of the first markup and the first location.

20 . The system of claim 19 , wherein the 3D object markup file comprises a hierarchical file structure, and wherein the 3D object information is stored under a 3D object information node within the hierarchical file structure, and wherein the markup information is stored under a mar

Assignees

• Apple Inc

Inventors

• Schattel David M
• Yoganandan Arun Rakesh
• Nolet Christopher L
• Lui David
• Abbasian Reza

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T17/005

  Tree description, e.g. octree, quadtree · CPC title

• G06T2210/32

  Image data format · CPC title

• G06T2219/004

  Annotating, labelling · CPC title

• G06T17/00 Primary

  Three-dimensional [3D] modelling for computer graphics · CPC title