Matching content to a spatial 3d environment

Patent metadata

Field	Value
Publication number	US-2024096038-A1
Application number	US-202318523763-A
Country	US
Kind code	A1
Filing date	Nov 29, 2023
Priority date	May 1, 2017
Publication date	Mar 21, 2024
Grant date	—

Abstract

Systems and methods for matching content elements to surfaces in a spatially organized 3D environment. The method includes receiving content, identifying one or more elements in the content, determining one or more surfaces, matching the one or more elements to the one or more surfaces, and displaying the one or more elements as virtual content onto the one or more surfaces.

First claim

What is claimed is:

1 . A method, comprising:
identifying a content element within content; extracting a tag from the content element; identifying a surface for the content element based on the tag; and storing the identified content element and the identified surface.

2 . The method of claim 1 , further comprising identifying an attribute of the content element.

3 . The method of claim 2 , wherein the tag pertains to placement of the content element.

4 . The method of claim 3 , further comprising identifying the attribute from the tag.

5 . The method of claim 2 , wherein the attribute pertains to placement of the content element.

6 . The method of claim 5 , wherein the attribute pertains to where and how to display the content element.

7 . The method of claim 2 , wherein identifying the attribute comprises inferring the attribute.

8 . The method of claim 7 , wherein inferring the attributing is based on placement of the content element within the content.

9 . The method of claim 1 , wherein the tag is a formatting tag.

10 . The method of claim 1 , further comprising identifying an alternative display form of the content element.

11 . The method of claim 10 , wherein identifying the alternative display forms of the content element comprises identifying a formatting rule for the content element and a device.

12 . The method of claim 11 , wherein the formatting rule relates to an image on a web page.

13 . The method of claim 1 , further comprising storing the identified content element and the identified surface in a non-transitory storage medium.

14 . The method of claim 1 , further comprising accessing the stored identified content element and the identified surface.

15 . The method of claim 14 , further comprising using the stored identified content element and the identified surface in a compositing process to match the content element to the surface.

16 . The method of claim 1 , further comprising storing the identified content element and the identified surface in a transitory storage medium.

17 . The method of claim 1 , further comprising:
analyzing the tag; and searching a logical structure including the identified surface based at least in part on the tag.

18 . The method of claim 1 , further comprising identifying the surface for the content element based on the tag by running a best fit algorithm on the content element based on the tag

19 . The method of claim 18 , wherein running the best fit algorithm on the content element based on the tag comprises:
extracting a view from the tag; and identifying a position of the identified surface corresponding to the view extracted from the tag.

20 . The method of claim 1 , further comprising identifying the surface for the content element based on the tag by matching the content element to the identified surface using a matching score.

Assignees

• Magic Leap Inc

Inventors

• Bastov Denys
• Ng-Thow-Hing Victor
• Reinhardt Benjamin Zaaron
• ZOLOTAREV Leonid
• Pellet Yannick
• Marchenko Aleksei
• Meaney Brian Everett
• Shelton Marc Coleman
• Geiman Megan Ann
• Gotcher John A
• Bogue Matthew Schon
• Balasubramanyam Shivakumar
• Ruediger Jeffrey Edward
• Lundmark David Charles

Classifications

• G02B30/00

  Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images (in microscopes G02B21/22) · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title