Generating virtual objects from embedded code

Patent metadata

Field	Value
Publication number	US-12430813-B2
Application number	US-202318109517-A
Country	US
Kind code	B2
Filing date	Feb 14, 2023
Priority date	Feb 14, 2023
Publication date	Sep 30, 2025
Grant date	Sep 30, 2025

Abstract

In implementation of techniques for generating virtual objects from embedded code, a computing device implements an embedded code system to detect an embedded code included in a physical object depicted in a frame of a digital video displayed in a user interface. The physical object includes visual features, and the embedded code is not visible relative to the visual features. The embedded code system determines a virtual object property based on the embedded code. A virtual object is generated for display relative to the visual features of the physical object in the user interface based on the virtual object property.

First claim

What is claimed is:

1. A method comprising:
detecting, by a processing device, an embedded code included on a physical object depicted in a frame of a digital video displayed in a user interface of a display device, the embedded code not visible relative to visual features of the physical object;
decoding, by the processing device, information from the embedded code including an embedded image and information specifying coordinates relative to a boundary of the physical object for displaying the embedded image;
determining, by the processing device, a location in the frame of the digital video corresponding to the coordinates relative to the boundary of the physical object for displaying the embedded image; and
generating, by the processing device, the embedded image for display at the location in the frame of the digital video displayed in the user interface based on the information from the embedded code.

2. The method of claim 1 , wherein the embedded code includes characters printed on the physical object using an infrared light absorbing ink.

3. The method of claim 1 , wherein the embedded code is detected by capturing the frame of the digital video using an infrared camera.

4. The method of claim 1 , wherein the embedded image is generated based on user information of a user that is associated with the processing device.

5. The method of claim 4 , wherein the user information includes a language of the user that is associated with the processing device.

6. The method of claim 4 , wherein the user information includes information based on a user input specified by the user.

7. The method of claim 1 , further comprising determining the boundary of the physical object using a machine learning model.

8. The method of claim 1 , wherein the information from the embedded code specifies an area of the physical object.

9. The method of claim 1 , wherein the user interface is a user interface of at least one of augmented reality goggles or a virtual reality headset.

10. The method of claim 1 , wherein the embedded image includes text displayed at the location in the frame of the digital video based on the information from the embedded code.

11. A system comprising:
a memory component; and
a processing device coupled to the memory component, the processing device to perform operations comprising:
detecting a physical object depicted in a digital image displayed in a user interface of a display device, the physical object having visual features;
detecting an embedded code included on the physical object, the embedded code not visible relative to the visual features;
decoding information from the embedded code including an embedded image and information specifying coordinates relative to a boundary of the physical object for displaying the embedded image;
determining a location in the digital image corresponding to the coordinates relative to the boundary of the physical object for displaying the embedded image; and
generating the embedded image for display at the location in the digital image, relative to the visual features and the boundary of the physical object in the user interface based on the information from the embedded code.

12. The system of claim 11 , wherein the boundary of the physical object is determined using a machine learning model.

13. The system of claim 11 , wherein the embedded image includes a visual property based on the information from the embedded code.

14. The system of claim 11 , wherein the information from the embedded code specifies an area of the physical object.

15. The system of claim 11 , wherein the embedded image is generated based on user information of a user that is associated with the processing device.

16. The system of claim 11 , wherein the embedded code is detected by capturing the digital image using an infrared camera.

17. A non-transitory computer-readable storage medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
detecting an embedded code included on a physical object depicted in a frame of a digital video displayed in a user interface of a display device, the embedded code not visible relative to visual features of the physical object;
decoding information from the embedded code including an embedded image and information specifying coordinates relative to a boundary of the physical object for displaying the embedded image;
determining a location in the frame of the digital video corresponding to the coordinates relative to the boundary of the physical object for displaying the embedded image; and
generating the embedded image for at the location in the frame of the digital video displayed in the user interface based on the information from the embedded code.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the embedded image is generated based on user information of a user that is associated with the processing device.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the boundary of the physical object is determined using a machine learning model.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the information from the embedded code specifies an area of the physical object.

Assignees

• Adobe Inc

Inventors

• Siu Alexa Fay
• Sun Tong
• Dogan Mustafa Doga
• Healey Jennifer Anne
• Wigington Curtis Michael

Classifications

• G06K7/1417

  2D bar codes · CPC title

• G09F3/02

  Forms or constructions (layered products B32B) · CPC title

• G06K19/06

  characterised by the kind of the digital marking, e.g. shape, nature, code · CPC title

• G02B2027/0141

  characterised by the informative content of the display · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title