Systems and methods for facilitating display of augmented reality content

Patent metadata

Field	Value
Publication number	US-11270522-B1
Application number	US-202017008042-A
Country	US
Kind code	B1
Filing date	Aug 31, 2020
Priority date	Aug 31, 2020
Publication date	Mar 8, 2022
Grant date	Mar 8, 2022

Abstract

An exemplary method includes an augmented reality system acquiring an image of an event from a viewpoint of a camera of a computing device in proximity to the event, the event including a performance area; identifying at least part of the performance area of the event within the image of the event; determining a three-dimensional (3D) pose of the performance area of the event within the image of the event; and providing, for concurrent display by a display device of the computing device, the image of the event and augmented reality content that is oriented according to the 3D pose of the performance area of the event within the image of the event.

First claim

What is claimed is:

1. A method comprising:
acquiring, by an augmented reality system, an image of an event from a viewpoint of a camera of a computing device in proximity to the event, the event including a performance area;
identifying, by the augmented reality system, at least part of the performance area of the event within the image of the event;
determining, by the augmented reality system, a three-dimensional (3D) pose of the performance area of the event within the image of the event;
determining, by the augmented reality system and based on the 3D pose of the performance area, an anchor vector that is perpendicular to the performance area; and
providing, by the augmented reality system for concurrent display by a display device of the computing device, the image of the event and augmented reality content that is oriented with respect to the anchor vector and according to the 3D pose of the performance area of the event within the image of the event.

2. The method of claim 1 , wherein the identifying of the at least part of the performance area includes determining an outer contour shape of the performance area of the event within the image of the event.

3. The method of claim 2 , wherein:
the identifying of the at least part of the performance area further includes determining, based on the outer contour shape, that the performance area of the event is completely viewable within the image of the event; and
the determining of the 3D pose of the performance area of the event is based on the outer contour shape indicating that the performance area is completely viewable within the image of the event.

4. The method of claim 2 , wherein:
the identifying of the at least part of the performance area further includes:
determining, based on the outer contour shape, a location where the performance area crosses a border of the image of the event; and
determining a location of a corner of the performance area based on the location where the outer contour shape of the performance area crosses the border of the image; and

the determining of the 3D pose of the performance area of the event is based on the outer contour shape and the location of the corner of the performance area.

5. The method of claim 2 , wherein:
the identifying of the at least part of the performance area further includes determining, based on the outer contour shape of the performance area, that each corner of the performance area of the event is outside of the image of the event; and
the augmented reality content is provided for display with the image of the event based on known dimensions of the performance area of the event.

6. The method of claim 2 , wherein the identifying of the at least part of the performance area further includes:
comparing the outer contour shape of the performance area of the event to a plurality of known outer contour shapes of the performance area of the event; and
determining that the outer contour shape corresponds to a known outer contour shape from the plurality of known outer contour shapes when a degree of similarity between the outer contour shape and the known outer contour shape satisfies a predefined threshold.

7. The method of claim 1 , wherein:
the determining of the 3D pose of the performance area of the event includes determining that a first 3D pose and a second 3D pose included in a plurality of 3D poses are candidates for being determined as the 3D pose of the performance area of the event;
the determining of the anchor vector includes determining a first anchor vector for the first 3D pose and a second anchor vector for the second 3D pose, the first anchor vector being perpendicular to a surface of the performance area represented in the first 3D pose and the second anchor vector being perpendicular to a surface of the performance area represented in the second 3D pose; and
the determining of the 3D pose of the performance area of the event further includes selecting the first 3D pose as the 3D pose of the performance area of the event based on the first anchor vector being relatively more vertical than the second anchor vector when positioned within the image of the event.

8. The method of claim 7 , wherein the augmented reality content is oriented with respect to the first anchor vector.

9. The method of claim 8 , wherein the first anchor vector is provided at a center of the performance area of the event within the image of the event.

10. The method of claim 1 , wherein an orientation of the augmented reality content is fixed in relation to the performance area of the event regardless of a change in viewing angle of the camera of the computing device.

11. The method of claim 1 , further comprising determining, by the augmented reality system, a center of the performance area within the image of the event,
wherein the providing of the image and the augmented reality content for concurrent display includes providing the augmented reality content at the center of the performance area within the image of the event.

12. The method of claim 1 , wherein the augmented reality content is associated with one or more participants in the event.

13. A method comprising:
acquiring, by an augmented reality system, an image of an event from a viewpoint of a camera of a computing device in proximity to the event, the event including a performance area;
determining, by the augmented reality system, a region included in the image of the event that represents the performance area of the event;
determining, by the augmented reality system based on the region in the image of the event that represents a performance area, an outer contour shape of the performance area of the event within the image of the event;
determining, by the augmented reality system based on the outer contour shape, a three-dimensional (3D) pose of the performance area of the event within the image of the event;
determining, based on the 3D pose of the performance area, an anchor vector that is perpendicular to the performance area; and
providing, by the augmented reality system for concurrent display by a display device of the computing device, the image of the event and augmented reality content that is oriented with respect to the anchor vector and according to the 3D pose of the performance area of the event within the image of the event.

14. The method of claim 13 , wherein the determining of the outer contour shape includes:
determining that at least one corner of the performance area of the event is not within the image of the event; and
determining a location of the at least one corner of the performance area of the event.

15. The method of claim 13 , wherein the determining of the first region in the image of the event includes determining an average color of pixels included in the image of the event.

16. A system comprising:
a memory that stores instructions;
a processor communicatively coupled to the memory and configured to execute the instructions to:
acquire an image of an event from a viewpoint of a camera of a computing device in proximity to the event, the event including a performance area;
identify at least part of the performance area of the event within the image of the event;
determine a three-dimensional (3D) pose of the performance area of the event within the image of the event;
determine, based on the 3D pose of the performance area, an anchor vector that is perpendicular to the performance area; and
provide, for concurrent display by a display device of the computing device, the image of the event and augmented reality content that is oriented with respect to th

Assignees

• Verizon Patent & Licensing Inc

Inventors

• Tauber Zachary
• Bizira Herve
• Kyriazakos Viktor
• Papapavlou Christos
• Mccall Sean
• Dassa Guy
• Scholz Jeffrey
• Mareedu Praveen
• Zhou Xingyue
• Guo Haoxin

Classifications

• G06T2207/30228

  Playing field · CPC title

• G06T7/73

  using feature-based methods · CPC title

• G06T2207/20084

  Artificial neural networks [ANN] · CPC title

• G06T2207/20081

  Training; Learning · CPC title

• G06T2207/10024

  Color image · CPC title