Systems and methods for enhancing augmented reality experience with dynamic output mapping

Patent metadata

Field	Value
Publication number	US-2018286129-A1
Application number	US-201615754551-A
Country	US
Kind code	A1
Filing date	Aug 17, 2016
Priority date	Aug 24, 2015
Publication date	Oct 4, 2018
Grant date	—

Abstract

Disclosed herein are systems and methods for configuring a multi-device digital experience. In an embodiment, the method includes presenting a first content portion of a digital experience via a wearable display device in an environment; presenting a second content portion of the digital experience via a first device in a set of one or more devices in the environment; capturing test-signal-output data presented by the first device, the test-signal-output data being captured by the wearable display device in the environment, the test-signal-output data being based on a test signal sent to the first device; estimating spatial-characteristic data of the first device based on the captured test-signal-output data; and modifying the presentation of the second content portion of the digital experience via the first device based on the estimated spatial-characteristic data of the first device.

First claim

What is claimed is:

1 . A method, performed by an augmented reality (AR) wearable display device, for configuring a multi-display device digital AR experience, the method comprising:
initially presenting a first content portion of a digital AR experience via a display of the AR wearable display device in an environment that includes a set of one or more additional display devices, wherein the digital AR experience is initially presented in the environment only on the display of the AR wearable display device; identifying a first display device of the set of one or more additional display devices based on one or more communication protocols; after the initial presentation of the first content portion of the digital AR experience and during a continued presentation of the first content portion of the digital AR experience, extending the digital AR experience from only the AR wearable display device to also the first display device such that a second content portion of the digital AR experience is being presented by the first display device in the environment; while the second content portion is being presented, capturing, test-signal-output data presented by the first display device, the test-signal-output data being based on a test signal sent to at least the first display device of the set of one or more additional display devices, wherein the test-signal-output data is a subset of the second content portion being presented by the first display device; estimating spatial-characteristic data of the first display device based on the captured test-signal-output data; and modifying the second content portion of the digital AR experience based on the estimated spatial-characteristic data of the first display device.

2 . The method of claim 1 , further comprising sending, to the first display device, a second-content-portion stream that comprises the second content portion of the digital AR experience.

3 . The method of claim 1 , further comprising sending the test signal to the first display device, wherein the test signal comprises a fiducial marker detectable by the AR wearable display device.

4 - 5 . (canceled)

6 . The method of claim 1 , further comprising analyzing second-content-portion data presented by the first display device, wherein modifying the second content portion of the digital AR experience is further based on the analyzed second-content-portion data.

7 . The method of claim 1 , wherein extending the digital AR experience from only the AR wearable display device to also the first display device such that the second content portion of the digital AR experience is being presented via the first display device comprises:
sending, to the first display device, a second-content-portion stream that comprises the second content portion of the digital AR experience; and extending the digital AR experience from only the AR wearable display device to also the first display device and also a second display device in the set of one or more additional display devices in the environment, such that a third content portion of the digital AR experience is being presented via the second display device while the second content portion of the digital AR experience is being presented via the first display device.

8 . The method of claim 1 , wherein the AR wearable display device comprises an RGB-D sensor, and wherein capturing the test-signal-output data further comprises capturing the test-signal-output data using the RGB-D sensor.

9 . The method of claim 1 , further comprising:
terminating a connection with the first display device; and marking the first display device as at least one of an unused display device or an underperforming display device.

10 . The method of claim 1 , wherein identifying the first display device using one or more communication protocols comprises:
polling for output devices in the environment; detecting the first display device as one or more available output devices in the environment; and establishing a connection with the first display device.

11 . The method of claim 1 , further comprising iteratively adjusting the estimated spatial-characteristic data of the first device based on a comparison of the presented second content portion of the digital AR experience to an expected presentation of the second content portion of the digital AR experience.

12 . The method of claim 1 , further comprising:
evaluating the presented second content portion of the digital AR experience based on an expected presentation of the second content portion of the digital AR experience; and determining, based on the evaluating, whether the first display device is underperforming in presenting the second content portion of the digital AR experience.

13 . The method of claim 1 , further comprising ceasing presentation of the second content portion of the digital AR experience responsive to determining that the first display device is underperforming in presenting the second content portion of the digital AR experience.

14 . The method of claim 1 , wherein the estimated spatial-characteristic data of the first display device comprises at least one of location data of the first device or orientation data of the first display device.

15 . A system for configuring a multi-device digital AR experience, the system comprising:
an AR wearable display device configured to:
initially present, via a display of the wearable display device, a first content portion of a digital AR experience in an environment that includes a set of one or more additional display devices, wherein the digital AR experience is initially presented in the environment only on the display of the AR wearable display device;
identify a first display device of the set of one or more additional display devices based on one or more communication protocols;
after the initial presentation of the first content portion of the digital AR experience and during a continued presentation of the first content portion of the digital AR experience, extending the digital AR experience from only the AR wearable display device to also the first display device such that the first display device is configured to present a second content portion of the digital AR experience in the environment;
while the second content portion is being presented, capture, test-signal-output data presented by the first display device, the test-signal-output data being based on a test signal sent to at least the first display device of the set of one or more additional display devices, wherein the test-signal-output data is a subset of the second content portion being presented by the first display device;
estimate spatial-characteristic data of the first display device based on the captured test-signal-output data; and
modify the second content portion of the digital AR experience based on the estimated spatial-characteristic data of the first display device.

16 . The system of claim 15 , wherein the AR wearable display device is further configured to:
send, to the first display device, a second-content-portion stream that comprises the second content portion of the digital AR experience.

17 . The system of claim 15 , wherein the AR wearable display device is further configured to:
send the test signal to the first display device, wherein the test signal comprises a fiducial marker detectable by the AR wearable display device.

18 . The system of claim 15 , wherein the AR wearable display device is further configured to:
iteratively adjust the estimated spatial-characteristic data of the first devic

Assignees

• Pcms Holdings Inc

Inventors

• Harviainen Tatu V J

Classifications

• H04S7/303

  Tracking of listener position or orientation · CPC title

• H04S7/301

  Automatic calibration of stereophonic sound system, e.g. with test microphone · CPC title

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• G06F3/147

  using display panels · CPC title