System and Method for Alerting VR Headset User to Real-World Objects

Patent metadata

Field	Value
Publication number	US-2017123747-A1
Application number	US-201514927309-A
Country	US
Kind code	A1
Filing date	Oct 29, 2015
Priority date	Oct 29, 2015
Publication date	May 4, 2017
Grant date	—

Abstract

A system and method are presented for alerting a head mounted display (HMD) user to real-world objects. The HMD includes a controller, an internal display, and an external sensor. One or more characteristics of an object in a vicinity of the user are detected, using the external sensor. It is determined whether a detected characteristic matches a predefined criterion, and, if so, an alert is displayed to the user on the internal display.

First claim

What is claimed is:

1 . A method for displaying an alert to a user of a head mounted display (HMD), the HMD comprising a controller, an internal display mechanically coupled to the HMD, communicatively coupled to the controller, and visible to a user of the HMD, and an external sensor, mechanically coupled to the headpiece and communicatively coupled to the controller, the method comprising:
using the external sensor, detecting one or more characteristics of an object in a vicinity of the user; determining whether a detected characteristic matches a predefined criterion; and in response to so determining, displaying an alert to the user on the internal display.

2 . The method of claim 1 , wherein determining whether the characteristic matches the predefined criterion comprises:
detecting a velocity of at least one of the object and the user; and calculating whether the object will enter a trigger zone having a predefined extent centered on a position of the user.

3 . The method of claim 2 , further comprising detecting a velocity of the object and a velocity of the user.

4 . The method of claim 2 , further comprising:
detecting an environment in which the user is operating the HMD; and selecting a value of the predefined extent based upon the detected environment.

5 . The method of claim 4 , wherein detecting the environment comprises one of receiving an input from the user and detecting an identity of a WiFi hotspot with which the HMD is communicating.

6 . The method of claim 1 , wherein detecting one or more characteristics of the object includes:
detecting that the object is a person; and detecting an action by the person.

7 . The method of claim 6 , further comprising, in response to determining that the action matches the predefined criterion, capturing a visual recording of the person.

8 . The method of claim 1 , further comprising:
detecting that the object is a person; detecting an identity of the person; selecting a predefined criterion based upon the identity of the person; and determining whether the characteristic matches the selected predefined criterion.

9 . The method of claim 1 , wherein the alert comprises a passthrough window.

10 . The method of claim 1 , further comprising, in response to determining whether the characteristic matches the predefined criterion, activating an external indicator, visible to a person other than the user.

11 . A head mounted display (HMD), comprising:
a headpiece configured to removably couple the HMD to the body of a user of the HMD; an internal display, mechanically coupled to the headpiece and visible to the user; an external sensor, mechanically coupled to the headpiece; and a controller, communicatively coupled to the internal display and the external sensor, wherein the controller is configured to
detect one or more characteristics of an object in a vicinity of the user, using the external sensor,
determine whether a detected characteristic matches a predefined criterion, and
in response to so determining, display an alert to the user on the internal display.

12 . The HMD of claim 11 , wherein the controller is further configured to:
detect a velocity of at least one of the object and the user; and calculate whether the object will enter a trigger zone having a predefined extent centered on a position of the user.

13 . The HMD of claim 12 , wherein the controller is further configured to detect a velocity of the object and a velocity of the user.

14 . The HMD of claim 11 , wherein the controller is further configured to:
detect an environment in which the user is operating the HMD; and select a value of the predefined extent based upon the detected environment.

15 . The HMD of claim 14 , further comprising:
a communications interface, configured to communicate with a WiFi hotspot, wherein the controller is further configured to detect the environment based upon one of an input received from the user and an identity of a WiFi hotspot with which the HMD is communicating.

16 . The HMD of claim 11 , wherein the controller is further configured to:
detect that the object is a person; detect an action by the person; and determine whether the action matches the predefined criterion.

17 . The HMD of claim 16 , wherein the controller is further configured to capture a visual recording of the person, in response to determining that the action matches the predefined criterion.

18 . The HMD of claim 16 , wherein the controller is further configured to:
detect that the object is a person; detect an identity of the person; select a predefined criterion based upon the identity of the person; and determine whether the characteristic matches the selected predefined criterion.

19 . The HMD of claim 16 , wherein the alert comprises a passthrough window.

20 . The HMD of claim 11 , further comprising an external indicator, visible to a person other than the user, wherein the controller is further configured to activate the external indicator in response to determining whether the characteristic matches the predefined criterion.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Rochford Ciaran
• Harscoet Philippe

Classifications

• G06F3/147 Primary

  using display panels · CPC title

• G06F3/1423 Primary

  controlling a plurality of local displays, e.g. CRT and flat panel display · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B2027/0141

  characterised by the informative content of the display · CPC title