Protection for head mounted display device

Patent metadata

Field	Value
Publication number	US-10952479-B2
Application number	US-201816141066-A
Country	US
Kind code	B2
Filing date	Sep 25, 2018
Priority date	Sep 25, 2018
Publication date	Mar 23, 2021
Grant date	Mar 23, 2021

Abstract

A head mounted display (HMD) device that includes a plurality of sensors, an actuator, a plurality of protective mechanisms, and a processor configured to identify a situational state of a user of the HMD device within a proximity of the user, based on sensor input received from the plurality of sensors. A risk-level of a potential injury to the user from a component of the HMD device is determined based on the identified situational state and the sensor input. A protective mechanism is selected from the plurality of protective mechanisms based on the identified situational state and the determined risk-level. The actuator is controlled to deploy the selected protective mechanism to mitigate injury to the user from the component of the HMD device, based on the identified situational state and the determined risk-level.

First claim

What is claimed is:

1. A head mounted display (HMD) device, comprising:
a plurality of sensors configured to output a sensor input;
an actuator;
a plurality of protective mechanisms; and
a processor configured to:
identify a situational state of a user of the HMD device based on the sensor input received from the plurality of sensors;
determine a risk-level of a potential injury to the user based on the identified situational state and the sensor input, wherein the risk-level corresponds to a risk associated with the user from a component of the HMD device;
select a protective mechanism from the plurality of protective mechanisms based on the identified situational state and the determined risk-level; and
control the actuator to deploy the selected protective mechanism to mitigate injury to the user from the component of the HMD device, wherein the actuator is controlled based on the identified situational state and the determined risk-level.

2. The HMD device according to claim 1 , wherein
the plurality of protective mechanisms includes a retract mechanism,
the processor is further configured to control the actuator to retract the component of the HMD device by the retract mechanism to mitigate injury to the user from the component of the HMD device, and
the actuator is controlled based on the identified situational state and the determined risk-level.

3. The HMD device according to claim 1 , wherein
the plurality of protective mechanisms includes a customized airbag,
the processor is further configured to control the actuator to deploy the customized airbag to mitigate injury to the user from the component of the HMD device, and
the actuator is controlled based on the identified situational state and the determined risk-level.

4. The HMD device according to claim 1 , wherein
the plurality of protective mechanisms includes a tubular structure,
the processor is further configured to control the actuator to deploy the tubular structure to encompass the component of the HMD device to mitigate injury to the user from the component of the HMD device, and
the actuator is controlled based on the identified situational state and the determined risk-level.

5. The HMD device according to claim 1 , wherein
the plurality of protective mechanisms includes a detachment mechanism, and
the processor is further configured to control the actuator to detach the component from the HMD device by the detachment mechanism to mitigate injury to the user from the component of the HMD device, based on the identified situational state and the determined risk-level.

6. The HMD device according to claim 1 , wherein the processor is further configured to determine a direction of fall of the user towards a ground surface within a proximity of the user.

7. The HMD device according to claim 6 , wherein the processor is further configured to identify the situational state of the user as a fall-on-back state or a fall-on-face state on the ground surface, based on the determined direction of fall of the user.

8. The HMD device according to claim 7 , wherein
the plurality of protective mechanisms include at least one of a customized airbag or a tubular structure,
the processor is further configured to control the actuator to deploy at least one of the customized airbag or the tubular structure to encompass the component of the HMD device to mitigate injury to the user from the component of the HMD device, and
the actuator is controlled based on the identification of the situational state as the fall-on-face state and the risk-level as a high risk-level greater than a threshold.

9. The HMD device according to claim 1 , wherein the processor is further configured to compute a distance between a moving object and the HMD device and a likelihood of a contact of the moving object with the HMD device within a proximity of the user.

10. The HMD device according to claim 9 , wherein the processor is further configured to determine, whether to output a warning signal or control the actuator to deploy the selected protective mechanism, based on the computed distance between the moving object and the HMD device and the likelihood of the contact of the moving object with the HMD device.

11. The HMD device according to claim 10 , wherein
the processor is further configured to:
identify the situational state as a sports-play state; and
generate the warning signal based on the situational state identified as the sports-play state and the risk-level determined as a medium-risk level, and

the risk-level is determined as the medium-risk level based on a comparison of the computed distance and the likelihood of the contact of the moving object with the HMD device with one or more defined thresholds.

12. The HMD device according to claim 1 , wherein the component of the HMD device corresponds to an optical unit that faces at least one eye of the user.

13. A protective system for a head mounted display (HMD) device, the protective system comprising:
an actuator;
a plurality of protective mechanisms; and
a processor configured to:
identify a situational state of a user of the HMD device, based on a sensor input received from a plurality of sensors;
determine a risk-level of a potential injury to the user, based on the identified situational state and the sensor input, wherein the risk-level corresponds to a risk associated with the user from a component of the HMD device;
select a protective mechanism from the plurality of protective mechanisms based on the identified situational state and the determined risk-level; and
control the actuator to deploy the selected protective mechanism to mitigate injury to the user from the component of the HMD device.

14. A method for a head mounted display (HMD) device, the method comprising:
in a protective system of the HMD device:
identifying a situational state of a user of the HMD device, based on a sensor input received from a plurality of sensors communicatively coupled to the protective system;
determining a risk-level of a potential injury to the user, based on the identified situational state and the sensor input, wherein the risk-level corresponds to a risk associated with the user from a component of the HMD device;
selecting a protective mechanism from a plurality of protective mechanisms provided in the protective system, based on the identified situational state and the determined risk-level; and
controlling an actuator of the protective system to deploy the selected protective mechanism to mitigate injury to the user from the component of the HMD device, wherein the selected protective mechanism is deployed based on the identified situational state and the determined risk-level.

15. The method according to claim 14 , further comprising
controlling the actuator to retract the component of the HMD device by a retract mechanism to mitigate injury to the user from the component of the HMD device, wherein
the actuator is controlled based on the identified situational state and the determined risk-level, and
the plurality of protective mechanisms includes the retract mechanism.

16. The method according to claim 14 , further comprising
controlling the actuator to deploy a customized airbag to mitigate injury to the user from the component of the HMD device, wherein
the actuator is controlled based on the identified situational state and the determined risk-level, and
the plurality of protective mechanisms includes the customized airbag.

17. The method according to claim 14 , further comprising
controlling the actuator

Assignees

• Sony Corp

Inventors

• Mohapatra Bibhudendu
• Resch Keith
• Ansfield Fred
• Pineda Loren

Classifications

• G02B2027/014

  comprising information/image processing systems · CPC title

• A41D13/0155 Primary

  having inflatable structure, e.g. non automatic · CPC title

• G02B27/0176 Primary

  characterised by mechanical features · CPC title

• G02B2027/0167

  Emergency system, e.g. to prevent injuries · CPC title

• A42B3/042

  Optical devices (night vision goggles G02B23/12) · CPC title