Head mounted display

Patent metadata

Field	Value
Publication number	US-10987574-B2
Application number	US-202016736787-A
Country	US
Kind code	B2
Filing date	Jan 7, 2020
Priority date	Jun 9, 2013
Publication date	Apr 27, 2021
Grant date	Apr 27, 2021

Abstract

A head mounted display (HMD) is provided. In one example configuration, the HMD has housing and a view port. The view port has a screen for rendering a virtual reality scene. The HMD has a communications device for exchanging data over a network. The HMD has a depth camera integrated in the housing and oriented to capture depth data of an environment in front of the housing. A processor is provided and is configured to use the depth data captured by the depth camera to identify real objects in the environment. A real object is rendered into the virtual reality scene. The real object is tracked such that movements of the real object are shown as movements in the virtual reality scene. The real object captured by the depth camera in the environment is a hand of a user wearing the HMD. The hand of the user is rendered as a virtual hand, and movements of the virtual hand are displayed in the screen of the viewport from a perspective that is in front of the user.

First claim

What is claimed is:

1. A head mounted display (HMD), comprising,
a housing;
a view port of the housing, the view port having a screen for rendering a virtual reality scene;
a communications device for exchanging data over a network;
a depth camera integrated in the housing and oriented to capture depth data of an environment in front of the housing; and
a processor is configured to use the depth data captured by the depth camera to identify real objects in the environment, wherein a real object is rendered into the virtual reality scene, the real object being tracked such that movements of the real object are shown as movements in the virtual reality scene;
wherein the real object captured by the depth camera in the environment is a hand of a user wearing the HMD, and said hand of the user is rendered as a virtual hand, and movements of the virtual hand are displayed in the screen of the viewport from a perspective that is in front of the user, wherein at least part of an arm of the user extended into the virtual reality scene in front of the user provides for the virtual hand to appear depth-wise as a continuation of the arm to the virtual hand.

2. The HMD of claim 1 , further comprising,
using the depth camera to further capture depth data for said at least part of an arm of the user that extends to the virtual hand, wherein said at least part of the arm is rendered in the virtual reality scene and parallels movement of the arm of the user.

3. The HMD of claim 1 , wherein the virtual hand is rendered in the virtual reality scene along with a virtual reality object that is allowed to interact with the virtual reality hand based on movements of the hand of the user in the environment in front of the housing.

4. The HMD of claim 1 , wherein the depth camera is configured to capture a second hand of the user, the second hand of the user being rendered into the virtual reality scene as a second virtual hand.

5. The HMD of claim 1 , wherein the processor executes data for input data, image data, audio data, or combinations of two or more thereof.

6. The HMD of claim 1 , wherein audio data is provided to the HMD as associated with content of the virtual reality scene.

7. The HMD of claim 6 , wherein the content includes game data, video data, internet navigation data, interactive data, combinations of game data and internet data, social media data, or combinations thereof.

8. A head mounted display (HMD), comprising,
a housing;
a view port of the housing, the view port having a screen for rendering a virtual reality scene;
a communications device for exchanging data over a network;
a depth camera coupled to the housing and oriented to capture depth data of an environment in front of the housing;
an inertial sensor integrated in the HMD, the inertial sensor produces inertial data in response to detected movement of the HMD when worn by the user; and
a processor is configured to use the depth data captured by the depth camera to identify real objects in the environment, wherein a real object is rendered into the virtual reality scene, the real object being tracked such that movements of the real object are shown as movements in the virtual reality scene;
wherein the real object captured by the depth camera in the environment is a hand of a user wearing the HMD, and said hand of the user is rendered as a virtual hand, and movements of the virtual hand are displayed in the screen of the viewport from a perspective that is in front of the user, wherein at least part of an arm of the user extended into the virtual reality scene in front of the user provides for the virtual hand to appear depth-wise as a continuation of the arm to the virtual hand.

9. The HMD of claim 8 , further comprising,
using the depth camera to further capture depth data for said at least part of an arm of the user that extends to the virtual hand, wherein said at least part of the arm is rendered in the virtual reality scene and parallels movement of the arm of the user.

10. The HMD of claim 8 , wherein the virtual hand is rendered in the virtual reality scene along with a virtual reality object that is allowed to interact with the virtual reality hand based on movements of the hand of the user in the environment in front of the housing.

11. The HMD of claim 8 , wherein the depth camera is configured to capture a second hand of the user, the second hand of the user being rendered into the virtual reality scene as a second virtual hand.

12. The HMD of claim 8 , wherein the processor executes data for input data, image data, audio data, inertial data, or combinations of two or more thereof.

13. The HMD of claim 12 , wherein audio data is provided to the HMD as associated with content of the virtual reality scene.

14. The HMD of claim 13 , wherein the content includes game data, video data, internet navigation data, interactive data, combinations of game data and internet data, social media data, or combinations thereof.

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Mikhailov Anton
• Mao Xiadong

Classifications

• G09G3/001

  using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP) · CPC title

• A63F13/211

  using inertial sensors, e.g. accelerometers or gyroscopes · CPC title

• A63F13/803

  Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• A63F13/285

  Generating tactile feedback signals via the game input device, e.g. force feedback · CPC title