Obstacle avoidance apparatus and obstacle avoidance method

Patent metadata

Field	Value
Publication number	US-9599818-B2
Application number	US-201313804240-A
Country	US
Kind code	B2
Filing date	Mar 14, 2013
Priority date	Jun 12, 2012
Publication date	Mar 21, 2017
Grant date	Mar 21, 2017

Abstract

An obstacle detecting unit detects an obstacle for a user wearing a head mounted display from an image of the outside world. A distance calculating unit calculates the distance from a detected obstacle to the user wearing the head mounted display. An obstacle replacing unit replaces the detected obstacle with a virtual object. A virtual object synthesizing unit generates a virtual object at a position within a virtual space displayed on the head mounted display, in which the position is determined according to the distance to the obstacle.

First claim

What is claimed is:

1. An obstacle avoidance apparatus, comprising:
circuitry configured to determine a user's position as the user moves throughout a real space;
circuitry configured to generate a fictitious, virtual space that a user views through a head mounted display (HMD), where the virtual space includes images of landscape, scenery, and objects of a fictitious space based, at least in part, on the user's position acquired as the user moves throughout the real space, and does not include images of landscape, scenery, or objects of a real space within which the user is located;
circuitry configured to detect a real obstacle from an image of the real space within which the user is located;
circuitry configured to generate a virtual object in response to the detection of the real obstacle by generating the virtual object in such a way as to be: (i) consistent with context established by the landscape, scenery, and objects of the fictitious, virtual space that the user is experiencing through the HMD, and (ii) a different kind of object than, and is not recognizable by the user as representing, the real obstacle of the real space within which the user is located; and
circuitry configured to locate the virtual object within the fictitious, virtual space displayed on the HMD.

2. The obstacle avoidance apparatus according to claim 1 , wherein the image of the outside world is captured by a camera mounted on the HMD.

3. The obstacle avoidance apparatus according to claim 1 , wherein the circuitry configured to generate the virtual object such that the user wearing the HMD is expected to avoid contact with the virtual object in the fictitious virtual space, thereby avoiding contact with the real obstacle in the real space within which the user is located.

4. The obstacle avoidance apparatus according to claim 3 , wherein, when the detected real obstacle is a movable object, the obstacle generating unit selects, as the virtual object, an object that moves within the fictitious, virtual space displayed on the HMD.

5. The obstacle avoidance apparatus according to claim 1 , further comprising
circuitry configured to calculate the distance from the detected real obstacle to the user wearing the HMD,
wherein the circuitry configured to locate displays the virtual object at a position within the fictitious, virtual space determined according to the distance from the real obstacle to the user wearing the head mounted display.

6. The obstacle avoidance apparatus according to claim 5 , further comprising circuitry configured to warn the user when the distance to an obstacle calculated by the distance calculating unit is less than a predetermined threshold.

7. An obstacle avoidance method, comprising:
determining a user's position as the user moves throughout a real space;
generating a fictitious, virtual space that a user views through a head mounted display (HMD), where the virtual space includes images of landscape, scenery, and objects of a fictitious space based, at least in part, on the user's position acquired during the step of determining the user's position as the user moves throughout the real space, and does not include images of landscape, scenery, or objects of a real space within which the user is located;
detecting a real obstacle from an image of the real space within which the user is located;
generating a virtual object in response to the detection of the real obstacle by generating the virtual object in such a way as to be: (i) consistent with context established by the landscape, scenery, and objects of the fictitious, virtual space that the user is experiencing through the HMD, and (ii) a different kind of object than, and is not recognizable by the user as representing, the real obstacle of the real space within which the user is located; and
locating the virtual object within the fictitious, virtual space displayed on the HMD.

8. A non-transitory, computer readable storage medium containing an embedded computer program, which when executed by a computer, causes the computer to carry out actions, comprising:
determining a user's position as the user moves throughout a real space;
generating a fictitious, virtual space that a user views through a head mounted display (HMD), where the virtual space includes images of landscape, scenery, and objects of a fictitious space based, at least in part, on the user's position acquired during the determining the user's position as the user moves throughout the real space, and does not include images of landscape, scenery, or objects of a real space within which the user is located;
detecting a real obstacle from an image of the real space within which the user is located;
generating a virtual object in response to the detection of the real obstacle by generating the virtual object in such a way as to be: (i) consistent with context established by the landscape, scenery, and objects of the fictitious, virtual space that the user is experiencing through the HMD, and (ii) a different kind of object than, and is not recognizable by the user as representing, the real obstacle of the real space within which the user is located; and
locating the virtual object within the fictitious, virtual space displayed on the HMD.

9. The obstacle avoidance method according to claim 7 , wherein the image of the outside world is captured by a camera mounted on the HMD.

10. The obstacle avoidance method according to claim 7 , further comprising generating the virtual object such that the user wearing the HMD is expected to avoid contact with the virtual object in the fictitious virtual space, thereby avoiding contact with the real obstacle in the real space within which the user is located.

11. The obstacle avoidance method according to claim 10 , wherein, when the detected real obstacle is a movable object, the method further comprises selecting, as the virtual object, an object that moves within the fictitious, virtual space displayed on the HMD.

12. The obstacle avoidance method according to claim 7 , further comprising
calculating the distance from the detected real obstacle to the user wearing the HMD; and
displaying the virtual object at a position within the fictitious, virtual space determined according to the distance from the real obstacle to the user wearing the head mounted display.

13. The obstacle avoidance method according to claim 12 , further comprising warning the user when the distance to an obstacle calculated is less than a predetermined threshold.

Assignees

• Sony Computer Entertainment Inc
• Sony Corp
• Sony Interactive Entertainment Inc

Inventors

• Yamagishi Takeshi
• Osawa Hiroshi
• Nishimaki Yoichi

Classifications

• A63F2300/204

  the platform being a handheld device · CPC title

• A63F2300/69

  Involving elements of the real world in the game world, e.g. measurement in live races, real video · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• A63F2300/301

  using an additional display connected to the game console, e.g. on the controller · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title