System and method for providing user interaction with projected three-dimensional environments

Patent metadata

Field	Value
Publication number	US-9244525-B2
Application number	US-37888709-A
Country	US
Kind code	B2
Filing date	Feb 19, 2009
Priority date	Feb 19, 2009
Publication date	Jan 26, 2016
Grant date	Jan 26, 2016

Abstract

There is provided an interactive device capable of providing input data to a computer program in response to user interactions, the interface device comprising a first position sensor reading a sensed location of the interface device having a free roaming movement in a three-dimensional space, a direction vector determination device determining a direction vector indicating an aiming direction, and a transmission system communicating aim information to an external device implementing the computer program. The transmission system may include a transmitter for the direction vector and/or a transmitter for the sensed location. The computer program can use the aim information and input data to support a projected 3D game environment or other application providing sensory feedback in response to the user interactions. Multiple interactive devices having unique identifiers may also be supported. The interactive device enables significant freedom to roam relative to implementing equipment, as compared to existing interactive devices having only a limited range of movement relative to implementing equipment.

First claim

What is claimed is:

1. A method of providing a sensory feedback in response to user interactions with a three-dimensional environment shown on a display, the method comprising:
showing the three-dimensional environment on the display;
receiving, from a first position sensor of an interface device, a first sensed location of at least one point of the interface device having a free roaming movement in a three-dimensional space;
determining an aim point being aimed at by the interface device, wherein the aim point is a point on the display;
receiving the first sensed location and the aim point;
deriving a projectile trajectory of a simulated object travelling from the interface device based on the first sensed location and the aim point, wherein the projectile trajectory is calculated based on a velocity associated with the simulated object;
determining a collision point in the three-dimensional environment based on the projectile trajectory; and
displaying, on the display, the collision point in the three-dimensional environment, as the sensory feedback.

2. The method of claim 1 , wherein first sensed position is measured with respect to a fixed reference in space around the interface device.

3. The method of claim 1 , wherein the aim point is determined using a camera.

4. The method of claim 3 , wherein the camera is operable to determine the aim point as the point on the display.

5. The method of claim 1 , wherein the collision point is different than the aim point.

6. A sever for providing a sensory feedback in response to user interactions with a three-dimensional environment shown on a display, the sever comprising:
a server processor configured to:
show the three-dimensional environment on the display;
receive, from a first position sensor of an interface device, a first sensed location of at least one point of the interface device having a free roaming movement in a three-dimensional space;
determine an aim point being aimed at by the interface device, wherein the aim point is a point on the display;
receive the first sensed location and the aim point;
derive a projectile trajectory of a simulated object travelling from the interface device based on the first sensed location and the aim point, wherein the projectile trajectory is calculated based on a velocity associated with the simulated object;
determine a collision point in the three-dimensional environment based on the projectile trajectory; and
displaying, on the display, the collision point in the three-dimensional environment, as the sensory feedback.

7. The server of claim 6 , wherein first sensed position is measured with respect to a fixed reference in space around the interface device.

8. The server of claim 6 , wherein the aim point is determined using a camera.

9. The server of claim 8 , wherein the camera is operable to determine the aim point as the point on the display.

10. The server of claim 6 , wherein the collision point is different than the aim point.

Assignees

• Crawford David
• Nemeth Edward
• Kalama Asa K
• Mine Mark R
• Disney Entpr Inc

Inventors

• Crawford David
• Nemeth Edward
• Kalama Asa K
• Mine Mark R

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title