Method and system for applying gearing effects to visual tracking

Patent metadata

Field	Value
Publication number	US-10099130-B2
Application number	US-201615283131-A
Country	US
Kind code	B2
Filing date	Sep 30, 2016
Priority date	Jul 27, 2002
Publication date	Oct 16, 2018
Grant date	Oct 16, 2018

Abstract

A method is provided, including: receiving inertial data from an input device, the inertial data being generated from one or more inertial sensors of the input device; receiving captured image data from an image capture device configured to capture images of an interactive environment in which the input device is disposed, the input device having a light emitting diode (LED) array that generates infrared light; processing the inertial data and the captured image data to determine a movement of the input device in the interactive environment; establishing a gearing that adjusts an amount by which the movement of the input device is mapped to movement of an image that is rendered to a display; changing the gearing to different settings during the movement of the image as the movement of the image is rendered to the display.

First claim

What is claimed is:

1. A method, comprising:
receiving inertial data from an input device, the inertial data being generated from one or more inertial sensors of the input device;
receiving captured image data from an image capture device configured to capture images of an interactive environment in which the input device is disposed, the input device having a light emitting diode (LED) array that generates infrared light;
processing the inertial data and the captured image data to determine a movement of the input device in the interactive environment;
establishing a gearing that adjusts an amount by which the movement of the input device is mapped to movement of an image that is rendered to a display;
changing the gearing to different settings during the movement of the image as the movement of the image is rendered to the display.

2. The method of claim 1 , wherein processing the captured image data includes tracking the LED array in the captured image data.

3. The method of claim 2 , wherein tracking the LED array includes analyzing a position and deformation of the LED array in the captured image data to determine a position and orientation of the input device in the interactive environment.

4. The method of claim 2 , wherein the input device is configured to modulate the LED array to enable the tracking of the LED array in the captured image data.

5. The method of claim 1 , wherein changing the gearing to different settings is in accordance with a user selectable setting.

6. The method of claim 1 , wherein the inertial sensors include one or more of an accelerometer and a gyroscope.

7. The method of claim 6 , wherein processing the inertial data includes analyzing signals from the accelerometer or gyroscope to determine a position or orientation of the input device in the interactive environment.

8. The method of claim 1 , wherein the movement of the image is a translational or rotational movement the image.

9. The method of claim 1 , wherein changing the gearing to different settings occurs during the movement of the input device.

10. A method, comprising:
receiving inertial data from an input device, the inertial data being generated from one or more inertial sensors of the input device;
receiving captured image data from an image capture device configured to capture images of an interactive environment in which the input device is disposed, the input device having a plurality of lights that generate infrared light;
processing the inertial data and the captured image data to determine a movement of the input device in the interactive environment, wherein determining the movement of the input device includes tracking a position and orientation of the input device based on the inertial data and the captured image data;
establishing a gearing that adjusts an amount by which the movement of the input device is mapped to a variable used to determine movement of an image that is rendered to a display;
changing the gearing to different settings during the movement of the image as the movement of the image is rendered to the display and during the movement of the input device.

11. The method of claim 10 , wherein processing the captured image data includes analyzing a position and deformation of the plurality of lights in the captured image data to determine the position and orientation of the input device in the interactive environment.

12. The method of claim 10 , wherein the input device is configured to modulate the plurality of lights to enable the tracking of the position and orientation of the input device.

13. The method of claim 10 , wherein changing the gearing to different settings is in accordance with a user selectable setting.

14. The method of claim 10 , wherein the inertial sensors include one or more of an accelerometer and a gyroscope.

15. The method of claim 14 , wherein processing the inertial data includes analyzing signals from the accelerometer or gyroscope to determine the position or orientation of the input device in the interactive environment.

16. The method of claim 10 , wherein the movement of the image is a translational or rotational movement the image.

17. A system, comprising:
an input device, the input device including,
one or more inertial sensors configured to generate inertial data in response to sensed motion of the input device,
a light emitting diode (LED) array that generates infrared light;
an image capture device configured to capture images of an interactive environment in which the input device is disposed, the image capture device configured to generate captured image data that is processed with the inertial data to determine a movement of the input device in the interactive environment;
wherein a gearing is established that adjusts an amount by which the movement of the input device is mapped to movement of an image that is rendered to a display, the gearing changing to different settings during the movement of the image as the movement of the image is rendered to the display.

18. The system of claim 17 , wherein the captured image data is processed to track the LED array in the captured image data, including analyzing a position and deformation of the LED array in the captured image data to determine a position and orientation of the input device in the interactive environment.

19. The system of claim 18 , wherein the input device is configured to modulate the LED array to enable the tracking of the LED array in the captured image data.

20. The system of claim 17 , wherein the inertial sensors include one or more of an accelerometer and a gyroscope, wherein processing the inertial data includes analyzing signals from the accelerometer or gyroscope to determine a position or orientation of the input device in the interactive environment.

Assignees

• Sony Interactive Entertainment America Llc

Inventors

• Zalewski Gary M
• Marks Richard
• Mao Crusoe Xiaodong

Classifications

• A63F2300/1062

  being specially adapted to a type of game, e.g. steering wheel · CPC title

• A63F2300/6045

  for mapping control signals received from the input arrangement into game commands · CPC title

• A63F13/50

  Controlling the output signals based on the game progress · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title

• A63F13/211 Primary

  using inertial sensors, e.g. accelerometers or gyroscopes · CPC title