Method and system for applying gearing effects to visual tracking

Patent metadata

Field	Value
Publication number	US-10406433-B2
Application number	US-201816147365-A
Country	US
Kind code	B2
Filing date	Sep 28, 2018
Priority date	Jul 27, 2002
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

A system is provided, including the following: an input device, the input device including, a light emitting diode (LED) array; an image capture device configured to capture images of an interactive environment in which the input device is disposed, the image capture device configured to generate captured image data that is processed to determine a movement of the input device in the interactive environment; wherein a gearing is established that adjusts an amount by which the movement of the input device is mapped to movement of an image that is rendered to a display, the gearing changing to different settings during the movement of the image as the movement of the image is rendered to the display.

First claim

What is claimed is:

1. A method, comprising:
receiving captured image data from an image capture device configured to capture images of an interactive environment in which an input device is disposed, the input device having a light emitting diode (LED) array;
processing the captured image data to determine a movement of the input device in the interactive environment;
establishing a gearing that adjusts an amount by which the movement of the input device is mapped to movement of an image that is rendered to a display;
changing the gearing to different settings during the movement of the image as the movement of the image is rendered to the display.

2. The method of claim 1 , wherein processing the captured image data includes tracking the LED array in the captured image data.

3. The method of claim 2 , wherein tracking the LED array includes analyzing a position and deformation of the LED array in the captured image data to determine a position and orientation of the input device in the interactive environment.

4. The method of claim 2 , wherein the input device is configured to modulate the LED array to enable the tracking of the LED array in the captured image data.

5. The method of claim 1 , wherein changing the gearing to different settings is in accordance with a user selectable setting.

6. The method of claim 1 , further comprising, receiving inertial data generated from one or more inertial sensors of the input device, the inertial sensors include one or more of an accelerometer and a gyroscope, the movement of the input device being determined using the inertial data.

7. The method of claim 6 , wherein processing the inertial data includes analyzing signals from the accelerometer or gyroscope to determine a position or orientation of the input device in the interactive environment.

8. The method of claim 1 , wherein the movement of the image is a translational or rotational movement the image.

9. The method of claim 1 , wherein changing the gearing to different settings occurs during the movement of the input device.

10. A system, comprising:
an input device, the input device including,
a light emitting diode (LED) array;
an image capture device configured to capture images of an interactive environment in which the input device is disposed, the image capture device configured to generate captured image data that is processed to determine a movement of the input device in the interactive environment;
wherein a gearing is established that adjusts an amount by which the movement of the input device is mapped to movement of an image that is rendered to a display, the gearing changing to different settings during the movement of the image as the movement of the image is rendered to the display.

11. The system of claim 10 , wherein the captured image data is processed to track the LED array in the captured image data, including analyzing a position and deformation of the LED array in the captured image data to determine a position and orientation of the input device in the interactive environment.

12. The system of claim 11 , wherein the input device is configured to modulate the LED array to enable the tracking of the LED array in the captured image data.

13. The system of claim 10 , wherein the input device further includes one or more inertial sensors configured to generate inertial data, the inertial sensors include an accelerometer or a gyroscope, wherein processing the inertial data includes analyzing signals from the accelerometer or gyroscope to determine a position or orientation of the input device in the interactive environment.

14. The system of claim 10 , wherein the input device includes a handle for holding by a hand of a user, and wherein the LED array is positioned on a front side of the input device that is opposite the handle.

15. The system of claim 10 , wherein the input device includes one or more of the following: a joystick, a trigger, a button, a pressure pad.

16. The system of claim 10 , wherein the image capture device includes two or more cameras.

17. The system of claim 10 , wherein the image capture device is proximate to the display.

18. A system, comprising:
an input device, the input device including,
a plurality of lights, and
one or more inertial sensors configured to generate inertial data;
an image capture device configured to capture images of an interactive environment in which the input device is disposed, the image capture device configured to generate captured image data that is processed with the inertial data to determine a movement of the input device in the interactive environment;
wherein a gearing is established that adjusts an amount by which the movement of the input device is mapped to movement of a virtual object that is rendered to a display, the gearing changing to different settings during the movement of the virtual object as the movement of the virtual object is rendered to the display.

19. The system of claim 18 , wherein the captured image data is processed to track the plurality of lights in the captured image data, including analyzing a position of the plurality of lights in the captured image data to determine a position of the input device in the interactive environment.

20. The system of claim 18 , wherein the inertial sensors include an accelerometer or a gyroscope, wherein processing the inertial data includes analyzing signals from the accelerometer or gyroscope to determine an orientation of the input device in the interactive environment.

21. The system of claim 18 , wherein the input device includes a handle for holding by a hand of a user, and wherein the plurality of lights are positioned on a front side of the input device that is opposite the handle.

22. The system of claim 18 , wherein the input device includes one or more of the following: a joystick, a trigger, a button, a pressure pad.

23. The system of claim 18 , wherein the image capture device includes two or more cameras.

24. The system of claim 18 , wherein the image capture device is proximate to the display.

Assignees

• Sony Interactive Entertainment America Llc

Inventors

• Zalewski Gary M
• Marks Richard
• Mao Crusoe Xiaodong

Classifications

• A63F2300/1093

  using visible light · CPC title

• A63F13/50

  Controlling the output signals based on the game progress · CPC title

• A63F2300/1062

  being specially adapted to a type of game, e.g. steering wheel · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title

• A63F2300/308

  Details of the user interface · CPC title