Multi-image interactive gaming device

Patent metadata

Field	Value
Publication number	US-10315105-B2
Application number	US-201715671581-A
Country	US
Kind code	B2
Filing date	Aug 8, 2017
Priority date	Jun 4, 2012
Publication date	Jun 11, 2019
Grant date	Jun 11, 2019

Abstract

An image capture device, including: a housing; a first camera defined along a front surface of the housing; a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting, the captured images from the first camera being analyzed to detect a dynamic range of the interactive environment and to track a user; a second camera defined along the front surface of the housing; a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting based on the detected dynamic range, the second exposure setting being lower than the first exposure setting and configured to enable capture of objects that are the brightest objects in the interactive environment, the captured images from the second camera being analyzed to track an illuminated object.

First claim

What is claimed is:

1. An image capture device for providing input to an interactive application, comprising:
a housing;
a first camera defined along a front surface of the housing;
a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting, the captured images from the first camera being analyzed to detect a dynamic range of the interactive environment and to track a user;
a second camera defined along the front surface of the housing;
a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting based on the detected dynamic range, the second exposure setting being lower than the first exposure setting and configured to enable capture of objects that are the brightest objects in the interactive environment, the captured images from the second camera being analyzed to track an illuminated object in the interactive environment that is among the objects that are the brightest objects in the interactive environment.

2. The image capture device of claim 1 , wherein the second exposure setting is configured to exclude capture of objects that are not the brightest objects in the interactive environment.

3. The image capture device of claim 1 , wherein tracking the user includes tracking a face of the user.

4. The image capture device of claim 1 , wherein the first camera and the second camera are horizontally aligned along the front surface of the housing.

5. The image capture device of claim 1 , further comprising a microphone array for capturing sound from the interactive environment.

6. The image capture device of claim 5 , wherein the microphone array includes a plurality of microphones that are horizontally aligned along the front surface of the housing.

7. The image capture device of claim 1 , wherein the first camera controller is configured to control the first camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the first exposure setting.

8. The image capture device of claim 1 , wherein the second camera controller is configured to control the second camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the second exposure setting.

9. A system for facilitating interactivity with an interactive application, comprising:
a controller device having an illuminated object;
an image capture device, the image capture device including a first camera, a second camera, a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting, and a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting;
a computing device connected to the image capture device,
the computing device configured to execute the interactive application,
the computing device configured to analyze the captured images from the first camera to detect a dynamic range of the interactive environment and determine the second exposure setting based on the detected dynamic range, the second exposure setting being configured to enable capture of objects that are the brightest objects in the interactive environment,
the computing device configured to analyze the captured images from the first camera to track a user in the interactive environment, wherein the captured images from the first camera are not analyzed to track the illuminated object,
the computing device configured to analyze the captured images from the second camera to track the illuminated object in the interactive environment, the illuminated object being one of the objects that are the brightest objects in the interactive environment, wherein the captured images from the second camera are not analyzed to track the user.

10. The system of claim 9 , wherein the second exposure setting is configured to exclude capture of objects that are not the brightest objects in the interactive environment.

11. The system of claim 9 , wherein tracking the user includes tracking a face of the user.

12. The system of claim 9 , wherein the first camera and the second camera are horizontally aligned along the front surface of the housing.

13. The system of claim 9 , further comprising a microphone array for capturing sound from the interactive environment.

14. The system of claim 13 , wherein the microphone array includes a plurality of microphones that are horizontally aligned along the front surface of the housing.

15. The system of claim 9 , wherein the first camera controller is configured to control the first camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the first exposure setting.

16. The system of claim 9 , wherein the second camera controller is configured to control the second camera to capture images of the interactive environment prior to the user interactivity, the images captured prior to the user interactivity being analyzed to determine the second exposure setting.

17. A method for interactivity with an interactive application, comprising:
capturing images from an interactive environment during user interactivity at a first exposure setting;
analyzing the images captured at the first exposure setting to detect a dynamic range of the interactive environment and to track a user;
simultaneous with the capturing images at the first exposure setting, capturing images from the interactive environment during the user interactivity at a second exposure setting based on the detected dynamic range, the second exposure setting being lower than the first exposure setting and configured to enable capture of objects that are the brightest objects in the interactive environment, wherein the second exposure setting is configured to exclude capture of objects that are not the brightest objects in the interactive environment;
analyzing the images captured at the second exposure setting to track an illuminated object in the interactive environment that is among the objects that are the brightest objects in the interactive environment, wherein the images captured at the second exposure setting are not analyzed to track the user.

18. The method of claim 17 , wherein tracking the user includes tracking a face of the user.

19. The method of claim 17 , further comprising, analyzing the images captured at the first exposure setting to identify and track an AR tag.

20. The method of claim 17 , further comprising, capturing sound from the interactive environment.

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Mikhailov Anton
• Marks Richard
• Larsen Eric

Classifications

• A63F2300/6072

  of an input signal, e.g. pitch and rhythm extraction, voice recognition · CPC title

• A63F13/22

  Setup operations, e.g. calibration, key configuration or button assignment · CPC title

• A63F13/843

  involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player · CPC title

• A63F2300/6045

  for mapping control signals received from the input arrangement into game commands · CPC title

• G06T2207/10152

  Varying illumination · CPC title