Image generation device and image generation method for multiplexing captured images to generate an image stream

Patent metadata

Field	Value
Publication number	US-9583133-B2
Application number	US-201214402633-A
Country	US
Kind code	B2
Filing date	Jun 11, 2012
Priority date	Jun 11, 2012
Publication date	Feb 28, 2017
Grant date	Feb 28, 2017

Abstract

Frame memories store captured images supplied from a plurality of imaging units, respectively. A motion detection portion detects the motion of a captured image of at least one of the imaging units. A mode determination portion sets, in accordance with at least either the amount of the motion detected by the motion detection portion or a power consumption limit of the image generation device, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently. A control signal generation portion supplies, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the mode set by the mode determination portion.

First claim

The invention claimed is:

1. An image generation device comprising:
a plurality of frame memories adapted to store captured images from a plurality of imaging units; and
a multiplexing section adapted to read the captured images of the imaging units from the frame memories and multiplex the captured images to generate an image stream,
wherein the multiplexing section includes
a motion detection portion adapted to detect a motion of a captured image of at least one of the imaging units,
a mode determination portion adapted to set, in accordance with at least one of: (i) an amount of the motion detected by the motion detection portion, and (ii) a predetermined power consumption limit of the image generation device, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and
a control signal generation portion adapted to supply, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the mode set by the mode determination portion.

2. The image generation device of claim 1 further comprising
a shooting control section adapted to control operations of the plurality of imaging units,
wherein the shooting control section supplies, to the plurality of imaging units, a control signal adapted to operate the plurality of imaging units simultaneously or intermittently in accordance with the mode set by the mode determination portion.

3. The image generation device of claim 2 ,
wherein, even when the mode for operating the plurality of imaging units intermittently is set by the mode determination portion, the control signal generation portion supplies, to the plurality of frame memories, a control signal adapted to operate the plurality of frame memories intermittently while operating the plurality of imaging units simultaneously.

4. The image generation device of claim 1 , wherein
the mode determination portion sets the mode for operating the plurality of imaging units simultaneously when the amount of the motion detected by the motion detection portion is equal to or greater than a given threshold, and
the mode determination portion sets the mode for operating the plurality of imaging units intermittently when the amount of the motion detected by the motion detection portion is smaller than the given threshold.

5. The image generation device of claim 4 , wherein,
even when the amount of the motion detected by the motion detection portion is equal to or greater than the given threshold, but when the image generation device is not operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units intermittently, and
when the amount of the motion detected by the motion detection portion is equal to or greater than the given threshold, and when the image generation device is operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously.

6. The image generation device of claim 1 , wherein,
when the image generation device is operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously, and
when the image generation device is not operating within the power consumption limit, the mode determination portion sets the mode for operating the plurality of imaging units intermittently.

7. The image generation device of claim 1 , wherein,
when the image generation device is operating on power from an external power source, the mode determination portion sets the mode for operating the plurality of imaging units simultaneously, and
when the image generation device is operating on power from a built-in chargeable battery, the mode determination portion sets the mode for operating the plurality of imaging units intermittently.

8. An image generation method comprising:
storing captured images from a plurality of imaging units in a plurality of frame memories; and
reading the captured images of the imaging units from the frame memories and multiplexing the captured images to generate an image stream,
wherein the reading includes
detecting a motion of a captured image of at least one of the imaging units,
setting, in accordance with at least one of: (i) an amount of the motion detected by the motion detection portion, and (ii) a predetermined power consumption limit, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and
supplying, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the set mode.

9. A non-transitory, computer-readable recording medium storing a program for a computer, the program comprising:
a module configured to store captured images from a plurality of imaging units in a plurality of frame memories; and
a module configured to read the captured images of the imaging units from the frame memories and multiplexing the captured images to generate an image stream,
wherein the module configured to read includes
a module configured to detect a motion of a captured image of at least one of the imaging units,
a module configured to set, in accordance with at least one of: (i) an amount of the motion detected by the motion detection portion, and (ii) a predetermined power consumption limit, one of two modes, one for operating the plurality of imaging units simultaneously and the other for operating the plurality of imaging units intermittently, and
a module configured to supply, to the plurality of frame memories, a control signal adapted to control reading of the captured images from the plurality of frame memories in accordance with the set mode.

Assignees

• Hirata Shinichi
• Osawa Hiroshi
• Furumura Kyoko
• Sony Corp
• Sony Interactive Entertainment Inc

Inventors

• Hirata Shinichi
• Osawa Hiroshi
• Furumura Kyoko

Classifications

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/651

  for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera · CPC title

• H04N1/21 Primary

  Intermediate information storage (H04N1/387, H04N1/41 take precedence {; for control between transmitter and receiver or between image input and image output device H04N1/32358; indexing, editing G11B27/00}) · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title