Multi-aperture camera with optical image stabilization function

Patent metadata

Field	Value
Publication number	US-9681052-B1
Application number	US-201514598424-A
Country	US
Kind code	B1
Filing date	Jan 16, 2015
Priority date	Jan 16, 2015
Publication date	Jun 13, 2017
Grant date	Jun 13, 2017

Abstract

Systems and methods are described that relate to optical image stabilization in mobile computing devices that include multiple optical element sets. In an example embodiment, a mobile computing device may include a plurality of optical element assemblies, which may be coupled to a shared frame. The shared frame may be configured to maintain a fixed spatial arrangement between the optical element assemblies. A controller may receive a signal indicative of a movement of the mobile computing device. Based at least on the signal, the controller may determine a stabilization movement of the shared frame. The controller may cause an actuator to move the shared frame according to the stabilization movement. Optionally, the shared frame may also be configured to provide focus adjustments. For example, the controller may be additionally configured to cause the shared frame to move to a focus position based on a focus signal.

First claim

What is claimed is:

1. A device comprising:
a shared frame coupled to a plurality of optical element assemblies such that movement of the shared frame causes a corresponding movement of the plurality of optical element assemblies while maintaining a fixed spatial arrangement of the optical element assemblies;
a plurality of actuators coupled to the shared frame, wherein at least one actuator of the plurality of actuators is disposed between optical axes of the plurality of optical element assemblies; and
a controller configured to carry out instructions, the instructions including:
determining a three-dimensional stabilization movement of the shared frame in response to a movement of the device, wherein the three-dimensional stabilization movement comprises a perpendicular component and an axial component, wherein the perpendicular component comprises a movement of the shared frame along a plane perpendicular to an optical axis of at least one of the plurality of optical element assemblies, wherein the axial component comprises a movement of the shared frame parallel to an optical axis of at least one of the plurality of optical element assemblies; and
causing the plurality of actuators to move the shared frame according to the three-dimensional stabilization movement.

2. The device of claim 1 , wherein moving the shared frame according to the three-dimensional stabilization movement causes the plurality of optical element assemblies to move a substantially same amount of distance and in a substantially same direction.

3. The device of claim 1 , wherein a given optical element assembly of the plurality of optical element assemblies comprises a plurality of optical elements configured to focus light along an optical axis of the given optical element assembly.

4. The device of claim 1 further comprising a sensor, wherein the sensor is configured to provide movement data to the controller based on the movement of the device and wherein determining the three-dimensional stabilization movement of the shared frame is based on the movement data.

5. The device of claim 1 , wherein at least one actuator of the plurality of actuators comprises a piezoelectric actuator, MEMS actuator, or a shape memory alloy.

6. The device of claim 1 , wherein the controller is further operable to:
determine a focus position of the shared frame, based on the movement of the device, wherein the focus position comprises a position of the shared frame along an optical axis of at least one of the plurality of optical element assemblies; and
cause at least one focus actuator coupled to the shared frame to move the shared frame to the focus position.

7. The device of claim 1 , further comprising a shared image sensor frame coupled to a plurality of image sensors and at least one focus actuator coupled to the shared image sensor frame, wherein the shared image sensor frame is configured to maintain the plurality of image sensors in a second fixed spatial arrangement, wherein the plurality of image sensors are configured to sense light, and wherein the controller is further operable to:
determine a focus position of the shared image sensor frame, based on the movement of the device, wherein the focus position comprises a position of the shared image sensor frame along an optical axis of at least one of the plurality of optical element assemblies; and
cause the at least one focus actuator to move the shared image sensor frame to the focus position.

8. A device comprising:
a plurality of image sensors configured to sense light;
a shared frame coupled to the plurality of image sensors such that movement of the shared frame causes a corresponding movement of the plurality of image sensors while maintaining a fixed spatial arrangement of the plurality of image sensors a plurality of optical element assemblies;
a plurality of actuators coupled to the shared frame, wherein at least one actuator of the plurality of actuators is disposed between optical axes of the plurality of optical element assemblies; and
a controller configured to carry out instructions, the instructions including:
determining a three-dimensional stabilization movement of the shared frame based on a movement of the device, wherein the three-dimensional stabilization movement comprises a first component and a second component, wherein the first component comprises a movement of the shared frame perpendicular to a focal plane of at least one of the plurality of image sensors, wherein the second component comprises a movement of the shared frame along a focal plane of at least one of the plurality of image sensors; and
causing the plurality of actuators to move the shared frame according to the three-dimensional stabilization movement.

9. The device of claim 8 , wherein the shared frame comprises a common substrate and wherein moving the common substrate according to the three-dimensional stabilization movement causes the plurality of image sensors to move a substantially same amount of distance and in a substantially same direction.

10. The device of claim 8 further comprising a sensor, wherein the sensor is configured to provide movement data to the controller based on the movement of the device and wherein determining the three-dimensional stabilization movement of the shared frame is based on the movement data.

11. The device of claim 8 , wherein at least one actuator of the plurality of actuators comprises a piezoelectric actuator, MEMS actuator, or a shape memory alloy.

12. The device of claim 8 , further comprising a shared focus frame coupled to the plurality of optical element assemblies and at least one focus actuator coupled to the shared focus frame, wherein the shared focus frame is configured to maintain the plurality of optical element assemblies in a second fixed spatial arrangement, wherein the plurality of optical element assemblies are configured to focus light, and wherein the controller is further operable to:
determine a focus position of the shared focus frame, based on the movement of the device, wherein the focus position comprises a position of the shared focus frame along an optical axis of at least one of the plurality of optical element assemblies; and
cause the at least one focus actuator to move the shared focus frame to the focus position.

13. The device of claim 8 , further comprising a subframe coupled to the shared frame and at least one focus actuator coupled to the subframe, wherein the subframe is configured to maintain the plurality of optical element assemblies in a second fixed spatial arrangement, wherein the plurality of optical element assemblies are configured to focus light, and wherein the controller is further operable to:
determine a focus position of the subframe, based on the movement of the device, wherein the focus position comprises a position of the subframe along an optical axis of at least one of the plurality of optical element assemblies; and
cause the at least one focus actuator to move the subframe to the focus position.

14. The device of claim 8 , wherein the plurality of optical element assemblies are arranged in a second fixed spatial arrangement, wherein the plurality of optical element assemblies are configured to focus light, and wherein the controller is further operable to:
determine a focus position of the shared frame, based on the movement of the device, wherein the focus position comprises a position of the shared frame along an optical axis of at least one of the plurality of optical element assemblies; and
cause the plurality of actuators to move the shared frame to the focus position.

15. A method

Assignees

• Google Inc

Inventors

• Lewkow Roman

Classifications

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• G02B7/08 Primary

  adapted to co-operate with a remote control mechanism · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• H04N23/687 Primary

  by shifting the lens or sensor position · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title