Electronic device and method for increasing a frame rate of a plurality of pictures photographed by an electronic device

Patent metadata

Field	Value
Publication number	US-9906715-B2
Application number	US-201514952545-A
Country	US
Kind code	B2
Filing date	Nov 25, 2015
Priority date	Jul 8, 2015
Publication date	Feb 27, 2018
Grant date	Feb 27, 2018

Abstract

An electronic device includes a first camera module photographing according to a first frame rate, a second camera module photographing according to a second frame rate and a multimedia processor coupled to the first camera module and the second camera module. The multimedia processor instructs the first camera module and the second camera module to alternately photograph to obtain a sequence of pictures recorded at a third frame rate. The third frame rate is higher than the first frame rate and the second frame rate.

First claim

What is claimed is:

1. An electronic device, comprising:
a first camera module, photographing according to a first frame rate;
a second camera module, photographing according to a second frame rate; and
a multimedia processor, coupled to the first camera module and the second camera module, instructing the first camera module and the second camera module to alternately photograph to obtain a sequence of pictures recorded at a third frame rate,
wherein the third frame rate is higher than the first frame rate and the second frame rate,
wherein when an image resolution of a picture photographed by the first camera module and an image resolution of a picture photographed by the second camera module are different, at least one picture in the sequence of pictures having a lower image resolution is replaced by another picture in the sequence of pictures having a higher image resolution or replaced by a new frame generated by the multimedia processor and having the higher image resolution,
wherein the sequence of pictures comprises at least a first picture photographed by the first camera module and having a first resolution and a plurality of second pictures photographed by the second camera module and having a second resolution, and
wherein the multimedia processor further estimates displacement of an object captured in the sequence of pictures over a plurality of periods of time, selects a second picture from the plurality of second pictures according to the estimated displacement, and generates a third picture having the second resolution to replace the first picture in the sequence of pictures according to content of the selected second picture and a position of the object in the first picture.

2. The electronic device as claimed in claim 1 , wherein the first camera module has a first field of view (FOV) and the second camera module has a second FOV, wherein the first FOV is larger than the second FOV.

3. The electronic device as claimed in claim 1 , wherein the third frame rate is equal to or higher than twice the first frame rate or the second frame rate.

4. The electronic device as claimed in claim 1 , wherein the multimedia processor further measures a first delay time for the first camera module to photograph and a second delay time for the second camera module to photograph, and instructs the first camera module and the second camera module to photograph alternately according to the first delay time and the second delay time.

5. The electronic device as claimed in claim 4 , wherein the first delay time relates to a processing time of the first camera module, and the second delay time relates to a processing time of the second camera module.

6. The electronic device as claimed in claim 1 , wherein the first frame rate is adjustable, and the multimedia processor further dynamically adjusts the first frame rate according to a moving speed of an object captured in the sequence of pictures, wherein the multimedia processor increases the first frame rate when determining that the moving speed increases.

7. The electronic device as claimed in claim 6 , wherein the multimedia processor further estimates displacement of the object over a plurality of periods of time according to content of the sequence of pictures, and determines whether the moving speed increases or decreases according to the estimated displacement of the object.

8. The electronic device as claimed in claim 1 , wherein the second resolution is higher than the first resolution.

9. The electronic device as claimed in claim 1 , wherein a position of the object in selected second picture has a minimum displacement from the position of the object in the first picture.

10. A method for increasing a frame rate of a plurality of pictures photographed by an electronic device, the electronic device comprising at least a first camera module photographing according to a first frame rate and a second camera module photographing according to a second frame rate, the method comprising:
measuring a first delay time for the first camera module to photograph and a second delay time for the second camera module to photograph;
instructing the first camera module and the second camera module to alternately photograph according to the first delay time and the second delay time to obtain a sequence of pictures recorded at a third frame rate, wherein the sequence of pictures comprises at least a first picture photographed by the first camera module and having a first resolution and a plurality of second pictures photographed by the second camera module and having a second resolution;
estimating displacement of an object captured in the sequence of pictures over a plurality of periods of time according to content of the sequence of pictures;
selecting a second picture from the plurality of second pictures according to the estimated displacement; and
generating a third picture having the second resolution to replace the first picture in the sequence of pictures according to content of the selected second picture and a position of the object in the first picture,
wherein the third frame rate is higher than the first frame rate and the second frame rate, and
wherein when an image resolution of a picture photographed by the first camera module and an image resolution of a picture photographed by the second camera module are different, at least one picture in the sequence of pictures having a lower image resolution is replaced by another picture in the sequence of pictures having a higher image resolution or replaced by a new frame having the higher image resolution.

11. The method as claimed in claim 10 , wherein the third frame rate is equal to or higher than twice the first frame rate or the second frame rate.

12. The method as claimed in claim 10 , wherein the first camera module and the second camera module are alternately instructed to photograph according to a difference between the first delay time and the second delay time.

13. The method as claimed in claim 10 , wherein the first camera module has a first field of view (FOV) and the second camera module has a second FOV, wherein the first FOV is larger than and overlaps the second FOV.

14. The method as claimed in claim 10 , wherein the first delay time relates to a processing time of the first camera module, and the second delay time relates to a processing time of the second camera module.

15. The method as claimed in claim 10 , wherein the first frame rate is adjustable, the method further comprising:
determining a moving speed of an object captured in the sequence of pictures; and
dynamically adjusting the first frame rate according to the moving speed,
wherein the first frame rate increases when the moving speed increases, and the first frame rate decreases when the moving speed decreases.

16. The method as claimed in claim 15 , further comprising:
estimating displacement of the object over a plurality of periods of time according to content of the sequence of pictures; and
determining whether the moving speed increases or decreases according to the estimated displacement of the object.

17. The method as claimed in claim 10 , wherein the second resolution is higher than the first resolution.

18. The method as claimed in claim 10 , wherein a position of the object in the selected second picture has a minimum displacement from the position of the object in the first picture.

Assignees

• Htc Corp

Inventors

• Yang kai ming

Classifications

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/66 Primary

  Remote control of cameras or camera parts, e.g. by remote control devices · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/951 Primary

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title