High framerate video recording

Patent metadata

Field	Value
Publication number	US-10861497-B2
Application number	US-201916411097-A
Country	US
Kind code	B2
Filing date	May 13, 2019
Priority date	May 14, 2018
Publication date	Dec 8, 2020
Grant date	Dec 8, 2020

Abstract

A device for recording videos includes an image signal processor to process frames captured in response to a request for recording a video at a first frame rate, and a video encoder to encode captured frames. The device also includes processing circuitry operative to allocate image buffers from memory in response to the request, and execute a camera software to direct the image signal processor to fill each image buffer with a batch of the captured frames. For each filled image buffer, a reference of the image buffer is passed from the camera software to a video software at a second rate, which is a fraction of the first frame rate. The processing circuitry then executes the video software to provide one frame at a time to the video encoder for encoding at the first frame rate.

First claim

What is claimed is:

1. A device operative to record videos, comprising:
an image signal processor to process frames captured in response to a request for recording a video at a first frame rate;
a video encoder to encode captured frames;
a memory to store a plurality of image buffers, wherein each image buffer contains a plurality of frame buffers and each frame buffer to store one captured frame; and
processing circuitry including one or more processors coupled to the memory and operative to:
allocate the image buffers from the memory in response to the request,
execute a camera software to direct the image signal processor to fill each image buffer with a batch of the captured frames,
for each image buffer filled up with the batch of the captured frames, pass a reference of the image buffer at a second rate from the camera software to a video software, wherein the second rate is a fraction of the first frame rate, and
execute the video software to provide one frame at a time to the video encoder for encoding at the first frame rate.

2. The device of claim 1 , wherein the processing circuitry is further operative to determine a size of the image buffer according to a ratio of the first frame rate to the second rate.

3. The device of claim 2 , wherein the size of the image buffer is equal to the first frame rate divided by the second rate.

4. The device of claim 2 , wherein the processing circuitry is further operative to determine the size of the image buffer dynamically after receiving the request for recording the video at the first frame rate.

5. The device of claim 1 , wherein the processing circuitry is further operative to execute camera middleware to split each image buffer into the plurality of frame buffers for the image signal processor to fill.

6. The device of claim 1 , wherein the processing circuitry is further operative to execute video middleware to split each image buffer filled up by the image signal processor into the plurality of frame buffers for video encoding.

7. The device of claim 1 , wherein the processing circuitry is further operative to execute a camera framework and a video framework as part of the camera software and the video software, respectively, and wherein the camera framework passes the reference of the image buffer at the second rate to the video framework.

8. The device of claim 1 , wherein the camera software passes metadata to the image signal processor to indicate the number of frames in each batch.

9. The device of claim 1 , wherein after the video encoder completes encoding the batch of the captured frames in a given image buffer, the given image buffer is released for reuse by the image signal processor.

10. A method for recording videos, comprising:
receiving a request for video recording at a first frame rate;
allocating a plurality of image buffers from memory in response to the request;
filling each image buffer with a batch of captured frames by an image signal processor, wherein each image buffer contains a plurality of frame buffers and each frame buffer to store one captured frame;
for each image buffer filled up with the batch of the captured frames, passing a reference of the image buffer at a second rate from a camera software to a video software, wherein the second rate is a fraction of the first frame rate, and
providing one frame at a time to a video encoder for encoding at the first frame rate.

11. The method of claim 10 , further comprising:
determining a size of the image buffer according to a ratio of the first frame rate to the second rate.

12. The method of claim 11 , wherein the size of the image buffer is equal to the first frame rate divided by the second rate.

13. The method of claim 11 , further comprising:
determining the size of the image buffer dynamically after receiving the request for recording the video at the first frame rate.

14. The method of claim 10 , further comprising:
executing camera middleware to split each image buffer into the plurality of frame buffers for the image signal processor to fill.

15. The method of claim 10 , further comprising:
execute video middleware to split each image buffer filled up by the image signal processor into the plurality of frame buffers for video encoding.

16. The method of claim 10 , further comprising:
executing a camera framework and a video framework as part of the camera software and the video software, respectively, and wherein the camera framework passes the reference of the image buffer at the second rate to the video framework.

17. The method of claim 10 , further comprising:
passing metadata from the camera software to the image signal processor to indicate the number of frames in each batch.

18. The method of claim 10 , wherein after the video encoder completes encoding the batch of the captured frames in a given image buffer, releasing the given image buffer for reuse by the image signal processor.

Assignees

• Mediatek Inc

Inventors

• Chou Kuan-Hung
• Lu Li-Wei

Classifications

• H04N23/951

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title

• H04N19/146

  Data rate or code amount at the encoder output · CPC title

• H04N5/76 Primary

  Television signal recording · CPC title

• G11B2020/00072

  the compressed signal including a video signal · CPC title

• H04N5/772

  the recording apparatus and the television camera being placed in the same enclosure · CPC title