Applying different motion blur parameters to spatial frame regions within a sequence of image frames

Patent metadata

Field	Value
Publication number	US-2018286019-A1
Application number	US-201815934394-A
Country	US
Kind code	A1
Filing date	Mar 23, 2018
Priority date	Mar 24, 2017
Publication date	Oct 4, 2018
Grant date	—

Abstract

First and second spatial frame regions are identified in a sequence of motion picture image frames captured at a high frame rate. Different motion blur parameters are determined for each of the first and second spatial frame regions. First and second intermediate frame sequences having frame rates less than the capture frame rate are generated from the original frame sequence. The first motion blur parameter is applied to the first intermediate frame sequence and the second motion blur parameter is applied to the second intermediate frame sequence. The first and second spatial frame regions in the corresponding first and second intermediate frame sequences are composited to produce an output frame sequence having different motion blur in different regions of the scene.

First claim

1 . A method of processing a sequence of image frames captured at a capture frame rate, the method comprising:
receiving the sequence of image frames captured at the capture frame rate; identifying a first spatial frame region for the image frames in the sequence of image frames, the first spatial frame region being a first subset of image information in the image frames; reducing the frame rate of the first spatial frame region in the sequence of image frames; and applying a first motion blur parameter to the first spatial frame region in the sequence of image frames.

2 . The method of claim 1 , further comprising:
identifying a second spatial frame region for the image frames in the sequence of image frames, the second spatial frame region being a second subset of image information in the image frames, the second subset different from the first subset; reducing the frame rate of the second spatial frame region in the sequence of image frames; and applying a second motion blur parameter to the second spatial frame region in the sequence of image frames, the second motion blur parameter different from the first motion blur parameter.

3 . A method of processing a sequence of image frames, the method comprising:
receiving the sequence of image frames captured at a capture frame rate; identifying a first spatial frame region for the image frames in the sequence of image frames, the first spatial frame region being a first subset of image information in the image frames; generating a plurality of intermediate frame sequences from the sequence of image frames; applying a first motion blur parameter to a first intermediate frame sequence; and after applying the first motion blur parameter to the first intermediate frame sequence, compositing the first spatial frame region of the first intermediate frame sequence with a different intermediate frame sequence.

4 . The method of claim 3 , wherein generating the first intermediate frame sequence comprises reducing the frame rate of the sequence of image frames.

5 . The method of claim 3 , wherein the applying the first motion blur parameter to the first intermediate frame sequence comprises applying the first motion blur parameter to the first spatial frame region of the first intermediate frame sequence.

6 . The method of claim 3 , further comprising:
identifying a second spatial frame region for the image frames in the sequence of image frames, the second spatial frame region being a second subset of image information in the image frames, the second subset different from the first subset, wherein the different intermediate frame sequence is the second spatial frame region of a second intermediate frame sequence.

7 . The method of claim 6 , further comprising:
before the compositing, applying a second motion blur parameter to the second intermediate frame sequence.

8 . The method of claim 7 , wherein the applying the second motion blur parameter to the second intermediate frame sequence comprises applying the second motion blur parameter to the second spatial frame region of the second intermediate frame sequence.

9 . The method of claim 6 , further comprising:
identifying a third spatial frame region for the image frames in the sequence of image frames, the third spatial frame region being a third subset of image information in the image frames, the third subset different from the first subset, and the third subset different from the second subset; and further compositing the third spatial frame region of a third intermediate frame sequence with the first spatial frame region of the first intermediate frame sequence and the second spatial frame region of the second intermediate frame sequence.

10 . The method of claim 6 , wherein the generating the second intermediate frame sequence comprises reducing the frame rate of the sequence of image frames.

11 . The method of claim 6 , wherein the first intermediate frame sequence has a first frame rate and first image content, wherein the second intermediate frame sequence has a second frame rate and second image content, wherein the first frame rate is the same as the second frame rate, and wherein the first image content and the second image content are substantially identical.

12 . A method of processing a sequence of image frames captured at a capture frame rate, the method comprising:
receiving the sequence of image frames; identifying a first spatial frame region for the image frames in the sequence of image frames, the first spatial frame region being a first subset of image information in the image frames; determining a first motion blur parameter for the first spatial frame region; identifying a second spatial frame region for the image frames in the sequence of image frames, the second spatial frame region being a second subset of image information in the image frames different from the first subset; determining a second motion blur parameter for the second spatial frame region different from the first motion blur parameter; generating a first intermediate frame sequence from the sequence of image frames, the first intermediate frame sequence having an output frame rate less than the capture frame rate; applying the first motion blur parameter to the first intermediate frame sequence; generating a second intermediate frame sequence from the sequence of image frames, the second intermediate frame sequence having the output frame rate; applying the second motion blur parameter to the second intermediate frame sequence; and for each image frame in the first intermediate frame sequence, compositing the first spatial frame region of the image frame in the first intermediate frame sequence with the second spatial frame region of the corresponding image frame in the second intermediate frame sequence.

13 . A system for processing a sequence of image frames captured at a capture frame rate, the system comprising one or more processors configured to perform the method of claim 1 .

14 . A system for processing a sequence of image frames, the system comprising one or more processors configured to perform the method of claim 3 .

15 . A system for processing a sequence of image frames, the system comprising one or more processors configured to perform the method of claim 12 .

16 . A computer program product for processing a sequence of image frames captured at a capture frame rate, the computer program product comprising a computer-readable storage medium having computer-readable program instructions thereon for causing at least one processor to perform the method of claim 1 .

17 . A computer program product for processing a sequence of image frames, the computer program product comprising a computer-readable storage medium having computer-readable program instructions thereon for causing at least one processor to perform the method of claim 3 .

18 . A computer program product for processing a sequence of image frames, the computer program product comprising a computer-readable storage medium having computer-readable program instructions thereon for causing at least one processor to perform the method of claim 12 .

Assignees

• Reald Inc

Inventors

• Davis Anthony

Classifications

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• H04N7/0137

  dependent on presence/absence of motion, e.g. of motion zones (H04N7/014 takes precedence; movement detection in television signals H04N5/144) · CPC title

• H04N7/0127

  by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter · CPC title

• G06T2207/20221

  Image fusion; Image merging · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title