Systems and methods for producing a flipbook

Patent metadata

Field	Value
Publication number	US-11688076-B2
Application number	US-201916663695-A
Country	US
Kind code	B2
Filing date	Oct 25, 2019
Priority date	Oct 25, 2019
Publication date	Jun 27, 2023
Grant date	Jun 27, 2023

Abstract

A system for producing a flipbook includes a processor that receives a video comprising a plurality of frames, selects a start frame and an end frame, and a plurality of frames therebetween. The processor can analyze the frames of the segment to determine an average rate of change of the plurality of frames and a threshold of relative image difference based on the average rate of change of the plurality of frames and a baseline frame rate. The processor can select, based on the results of its analysis, a plurality of selected frames, each of the selected frames being separated from two other selected frames by a sub-segment of the video, wherein each pair of adjacent frames comprises a relative image difference above the threshold and wherein each selected frame meets quality criteria not met by one or more local frames. The processor arranges the selected frames in temporal order, adds a protruding edge to each of the selected frames, and transmits data representing each of the selected frames to a printer for printing and binding a flipbook.

First claim

What is claimed is:

1. A system for producing a flipbook comprising processing circuitry configured to:
receive a video comprising a plurality of frames;
select a start frame and an end frame of a subject of the video, and a plurality of frames therebetween defining a segment of the video, wherein the start frame is selected based on a predetermined percentage change relative to a previous frame;
analyze the plurality of frames of the segment to determine an average rate of change of the plurality of frames by comparing a number of pixels in one of the plurality of frames to a number of pixels in a previous frame;
determine a threshold of relative image difference based on the average rate of change of the plurality of frames and a baseline frame rate, wherein the threshold is adjustable based on the nature of the video;
select, based on the results of analyzing the plurality of frames, a plurality of selected frames, each of the selected frames being separated from two other selected frames by a sub-segment of the video, wherein each pair of selected sequential frames comprises a relative image difference above the threshold and wherein each selected frame meets quality criteria not met by one or more local frames;
arrange the selected frames in temporal order;
add a protruding edge to each of the selected frames; and
transmit data representing each of the selected frames, in temporal order, to a printer for printing and binding a flipbook.

2. The system of claim 1 , wherein the processing circuitry is further configured to:
create a preview video comprising each of the selected frames; and
display the preview video, by a display, at an expected flip rate of the flipbook.

3. The system of claim 1 , wherein the threshold of relative image difference is determined using a machine learning algorithm.

4. The system of claim 1 , wherein the processing circuitry is further configured to select the start frame and the end frame of a subject of the video based on a user selection.

5. The system of claim 1 , wherein the processing circuitry is further configured to select the start frame and the end frame of a subject of the video is based on relative change based on configurable threshold and/or configurable data change.

6. The system of claim 1 , wherein the length of each sub-segment varies based on the selection of frames that meet quality criteria not met by the one or more local frames.

7. The system of claim 1 , wherein the processing circuitry is further configured to automatically edit the selected frames for quality, including one or more of the following: red eye reduction, brightness adjustment, blemish removal, and cropping.

8. The system of claim 1 , wherein the processing circuitry is further configured to present one or more of the selected frames to a user to optionally apply edits based on quality.

9. The system of claim 1 , wherein the frame rate of the video-is one of 60 or 24 frames per second.

10. The system of claim 1 , wherein the processing circuitry is further configured analyze at least one of:
a plurality of frames before or after the start frame, and begin analyzing the segment at a frame of the plurality of frames before or after the start frame which has a highest quality; and
a plurality of frames before or after the end frame, and stop analyzing the segment at a frame of the plurality of frames before or after the end frame which has a highest quality.

11. A method for producing a flipbook comprising:
receiving, by processing circuitry, a video comprising a plurality of frames;
selecting, by the processing circuitry, a start frame and an end frame of a subject of the video, and a plurality of frames therebetween defining a segment of the video, wherein the start frame is selected based on a predetermined percentage change relative to a previous frame;
analyzing, by the processing circuitry, the plurality of frames of the segment to determine an average rate of change of the plurality of frames;
determining, by the processing circuitry, a threshold of relative image difference based on the average rate of change of the plurality of frames by comparing a number of pixels in one of the plurality of frames to a number of pixels in a previous frame and a baseline frame rate, wherein the threshold is adjustable based on the nature of the video;
selecting, by the processing circuitry, based on the results of analyzing the plurality of frames, a plurality of selected frames, each of the selected frames being separated from two other selected frames by a sub-segment of the video, wherein each pair of selected sequential frames comprises a relative image difference above the threshold and wherein each selected frame meets quality criteria not met by one or more local frames;
arranging, by the processing circuitry, the selected frames, in temporal order;
editing, by the processing circuitry, to add a protruding edge to each of the selected frames; and
transmitting, by the processing circuitry, data representing each of the selected frames, in temporal order, to a printer for printing and binding a flipbook.

12. The method of claim 11 , further comprising:
creating, by the processing circuitry, a preview video comprising each of the selected frames; and
displaying the preview video, by a display, at an expected flip rate of the flipbook.

13. The method of claim 11 , wherein the threshold of relative image difference is determined using a machine learning algorithm.

14. The method of claim 11 , wherein selecting the start frame and the end frame of a subject of the video is based on a user selection.

15. The method of claim 11 , wherein selecting the start frame and the end frame of a subject of the video is based on relative change based on configurable threshold and/or configurable data change.

16. The method of claim 11 , wherein the length of each sub-segment varies based on the selection of frames that meet quality criteria not met by the one or more local frames.

17. The method of claim 11 , wherein the selected frames are automatically edited for quality, including one or more of the following: red eye reduction, brightness adjustment, blemish removal, and cropping.

18. The method of claim 11 , wherein one or more of the selected frames is presented to a user to optionally apply edits based on quality.

19. The method of claim 11 , wherein the frame rate of the video is one of 60 or 24 frames per second.

20. The method of claim 11 , further comprising analyzing at least one of:
a plurality of frames before or after the start frame, and beginning analyzing the segment at a frame of the plurality of frames before or after the start frame which has a highest quality; and
a plurality of frames before or after the end frame, and stopping analyzing the segment at a frame of the plurality of frames before or after the end frame which has a highest quality.

Assignees

• Fujifilm North America Corp

Inventors

• Dolce James
• Curry Nathaniel
• Moore Ryan

Classifications

• G06V20/47

  Detecting features for summarising video content · CPC title

• G06T5/005

  Physics · mapped topic

• H04N5/147

  Scene change detection · CPC title

• G06T2207/30168

  Image quality inspection · CPC title

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title