Method and device for video browsing based on keyframe

Patent metadata

Field	Value
Publication number	US-9799376-B2
Application number	US-201514696691-A
Country	US
Kind code	B2
Filing date	Apr 27, 2015
Priority date	Sep 17, 2014
Publication date	Oct 24, 2017
Grant date	Oct 24, 2017

Abstract

A method for video browsing includes comparing a current image frame with a previous image frame prior to the current image frame in a video to obtain target block information, identifying the current image frame as a keyframe if the target block information satisfies a predetermined condition, and playing the keyframe.

First claim

What is claimed is:

1. A method for video browsing, comprising:
comparing a current image frame with a previous image frame prior to the current image frame in a video to obtain target block information;
identifying the current image frame as a keyframe when the target block information satisfies a predetermined condition; and
playing the keyframe;
wherein:
the current image frame includes an image of a person, and
identifying the current image frame as the keyframe includes:
determining whether posture information of the person in the current image frame has changed relative to the previous image frame, and whether the target block information in the current image frame excluding the person satisfies the predetermined condition; and
when the posture information has changed and the target block information in the current image frame excluding the person satisfies the predetermined condition, identifying the current image frame as the keyframe.

2. The method according to claim 1 , wherein:
the current image frame includes at least one target block,
the previous image frame includes at least one target block, and
comparing the current image frame with the previous image frame includes:
comparing the at least one target block in the previous image frame and the at least one target block in the current image frame;
when the current image frame includes a newly-added target block that does not exist in the previous image frame, setting flag bit information for the newly-added target block as the target block information of the newly-added target block, the flag bit information being the number of already identified keyframes plus 1;
when the current image frame includes an existing target block that also exists in the previous image frame, calculating movement information of the existing target block in the current image frame relative to the previous image frame to obtain the target block information of the existing target block; and
when the previous image frame includes a disappeared target block that does not exist in the current image frame, obtaining the target block information of the disappeared target block.

3. The method according to claim 2 , wherein:
the current image frame includes at least one existing target block, and
identifying the current image frame as the keyframe includes:
reading the movement information of each of the at least one existing target block from the target block information of the current image frame, the movement information of an existing target block including at least one of the number of moving times, a movement displacement, or a movement destination of the existing target block;
determining whether the number of existing target blocks having movement information satisfying a movement condition is greater than a predetermined threshold; and
when the number of existing target blocks having movement information satisfying the movement condition is greater than the predetermined threshold, identifying the current image frame as the keyframe.

4. The method according to claim 2 , wherein identifying the current image frame as the keyframe includes:
reading the flag bit information of each target block from the target block information of the current image frame;
determining whether there exists flag bit information identical to the flag bit information of the disappeared target block; and
when there exists no flag bit information identical to the flag bit information of the disappeared target block, identifying the current image frame as the keyframe.

5. The method according to claim 1 , further comprising:
acquiring image frames in the video and sensor information when shooting the image frames, the sensor information including at least one of Global Positioning System (GPS) information, acceleration information, or ISO sensitivity information;
discarding image frames that do not satisfy a screening condition according to the sensor information; and
designating one of remaining image frames as the current image frame.

6. The method according to claim 2 , wherein the method further comprises:
acquiring image frames in the video and sensor information when shooting the image frames, the sensor information including at least one of Global Positioning System (GPS) information, acceleration information, or ISO sensitivity information;
discarding image frames that do not satisfy a screening condition according to the sensor information; and
designating one of remaining image frames as the current image frame.

7. The method according to claim 3 , wherein the method further comprises:
acquiring image frames in the video and sensor information when shooting the image frames, the sensor information including at least one of Global Positioning System (GPS) information, acceleration information, or ISO sensitivity information;
discarding image frames that do not satisfy a screening condition according to the sensor information; and
designating one of remaining image frames as the current image frame.

8. The method according to claim 4 , wherein the method further comprises:
acquiring image frames in the video and sensor information when shooting the image frames, the sensor information including at least one of Global Positioning System (GPS) information, acceleration information, or ISO sensitivity information;
discarding image frames that do not satisfy a screening condition according to the sensor information; and
designating one of remaining image frames as the current image frame.

9. The method according to claim 1 , further comprising:
designating an image frame next to the current image frame as a new current image frame; and
repeatedly performing the comparing of the current image frame with its corresponding previous image frame, identifying a keyframe, and designating a new current image frame until a last image frame in the video has been compared with its corresponding previous image frame;
wherein playing the keyframe includes playing at least one of the identified keyframes.

10. A device for video browsing, comprising:
a processor; and
a non-transitory computer-readable storage medium storing instructions that, when executed by the processor, cause the processor to:
compare a current image frame with a previous image frame prior to the current image frame in a video to obtain target block information;
identify the current image frame as a keyframe when the target block information satisfies a predetermined condition; and
play the keyframe;

wherein:
the current image frame includes an image of a person, and
the instructions further cause the processor to:
determine whether posture information of the person in the current image frame has changed relative to the previous image frame, and whether the target block information in the current image frame excluding the person satisfies the predetermined condition; and
when the posture information has changed and the target block information in the current image frame excluding the person satisfies the predetermined condition, identify the current image frame as the keyframe.

11. The device according to claim 10 , wherein
the current image frame includes at least one target block,
the previous image frame includes at least one target block, and
the instructions further cause the processor to:
compare the at least one target block in the previous image frame and the at least one target block in the current image frame;
when the current image frame includes a newly-added target block that does not exist in the previous image frame, set flag bit information for the newly-added target block as the target block information of the newly-added

Assignees

• Xiaomi Inc

Inventors

• Wang Baichao
• Qin Qiuping
• Hou Wendi

Classifications

• G11B27/34 Primary

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G11B27/11

  by using information not detectable on the record carrier · CPC title

• G11B27/105

  of operating discs · CPC title

• G11B27/3081

  used signal is a video-frame or a video-field (P.I.P) · CPC title