Electronic device and operation method thereof

Patent metadata

Field	Value
Publication number	US-10504560-B2
Application number	US-201715648766-A
Country	US
Kind code	B2
Filing date	Jul 13, 2017
Priority date	Aug 1, 2016
Publication date	Dec 10, 2019
Grant date	Dec 10, 2019

Abstract

The present disclosure relates to an electronic device and a method of operation thereof, and the electronic device includes: a display; and a processor electrically connected with the display, and the processor is configured to extract a plurality of frames from video data, to identify a size of an object included in each of the extracted frames and a number of objects, to determine a layout regarding each of the extracted frames based on the size of the object and the number of objects, and to display the extracted frames on the display to correspond to the layout.

First claim

What is claimed is:

1. An electronic device comprising:
a display; and
a processor connected with the display, the processor configured to:
extract a plurality of frames from video data,
identify, based on a face recognition function, first objects in each of the extracted frames,
select a set of frames from the extracted frames based on at least one of sizes of the first objects identified in each of the extracted frames or a number of the objects identified in each of the extracted frames,
determine a layout for displaying the extracted frames based on the set of frames, and
display the extracted frames on the display according to the determined layout,

wherein the processor is further configured to:
if a number of the frames included in the set of frames is less than a reference frame number, identify, based on a recognition function, second objects in each of the extracted frames,
select an additional set of frames from the extracted frames based on at least one of sizes of the second objects identified in each of the extracted frames or a number of the second objects identified in each of the extracted frames, and
update the set of frames by adding the additional set of frames.

2. The electronic device of claim 1 , wherein the layout comprises at least one of: a size of a frame and a display location of a frame.

3. The electronic device of claim 1 , wherein the processor is configured to,
display the set of the frames comprising frames of which the number of at least one of the first objects or the second objects is within a predetermined number range to a first layout, and
display at least one other frame from among the extracted frames to a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout.

4. The electronic device of claim 1 , wherein the processor is configured to,
display the set of the frames comprising frames of which the sizes of at least one of the first objects or the second objects is within a predetermined size range to a first layout, and
display at least one other frame from among the extracted frames to a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout.

5. The electronic device of claim 1 , wherein the processor is configured to,
display at least one frame related to a first specified photographing mode from among the set of the frames to a first layout, and
display at least one other frame related to a second specified photographing mode from among the set of the frames to a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout.

6. The electronic device of claim 1 , wherein the processor is configured to,
display at least one frame comprising audio information satisfying a first condition from among the set of the frames to a first layout, and
display at least one other frame comprising audio information satisfying a second condition from among the set of the frames to a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout, and
wherein the audio information satisfying the condition comprises at least one of: a change in an emotion and a change in a speaker.

7. The electronic device of claim 1 , wherein the processor is configured to,
display a frame having a time interval greater than or equal to a reference time from among the set of the frames to a first layout, and
display a frame having a time interval less the reference time from among the set of the frames to a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout.

8. The electronic device of claim 1 , wherein the processor is configured to display the extracted frames based on a time sequence of the frames.

9. The electronic device of claim 1 , wherein, in response to at least one frame being selected from among the extracted frames displayed on the display, the processor is configured to determine a time to reproduce the video data based on the selected frame.

10. The electronic device of claim 1 , wherein the layout comprises at least one of: a size of a frame and a display location of a frame.

11. A method of operating an electronic device, the method comprising:
extracting a plurality of frames from video data;
identifying, based on a face recognition function, at least one first objects in each of the extracted frames;
selecting a set of frames from the extracted frames based on at least one of sizes of the first objects identified in each of the extracted frames or a number of the objects identified in each of the extracted frames;
determining a layout for displaying the extracted frames based on the set of frames;
displaying the extracted frames according to the determined layout,
if a number of the frame included in the set of frames is less than a reference frame number, identifying, based on a recognition function, second objects in each of the extracted frames,
selecting an additional set of frames from the extracted frames based on at least one of sizes of the second objects identified in each of the extracted frames or a number of the second objects identified in each of the extracted frames,
updating the set of frames by adding the additional set of frames.

12. The method of claim 11 , wherein determining the layout comprises determining at least one of: a size of a frame and a display location of a frame.

13. The method of claim 11 , wherein determining the layout comprises determining the set of the frames comprising frames of which the number of at least one of the first objects or the second objects is within a predetermined number range as a first layout, and determining at least one other frame from among the extracted frames as a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout.

14. The method of claim 11 , wherein determining the layout comprises determining the set of the frames comprising frames of which the size of at least one of the first objects or the second objects is within a predetermined size range as a first layout, and determining at least one other frame from among the extracted frames as a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout.

15. The method of claim 11 , wherein determining the layout comprises determining at least one frame related to a first specified photographing mode from among the set of the frames as a first layout, and determining at least one other frame related to a second specified photographing mode from among the set of the frames as a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout.

16. The method of claim 11 , wherein determining the layout comprises determining at least one frame comprising audio information satisfying a first condition from among the set of the frames as a first layout, and determining at least one other frame comprising audio information satisfying a second condition from among the set of the frames as a second layout,
wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout, and
wherein the audio information satisfying the condition comp

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Seoyoung
• LEE Bado
• Jung Yumin
• Kim Daehee
• Shin Dae-Kyu
• Cho Sung Dae
• Park Ji-Yoon

Classifications

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G11B27/3081 Primary

  used signal is a video-frame or a video-field (P.I.P) · CPC title

• H04N5/93

  Regeneration of the television signal or of selected parts thereof · CPC title