Electronic device and control method thereof

Patent metadata

Field	Value
Publication number	US-11907290-B2
Application number	US-202217984749-A
Country	US
Kind code	B2
Filing date	Nov 10, 2022
Priority date	Apr 3, 2019
Publication date	Feb 20, 2024
Grant date	Feb 20, 2024

Abstract

An electronic device is provided. The electronic device includes a display, at least one processor, and at least one memory configured to store instructions that cause the at least one processor to obtain first information from a first still image frame that is included in a first moving image, obtain second information from the first moving image, identify at least one image function based on at least one of the first information or the second information, and control the display to display at least one function execution object for executing the at least one image function. Various other embodiments can be provided.

First claim

What is claimed is:

1. An electronic device comprising:
a display;
at least one processor; and
at least one memory configured to store instructions that cause the at least one processor to:
obtain information for a scene recognition result from a still image frame of a moving image, the scene recognition result comprising one of a human recognition result of recognizing a person included in the still image frame, an object recognition result of recognizing a shape included in the still image frame, a place recognition result of recognizing a geographical region included in the still image frame, or a movement recognition result of the human or the object detected in the still image frame,
determine, among a plurality of image functions related to the moving image, at least one image function based on the information for the scene recognition result, wherein the plurality of image functions include an image correction function, a text input function, a graphics interchange format (GIF) generation function, an image generation function, and an icon recommendation function,
control the display to display at least one function execution object corresponding to the determined at least one image function, and
execute, in response to detecting an input for selecting a function execution object of the at least one function execution object, an image function corresponding to the selected function execution object.

2. The electronic device of claim 1 , wherein the instructions are further configured to cause the at least one processor to:
control the display to playback the moving image,
in response to an input for stopping the playback, stop the playback of the moving image at the still image frame and display the still image frame.

3. The electronic device of claim 2 ,
wherein the at least one function execution object includes at least one of an image correction execution object corresponding to the image correction function, a text input execution object corresponding to the text input function, a GIF generation execution object corresponding to the GIF generation function, an image generation execution object corresponding to the image generation function, or an icon recommendation execution object corresponding to the icon recommendation function,
wherein, when the information on the human recognition result is obtained, the determined at least one image function includes the image correction function and the image generation function,
wherein, when the information on the object recognition result is obtained, the determined at least one image function includes the icon recommendation function,
wherein, when the information on the place recognition result is obtained, the determined at least one image function includes the text input function, and
wherein, when the information on the movement recognition result is obtained, the determined at least one image function includes the image generation function and the GIF generation function.

4. The electronic device of claim 3 ,
wherein the instructions are further configured to cause the at least one processor to:
in response to an input for selecting the image correction execution object, apply an image correction function to the still image frame and generate a corrected image frame, and
control the display to display the corrected image frame, and

wherein the image correction execution object comprises a portrait correction execution object to correct a face of a person in the still image frame, and
wherein the portrait correction execution object including at least one of an intensity correction object, an eye correction object, a face correction object, or a skin tone correction object.

5. The electronic device of claim 3 , wherein the instructions are further configured to cause the at least one processor to:
in response to an input for selecting the image correction execution object, apply an image correction function to the moving image and generate a second moving image, and
control the display to display the second moving image.

6. The electronic device of claim 3 , wherein the instructions are further configured to cause the at least one processor to:
control the display to display, in response to an input for selecting the text input execution object, a text input box,
generate, in response to an input for selecting the GIF generation execution object, a GIF file based on the still image frame,
extract, in response to an input for selecting the image generation execution object, a plurality of still image frames from the moving image based on the information, and generate a second moving image based on the plurality of still image frames, and
control the display to display, in response to an input for selecting the icon recommendation execution object, one or more selectable icons.

7. The electronic device of claim 3 ,
further comprising a communication circuit, and
wherein the instructions are further configured to, in response to an input for selecting the image generation execution object, cause the at least one processor to:
control the communication circuit to transmit the still image frame to a server,
control the communication circuit to receive one or more still image frames that are selected by the server based on the still image frame, and
generate a second moving image based on the one or more still image frames and the still image frame.

8. The electronic device of claim 3 , wherein the instructions are further configured to cause the at least one processor to:
identify a non-verbal communication in the still image frame,
identify a plurality of graphical objects corresponding to the non-verbal communication,
display the plurality of graphical objects, and
generate, in response to an input onto a first graphical object from the plurality of graphical objects, a second still image frame including the first graphical object.

9. The electronic device of claim 3 , wherein the instructions are further configured to cause the at least one processor to:
identify that a subject of the still image frame is performing a continuous action,
identify a plurality of image frames from the moving image corresponding to the continuous action, and
generate a second moving image based on the plurality of image frames and the still image frame.

10. The electronic device of claim 3 , wherein the instructions are further configured to cause the at least one processor to:
identify a person in the still image frame,
identify a plurality of still image frames, in which the identified person is present, from the moving image based on identification of the person, and
generate a second moving image based on the plurality of still image frames in which the identified person is present and the still image frame.

11. The electronic device of claim 1 , wherein the instructions are further configured to cause the at least one processor to, in response to a user input, control the display to display a shortcut function execution object associated with the function execution object.

12. The electronic device of claim 1 , wherein the information further includes at least one of a shooting time of the still image frame, or a comparison result between the still image frame and still image frames preceding or following the still image frame.

13. The electronic device of claim 9 , wherein the instructions are further configured to cause the at least one processor to:
obtain second information includes at least one of a shooting time, a shooting location, a playback duration, a shooting format, a file name, a resolution, codec information, or a frame rate of the movin

Assignees

• Samsung Electronics Co Ltd

Inventors

• Han Jiwan
• Kim Hangyul
• Park Miji
• Park Sunyoung
• Park Chunhyoung
• Shin Jiyoung
• Oh Younghak

Classifications

• G06F16/739 Primary

  in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames · CPC title

• G06F16/735

  Filtering based on additional data, e.g. user or group profiles · CPC title

• G06F16/7847

  using low-level visual features of the video content · CPC title

• H04N21/234318

  by decomposing into objects, e.g. MPEG-4 objects · CPC title

• H04N21/234327

  by decomposing into layers, e.g. base layer and one or more enhancement layers · CPC title