Method and apparatus for providing edited image based on user preference

Patent metadata

Field	Value
Publication number	US-12363422-B2
Application number	US-202217986834-A
Country	US
Kind code	B2
Filing date	Nov 14, 2022
Priority date	May 15, 2020
Publication date	Jul 15, 2025
Grant date	Jul 15, 2025

Abstract

Disclosed in various embodiments of the present disclosure are a method and an apparatus for providing an image in an electronic device. An electronic device according to various embodiments comprises a camera module, a display, a memory, and a processor, where the processor can display a preview image through the display, capture an image at least based on of the preview image in response to a user input while displaying the preview image, perform image analysis based on the captured image, identify at least one class related to the captured image based on the image analysis result, identify at least one user preference based on the identified class, and provide, through the display, at least one recommended image related to the at least one user preference.

First claim

What is claimed is:

1. An electronic device comprising:
a camera module;
a display;
a processor operatively coupled to the camera module and the display,
memory storing instructions that, when executed by the processor, cause the electronic device to:
display a preview image through the display;
capture an image at least based on the preview image, based on a user input while displaying the preview image;
perform image analysis, based on the captured image;
identify at least one class for categorizing a subject of the captured image, based on the result of image analysis;
identify at least one user preference, based on the identified class, wherein the at least one user preference is determined based on a user's pattern of use of at least one editing element related to editing of the captured image as tracked through a database comprising a usage history of the user; and
display the captured image and at least one edited image based on the at least one user preference through the display, wherein each edited image is a different image of the captured image, generated by applying at least one editing element based on the at least one user preference.

2. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to analyze an image, based on at least one image analysis algorithm of a scene classifier, object detection, and/or composition detection of the captured image.

3. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to perform the image analysis, based on the captured image in the background at the time of capturing the image.

4. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
display the captured image through a first designated area of the display; and
display the at least one edited image through a second designated area of the display.

5. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to display one or more edited images, based on the identified at least one class and the at least one user preference clustered in the at least one class, and
wherein the edited images comprise images edited with editing elements of different user preferences belonging to the same class and/or images edited with editing elements of different user preferences belonging to different classes.

6. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
extract feature vectors by analyzing the contents of the image;
classify the class of the image, based on the extracted feature vector; and
call the user preference stored in the classified class to provide the edited image.

7. The electronic device of claim 1 , wherein the memory is configured to store the database in which the at least one user preference is tracked for each of various classes related to an image.

8. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
update the corresponding user preference in the selected edited image class, based on detecting the selection of the edited image; and
count the number of times of use of the user preference related to the selected edited image, in the class.

9. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
apply the editing elements of a selected edited image to a captured image, based on detecting the selection of the edited image; and
store the captured image and the selected edited image in association with each other.

10. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
update a user preference according to the editing element to a corresponding class where an editing element is configured at a time of taking the image;
count the number of times the user preference is used where there is a user preference corresponding to the edit element, in the class; and
generate a new user preference, based on the editing element where there is no user preference corresponding to the editing element in the corresponding class.

11. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
perform image analysis, based on image editing triggers related to image editing;
classify a class related to an image, based on the result of the image analysis;
estimate at least one editing element used for editing the image according to the image editing trigger; and
update the at least one user preference in the database, based at least on the classified class and the estimated editing element.

12. The electronic device of claim 11 , wherein the image editing trigger comprises image editing using an editing tool for image editing, capturing configurations while performing capturing, and/or external sharing of the image.

13. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
predict the user preference expected to be executed by the user using a learning model learned using an artificial intelligence algorithm; and
predict user preferences that users are expected to execute using a learning model learned using at least one of machine learning, neural network, genetic, deep learning, or classification algorithm, as the artificial intelligence algorithm.

14. An operation method of an electronic device, the method comprising:
displaying a preview image through a display of the electronic device;
capturing an image, based on at least the preview image, based on a user input while the preview image is displayed;
performing image analysis, based on the captured image;
identifying at least one class for categorizing a subject of the captured image, based on a result of image analysis;
identifying at least one user preference, based on the identified class, wherein the at least one user preference is determined based on a user's pattern of use of at least one editing element related to editing of the captured image as tracked through a database comprising a usage history of the user; and
displaying the captured image and at least one edited image based on the at least one user preference through the display, wherein each edited image is a different image of the captured image, generated by applying at least one editing element based on the at least one user preference.

15. The method of claim 14 , further comprising analyzing an image, based on at least one image analysis algorithm of a scene classifier, object detection, and/or composition detection of the captured image.

16. The method of claim 14 , further comprising displaying one or more edited images, based on the identified at least one class and the at least one user preference clustered in the at least one class, and
wherein the edited images comprise images edited with editing elements of different user preferences belonging to the same class and/or images edited with editing elements of different user preferences belonging to different classes.

17. The method of claim 14 , further comprising:
updating the corresponding user preference in the selected edited image class, based on detecting the selection of the edited image; and
counting the number of times of use of the user preference related to the

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Beomsu
• Do Wonjoon
• Choe Jihwan

Classifications

• H04N23/64 Primary

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/61

  based on recognised objects · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• H04N23/632 Primary

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• G06V20/35

  Categorising the entire scene, e.g. birthday party or wedding scene · CPC title