Mobile terminal for displaying a preview image to be captured by a camera and control method therefor

Patent metadata

Field	Value
Publication number	US-11500533-B2
Application number	US-201816970317-A
Country	US
Kind code	B2
Filing date	May 2, 2018
Priority date	Feb 14, 2018
Publication date	Nov 15, 2022
Grant date	Nov 15, 2022

Abstract

Disclosed are a mobile terminal and a control method therefor. The mobile terminal according to one embodiment of the present invention comprises: a camera provided to a main body; a display unit for displaying a preview image for the photographing of the camera; and a control unit for detecting the entering into of a subject recognition mode while the preview image is being displayed, and in the subject recognition mode, analyzing objects included in the preview image so as to recognize a subject to be photographed, and applying, to the preview image, a camera effect matched with the recognized subject. In addition, while the matched camera effect is being applied to the preview image, the control unit may further provide, on the display unit, on the basis of a touch input applied to the preview image, a list of camera effects additionally applicable to the recognized subject.

First claim

The invention claimed is:

1. A mobile terminal comprising:
a camera provided in a main body;
a display configured to display a preview image to be captured by the camera when a camera application is executed; and
a controller configured to:
in a preview state:
detect entry into a subject recognition mode, in response to a touch input applied to an icon while the preview image is displayed;
analyze the preview image in response to the subject recognition mode;
generate and display a tag cloud comprising a plurality of tags on the preview image, based on the analysis, wherein each tag in the tag cloud corresponds to a respective object of a plurality of objects included in the preview image and appears in a text form comprising a name of the object, a color, and a keyword of emotion, wherein the tags appear sequentially at positions adjacent to the objects in a recognized order on the preview image, and then gradually fade and disappear sequentially or simultaneously;
recognize a subject to be photographed by analyzing the objects included in the preview image, based on the analysis;
apply a camera effect suitable for the recognized subject to the preview image; and
display, on the display, a changed preview image according to the applying of the camera effect,
wherein when a shutter button is selected, the changed preview image is captured and stored into a memory, and
wherein when a consecutive touch input is applied to the icon, the subject recognition mode is disabled and the preview image is displayed instead of the changed preview image.

2. The mobile terminal of claim 1 , wherein a graphic object indicating the recognized subject is output to the preview image when the subject to be photographed is recognized.

3. The mobile terminal of claim 2 , wherein the controller, while the camera effect is applied to the preview image, is further configured to provide the display with a list of camera effects additionally applicable to the recognized subject based on a touch input applied to the preview image, and wherein the list disappears when a second touch input is applied to the graphic object, or a preset time has elapsed.

4. The mobile terminal of claim 2 , wherein, when one of the objects included in the preview image is changed or the preview image is changed, an image of the graphic object is changed in real time to correspond to a changed subject.

5. The mobile terminal of claim 1 , wherein the subject to be photographed is recognized by using the generated tag cloud.

6. The mobile terminal of claim 1 , wherein the controller, when a plurality of persons is recognized in the subject recognition mode and at least a part of a face of one of the plurality of persons is determined to be located at an edge of the display, is further configured to perform control such that a mode is switched to a wide-angle mode after applying the camera effect.

7. The mobile terminal of claim 1 , further comprising a memory configured to store a plurality of recognizable subjects and camera effects respectively suitable for the recognizable subjects in a table form, wherein the controller, in the subject recognition mode, is further configured to specify one of the plurality of recognizable subjects stored in the memory by analyzing the objects included in the preview image, so as to apply a matching one of the camera effects in a calling manner.

8. The mobile terminal of claim 5 , wherein the controller is further configured to perform control such that captured images are classified and stored using the generated tag when the camera is operated in the subject recognition mode.

9. The mobile terminal of claim 1 , wherein the controller, in the subject recognition mode, is further configured to output a focus image corresponding to a particular object based on a touch input to the particular object in the preview image, and control the camera to capture a corresponding preview image based on a touch input continuously applied to the output focus image.

10. The mobile terminal of claim 1 , further comprising a sensor configured to sense changes in a movement value of the main body, wherein the controller is further configured to specify a main subject to be photographed among the objects included in the preview image by using the sensed changes in the movement value of the main body.

11. The mobile terminal of claim 1 , wherein the controller, when different camera effects suitable for the recognized subject exist in the subject recognition mode, is further configured to selectively apply one of the different camera effects using at least one of time information or location information.

12. The mobile terminal of claim 1 , wherein the controller, when the recognized subject is determined as a document including text, is further configured to adjust a contrast ratio between the text and a background according to an analyzed text attribute so as to be reflected in the preview image.

13. A method for controlling a mobile terminal, the method comprising:
displaying a preview image to be captured by a camera when a camera application is executed; and
in a preview state:
detecting entry into a subject recognition mode, in response to a touch input applied to an icon while the preview image is displayed;
analyzing the preview image in response to the subject recognition mode;
generating and displaying a tag cloud comprising a plurality of tags on the preview image, based on the analysis, wherein each tag in the tag cloud corresponds to a respective object of a plurality of objects included in the preview image and appears in a text form comprising a name of the object, a color, or a keyword of emotion, wherein the tags appear sequentially at positions adjacent to the objects in a recognized order on the preview image, and then gradually fade and disappear sequentially or simultaneously;
recognizing a subject to be photographed by analyzing objects included in the preview image, based on the analysis;
applying a camera effect suitable for the recognized subject to the preview image;
displaying a changed preview image according to the applying of the camera effect;
capturing and storing the changed preview image into a memory when a shutter button is selected; and
disabling the subject recognition mode and displaying the preview image instead of the changed preview image when a consecutive touch input is applied to the icon.

14. The method of claim 13 , further comprising:
while the camera effect is applied to the preview image, providing the display with a list of camera effects additionally applicable to the recognized subject based on a touch input to the preview image.

Assignees

• Lg Electronics Inc

Inventors

• Yun Jiwon
• Kang Pilseok
• Kim Changmok
• Ku Hyerim

Classifications

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• H04N23/61

  based on recognised objects · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title