Mobile terminal and control method thereof

Patent metadata

Field	Value
Publication number	US-10205881-B2
Application number	US-201715583481-A
Country	US
Kind code	B2
Filing date	May 1, 2017
Priority date	Oct 12, 2016
Publication date	Feb 12, 2019
Grant date	Feb 12, 2019

Abstract

A mobile terminal including a main body; an image sensor provided in the main body; a driving unit coupled to the image sensor and configured to change the posture of the image sensor in at least one of roll, pitch, and yaw directions; a sensing unit configured to sense movement information of a subject as an imaging target in an image input through the image sensor; a touch screen; and a controller configured to change the posture of the image sensor using the driving unit such that the image sensor tracks a movement of the subject based on the sensed movement information, and display guide information on the touch screen related to the movement information of the subject to guide a movement of the main body of the mobile terminal.

First claim

What is claimed is:

1. A mobile terminal comprising:
a main body;
an image sensor provided in the main body;
a driving unit coupled to the image sensor and configured to change a posture of the image sensor in at least one of roll, pitch, and yaw directions;
a sensing unit configured to sense movement information of a subject as an imaging target in an image input through the image sensor;
a touch screen; and
a controller configured to:
operate in one a first mode or a second mode,
wherein the first mode corresponds to correcting a shaking occurring in a capture image caused by a movement of the subject via an optical image stabilization (OIS) procedure by changing the posture of the image sensor through the driving unit to enable the image sensor to move in a direction opposite to a direction in which the image sensor has moved,
wherein the second mode corresponds to correcting the shaking occurring in the capture image caused by the movement of the subject by moving the image sensor in a direction corresponding to a movement direction of the moving subject, and
control the driving unit to change the posture of the image sensor using the driving unit such that the image sensor tracks a movement of the subject based on the sensed movement information.

2. The mobile terminal of claim 1 , wherein the controller is further configured to control the touch screen to display guide information on the touch screen related to the movement information of the subject, and
wherein the guide information includes information related to a movement of the main body such that the main body of the mobile terminal is guided to move according to the movement of the subject.

3. The mobile terminal of claim 2 , wherein the information related to the movement of the main body includes at least one of information regarding a movement direction, a movement speed, a slope, and a posture of the main body.

4. The mobile terminal of claim 2 , wherein the controller is further configured to:
determine whether it is possible to track the movement of the subject through a change in the posture of the image sensor using the movement information of the subject in the second mode, and
when it is not possible to track the movement of the subject through the change in the posture of the image sensor, display the guide information on the touch screen in the second mode.

5. The mobile terminal of claim 1 , wherein the controller is further configured to:
extract vector information of the subject using the movement information of the subject in the second mode,
obtain change target posture information of the image sensor using a difference between the vector information of the subject and vector information of the main body in the second mode, and
control the driving unit to change the posture of the image sensor based on the obtained change target posture in the second mode.

6. The mobile terminal of claim 5 , wherein the posture information includes vector information corresponding to a value obtained by subtracting the vector information of the main body from the vector information of the subject.

7. The mobile terminal of claim 6 , wherein the controller is further configured to control the touch screen to display guide information on the touch screen related to the movement information of the subject, and
wherein when the value obtained by subtracting the vector information of the main body from the vector information of the subject is not within a posture change driving range of the image sensor, the controller is further configured to display the guide information on the touch screen.

8. The mobile terminal of claim 1 , wherein the controller is further configured to:
when the movement of the subject is sensed, change the posture of the image sensor using the driving unit such that the image sensor is oriented in the movement direction of the subject, and
when the movement of the main body is sensed and the movement of the subject is not sensed, change the posture of the image sensor using the driving unit such that the image sensor is oriented in a direction opposite to a movement direction of the main body.

9. The mobile terminal of claim 1 , wherein the image sensor includes a first image sensor having a first angle of view and a second image sensor having a second angle of view wider than the first angle of view, and
when a movement degree of the subject is not within a posture change driving range of the image sensor and the first image sensor is activated, the controller is further configured to activate the second image sensor having the angle of view wider than that of the first image sensor in the second mode.

10. The mobile terminal of claim 1 , wherein the image sensor includes a first image sensor having a first angle of view and a second image sensor having a second angle of view wider than the first angle of view, and
when the subject moves out of the angle of the view of the first image sensor and the first image sensor is activated, the controller is further configured to activate the second image sensor having the second angle of view wider than that of the first image sensor in the second mode.

11. The mobile terminal of claim 1 , wherein the controller is further configured to:
when the movement of the subject is sensed, display an indicator indicating that it is possible for the image sensor to track the movement of the subject, and
when a preset type of touch is applied to the indicator, control the driving unit such that the image sensor tracks the movement of the subject.

12. The mobile terminal of claim 1 , wherein when the image sensor senses that a plurality of subjects move through the image input through the image sensor, the controller is further configured to control the driving unit such that the image sensor sequentially tracks each of the plurality of subjects, and synthesize a plurality of images captured by tracking each of the plurality of subjects, based on the plurality of subjects.

13. The mobile terminal of claim 12 , wherein the controller is further configured to:
capture a first image by changing the posture of the image sensor with respect to a first subject among the plurality of subjects, and
after capturing the first image, capture a second image by changing the posture of the image sensor with respect to a second subject different from the first subject among the plurality of subjects.

14. The mobile terminal of claim 1 , wherein the image sensor includes a first image sensor having a first angle of view and a second image sensor having a second angle of view wider than the first angle of view, and
when the image sensor senses that a plurality of subjects move, through an image input through the image sensor, the controller is further configured to:
activate both the first and second images sensors,
change a posture of the first image sensor based on movement of any one of the plurality of subjects, and
change a posture of the second image sensor different from the first image sensor based on movement of another subject different from the any one subject among the plurality of subjects.

15. The mobile terminal of claim 14 , wherein when an image capture request is received, the controller is further configured to capture images respectively through the first and second image sensors, and synthesize the captured images to generate a single image.

16. The mobile terminal of claim 1 , wherein the controller is further configured to change the posture of the image sensor with respect to a subject whose relative distance to the main body is gradual

Assignees

• Lg Electronics Inc

Inventors

• Jung Byungwook
• Hyun Jeeho
• Kang Kyunghee
• Joo Sungbum

Classifications

• H04N23/681

  Motion detection · CPC title

• H04N23/58

  Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/631

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title

• H04N23/6811

  based on the image signal · CPC title