Mobile terminal

Patent metadata

Field	Value
Publication number	US-11500103-B2
Application number	US-201916661215-A
Country	US
Kind code	B2
Filing date	Oct 23, 2019
Priority date	Oct 23, 2018
Publication date	Nov 15, 2022
Grant date	Nov 15, 2022

Abstract

A mobile terminal including a display configured to display a rotatable graphic interface; a Time of Flight (TOF) camera configured to obtain a depth image of an object; and a controller configured to control the TOF camera to enter a rotation detection mode based on the object included the depth image, obtain a relative rotation amount of a plurality of specific points of the object included in the depth image, and rotate the graphic interface on the display based on the obtained relative rotation amount.

First claim

What is claimed is:

1. A mobile terminal comprising:
a display configured to display a rotatable graphic interface;
a Time of Flight (TOF) camera configured to obtain a depth image of an object; and
a controller configured to:
control the TOF camera to enter a rotation detection mode based on the object included the depth image,
obtain a relative rotation amount of a plurality of specific points of the object included in the depth image, and
rotate the graphic interface on the display based on the obtained relative rotation amount,
wherein when the TOF camera enters the rotation detection mode, the controller is further configured to:
match specific points of an N-th image with specific points of an (N+1)-th image,
calculate a first average of slopes between the matched specific points of the N-th image and a second average of slopes between the matched specific points of the (N+1)-th image, and
calculate the relative rotation amount based on the first and second averages.

2. The mobile terminal of claim 1 , wherein the controller controls the TOF camera to enter the rotation detection mode when the plurality of specific points are included in the depth image.

3. The mobile terminal of claim 2 , wherein each of the specific points is positioned in a specific region of an imaging region of the TOF camera.

4. The mobile terminal of claim 2 , wherein each of the specific points corresponds to an end protruding by a predefined distance or greater from a portion of the object towards the mobile terminal.

5. The mobile terminal of claim 4 , wherein each of the specific points has an end whose an area on a plane facing the TOF camera is within a predefined range.

6. The mobile terminal of claim 2 , wherein the controller controls the TOF camera to enter the rotation detection mode when the plurality of specific points are maintained in the depth image for a predefined time duration or greater.

7. The mobile terminal of claim 1 , wherein each of the specific points corresponds to a distal end point of a finger of a user's hand.

8. The mobile terminal of claim 7 , wherein the controller controls the TOF camera to enter the rotation detection mode when the user's hand has a predefined shape.

9. The mobile terminal of claim 1 , wherein when the TOF camera enters the rotation detection mode, the controller is further configured to display the rotatable graphic interface on the display.

10. The mobile terminal of claim 1 , wherein the controller is further configured to match specific points of the N-th image with specific points of the (N+1)-th image based on distances between the specific points included in the N-th image and distances between the specific points included in the (N+1)-th image.

11. The mobile terminal of claim 1 , wherein the controller is further configured to match specific points of the N-th image with specific points of the (N+1)-th image based on moving distances of the specific point included in the N-th image and the specific point included in the (N+1)-th image.

12. The mobile terminal of claim 1 , wherein the specific point corresponds to an end protruding by a predefined length or greater from a specific body towards the mobile terminal, and
wherein the controller is further configured to match specific points of the N-th image with specific points of the (N+1)-th image based on protrusion lengths of the specific points included in the N-th image and protrusion lengths of the specific points included in the (N+1)-th image.

13. The mobile terminal of claim 12 , wherein the controller is further configured to match specific points of the N-th image with specific points of the (N+1)-th image based on areas of ends corresponding to the specific points included in the N-th image and areas of ends corresponding to the specific points included in the (N+1)-th image.

14. The mobile terminal of claim 1 , wherein the controller is further configured to obtain the relative rotation amount on a first plane facing the TOF camera.

15. The mobile terminal of claim 14 , wherein the controller is further configured to obtain the relative rotation amount on a second plane perpendicular to the first plane.

16. The mobile terminal of claim 1 , wherein the controller is further configured to obtain a relative rotation velocity based on the relative rotation amount and a time difference between the N-th image and the (N+1)-th image.

17. The mobile terminal of claim 1 , wherein the graphic interface contains a 2D image or a 3D image rotating based on the relative rotation amount.

18. The mobile terminal of claim 1 , wherein the graphic interface provides an application to be selected based on the relative rotation amount.

19. The mobile terminal of claim 1 , wherein the graphic interface provides fast forward, next content playback, brightness control, and volume control based on the relative rotation amount.

20. A mobile terminal comprising:
a display configured to display a graphical object;
a Time of Flight (TOF) camera configured to obtain a depth image of a user's hand spaced a predetermined distance from the display; and
a controller configured to:
control the TOF camera to enter a rotation detection mode based on the user's hand being maintained at the predetermined distance from the display for a predefined time duration or greater,
display a rotatable graphical interface on the display for rotating the graphical object in response to the user's hand being maintained at the predetermined distance from the display for the predetermined time duration or greater,
obtain a relative rotation amount of a plurality of distal end points of fingers of the user's hand included in the depth image and that is spaced the predetermined distance from the display, and
rotate the graphical object on the display based on the obtained relative rotation amount of the user's hand.

21. A mobile terminal comprising:
a display configured to display a graphical object without displaying a graphical interface for rotating the graphical object;
a Time of Flight (TOF) camera configured to obtain a depth image of a user's hand spaced a predetermined distance from the display; and
a controller configured to:
control the TOF camera to enter a rotation detection mode based on the user's hand being maintained at the predetermined distance from the display for a predefined time duration or greater,
obtain a relative rotation amount of a plurality of distal end points of fingers of the user's hand included in the depth image and that is spaced the predetermined distance from the display, and
rotate the graphical object on the display based on the obtained relative rotation amount of the user's hand without displaying the graphical interface for rotating the graphical object.

Assignees

• Lg Electronics Inc

Inventors

• Ahn Yehan
• Kim Minho
• Kim Hoyoung
• Song Minwoo
• Yu Jihye
• Lee Dongju
• Lee Jieun
• Jeon Sangkuk
• Jin Dongchul

Classifications

• G01S7/4865

  Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak (peak detection in noise, signal conditioning G01S7/487) · CPC title

• G01S17/89 Primary

  for mapping or imaging · CPC title

• G01S7/4915

  Time delay measurement, e.g. operational details for pixel components (signal extraction and conditioning G01S7/493); Phase measurement · CPC title

• H04N13/254

  in combination with electromagnetic radiation sources for illuminating objects · CPC title

• H04N13/271 Primary

  wherein the generated image signals comprise depth maps or disparity maps · CPC title