Display device, user terminal device, display system including the same and control method thereof

Patent metadata

Field	Value
Publication number	US-11367258-B2
Application number	US-202016867088-A
Country	US
Kind code	B2
Filing date	May 5, 2020
Priority date	Oct 12, 2017
Publication date	Jun 21, 2022
Grant date	Jun 21, 2022

Abstract

A display device and a method thereof are provided. The display device includes a display, a communicator, and a processor to display a virtual reality (VR) content on the display, in response to a trigger signal and motion information to change a display viewpoint area of the VR content being received from a user terminal device through the communicator, control the display to display by changing a display viewpoint area of the VR content based on first motion direction included in the motion information until a predetermined signal is received. In response to the predetermined signal being received from the user terminal device, control the display to terminate changing the display viewpoint area.

First claim

What is claimed is:

1. A display device, comprising:
a display;
a communicator; and
a processor configured to:
control the display to display a content,
control the communicator to receive trigger information and motion information of an external device from the external device through the communicator, the trigger information being for triggering move of a display viewpoint area of the content being displayed on the display and the motion information of the external device indicating a motion direction of the external device, wherein the trigger information corresponds to a first user manipulation regarding the external device, and the motion information corresponds to a motion of the external device while the first user manipulation regarding the external device is maintained,
based on the trigger information and the motion information of the external device, control the display to move the display viewpoint area of the content being displayed on the display in a first direction corresponding to the motion direction of the external device, and
in response to a second user manipulation following the first user manipulation being occurred, control the display to stop moving the display viewpoint area of the content on the display,

wherein the processor is further configured to:
based on the external device moving at a speed lower than a predetermined value, not move the display viewpoint area,
based on receiving the trigger information and the motion information in which the external device is moved at a speed equal to or greater than the predetermined value and lower than a first threshold value, move the display viewpoint area in the first direction at a first moving speed,
based on receiving the trigger information and the motion information in which the external device is moved at a speed equal to or greater than the first threshold value and lower than a second threshold value, move the display viewpoint area in the first direction at a second moving speed which is greater than the first moving speed, and
based on the first user manipulation being maintained after the display viewpoint area is moved in the first direction, keep moving the display viewpoint area in the first direction regardless of further movement of the external device.

2. The display device of claim 1 , wherein the processor is further configured to, based on the motion information indicating a second direction different from the first direction being received from the external device while the display viewpoint area of the content is being moved in the first direction, move the display viewpoint area of the content in the second direction until the second user manipulation following the first user manipulation is occurred.

3. The display device of claim 1 , wherein the processor is further configured to, based on a motion speed included in the motion information being greater than or equal to the predetermined value, move the display viewpoint area of the content based on the first direction.

4. The display device of claim 1 , wherein the processor is further configured to move the display viewpoint area of the content at a predetermined speed based on the first direction.

5. The display device of claim 1 , wherein the processor is further configured to:
based on a motion speed included in the motion information being equal to or greater than the predetermined value and lower than the first threshold value, set a speed at which the display viewpoint area of the content is moved to the first moving speed, and
based on the motion speed being equal to or greater than the first threshold value and lower than the second threshold value, set the speed at which the display viewpoint area of the content is moved to the second moving speed.

6. The display device of claim 1 , wherein the processor is further configured to enlarge or reduce the displayed content based on a third direction, until the second user manipulation following the first user manipulation is occurred.

7. The display device of claim 1 , wherein the processor is further configured to continue moving the display viewpoint area in the first direction until the second user manipulation following the first user manipulation is occurred.

8. The display device of claim 1 , wherein the processor is configured to:
periodically receive the motion information from the external device, and
continue moving the display viewpoint area of the content in the first direction when the motion information newly received indicates no movement of the external device until the second user manipulation following the first user manipulation is occurred.

9. The display device of claim 1 , wherein the motion information is obtained from a predetermined application installed in the external device.

10. The display device of claim 1 , wherein the first manipulation is one among entering a touch input to a touch screen on the external device or entering a push input to a button on the external device and the second manipulation is removing the touch input or the push input from the external device.

11. A display system, comprising:
a display device configured to display a content; and
an external device configured to sense a motion for controlling the display device and transmit motion information of the external device based on the sensed motion to the display device,
wherein the display device is configured to:
control a communicator of the display device to receive trigger information and the motion information of the external device from the external device through the communicator, the trigger information being for triggering move of a display viewpoint area of the content being displayed on a display of the display device and the motion information of the external device indicating a motion direction of the external device, wherein the trigger information corresponds to a first user manipulation regarding the external device, and the motion information corresponds to a motion of the external device while the first user manipulation regarding the external device is maintained,
based on the trigger information and the motion information of the external device transmitted by the external device, move the display viewpoint area of the content, wherein the display viewpoint area of the content is moved in a first direction corresponding to the motion direction of the external device, and
in response to a second user manipulation following the first user manipulation being occurred, control the display to stop moving the display viewpoint area,

wherein the display device is further configured to:
based on the external device moving at a speed lower than a predetermined value, not move the display viewpoint area,
based on receiving the trigger information and the motion information in which the external device is moved at a speed equal to or greater than the predetermined value and lower than a first threshold value, move the display viewpoint area in the first direction at a first moving speed,
based on receiving the trigger information and the motion information in which the external device is moved at a speed equal to or greater than the first threshold value and lower than a second threshold value, move the display viewpoint area in the first direction at a second moving speed which is greater than the first moving speed, and
based on the first user manipulation being maintained after the display viewpoint area is moved in the first direction, keep moving the display viewpoint area in the first direction regardless of further movement of the external device.

12. The display system of claim 11 , wherein the display device is further configur

Assignees

• Samsung Electronics Co Ltd

Inventors

• Jeong Hee-Seok
• Lee Sang-Young
• Cho Kyu-Hyun

Classifications

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G09G2340/045

  Zooming at least part of an image, i.e. enlarging it or shrinking it · CPC title

• H04N21/42222

  Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device · CPC title

• H04N21/816

  involving special video data, e.g 3D video · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title