Display device and image displaying method therefor

Patent metadata

Field	Value
Publication number	US-10467933-B2
Application number	US-201615761692-A
Country	US
Kind code	B2
Filing date	Oct 31, 2016
Priority date	Nov 2, 2015
Publication date	Nov 5, 2019
Grant date	Nov 5, 2019

Abstract

A display device according to an embodiment of the present disclosure comprises: a display disposed on the front surface of the display device; a front camera for capturing a user located in front of the display device; a rear camera for capturing a wall surface positioned behind the display device; a sensor unit for measuring the distance between the display device and the wall surface; and a processor for determining a position of the user with regard to the captured image of the user, and for controlling the display to display an image corresponding to a partial area of the wall surface existing in the direction in which the display device is located with respect to the position of the user in the captured images of the wall surface.

First claim

What is claimed is:

1. A display device, comprising:
a display;
a front camera;
a rear camera;
a sensor unit; and
a processor configured to:
identify a position of a user based on an image captured by the front camera, and
control the display to display an image, which is captured by the rear camera, corresponding to a partial area of a wall surface positioned behind the display device in a direction where the display device is positioned, with reference to the position of the user, based on the position of the user and a distance between the display device and the wall surface that is measured by the sensor unit, wherein

the processor is further configured to:
obtain a direction and a distance from the display device to the position of the user based on the image captured by the front camera,
identify an area of the image corresponding to the partial area of the wall surface based on the obtained direction from the display device to the position of the user,
identify a size of the image corresponding to the partial area of the wall surface based on the distance from the display device to the position of the user, and
control the display to display the image corresponding to the partial area of the wall surface based on at least one of the identified area or the size of the image corresponding to the partial area of the wall surface.

2. The display device as claimed in claim 1 , wherein the partial area of the wall surface is a partial area of the wall surface hidden by the display device of the wall surface positioned in the direction where the display device is positioned with reference to the position of the user.

3. The display device as claimed in claim 1 , wherein the processor is configured to identify the size of the image corresponding to the partial area of the wall surface of a captured image of the wall surface by using a ratio between the distance from the display device to the position of the user obtained by the processor and a size of a front surface of the display device, and the distance between the display device and the wall surface that is measured by the sensor unit.

4. The display device as claimed in claim 1 , wherein the rear camera includes a wide angle lens, and
wherein the processor compensates barrel distortion of a captured image of the wall surface caused by the wide angle lens and controls the display to display the image corresponding to the partial area of the wall surface of the compensated image of the wall surface.

5. The display device as claimed in claim 1 , wherein the rear camera captures a rear view of the display device in a direction forming an angle with a vertical axis of a tangent plane of the display, compensates keystone distortion of a captured image of the wall surface caused by a capturing direction, and controls the display to display the image corresponding to the partial area of the wall surface of the compensated image of the wall surface.

6. The display device as claimed in claim 1 , wherein the processor analyzes a pattern and a color of the wall surface based on a captured image of the wall surface captured by the rear camera, generates an image including the analyzed color and pattern, and controls the display to display the image corresponding to the partial area of the wall surface in the direction where the display device is positioned, with reference to the position of the user, based on the position of the user and the distance between the display device and the wall surface.

7. The display device as claimed in claim 1 , wherein the processor analyzes a pattern and a color of the wall surface based on a captured image of the wall surface captured by the rear camera, searches an image having the analyzed pattern of pre-stored images, and based on the position of the user and the distance between the display device and the wall surface, controls the display to display the image corresponding to the partial area of the wall surface in the direction where the display device is positioned with reference to the position of the user.

8. The display device as claimed in claim 1 , wherein the processor controls the display to display a screen including a picture or an animation having the image corresponding to the partial area of the wall surface as background or a widget executing a specific application.

9. The display device as claimed in claim 8 , further comprising:
light sensor configured to sense light amount,
wherein the processor controls the display to adjust brightness for displaying the image corresponding to the partial area of the wall surface according to the sensed light amount.

10. The display device as claimed in claim 1 , wherein, in a case where a plurality of users are captured by the front camera, the processor is configured to determine an average position between determined positions of the plurality of users as the position of the user that is used in controlling the display to display the image corresponding to the partial area of the wall surface.

11. A display device, comprising:
a display;
a front camera;
a rear camera;
a sensor unit; and
a processor configured to:
identify a position of a user based on an image captured by the front camera, and
control the display to display an image, which is captured by the rear camera, corresponding to a partial area of a wall surface positioned behind the display device in a direction where the display device is positioned, with reference to the position of the user, based on the position of the user and a distance between the display device and the wall surface that is measured by the sensor unit, wherein

the processor is further configured to:
based on the image captured by the front camera, with reference to a center of the display, calculate an angle of rotation from a vertical axis of a tangent plane of the display in a direction of the position of the user and a distance from the center of the display to the position of the user,
calculate a viewing angle for viewing an entire front surface of the display device at the calculated distance on the vertical axis,
calculate a width and a height of the partial area of the wall surface hidden by the display device when the rotated angle is added to the calculated viewing angle, and
control the display to display an image having a size corresponding to the calculated width and height.

12. A method of displaying an image of a display device, the method comprising:
capturing a user positioned in front of the display device and a wall surface positioned behind the display device;
measuring a distance between the display device and the wall surface;
identifying a position of the user based on a captured image of the user; and
displaying an image corresponding to a partial area of the wall surface in a direction where the display device is positioned, with reference to the position of the user, based on the position of the user and the distance between the display device and the wall surface that is measured, wherein
the identifying of the position of the user comprises obtaining a direction and a distance from the display device to the position of the user based on the captured image of the user, and
the displaying comprises:
identifying an area of the image corresponding to the partial area of the wall surface based on the obtained direction from the display device to the position of the user,
identifying a size of the image corresponding to the partial area of the wall surface based on the distance from the display device to the position of the user, and
displaying the image corresponding to the partial area of the wall surface based on at least one of the identifi

Assignees

• Samsung Electronics Co Ltd

Inventors

• Hur Jae-Myung
• Kim Hye-Suk
• Park Jong-Jin
• An Jae-Sung
• Yun Hyun-Kyu
• Lee Myoung-Il
• Lee Bong-Seok
• Cho Dae-Woo

Classifications

• H04N21/42202

  environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes · CPC title

• G09G3/001 Primary

  using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP) · CPC title

• H04N5/262

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title

• G06T7/62

  of area, perimeter, diameter or volume · CPC title

• G09G5/10

  Intensity circuits · CPC title