Electronic device for generating a background image for a display apparatus and operation method thereof

Patent metadata

Field	Value
Publication number	US-11310441-B2
Application number	US-201916961595-A
Country	US
Kind code	B2
Filing date	Jan 29, 2019
Priority date	Feb 13, 2018
Publication date	Apr 19, 2022
Grant date	Apr 19, 2022

Abstract

An electronic device and an operating method thereof are provided. The electronic device includes: a camera; a display; a communication interface; a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: generate an event to instruct a plurality of markers to be displayed on a screen of a display apparatus and transmit the generated event to the display apparatus; determine, from among images obtained from the camera, an image from which at least a region of a wall surface in the vicinity of the display apparatus is to be extracted, via recognition of the plurality of markers displayed on the screen of the display apparatus in response to the generated event; extract, from the determined image, a region corresponding to a shape obtained based on the recognized plurality of markers; generate a background image to be displayed on the screen of the display apparatus, by correcting an image of the extracted region; and transmit the generated background image to the display apparatus so that the generated background image is displayed on the screen of the display apparatus.

First claim

The invention claimed is:

1. An electronic device comprising:
a camera;
a display;
a communication interface;
a memory storing one or more instructions; and
a processor configured to execute the one or more instructions stored in the memory to:
generate an event and transmit, to a display apparatus, the generated event to instruct a plurality of markers to be displayed on a screen of the display apparatus;
determine, from among images obtained from the camera, an image, from which at least a region of a wall surface in the vicinity of the display apparatus is to be extracted, based on recognition of the plurality of markers displayed on the screen of the display apparatus in response to the generated event;
extract, from the determined image, a region corresponding to a shape obtained based on the recognized plurality of markers;
generate a background image to be displayed on the screen of the display apparatus, by correcting an image of the extracted region; and
transmit the generated background image to the display apparatus so that the generated background image is displayed on the screen of the display apparatus.

2. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to:
obtain size information of the screen of the display apparatus; and
determine, based on the obtained size information, a location of the screen of the display apparatus on which the plurality of markers are to be displayed, and generate the event including information about the determined location.

3. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to,
when the plurality of markers displayed on the screen of the display apparatus are recognized, determine, from the images obtained from the camera, an image in which the plurality of markers exist, as an image from which the background image is to be extracted.

4. The electronic device of claim 1 , wherein the at least the region of the wall surface on which the display apparatus is mounted includes at least one of a left region, a right region, an upper region, and a lower region of the wall surface in the vicinity of the display apparatus.

5. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to correct the image of the extracted region by performing at least one of adjusting of a length of at least one side of the image, rotating the image of the extracted region, and symmetrizing the image of the extracted region.

6. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to generate the background image by combining an image generated by correcting the image of the extracted region with a symmetric image of the corrected image.

7. The electronic device of claim 6 , wherein the processor is further configured to execute the one or more instructions to:
when the determined image is an image obtained from a left region or a right region of the wall surface in the vicinity of the display apparatus, obtain the symmetric image by symmetrizing the obtained image in a left direction or a right direction; and
when the determined image is an image obtained from an upper region or a lower region of the wall surface in the vicinity of the display apparatus, obtain the symmetric image by symmetrizing the obtained image in an upper direction or a lower direction.

8. The electronic device of claim 1 , wherein the processor is further configured to execute the one or more instructions to transmit the event and the background image to the display apparatus via a server.

9. The electronic device of claim 1 , wherein the shape obtained based on the recognized plurality of markers includes a polygonal shape obtained by connecting the recognized plurality of markers.

10. An operating method of an electronic device, the method comprising:
generating an event to instruct a plurality of markers to be displayed on a screen of a display apparatus and transmitting the generated event to the display apparatus;
determining, from among images obtained from a camera, an image, from which at least a region of a wall surface in the vicinity of the display apparatus is to be extracted, via recognition of the plurality of markers displayed on the screen of the display apparatus in response to the generated event;
extracting, from the determined image, a region corresponding to a shape obtained based on the recognized plurality of markers;
generating a background image to be displayed on the screen of the display apparatus, by correcting an image of the extracted region; and
transmitting the generated background image to the display apparatus so that the generated background image is displayed on the screen of the display apparatus.

11. The method of claim 10 , further comprising:
obtaining size information of the screen of the display apparatus; and
determining, based on the obtained size information, a location of the screen of the display apparatus on which the plurality of markers are to be displayed, and generating the event including information about the determined location.

12. The method of claim 10 , further comprising:
recognizing the plurality of markers displayed on the screen of the display apparatus, from the images obtained from the camera; and
determining an image, in which the recognized plurality of markers exist, as an image from which the background image is to be extracted.

13. The method of claim 10 , wherein the at least the region of the wall surface on which the display apparatus is mounted includes at least one of a left region, a right region, an upper region, and a lower region of the wall surface in the vicinity of the display apparatus.

14. The method of claim 10 , further comprising, with respect to the image of the extracted region, correcting the image of the extracted region by performing at least one of adjusting a length of at least one side of the image, rotating the image of the extracted region, and symmetrizing the image of the extracted region.

15. A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 10 on a computer.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Insun
• Lee Yunho
• Yang Kwansik

Classifications

• H04N5/272 Primary

  Means for inserting a foreground image in a background image, i.e. inlay, outlay · CPC title

• H04N5/2628 Primary

  Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title