Electronic apparatus and control method thereof

Patent metadata

Field	Value
Publication number	US-11908042-B2
Application number	US-202318110433-A
Country	US
Kind code	B2
Filing date	Feb 16, 2023
Priority date	Aug 2, 2019
Publication date	Feb 20, 2024
Grant date	Feb 20, 2024

Abstract

An electronic apparatus is provided. The electronic apparatus according to the disclosure may include a memory configured to store instructions, and a processor configured to execute the instructions to control a display to display an image captured via a camera, and a first guideline, recognize an object in the image based on the first guideline, render a virtual object to replace the object, generate an augmented reality image including the virtual object that is located in an area where the object is located in the image; and control the display to display the augmented reality image.

First claim

What is claimed is:

1. An electronic apparatus comprising:
a display;
a memory configured to store instructions; and
a processor configured to execute the instructions to:
control a display to display an image captured via a camera, and a first guideline,
identify a position where an object is located in the image based on the first guideline,
render a virtual object to replace the object,
generate an augmented reality image including the virtual object that is located at the position, and
control the display to display the augmented reality image.

2. The electronic apparatus of claim 1 , wherein the processor is further configured to:
control the display to display a message for guiding a user to adjust a location of the camera such that the object included in the image is aligned on the first guideline.

3. The electronic apparatus of claim 2 , wherein the processor is further configured to:
based on identifying that the object included in the image is aligned on the first guideline, identify the position where the object is located in the image.

4. The electronic apparatus of claim 1 , wherein the processor is further configured to:
control the display to display a message for guiding a user to move the camera such that a capture direction of the camera corresponds to a direction of the first guideline.

5. The electronic apparatus of claim 1 , wherein the processor is further configured to:
identify a length of a blank space existing in an adjacent area of the object,
identify whether the virtual object is capable of being located in the area where the object is located based on length information of the object and the length of the blank space, and
based on the virtual object being capable of being located in the area where the object is located, render the virtual object.

6. The electronic apparatus of claim 1 , wherein the processor is further configured to:
identify whether the virtual object is capable of covering an object area of the object in the image, and
generate the augmented reality image by replacing a partial object area of the object that is not covered by the virtual object with a background area adjacent to the partial object area.

7. The electronic apparatus of claim 1 , wherein the processor is further configured to:
control the display to display a plurality of virtual objects that are capable of replacing the object, and
based on a user input selecting one of the plurality of virtual objects being received, render the virtual object corresponding to the user input.

8. The electronic apparatus of claim 1 , wherein the processor is further configured to:
based on a line being input in association with a surface of the object in the image, determine a location of the virtual object in the augmented reality image based on the input line.

9. The electronic apparatus of claim 1 , wherein the processor is further configured to:
identify a location of the virtual object in the augmented reality image based on location information and angle information of the camera, and
generate the augmented reality image by arranging the virtual object in the location.

10. The electronic apparatus of claim 1 , wherein the processor is further configured to:
generate a second guideline for guiding a capturing angle of the camera, and
change a length of the second guideline according to the capturing angle of the camera.

11. A control method of an electronic apparatus, the method comprising:
capturing an image;
displaying a first guideline and the image;
identifying a position where an object is located in the image based on the first guideline;
rendering a virtual object to replace the object;
generating an augmented reality image including the virtual object that is located at the position; and
displaying the augmented reality image.

12. The control method of claim 11 , further comprising:
displaying a message for guiding a user to adjust a location of a camera for capturing the image such that the object included in the image is aligned on the first guideline.

13. The control method of claim 12 , the identifying the position further comprising:
based on identifying that the object included in the image is aligned on the first guideline, identifying the position where the object is located in the image.

14. The control method of claim 11 , further comprising:
displaying a message for guiding a user to move a camera for capturing the image such that a capture direction of the camera corresponds to a direction of the first guideline.

15. The control method of claim 11 , wherein the rendering a virtual object comprises:
identifying a length of a blank space existing in an adjacent area of the object;
identifying whether the virtual object is capable of being located in the area where the object is located based on length information of the object and the length of the blank space; and
based on the virtual object being capable of being located in the area where the object is located, rendering the virtual object.

16. The control method of claim 11 , wherein the generating an augmented reality image comprises:
identifying whether the virtual object is capable of covering an object area of the object in the image; and
generating the augmented reality image by replacing a partial object area of the object that is not covered by the virtual object with a background area adjacent to the partial object area.

17. The control method of claim 11 , further comprising:
displaying a plurality of virtual objects that are capable of replacing the object; and
based on a user input selecting one of the plurality of virtual objects being received, rendering the virtual object corresponding to the user input.

18. The control method of claim 11 , further comprising:
based on a line being input in association with a surface of the object in the image, determining a location of the virtual object in the augmented reality image based on the input line.

19. The control method of claim 11 , further comprising:
identifying a location of the virtual object in the augmented reality image based on location information and angle information of a camera; and
generating the augmented reality image by arranging the virtual object in the location.

20. The control method of claim 11 , further comprising:
generating a second guideline for guiding a capturing angle of a camera; and
changing a length of the second guideline according to the capturing angle of the camera.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Cho Eunbi
• Kim Jiin
• Jeong Jaeyun
• Lee Seunga
• Kim Gipyo
• Kim Seokyeol
• Kim Songhyeon
• Song Seokwoo

Classifications

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06V20/10

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title