Electronic apparatus and control method thereof

Patent metadata

Field	Value
Publication number	US-11587265-B2
Application number	US-202016929287-A
Country	US
Kind code	B2
Filing date	Jul 15, 2020
Priority date	Aug 2, 2019
Publication date	Feb 21, 2023
Grant date	Feb 21, 2023

Abstract

An electronic apparatus is provided. The electronic apparatus according to the disclosure may include a memory configured to store instructions, and a processor configured to execute the instructions to control a display to display an image captured via a camera, and a first guideline, recognize an object in the image based on the first guideline, render a virtual object to replace the object, generate an augmented reality image including the virtual object that is located in an area where the object is located in the image; and control the display to display the augmented reality image.

First claim

What is claimed is:

1. An electronic apparatus comprising:
a display;
a memory configured to store instructions; and
a processor configured to execute the instructions to:
control a display to display an image captured via a camera, and a first guideline,
identify a position of an area where an object is located in the image and a size of the area corresponding to a size of the object based on the first guideline,
render a virtual object to replace the object,
generate an augmented reality image including the virtual object that is located in the area, and
control the display to display the augmented reality image.

2. The electronic apparatus of claim 1 , wherein the processor is further configured to:
based on an event, render the virtual object to indicate a movement of the virtual object.

3. The electronic apparatus of claim 1 , wherein the processor is further configured to:
identify a length of a blank space existing in an adjacent area of the object,
identify whether the virtual object is capable of being located in the area where the object is located based on length information of the object and the length of the blank space, and
based on the virtual object being capable of being located in the area where the object is located, render the virtual object.

4. The electronic apparatus of claim 1 , wherein the processor is further configured to:
identify whether the virtual object is capable of covering an object area of the object in the image, and
generate the augmented reality image by replacing a partial object area of the object that is not covered by the virtual object with a background area adjacent to the partial object area.

5. The electronic apparatus of claim 1 , wherein the processor is further configured to:
control the display to display a plurality of virtual objects that are capable of replacing the object, and
based on a user input selecting one of the plurality of virtual objects being received, render the virtual object corresponding to the user input.

6. The electronic apparatus of claim 1 , wherein the processor is further configured to:
based on a line being input in association with a surface of the object in the image, determine a location of the virtual object in the augmented reality image based on the input line.

7. The electronic apparatus of claim 1 , wherein the processor is further configured to:
identify a location of the virtual object in the augmented reality image based on location information and angle information of the camera, and
generate the augmented reality image by arranging the virtual object in the location.

8. The electronic apparatus of claim 1 , wherein the processor is further configured to:
generate a second guideline for guiding a capturing angle of the camera, and
change a length of the second guideline according to the capturing angle of the camera.

9. The electronic apparatus of claim 1 , wherein the processor is further configured to:
based on receiving a user input that moves the virtual object included in the augmented reality image, change a location of the virtual object based on the user input and render the virtual object according to the changed location.

10. The electronic apparatus of claim 1 , wherein the processor is further configured to:
based on location information or angle information of the camera being changed while the augmented reality image is displayed, change the virtual object based on the location information or angle information of the camera.

11. A control method of an electronic apparatus, the method comprising:
capturing an image;
displaying a first guideline and the image;
identifying a position of an area where an object is located in the image and a size of the area corresponding to a size of the object based on the first guideline;
rendering a virtual object to replace the object;
generating an augmented reality image including the virtual object that is located in the area; and
displaying the augmented reality image.

12. The control method of claim 11 , further comprising:
based on an event, rendering the virtual object to indicate a movement of the virtual object.

13. The control method of claim 11 , wherein the rendering a virtual object comprises:
identifying a length of a blank space existing in an adjacent area of the object;
identifying whether the virtual object is capable of being located in the area where the object is located based on length information of the object and the length of the blank space; and
based on the virtual object being capable of being located in the area where the object is located, rendering the virtual object.

14. The control method of claim 11 , wherein the generating an augmented reality image comprises:
identifying whether the virtual object is capable of covering an object area of the object in the image; and
generating the augmented reality image by replacing a partial object area of the object that is not covered by the virtual object with a background area adjacent to the partial object area.

15. The control method of claim 11 , further comprising:
displaying a plurality of virtual objects that are capable of replacing the object; and
based on a user input selecting one of the plurality of virtual objects being received, rendering the virtual object corresponding to the user input.

16. The control method of claim 11 , further comprising:
based on a line being input in association with a surface of the object in the image, determining a location of the virtual object in the augmented reality image based on the input line.

17. The control method of claim 11 , further comprising:
identifying a location of the virtual object in the augmented reality image based on location information and angle information of a camera; and
generating the augmented reality image by arranging the virtual object in the location.

18. The control method of claim 11 , further comprising:
generating a second guideline for guiding a capturing angle of a camera; and
changing a length of the second guideline according to the capturing angle of the camera.

19. The control method of claim 11 , further comprising:
receiving a user input that moves the virtual object included in the augmented reality image; and
changing a location of the virtual object based on the user input and rendering the virtual object according to the changed location.

20. A non-transitory computer-readable medium configured to store instructions that, when executed by a processor of an apparatus, cause the processor to:
control a display of the apparatus to display an image captured via a camera of the apparatus;
control the display to display a first guideline in the image;
identify a position of an area where an object is located in the image and a size of the area corresponding to a size of the object based on the first guideline;
render a virtual object to replace the object;
generate an augmented reality image including the virtual object that is located in the area; and
control the display to display the augmented reality image.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Cho Eunbi
• Kim Jiin
• Jeong Jaeyun
• Lee Seunga
• Kim Gipyo
• Kim Seokyeol
• Kim Songhyeon
• Song Seokwoo

Classifications

• G06V20/10

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title