Method for operating augmented reality contents and device and system for supporting the same

Patent metadata

Field	Value
Publication number	US-9754414-B2
Application number	US-201314095100-A
Country	US
Kind code	B2
Filing date	Dec 3, 2013
Priority date	Dec 3, 2012
Publication date	Sep 5, 2017
Grant date	Sep 5, 2017

Abstract

Disclosed are methods of operating augmented reality (AR) contents, and a device and a system supporting the same. In one method, a real world image is captured using a camera in a portable device. A virtual space corresponding to the real world image is built, by partitioning image elements included in the virtual space into plural background objects and displaying the background objects. Augmented reality contents are generated by mapping one or more user contents onto the background objects. In other embodiments, location information of the portable device is used to obtain AR contents for enhancing captured images.

First claim

What is claimed is:

1. A method performed by an electronic device, for generating augmented reality contents, the method comprising:
capturing a real world image using a camera of the electronic device;
building a virtual space corresponding to the real world image, by partitioning image elements included in the captured image into plural background objects, and displaying the background objects; and
generating augmented reality contents by mapping one or more user contents onto the background objects;
wherein displaying the background objects comprises one of:
identifying a number of predefined user contents to be included within the augmented reality contents, and partitioning the image elements into the background objects corresponding to the number of user contents; and
partitioning the image elements into background objects according to a number of user contents defined by default.

2. The method of claim 1 , further comprising:
receiving a request for increasing or decreasing a number of background objects; and
increasing or decreasing the number of background objects in the virtual space according to the request, and re-partitioning the image elements into the increased or decreased number of background objects.

3. The method of claim 1 , wherein displaying the background objects comprises:
identifying the number of predefined user contents to be included within the augmented reality contents and partitioning the image elements into background objects corresponding to the number of user contents; and
displaying allocation areas on which the user contents are to be placed within predetermined areas of the background objects.

4. The method of claim 3 , wherein displaying the background objects comprises setting sizes, positions, or inclinations of the allocation areas according to respective states of sizes, positions, and inclinations of the background objects.

5. The method of claim 1 , further comprising detecting selection of a placement scheme for placing the user contents on the virtual space in a predetermined form, wherein detecting selection comprises designating at least one of a placement element for each of a plurality of depths in the virtual space, a placement element for each of a plurality of positions in the virtual space and placement elements based on at least one of a movement trace and movement speed of the device according to a motion of the device.

6. The method of claim 1 , wherein generating the augmented reality contents comprises:
displaying a list of the user contents; and
mapping one or more user contents included in the list onto at least one of the background objects designated by an input event.

7. The method of claim 1 , further comprising:
obtaining current position information; and
inserting the current position information into the augmented reality contents and then storing the augmented reality contents.

8. The method of claim 7 , further comprising transmitting the augmented reality contents to an augmented reality providing server apparatus.

9. The method of claim 1 , further comprising:
distinguishing background objects and user contents in particular augmented reality contents and displaying the distinguished background objects and user contents on a display unit when an editing mode is selected; and
editing mapping information of the user contents and the background objects according to reception of an input event.

10. The method of claim 9 , further comprising performing resizing in displaying the augmented reality contents such that a whole screen of the augmented reality contents is displayed on the display unit.

11. The method of claim 1 , wherein the user contents include at least one of still image contents, video contents, and audio contents.

12. A method performed by an electronic device, for generating augmented reality contents, the method comprising:
capturing a real world image using a camera of the electronic device;
building a virtual space corresponding to the real world image, by partitioning image elements included in the captured image into plural background objects, and displaying the background objects; and
generating the augmented reality contents by partitioning the image elements into background objects in the virtual space based on a selected placement scheme for placing user contents on the virtual space in a predetermined form, wherein selection of the placement scheme is detected according to a movement trace and speed; and
mapping the user contents onto the background objects.

13. A device supporting generation of augmented reality contents, the device comprising:
a camera unit configured to capture a real world image;
a display unit; and
a controller configured to build a virtual space corresponding to the captured image, by partitioning image elements included in the virtual space into plural background objects, displaying the background objects via the display unit, and generating the augmented reality contents by mapping one or more user contents onto the background objects;
wherein displaying the background objects comprises one of:
identifying a number of predefined user contents to be included within the augmented reality contents, and partitioning the image elements into the background objects corresponding to the number of user contents; and
partitioning the image elements into background objects according to a number of user contents defined by default.

14. The device of claim 13 , further comprising:
a position information collection module configured to collect image acquisition position information; and
a storage unit for storing augmented reality contents including the virtual space, information on the background objects onto which the user contents are mapped, and the position information.

15. The device of claim 14 , wherein the controller is further configured to distinguish, via the display unit, user contents and background objects of augmented reality contents stored in the storage unit, and to present via the display unit the distinguished user contents and background objects when an editing function is selected.

16. The device of claim 14 , further comprising a communication unit configured to form at least one of a communication channel to provide the augmented reality contents to an augmented reality providing server apparatus and a communication channel to receive augmented reality contents stored in the augmented reality providing server apparatus.

17. The device of claim 13 , wherein the display unit is configured to display one or more allocation areas on which the user contents to be mapped into the background objects are placed.

18. A device supporting generation of augmented reality contents, the device comprising:
a camera configured to capture a real world image;
a display; and
a controller configured to:
build a virtual space corresponding to the real world image, by partitioning at least a part of the captured image into plural background objects based on a selected placement scheme for placing user contents on the virtual space in a predetermined form, wherein selection of the placement scheme is detected according to a movement trace and speed; and
generate the augmented reality contents by mapping the user contents onto the background objects.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Eunsun
• Song Hwayoung
• Lee Yujin
• Jeong Hayoung

Classifications

• G06T11/40

  Filling planar surfaces by adding surface attributes, e.g. adding colours or textures · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04N5/262 Primary

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title