Method of providing augmented reality contents and electronic device therefor

Patent metadata

Field	Value
Publication number	US-11238622-B2
Application number	US-202016794621-A
Country	US
Kind code	B2
Filing date	Feb 19, 2020
Priority date	Feb 19, 2019
Publication date	Feb 1, 2022
Grant date	Feb 1, 2022

Abstract

An electronic device may identify a marker in an image based on an input to the image displayed on the display, identify at least one object associated with the marker using marker information of the identified marker, display the identified at least one object on the display as recommendation contents associated with the marker, and map at least part of the at least one object to the marker based on an input to generate augmented reality contents.

First claim

What is claimed is:

1. An electronic device comprising:
a camera;
a display;
a communication circuit;
a processor operatively connected to the camera, the display, and the communication circuit; and
a memory operatively connected to the processor, wherein the memory stores one or more instructions that, when executed, cause the processor to control the electronic device to:
display, on the display, an image obtained by the camera;
identify a marker in the displayed image based on a first input to the displayed image, wherein the marker corresponds to a portion of the displayed image or an object in the image selected by the first input;
obtain marker information of the identified marker, wherein obtaining the marker information includes obtaining location of the electronic device and identifying at least one keyword corresponding to an object identified in the selected portion of the displayed image or to the selected object;
identify a plurality of objects associated with the marker using the location of the electronic device and the at least one keyword;
display the identified plurality of objects on the display as recommendation contents associated with the marker; and
map the marker to a plurality of objects selected among the identified plurality of objects based on a second input to generate augmented reality contents.

2. The electronic device of claim 1 , wherein information of the marker further includes an acquisition time of the marker, and
wherein the one or more instructions, when executed, cause the processor to control the electronic device to:
identify the plurality of objects by searching for objects corresponding to the acquisition time of the marker.

3. The electronic device of claim 2 , wherein the one or more instructions, when executed, cause the processor to control the electronic device to:
identify the plurality of objects by searching the memory or an external server using the marker information.

4. The electronic device of claim 1 , wherein the identified plurality of objects include at least one of a 2-dimensional (2D) image, a 3-dimensional (3D) image, a video, a still image, or music.

5. The electronic device of claim 1 , wherein the one or more instructions, when executed, cause the processor to control the electronic device to:
generate the augmented reality contents by generating a file including the marker, the objects mapped to the marker, and mapping information between the marker and the selected objects.

6. The electronic device of claim 5 , wherein the mapping information includes at least one of playback information of the mapped objects, playback authority information, or location information of the marker.

7. The electronic device of claim 5 , wherein the one or more instructions, when executed, cause the processor to control the electronic device to:
transmit the generated file using the communication circuit.

8. A method of generating augments reality contents by an electronic device, the method comprising:
displaying, on a display of the electronic device, an image obtained by a camera;
identifying a marker in the displayed image based on a first input to the displayed image, wherein the marker corresponds to a portion of the displayed image or an object in the image selected by the first input;
obtaining marker information of the identified marker, wherein obtaining the marker information includes obtaining location of the electronic device and identifying at least one keyword corresponding to an object identified in the selected portion of the displayed image or to the selected object;
identifying a plurality of objects associated with the marker using the location of the electronic device and the at least one keyword;
displaying the identified plurality of objects on the display as a plurality of recommendation contents associated with the marker; and
mapping the marker to a plurality of objects selected among the identified plurality objects based on a second input to generate augmented reality contents.

9. The method of claim 8 , wherein information of the marker further includes an acquisition time of the marker, and
wherein the identifying of the plurality of objects associated with the marker includes:
identifying the plurality of objects by searching for an object corresponding to the acquisition time of the marker.

10. The method of claim 9 , wherein the identifying of the plurality of objects associated with the marker includes:
searching a memory of the electronic device or an external server using the marker information.

11. The method of claim 8 , wherein the identified plurality of objects include at least one of a two-dimensional (2D) image, a three-dimensional (3D) image, a video, a still image, or music.

12. The method of claim 8 , wherein the generating of the augmented reality contents includes:
generating the augmented reality contents by generating a file including the marker, the objects mapped to the marker, and mapping information between the marker and the selected objects.

13. The method of claim 12 , wherein the mapping information includes at least one of playback information of the mapped objects, playback authority information, or location information of the marker.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Jung Hansub
• Moon Sunho
• Ryu Seongki
• Han Donghyun

Classifications

• G06V20/20

  in augmented reality scenes · CPC title

• G06V10/245

  by locating a pattern; Special marks for positioning · CPC title

• G06T2207/30204

  Marker · CPC title

• H04N1/0044

  for image preview or review, e.g. to help the user position a sheet · CPC title

• G06Q50/10

  Services · CPC title