Method and apparatus for providing contents including augmented reality information

Patent metadata

Field	Value
Publication number	US-9710970-B2
Application number	US-201414242104-A
Country	US
Kind code	B2
Filing date	Apr 1, 2014
Priority date	May 9, 2013
Publication date	Jul 18, 2017
Grant date	Jul 18, 2017

Abstract

An augmented reality contents provision method and apparatus are provided. The method and apparatus includes generating augmented reality content by merging augmented reality information onto an image and updating the augmented reality information on the image. The method for providing a content including augmented reality information according to the present disclosure includes displaying a preview image input through a camera and the augmented reality information applied on to the preview image, capturing the preview image as an image in response to an augmented reality content creation request, and generating the augmented reality content by combining the image and the augmented reality information.

First claim

What is claimed is:

1. A method for providing content including augmented reality information, the method comprising:
displaying, using a touch sensitive display, a preview image input;
capturing, using a camera, the preview image as an image in response to an augmented reality content creation request received via the touch sensitive display;
recognizing, using a processor electrically connected to the camera and the touch sensitive display, at least one object included in the captured image;
receiving the augmented reality information corresponding to the at least one object;
generating the augmented reality content by combining the image and the augmented reality information;
receiving updated augmented reality information when at least one augmented reality information corresponding to the at least one object is updated;
updating the augmented reality content based on the updated augmented reality information by generating an updated version of the augmented reality content based on the updated augmented reality information and storing information on a time point when the updated version is generated in association with the updated version of the augmented reality content;
displaying a number of updates to the updated version of the augmented reality content;
searching, when a request for an updated version generated at a certain time point is detected, for the updated version matching the certain time point or an updated version at a time point closest to the certain time point;
if the updated version generated at the certain time point is searched, displaying the searched updated version; and
if the updated version generated at the certain time point is not searched, displaying an augmented reality information updated at a time point closest to the certain time point.

2. The method of claim 1 , wherein the generating of the augmented reality content comprises:
extracting a template and a context of the augmented reality information; and
generating the augmented reality content by combining the image with the template and the context.

3. The method of claim 2 ,
wherein the template comprises information on a presenting position of the augmented reality information, and
wherein the context corresponds to information on content of the augmented reality information including at least one of image information, webpage information, and application information.

4. The method of claim 2 , further comprising:
receiving a request for an augmented reality content display;
combining the augmented reality information onto the image in response to the augmented reality content display request; and
displaying the combined augmented reality content and image.

5. The method of claim 1 , wherein the receiving of the updated augmented reality information comprises:
requesting, when an update push notifying update of the augmented reality information is received, a server for the updated augmented reality information; and
receiving the updated augmented reality information from the server.

6. The method of claim 1 , wherein the receiving of the updated augmented reality information comprises:
requesting the server for the updated augmented reality information in response to an augmented reality content display request; and
receiving the updated augmented reality information from the server.

7. The method of claim 1 , further comprising:
receiving a request for an augmented reality content display;
combining the augmented reality information onto the image in response to the augmented reality content display request; and
displaying the combined augmented reality content and image.

8. The method of claim 7 , wherein the displaying of the combined
augmented reality content and image comprises:
displaying a progress bar showing time progress.

9. The method of claim 1 , further comprising:
displaying a list of at least one augmented reality content along with update information on the at least one augmented reality content.

10. The method of claim 1 , further comprising:
extracting, when an augmented reality information add request is detected, a template and a context of an augmented reality information corresponding to the augmented reality information add request; and
reconfiguring the augmented reality content corresponding to the augmented reality information add request based on the template and the context.

11. An apparatus providing content including augmented reality information, the apparatus comprising:
a camera configured to capture an image;
a memory storing executable instructions;
a display configured to display a preview image captured by the camera and the augmented reality information applied on to the preview image; and
a computer processor reading the stored executable instructions which configure the computer processor to:
capture the preview image as an image in response to an augmented reality content creation request,
recognize at least one object included in the captured image,
receive the augmented reality information corresponding to the at least one object, and
generate the augmented reality content by combining the image and the augmented reality information,

wherein the computer processor updates the augmented reality content based on updated augmented reality information, when updated augmented reality information is received,
wherein the updated augmented reality information is received when at least one augmented reality information corresponding to the at least one object is updated, and
wherein the computer processor is further configured to:
acquire, when an update event occurs for the augmented reality content,
updated augmented reality information,
generate an updated version of the augmented reality content based on the updated augmented reality information along with information on a time point when the updated version is generated,
display a number of updates to the updated version of the augmented reality content;
search, when a request for an update version generated at a certain time point is detected, for the update version matching the certain time point or an updated version at a time point closest to the certain time point,
if the updated version generated at the certain time point is searched, control the display to display the updated version of the augmented reality content matching the certain time point, and
if the updated version generated at the certain time point is not searched, control the display to display an augmented reality information updated at a time point closest to the certain time point.

12. The apparatus of claim 11 , wherein the computer processor is further configured to:
extract a template and a context of the augmented reality information, and
generate the augmented reality content by combining the image with the template and the context.

13. The apparatus of claim 12 ,
wherein the template comprises information on a presenting position of the augmented reality information, and
wherein the context corresponds to information on content of the augmented reality information including at least one of image information, webpage information, and application information.

14. The apparatus of claim 12 , wherein the computer processor is further configured to:
combine the template and context onto the image in response to an augmented reality content display request, and
control the display to display the combination result.

15. The apparatus of claim 14 , wherein the control unit is further configured to control the display unit to display a progress bar showing time progress alo

Assignees

• Samsung Electronics Co Ltd

Inventors

• Jung Jinhe
• Son Taehwan
• Lee Gongwook
• Lee Junho

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• H04N5/262 Primary

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title