Method and apparatus for managing content in augmented reality system

Patent metadata

Field	Value
Publication number	US-2019362563-A1
Application number	US-201916420783-A
Country	US
Kind code	A1
Filing date	May 23, 2019
Priority date	May 23, 2018
Publication date	Nov 28, 2019
Grant date	—

Abstract

A method for managing, by an electronic device, content in an augmented reality (AR) system is provided. The method includes identifying a digital artefact that is used by a first application of an electronic device, executing and displaying an image capturing application to capture images, displaying the digital artefact on a captured image which includes an object of a real world where the digital artefact is displayed on or around the object, and, while the digital artefact is displayed, receiving an user input on at least one of the digital artefact or the object for performing an action associated with the digital artefact.

First claim

What is claimed is:

1 . A method of managing content in an augmented reality (AR) system, the method comprising:
identifying a digital artefact that is used by a first application of an electronic device; executing an image capturing application to capture images; displaying the digital artefact on at least one captured image on a screen, wherein the at least one captured image includes an object of a real world and the digital artefact is displayed on or around the object; and while the digital artefact is displayed, receiving a user input on at least one of the digital artefact or the object for performing an action associated with the digital artefact.

2 . The method of claim 1 , further comprising:
selecting the digital artefact on the screen; matching a shape of the digital artefact to a perspective of the object; and superimposing the digital artefact on the object based on the perspective.

3 . The method of claim 1 , wherein the performing of the action comprises:
displaying a plurality of contacts on the screen; selecting a contact among the plurality of contacts; and sharing the digital artefact with the contact via an augmented reality (AR) view application.

4 . The method of claim 1 , wherein the performing of the action comprises:
displaying a plurality of contacts, wherein the digital artefact comprises a contact selected from the plurality of contacts; and transmitting a notification to a second electronic device of the contact.

5 . The method of claim 4 , wherein the notification is transmitted when the second electronic device is located in vicinity of the object.

6 . The method of claim 1 ,
wherein the object comprises a second user, and wherein the performing the action comprises sharing the digital artefact with a second electronic device of the second user.

7 . The method of claim 6 , wherein the sharing of the digital artefact comprises transmitting a notification corresponding to the digital artefact to the second electronic device of the second user.

8 . The method of claim 1 , further comprising:
while the digital artefact is displayed on the screen, selecting the digital artefact; and superimposing the digital artefact on the object.

9 . The method of claim 8 , further comprising:
when a second electronic device is located in vicinity of the object on which the digital artefact is superimposed, transmitting a notification to the second electronic device.

10 . The method of claim 9 , further comprising:
determining whether the second electronic device is located in vicinity of the object based on at least one of a depth estimation of the object on the screen or global positioning system (GPS) information of the object.

11 . The method of claim 8 , further comprising:
when a second electronic device points at the object, transmitting a notification to the second electronic device.

12 . The method of claim 11 , wherein the digital artefact comprises price information of the object.

13 . The method of claim 1 ,
wherein the digital artefact is displayed when the electronic device points in a first direction, and wherein the performing of the action comprises displaying information associated with the digital artefact when the electronic device points in the first direction.

14 . The method of claim 1 ,
wherein the identifying of the digital artefact comprises detecting digital content that is displayed by the first application, and wherein the object comprises a content renderer for rendering the digital content.

15 . The method of claim 14 , wherein the performing of the action comprises, in response to the user input, reproducing the digital content on the content renderer.

16 . The method of claim 15 , wherein the reproducing of the digital content on the content renderer comprises, when an input for pausing the displaying of the digital artefact is received, resuming the displaying of the digital content.

17 . The method of claim 15 , wherein the displaying of the digital artefact comprises identifying the object based on at least one of global positioning system (GPS) information or a depth estimation of the object on the screen.

18 . The method of claim 15 , wherein the performing of the action further comprises controlling the content renderer to be powered on for reproducing the digital content.

19 . The method of claim 1 , wherein the digital artefact is associated with security information and the object is unlocked or logged-in with the security information.

20 . An apparatus for managing content in an augmented reality (AR) system, the apparatus comprising:
a display; an image capturing device; and a processor configured to:
identify a digital artefact used by a first application,
execute an image capturing application to capture images,
display the digital artefact on at least one captured image which includes an object of a real world, wherein the digital artefact is displayed on or around the object, and
while the digital artefact is displayed, receive a user input on at least one of the digital artefact or the object for performing an action associated with the digital artefact.

21 . The apparatus of claim 20 , wherein the processor is further configured to:
identify an object disposed in the screen, identify content associated with the object, and in response to the user input, display the content superimposed over the object.

22 . The apparatus of claim 21 , wherein the content comprises private information of a user.

23 . The apparatus of claim 22 , wherein the processor is further configured to:
display the private information using the first application, and receive an input in the first application to bind the private information to the image capturing application.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Mukherjee Debayan
• Jaiswal Swadha
• Choudhury Saumitri
• Shukla Preksha
• Mishra Veethika
• Pal Shivi
• Gara Suresh Kumar
• Gupta Nitish

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T15/20

  Perspective computation · CPC title

• G06T7/536

  from perspective effects, e.g. by using vanishing points · CPC title