Method and computing device for providing augmented reality

Patent metadata

Field	Value
Publication number	US-9911231-B2
Application number	US-201414487543-A
Country	US
Kind code	B2
Filing date	Sep 16, 2014
Priority date	Oct 8, 2013
Publication date	Mar 6, 2018
Grant date	Mar 6, 2018

Abstract

A method and computing device for providing Augmented Reality (AR) is provided. The method of providing AR includes detecting at least one physical object from a real scene obtained through a camera of a computing device, rendering at least one virtual object at a desired position of the detected at least one physical object on the real scene provided on a display, enabling communication through a command for interaction between the rendered at least one virtual object, and enabling the at least one virtual object to perform an action in response to command communication between the at least one virtual object.

First claim

What is claimed is:

1. A method of providing Augmented Reality (AR) on a computing device, the method comprising:
detecting a first physical object and a second physical object from a real scene obtained through a camera of the computing device;
displaying the first physical object and the second physical object on a display;
rendering a first virtual object, at a position with regard to the displayed first physical object, and a second virtual object, at a position with regard to the displayed second physical object, on the real scene provided on the display;
in response to a first command to the first virtual object, triggering the first virtual object to perform a first action corresponding to the first command, the first command being a first type of command acting on a virtual object;
in response to the first action, initiating a second command which is communicated from the first virtual object to the second virtual object, the second command being a second type of command which is used in communication between virtual objects; and
in response to receiving the second command, triggering the second virtual object to perform a second action corresponding to the second command.

2. The method of claim 1 , further comprising sending the first command as an input to the at least one of the first virtual object or the second virtual object.

3. The method of claim 1 , wherein the triggering of the second virtual object to perform the second action comprises:
processing the second command; and
enabling the second virtual object to perform the second action in response to the second command being received by the second virtual object.

4. The method of claim 1 , further comprising:
initiating a handshake, to confirm performing of the first action or the second action, between the first virtual object and the second virtual object; and
storing states corresponding to the first virtual object and the second virtual object during communication between the first virtual object and the second virtual object.

5. The method of claim 1 , wherein the first action or the second action comprises at least one of a touch, a grab, a movement, or a release.

6. The method of claim 1 , wherein the first action or the second action is performed based on detection of particular events.

7. The method of claim 6 , wherein the particular events are values corresponding to at least one of a state of the first virtual object, a state of the second virtual object, a surrounding environment of the first virtual object, a surrounding environment of the second virtual object, or relative motion between the first virtual object and the second virtual object.

8. The method of claim 1 , further comprising providing multimedia effects to the first virtual object or the second virtual object or providing real-time effects to the first action performed by the first virtual object or the second action performed by the second virtual object, during communication between the first virtual object and the second virtual object.

9. A computing device configured to provide Augmented Reality (AR), the computing device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor,
wherein the at least one processor is configured to:
detect a first physical object and a second physical object from a real scene obtained through a camera,
display the first physical object and the second physical object on a display,
render the first virtual object, at a position with regard to the displayed first physical object, and a second virtual object, at a position with regard to the displayed second physical object, on the real scene provided on the display,

in response to a first command to the first virtual object, trigger the first virtual object to perform a first action corresponding to the first command, the first command being a first type of command acting on a virtual object,
in response to the first action, initiate a second command which is communicated from the first virtual object to the second virtual object, the second command being a second type of command which is used in communication between virtual objects, and
in response to receiving the second command, trigger the second virtual object to perform a second action corresponding to the second command.

10. The computing device of claim 9 , wherein the at least one processor is further configured to send the first command as an input to at least one of the first virtual object or the second virtual object to communicate the second command.

11. The computing device of claim 9 , wherein, to render the at least one of the first virtual object or the second virtual object to perform the first action or the second action, the at least one processor is further configured to process the second command sent from the first virtual object to the second virtual object and enable the second virtual object to perform the second action in response to the second command being received by the second virtual object.

12. The computing device of claim 9 ,
wherein the at least one processor is further configured to initiate a handshake, to confirm performing of the first action or the second action, between the first virtual object and the second virtual object, and
wherein the memory is configured to store states corresponding to the first virtual object and the second virtual object during communication between the first virtual object and the second virtual object.

13. The computing device of claim 9 , wherein the first action or the second action is performed based on detection of particular events.

14. The computing device of claim 13 , wherein the particular events are values corresponding to at least one of a state of the first virtual object or the second virtual object, a surrounding environment of the first virtual object or the second virtual object, or relative motion between the first virtual object and the second virtual object.

15. The computing device of claim 9 , wherein the memory stores a database which is connected to the at least one processor and is configured to store information about handshakes between the first virtual object and the second virtual object and information about the first virtual object and the second virtual object.

16. The computing device of claim 9 , wherein the at least one processor is further configured to provide multimedia effects to the first virtual object or the second virtual object or to provide real-time effects to the first action performed by the first virtual object or the second action performed by the second virtual object, during communication between the first virtual object and the second virtual object.

17. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of providing Augmented Reality (AR) on a computing device, the method comprising:
detecting a first physical object and a second physical object from a real scene obtained through a camera of the computing device;
displaying the first physical object and the second physical object on a display;
rendering a first virtual object, at a position with regard to the displayed first physical object, and a second virtual object, at a position with regard to the displayed second physical object, on the real scene provided on the display;
in response to a first command to the first virtual object, triggering the first virtual object to perform a first action corresponding to the first command, the first command being a first type of command acting on a virtual

Assignees

• Samsung Electronics Co Ltd

Inventors

• Subramanian Muthukumar
• Mishra Pankaj

Classifications

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04N2201/3256

  colour related metadata, e.g. colour, ICC profiles · CPC title