Augmented reality display device and program recording medium

Patent metadata

Field	Value
Publication number	US-2021390785-A1
Application number	US-202117303998-A
Country	US
Kind code	A1
Filing date	Jun 11, 2021
Priority date	Jun 14, 2020
Publication date	Dec 16, 2021
Grant date	—

Abstract

Provided is an augmented reality display technology capable of more entertaining a user.An augmented reality display device 10 includes an imaging unit 13, a special effect execution unit 11b, and a display unit 14. The imaging unit 13 acquires a background image of a real world. When a plurality of models for a specific combination are present in a virtual space, the special effect execution unit 11b executes a special effect corresponding to the combination of the models. The display unit 14 displays the models together with the background image based on the special effect.

First claim

1 . An augmented reality display device comprising:
a camera configured to acquire a background image of a real world; a processor configured to execute a special effect corresponding to the combination of the models, when a plurality of models for a specific combination are present in a virtual space; and a display configured to display the models together with the background image based on the special effect.

2 . The augmented reality display device according to claim 1 , wherein the special effect comprises at least one of:
causing the plurality of models for the specific combination to perform a specific operation; or displaying a specific computer graphic or another model in addition to the plurality of models for the specific combination.

3 . The augmented reality display device according to claim 1 , wherein
the model includes a dynamic model that is configured to move in the virtual space and a static model is configured to stay at a specific position in the virtual space, and the processor is configured to execute the special effect corresponding to the specific combination of the dynamic model and the static model.

4 . The augmented reality display devise according to claim 1 , wherein the processor is further configured to:
analyze an image including a real object; extract a feature of the real object included in the image; and execute a special effect corresponding to a combination of the model and the feature of the real object.

5 . The augmented reality display device according to claim 4 , wherein
when the real object contacts the model in a display space of the display, the processor is configured to execute a special effect of applying an action by the contact to the model.

6 . The augmented reality display device according to claim 1 , wherein the processor is further configured to analyze an image including a real object and generate a two-dimensional or three-dimensional model from the real object included in the image, and to further configured to set a special effect to the generated model for a combination of the generated model with another model.

7 . The augmented reality display device according to claim 1 , wherein the processor is further configured to analyze an image including a real object, and further configured to either read the model corresponding to the real object from memory or acquire the model corresponding to the real object from a server via a communication line, based on information of the real object included in the image.

8 . A non-transitory recording medium storing a program configured to cause a portable information terminal to function as the augmented reality display device according to claim 1 .

Assignees

• Square Enix Co Ltd

Inventors

• Driancourt Remi
• Tsuda Makoto

Classifications

• G06V20/20

  in augmented reality scenes · CPC title

• G06V20/647

  by matching two-dimensional images to three-dimensional objects · CPC title

• G06F18/24

  Classification techniques · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title