Method and apparatus for creating virtual world

Patent metadata

Field	Value
Publication number	US-12225175-B2
Application number	US-202218050448-A
Country	US
Kind code	B2
Filing date	Oct 27, 2022
Priority date	Sep 5, 2022
Publication date	Feb 11, 2025
Grant date	Feb 11, 2025

Abstract

An apparatus for creating a virtual world includes a processor and a memory connected to the processor, in which the memory stores program instructions executed by the processor so as to receive an image of a real space through a device having a stereo camera, collect mesh data for the real space and an object existing in the real space through the image, determine coordinates for first edges of the real space from the mesh data for the real space, select one of a plurality of second edges based on an area of a virtual space defined by each of the plurality of second edges facing a predetermined direction, when there are more first edges of the real space than edges of a polygon preset for the real space, and output a virtual space defined by some of the first edges and the selected one second edge and a virtual object corresponding to the real object recognized in the real space.

First claim

What is claimed is:

1. An apparatus for creating a virtual world, comprising:
a processor; and
a memory connected to the processor,
wherein the memory stores program instructions executed by the processor to receive an image of a real space through a device having a stereo camera,
collect mesh data for the real space and an object existing in the real space through the image,
determine coordinates for first edges of the real space from the mesh data for the real space,
select one of a plurality of second edges based on an area of a virtual space defined by each of the plurality of second edges facing a predetermined direction, when there are more first edges of the real space than edges of a polygon preset for the real space, and
output a virtual space defined by some of the first edges and the selected one second edge and a virtual object corresponding to the object existing in the real space,
wherein the apparatus is a head-mounted display, and
the program instructions determine coordinates for the first edges by tracking a position of the head-mounted display in the real space through at least two tracking devices disposed in the real space,
wherein in the program instructions, 3D initial coordinates of the head-mounted display are set as an origin point at the center in the real space, and a y-coordinate in the 3D initial coordinates is preset by a user,
wherein a boundary of the real space is defined by x and z coordinates of at least some of the first edges of the real space based on the 3D initial coordinates,
wherein each edge of the preset polygon is disposed in one of quadrants divided into x-axis and y-axis, and the x-axis and z-axis, and
the program instructions calculate an area of a virtual space defined by each of the plurality of second edges positioned within a predetermined angular range on the same axis or the same quadrant, and select one second edge having the largest calculated area.

2. The apparatus for creating the virtual world of claim 1 , wherein the program instructions classify the object existing in the real space in detail through a deep learning model, and output a virtual object corresponding to the classified object in detail.

3. The apparatus for creating the virtual world of claim 1 , wherein the program instructions output an image corresponding to a virtual simulation preset in the virtual space.

4. A method for creating a virtual world in a computing device including a processor and a memory, comprising:
receiving an image of a real space through a device having a stereo camera;
collecting mesh data for the real space and an object existing in the real space through the image;
determining coordinates for first edges of the real space from the mesh data for the real space by tracking a position of the device having the stereo camera in the real space through at least two tracking devices disposed in the real space;
selecting one of a plurality of second edges based on an area of a virtual space defined by each of the plurality of second edges facing a predetermined direction, when there are more first edges of the real space than edges of a polygon preset for the real space; and
outputting a virtual space defined by some of the first edges and the selected one second edge and a virtual object corresponding to the object existing in the real space,
wherein 3D initial coordinates of the device having the stereo camera are set as an origin point at the center in the real space, and a y-coordinate in the 3D initial coordinates is preset by a user, and
the selecting step includes defining a boundary of the real space by x and z coordinates of at least some of the first edges of the real space based on the 3D initial coordinates,
wherein each edge of the preset polygon is disposed in one of quadrants divided into x-axis and y-axis, and the x-axis and z-axis,
the selecting step includes calculating an area of a virtual space defined by each of the plurality of second edges positioned within a predetermined angular range on the same axis or the same quadrant, and selecting one second edge having the largest calculated area.

5. A program stored in a non-transitory computer-readable recording medium for performing the method according to claim 4 .

Assignees

• Univ Sejong Ind Acad Coop Foud

Inventors

• Choi Soo Mi
• Lee Jong Won
• Kang Ho San

Classifications

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• H04N13/366

  using viewer tracking · CPC title

• G06T7/593

  from stereo images · CPC title

• G06T7/13

  Edge detection · CPC title