Positioning Method and Reality Presenting Device

Patent metadata

Field	Value
Publication number	US-2020184675-A1
Application number	US-201816214124-A
Country	US
Kind code	A1
Filing date	Dec 9, 2018
Priority date	Dec 9, 2018
Publication date	Jun 11, 2020
Grant date	—

Abstract

A positioning method, applied in a reality presenting device, includes collecting a plurality of first images of a real environment and constructing a virtual environment corresponding to the real environment according to the plurality of first images; obtaining, by a reality presenting device, a second image of the real environment; computing an initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image; and displaying, by the reality presenting device, the virtual environment in a perspective from the initial virtual position at a time which a specific application of the reality presenting device is initiated; wherein the initial virtual position is corresponding to an initial real location in the real environment at which the reality presenting device captures the second image.

First claim

What is claimed is:

1 . A positioning method, comprising:
collecting a plurality of first images of a real environment and constructing a virtual environment corresponding to the real environment according to the plurality of first images; obtaining, by a reality presenting device, a second image of the real environment; computing an initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image; and displaying, by the reality presenting device, the virtual environment in a perspective from the initial virtual position at a time which a specific application of the reality presenting device is initiated; wherein the initial virtual position is corresponding to an initial real location in the real environment at which the reality presenting device captures the second image.

2 . The positioning method of claim 1 , further comprising:
comparing the second image with the plurality of first images and obtaining a plurality of correlation coefficients of the plurality of first images versus the second image; obtaining at least a filtered image within the plurality of first images, such that at least a filtered correlation coefficient corresponding to the at least a filtered image are greater than a specific threshold, wherein the at least a filtered image is corresponding to at least a virtual position in the virtual environment, and the at least a virtual position is corresponding to at least a real locations in the real environment at which the reality presenting device captures the at least a filtered image; and computing the initial virtual position according to the at least a filtered image and the second image.

3 . The positioning method of claim 2 , wherein the step of comparing the second image with the plurality of first images and obtaining the plurality of correlation coefficients of the plurality of first images versus the second image comprises:
obtaining a plurality of first quantifying vectors corresponding to the plurality of first images; obtaining a second quantifying vector corresponding to the second image; computing a plurality of first correlation coefficients of the plurality of first quantifying vectors versus the second quantifying vector; and obtaining the plurality of correlation coefficients as the plurality of first correlation coefficients.

4 . The positioning method of claim 3 , wherein the step of obtaining the plurality of first quantifying vectors corresponding to the plurality of first images comprises:
performing a feature extraction operation on the plurality of first images to obtain the plurality of first quantifying vectors; wherein a quantifying vector corresponding to a first image within the plurality of first images indicates a plurality of appearance numbers corresponding to a plurality of features within the first image.

5 . The positioning method of claim 3 , wherein the step of obtaining the second quantifying vector corresponding to the second image comprises:
performing a feature extraction operation on the second image to obtain the second quantifying vector; wherein the second quantifying vector indicates a plurality of appearance numbers corresponding to a plurality of features within the second image.

6 . The positioning method of claim 2 , wherein the step of computing the initial virtual position corresponding to the second image in the virtual environment according to the at least a filtered images and the second image comprises:
computing a relative virtual position related to a virtual position within the at least a virtual position according to the at least a filtered image and the second image; and computing the initial virtual position corresponding to the second image according to the virtual position and the relative virtual position.

7 . A reality presenting device capable of displaying a virtual environment to a user, the virtual environment is constructed based on a plurality of first images captured from a real environment, the reality presenting device comprising:
an image capturing module, configured to capture a second image from the real environment; a processing unit, configured to perform the following steps:
constructing the virtual environment corresponding to the real environment according to the plurality of first images; and
computing an initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image; and
a displaying screen, configured to display the virtual environment in a perspective from the initial virtual position at a time which a specific application of the reality presenting device is initiated; wherein the initial virtual position is corresponding to an initial real location in the real environment at which the reality presenting device captures the second image.

8 . The reality presenting device of claim 7 , wherein the processing unit is further configured to perform the following steps:
comparing the second image with the plurality of first images and obtaining a plurality of correlation coefficients of the plurality of first images versus the second image; and obtaining at least a filtered image within the plurality of first images, such that at least a filtered correlation coefficient corresponding to the at least a filtered image are greater than a specific threshold, wherein the at least a filtered image is corresponding to at least a virtual position in the virtual environment, and the at least a virtual position is corresponding to at least a real locations in the real environment at which the reality presenting device captures the at least a filtered image; and computing the initial virtual position according to the at least a filtered image and the second image.

9 . The reality presenting device of claim 8 , wherein the processing unit is further configured to perform the following steps, for comparing the second image with the plurality of first images and obtaining the plurality of correlation coefficients of the plurality of first images versus the second image:
obtaining a plurality of first quantifying vectors corresponding to the plurality of first images; obtaining a second quantifying vector corresponding to the second image; computing a plurality of first correlation coefficients of the plurality of first quantifying vectors versus the second quantifying vector; and obtaining the plurality of correlation coefficients as the plurality of first correlation coefficients.

10 . The reality presenting device of claim 9 , wherein the processing unit is further configured to perform the following step, for obtaining the plurality of first quantifying vectors corresponding to the plurality of first images:
performing a feature extraction operation on the plurality of first images to obtain the plurality of first quantifying vectors; wherein a quantifying vector corresponding to a first image within the plurality of first images indicates a plurality of appearance numbers corresponding to a plurality of features within the first image.

11 . The reality presenting device of claim 9 , wherein the processing unit is further configured to perform the following step, for obtaining the second quantifying vector corresponding to the second image:
performing a feature extraction operation on the second image to obtain the second quantifying vector; wherein the second quantifying vector indicates a plurality of appearance numbers corresponding to a plurality of features within the second image.

12 . The positioning method of claim 8 , wherein the proces

Assignees

• Xrspace Co Ltd

Inventors

• Chou Peter
• Su Shang-Chin
• Wu Meng-Hau
• Chu Feng-Seng

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G06T7/73 Primary

  using feature-based methods · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title