Electronic device for providing indoor positioning and method therefor

Patent metadata

Field	Value
Publication number	US-12056825-B2
Application number	US-202217846500-A
Country	US
Kind code	B2
Filing date	Jun 22, 2022
Priority date	Dec 24, 2019
Publication date	Aug 6, 2024
Grant date	Aug 6, 2024

Abstract

An electronic device is provided. The electronic device includes a display, a camera, and a processor operatively connected to the display and the camera. The processor may display an augmented reality on the display on the basis of an image captured by the camera, may display a point on the display so as to move on the augmented reality while interworking with the movement of the electronic device, may recognize a selected spot on the augmented reality, may display a guide area on the augmented reality, the guide area including the selected spot such that the point moves within a specific area, may store sensor information including a geomagnetic value measured while the point moves within the guide area, may store radio signal intensity information measured while the point moves within the guide area, and may correct a geomagnetic value included in the sensor information.

First claim

What is claimed is:

1. An electronic device comprising:
a display;
a camera; and
one or more processors communicatively connected to the display and the camera,
memory storing one or more computer programs including computer-executable instructions that, when executed by the one or more processors, cause the electronic device to:
display, based on an image captured by the camera, augmented reality screen on the display,
display a point in the augmented reality screen on the display, the point moving in association with movement of the electronic device,
identify a spot selected by a user input in the augmented reality screen,
display a guide area comprising the selected spot in the augmented reality screen,
store sensor information comprising a magnetometer value measured while the point is moving within the guide area,
store radio signal intensity information measured while the point is moving within the guide area, and
correct the magnetometer value included in the sensor information by using a reference direction and a direction of the electronic device at a point in time when the magnetometer value is measured, and

wherein the point corresponds to a measurement spot where a line extending in a direction perpendicular to a real area corresponding to the guide area from a specific spot of the electronic device meets the real area.

2. The electronic device of claim 1 , wherein the one or more computer programs further comprise computer-executable instructions to:
divide the guide area into multiple blocks;
match sensor information, which comprises magnetometer values measured in blocks through which the point passes while the point is moving within the guide area, to corresponding blocks so as to store the same; and
store radio signal intensity information measured in at least one of the multiple blocks through which the point passes while the point is moving within the guide area.

3. The electronic device of claim 2 , wherein the one or more computer programs further comprise computer-executable instructions to derive magnetometer values between the multiple blocks by using the magnetometer values corresponding to the multiple blocks so that the magnetometer values become continuous data within the guide area.

4. The electronic device of claim 2 , wherein the one or more computer programs further comprise computer-executable instructions to:
verify validity of the magnetometer values included in the sensor information; and
request re-measurement of the sensor information, based on the validity of the magnetometer values.

5. The electronic device of claim 4 , wherein the one or more computer programs further comprise computer-executable instructions to verify the validity of the magnetometer values by comparing the magnetometer values with magnetometer values measured in another guide area other than the guide area.

6. The electronic device of claim 4 , wherein the one or more computer programs further comprise computer-executable instructions to verify the validity of the magnetometer values by comparing the magnetometer values with noise generated when the magnetometer values are measured.

7. The electronic device of claim 4 , wherein the one or more computer programs further comprise computer-executable instructions to verify the validity of the magnetometer values, based on a graph shape of the magnetometer values corresponding to the multiple blocks.

8. The electronic device of claim 1 , wherein the reference direction refers to a direction of the electronic device in a state where the electronic device is horizontal with respect to the real area corresponding to the guide area.

9. The electronic device of claim 8 ,
wherein the correcting of the magnetometer value, which is performed by the processor, comprises a first correction and a second correction,
wherein the first correction is performed so that a direction that the electronic device faces during measurement of the magnetometer value matches a direction of a vector passing vertically through the real area at a specific spot of the electronic device, and
wherein the second correction is performed so that an extension direction of the electronic device during measurement of the magnetometer value matches one direction of the real area.

10. The electronic device of claim 1 , wherein the sensor information further comprises an acceleration value measured by an acceleration sensor of the electronic device and a gyro value measured by a gyro sensor of the electronic device.

11. A method for providing indoor positioning, the method comprising:
displaying a point in augmented reality screen, the point moving in association with movement of an electronic device;
identifying a spot selected by a user input in the augmented reality screen;
displaying a guide area, which comprises the selected spot, in the augmented reality screen;
storing sensor information comprising a magnetometer value measured in a block through which the point passes while the point is moving within the guide area;
storing radio signal intensity information measured while the point is moving within the guide area; and
correcting the magnetometer value included in the sensor information by using a reference direction and a direction of the electronic device at a point in time when the magnetometer value is measured,
wherein the point corresponds to a measurement spot where a line extending in a direction perpendicular to a real area corresponding to the guide area from a specific spot of the electronic device meets the real area.

12. The method of claim 11 , further comprising:
dividing the guide area into multiple blocks,
wherein the storing of the sensor information comprises matching sensor information, which comprises magnetometer values measured in blocks through which the point passes while the point is moving within the guide area, to corresponding blocks so as to store the same, and
wherein the storing of the radio signal intensity information comprises storing radio signal intensity information measured in at least one of the blocks through which the point passes while the point is moving within the guide area.

13. The method of claim 12 , further comprising:
deriving magnetometer values between the multiple blocks by using the magnetometer values corresponding to the multiple blocks so that the magnetometer values become continuous data within the guide area.

14. The method of claim 12 , further comprising:
verifying validity of the magnetometer values corresponding to the multiple blocks; and
requesting re-measurement of the sensor information, based on the validity of the magnetometer values.

15. The method of claim 14 , wherein the verifying of the validity of the magnetometer values is performed by comparing the magnetometer values with magnetometer values measured in another guide area other than the guide area.

16. The method of claim 14 , wherein the verifying of the validity of the magnetometer values is performed by comparing the magnetometer values with noise generated when the magnetometer values are measured.

17. The method of claim 14 , wherein the verifying of the validity of the magnetometer values is performed based on a graph shape of the magnetometer values corresponding to the multiple blocks.

18. The method of claim 11 , wherein in the correcting of the magnetometer value, the reference direction refers to a direction of the electronic device in a state where the electronic device is horizontal with respect to the real area corresponding to the guide area.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Hyeonggeon
• Kim Taeyoon
• Lee Youngpo
• Chang Dukhyun
• Lee Hyoungjoo
• Lim Chaeman

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G01R33/0064

  comprising means for performing simulations, e.g. of the magnetic variable to be measured · CPC title

• G01R33/0029

  Treating the measured signals, e.g. removing offset or noise · CPC title

• G06T2207/30204

  Marker · CPC title

• G01C25/00

  Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass (testing, calibrating or compensating compasses G01C17/38) · CPC title