Augmented reality based point of interest guide device and method

Patent metadata

Field	Value
Publication number	US-12392633-B2
Application number	US-202217830504-A
Country	US
Kind code	B2
Filing date	Jun 2, 2022
Priority date	Jun 15, 2021
Publication date	Aug 19, 2025
Grant date	Aug 19, 2025

Abstract

An embodiment augmented reality (AR)-based point of interest (POI) guide method includes performing a plane detection with respect to an actual image in an area around a POI, forming a grid in the area where the plane detection of the actual image is performed, and displaying an anchor and a highlight at a position of the POI based on the grid.

First claim

What is claimed is:

1. An augmented reality (AR)-based point of interest (POI) guide method, the method comprising:
performing a plane detection with respect to an actual image in an area around a POI;
forming a grid in the area where the plane detection of the actual image is performed;
displaying an anchor and a highlight at a position of the POI based on the grid; and
evaluating an accuracy of the anchor displayed to indicate the position of the POI according to a preset evaluation criterion in order to utilize the accuracy of the displayed anchor for improving the accuracy of POI indications by crowdsourcing,
wherein:
the preset evaluation criterion comprises a feature point set,
the feature point set comprises a number of feature points on a background image of a position where the anchor is created, and
the accuracy with respect to the position of the anchor is evaluated based on the number of feature points.

2. The method of claim 1 , further comprising displaying a tag including additional related information for each category of the POI.

3. The method of claim 1 , wherein the preset evaluation criterion further comprises a distance, or a plane detection area.

4. The method of claim 3 , wherein:
when the preset evaluation criterion comprises the distance, the distance comprises a distance between the position where the anchor is created and a device that performs an anchoring operation; and
the accuracy with respect to the position of the anchor is evaluated based on the distance.

5. The method of claim 3 , wherein:
when the preset evaluation criterion comprises the plane detection area, the plane detection area comprises a size where the plane detection is performed with respect to a surrounding area of the anchor; and
the accuracy with respect to the position of the anchor is evaluated based on the plane detection area.

6. The method of claim 3 , further comprising:
displaying a search result of the POI; and
displaying an evaluation result according to the preset evaluation criterion as related information of the POI.

7. The method of claim 1 , further comprising:
inducing crowdsourcing for a position correction through a predetermined reward,
wherein the position correction is performable by adjusting the position of the anchor by a user in a drag and drop manner.

8. The method of claim 1 , further comprising:
inducing crowdsourcing for a position correction through a predetermined reward,
wherein the position correction is performable by directly inputting an address or an image of the POI by a user.

9. The method of claim 1 , further comprising:
inducing crowdsourcing for a position correction through a predetermined reward,
wherein the position correction is performable by removing the highlight of the POI through gamification and setting a new position of the POI.

10. An augmented reality (AR)-based point of interest (POI) guide device, the device comprising:
a display module; and
a processor configured to:
perform a plane detection with respect to an actual image in an area around a POI, to form a grid in the area where the plane detection of the actual image is performed,
control the display module to display on an AR-based image an anchor and a highlight at a position of the POI based on the grid, and
evaluate an accuracy of the anchor displayed to indicate the position of the POI according to a preset evaluation criterion in order to utilize the accuracy of the displayed anchor for improving the accuracy of POI indications by crowdsourcing,

wherein:
the preset evaluation criterion is a feature point set;
the feature point set comprises a number of feature points on a background image of a position where the anchor is created; and
the accuracy with respect to the position of the anchor is evaluated based on the number of feature points.

11. The device of claim 10 , wherein the display module is configured to display a tag including additional related information for each category of the POI.

12. The device of claim 10 , wherein the preset evaluation criterion further comprises a distance, or a plane detection area.

13. The device of claim 12 , wherein:
when the preset evaluation criterion comprises the distance, the distance comprises a distance between the position where the anchor is created and the device configured to perform an anchoring operation; and
the accuracy with respect to the position of the anchor is evaluated based on the distance.

14. The device of claim 12 , wherein:
when the preset evaluation criterion comprises the area, the area comprises an area where the plane detection is performed with respect to a surrounding area of the anchor; and
the accuracy with respect to the position of the anchor is evaluated based on the plane detection area.

15. The device of claim 12 , wherein:
the display module is configured to display a search result of the POI; and
the processor is configured to control the display module to display an evaluation result according to the preset evaluation criterion as related information of the POI.

16. The device of claim 10 , wherein;
the processor is configured to induce crowdsourcing for a position correction through a predetermined reward, and
the position correction comprises an adjustment of the position of the anchor by a user in a drag-and-drop manner.

17. The device of claim 10 , wherein:
the processor is configured to induce crowdsourcing for a position correction through a predetermined reward, and
the position correction comprises a direct input of an address or an image of the POI by a user.

18. The device of claim 10 , wherein the processor is configured to induce crowdsourcing for a position correction through a predetermined reward.

Assignees

• Hyundai Motor Co Ltd
• Kia Corp

Inventors

• Woo Seunghyun
• Woo Jae Yul
• An Rowoon
• Kim Soobin

Classifications

• G01C21/365

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G01C21/3664

  Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures · CPC title

• G01C21/367

  Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker · CPC title

• G06F3/0486

  Drag-and-drop · CPC title

• G01C21/3638 Primary

  including 3D objects and buildings (three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05) · CPC title