Server and control method thereof

Patent metadata

Field	Value
Publication number	US-12307711-B2
Application number	US-202217975817-A
Country	US
Kind code	B2
Filing date	Oct 28, 2022
Priority date	Dec 15, 2021
Publication date	May 20, 2025
Grant date	May 20, 2025

Abstract

A server includes a communicator; and a controller configured to: when an image data is received from a terminal device through the communicator, determine a first key point of the image data and a first descriptor corresponding to the first key point, determine a location of the terminal device by comparing the first descriptor with a second descriptor stored in a virtual positioning system (VPS) map, determine an area where a difference between the first descriptor and the second descriptor is greater than or equal to a predetermined value based on the location of the terminal device, and update a key point of the area on the VPS map and the second descriptor based on the image data, or request crowdsourcing of an image data about the area.

First claim

What is claimed is:

1. A server, comprising:
a communicator; and
a controller configured to:
when first image data is received from a terminal device through the communicator, determine a first key point of the first image data and a first descriptor corresponding to the first key point,
determine a location of the terminal device by comparing the first descriptor with a second descriptor stored in a virtual positioning system (VPS) map,
identify an area where a difference between the first descriptor and the second descriptor is greater than or equal to a predetermined value based on the location of the terminal device,
in response to the identified area where the difference between the first descriptor and the second descriptor is not greater than or equal to a predetermined reconstruction reference value, update the second descriptor based on the first image data,
in response to the identified area where the difference between the first descriptor and the second descriptor is greater than or equal to the predetermined reconstruction reference value, request crowdsourcing of second image data of the area to the terminal device,
after the second image data of the area is received from the terminal device, update a key point of the area on the VPS map and the second descriptor based on the second image data of the area, and
when a plurality of areas are identified where the difference between the first descriptor and the second descriptor is greater than or equal to the predetermined reconstruction reference value, control a user interface to display a list of the plurality of areas in an order of greatest difference between the first descriptor and the second descriptor.

2. The server of claim 1 , wherein the controller is configured to provide a reward to the terminal device that transmits the second image data of the area.

3. The server of claim 1 , wherein a request signal for requesting the crowdsourcing includes at least one of a location information of the area, a photographing guide information for obtaining the second image data, or an augmented reality (AR) icon information for guiding a location of the area.

4. The server of claim 1 , further comprising:
the user interface including a display module and an input module.

5. The server of claim 4 , wherein, when the area where the difference between the first descriptor and the second descriptor is greater than or equal to the predetermined reconstruction reference value is identified, the controller is configured to control the user interface to guide a necessity for reconstruction of the VPS map for the area, and request crowdsourcing for the area based on a user input.

6. The server of claim 5 , wherein, when a crowdsourcing information of an area that requires crowdsourcing is input, the controller is configured to request crowdsourcing for the area that requires the crowdsourcing, the crowdsourcing information comprising at least one of a name, a location or a reward information of the area that requires the crowdsourcing.

7. The server of claim 6 , wherein the controller is configured to control the user interface to display the crowdsourcing information of the area that requires the crowdsourcing.

8. The server of claim 4 , wherein the controller is configured to control the user interface to display information of an area located within a predetermined distance based on the location of the terminal device.

9. The server of claim 8 , wherein, when at least one of generation, correction, or deletion of information of an area is input, the controller is configured to request crowdsourcing for the area of which the at least one of the generation, the correction, or the deletion of information is input.

10. The server of claim 4 , wherein the controller is configured to control the user interface to display a crowdsourcing state information about each of areas where crowdsourcing is requested, as a list, the crowdsourcing state information comprising information of at least one of whether the second image data is uploaded or a degree of update progress.

11. The server of claim 4 , wherein the controller is configured to stop requesting crowdsourcing for the area, when an end command for crowdsourcing is received.

12. The server of claim 1 , wherein the controller is configured to control the communicator to transmit a message that confirms the update of the key point of the area and the second descriptor, to the terminal device that transmits the second image data of the area.

13. A method of controlling a server comprising a communicator and a controller, the control method comprising:
when first image data is received from a terminal device through the communicator, determining, by the controller, a first key point of the first image data and a first descriptor corresponding to the first key point;
determining, by the controller, a location of the terminal device by comparing the first descriptor with a second descriptor stored in a virtual positioning system (VPS) map;
identifying, by the controller, an area where a difference between the first descriptor and the second descriptor is greater than or equal to a predetermined value based on the location of the terminal device;
in response to an identified area where the difference between the first descriptor and the second descriptor is not greater than or equal to a predetermined reconstruction reference value, update the second descriptor based on the first image data;
in response to the identified area where the difference between the first descriptor and the second descriptor is greater than or equal to the predetermined reconstruction reference value, request crowdsourcing of second image data of the area to the terminal device;
after the second image data of the area is received from the terminal device, update a key point of the area on the VPS map and the second descriptor based on the second image data of the area; and
when a plurality of areas are identified where the difference between the first descriptor and the second descriptor is greater than or equal to the predetermined reconstruction reference value, controlling, by the controller, a user interface to display a list of the plurality of areas in an order of greatest difference between the first descriptor and the second descriptor.

14. The method of controlling claim 13 , further comprising:
providing, by the controller, a reward to the terminal device that transmits the second image data of the area.

15. The method of controlling claim 13 , wherein a request signal for requesting the crowdsourcing comprises at least one of a location information of the area, a photographing guide information for obtaining the second image data, or an augmented reality (AR) icon information for guiding a location of the area.

16. The method of controlling claim 13 , wherein the server further comprises the user interface comprising a display module and an input module.

17. The method of controlling claim 13 , further comprising:
controlling, by the controller, the communicator to transmit a message that confirms the update of the key point of the area and the second descriptor, to the terminal device that transmits the second image data of the area.

Assignees

• Hyundai Motor Co Ltd
• Kia Corp

Inventors

• Woo Seunghyun
• Woo Jae Yul
• An Rowoon
• Kim Soobin

Classifications

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06Q50/40

  Business processes related to the transportation industry (shipping G06Q10/083) · CPC title

• G06Q30/0207

  Discounts or incentives, e.g. coupons or rebates · CPC title

• G01C21/367

  Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker · CPC title

• G01C21/3647

  Guidance involving output of stored or live camera images or video streams · CPC title