Route guidance device and route guidance system

Patent metadata

Field	Value
Publication number	US-12498240-B2
Application number	US-202118039909-A
Country	US
Kind code	B2
Filing date	Nov 30, 2021
Priority date	Dec 1, 2020
Publication date	Dec 16, 2025
Grant date	Dec 16, 2025

Abstract

The present invention provides a route guidance device and a route guidance system. The route guidance device according to an embodiment of the present invention comprises: an interface unit which communicates with at least one of components provided in a vehicle; and a processor which generates a digital twin three-dimensional map using at least one among an image captured by a camera provided in the vehicle, two-dimensional map information, and three-dimensional map information, wherein the processor overlays a graphical object related to route guidance on the digital twin three-dimensional map, and performs route guidance using the digital twin three-dimensional map overlaid with the graphical object related to route guidance.

First claim

The invention claimed is:

1 . A route guidance device comprising:
an interface unit that communicates with at least one of components disposed in a vehicle; and a processor that generates a digital twin three-dimensional (3D) map using at least one of an image captured by a camera disposed in the vehicle, two-dimensional (2D) map information, and 3D map information, overlays a graphic object related to route guidance on the digital twin 3D map, and performs the route guidance using the digital twin 3D map with the graphic object related to the route guidance overlaid thereon, wherein the processor overlays the graphic object related to the route guidance on the digital twin 3D map by mapping a location of the graphic object onto the digital twin 3D map based on the 2D map information, and matches the 2D map information with the image captured by the camera disposed in the vehicle and displays the graphic object overlaid on the digital twin 3D map on the image captured by the camera that is aligned based on the 2D map information.

2 . The route guidance device of claim 1 , wherein the processor generates the digital twin 3D map by mapping the image captured by the camera to the 3D map information.

3 . The route guidance device of claim 2 , wherein the processor deletes a 3D block corresponding to an object, which does not exist in reality, from the 3D map information or adds a 3D block corresponding to an object existing in reality, based on the 2D map information and the 3D map information.

4 . The route guidance device of claim 1 , where the processor creates the digital twin 3D map and overlays a graphic object related to route guidance on the digital twin 3D map when a preset condition is satisfied.

5 . The route guidance device of claim 4 , wherein the preset condition includes at least one of a case corresponding to a specific weather condition or a case where another object exists, instead of an object on which the graphic object related to route guidance is to be overlaid.

6 . A route guidance system comprising:
a server that transmits three-dimensional (3D) map information; and a route guidance device that senses vehicle-related information from a sensor disposed in a vehicle, generates a digital twin 3D map by matching the sensed vehicle-related information with the 3D map information received from the server, overlays a graphic object related to route guidance on the digital twin 3D map, and performs the route guidance using the digital twin 3D map with the graphic object related to the route guidance overlaid thereon, wherein the route guidance device comprises: a camera disposed in the vehicle to capture an image; and an augmented reality (AR) engine that generates the digital twin 3D map by mapping the image captured by the camera to the 3D map information, and wherein the AR engine is provided with the digital twin 3D map, and renders the graphic object related to the route guidance on the provided digital twin 3D map based on two-dimensional (2D) map information.

7 . The route guidance system of claim 6 , wherein the AR engine determines a position where the image captured by the camera is mapped to the 3D map information, using the 2D map information.

8 . The route guidance system of claim 6 , wherein the route guidance device transmits an image obtained through a camera disposed in the vehicle to the server, and
the server generates a digital twin 3D map by mapping the image to the 3D map information, and transmits the generated 3D map to the route guidance device.

9 . The route guidance system of claim 8 , wherein the route guidance device overlays a graphic object related to route guidance on the digital twin 3D map received from the server.

10 . The route guidance system of claim 8 , wherein the route guidance device determines whether a preset condition that requires for route guidance through the digital twin 3D map is satisfied, based on the image obtained through the camera, and
transmits the image to the server and receives the digital twin 3D map from the server when the preset condition is satisfied.

11 . The route guidance system of claim 10 , wherein the preset condition includes a case where there is a graphic object which has to be exposed at a place where the vehicle is to be located after a predetermined time elapses based on the 2D map information.

Assignees

• Lg Electronics Inc

Inventors

• Son Jinho

Classifications

• G01C21/365

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G01C21/3638 Primary

  including 3D objects and buildings (three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06Q50/40

  Business processes related to the transportation industry (shipping G06Q10/083) · CPC title

• G06T17/05

  Geographic models · CPC title