Method and system for geographic map overlay onto a live feed

Patent metadata

Field	Value
Publication number	US-10242499-B2
Application number	US-201615044582-A
Country	US
Kind code	B2
Filing date	Feb 16, 2016
Priority date	Feb 16, 2016
Publication date	Mar 26, 2019
Grant date	Mar 26, 2019

Abstract

A computer program product for overlaying geographic map data onto a live feed is provided. The computer program product includes a computer readable storage medium having program instructions embodied therewith. The program instructions are readable and executable by a processing circuit to cause the processing circuit to approximate fluid depth on fixed points in a live feed to calculate discrete depth readings, combine the discrete depth readings with a contour map associated with the live feed to generate a fluid depth map and combine the fluid depth map with the live feed to produce an augmented reality image including the fluid depth map superimposed onto the live feed.

First claim

What is claimed is:

1. A computer program product for overlaying geographic map data onto a live feed of a flooded environment, which is flooded by at least one of water, snow and mud, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions being readable and executable by a processing circuit to cause the processing circuit to:
project the live feed of the flooded environment through smart glasses or a handheld computing device worn or held by a user;
determine a location of the smart glasses or the handheld computing device and the live feed;
obtain a contour map associated with the live feed of the determined location from a remote server;
derive a topology of the determined location from the contour map such that approximate fluid depths on fixed points in the live feed can be generated from a comparison between the topology and fluid levels at the determined location to thereby calculate discrete fluid level depth readings at the fixed points;
combine the discrete fluid level depth readings with the contour map associated with the live feed to generate a fluid depth map;
combine the fluid depth map with the live feed to enable production of an augmented reality image which includes the fluid depth map superimposed onto the live feed, which is user interactive and which is adjusted for a perspective of the user so that foreground portions of the augmented reality image are larger than corresponding background portions;
produce the augmented reality image which includes the fluid depth map superimposed onto the live feed, which is user interactive and which is adjusted for the perspective of the user; and
project the augmented reality image adjusted for the perspective of the user and including the fluid depth map superimposed onto the live feed through the smart glasses or the handheld computing device for interaction with a user.

2. The computer program product according to claim 1 , wherein the program instructions cause the processing circuit to approximate the fluid depth by reference to historical data associated with the fixed points in the live feed.

3. The computer program product according to claim 1 , wherein the contour map is derived from one or more of a torrent map, a satellite map, a line map and a three-dimensional map.

4. The computer program product according to claim 1 , wherein the fluid depth map illustrates fluid depth in one or more of varying colors, textual information and numerical information.

5. A computing system for overlaying geographic map data onto a live feed of a flooded environment, which is flooded by at least one of water, snow and mud, the computing system comprising a computer readable storage medium having instructions stored thereon that are executable by a processing circuit to cause the processing circuit to:
project the live feed of the flooded environment through smart glasses or a handheld computing device worn or held by a user;
determine a location of the smart glasses or the handheld computing device and the live feed;
obtain a contour map associated with the live feed of the determined location from a remote server;
derive a topology of the determined location from the contour map such that approximate fluid depths on fixed points in the live feed can be generated from a comparison between the topology and fluid levels at the determined location to thereby calculate discrete fluid level depth readings at the fixed points;
combine the discrete fluid level depth readings with the contour map associated with the live feed to generate a fluid depth map;
combine the fluid depth map with the live feed to enable production of an augmented reality image which includes the fluid depth map superimposed onto the live feed, which is user interactive and which is adjusted for a perspective of the user so that foreground portions of the augmented reality image are larger than corresponding background portions;
produce the augmented reality image which includes the fluid depth map superimposed onto the live feed, which is user interactive and which is adjusted for the perspective of the user; and
project the augmented reality image adjusted for the perspective of the user and including the fluid depth map superimposed onto the live feed through the smart glasses or the handheld computing device for interaction with a user.

6. The computing system according to claim 5 , wherein the instructions cause the processing circuit to approximate the fluid depth by reference to historical data associated with the fixed points in the live feed.

7. The computing system according to claim 5 , wherein the contour map is derived from one or more of a torrent map, a satellite map, a line map and a three-dimensional map.

8. The computing system according to claim 5 , wherein the fluid depth map illustrates fluid depth in one or more of varying colors, textual information and numerical information.

9. A computer-implemented method for overlaying geographic map data onto a live feed of an environment, which is flooded by at least one of water, snow and mud, comprising:
projecting the live feed of the flooded environment through smart glasses or a handheld computing device worn or held by a user;
determining a location of the smart glasses or the handheld computing device and the live feed;
obtaining a contour map associated with the live feed of the determined location from a remote server;
deriving a topology of the determined location from the contour map such that approximate fluid depths on fixed points in the live feed can be generated from a comparison between the topology and fluid levels at the determined location to thereby calculate discrete fluid depth readings at the fixed points;
combining the discrete fluid level depth readings with a contour map associated with the live feed to generate a fluid depth map;
combining the fluid depth map with the live feed to enable production of an augmented reality image which includes the fluid depth map superimposed onto the live feed, which is user interactive and which is adjusted for a perspective of the user so that foreground portions of the augmented reality image are larger than corresponding background portions;
producing the augmented reality image which includes the fluid depth map superimposed onto the live feed, which is user interactive and which is adjusted for the perspective of the user; and
projecting the augmented reality image adjusted for the perspective of the user and including the fluid depth map superimposed onto the live feed through the smart glasses or the handheld computing device for interaction with a user.

10. The computer-implemented method according to claim 9 , wherein the approximating comprises approximating the fluid depth by reference to historical data associated with the fixed points in the live feed.

11. The computer-implemented method according to claim 9 , wherein:
the contour map is derived from one or more of a torrent map, a satellite map, a line map and a three-dimensional map, and
the fluid depth map illustrates fluid depth in one or more of varying colors, textual information and numerical information.

Assignees

• IBM

Inventors

• Bryson Donald L
• Kline Eric V
• Rakshit Sarbajit K

Classifications

• G06T17/05

  Geographic models · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title