Crowd sourced vision and sensor-surveyed mapping

Patent metadata

Field	Value
Publication number	US-9641814-B2
Application number	US-201013697589-A
Country	US
Kind code	B2
Filing date	May 19, 2010
Priority date	May 19, 2010
Publication date	May 2, 2017
Grant date	May 2, 2017

Abstract

A system for enhancing the provision of location information based on previously stored visual data. Apparatuses may utilize sensors to sense at least visual information at a location. The sensed visual information may include attributes that may be defined as one or more visual elements in the recorded visual information. The one or more visual elements may then be stored in a mapping database in association with the location.

First claim

What is claimed is:

1. A method, comprising:
utilizing sensing resources in an apparatus to sense at least visual information corresponding to the location of the apparatus;
utilizing the sensing resources in the apparatus to sense electronic signals and/or fields at the location of the apparatus;
identifying attributes of the location by defining one or more visual elements within the visual information corresponding to the attributes;
extracting the defined one or more visual elements from the sensed visual information; and
creating a representation of the location in a mapping database by recording the extracted one or more visual elements, rather than the sensed visual information, in association with the location in the mapping database,
wherein recording the extracted one or more visual elements in association with the location in the mapping database comprises determining if any of the extracted one or more visual elements already exist in the mapping database by at least using the electronic signals and/or fields sensed at the location to find the extracted one or more visual elements in the mapping database.

2. The method of claim 1 , wherein the sensing resources comprise at least a camera and the visual information is an electronic image captured at the location.

3. The method of claim 1 , wherein the attributes of the location may comprise physical objects, hallways, doorways, shapes or colors in the location.

4. The method of claim 1 , wherein recording the one or more visual elements in association with the location in the mapping database comprises identifying the location as a new location when the one or more visual elements do not already exist in the mapping database.

5. The method of claim 1 , wherein the mapping database comprises representations for one or more locations that are combined together in the mapping database to form a map, the one or more locations being combined together based at least on common visual elements in the one or more visual elements corresponding to each representation of a location.

6. The method of claim 5 , wherein the map corresponds to a structure interior, the representations of locations corresponding to areas within the structure interior.

7. A computer program product comprising computer executable program code recorded on a non-transitory computer readable storage medium, the computer executable program code comprising:
code configured to cause an apparatus to perform the method of claim 1 .

8. An apparatus, comprising:
at least one processor; and
at least one memory including executable instructions, the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to perform at least the following:
utilize sensing resources in an apparatus to sense at least visual information corresponding to the location of the apparatus;
utilize the sensing resources in the apparatus to sense electronic signals and/or fields at the location of the apparatus;
identify attributes of the location by defining one or more visual elements within the visual information corresponding to the attributes;
extract the defined one or more visual elements from the sensed visual information; and
create a representation of the location in a mapping database by recording the extracted one or more visual elements, rather than the sensed visual information, in association with the location in the mapping database,
wherein recording the extracted one or more visual elements in association with the location in the mapping database comprises the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to determine if any of the extracted one or more visual elements already exist in the mapping database by at least using the electronic signals and/or fields sensed at the location to find the extracted one or more visual elements in the mapping database.

9. The apparatus of claim 8 , wherein the sensing resources comprise at least a camera and the visual information is an electronic image captured at the location.

10. The apparatus of claim 8 , wherein the attributes of the location may comprise physical objects, hallways, doorways, shapes or colors in the location.

11. The apparatus of claim 8 , wherein recording the one or more visual elements in association with the location in the mapping database further comprises the at least one memory and the executable instructions being configured to, in cooperation with the at least one processor, cause the apparatus to identify the location as a new location when the one or more elements do not already exist in the mapping database.

12. The apparatus of claim 8 , wherein the mapping database comprises representations for one or more locations that are combined together in the mapping database to form a map, the one or more locations being combined together based at least on common visual elements in the one or more visual elements corresponding to each representation of a location.

13. The apparatus of claim 12 , wherein the map corresponds to a structure interior, the representations of locations corresponding to areas within the structure interior.

14. A system, comprising:
an apparatus; and
a mapping database;
the apparatus utilizing sensing resources in the apparatus to sense at least visual information corresponding to the location of the apparatus and identifying attributes of the location by defining one or more visual elements within the visual information corresponding to the attributes;
the apparatus further utilizing the sensing resources in the apparatus to sense electronic signals and/or fields at the location of the apparatus;
the apparatus further extracting the defined one or more visual elements from the sensed visual information; and
the apparatus further creating a representation of the location in the mapping database by recording the extracted one or more visual elements, rather than the sensed visual information, in association with the location in the mapping database,
wherein recording the extracted one or more visual elements in association with the location in the mapping database comprises the apparatus determining if any of the extracted one or more visual elements already exist in the mapping database by at least using the electronic signals and/or fields sensed at the location to find the extracted one or more visual elements in the mapping database.

Assignees

• Wirola Lauri
• Syrjarinne Jari
• Nokia Technologies Oy

Inventors

• Wirola Lauri
• Syrjarinne Jari

Classifications

• H04W64/00 Primary

  Locating users or terminals {or network equipment} for network management purposes, e.g. mobility management · CPC title

• G01S5/0264

  at least one of the systems being a non-radio wave positioning system · CPC title

• H04N9/04 Primary

  Electricity · mapped topic

• G01S5/0263

  by combining or switching between positions derived from two or more separate positioning systems · CPC title

• H04N23/10

  for generating image signals from different wavelengths · CPC title