Independent beacon based light position system

Patent metadata

Field	Value
Publication number	US-9829559-B2
Application number	US-201615007614-A
Country	US
Kind code	B2
Filing date	Jan 27, 2016
Priority date	Jul 26, 2011
Publication date	Nov 28, 2017
Grant date	Nov 28, 2017

Abstract

Systems an methods are provided that disclose providing a positioning service for devices based on light received from one or more light sources. This light based positioning service uses light information transmitted by each light source to determine the position of the device. The positioning information can include three dimension position information in a building that can then be used to deliver services and information to a mobile device. The content delivered to a mobile device can include multimedia, text, audio, and/or pictorial information. The positioning information along with other location or positioning information can be used in providing augmented reality or location aware services. The light sources can be independent beacons that broadcast information in visible light at a rate that is undetectable by the human eye. Content can be retrieved from a server over a communications connection.

First claim

What is claimed is:

1. A mobile device, comprising:
an image sensor;
a wireless interface configured to communicate through a network over a wireless medium;
a processor coupled to the image sensor and the wireless interface;
a memory; and
software in the memory to be run by the processor, wherein running of the software by the processor configures the mobile device to perform functions, including functions to:
operate the image sensor to capture an image of at least two visible light sources in an indoor location including a modulated visible light signal transmitted by one of the at least two visible light sources of an indoor location;
using the captured image, demodulate the modulated visible light signal transmitted by the one visible light source;
based on the demodulated visible light signals, determine a light source identifier corresponding to the one visible light source;
retrieve position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and
calculate, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the at least two light sources, coordinates for a position of the mobile device relative in the indoor location.

2. The mobile device of claim 1 , wherein the mobile device when retrieving position information is further configured by the software running on the processor, to:
transmit, via the wireless interface, a request to a server requesting position information corresponding to the determined light source identifier; and
receive, via the wireless interface, position information corresponding to the determined light source identifier.

3. The mobile device of claim 1 , further comprises:
indoor location information stored in the memory, the indoor location information including a map of the indoor location, light source identifiers, and position information of light sources within the indoor location, wherein:
the mobile device when retrieving position information is further configured by the software running on the processor, to:
access the indoor location information stored in the memory; and
retrieve position information corresponding to the determined light source identifier.

4. The mobile device of claim 1 , wherein:
the mobile device, when demodulating the visible light signals is further configured by the software running on the processor, to:
apply a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the at least two light sources appear in brighter regions of pixels than other pixels in the captured image;
in response to isolating the brighter regions of pixels in the captured image, independently process each of the isolated brighter regions as corresponding to each of the at least two light sources to determine the visible light signal transmitted by the respective light sources.

5. The mobile device of claim 1 , further comprising:
a display device;
a map of the indoor location stored in the memory; and
wherein running of the software by the processor configures the mobile device to implement functions, including functions to:
retrieve the map of the indoor location in which the mobile device is located; and
present, on the display device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

6. The mobile device of claim 1 , wherein the image sensor is a rolling shutter camera.

7. The mobile device of claim 1 , wherein the image sensor is a charge-coupled device.

8. A method, comprising:
operating an image sensor of the mobile device to capture an image of at least two visible light signals in an outdoor location including a modulated visible light signal transmitted by at least two visible light source of an indoor location;
demodulating the modulated visible light signal transmitted by one of the at least two visible light source using the captured image;
determining a light source identifier corresponding to the one of at least two visible light source based on the demodulated visible light signals;
retrieving position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and
calculating, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the three light sources, coordinates for a position of the mobile device relative in the indoor location.

9. The method of claim 8 , wherein retrieving position information further comprises:
transmitting, via a wireless interface configured to communicate through a network over a wireless medium, a request to a server, the request requesting position information corresponding to each of the determined light source identifier; and
receiving, via the wireless interface, position information corresponding to the determined light source identifiers.

10. The method of claim 8 , further comprises:
accessing indoor location information stored in a memory of the mobile device, wherein the indoor location information includes a map of the indoor location, light source identifiers, and position information of light sources within the indoor location; and
retrieving position information from the accessed indoor location information corresponding to the determined light source identifier.

11. The method of claim 8 , wherein demodulating the visible light signals further comprises:
applying a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the at least two light sources appear in brighter regions of pixels than other pixels in the captured image;
in response to isolating the brighter regions of pixels in the captured image, independently processing each of the isolated brighter regions as corresponding to each of the at least two light sources to determine the visible light signal transmitted by the respective light sources.

12. The method of claim 8 , further comprising:
retrieving, from a memory of the mobile device, a map of the indoor location in which the mobile device is located; and
presenting, on a display device of the mobile device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

13. The method of claim 8 , wherein the image sensor is a rolling shutter camera.

14. A non-transitory tangible computer readable medium embodying instructions to cause a mobile device to perform functions, including functions to:
operate an image sensor of the mobile device to capture an image of at least two visible light signal in an outdoor location including a modulated visible light signal transmitted by one of at least one visible light source of an indoor location;
demodulate the modulated visible light signal transmitted by the one of the at least two visible light source using the captured image;
determine a light source identifier corresponding to the one visible light source based on the demodulated visible light signals;
retrieve position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresp

Assignees

• Abl Ip Holding Llc

Inventors

• Ganick Aaron
• Ryan Daniel

Classifications

• G01S5/16 Primary

  using electromagnetic waves other than radio waves · CPC title

• H04N7/183

  for receiving images from a single remote source · CPC title

• H04B10/116

  Visible light communication · CPC title

• H04W4/023

  using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds · CPC title

• H04B10/60

  Receivers · CPC title