Hybrid multi-camera based positioning

Patent metadata

Field	Value
Publication number	US-2018349727-A1
Application number	US-201816005672-A
Country	US
Kind code	A1
Filing date	Jun 11, 2018
Priority date	Jul 18, 2013
Publication date	Dec 6, 2018
Grant date	—

Abstract

A positioning server is connected to a collection of access points, base stations, NFC stations, and image or video cameras and the collected data is used for positioning objects. A plurality of electronic devices are paired with an object by tracking the position of the object based on imaging and the position of electronic devices based on RF signals in vicinity of the object. Once a device is paired with an object, the propagation channel profile measured through the electronic device is used to develop and tune a database of channel profiles versus location. This database is used based on signature/profile matching and correlation for positioning devices and objects that do not have pairing or have poor image-based positioning accuracy or reliability. When a device is detected that cannot be paired with any object, or a device that is unpaired from a previously associated object, a theft or loss alert is generated.

First claim

1 - 17 . (canceled)

18 . A non-transitory machine readable medium storing a program for providing a position of an object, the program executable by at least one processing unit, the program comprising sets of instructions for:
determining the position of the object using a plurality of images taken by a set of cameras; identifying a set of electronic devices within a predetermined distance of the object based on a set of radio frequency (RF) signals received from each electronic device in the set of electronic devices; pairing a plurality of electronic devices in the set of electronic devices with the object based on distances between the object and each electronic device in the set of electronic devices at a plurality of instances of time; and sending the position of the object determined by using the plurality of images to at least one of the paired electronic devices.

19 . The non-transitory machine readable medium of claim 18 , wherein the set of instructions for identifying a set of electronic devices within a predetermined distance of the object based on a set of radio frequency (RF) signals received from each electronic device comprises sets of instructions for:
determining a set of channel propagation profiles from the set of RF signals received from each electronic device; comparing the propagation profile determined for each electronic device with a set of channel propagation profiles retrieved from a database; determining a position of each electronic device based on the comparison; and determining that a distance between the determined position of each electronic device and the position of the object is within the predetermined distance.

20 . The non-transitory machine readable medium of claim 19 , the program further comprising sets of instructions for:
determining that a plurality of channel propagation profiles from the set of channel propagation profiles retrieved from a database matches the measured propagation profile received from a particular electronic device, the plurality of channel propagation profiles corresponding to a plurality of positions retrieved from the database; determining a search region for the particular electronic device centered around a previous position of the particular electronic device, the search region radius determined based on (ii) a maximum speed of the particular electronic device and (iii) an elapsed time since the previous position was determined; and determining a position of the particular electronic device from one or more of the positions retrieved from the database that are within the search region.

21 . The non-transitory machine readable medium of claim 20 , wherein the set of instructions for determining a position of the particular electronic device from one or more of the positions retrieved from the database that are within the search region comprises sets of instructions for:
determining that only one position from the positions retrieved from the database is within the search region; and setting the position of the particular electronic device to the only position from the positions retrieved from the database that is within the search region.

22 . The non-transitory machine readable medium of claim 21 , wherein the search region is a first search region, wherein the previous position of the particular electronic device is a first previous position, wherein the set of instructions for determining a position of the particular electronic device from one or more of the positions retrieved from the database that are within the search region comprises sets of instructions for:
determining that more than one positions from the positions retrieved from the database are within the search region; determining a second search region for the particular electronic device centered around a second previous position of the particular electronic device, the search region radius determined based on (ii) a maximum speed of the particular electronic device and (iii) an elapsed time since the second previous position was determined; and determining the position of the particular electronic device from one or more of the positions retrieved from the database that are within the second search region.

23 . The An apparatus comprising:
a set of processing units for executing sets of instructions; a non-transitory machine readable medium storing a program which when executed by one of the processing units provides a position of an object, the program comprising sets of instructions for: determining the position of the object using a plurality of images taken by a set of cameras; identifying a set of electronic devices within a predetermined distance of the object based on a set of radio frequency (RF) signals received from each electronic device in the set of electronic devices; pairing a plurality of electronic devices in the set of electronic devices with the object based on distances between the object and each electronic device in the set of electronic devices at a plurality of instances of time; and sending the position of the object determined by using the plurality of images to at least one of the paired electronic devices.

24 . The apparatus of claim 23 , wherein the set of instructions for identifying a set of electronic devices within a predetermined distance of the object based on a set of radio frequency (RF) signals received from each electronic device comprises sets of instructions for:
determining a set of channel propagation profiles from the set of RF signals received from each electronic device; comparing the propagation profile determined for each electronic device with a set of channel propagation profiles retrieved from a database; determining a position of each electronic device based on the comparison; and determining that a distance between the determined position of each electronic device and the position of the object is within the predetermined distance.

25 . The apparatus of claim 24 , the program further comprising sets of instructions for:
determining that a plurality of channel propagation profiles from the set of channel propagation profiles retrieved from a database matches the measured propagation profile received from a particular electronic device, the plurality of channel propagation profiles corresponding to a plurality of positions retrieved from the database; determining a search region for the particular electronic device centered around a previous position of the particular electronic device, the search region radius determined based on (ii) a maximum speed of the particular electronic device and (iii) an elapsed time since the previous position was determined; and determining a position of the particular electronic device from one or more of the positions retrieved from the database that are within the search region.

26 . The apparatus of claim 25 , wherein the set of instructions for determining a position of the particular electronic device from one or more of the positions retrieved from the database that are within the search region comprises sets of instructions for:
determining that only one position from the positions retrieved from the database is within the search region; and setting the position of the particular electronic device to the only position from the positions retrieved from the database that is within the search region.

27 . The apparatus of claim 26 , wherein the search region is a first search region, wherein the previous position of the particular electronic device is a first previous position, wherein the set of instructions for determining a position of the particular electronic device from one or more of the positions retrieved from the database

Assignees

• Golba Llc

Inventors

• Moshfeghi Mehran

Classifications

• G06T7/292 Primary

  Multi-camera tracking · CPC title

• G06T2207/30196

  Human being; Person · CPC title

• G01S5/0263

  by combining or switching between positions derived from two or more separate positioning systems · CPC title

• G06T2207/10048

  Infrared image · CPC title

• G06T2207/10024

  Color image · CPC title