Link devices using their relative positions

Patent metadata

Field	Value
Publication number	US-2020314626-A1
Application number	US-201916364960-A
Country	US
Kind code	A1
Filing date	Mar 26, 2019
Priority date	Mar 26, 2019
Publication date	Oct 1, 2020
Grant date	—

Abstract

A method, system, and computer program product for identifying and linking communicating devices using live camera data includes: identifying a visible device that is visible to a linking device; identifying a connected device that is connected to the linking device; determining visible movement of the visible device; requesting video information from the connected device; calculating, using the video information, video movement of the connected device; determining that the visible movement matches the video movement; concluding, based on the determining, that the visible device is the connected device; and linking, based on the concluding, the visible device and the connected device.

First claim

What is claimed is:

1 . A computer-implemented method comprising:
identifying a visible device that is visible to a linking device; identifying a connected device that is connected to the linking device; determining visible movement of the visible device; requesting video information from the connected device; calculating, using the video information, video movement of the connected device; determining that the visible movement matches the video movement; concluding, based on the determining, that the visible device is the connected device; and linking, based on the concluding, the visible device and the connected device.

2 . The method of claim 1 , wherein determining visible movement includes calculating a rotation, direction, and angular frequency of the one or more visible devices.

3 . The method of claim 1 , wherein calculating video movement includes calculating at least a rotation and translation of the one or more visible devices.

4 . The method of claim 1 , wherein determining that the visible movement matches the video movement comprises:
identifying a path of the video movement for the connected device; identifying a path of the visible movement for the visible device; and determining whether the path of the video movement matches the path of the visible movement.

5 . The method of claim 4 , wherein the visible device includes a plurality visible devices, further comprising:
determining that a plurality of paths of visible movement from the plurality of the visible devices match the path of video movement; and selecting the path of visible movement with a highest match similarity to the video movement as a match.

6 . The method of claim 4 , wherein the visible device includes a plurality visible devices, further comprising:
determining that a plurality of paths of visible movement from the plurality of the visible devices match the path of video movement; and comparing the plurality of paths of visible movement to the path of video movement as at least the path of video movement evolves, until a single path of visible movement matches the path of video movement.

7 . The method of claim 1 , wherein the visible movement is determined using a constantly running video feed from the camera of the linking device.

8 . The method of claim 1 , wherein the visible movement is determined using a video feed that is activated by a trigger to begin monitoring the visible device.

9 . The method of claim 1 , wherein linking the visible device and the connected device includes mapping location data for the visible device with connection data for the connected device to form a more complete data set for the connected device.

10 . The method of claim 1 , wherein the linking device has knowledge of a device type of the connected device and the identifying the visible device further comprises:
identifying the visible device with the device type of the connected device.

11 . The method of claim 1 , wherein the identifying the visible device includes identifying the visible device including a camera visible to the linking device.

12 . A system having one or more computer processors, the system configured to:
identify a visible device that is visible to a linking device; identify a connected device that is connected to the linking device; determine visible movement of the visible device; request video information from the connected device; calculate, using the video information, video movement of the connected device; determine that the visible movement matches the video movement; conclude, based on the determining, that the visible device is the connected device; and link, based on the concluding, the visible device and the connected device.

13 . The system of claim 12 , wherein determining visible movement includes calculating a rotation, direction, and angular frequency of the one or more visible devices.

14 . The system of claim 12 , wherein calculating video movement includes calculating at least a rotation and translation of the one or more visible devices.

15 . The system of claim 12 , wherein comparing the video movement to the visible movement comprises:
identifying a path of the video movement for the connected device; identifying a path of the visible movement for the visible device; and determining whether the path of the video movement matches the path of the visible movement.

16 . The system of claim 15 , wherein the one or more visible devices is comprised of a plurality of at least two visible devices, further comprising:
determining that a plurality of paths of visible movement from the plurality of the visible devices match the path of video movement; and selecting the path of visible movement with a highest match similarity to the video movement as a match.

17 . The system of claim 15 , wherein the one or more visible devices is comprised of a plurality of at least two visible devices, further comprising:
determining that a plurality of paths of visible movement from the plurality of the visible devices match the path of video movement; and comparing the plurality of paths of visible movement to the path of video movement as at least the path of video movement evolves, until a single path of visible movement matches the path of video movement.

18 . A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a server to cause the server to perform a method, the method comprising:
identifying a visible device that is visible to a linking device; identifying a connected device that is connected to the linking device; determining visible movement of the visible device; requesting video information from the connected device; calculating, using the video information, video movement of the connected device; determining that the visible movement matches the video movement; concluding, based on the determining, that the visible device is the connected device; and linking, based on the concluding, the visible device and the connected device.

19 . The computer program product of claim 18 , wherein comparing the video movement to the visible movement comprises:
identifying a path of the video movement for the connected device; identifying a path of the visible movement for the visible device; and determining whether the path of the video movement matches the path of the visible movement.

20 . The computer program product of claim 19 , wherein the one or more visible devices is comprised of a plurality of at least two visible devices, further comprising:
determining that a plurality of paths of visible movement from the plurality of the visible devices match the path of video movement; and selecting the path of visible movement with a highest match similarity to the video movement as a match.

Assignees

• IBM

Inventors

• Hawker Samuel B
• Lees Andrew Michael
• Collins Aaron James
• Gashi Aaron Tomor Robert

Classifications

• G06V20/10

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06V20/40

  in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) · CPC title

• G06T2207/30241

  Trajectory · CPC title

• G06T7/248 Primary

  involving reference images or patches · CPC title