Tagging visual data with wireless signal information

Patent metadata

Field	Value
Publication number	US-2016188540-A1
Application number	US-201414585535-A
Country	US
Kind code	A1
Filing date	Dec 30, 2014
Priority date	Dec 30, 2014
Publication date	Jun 30, 2016
Grant date	—

Abstract

Techniques describe tagging visual data with wireless and sensor measurement information by a mobile device. In some implementations, additional metadata fields may be used for tagging visual data with wireless and/or sensor measurement information. Embodiments also describe expanding the current format dictated by the standards for image (e.g., Exif) and video formats (mediaObject metadata) to include wireless and sensor measurements in the metadata. Furthermore, sensor information may include barometer, magnetometer and motion sensor (e.g., accelerometer, gyroscope, etc.) information. The mobile device may transmit the tagged visual data to a crowdsourcing server.

First claim

What is claimed is:

1 . A method for tagging visual data, the method comprising:
acquiring visual data using a camera coupled to a device; receiving at least one wireless signal from an at least one signal emitting device; deriving information comprising source identifying information associated with the at least one signal emitting device from the at least one wireless signal; and tagging the visual data with the information associated with the at least one signal emitting device.

2 . The method of claim 1 , further comprising wirelessly transmitting the tagged visual data to a remote server.

3 . The method of claim 1 , wherein deriving information further comprises deriving signal strength of the at least one wireless signal from the at least one signal emitting device measured at the device.

4 . The method of claim 1 , wherein deriving information further comprises deriving a round-trip time using the at least one wireless signal from the at least one signal emitting device.

5 . The method of claim 1 , wherein the at least one signal emitting device is a wireless access point.

6 . The method of claim 1 , wherein the source identifying information is a media access control (MAC) address.

7 . The method of claim 1 , wherein the at least one wireless signal is one of a Wi-Fi signal, non-audible sound, ultra-sound signal and non-visible light ray.

8 . The method of claim 1 , wherein the visual data is acquired by the camera in a GNSS-denied environment.

9 . The method of claim 1 , wherein the at least one signal emitting device is stationary.

10 . The method of claim 1 , wherein a location of the signal emitting device is unknown at least at a time the at least one wireless signal is received.

11 . The method of claim 1 , further comprising tagging the visual data with barometer information.

12 . The method of claim 1 , further comprising tagging the visual data with magnetometer information.

13 . The method of claim 1 , further comprising tagging the visual data with motion sensor information.

14 . The method of claim 1 , wherein the visual data is an image.

15 . The method of claim 1 , wherein the visual data is included in an image file formatted according to Exchangeable Image File format (Exif) and tagging the visual data comprises including the information associated with the at least one signal emitting device as part of metadata for the image file.

16 . The method of claim 1 , wherein the visual data is a video.

17 . A device comprising:
a camera configured to acquire visual data; a memory configured to store the visual data; a transceiver configured to receive at least one wireless signal from an at least one signal emitting device; and a processor configured to:
derive information comprising identifying information associated with the at least one signal emitting device from the at least one wireless signal; and
tag the visual data with the information associated with the at least one signal emitting device.

18 . The device of claim 17 , wherein the transceiver is further configured to wirelessly transmit the tagged visual data to a remote server.

19 . The device of claim 17 , wherein the information associated with the at least one signal emitting device further comprises one or more of signal strength of the at least one wireless signal from the at least one signal emitting device and round-trip time using the at least one wireless signal from the at least one signal emitting device.

20 . The device of claim 17 , wherein the at least one signal emitting device is a wireless access point.

21 . The device of claim 17 , wherein the at least one wireless signal is one of a Wi-Fi signal, non-audible sound, ultra-sound signal and non-visible light ray.

22 . The device of claim 17 , wherein the visual data is acquired by the camera in a GNSS-denied environment.

23 . The device of claim 17 , wherein a location of the signal emitting device is unknown at least at a time the at least one wireless signal is received.

24 . The device of claim 17 , wherein the processor is further configured to tag the visual data with one or more of barometer information, magnetometer information and motion sensor information.

25 . The device of claim 17 , wherein the visual data is included in an image file formatted according to Exchangeable Image File format (Exif) and tagging the visual data comprises including the information associated with the at least one signal emitting device as part of metadata for the image file.

26 . An apparatus comprising:
means for acquiring visual data using a camera coupled to the apparatus; means for receiving at least one wireless signal from an at least one signal emitting device; means for deriving information comprising source identifying information associated with the at least one signal emitting device from the at least one wireless signal; and means for tagging the visual data with the information associated with the at least one signal emitting device.

27 . The apparatus of claim 26 , further comprising means for wirelessly transmitting the tagged visual data to a remote server.

28 . The apparatus of claim 26 , wherein the visual data is acquired by the camera in a GNSS-denied environment.

29 . A non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises instructions executable by a processor, the instructions comprising instructions to:
acquire visual data using a camera coupled to a device; receive at least one wireless signal from an at least one signal emitting device; derive information comprising source identifying information associated with the at least one signal emitting device from the at least one wireless signal; and tag the visual data with the information associated with the at least one signal emitting device.

30 . The non-transitory computer-readable storage medium of claim 29 , further comprising instructions for wirelessly transmitting the tagged visual data to a remote server.

Assignees

• Qualcomm Inc

Inventors

• Naguib Ayman Fawzy
• Chao Hui
• Das Saumitra Mohan

Classifications

• G01S5/02525

  Gathering the radio frequency fingerprints · CPC title

• G01S5/02526

  using non-dedicated equipment, e.g. user equipment or crowd-sourcing · CPC title

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• G01S5/02521 Primary

  using a radio-map · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title