Enhancing images using environmental context

Patent metadata

Field	Value
Publication number	US-11323615-B2
Application number	US-201916541343-A
Country	US
Kind code	B2
Filing date	Aug 15, 2019
Priority date	Aug 15, 2019
Publication date	May 3, 2022
Grant date	May 3, 2022

Abstract

An image is captured using an image recorder. A set of contextual data associated with the image is also captured. The image is annotated with information describing the set of contextual data. A user is notified of the image and the set of contextual data, based on the annotated information that describes the set of contextual data.

First claim

What is claimed is:

1. A computer-implemented method for enhancing an image with contextual data, the method comprising:
capturing the image with an image recorder, the image including a first object having a first temperature and a second object having a second temperature that is different from the first temperature;
capturing a set of contextual data associated with the image, the set of contextual data comprising a spatial map of the first temperature and the second temperature;
displaying the image; and
presenting, in response to displaying the image, one or more contextual artifacts associated with the set of contextual data,
wherein presenting the one or more contextual artifacts comprises utilizing the spatial map to modify a third temperature.

2. The method of claim 1 , wherein the one or more contextual artifacts includes one or more scents.

3. The method of claim 1 , wherein the one or more contextual artifacts includes a set of ambient lighting characteristics.

4. The method of claim 3 , wherein the set of ambient lighting characteristics includes a set of light wavelengths and intensities.

5. The method of claim 1 , wherein the one or more contextual artifacts is selected from the group consisting of temperature, humidity, sounds, one or more recipes, and travel purchase information.

6. The method of claim 1 , wherein a first subset of the set of contextual data is captured, concurrently with the image, using a set of sensors communicatively coupled to the image recorder.

7. The method of claim 6 , wherein the first subset of the set of contextual data is selected from the group consisting of temperature data, sound data, Global Positioning System (GPS) data, light data, olfactory data, and micro-climate data.

8. The method of claim 1 , wherein a second subset of the set of contextual data is captured from archival sources.

9. The method of claim 8 , wherein the second subset of set of contextual data is selected from the group consisting of sound data, weather data, and calendar data.

10. The method of claim 9 , further comprising:
annotating the image with information describing the set of contextual data,
wherein the information includes metadata in exchangeable image file format.

11. The method of claim 1 , wherein a third subset of the set of contextual data is generated using image analysis techniques on the image to identify environmental objects and conditions.

12. The method of claim 1 , further comprising:
determining that a user does not have access rights to a first contextual artifact associated with the set of contextual data;
presenting, in response to the determining, an option to purchase the access rights; and
presenting, in response to the user purchasing the access rights, the first contextual artifact.

13. A system for enhancing an image with contextual data, comprising:
a memory with program instructions included thereon; and
a processor in communication with the memory, wherein the program instructions cause the processor to:
capture the image with an image recorder, the image including a first object having a first temperature and a second object having a second temperature that is different from the first temperature;
capture a set of contextual data associated with the image, the set of contextual data comprising a spatial map of the first temperature and the second temperature;
display the image; and
present, in response to displaying the image, one or more contextual artifacts associated with the set of contextual data,
wherein presenting the one or more contextual artifacts comprises utilizing the spatial map to modify a third temperature.

14. The system of claim 13 , wherein a first subset of the contextual data is captured, concurrently with the image, using a set of sensors communicatively coupled to the image recorder.

15. The system of claim 13 , wherein the one or more contextual artifacts is selected from the group consisting of temperature, humidity, sounds, one or more recipes, and travel purchase information.

16. The system of claim 13 , wherein the program instructions further cause the processor to:
determine that a user does not have access rights to a first contextual artifact associated with the set of contextual data;
present, in response to the determining, an option to purchase the access rights; and
present, in response to the user purchasing the access rights, the first contextual artifact.

17. A computer program product for enhancing an image with contextual data, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to:
capture the image with an image recorder, the image including a first object having a first temperature and a second object having a second temperature that is different from the first temperature;
capture a set of contextual data associated with the image, the set of contextual data comprising a spatial map of the first temperature and the second temperature;
display the image; and
present, in response to displaying the image, one or more contextual artifacts associated with the set of contextual data,
wherein presenting the one or more contextual artifacts comprises utilizing the spatial map to modify a third temperature.

18. The computer program product of claim 17 , wherein a first subset of the contextual data is captured, concurrently with the image, using a set of sensors communicatively coupled to the image recorder.

19. The computer program product of claim 17 , wherein the program instructions further cause the device to:
determine that a user does not have access rights to a first contextual artifact associated with the set of contextual data;
present, in response to the determining, an option to purchase the access rights; and present, in response to the user purchasing the access rights, the first contextual artifact.

20. The computer program product of claim 19 , wherein the program instructions further cause the device to:
present one or more additional contextual artifacts associated with the set of contextual data,
wherein the one or more additional contextual artifacts is selected from the group consisting of temperature, humidity, sounds, one or more recipes, and travel purchase information.

Assignees

• IBM

Inventors

• Tkac Vincent
• Allen Mark Timothy
• Guminy Scott

Classifications

• G06F16/583 Primary

  using metadata automatically derived from the content · CPC title

• G06F18/25

  Fusion techniques · CPC title

• G06V20/00

  Scenes; Scene-specific elements (control of digital cameras H04N23/60) · CPC title

• H04N23/23

  from thermal infrared radiation · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title