Identifying a change in a home environment

Patent metadata

Field	Value
Publication number	US-9978290-B2
Application number	US-201615146378-A
Country	US
Kind code	B2
Filing date	May 4, 2016
Priority date	May 22, 2014
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

A system and computer implemented method for detecting a change in a home environment for a visually impaired user is disclosed. The method may include monitoring the home environment using a set of sensors configured to collect environment data for a set of areas of the home environment. The method may also include detecting an environmental change in an area of the home environment. The method may also include providing, in response to a triggering event, a notification of the environmental change.

First claim

What is claimed is:

1. A computer implemented method for detecting a change in a home environment for a visually impaired user, the method comprising:
capturing, by an image capturing system, a first set of images for a set of areas of the home environment, the first set of images including one or more objects, each of the one or more objects having a respective first position in the first set of images;
while the visually impaired user is not located within the home environment, capturing a second set of images for the set of areas of the home environment in response to receiving a motion alert from a motion detection system coupled to the image capturing system, the second set of images including the one or more objects;
while the visually impaired user is not located within the home environment, comparing the first set of images with the second set of images to identify an object of the one or more objects having a respective second position in the second set of images, the respective second position of the identified object in the second set of images being different from the respective first position of the identified object in the first set of images such that the identified object meets an obstruction criterion; and
in response to detecting arrival of the visually impaired user at the home environment, providing a notification to the visually impaired user that the identified object meets the obstruction criterion.

2. The method of claim 1 , wherein the obstruction criterion includes an object displacement threshold based on an origin position and a subsequent position, and an object size threshold based on a first dimension, a second dimension, and a third dimension.

3. The method of claim 1 , wherein the home arrival is detected by a security system in response to a door unlock of a home.

4. The method of claim 1 , wherein detecting arrival of the visually impaired user at the home environment comprises monitoring, using a radio-frequency identification (RFID) tracking system, the location of a cane of the user, wherein the cane is equipped with a RFID bit communicatively connected to the RFID tracking system.

5. The method of claim 1 , wherein detecting arrival of the visually impaired user at the home environment comprises monitoring, using a thermal imaging system, a body heat signature; and detecting arrival of the visually impaired user based on the body heat signature.

6. The method of claim 1 , wherein providing the notification includes announcing, through a dog collar communicatively connected to the image capturing system and equipped with a speaker, a voice message notifying the user of the identified object meeting the obstruction criterion.

7. A system for detecting a change in a home environment for a visually impaired user, the system comprising:
an image capturing system configured to collect a first set of images for a set of areas of the home environment, the first set of images including one or more objects, each of the one or more objects having a respective first position in the first set of images;
a motion detection system coupled to the image capturing system and configured to detect motion in the home environment; and
a processor communicatively coupled to the image capturing system and the motion detection system;
wherein the image capturing system is configured to capture a second set of images for the set of areas of the home environment while the visually impaired user is not located within the home environment, in response to receiving a motion alert from the motion detection system, the second set of images including the one or more objects;
wherein the processor is configured to compare the first set of images with the second set of images while the visually impaired user is not located within the home environment to identify an object of the one or more objects having a respective second position in the second set of images, the respective second position of the identified object in the second set of images being different from the respective first position of the identified object in the first set of images such that the identified object meets an obstruction criterion; and
wherein the processor is configured to provide a notification to the visually impaired user that the identified object meets the obstruction criterion in response to detecting arrival of the visually impaired user at the home environment.

8. The system of claim 7 , wherein the obstruction criterion includes an object displacement threshold based on an origin position and a subsequent position, and an object size threshold based on a first dimension, a second dimension, and a third dimension.

9. The system of claim 7 , wherein the system further comprises a security system configured to detect the home arrival in response to a door unlock of a home.

10. The system of claim 7 , wherein the system further comprises a radio-frequency identification (RFID) tracking system configured to monitor the location of a cane of the user, wherein the cane is equipped with a RFID bit communicatively connected to the RFID tracking system.

11. The system of claim 7 , wherein the system further comprises a thermal imaging system configured to monitor for body heat signature of the visually impaired user to detect arrival of the visually impaired user at the home environment.

12. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a first computing device, causes the first computing device to:
receive a first set of images for a set of areas of the home environment from an image capturing system, the first set of images including one or more objects, each of the one or more objects having a respective first position in the first set of images;
receive a second set of images for the set of areas of the home environment while the visually impaired user is not located within the home environment in response to receiving a motion alert from a motion detection system, the second set of images including the one or more objects;
compare the first set of images with the second set of images while the visually impaired user is not located within the home environment to identify an object of the one or more objects having a respective second position in the second set of images, the respective second position of the identified object in the second set of images being different from the respective first position of the identified object in the first set of images such that the identified object meets an obstruction criterion; and
in response to detecting arrival of the visually impaired user at the home environment, provide a notification to the visually impaired user that the identified object meets the obstruction criterion.

13. The computer program product of claim 12 , wherein the obstruction criterion includes an object displacement threshold based on an origin position and a subsequent position, and an object size threshold based on a first dimension, a second dimension, and a third dimension.

Assignees

• IBM

Inventors

• Stevens Mark B
• Wilson John D

Classifications

• G09B29/004

  Map manufacture or repair; Tear or ink or water resistant maps; Long-life maps (printing processes for maps B41M3/02; by permanently attaching map sections to sheets B42B7/00) · CPC title

• G09B21/008

  using visual presentation of the information for the partially sighted · CPC title

• G09B21/00

  Teaching, or communicating with, the blind, deaf or mute (audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B) · CPC title

• A61H2201/5097

  wireless · CPC title

• A61H2201/5092

  Optical sensor · CPC title