Room information inferring apparatus including a person detector and a presence map generator, room information inferring method including person detection and presence map generation, and air conditioning apparatus

Patent metadata

Field	Value
Publication number	US-9760796-B2
Application number	US-201514751732-A
Country	US
Kind code	B2
Filing date	Jun 26, 2015
Priority date	Jul 11, 2014
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

A room information inferring apparatus that infers information regarding a room has an imaging unit that captures an image of a room that is to be subjected to inferring, a person detector that detects a person in an image captured by the imaging unit, and acquires a position of the person in the room, a presence map generator that generates a presence map indicating a distribution of detection points corresponding to persons detected in a plurality of images captured at different times, and an inferring unit that infers information regarding the room based on the presence map.

First claim

The invention claimed is:

1. A room information inferring apparatus that infers information regarding a room, comprising:
an imaging unit that captures an image of a room that is to be subjected to inferring;
a person detector that detects a person in an image captured by the imaging unit, and acquires a position of the person in the room;
a presence map generator that generates a presence map indicating a distribution of detection points corresponding to persons detected in a plurality of images captured at different times; and
an inferring unit that infers information regarding the room based on the presence map,
wherein, in a case where the presence map includes a blank region that includes no detection points and is surrounded by detection points, the inferring unit infers that the blank region is a region in which a furniture item is placed.

2. The room information inferring apparatus according to claim 1 , wherein the person detector detects a face, a head, or an upper body of the person in the image, and acquires the position of the person in the room based on a position and a size of the face, the head, or the upper body in the image.

3. The room information inferring apparatus according to claim 1 , wherein the inferring unit infers a shape of the room based on the presence map.

4. The room information inferring apparatus according to claim 3 , wherein the inferring unit infers that a polygon circumscribed around the distribution of detection points in the presence map is the shape of the room.

5. The room information inferring apparatus according to claim 4 , wherein the inferring unit infers the shape of the room based on an assumption that the room is defined by straight lines that are parallel in two mutually orthogonal directions.

6. The room information inferring apparatus according to claim 5 , wherein the two directions are respectively an imaging direction of the imaging unit and a direction orthogonal to the imaging direction.

7. The room information inferring apparatus according to claim 4 , wherein, when inferring the shape of the room, the inferring unit deems that a wall surface is outward by a predetermined distance from a shape obtained as a polygon circumscribed around the distribution of detection points in the presence map.

8. The room information inferring apparatus according to claim 7 ,
wherein the person detector also detects whether a person at a detected position is moving or stationary, and
wherein, in a case of a detection point at which the person is stationary, the inferring unit sets the predetermined distance lower than in a case of a detection point at which the person is moving.

9. The room information inferring apparatus according to claim 1 ,
wherein the person detector also detects whether a person at a detected position is moving or stationary, and
wherein, in a case where a group of stationary points exists in a periphery of the blank region, the inferring unit infers that a table is placed in the blank region.

10. The room information inferring apparatus according to claim 1 , wherein in a case where the presence map includes a blank region that includes no detection points and is not surrounded by detection points, the inferring unit infers that the blank region is a wall region or a region in which a furniture item is placed next to a wall.

11. The room information inferring apparatus according to claim 1 , wherein the inferring unit infers a people containing region based on the presence map.

12. The room information inferring apparatus according to claim 11 ,
wherein the person detector also detects whether a person at a detected position is moving or stationary, and
wherein the inferring unit infers that, in the people containing region, a region including more than a predetermined percentage of stationary detection points is a stationary region.

13. The room information inferring apparatus according to claim 11 ,
wherein the person detector unit also detects whether a person at a detected position is moving or stationary, and
wherein the inferring unit infers that, in the people containing region, a region including more than a predetermined percentage of moving detection points is a movement region.

14. The room information inferring apparatus according to claim 1 ,
wherein the person detector also performs processing for tracking a detected person, and
wherein, in a case of a location at which the number of intersections between person movement paths and a boundary of the inferred room shape is greater than or equal to a predetermined number, the inferring unit infers that the location is a doorway of the room or a storage space.

15. The room information inferring apparatus according to claim 14 , wherein, in a case of a location at which the number of intersections between person movement paths and the boundary of the inferred room shape is greater than or equal to a predetermined number, and at which person tracking can no longer be performed, or a person is newly detected, the inferring unit infers that the location is a doorway of the room.

16. The room information inferring apparatus according to claim 14 , wherein, in a case of a location at which the number of intersections between person movement paths and a boundary of the inferred room shape is greater than or equal to a predetermined number, and at which person tracking can be continued, the inferring unit infers that the location is a storage space.

17. The room information inferring apparatus according to claim 1 ,
wherein the person detector also acquires time information indicating when the person was detected,
wherein the room information inferring apparatus further comprises a storage unit that stores a life scene definition that includes a time period and a behavior pattern, and
wherein the inferring unit infers a life scene that appears in the room based on a behavior pattern of a person obtained based on a detection result from the person detector, time information indicating when the person was detected, and the life scene definition stored in the storage unit.

18. A room information inferring method carried out by a room information inferring apparatus, comprising:
an imaging step of capturing an image of a room that is to be subjected to inferring;
a person detection step of detecting a person in an image captured in the imaging step, and acquiring a position of the person in the room;
a presence map generation step of generating a presence map indicating a distribution of detection points corresponding to persons detected in a plurality of images captured at different times; and
an inferring step of inferring information regarding the room based on the presence map,
wherein, in a case where the presence map includes a blank region that includes no detection points and is surrounded by detection points, the inferring apparatus infers that the blank region is a region in which a furniture item is placed.

19. A program stored on a non-transitory computer readable medium that causes a computer to execute a room information inferring method comprising:
an imaging step of capturing an image of a room that is to be subjected to inferring;
a person detection step of detecting a person in an image captured in the imaging step, and acquiring a position of the person in the room;
a presence map generation step of generating a presence map indicating a distribution of detection points corresponding to persons detected in a plurality of images captured at different times; and
an inferring s

Assignees

• Omron Tateisi Electronics Co

Inventors

• Manabe Seiichi
• Nakaichi Jun

Classifications

• F24F11/30 Primary

  for purposes related to the operation of the system, e.g. for safety or monitoring · CPC title

• F24F11/79

  for controlling the direction of the supplied air · CPC title

• F24F11/63

  Electronic processing · CPC title

• F24F11/74

  for controlling air flow rate or air velocity · CPC title

• F24F11/46

  Improving electric energy efficiency or saving · CPC title