Automated control-schedule acquisition within an intelligent controller

Patent metadata

Field	Value
Publication number	US-9020646-B2
Application number	US-201314099853-A
Country	US
Kind code	B2
Filing date	Dec 6, 2013
Priority date	Oct 21, 2011
Publication date	Apr 28, 2015
Grant date	Apr 28, 2015

Abstract

The current application is directed to intelligent controllers that initially aggressively learn, and then continue, in a steady-state mode, to monitor, learn, and modify one or more control schedules that specify a desired operational behavior of a device, machine, system, or organization controlled by the intelligent controller. An intelligent controller generally acquires one or more initial control schedules through schedule-creation and schedule-modification interfaces or by accessing a default control schedule stored locally or remotely in a memory or mass-storage device. The intelligent controller then proceeds to learn, over time, a desired operational behavior for the device, machine, system, or organization controlled by the intelligent controller based on immediate-control inputs, schedule-modification inputs, and previous and current control schedules, encoding the desired operational behavior in one or more control schedules and/or sub-schedules.

First claim

The invention claimed is:

1. An intelligent controller comprising:
a processor;
a memory;
a control schedule stored in the memory;
a schedule interface;
a control interface; and
instructions stored within the memory that, when executed by the processor, cause the intelligent controller to:
control, during a monitoring period, an environmental system according to the control schedule, wherein the length of the monitoring period is at least one day in length;
receive immediate-control inputs through the control interface during the monitoring period and record the received immediate-control inputs in the memory;
receive schedule changes through the schedule interface during the monitoring period and record the received schedule changes in the memory;
generate, after the monitoring period, an updated monitoring-period schedule based on the recorded immediate-control inputs and the recorded schedule changes recorded in the memory during the monitoring period, and the control schedule;
substitute, after the monitoring period, the updated monitoring-period schedule for a portion of the control schedule corresponding to the monitoring period; and
propagate, after the monitoring period, the updated monitoring-period schedule to additional time periods within the control schedule.

2. The intelligent controller of claim 1
wherein the processor includes one or more of
one or more local processors, and
one or more remote processors; and

wherein the memory includes one or more of
one or more local electronic memories,
one or more local mass-storage devices,
one or more remote electronic memories, and
one or more remote mass-storage devices.

3. The intelligent controller of claim 1 wherein control schedule stored in the memory includes one or more setpoints, each setpoint associated with a time and one or more parameter values.

4. The intelligent controller of claim 1 wherein an immediate-control input is made through the control interface to specify one or more parameter values to be implemented by one or more intelligent-controller outputs.

5. The intelligent controller of claim 1 wherein a control-schedule change is input through the schedule interface to specify a control-schedule setpoint to be implemented by one or more intelligent-controller outputs when a current time is equal to the time associated with the schedule setpoint.

6. The intelligent controller of claim 1 wherein the instructions generate an updated monitoring-period schedule, after the monitoring period, based on the recorded immediate-control inputs, recorded schedule changes, and the control schedule by:
combining the recorded immediate-control inputs, recorded schedule changes, and setpoints of the control schedule to produce a provisional schedule;
clustering the immediate-control inputs, schedule changes, and setpoints of the provisional schedule into one or more clusters;
resolving the one or more clusters within the provisional schedule; and
generating the updated monitoring-period schedule from the resolved clusters of the provisional schedule.

7. The intelligent controller of claim 6 wherein combining the recorded immediate-control inputs, recorded schedule changes, and setpoints of the control schedule to produce the provisional schedule further comprises:
representing immediate-control inputs as time-associated values of one or more parameters within a portion of the control schedule corresponding to the monitoring period;
representing recorded control-schedule changes as time-associated values of one or more parameters, additionally associated with input times, within the portion of the control schedule corresponding to the monitoring period; and
considering the represented immediate-control inputs, retrospective control-schedule changes, and setpoints of the provisional schedule to be events.

8. The intelligent controller of claim 7 wherein clustering the immediate-control inputs, schedule changes, and setpoints within the provisional schedule into one or more clusters further comprises:
collecting together, as a separate cluster, each group of events that are each within a first threshold time interval of another event of the separate cluster; and
collecting, as a separate cluster, each event that is not within the first threshold time interval of another event.

9. The intelligent controller of claim 8 wherein resolving the one or more clusters within the provisional schedule further includes replacing each cluster of events with one of:
no event, when no control-change trend is discerned in the cluster;
one event, when a single-event control-change trend is discerned in the cluster; and
two events, when a two-event control-change trend is discerned in the cluster.

10. The intelligent controller of claim 1 wherein the instructions propagate the updated monitoring-period schedule to additional time periods within the control schedule by:
selecting, according to one or more rules, one or more additional time periods within the control schedule related to the time period of the updated monitoring-period schedule; and
to each of the selected time periods,
copying setpoints corresponding to immediate-control inputs of the provisional monitoring-period schedule onto a portion of the control schedule corresponding to the selected time period, and
resolving the portion of the control schedule corresponding to the selected time period.

11. The intelligent controller of claim 10 wherein resolving the portion of the control schedule corresponding to the selected time period further comprises:
applying, to each copied setpoint, one or more rules that result in one of
deleting the copied setpoint,
deleting an existing setpoint,
moving either the copied setpoint or another setpoint in time, and
no change to the copied setpoint.

12. The intelligent controller of claim 1 further comprising:
at least three phases of control-schedule learning implemented by instructions stored in the memory, including
an initial phase,
at least one aggressive-learning phase, and
one or more steady-state learning phases.

13. The intelligent controller of claim 12
wherein, during the aggressive-learning phase, learning parameters are provided values to encourage frequent, additional immediate-control inputs; and
wherein, during the steady-state learning phase, learning parameters are provided values to discourage frequent, additional immediate-control inputs.

14. The intelligent controller of claim 1 wherein the intelligent controller controls one or more of:
an HVAC unit;
a furnace;
an air conditioner;
a heat pump;
an irrigation system;
a pump;
a fan;
one or more light sources;
a machine;
a device;
an organization; and
a system.

15. The intelligent controller of claim 1 wherein the setpoints of the control schedule specify one or more of:
temperature;
flow rate of a liquid or gas;
rate of energy dissipation;
pressure;
current density;
voltage;
a machine setting;
a position of a machine component;
a computational state;
a mechanical state; and
process throughput.

16. An intelligent controller comprising:
a processor;
a memory;
a schedule interface;
a control interface; and
instructions stored within the memory that, when executed by the processor,
acquire an initial control schedule and store the initial control schedule in memory as a current control schedule,
during an aggressive-learning phase, modify the current control schedule based on immediate-control inputs received through the control interface and sch

Assignees

• Google Inc

Inventors

• Matsuoka Yoky
• Lee Eric A
• Hales Steven A
• Stefanski Mark D
• Sharan Rangoli

Classifications

• F24F11/64 Primary

  using pre-stored data · CPC title

• F24F11/523

  for displaying temperature data · CPC title

• F24F11/58

  using Internet communication · CPC title

• G05B19/0423

  Input/output · CPC title

• F24F11/62 Primary

  characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values · CPC title