Physical knowledge action triggers

Patent metadata

Field	Value
Publication number	US-10600296-B2
Application number	US-201514830080-A
Country	US
Kind code	B2
Filing date	Aug 19, 2015
Priority date	Aug 19, 2015
Publication date	Mar 24, 2020
Grant date	Mar 24, 2020

Abstract

Methods, systems, and apparatus, for defining and monitoring an event for a physical entity and the performance of an action in response to the occurrence of the event. A method includes receiving data indicating an event for a physical entity, the event specified in part by a physical environment feature for which the occurrence of the event is to be monitored by the data processing apparatus; receiving data indicating an action associated with the event and to be taken in response to the occurrence of the event; monitoring for the occurrence of the event for the physical entity; and in response to the occurrence of the event, causing the action associated with the event to be performed.

First claim

What is claimed is:

1. A method, comprising:
receiving, by a data processing apparatus, data specifying a physical environment feature for a physical entity;
providing to a user device data that causes the user device to display an action trigger menu that displays a respective event selection input for each of a plurality of events associated with the physical environment feature, and displays only a first set of actions that can be associated with the events;
receiving, by the data processing apparatus, data specifying a selection at the user device of an event from the plurality of events associated with the physical environment feature;
receiving, by the data processing apparatus, data indicating an action associated with the event and to be taken in response to the occurrence of the event, wherein the action is defined by the user, and is independent of the event for the physical environmental feature and independent of the physical entity, and is not an action included in the first set of actions, the receiving data comprising:
receiving, by the data processing apparatus, data indicating an action input by the user by use of an assistant operating on the user device, wherein the action input by the user is not an action included in the first set of actions and is defined by the user independent of the event and the physical entity, and the action is semantically defined by the user by a voice command that is parsed by the assistant to determine the action;
receiving, by the data processing apparatus, data indicating the action input by the user is associated, by the user, with the event so that the action will be taken in response to the occurrence of the event;

monitoring for the occurrence of the event for the physical environment feature; and
in response to the occurrence of the event, causing the action associated with the event to be performed.

2. The method of claim 1 , further comprising:
storing the data specifying the event and the action to be taken in response to the occurrence of the event in an action trigger data store; and
wherein monitoring for the occurrence of the event for the physical entity comprises monitoring for the occurrence of the event for the physical entity based on the data stored in the action trigger data store.

3. The method of claim 2 , further comprising inferring, by the data processing apparatus and based on the event, the action to be performed.

4. The method of claim 1 , wherein the action is a notification presentation to the user; and
causing the action associated with the event to be performed comprises:
determining, based on one or more notification conditions, whether to delay presentation of the notification to the user.

5. The method of claim 1 , wherein the physical environment feature is described by an image of the physical environment feature.

6. The method of claim 5 , wherein the image of the physical environment feature is an image of a location without the physical entity, and the event is the presence of the physical entity at the location.

7. The method of claim 5 , wherein monitoring for the occurrence of the event for the physical entity comprises:
iteratively receiving images of the physical environment feature;
for each iteration, determining by image processing whether the physical entity is depicted within the image; and
determining the event has occurred when the physical entity is determined to be depicted within the image.

8. The method of claim 1 , wherein monitoring for the occurrence of the event for the physical entity comprises:
receiving location data specifying a current location of the physical entity;
determining a proximity of the current location of the physical entity to the location of the of the physical environment feature; and
determining the event has occurred when the proximity is less than a threshold proximity.

9. The method of claim 1 , wherein the physical environment feature is described by a data signal generated by the physical entity.

10. The method of claim 9 , wherein the data signal identifies the physical entity, and further comprising:
receiving location data specifying a current location of the physical entity;
determining a proximity of the current location of the physical entity to the location of the of the physical environment feature; and
determining that the event has occurred when the proximity is less than a threshold proximity.

11. The method of claim 9 , wherein:
the data signal identifies the physical entity and includes data indicating a condition of the physical entity that is independent of the physical entity's location;
and further comprising:
receiving physical entity data specifying a current condition of the physical entity;
determining whether the current condition of the physical entity satisfies the condition of the physical entity specified by the event; and
determining the event has occurred when the current condition of the physical entity satisfies the condition of the physical entity specified by the event.

12. The method of claim 1 , wherein:
the physical environment feature detected by the user device is a location of a physical entity; and
monitoring for the occurrence of the event for the physical entity comprises:
receiving location data specifying a current location of a user device;
determining a proximity of the current location of the user device to the location of the physical entity; and
determining the event has occurred when the proximity is less than a threshold proximity.

13. A system, comprising:
a processor; and
a computer-readable medium coupled to the processor and having instructions stored thereon, which, when executed by the processor, cause the processor to perform operations comprising:
data specifying a physical environment feature for a physical entity;
providing to a user device data that causes the user device to display an action trigger menu that displays a respective event selection input for each of a plurality of events associated with the physical environment feature, and displays only a first set of actions that can be associated with the events;
receiving, by the data processing apparatus, data specifying a selection at the user device of an event from the plurality of events associated with the physical environment feature;
receiving, by the data processing apparatus, data indicating an action associated with the event and to be taken in response to the occurrence of the event, wherein the action is defined by the user, and is independent of the event for the physical environmental feature and independent of the physical entity, and is not an action included in the first set of actions, the receiving data comprising:
receiving, by the data processing apparatus, data indicating an action input by the user by use of an assistant operating on the user device, wherein the action input by the user is not an action included in the first set of actions and is defined by the user independent of the event and the physical entity, and the action is semantically defined by the user by a voice command that is parsed by the assistant to determine the action;
receiving, by the data processing apparatus, data indicating the action input by the user is associated, by the user, with the event so that the action will be taken in response to the occurrence of the event;

monitoring for the occurrence of the event for the physical entity; and
in response to the occurrence of the event, causing the action associated with the event to be performed.

14. The system of claim 13 , the operations further comprising:
determining, based o

Assignees

• Google Llc

Inventors

• Hurley Fergus Gerard
• Dua Robin

Classifications

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F16/9537

  Spatial or temporal dependent retrieval, e.g. spatiotemporal queries · CPC title

• G06Q30/0261

  based on user location · CPC title

• G06Q30/0267

  Wireless devices · CPC title

• G06Q30/0259

  based on store location · CPC title