Platform for interaction via commands and entities

Patent metadata

Field	Value
Publication number	US-10749986-B2
Application number	US-201715481701-A
Country	US
Kind code	B2
Filing date	Apr 7, 2017
Priority date	Apr 11, 2016
Publication date	Aug 18, 2020
Grant date	Aug 18, 2020

Abstract

Interacting with a computing device can include registering a plurality of commands from a plurality of applications, wherein the plurality of commands specify entity types that are accepted as parameters, determining a first entity having a first entity type, wherein the first entity is independent of the plurality of applications, and determining a selected command from the plurality of commands registered by the plurality of applications that accepts the first entity type as a parameter. The first entity and the selected command can be provided, using a processor, to a first application of the plurality of applications that supports the selected command for execution.

First claim

What is claimed is:

1. A method for interacting with a computing device, comprising:
registering, using program code, a plurality of commands from a plurality of applications, the program code being separate from the plurality of applications, wherein the plurality of commands specify entity types that are accepted as parameters and wherein the program code and the plurality of applications are stored in the computing device;
displaying a notification for a data object of a selected application of the plurality of applications on a screen of the computing device;
in response to detecting a user input requesting a list of entities associated with the notification, determining a first entity having a first entity type, wherein the first entity is independent of the plurality of applications and is determined from an attribute of the notification;
determining a selected command from the plurality of commands registered by the plurality of applications that acts on the first entity;
displaying a graphical user interface including the first entity and the selected command on the screen of the computing device;
in response to a user input selecting the selected command, providing, using a processor, the first entity and the selected command to a first application of the plurality of applications that supports the selected command for execution;
wherein the first entity and the first entity type are determined by performing named entity processing on text displayed on the screen of the computing device to recognize a named entity within the text as the first entity; and
wherein the determining the first entity includes providing the text to a named entity recognition service remote from the computing device, wherein the named entity recognition service performs the named entity processing and provides the named entity recognized from the text to the computing device.

2. The method of claim 1 , further comprising:
storing the first entity within a data storage device for subsequent recall; and
displaying a list of saved entities including the first entity.

3. The method of claim 2 , wherein the first entity is stored in association with at least one of the selected command or the first application.

4. The method of claim 1 , further comprising:
receiving a user input selecting a subset of the text, wherein the named entity processing is performed on the subset of the text.

5. The method of claim 4 , wherein the user input draws a bounding box on the screen of the computing device selecting the subset of the text.

6. The method of claim 1 , wherein the data object is a calendar event and the first entity is a location of the calendar event or an attendee of the calendar event.

7. The method of claim 1 , wherein the data object is a calendar event, the first entity is a location of the calendar event, and a second entity specifying an attendee for the calendar event is determined from a further attribute of the calendar event; and
wherein the graphical user interface further includes the second entity and a command registered by the plurality of applications that acts on the second entity.

8. An apparatus, comprising:
a processor configured to initiate operations for interacting with the apparatus including:
registering, using program code, a plurality of commands from a plurality of applications, the program code being separate from the plurality of applications, wherein the plurality of commands specify entity types that are accepted as parameters and wherein the program code and the plurality of applications are stored in the apparatus;
displaying a notification for a data object of a selected application of the plurality of applications on a screen of the apparatus;
in response to detecting a user input requesting a list of entities associated with the notification, determining a first entity having a first entity type, wherein the first entity is independent of the plurality of applications and is determined from an attribute of the notification;
determining a selected command from the plurality of commands registered by the plurality of applications that acts on the first entity;
displaying a graphical user interface including the first entity and the selected command on the screen of the apparatus;
in response to a user input selecting the selected command, providing the first entity and the selected command to a first application of the plurality of applications that supports the selected command for execution;
wherein the first entity and the first entity type are determined by performing named entity processing on text displayed on the screen of the apparatus to recognize a named entity within the text as the first entity; and
wherein the determining the first entity includes providing the text to a named entity recognition service remote from the apparatus, wherein the named entity recognition service performs the named entity processing and provides the named entity recognized from the text to the apparatus.

9. The apparatus of claim 8 , wherein the processor is configured to initiate operations further including:
storing the first entity within a data storage device for subsequent recall; and
displaying a list of saved entities including the first entity.

10. The apparatus of claim 9 , wherein the first entity is stored in association with at least one of the selected command or the first application.

11. The apparatus of claim 8 , wherein the processor is configured to initiate operations further including:
receiving a user input selecting a subset of the text, wherein the named entity processing is performed on the subset of the text.

12. The apparatus of claim 11 , wherein the user input draws a bounding box on the screen of the apparatus selecting the subset of the text.

13. The apparatus of claim 8 , wherein the data object is a calendar event and the first entity is a location of the calendar event or an attendee of the calendar event.

14. The apparatus of claim 8 , wherein the data object is a calendar event, the first entity is a location of the calendar event, and a second entity specifying an attendee for the calendar event is determined from a further attribute of the calendar event; and
wherein the graphical user interface further includes the second entity and a command registered by the plurality of applications that acts on the second entity.

15. A computer program product comprising a computer readable storage medium having program code stored thereon for interacting with a computing device, the program code executable by a processor to perform operations comprising:
registering, using the program code, a plurality of commands from a plurality of applications, the program code being separate from the plurality of applications, wherein the plurality of commands specify entity types that are accepted as parameters and wherein the program code and the plurality of applications are stored in a computing device;
displaying a notification for a data object of a selected application of the plurality of applications on a screen of the computing device;
in response to detecting a user input requesting a list of entities associated with the notification, determining a first entity having a first entity type, wherein the first entity is independent of the plurality of applications and is determined from an attribute of the notification;
determining a selected command from the plurality of commands registered by the plurality of applications that acts on the first entity;
displaying a graphical user interface including the first entity and the selected command on the screen o

Assignees

• Samsung Electronics Co Ltd

Inventors

• Pierce Jeffrey S
• Digman Mike
• Chung Ranhee

Classifications

• H04L67/125 Primary

  involving control of end-device applications over a network · CPC title

• H04L67/565

  Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561) · CPC title

• G06Q50/00

  Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism (healthcare informatics G16H) · CPC title

• G06F8/36

  Software reuse · CPC title

• G06Q30/00

  Commerce · CPC title