Transformation of data object based on context

Patent metadata

Field	Value
Publication number	US-10901604-B2
Application number	US-201715824325-A
Country	US
Kind code	B2
Filing date	Nov 28, 2017
Priority date	Nov 28, 2017
Publication date	Jan 26, 2021
Grant date	Jan 26, 2021

Abstract

Non-limiting examples described herein relate to dynamic and intelligent transformation of a data object to a form that fits a context of a content portion in a receiving application/service. As an example, action(s), such as a drag and drop, is received through a user interface of a productivity service. The drag and drop drags a data object onto a content portion of a digital document. A context for the drag and drop is determined based on semantic analysis of the drag and drop. A composite data object is generated based on the determined context of the drag and drop. The composite data object comprises the content portion and a representation of the data object that alters presentation of the data object to fit a context of the content portion. The composite data object may be surfaced through the user interface.

First claim

What is claimed is:

1. A method comprising:
receiving, through a user interface of a productivity service, a drag and drop that drags a complex data object onto a content portion of a digital document, wherein the complex data object is an interactive data object that comprises two or more hyperlink data fields;
determining a context for the drag and drop based on an application of a trained model that is configured to execute semantic analysis on the drag and drop, wherein the semantic analysis comprises:
a correlation evaluation of an entity data type of the content portion with the two or more hyperlink data fields of the complex data object and
a selection of a modification of a visual state of the complex data object based on a result of the correlation evaluation identifying a contextual relationship between the entity data type of the content portion and at least one hyperlink data field of the complex data object, wherein the modification of the visual state of the complex data object changes a visual presentation of the at least one hyperlink data field;

generating the composite data object that combines the content portion and the modification of the visual state of the complex data object in an aggregate representation based on a result of the semantic analysis executed by the trained model; and
surfacing, through the user interface of the productivity service, the composite data object.

2. The method of claim 1 , further comprising: receiving, through the user interface, a user interaction with the aggregate representation that comprises an action selected from a group consisting of: a hover action over the aggregate representation and a drag action of the aggregate representation; and displaying, through the user interface a user interface callout that presents additional content for the aggregate representation.

3. A system comprising:
at least one processor; and
a memory, operatively connected with the at least one processor, storing computer-executable instructions that, when executed by the at least one processor, causes the at least one processor to execute a method that comprises:
receiving, through a user interface of a productivity service, a drag and drop that drags a complex data object onto a content portion of a digital document, wherein the complex data object is an interactive data object that comprises two or more hyperlink data fields;
determining a context for the drag and drop based on an application of a trained model that is configured to execute semantic analysis on the drag and drop, wherein the semantic analysis comprises:
a correlation evaluation of an entity data type of the content portion with the two or more hyperlink data fields of the complex data object and
a selection of a modification of a visual state of the complex data object based on a result of the correlation evaluation identifying a contextual relationship between the entity data type of the content portion and at least one hyperlink data field of the complex data object, wherein the modification of the visual state of the complex data object changes a visual presentation of the at least one hyperlink data field;

generating the composite data object that combines the content portion and the modification of the visual state of the complex data object in an aggregate representation based on a result of the semantic analysis executed by the trained model; and
surfacing, through the user interface of the productivity service, the composite data object.

4. The system of claim 3 , wherein the method, executed by the at least one processor, further comprises: receiving, through the user interface, a user interaction with the aggregate representation that comprises an action selected from a group consisting of: a hover action over the aggregate representation and a drag action of the aggregate representation; and displaying, through the user interface a user interface callout that presents additional content for the aggregate representation.

5. A computer-readable storage medium storing computer-executable instructions that, when executed by at least one processor, causes the at least one processor to execute a method comprising:
receiving, through a user interface of a productivity service, a drag and drop that drags a complex data object onto a content portion of a digital document, wherein the complex data object is an interactive data object that comprises two or more hyperlink data fields;
determining a context for the drag and drop based on an application of a trained model that is configured to execute semantic analysis on the drag and drop, wherein the semantic analysis comprises:
a correlation evaluation of an entity data type of the content portion with the two or more hyperlink data fields of the complex data object and
a selection of a modification of a visual state of the complex data object based on a result of the correlation evaluation identifying a contextual relationship between the entity data type of the content portion and at least one hyperlink data field of the complex data object, wherein the modification of the visual state of the complex data object changes a visual presentation of the at least one hyperlink data field;

generating the composite data object that combines the content portion and the modification of the visual state of the complex data object in an aggregate representation based on a result of the semantic analysis executed by the trained model; and
surfacing, through the user interface of the productivity service, the composite data object.

6. The computer-readable storage medium of claim 5 , wherein the executed method further comprising: receiving, through the user interface, a user interaction with the aggregate representation that comprises an action selected from a group consisting of: a hover action over the aggregate representation and a drag action of the aggregate representation; and displaying, through the user interface a user interface callout that presents additional content for the aggregate representation.

7. The method of claim 1 , further comprising: receiving, through the user interface of the productivity service, a scroll-over action over the composite data object in the aggregate representation; and in response to receipt of the scroll-over action, presenting an original representation of the complex data object that reflects a state of the complex data object prior to inclusion of the complex data object in the aggregate representation.

8. The method of claim 1 , wherein the complex data object is an electronic contact card for a user, wherein the composite data object alters state of the electronic contact card to fit a context of the content portion, wherein the surfacing comprises presenting, through the user interface as part of the composite data object, a selectable user interface feature as the aggregate representation of the complex data object, and wherein the method further comprising: receiving a selection of the selectable user interface feature; and presenting, through the user interface, a full version of the electronic contact card.

9. The system of claim 3 , wherein the method, executed by the at least one processor, further comprises: receiving, through the user interface of the productivity service, a scroll-over action over the composite data object in the aggregate representation; and in response to receipt of the scroll-over action, presenting an original representation of the complex data object that reflects a state of the complex data object prior to inclusion of the complex data object in the aggregate representation.

10. The system of claim 3 , wherein the complex data object is an electronic contact card for a user, where

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Zhu Yibing
• Fox Seth

Classifications

• G06F40/166 Primary

  Editing, e.g. inserting or deleting · CPC title

• G06F3/0486 Primary

  Drag-and-drop · CPC title

• G06F40/106

  Display of layout of documents; Previewing · CPC title

• G06F40/30

  Semantic analysis · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title