Intelligent management of content related to objects displayed within communication sessions

Patent metadata

Field	Value
Publication number	US-11080941-B2
Application number	US-201816228638-A
Country	US
Kind code	B2
Filing date	Dec 20, 2018
Priority date	Dec 20, 2018
Publication date	Aug 3, 2021
Grant date	Aug 3, 2021

Abstract

The techniques disclosed herein improve the efficiency of a system by providing intelligent management of content that is associated with objects displayed within communication sessions. The participants can generate a content object associated with a 3D object. The content object may be in the form of 3D virtual object such as an arrow pointing to the table, a text box of an annotation, etc. The content object may also include functional features that collect and display information voting agent. The system can generate a data structure that associates the object with the content object. The data structure enables a system to maintain an association between the object and the content object when various operations are applied to either object. Thus, if a remote computer sends a request for the content object, the associated object is delivered with the content object.

First claim

The invention claimed is:

1. A system for creating and tracking associations between a content object and an object comprising:
one or more data processing units; and
a computer-readable medium having encoded thereon computer-executable instructions to cause the one or more data processing units to
receive input data indicating a position for the content object to be displayed in association with the object rendered on one or more computing devices of a communication session;
generate a data structure defining the association between the content object and the object, the position of the content object and a position of the object, characteristics of the object content and characteristics of the object, and one or more permissions for applying an operation to the content object or the object;
detect an input indicating the operation to graphically move the content object or the object;
in response to detecting that the operation is to be applied to the content object, apply the operation to the content object and replicate the operation to the object based on the one or more permissions defined in the data structure allowing the object to be graphically moved with the content object, wherein the operation applied to the content object is further applied to at least one associated object based on the one or more permissions defined in the data structure allowing the object to be graphically moved with the content object; and
in response to detecting that the operation is to be applied to the object, apply the operation to the object and replicate the operation to the content object based on the one or more permissions defined in the data structure allowing the content object to be graphically moved with the object, wherein the operation applied to the object is further applied to at least one associated content object based on the one or more permissions defined in the data structure allowing the content object to be graphically moved with the object.

2. The system of claim 1 , wherein the operation further comprises instructions for sending the object to a remote computing device of a second communication session, wherein applying the operation to the object and replicating the operation to the content object comprises:
communicate model data defining the object to the remote computing device; and
communicate model data defining the content object to the remote computing device in response to verifying the association defined in the data structure, wherein the data structure provides computing devices of the second communication session access to the object and the content object.

3. The system of claim 2 , wherein the data structure defines a plurality of content objects and permissions for individual content objects of the plurality of objects, wherein the communication of the model data defining the content object is based on the permissions associated with content object.

4. The system of claim 1 , wherein the operation further comprises instructions for sending the content object to a remote computing device of a second communication session, wherein applying the operation to the content object and replicating the operation to the object comprises:
communicate model data defining the content object to the remote computing device; and
communicate model data defining the object to the remote computing device in response to verifying the association defined in the data structure, wherein the data structure provides computing devices of the second communication session access to the object and the content object.

5. The system of claim 1 , wherein detecting the input indicating the operation comprises:
analyzing streams between a plurality of computers of a second communication session;
determining that at least one stream comprises at least one reference to the object or the content object, wherein the operation comprises instructions for sending the content object and the object to the remote computing device in response to determining that the at least one stream comprises the at least one reference to the object or the content object.

6. The system of claim 1 , wherein the data structure further comprises historical data defining one or more operations previously applied to the content object or the object.

7. The system of claim 1 , wherein the one or more permissions are configured to allow or deny individual users from moving the object, wherein repositioning the rendering of the object is denied or allowed based on the permissions.

8. A method for execution on a computing device, comprising:
receiving input data indicating a position for a content object to be displayed in association with an object rendered on one or more computing devices of a communication session;
generating a data structure defining an association between the content object and the object, the position of the content object and a position of the object, characteristics of the object content and characteristics of the object, one or more permissions for applying an operation to the content object or the object;
receiving an input invoking the operation causing the content object or the object to be communicated to a remote computing device participating in a second communication session;
in response to detecting that the operation is to be applied to the content object, applying the operation to the content object and replicating the operation to the object based on the one or more permissions defined in the data structure for applying an operation to the content object or the object and allowing the object to be communicated to the remote computing device participating in the second communication session, wherein the operation applied to the content object is further applied to at least one associated object based on the one or more permissions defined in the data structure allowing the object to be graphically moved with the content object; and
in response to detecting that the operation is to be applied to the object, applying the operation to the object and replicating the operation to the content object based on the one or more permissions defined in the data structure for applying an operation to the content object or the object and allowing the content object to be communicated to the remote computing device participating in the second communication session, wherein the operation applied to the object is further applied to at least one associated content object based on the one or more permissions defined in the data structure allowing the content object to be graphically moved with the object.

9. The method of claim 8 , wherein the input indicates that the operation further comprises a movement of the object to a new position within a three-dimensional environment, and wherein applying the operation to the object and replicating the operation to the content object comprises:
moving a rendering of the object to the new position in response to the input; and
repositioning a rendering of the content object to track the movement of the object, wherein repositioning of the content object maintains a graphical association between the content object and the object defined in the data structure.

10. The method of claim 8 , wherein the one or more permissions are configured to allow or deny individual users from moving the content object, wherein repositioning the rendering of the content object is denied or allowed based on the permissions.

11. The method of claim 8 , wherein the input indicates that the operation further comprises a movement of the content object to a new position within a three-dimensional environment, wherein applying the operation to the content object and replicating the operation to

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Faulkner Jason Thomas
• Rao Sandhya

Classifications

• G06F21/604

  Tools and structures for managing or administering access control systems · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• H04L65/1066

  Session management · CPC title

• H04L12/1813

  for computer conferences, e.g. chat rooms (instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title