View augmentation in multiscreen environment

Patent metadata

Field	Value
Publication number	US-10901760-B2
Application number	US-201815912369-A
Country	US
Kind code	B2
Filing date	Mar 5, 2018
Priority date	Mar 5, 2018
Publication date	Jan 26, 2021
Grant date	Jan 26, 2021

Abstract

The disclosed technology is generally directed to multiscreen environments. In one example of the technology, a registry is maintained. The registry includes a plurality of context schemas. Each context schema in the plurality of context schemas includes a context schema input and a context schema output. Context data is received from a first application. The context data includes at least one of a context schema input that is associated with view augmentation in a multiscreen environment or a context schema output that is associated with view augmentation in a multiscreen environment. It is determined whether the context data is valid based, at least in part, on the registry. In response to determining that the context data is valid, the context data is forwarded to at least a second application. The second application is separate from the first application.

First claim

We claim:

1. An apparatus, comprising:
a device, including:
a first screen;
a second screen that is separate from the first screen; and
a controller that is configured to perform actions, including:
executing a first application;
executing a second application;
registering a first context schema, wherein the first context schema includes at least one of: a physical location, a search term, a place, price information, or a person;
generating, via the first application, a first set of information that is associated with the first context schema;
receiving, via the first application, at least a first context schema input of the first context schema that originates from the second application;
causing the first screen to display information that is associated with the first set of information; and
while causing the first screen to display the information that is associated with the first set of information, automatically causing a view on the second screen to change to display information that is associated with the first context schema input responsive to receiving the first context schema input.

2. The apparatus of claim 1 , wherein causing the first screen to display information that is associated with the first set of information includes displaying a map display, and wherein causing the second screen to display information that is associated with the first context schema input includes displaying information associated with at least one location on the map display.

3. The apparatus of claim 1 , wherein a search is made with a search term on the first screen, and wherein causing the second screen to display information that is associated with the first context schema input includes displaying information associated with the search term.

4. The apparatus of claim 1 , wherein the second screen is physically coupled to the first screen in such a way that the first and second screen are foldable into a plurality of different physical configurations, including a physical configuration in which the first screen and the second screen are side-by-side.

5. The apparatus of claim 1 , wherein causing the first screen to display information that is associated with the first set of information includes using the first application to provide a display based on the first application on the first screen, and wherein causing the second screen to display information that is associated with the first context schema input includes augmenting the view provided on the first screen with an additional view from the second application on the second screen.

6. The apparatus of claim 1 , wherein causing the first screen to display information that is associated with the first set of information includes using the first application to provide a display based on the first application on the first screen, and wherein causing the second screen to display information that is associated with the first context schema input includes augmenting the view provided on the first screen with information provided on the second screen by the first application that includes information from the second application.

7. The apparatus of claim 1 , the actions further including:
sending a first registration request to register the first context schema from the first application to an operating system;
receiving, via the first application, a response to the first registration request from the operating system;
sending a second registration request to register a second context schema from the second application to the operating system;
receiving, via the second application, a response to the second registration request from the operating system.

8. A method, comprising:
executing a first application;
executing a second application;
registering a first context schema;
generating, via the first application, a first set of information that is associated with the first context schema;
receiving, via the first application, at least a first context schema input of the first context schema that originates from the second application, wherein the first context schema includes at least one of: a physical location, a search term, a place, price information, or a person;
causing a first screen to display information that is associated with the first set of information; and
while causing the first screen to display the information that is associated with the first set of information, automatically causing a view on a second screen that is separate from the first screen to display information that is associated with the first context schema input responsive to receiving the first context schema input.

9. The method of claim 8 , further comprising:
sending a first registration request to register the first context schema from the first application to an operating system;
receiving, via the first application, a response to the first registration request from the operating system;
sending a registration request to register a second context schema from the second application to the operating system;
receiving, via the second application, a response to the second registration request from the operating system.

10. A method, comprising:
controlling storage of a ledger that includes a plurality of context schemas, wherein each context schema in the plurality of context schemas includes a context schema input and a context schema output, wherein a first context schema of the plurality of context schemas includes at least one of: a physical location, a search term, a place, price information, or a person;
controlling receiving, from a first application, context data, including at least one of a context schema input of the first context schema that is associated with view augmentation in a multiscreen environment or a context schema output of the first context schema that is associated with view augmentation in a multiscreen environment; and
controlling communicating the context data to at least a second application, wherein the second application is separate from the first application.

11. The method of claim 10 , further comprising:
receiving a request to unregister a requested context schema; and
deleting the requested context schema from the ledger.

12. The method of claim 10 , wherein the context data is received based on a defined application programming interface (API) call from the first application.

13. The method of claim 10 , wherein the ledger includes a global ledger stored in a local database.

14. The method of claim 10 , further comprising:
determining whether the context data is valid based, at least in part, on the ledger, wherein controlling communicating the context data to at least a second application is performed in response to determining that the context data is valid.

15. The method of claim 14 , wherein determining whether the context data is valid is further based on permissioning settings.

16. The method of claim 14 , further comprising, in response to determining that the context data is valid, forwarding the context data to a third application, wherein the second application and the third application are each subscribed to the context schema associated with the context data.

17. The method of claim 10 , further comprising:
receiving a registration request for a requested context schema;
making a determination as to whether to accept the requested context schema; and
in response to determining to accept the requested context schema, adding the requested context schema to the ledger.

18. The method of claim 17 , further comprising, after adding the requ

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Grochocki Jr David
• Otero Diaz Ana Lilia
• Sethi Kshitij
• West Jeff
• Andrew Felix

Classifications

• G06F9/452 Primary

  Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131) · CPC title

• G06F1/1641

  the display being formed by a plurality of foldable display components (G06F1/1647 takes precedence) · CPC title

• G06F3/1423 Primary

  controlling a plurality of local displays, e.g. CRT and flat panel display · CPC title

• G09G2356/00

  Detection of the display position w.r.t. other display screens · CPC title

• G01C21/3679

  Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities (G01C21/3611 takes precedence) · CPC title