System and method for virtual displays

Patent metadata

Field	Value
Publication number	US-9250700-B2
Application number	US-201313781335-A
Country	US
Kind code	B2
Filing date	Feb 28, 2013
Priority date	Feb 28, 2013
Publication date	Feb 2, 2016
Grant date	Feb 2, 2016

Abstract

An operating system creates one or more virtual display interfaces for communication of display data and user input events between the application layer and one or more virtual display devices. The one or more virtual display devices are not physically connected to the computing system managed by the operating system. One or more applications are executed in an application layer. At least one of the one or more applications communicates display data to and receives user input events from at least one of the one or more display devices using at least one of the display interfaces. At least one other of the one or more applications communicates display data to and receives user input events from at least one of the one or more virtual display devices using at least one of the one or more virtual display interfaces.

First claim

What is claimed is:

1. A method, the method comprising:
using one or more processors to perform
creating, by an operating system, one or more display interfaces, wherein
the one or more display interfaces are interfaces for communication of display data and user input events between an application layer and one or more display devices,
each of the one or more display devices is physically connected to a computing system managed by the operating system;

creating, by the operating system, one or more virtual display interfaces for communication of display data and user input events between the application layer and one or more virtual display devices, wherein
the one or more virtual display devices are not physically connected to the computing system managed by the operating system; and

executing one or more applications in the application layer, wherein
at least one of the one or more applications communicates display data to and receives user input events from at least one of the one or more display devices using at least one of the display interfaces, and
at least one other of the one or more applications communicates display data to and receives user input events from at least one of the one or more virtual display devices using at least one of the one or more virtual display interfaces.

2. The method of claim 1 , wherein executing the one or more applications in the application layer further comprises:
generating, using the one or more processors, output of at least one other application for communication to the at least one of the one or more virtual display devices, and
rendering from the output of the at least one other application, using hardware acceleration provided by a graphics processing unit, display data for display on the virtual display device.

3. The method of claim 1 , further comprising:
transmitting the display data from the virtual display device to a target display device over a radio frequency connection.

4. The method of claim 1 , further comprising:
transmitting over a network connection the display data from the virtual display device to a remote computing system connected to a target display device.

5. The method of claim 1 , further comprising:
generating, using the one or more processors, output representing attributes of a window, wherein the window displays the interactive elements of a graphical user interface on at least one of the one or more virtual display devices using at least one of the virtual display interfaces in a simulation of a virtual display; and
rendering, using hardware acceleration provided by a graphics processing unit, the output for display on the one or more virtual display devices; and
displaying, on the at least one of the plurality of display devices using at least one of the display interfaces, the output for display on the one or more virtual display devices.

6. The method of claim 1 , further comprising:
generating, using the one or more processors, output representing attributes of a window, wherein the window displays the interactive elements of a graphical user interface on at least one of the one or more virtual display devices using at least one of the virtual display interfaces in a simulation of a virtual display; and
rendering, using hardware acceleration provided by a graphics processing unit, the output for display on the one or more virtual display devices; and
comparing to expected values the output for display on the one or more virtual display devices to appraise display performance.

7. The method of claim 1 , further comprising:
verifying a permission of a remote computing system housing a target display device to display the display data; and
transmitting the display data over a network connection to the remote computing system connected to the target display device.

8. A system, comprising:
at least one processor; and
a memory comprising program instructions, wherein the program instructions are executable by the at least one processor to:
create, by an operating system, one or more display interfaces, wherein
the one or more display interfaces are interfaces for communication of display data and user input events between an application layer and one or more display devices,
each of the one or more display devices is physically connected to a computing system managed by the operating system;

create, by the operating system, one or more virtual display interfaces for communication of display data and user input events between the application layer and one or more virtual display devices, wherein
the one or more virtual display devices are not physically connected to the computing system managed by the operating system; and

execute one or more applications in the application layer, wherein
at least one of the one or more applications communicates display data to and receives user input events from at least one of the one or more display devices using at least one of the display interfaces, and
at least one other of the one or more applications communicates display data to and receives user input events from at least one of the one or more virtual display devices using at least one of the one or more virtual display interfaces.

9. The system of claim 8 , wherein the program instructions executable by the at least one processor to execute the one or more applications in the application layer further comprise:
program instructions executable by the at least one processor to generate, using the at least one processor, output of at least one other application for communication to the at least one of the one or more virtual display devices, and
program instructions executable by the at least one processor to render from the output of the at least one other application, using hardware acceleration provided by a graphics processing unit, display data for display on the virtual display device.

10. The system of claim 8 , further comprising:
program instructions executable by the at least one processor to transmit the display data from the at least one other of the one or more applications to a target display device over a radio frequency connection.

11. The system of claim 8 , further comprising:
program instructions executable by the at least one processor to transmit over a network connection the display data from the at least one other of the one or more applications to a remote computing system connected to a target display device.

12. The system of claim 8 , further comprising:
program instructions executable by the at least one processor to generate, using the at least one processor, output representing attributes of a window, wherein the window displays the interactive elements of a graphical user interface on at least one of the one or more virtual display devices using at least one of the virtual display interfaces in a simulation of a virtual display; and
program instructions executable by the at least one processor to render, using hardware acceleration provided by a graphics processing unit, the output for display on the one or more virtual display devices; and
program instructions executable by the at least one processor to display, on the at least one of the plurality of display devices using at least one of the display interfaces, the output for display on the one or more virtual display devices.

13. The system of claim 8 , further comprising:
program instructions executable by the at least one processor to generate, using the at least one processor, output representing attributes of a window, wherein the window displays the interactive elements of a graphical user interface on at least one of the one or more vir

Assignees

• Apple Inc

Inventors

• Wright Christopher P
• Dyke Kenneth C
• Fard Assana M
• Costa Thomas W

Classifications

• G06F3/01 Primary

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G06F9/4445

  Physics · mapped topic

• G06F9/452 Primary

  Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131) · CPC title

• G06F3/1423 Primary

  controlling a plurality of local displays, e.g. CRT and flat panel display · CPC title

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title