Automatic configuration of the logical orientation of multiple monitors based on captured images

Patent metadata

Field	Value
Publication number	US-9516263-B2
Application number	US-201313957826-A
Country	US
Kind code	B2
Filing date	Aug 2, 2013
Priority date	Aug 2, 2013
Publication date	Dec 6, 2016
Grant date	Dec 6, 2016

Abstract

A system and method for configuring the display of a virtual workspace on multiple monitors connected to a single computing device based on images/frames captured by multiple cameras is described. A monitor orientation controller analyzes the frames to detect motion/movement within the captured scene and a corresponding centroid of the detected motion. The monitor orientation controller determines the positions of the monitors relative to each other based on the calculated centroids. Based on the relative determined positions of the monitors, the monitor orientation controller adjusts how the virtual workspace is displayed on the monitors. Other embodiments are also described.

First claim

What is claimed is:

1. A method for configuring the arrangement of a virtual workspace on a plurality of monitors, comprising:
capturing, by a first camera, a first set of frames representing a scene in front of first and second monitors from the perspective of the first monitor;
capturing, by a second camera, a second set of frames representing the scene in front of the first and second monitors from the perspective of the second monitor;
detecting motion in each of the first and second sets of frames;
calculating a first centroid for the detected motion in the first set of frames, wherein the first centroid represents the approximate center point of the detected motion relative to the first set of frames;
calculating a second centroid for the detected motion in the second set of frames, wherein the second centroid represents the approximate center point of the detected motion relative to the second set of frames;
determining the position of the first monitor in relation to the second monitor based on the first and second centroids; and
adjusting the display of the virtual workspace on the first and second monitors based on determined position.

2. The method of claim 1 , wherein when the first monitor is determined to be positioned to the left of the second monitor a left portion of the virtual workspace is displayed on the first monitor and a right portion of the virtual workspace is displayed on the second monitor.

3. The method of claim 1 , wherein when the first monitor is determined to be positioned to the right of the second monitor a right portion of the virtual workspace is displayed on the first monitor and a left portion of the virtual workspace is displayed on the second monitor.

4. The method of claim 1 , wherein the virtual workspace includes an application dock, one or more application windows, and a desktop.

5. The method of claim 1 , wherein the first and second monitors are displays in separate tablet computers and the first and second cameras are integrated in each of the tablet computers, respectively.

6. A monitor orientation controller for configuring the arrangement of a virtual workspace on a first monitor and a second monitor coupled to a computing device, comprising:
a motion detector to receive a first set of frames from a first camera and a second set of frames from a second camera and detect motion in each of the first and second sets of frames, wherein the first set of frames represent a scene in front of the first and second monitors from the perspective of the first monitor and the second set of frames represent the scene in front of the first and second monitors from the perspective of the second monitor;
a centroid calculator to calculate (1) a first centroid for the detected motion in the first set of frames, wherein the first centroid represents the approximate center point of the detected motion relative to the first set of frames and (2) a second centroid for the detected motion in the second set of frames, wherein the second centroid represents the approximate center point of the detected motion relative to the second set of frames;
an orientation calculator to determine the position of the first monitor in relation to the second monitor based on the first and second centroids; and
a virtual workspace configurator to adjust the display of the virtual workspace on the first and second monitors based on the determined position.

7. The monitor orientation controller of claim 6 , wherein when the first monitor is positioned to the left of the second monitor a left portion of the virtual workspace is displayed on the first monitor and a right portion of the virtual workspace is displayed on the second monitor.

8. The monitor orientation controller of claim 6 , wherein when the first monitor is positioned to the right of the second monitor a right portion of the virtual workspace is displayed on the first monitor and a left portion of the virtual workspace is displayed on the second monitor.

9. The monitor orientation controller of claim 6 , wherein the virtual workspace includes an application dock, one or more application windows, and a desktop.

10. An article of manufacture for configuring the arrangement of a virtual workspace on a plurality of monitors, comprising:
a non-transitory machine-readable storage medium that stores instructions which, when executed by a processor in a computing device,
capture, by a first camera, a first set of frames representing a scene in front of first and second monitors from the perspective of the first monitor;
capture, by a second camera, a second set of frames representing the scene in front of the first and second monitors from the perspective of the second monitor;
detect motion in each of the first and second sets of frames;
calculate a first centroid for the detected motion in the first set of frames, wherein the first centroid represents the approximate center point of the detected motion relative to the first set of frames;
calculate a second centroid for the detected motion in the second set of frames, wherein the second centroid represents the approximate center point of the detected motion relative to the second set of frames;
determine the position of the first monitor in relation to the second monitor based on the first and second centroids; and
adjust the display of the virtual workspace on the first and second monitors based on the determined position.

11. The article of manufacture of claim 10 , wherein when the first monitor is determined to be positioned to the left of the second monitor a left portion of the virtual workspace is displayed on the first monitor and a right portion of the virtual workspace is displayed on the second monitor.

12. The article of manufacture of claim 10 , wherein when the first monitor is determined to be positioned to the right of the second monitor a right portion of the virtual workspace is displayed on the first monitor and a left portion of the virtual workspace is displayed on the second monitor.

13. The article of manufacture of claim 10 , wherein the virtual workspace includes an application dock, one or more application windows, and a desktop.

Assignees

• Apple Inc

Inventors

• Mathew Binu K
• Mattisson Nils E

Classifications

• H04N23/6811

  based on the image signal · CPC title

• H04N7/141 Primary

  between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085) · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• H04N5/23254

  Electricity · mapped topic