Device, method, and system of providing extended display with head mounted display

Patent metadata

Field	Value
Publication number	US-10310265-B2
Application number	US-201315039405-A
Country	US
Kind code	B2
Filing date	Dec 27, 2013
Priority date	Dec 27, 2013
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

A head mounted display for displaying computer-generated information in conjunction with a physical display of a computer system is provided. The head mounted display includes a generation logic, a see through display, and a presentation unit. The generation logic is used to generate at least one virtual display. The presentation unit is used to present the at least one virtual display on the see-through display. The see-through display is configured to enable a user of the head mounted display to view the at least one virtual display and the physical display in a real-world scene. The at least one virtual display is presented on the see-through display as an additional object in the real-world scene, and the at least one virtual display is used in conjunction with the physical display to present the computer-generated information in an extended desktop from a visual perspective of the user.

First claim

What is claimed is:

1. A head mounted display (HMD), comprising:
a generation logic to generate at least one virtual display;
a see-through display; and
a presentation unit to present the at least one virtual display on the see-through display; and
a memory coupled to the presentation unit,
wherein the see-through display is configured to enable a user to view the at least one virtual display and a physical display in a real-world scene,
wherein the at least one virtual display is presented on the see-through display as an additional object in the real-world scene, and
wherein the at least one virtual display is used in conjunction with the physical display to present a first computer-generated information in a first extended desktop from a visual perspective of the user, the first extended desktop comprising a first portion assigned to the physical display and a second portion assigned to the at least one virtual display, wherein the presentation unit is configured to determine if the physical display is in a field of vision of the HMD; and wherein the presentation unit is configured to present the first computer-generated information that has been previously stored in the memory in a second extended desktop comprising a third portion assigned to the at least one virtual display that represents the first portion, if the physical display is not in the field of vision of the HMD to continue viewing the first computer-generated information after the removal of physical display from the field of vision.

2. The HMD of claim 1 , wherein the first computer-generated information is presented in the first extended desktop while the physical display is in the field of vision of the HMD.

3. The HMD of claim 1 , further comprising:
a calculation logic to
determine a position of the head mounted display;
determine a location of the physical display based on at least the determined position of the head mounted display;
determine a surface position and a screen area of the physical display based on at least the determined location of the physical display; and

provide the determined position of the head mounted display, the determined location of the physical display, the determined surface position of the physical display, and the determined screen area of the physical display to the generation logic.

4. The HMD of claim 3 , further comprising:
the calculation logic to re-determine the position of the head mounted display, the location of the physical display, the surface position of the physical display, and the screen area of the physical display in response to at least one of
a physical movement of the physical display,
a physical movement of the HMD, and
an amount of time elapsed from at least one of a previous determination of the position of the HMD, a previous determination of the location of the physical display, a previous determination of the surface position of the physical display, and a previous determination screen area of the physical display.

5. The HMD of claim 3 , wherein the generation logic generates the at least one virtual display with a screen area that is a multiple of the screen area of the physical display, wherein eye-tracking data is gathered by at least one eye-tracking sensor, and wherein the generation logic generates the at least one virtual display based on at least one of
the gathered eye-tracking data,
the determined position of the head mounted display,
the determined location of the physical display,
the determined surface position of the physical display, and
the determined screen area of the physical display.

6. The HMD of claim 1 , further comprising:
a perspective logic to determine a desired relative display orientation between the first portion and the second portion; and
an association logic to configure the first portion and the second portion of the first extended desktop with the desired relative display orientation, wherein the at least one virtual display is used in conjunction with the physical display to present the configured first portion and the configured second portion of the first extended desktop from a visual perspective of the user.

7. The HMD of claim 1 , wherein the at least one virtual display is presented on the see-through display as an additional object that is adjacently located to the physical display in the real-world scene from a visual perspective of the user.

8. The HMD of claim 1 , wherein the at least one virtual display is presented on the see-through display as an additional object that is superimposed over the physical display in the real-world scene from a visual perspective of the user.

9. A computer-implemented method, comprising:
generating, with a Head Mounted Display (HMD), at least one virtual display;
presenting the at least one virtual display on the HMD, wherein the HMD is configured to enable a user to view the at least one virtual display and a physical display in a real-world scene, wherein the at least one virtual display is presented on the HMD as an additional object in the real-world scene, and wherein the at least one virtual display is used in conjunction with the physical display to present a first computer-generated information in a first extended desktop from a visual perspective of the user, the first extended desktop comprising a first portion assigned to the physical display and a second portion assigned to the at least one virtual display;
determining if the physical display is in a field of vision of the HMD; and
presenting the first computer-generated information in a second extended desktop comprising a third portion assigned to the at least one virtual display that represents the first portion, if the physical display is not in the field of vision of the HMD to continue viewing the first computer-generated information after the removal of physical display from the field of vision.

10. The computer-implemented method of claim 9 , wherein the first computer-generated information is presented in the first extended desktop while the physical display is in a field of vision of the HMD.

11. The computer-implemented method of claim 9 , further comprising:
determining a position of the head mounted display;
determining a location of the physical display based on at least the determined position of the head mounted display;
determining a surface position and a screen area of the physical display based on at least the determined location of the physical display; and
providing the determined position of the head mounted display, the determined location of the physical display, the determined surface position of the physical display, and the determined screen area of the physical display to the HMD.

12. The computer-implemented method of claim 11 , further comprising:
re-determining the position of the head mounted display, the location of the physical display, the surface position of the physical display, and the screen area of the physical display in response to at least one of
a physical movement of the physical display,
a physical movement of the HMD, and
an amount of time elapsed from at least one of a previous determination of the position of the HIVID, a previous determination of the location of the physical display, a previous determination of the surface position of the physical display, and a previous determination screen area of the physical display.

13. The computer-implemented method of claim 11 , wherein the determining the location of the physical display further includes determining each angle between each vertex of the physical display, and wherein at least one of the surface position and the screen area of the

Assignees

• Intel Corp
• Giwnewer Yair
• Rider Tomer
• Ron Aviv
• Kiveisha Yevgeniy
• Jiang Minghao

Inventors

• Giwnewer Yair
• Rider Tomer
• Ron Aviv
• Kiveisha Yevgeniy
• Jiang Minghao

Classifications

• G06F3/012

  Head tracking input arrangements · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B27/02

  Viewing or reading apparatus (stereoscopic systems G02B30/00) · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title