Systems and methods for configuring a hub-centric virtual/augmented reality environment

Patent metadata

Field	Value
Publication number	US-11487353-B2
Application number	US-202017139666-A
Country	US
Kind code	B2
Filing date	Dec 31, 2020
Priority date	Nov 14, 2016
Publication date	Nov 1, 2022
Grant date	Nov 1, 2022

Abstract

In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.

First claim

What is claimed is:

1. A hub device for determining a virtual workstation for use with a virtual environment, comprising:
a transceiver configured to communicate with a display system for presenting a virtual reality or augmented reality environment to a user;
one or more sensors configured to detect aspects of a physical environment in proximity to the hub device; and
one or more processors configured to:
determine, via the one or more sensors, the aspects of the physical environment in proximity to the hub device;
based on determining the aspects of the physical environment, defining one or more zones for the user to interact with a physical peripheral input device and a virtual display provided by the display system; and
transmit, via the transceiver, to the display system, information indicative of the one or more zones,

wherein the one or more zones include a first zone that defines an area characterized in that the physical peripheral input device placed within the first zone is used by a first user to interact with one or more virtual displays rendered by the display system,
wherein the one or more zones further includes a second zone characterized in that a virtual display can be perceived by the first user as being located within the second zone and interaction with a physical peripheral device within the first zone modifies content observable by the first user rendered on the virtual display within the second zone,
wherein the one or more zones further includes a third zone characterized in that content displayed within the third zone is viewable by a plurality of users interacting within an augmented reality or virtual reality virtual environment, and
wherein content displayed within the second zone is viewable by only the first user of the plurality of users.

2. The hub device of claim 1 , wherein the display system is a head-mounted display (HMD).

3. The hub device of claim 1 , wherein the content displayed within the second zone is viewably by the plurality of users when moved to the third zone.

4. The hub device of claim 1 , wherein the content displayed within the third zone remains unmoved as the physical peripheral input device placed within the first zone is moved causing the content displayed within the second zone to move as well.

5. The hub device of claim 1 , wherein the content displayed within the third zone includes the one or more virtual displays, and when the physical peripheral input device is lifted by the first user the one or more virtual displays are collapsed.

6. The hub device of claim 5 , wherein the one or more virtual displays are expanded when the physical peripheral input device returns from being lifted to an approved location.

7. A system comprising:
one or more processors;
one or more non-transitory computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations including:
communicating, via a transceiver, with a display system for presenting a virtual reality or augmented reality virtual environment to a user;
detecting and determining, via one or more sensors, aspects of a physical environment in proximity to a hub device;
defining, based on determining the aspects of the physical environment, one or more zones for the user to interact with a physical peripheral input device and a virtual display provided by a display system; and
transmitting to the display system, via the transceiver, information indicative of the one or more zones,
wherein the one or more zones include a first zone that defines an area characterized in that the physical peripheral input device placed within the first zone is used by a first user to interact with one or more virtual displays rendered by the display system,
wherein the one or more zones further includes a second zone characterized in that a virtual display can be perceived by the first user as being located within the second zone and interaction with a physical peripheral device within the first zone modifies content observable by the first user rendered on the virtual display within the second zone,
wherein the one or more zones further includes a third zone characterized in that content displayed within the third zone is viewable by a plurality of users interacting within an augmented reality or virtual reality virtual environment, and
wherein content displayed within the second zone is viewable by only the first user of the plurality of users.

8. The system of claim 7 , wherein the display system is a head-mounted display (HMD).

9. The system of claim 7 , wherein the content displayed within the second zone is viewably by the plurality of users when moved to the third zone.

10. The system of claim 7 , wherein the content displayed within the third zone remains unmoved as the physical peripheral input device placed within the first zone is moved causing the content displayed within the second zone to move as well.

11. The system of claim 7 , wherein the content displayed within the third zone includes the one or more virtual displays, and when the physical peripheral input device is lifted by the first user the one or more virtual displays are collapsed.

12. The system of claim 11 , wherein the one or more virtual displays are expanded when the physical peripheral input device returns from being lifted to an approved location.

13. A method for determining a virtual workstation for use with a virtual environment, the method comprising:
communicating, via a transceiver, with a display system for presenting a virtual reality or augmented reality virtual environment to a user;
detecting and determining, via one or more sensors, aspects of a physical environment in proximity to a hub device;
defining, based on determining the aspects of the physical environment, one or more zones for the user to interact with a physical peripheral input device and a virtual display provided by a display system; and
transmitting to the display system, via the transceiver, information indicative of the one or more zones,
wherein the one or more zones include a first zone that defines an area characterized in that the physical peripheral input device placed within the first zone is used by a first user to interact with one or more virtual displays rendered by the display system,
wherein the one or more zones further includes a second zone characterized in that a virtual display can be perceived by the first user as being located within the second zone and interaction with a physical peripheral device within the first zone modifies content observable by the first user rendered on the virtual display within the second zone,
wherein the one or more zones further includes a third zone characterized in that content displayed within the third zone is viewable by a plurality of users interacting within an augmented reality or virtual reality virtual environment, and
wherein content displayed within the second zone is viewable by only the first user of the plurality of users.

14. The method of claim 13 , wherein the display system is a head-mounted display (HMD).

15. The method of claim 13 , wherein the content displayed within the second zone is viewably by the plurality of users when moved to the third zone.

16. The method of claim 13 , wherein the content displayed within the third zone remains unmoved as the physical peripheral input device placed within the first zone is moved causing the content displayed within the second zone to move as well.

17. The method of claim 13 , wherein the content displayed within the third zone includes

Assignees

• Logitech Europe Sa

Inventors

• Harvey Stephen
• O'Keeffe Denis
• Connellan Andreas
• O'Sullivan Damien
• Kehoe Aidan
• Curran Noirin
• Rouvinez Thomas
• Gutierrez Mario
• Riviere Olivier
• Zimmermann Remy
• Meisser Mathieu
• Onorio Dennin
• Trotman Ciaran
• O'Bradaigh Pierce
• Twohig Marcel
• Murphy Padraig
• Ahern Jerry

Classifications

• G06F3/038

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0426

  tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886) · CPC title