Augmented reality screen system and augmented reality screen display method

Patent metadata

Field	Value
Publication number	US-11328493-B2
Application number	US-202117183488-A
Country	US
Kind code	B2
Filing date	Feb 24, 2021
Priority date	Aug 10, 2020
Publication date	May 10, 2022
Grant date	May 10, 2022

Abstract

An augmented reality screen system includes an augmented reality device and a host. The augmented reality device is configured to take a physical mark through a camera. The host is configured to receive the physical mark, determine position information and rotation information of the physical mark, and fetch a virtual image from a storage device through a processor of the host. The processor transmits an adjusted virtual image to the augmented reality device according to the position information and the rotation information, and the augmentation device projects the adjusted virtual image to a display of the augmented reality device. The adjusted virtual image becomes a virtual extended screen, and the virtual extended screen and the physical mark are simultaneously displayed on the display of the augmented reality device.

First claim

What is claimed is:

1. An augmented reality screen system, comprising:
an augmented reality device, configured to take a physical mark through a camera; and
a host, configured to receive the physical mark, determine position information and rotation information of the physical mark, and fetch a virtual image from a storage device through a processor of the host;
wherein the processor transmits an adjusted virtual image to the augmented reality device according to the position information and the rotation information, and the augmented reality device projects the adjusted virtual image to a display of the augmented reality device, the adjusted virtual image becomes a virtual extended screen, and the virtual extended screen and the physical mark are simultaneously displayed on the display of the augmented reality device.

2. The augmented reality screen system of claim 1 , wherein the processor executes a tracking algorithm to detect the position information and the rotation information of the physical mark.

3. The augmented reality screen system of claim 1 , wherein the processor uses a position projection algorithm to calculate target coordinates of each pixel of the virtual image projected to the display of the augmented reality device using the position projection algorithm to adjust the virtual image.

4. The augmented reality screen system of claim 1 , wherein the processor captures a field-of-view (FOV) range in a frame captured by the camera, selects a reference point from the field-of-view range, moves the reference point to a boundary in the frame, captures a first specific range of the field-of-view range in the frame, zooms in the first specific range to match the resolution of a physical display coupled to the host, moves the reference point to target coordinates on the display of the augmented reality device, captures a second specific range of the field of view in the frame, and matches a designated pixel of the second specific range to a designated position of the physical mark, so that the second specific area of the frame becomes the virtual extended screen.

5. The augmented reality screen system of claim 4 , wherein the processor adjusts the second specific range according to the position information and the rotation information, and regards the adjusted second specific range as the virtual extended screen, the processor obtains an extension direction from the physical mark, the extension direction is transmitted to the augmented reality device, and the augmented reality device displays the virtual extended screen on the display of the augmented reality device according to the physical mark and the extension direction.

6. An augmented reality screen display method, comprising:
taking a physical mark through a camera of an augmented reality device;
receiving the physical mark;
determining position information and rotation information of the physical mark; and
fetching a virtual image from a storage device through a processor of a host;
wherein the processor transmits an adjusted virtual image to the augmented reality device according to the position information and the rotation information, and the augmented reality device projects the adjusted virtual image to a display of the augmented reality device, the adjusted virtual image becomes a virtual extended screen, and the virtual extended screen and the physical mark are simultaneously displayed on the display of the augmented reality device.

7. The augmented reality screen display method of claim 6 , further comprising:
executing, by the processor, a tracking algorithm to detect the position information and the rotation information of the physical mark.

8. The augmented reality screen display method of claim 6 , further comprising calculating, by the processor, target coordinates of each pixel of the virtual image projected to the display of the augmented reality device using the position projection algorithm to adjust the virtual image.

9. The augmented reality screen display method of claim 6 , further comprising:
capturing a field-of-view (FOV) range in a frame captured by the camera;
selecting, by the processor, a reference point from the field-of-view range;
moving, by the processor, the reference point to a boundary in the frame;
capturing, by the processor, a first specific range of the field-of-view range in the frame;
zooming, by the processor, in the first specific range to match the resolution of a physical display coupled to the host, and moving the reference point to target coordinates on the display of the augmented reality device;
capturing, by the processor, a second specific range of the field of view in the frame;
matching, by the processor, a designated pixel of the second specific range to a designated position of the physical mark, so that the second specific area of the frame becomes the virtual extended screen; and
displaying, by the processor, the virtual extended screen and the physical mark simultaneously on the display of the augmented reality device.

10. The augmented reality screen display method of claim 9 , further comprising:
adjusting, by the processor, the second specific range according to the position information and the rotation information, and regarding the adjusted second specific range as the virtual extended screen;
obtaining, by the processor, an extension direction from the physical mark; and
displaying the virtual extended screen on the display of the augmented reality device according to the physical mark and the extension direction.

Assignees

• Acer Inc

Inventors

• Tzeng Huei-Ping
• Yang Chao-Kuang
• Hsu Wen-Cheng
• Huang Chih-Wen
• Tan Chih-Haw

Classifications

• G06T15/20

  Perspective computation · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T2207/30204

  Marker · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title