Augmented reality information prompting system, display control method, equipment and medium

Patent metadata

Field	Value
Publication number	US-11703945-B2
Application number	US-202117459271-A
Country	US
Kind code	B2
Filing date	Aug 27, 2021
Priority date	Nov 19, 2020
Publication date	Jul 18, 2023
Grant date	Jul 18, 2023

Abstract

The present disclosure provides an augmented reality information prompting system, including: a head pose detector to detect a user's head pose to generate head pose data; an operation control device to generate operation control data based on the user's operation; and a processor to receive the head pose data from the head pose detector and generate a first display control instruction based on the head pose data, and to receive the operation control data from the operation control device and generate a second display control instruction based on the operation control data; an augmented reality display configured to receive the first and second display control instructions from the processor, and to operate prompt information based on the first and second display control instructions. The present disclosure further relates to a display control method used for the system, as well as an electronic equipment and a non-transitory computer-readable storage medium.

First claim

What is claimed is:

1. An augmented reality information prompting system comprising a smart phone and a head-mounted display equipment, wherein:
the smart phone comprises:
an operation control device configured to generate operation control data based on the user's operation;
a processor configured to receive head pose data and generate a first display control instruction based on the head pose data, and to receive the operation control data from the operation control device and generate a second display control instruction based on the operation control data,

the head-mounted display equipment comprises:
a head pose detector configured to detect a user's head pose to generate the head pose data;
an augmented reality display configured to receive the first display control instruction and the second display control instruction from the processor, and to operate the prompt information based on the first display control instruction and the second display control instruction,

wherein the processor is also configured to collect and analyze the user's operating habit data, and to determine a content display angle range for the prompt information based on the user's operating habit data, and
wherein the augmented reality information prompting system is used for providing prompt information to a user during a speech.

2. The augmented reality information prompting system according to claim 1 , wherein the head pose detector comprises an inertial measurement unit.

3. The augmented reality information prompting system according to claim 1 , wherein the processor determines the user's head rotation angle value based on the head pose data, and when the head rotation angle value is within the content display angle range, the first display control instruction instructs the augmented reality display to display the prompt information.

4. The augmented reality information prompting system according to claim 3 , wherein the first display control instruction instructs the augmented reality display to suspend display when the head rotation angle value is outside the content display angle range.

5. The augmented reality information prompting system according to claim 1 , wherein the second display control instruction instructs the augmented reality display to perform a page turning operation on the prompt information.

6. The augmented reality information prompting system according to claim 1 , wherein the operation control device comprises one or more buttons of the smart phone, and is configured to receive input data of the user to generate the operation control data.

7. The augmented reality information prompting system according to claim 1 , wherein the operation control device comprises a touch screen of the smart phone, and the touch screen is configured to display a prompt information operation interface for receiving input data of the user to generate the operation control data.

8. The augmented reality information prompting system according to claim 2 , further comprising a control handle, wherein the operation control device is configured to receive data from the control handle to generate the operation control data.

9. The augmented reality information prompting system according to claim 1 , wherein the smart phone comprises a display screen, and when the augmented reality display displays the prompt information, the display screen of the smart phone displays content that is different from the prompt information or suspends display.

10. A display control method for controlling the augmented reality information prompting system according to claim 1 , comprising the following steps:
generating the head pose data based on the user's head pose by the head pose detector of the head-mounted display equipment;
generating the operation control data based on the user's operation by the processor of the smart phone;
generating the first display control instruction based on the head pose data by the processor of the smart phone;
generating the second display control instruction based on the operation control data by the processor of the smart phone;
operating the prompt information based on the first display control instruction and the second display control instruction by the augmented reality display of the head-mounted display equipment;
collecting and analyzing the user's operating habit data;
determining the content display angle range based on the user's operating habit data.

11. The display control method according to claim 10 , wherein the step of generating the first display control instruction based on the head pose data by the processor of the smart phone comprises:
determining the user's head rotation angle value based on the head pose data;
generating the first display control instruction based on the head rotation angle value.

12. The display control method according to claim 11 , wherein:
when the head rotation angle value is within the content display angle range, the first display control instruction instructs the augmented reality display to display the prompt information;
when the head rotation angle value is outside the content display angle range, the first display control instruction instructs the augmented reality display to suspend display.

13. The display control method according to claim 10 , wherein the step of generating the operation control data based on the user's operation by the processor of the smart phone comprises:
generating the operation control data based on the user's gesture.

14. The display control method according to claim 10 , wherein the step of generating the operation control data based on the user's operation by the processor of the smart phone comprises:
generating the operation control data based on input data of the user.

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Fan Qingwen
• Miao Jinghua
• Hao Shuai
• Zheng Chao
• Zhang Hao
• Chen Lili

Classifications

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06F3/0483

  Interaction with page-structured environments, e.g. book metaphor · CPC title

• H04M1/72412

  using two-way short-range wireless interfaces · CPC title