Augmented reality information prompting system, display control method, equipment and medium

Patent metadata

Field	Value
Publication number	US-2022155853-A1
Application number	US-202117459271-A
Country	US
Kind code	A1
Filing date	Aug 27, 2021
Priority date	Nov 19, 2020
Publication date	May 19, 2022
Grant date	—

Abstract

The present disclosure provides an augmented reality information prompting system, including: a head pose detector to detect a user's head pose to generate head pose data; an operation control device to generate operation control data based on the user's operation; and a processor to receive the head pose data from the head pose detector and generate a first display control instruction based on the head pose data, and to receive the operation control data from the operation control device and generate a second display control instruction based on the operation control data; an augmented reality display configured to receive the first and second display control instructions from the processor, and to operate prompt information based on the first and second display control instructions. The present disclosure further relates to a display control method used for the system, as well as an electronic equipment and a non-transitory computer-readable storage medium.

First claim

What is claimed is:

1 . An augmented reality information prompting system, comprising:
a head pose detector configured to detect a user's head pose to generate head pose data; an operation control device configured to generate operation control data based on the user's operation; a processor configured to receive the head pose data from the head pose detector and generate a first display control instruction based on the head pose data, and to receive the operation control data from the operation control device and generate a second display control instruction based on the operation control data; an augmented reality display configured to receive the first display control instruction and the second display control instruction from the processor, and to operate prompt information based on the first display control instruction and the second display control instruction.

2 . The augmented reality information prompting system according to claim 1 , wherein the head pose detector comprises an inertial measurement unit.

3 . The augmented reality information prompting system according to claim 1 , wherein the processor determines the user's head rotation angle value based on the head pose data, and when the head rotation angle value is within a predetermined range, the first display control instruction instructs the augmented reality display to display the prompt information.

4 . The augmented reality information prompting system according to claim 3 , wherein the first display control instruction instructs the augmented reality display to suspend display when the head rotation angle value is outside the predetermined range.

5 . The augmented reality information prompting system according to claim 1 , wherein the second display control instruction instructs the augmented reality display to perform a page turning operation on the prompt information.

6 . The augmented reality information prompting system according to claim 2 , comprising a head-mounted display equipment, wherein the head-mounted display equipment comprises the head pose detector, the operation control device, the processor and the augmented reality display, and wherein the operation control device is further configured to detect a gesture of the user to generate the operation control data.

7 . The augmented reality information prompting system according to claim 2 , comprising a head-mounted display equipment and a control handle, wherein the head-mounted display equipment comprises the head pose detector, the processor and the augmented reality display, the control handle comprises the operation control device, and wherein the operation control device is configured to receive input data of the user to generate the operation control data.

8 . The augmented reality information prompting system according to claim 2 , comprising a head-mounted display equipment and a mobile equipment, wherein the head-mounted display equipment comprises the head pose detector and the augmented reality display, and the mobile equipment comprises the operation control device and the processor.

9 . The augmented reality information prompting system according to claim 8 , wherein the operation control device comprises one or more buttons of the mobile equipment, and is configured to receive input data of the user to generate the operation control data.

10 . The augmented reality information prompting system according to claim 8 , wherein the operation control device comprises a touch screen of the mobile equipment, and the touch screen is configured to display a prompt information operation interface for receiving input data of the user to generate the operation control data.

11 . The augmented reality information prompting system according to claim 2 , comprising a head-mounted display equipment, a mobile equipment and a control handle, wherein the head-mounted display equipment comprises the head pose detector and the augmented reality display, the mobile equipment comprises the processor, the control handle comprises the operation control device, and wherein the operation control device is configured to receive input data of the user to generate the operation control data.

12 . The augmented reality information prompting system according to claim 8 , wherein the mobile equipment comprises a display screen, and when the augmented reality display displays the prompt information, the display screen of the mobile equipment displays content that is different from the prompt information or suspends display.

13 . A display control method for controlling the augmented reality information prompting system according to claim 1 , comprising the following steps:
generating the head pose data based on the user's head pose; generating the operation control data based on the user's operation; generating the first display control instruction based on the head pose data; generating the second display control instruction based on the operation control data; operating the prompt information based on the first display control instruction and the second display control instruction.

14 . The display control method according to claim 13 , wherein the step of generating the first display control instruction based on the head pose data comprises:
determining the user's head rotation angle value based on the head pose data; generating the first display control instruction based on the head rotation angle value.

15 . The display control method according to claim 14 , wherein:
when the head rotation angle value is within a predetermined range, the first display control instruction instructs the augmented reality display to display the prompt information; when the head rotation angle value is outside the predetermined range, the first display control instruction instructs the augmented reality display to suspend display.

16 . The display control method according to claim 13 , wherein the step of generating the operation control data based on the user's operation comprises:
generating the operation control data based on the user's gesture.

17 . The display control method according to claim 13 , wherein the step of generating the operation control data based on the user's operation comprises:
generating the operation control data based on input data of the user.

18 . An electronic equipment comprising a memory, a processor, and a computer program stored in the memory and capable of being run in the processor, and the computer program, when run by the processor, implements the display control method according to claim 13 .

19 . A non-transitory computer-readable storage medium on which a computer program is stored, the computer program, when run by a processor, implements the display control method according to claim 13 .

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Fan Qingwen
• Miao Jinghua
• Hao Shuai
• Zheng Chao
• Zhang Hao
• Chen Lili

Classifications

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/0485

  Scrolling or panning · CPC title